indication of responsibility for audio playback

By temporarily adjusting the spatial characteristics of the audio content, it solves the confusion of users in determining the playback device in a multi-device environment, achieves clear indication of device responsibility, avoids the troubles of privacy leakage and connection interruption, and reduces interference with the actual sound experience.

CN114816316BActive Publication Date: 2025-10-10NOKIA TECHNOLOGIES OY
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210053963.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-01-19
Filing Date
2022-01-18
Publication Date
2025-10-10
Estimated Expiration
2042-01-18

AI Technical Summary

Technical Problem

When multiple audio playback devices are connected, it is difficult for users to determine which device is responsible for playing the audio content, leading to confusion, privacy leakage, unintentional public playback, and unnoticed connection interruptions.

Method used

Temporarily adjusts the presentation of audio content to provide a user-perceivable indication of the responsible playback device by exploiting spatial characteristics that cannot be reproduced by other audio playback devices connected to the user device.

Benefits of technology

Users can clearly know which device is responsible for playing back the audio content, maintain privacy, avoid unintentional public playback, and promptly detect connection interruptions, reducing interference with the actual sound experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114816316B_ABST
    Figure CN114816316B_ABST
Patent Text Reader

Abstract

According to various but not necessarily all embodiments, an apparatus is provided comprising means for causing a user perceptible indication that an audio playback device is responsible for playing back audio content received from a user device by temporarily rendering the audio content with at least one spatial characteristic that cannot be reproduced by at least one other audio playback device connected to the user device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001]

[0014] Embodiments of the present disclosure relate to indication of responsibility for causing audio playback.Some embodiments relate to indication of responsibility for causing audio playback when multiple audio playback devices are connected to a user device from which audio content is received. Background Art

[0002] When responsibility for audio content playback is switched between audio playback devices, the newly responsible audio playback device may play a guidance sound, such as a beep or voice prompt, that is unrelated to the audio content it is responsible for playing back.

[0003] Some audio playback devices are capable of spatial audio reproduction, which places sound sources in three-dimensional space with the intention that listeners hear specific sounds coming from specific directions.

[0004] Spatial audio reproduction can be performed for audio content formatted as, for example, metadata-assisted spatial audio (MASA), object-based audio, channel-based audio (e.g., 5.1 or 7.1+4), non-parametric scene-based audio (e.g., first-order mixes, higher-order mixes), or a combination of these formats. Audio content in these formats can be spatialized for the user using a spatial audio codec such as the Immersive Voice and Audio Services (IVAS) and a suitable renderer (e.g., the IVAS internal renderer). For headphone listening, spatialization includes binauralization. Summary of the Invention

[0005] According to various, but not necessarily all, embodiments, an apparatus is provided that includes means for temporarily presenting audio content by utilizing at least one spatial characteristic that cannot be reproduced by at least one other audio playback device connected to a user device, causing a user-perceivable indication that the audio playback device is responsible for playback of the audio content received from the user device.

[0006] According to various, but not necessarily all, embodiments, a method is provided that includes causing a user-perceivable indication that an audio playback device is responsible for playback of audio content received from a user device by temporarily presenting the audio content using at least one spatial characteristic that is not reproducible by at least one other audio playback device connected to the user device.

[0007] According to various, but not necessarily all, embodiments, a computer program is provided that, when executed on a computer, performs: causing a user-perceivable indication that an audio playback device is responsible for playback of audio content received from a user device by temporarily rendering audio content utilizing at least one spatial characteristic that is not reproducible by at least one other audio playback device connected to the user device.

[0008] The following section of the “SUMMARY” describes various features, which can be features of any of the embodiments described in the preceding section of the “SUMMARY”. Additionally, descriptions of functionality should be considered as equally applicable to corresponding computer-readable instructions or code structures, and vice versa.

[0009] Temporarily rendering the audio content with the at least one spatial characteristic can include temporarily adjusting the rendering of the audio content such that the audio content is rendered with the at least one spatial characteristic.

[0010] Temporarily rendering the audio content with the at least one spatial characteristic can include temporarily modifying the audio content such that the audio content has the at least one spatial characteristic.

[0011] Temporarily rendering the audio content with the at least one spatial characteristic can be configured to increase energy that a user will perceive to originate from at least one direction away from the at least one other audio playback device relative to energy that the user will perceive to originate from one or more directions corresponding to one or more locations of the at least one other audio playback device.

[0012] The at least one direction away from the at least one other audio playback device can be a direction in which there are no real sound sources associated with the at least one other audio playback device and no possible virtual sound sources associated with the at least one other audio playback device.

[0013] Temporarily rendering the audio content with the at least one spatial characteristic can include causing a higher-than-threshold amount of total energy of the audio content to be directed into at least one direction away from the at least one other audio playback device.

[0014] The user-perceivable indication can be discontinued after directing a higher-than-threshold amount of total energy of the audio content into two or more consecutive directions, at least one of the two or more consecutive directions being the at least one direction away from the at least one other audio playback device.

[0015] Temporarily rendering the audio content with the at least one spatial characteristic can include repositioning one or more audio objects into the at least one direction away from the at least one other audio playback device.

[0016] Temporarily rendering the audio content with the at least one spatial characteristic can include converting at least one diffuse component of the audio content into directional audio in the at least one direction away from the at least one other audio playback device.

[0017] Temporarily rendering the audio content with the at least one spatial characteristic can include converting at least one directional component of the audio content in a direction corresponding to a location of another audio playback device into diffuse audio.

[0018] Temporarily rendering the audio content with the at least one spatial characteristic can comprise reducing an energy of at least one directional component of the audio content in a direction corresponding to a location of the at least one other audio playback device, and / or increasing an energy of at least one directional component of the audio content in at least one direction away from the at least one other audio playback device.

[0019] Temporarily rendering the audio content with the at least one spatial characteristic can comprise rendering spatial audio components in mono or stereo format.

[0020] Temporarily rendering the audio content with the at least one spatial characteristic can be in response to a change in responsibility for playback of the audio content among audio playback devices connected to the user device.

[0021] Temporarily rendering the audio content with the at least one spatial characteristic can be in response to a user request for confirmation that an audio playback device is responsible for playback of the audio content.

[0022] Components of the audio content that are marked in associated metadata as not to be modified can not be modified.

[0023] According to various but not necessarily all embodiments, examples are provided as claimed in the appended claims. The scope of the protection of various embodiments of the invention is given by the independent claims. Examples described in this specification and depending on the independent claims are to be interpreted as examples useful for understanding the inventive concept and the advantages of various embodiments of the invention. It is understood that various features described and / or illustrated herein can be used separately or in any combination. BRIEF DESCRIPTION OF DRAWINGS

[0024] Some examples will now be described, by way of example, with reference to the accompanying drawings, in which:

[0025] Figure 1A , Figure 1B An example of the subject matter described herein is shown;

[0026] Figure 2 Another example of the subject matter described herein is shown;

[0027] Figure 3 An example method described herein is shown;

[0028] Figure 4 An example of the subject matter described herein is shown;

[0029] Figure 5 Another example method described herein is shown;

[0030] Figure 6 An example of the subject matter described herein is shown;

[0031] Figure 7 An example of the subject matter described herein is shown;

[0032] Figure 8 An example of the subject matter described herein is shown;

[0033] Figure 9 An example of the subject matter described herein is shown;

[0034] Figure 10 An example of the subject matter described herein is shown;

[0035] Figure 11 An example of the subject matter described herein is shown;

[0036] Figure 12 An example of the subject matter described herein is shown;

[0037] Figure 13 An example of the subject matter described herein is shown;

[0038] Figure 14 An example of the subject matter described herein is shown;

[0039] Figure 15A 、 Figure 15B illustrates an example of the subject matter described herein; and

[0040] Figure 16 An example apparatus described herein is shown. DETAILED DESCRIPTION

[0041] The following description describes an apparatus, method, and computer program for indicating to a user 1 that an audio playback device 3 is responsible for playing back the audio content they hear. Specifically, this is achieved by temporarily presenting the audio content using at least one spatial characteristic that can be associated with the audio playback device 3 by the user 1.

[0042] The audio playback device 3 is any device that can convert audio—an electrical signal (digital or analog) representing sound—into sound—a pressure wave that propagates through a medium. Audio content is information that, once converted into sound, can be heard by the user 1. Playing back audio content involves converting the audio content into sound so that the user 1 can hear the information.

[0043] Figure 1A and Figure 1B Illustrated is an example of a situation where there are two audio playback devices 3, 7 in the vicinity of a user 1. In this example, the user is wearing headphones 3 and holding a user device 5 with an integrated speaker 7. The user device may be an electronic communication device.

[0044] If the audio consists of non-spatial (head-locked) audio, the user 1 is able to determine which audio playback device—the headphones 3 or the integrated speakers 7—is responsible for playback by moving their head relative to the user device 5. If the headphones 3 are responsible for playback, the apparent sound source 9 of the audio content will appear to move with the user's head, whereas if the integrated speakers 7 are responsible for playback, the apparent sound source 9 of the audio content will not move with the user's head.

[0045] Of course, there may be multiple apparent sound sources of the audio content, each corresponding to a different component of the audio content. In this case, when played back via headphones 3, each of the multiple apparent sound sources will appear to move in unison with the user's head, but this will not be observed when played back via integrated speakers 7.

[0046] On the other hand, if the audio includes at least some spatial audio components, the user 1 cannot determine which audio playback device—the headphones 3 or the integrated speakers 7—is responsible for playback by moving their head relative to the user device 5. Regardless of whether the headphones 3 or the integrated speakers 7 are responsible for playing back the audio content heard by the user 1, the apparent sound source 9 of the audio content, or at least some components thereof, will not move. Consequently, the user 1 may be confused as to which audio playback device 3, 7 is responsible for playing back the audio content they hear.

[0047] In some examples where audio content accompanies visual content, the majority of the audio content (e.g., the main dialogue) may be reproduced from the direction in which the visual content is displayed. This may be at the user device 5 and therefore generally in the same direction as the integrated speaker 7. This may lead the user 1 to believe that the integrated speaker 7 is responsible for playing back the audio content they hear, even when in fact the headphones 3 are responsible for playback.

[0048] When there are more audio playback devices near user 1, it may be more difficult for user 1 to determine which audio playback device near them is responsible for playing back the audio content they hear. Figure 2 An example of a situation where there are more than two audio playback devices is shown. Figure 2 In the embodiment, the user not only wears the earphones 3 but also holds a headset with an integrated speaker 7 (such as Figure 1A and Figure 1BIn the example embodiment, user 1 has a user device 5 (e.g., in the same room as user 1) and a speaker system 11 in the same room as user 1, which can be used to play back audio content. Speaker system 11 can be more capable of reproducing spatial audio effects or a wider variety of spatial audio effects than integrated speaker 7. Thus, even if a significant amount of audio content is not being reproduced from the direction of user device 5 (e.g., where accompanying visual content can be displayed), it can still be difficult for user 1 to determine which of speaker system 11 and headphones 3 is responsible for the playback of the audio content. For example, the apparent proximity of sound source 13 to speaker system 11 can be the result of playback being performed by headphones 3 or speaker system 11.

[0049] It will be appreciated that if the majority of the audio content is reproduced from the direction of the user device 5—as in the case where the audio content comprises dialogue accompanying visual content displayed on the user device 5—then it may be difficult for the user 1 to distinguish even between playback by the speaker system 11 and playback by the integrated speaker 7 of the user device 5. For example, the location of the apparent sound source 15 close to the user device 5 may be the result of playback by the earphones 3, the integrated speaker 7, or the speaker system 11. Thus, the problem is not limited to determining whether the earphones 3 are responsible for playback; rather, the problem is relevant to all audio playback devices 3, 7, 11.

[0050] If user 1 cannot easily determine which audio playback device 3, 7, 11 in their vicinity is responsible for playing back the audio content they hear, there are several disadvantages for user 1. For example: user 1 may become confused; user 1 may inadvertently allow playback of private (e.g., confidential, embarrassing, etc.) audio content, such as a private communication call, in a public manner; user 1 may inadvertently disturb others nearby with the public playback of audio content; user 1 may not realize that the wireless connection between user device 5 and other devices, such as audio playback device 3, has been dropped because, in some cases, playback will resume uninterrupted via the integrated speaker 7 of user device 5; user 1 may be frustrated or distracted by perceived non-responsiveness of audio playback device 3 to adjustments (e.g., volume, etc.), without realizing that the perceived non-responsiveness is due to the audio playback device 3 not being responsible for playing back the audio content they hear.

[0051] Figure 3 Illustrated is an example of a method 100 for enabling a user 1 to determine that an audio playback device 3 is responsible for playing back audio content that they hear.

[0052] In block 110, the audio playback device 3 is caused to play back the audio content. The audio playback device 3 receives the audio content from the user device 5, where the user 1 can control the audio content to be played back. This can involve selecting a media file stored at the user device 5 or remotely and accessed via the user device 5. The user device 5 can also be configured to enable the user 1 to control which audio playback device 3, 7, 11 connected to the user device 5 should play back the audio content. In this case, connection means that data exchange between the devices is enabled. This data exchange can be carried out via a wired or wireless link.

[0053] The method 100 includes temporarily presenting audio content by utilizing at least one spatial characteristic that cannot be reproduced by at least one other audio playback device 7, 11 connected to the user device 5, causing the audio playback device 3 to be responsible for playing back a user-perceivable indication of the audio content received from the user device 5, as shown in box 120.

[0054] Thus, the resulting user-perceivable indication, although audible in form, is not necessarily a sound that diverges from the sound desired by user 1, but rather may be an undesired spatialization of the desired sound. At least one spatial characteristic may be applied to existing information recorded in the audio content so that, within the sound scene perceived by user 1, this information appears to be misplaced. The user-perceivable indication does not attempt to recreate for user 1 a realistic sound experience as intended by the original composer of the audio content, but rather provides a deviation therefrom. In this way, user 1 may perceive that the sound has been altered in a way that would not or could not be reproduced by another audio playback device 7, 11 connected to user device 5, other than the audio playback device 3 actually responsible for playback.

[0055] The user-perceivable indication may be an indication that the audio playback device 3 is newly responsible for playing back the audio content, e.g., responsibility for playback has just changed from another audio playback device 7, 11 to the audio playback device 3 based on a user selection communicated to the user device 5. Thus, in some examples, the method 100 includes temporarily presenting the audio content using the at least one spatial characteristic in response to a change in responsibility for playing back the audio content among the audio playback devices 3, 7, 11 connected to the user device 5.

[0056] Alternatively, the user-perceivable indication may be an indication that the audio playback device 3 has taken, and remains in, charge of playing back the audio content. Thus, in some examples, method 100 includes, in response to a user request to confirm that the audio playback device 3 is in charge of playing back the audio content, temporarily presenting the audio content using at least one spatial characteristic. The user request for confirmation may include, for example, Figure 4. As illustrated, the predetermined gesture 17 may include cupping one or both of the user's ears and any earphone speakers they are wearing with one or both hands. Such a gesture 17 may be intuitive, reflecting an action taken by the user 1 to block out unwanted sound. If the user 1 is wearing headphones 3, they may be adapted to detect the gesture 17. For example, the headphones 3 may include sensors for detecting the blocking gesture 17. The user-perceivable indication may persist for the time that the user 1 performs the gesture 17.

[0057] Return to Figure 3 As discussed above, in some examples, one or more other audio playback devices 7, 11 connected to the user device 5 and having different spatial audio capabilities are unable to reproduce at least one spatial characteristic of the temporarily presented audio content. For example, where the audio playback device 3 has the capability to produce full-sound surround sound and the one or more other audio playback devices 7, 11 are limited to multi-planar surround sound, the at least one spatial characteristic may be audio content having apparent sound sources 9 at locations outside of a plane such as above the user's head. In another example, where the one or more other audio playback devices 7, 11 are capable of full-sound surround sound, the at least one spatial characteristic may be head-internalisation of the apparent sound sources 9 of the audio content as perceived by presenting the audio content in a mono or stereo format.

[0058] The distinctiveness of the at least one spatial characteristic may not be limited to considering only the one or more other audio playback devices 7, 11 connected to the user device 5. In some examples, the at least one spatial characteristic may be a spatial characteristic that is not otherwise reproducible by other nearby audio playback devices, or at least those nearby audio playback devices that were previously connected to the user device 5. Nearby may be understood as being in the same room or in another common acoustic environment.

[0059] Because the user-perceivable indication is temporary, playback of the audio content continues thereafter per block 130 .

[0060] By temporarily presenting the audio content using at least one spatial characteristic, the user-perceivable indication has a limited duration. The duration can be predetermined. The duration can be a few seconds or any other suitable length, allowing the user 1 to recognize that the deviation from the realistic sound experience or expected spatialization is intentional and not simply an error. Alternatively, the duration can be based on the audio content. For example, the duration can be determined as a percentage of the duration of the audio content. This percentage can decrease as the duration of the audio content increases. For audio content lasting less than one minute, the percentage can be, for example, 10%, while for audio content lasting nearly one hour, the percentage can be, for example, close to 1%. In either case, by temporarily presenting the audio content with at least one spatial characteristic, the user-perceivable indication has a duration shorter than the duration of the audio content.

[0061] In some examples, the user-perceivable indication may be terminated in response to a user input (such as a gesture) confirming the user-perceivable indication. In the absence of such user input confirming the user-perceivable indication, the user-perceivable indication may persist for a longer period of time, or the temporary presentation may be configured to further emphasize at least one spatial characteristic or other spatial characteristics that are also not reproducible by at least one other audio playback device 7, 11 connected to the user device 5. For example, if initially only a subset of the components of the audio content (e.g., one or more audio objects or one or more frequencies) are presented as having at least one spatial characteristic, then in the absence of such user input confirming the user-perceivable indication, more components of the audio content (in some examples, even all components) may be presented as having the at least one spatial characteristic.

[0062] As playback continues, the audio content is rendered using its intended spatialization, per block 130. The intended spatialization of the audio content may be recorded, for example, in associated metadata. The intended spatialization may also be recorded in the order of the channels for channel-based audio.

[0063] It will be appreciated that, after the user-perceivable indication ceases, the intended spatialization of the audio content may have spatial characteristics that are not achievable by the at least one other audio playback device 7, 11 connected to the user device 5, however, these spatial characteristics will not be unexpected to the user 1 in view of the audio content and will not be due to consideration of the playback capabilities 212, 214 of the at least one other audio playback device 7, 11 (see Figure 5 ) and are generated in particular taking into account that they do not have the playback capabilities 212, 214 possessed by the audio playback device 3 responsible for playing back the audio content during that time.

[0064] Alternatively, if no user input is provided confirming the user-perceptible indication, the audio presentation may be switched to a conventional stereo presentation.

[0065] By causing this user-perceivable indication: user 1 can resolve confusion about which audio playback device 3, 7, 11 is responsible for playing back the audio content they hear; user 1 can be sure that playback of private (e.g., confidential, embarrassing, etc.) audio content remains private; user 1 can be made aware that the wireless connection between the user device 5 and other devices such as the audio playback device 3 has not been dropped; user 1 can confirm that the audio playback device 3 is using the correct spatialization mode; in order to indicate to user 1 which audio playback device 3, 7, 11 is responsible for playback, user 1 is not distracted from the audio content by adding new sounds such as loud beeps or voice prompts, nor is the user 1 distracted from the accompanying visual content by visual overlays (if any); user 1 does not need to use a process of elimination to deactivate or disconnect the audio playback devices 3, 7, 11 to check which device is responsible for playback, which process would create unnecessary discontinuities in the audio content perceived by user 1.

[0066] Figure 5 An example is illustrated wherein knowledge of the playback capabilities 212, 214 of at least one other audio playback device 7, 11 connected to a user device 5 is obtained in order to determine at least one spatial characteristic, wherein the at least one spatial characteristic is utilized to temporarily present audio content in order to indicate to the user 1 that the audio playback device 3 is responsible for playing back the audio content.

[0067] At block 210, information about the playback capabilities of at least one other audio playback device 7, 11 connected to the user device 5 is obtained. This may involve obtaining information about one or more locations 212 of the at least one other audio playback device 7, 11. The one or more locations 212 of the at least one other audio playback device 7, 11 may be obtained by any suitable means, such as, for example, radio positioning using ultra-wideband positioning; computer vision using a camera of the user device 5; or acoustic measurements, such as those used by some audio playback devices to optimize performance by taking into account room acoustics. Such acoustic measurements may be performed using one or more microphones housed within the at least one other audio playback device 7, 11, or dedicated microphones. In examples where the at least one other audio playback device 7, 11 has one or more predictable locations 212, such as speaker units in a surround sound system, these may be saved for future use.

[0068] Obtaining information of playback capabilities 212, 214 of the at least one other audio playback device 7, 11 can additionally involve obtaining information about spatial audio effects 214, if any, that can be produced by the at least one other audio playback device 7, 11. This information 214 can be communicated by the at least one other audio playback device 7, 11.

[0069] According to block 220, based on the one or more positions 212 of the at least one other audio playback device 7, 11, one or more directions of one or more real sound sources 222 can be obtained from the perspective of the user 1.

[0070] Also according to block 220, based on the one or more positions 212 of the at least one other audio playback device 7, 11 and the spatial audio effects 214 that can be produced by the at least one other audio playback device 7, 11, one or more directions of one or more possible virtual sound sources 224 can be obtained from the perspective of the user 1.

[0071] The perspective of the user 1 can be determined based on a position of the user 1 relative to the user device 5, which can be obtained by any suitable means such as, for example, time-of-flight radio wave measurements or computer vision.

[0072] At block 230, information is obtained in at least one direction 232 in which there is no real sound source associated with the at least one other audio playback device 7, 11 and no possible virtual sound source associated with the at least one other audio playback device 7, 11. Thus, the at least one direction 232 is determined from the perspective of the user 1 based on the one or more directions of the one or more real sound sources 222 and the one or more possible virtual sound sources 224, if any.

[0073] It will be appreciated that, in some examples, obtaining the playback capabilities 212, 214 can involve obtaining information about the one or more positions 212 of the at least one other audio playback device 7, 11 and accordingly obtaining information about the one or more directions of the one or more real sound sources 222, without obtaining information about the spatial audio effects 214, if any, that can be produced by the at least one other audio playback device and accordingly without obtaining information about the directions of the possible virtual sound sources 224. Thus, in some examples, at block 230, information is obtained in at least one direction 232 in which there is no real sound source. In this example, the at least one direction 232 obtained is at least one direction away from the at least one other audio playback device 7, 11.

[0074] Figures 6 to 14 An example of at least one spatial characteristic is illustrated with which the audio content is temporarily rendered to indicate to the user 1 that the audio playback device 3 is responsible for playing back the audio content.

[0075] In each of these examples, temporarily presenting the audio content with at least one spatial characteristic may include temporarily adjusting the presentation of the audio content so that the audio content is presented with the at least one spatial characteristic, or temporarily modifying the audio content so that the audio content has the at least one spatial characteristic.

[0076] For different components of the audio content, the spatial characteristics that can be utilized to render the different components may be different. Thus, in some examples, the spatial characteristics are content-dependent.

[0077] exist Figures 6 to 13 In the example, the temporary presentation of audio content using at least one spatial characteristic is configured to increase the energy that user 1 will perceive originating from at least one direction 232 away from at least one other audio playback device 7, 11 relative to the energy that user 1 will perceive originating from one or more directions corresponding to one or more positions 212 of at least one other audio playback device 7, 11.

[0078] In some examples, during the user-perceivable indication, the relative energies perceived as originating from at least one direction 232 away from at least one other audio playback device and from one or more directions corresponding to one or more locations 212 of at least one other audio playback device 7, 11 vary with respect to one or more frequencies or frequency bands, and not necessarily across the entire frequency spectrum.

[0079] In some examples, the at least one direction 232 away from the other audio playback devices 7, 11 is a direction in which there is no real sound source associated with the at least one other audio playback device 7, 11. It may also be a direction in which there is no possible virtual sound source associated with the at least one other audio playback device 7, 11.

[0080] Figure 6 An example is illustrated in which an amount of total energy of the audio content that is above a threshold is perceived as originating from at least one direction 232 away from at least one other audio playback device 7, 11. The apparent sound source 19 of the amount of total energy of the audio content that is above the threshold is located in the at least one direction 232 away from the at least one other audio playback device 7, 11.

[0081] An amount above a threshold of total energy of audio content having an apparent sound source 19 located in at least one direction 232 away from the at least one other audio playback device 7 , 11 is an example of a spatial characteristic that cannot be reproduced by the at least one other audio playback device 7 , 11 .

[0082] exist Figure 6In the example illustrated in FIG, user 1 is wearing headphones 3, and user device 5 is located in front of user 1. The audio playback device responsible for playing back the audio content is headphones 3. The other audio playback device connected to user device 5 is the integrated speaker 7 of user device 5. The apparent sound source 19 for the above-threshold amount of total energy of the audio content is located behind user 1. Therefore, compared to the relative position of integrated speaker 7 with respect to user 1, the above-threshold amount of total energy of the audio content is perceived as originating from the opposite side of the user's head.

[0083] In this example, the apparent sound source 19 for the above-threshold amount of total energy of the audio content is located at a location where no real or possible virtual sound sources associated with the integrated loudspeaker 7 exist. Generally speaking, utilizing at least one spatial characteristic to temporarily present the audio content may comprise causing the above-threshold amount of total energy of the audio content to be perceived as originating from at least one direction 232 in which no real sound sources associated with at least one other audio playback device 7, 11 connected to the user device 5 exist and where no possible virtual sound sources associated with the at least one other audio playback device 7, 11 connected to the user device 5 exist.

[0084] An amount above the threshold may refer to a majority. In some examples, the threshold may be higher. The threshold may be 70%. Utilizing at least one spatial characteristic to temporarily render the audio content may include causing 70% or more of the total energy of the audio content to be perceived as originating from at least one direction 232 away from at least one other audio playback device 7, 11 (such as an integrated speaker 7).

[0085] In some examples, the amount of total energy of the audio content that is above a threshold can be concentrated in a direction within the intended spatialization of the audio content, or in a directional component of the audio content. For example, the audio content can include one or more audio objects. Thus, temporarily presenting the audio content using at least one spatial characteristic can include repositioning the one or more audio objects in at least one direction 232 away from at least one other audio playback device 7, 11.

[0086] For one or more directional components of audio content (such as audio objects) that are relocated to at least one direction away from at least one other audio playback device 7, 11, all or substantially all of the energy of these components can be made to have a perceived origin from at least one direction 232 away from the at least one other audio playback device 7, 11. An amount of the total energy of the audio content above a threshold can include all or substantially all of the energy of the one or more directional components of the audio content. In the case where the one or more directional components represent direct sound, all or substantially all of their energy can be concentrated in at least one direction 232 away from the at least one other audio playback device 7, 11. For example, in the case where the one or more directional components represent reflected sound or delayed reverberation, their energy can be spread around at least one direction 232 away from the at least one other audio playback device 7, 11.

[0087] Alternatively, utilizing the at least one spatial characteristic to temporarily render the audio content may comprise reducing the energy of at least one directional component of the audio content in a direction corresponding to the position of the at least one other audio playback device 7, 11 and / or increasing the energy of at least one directional component of the audio content in at least one direction 232 away from the at least one other audio playback device 7, 11, e.g. Figure 7 As shown in .

[0088] exist Figure 7 In the example of FIG1 , apparent sound source 21 for the component of audio content behind user 1 during the user-perceivable indication has more energy (indicated by the larger circle) than apparent sound source 23 for the component of audio content behind user 1 in the intended spatialization. On the other hand, apparent sound source 25 for the component of audio content in front of user 1 during the user-perceivable indication has less energy (indicated by the smaller circle) than apparent sound source 27 for the component of audio content in front of user 1 in the intended spatialization.

[0089] In other examples, such as Figure 8 As illustrated in , the directional properties of the diffuse component 29 of the audio content can be increased and directed into at least one direction 232 away from at least one other audio playback device 7, 11. For example, in the case of IVASMASA content, the direct-to-total energy ratio of the diffuse component 29 can be increased.

[0090] That is, temporarily rendering the audio content using the at least one spatial characteristic may include converting at least one diffuse component 29 of the audio content from at least one direction 232 away from the at least one other audio playback device 7 , 11 into directional audio.

[0091] like Figure 8As shown in , this may be performed in conjunction with repositioning one or more existing directional components 31 of audio content (eg, one or more audio objects) into at least one direction 232 away from at least one other audio playback device. Figure 8 It is shown that the apparent sound source 9 of the audio content, or at least the apparent sound source 19 of an amount of the total energy of the audio content above a threshold, is behind the user 1 .

[0092] Alternatively, the directional component 31 and the diffuse component 29 can be switched. That is, the information recorded in the directional component 31 can be distributed in a diffuse manner, while the information recorded in the diffuse component 29 is concentrated in one direction. This reversal of the intended spatialization of the audio content is often unrealistic, and therefore the user will not be confused about the intended spatialization. As a result, the user 1 will be more aware that they are being provided with user-perceivable instructions.

[0093] Thus, temporarily presenting the audio content using at least one spatial characteristic may include, additionally or alternatively, converting at least one directional component 31 of the audio content in directions corresponding to one or more positions 212 of at least one other audio playback device 7, 11 into diffuse audio.

[0094] Temporarily presenting the audio content utilizing the at least one spatial characteristic may include causing, during providing the user-perceivable indication, an amount above a threshold of total energy of the audio content to be perceived as originating from more than one direction. Figure 9 An example is shown.

[0095] An apparent sound source 19 having an amount of the total energy of the audio content that is above a threshold value may be perceived as originating from two or more consecutive directions, at least one of which is a direction 232 away from the at least one other audio playback device 7, 11. At least one of the two or more consecutive directions may be a direction in which there are no real sound sources associated with the at least one other audio playback device 7, 11 connected to the user device 5 and no possible virtual sound sources associated with the at least one other audio playback device 7, 11 connected to the user device 5.

[0096] The user-perceivable indication may be interrupted after directing an amount of the total energy of the audio content above a threshold into two or more consecutive directions, at least one of which is at least one direction 232 away from at least one other audio playback device 7, 11.

[0097] exist Figure 9 In the example of FIG. 1 , the apparent sound source 19 of the amount of total energy of the audio content above the threshold is first as Figure 69 , this may result in an above-threshold amount of the total energy of the audio content being perceived as originating in front of user 1 , from the direction of user device 5 where accompanying visual content (if any) may be displayed. The apparent sound source located in front of user 1 is labeled 19".

[0098] In some examples, the user-perceivable indication may be in the form of an apparent sound source 19 continuously moving around the user for an amount of total energy of the audio content that is above a threshold. The continuous movement may follow Figure 9 The trajectory marked as 33 in .

[0099] This is advantageous where the audio playback device responsible for playing back the audio content is the headphones 3. In contrast to the sound produced by the headphones 3, the sound produced by the speakers 7, 11 will be reflected from the room rather than coloured, and the perceived trajectory of the apparent sound source will generally be less clear or consistent than that produced by the headphones 3. This can be another user-perceivable indication to the user 1 that the headphones 3 are responsible for playing back the audio content they hear.

[0100] In other examples, the user-perceivable indication may be in the form of one or more discrete changes in the position of the apparent sound source 19 for an amount of total energy of the audio content that is above a threshold.

[0101] Temporarily rendering the audio content using the at least one spatial characteristic may start from at least one direction 232 away from the at least one other audio playback device 7, 11 or may comprise a rapid pan towards the direction 232 from an intended direction in an intended spatialization of the audio content.

[0102] Figure 10The diagram illustrates an example in which multiple other audio playback devices 7 and 11 are connected to a user device 5. In this example, the user device 5 is connected to its own integrated speaker 7, headphones 3 worn by user 1, and a speaker system 11, which may be a surround sound speaker system. The audio playback device responsible for playing back the audio content is the headphones 3. The speaker system 11 is located to the left of user 1, while the user device 5 is located in front of user 1. Therefore, directions away from the other audio playback devices 7 and 11 connected to the user device 5 include behind user 1 and to the right of user 1. If the speaker system 11 is not configured for surround sound or is configured for planar surround sound rather than spherical surround sound, directions away from the other audio playback devices 7 and 11 connected to the user device 5 may also include above and / or below the user's head.

[0103] As in Figure 6-Figure 9 As in the example, Figure 10 In the example shown, headphones 3 worn by user 1 are the audio playback device responsible for playing back the audio content heard by the user. An apparent sound source 19, with an amount of total energy of the audio content above a threshold, is initially located to the right rear side of the user's head, away from the integrated speaker 7 of user device 5 and the surround sound speaker system 11. In some examples, this may be the only direction in which the apparent sound source 19 is located during the user-perceivable indication. In other examples, such as the illustrated example, the apparent sound source 19 is moved to at least one other direction that is also away from the other audio playback devices 7, 11. As illustrated, the apparent sound source is then located to the right front side of the user's head, away from the surround sound speaker system 11. The apparent sound source located to the right front side of user 1 is labeled 19'. In this position, apparent sound source 19' is also not in the direction of integrated speaker 7, but user 1 may not be aware that the apparent sound source 19' in this position cannot be reproduced by the integrated speaker 7 in front of user 1.

[0104] At a later time, the user-perceivable indication may be discontinued and the presentation of the audio content continued using its composer's intended spatialization. Figure 10 , this may result in an above-threshold amount of the total energy of the audio content being perceived as originating in front of the user 1 , from the direction of the user device 5 where accompanying visual content (if any) may be displayed. The apparent sound source located in front of the user 1 is labeled 19".

[0105] In some examples, the trajectory 33 followed by the apparent sound source 19 may be Figure 9 and Figure 10 The illustrated trajectory is more complex.

[0106] Figure 11An example is shown in which directional components of audio content (or diffuse components whose directionality has been increased) that contribute an amount of the total energy of the audio content that is above a threshold are divided between two or more groups having differentially controllable associated directions. The components of the audio content included in the first group may have a first apparent sound source 191 that moves along a first trajectory 331, and the components of the audio content included in the second group may have a second apparent sound source 192 that moves along a second trajectory 332 that is different from the first trajectory 331.

[0107] exist Figure 11 In the example illustrated in , the first and second apparent sound sources 191 and 192 are initially located behind the user 1. The first apparent sound source 191 then moves around to the user's right hand side (labeled here as 191'), while the second apparent sound source 192 moves around to the user's left hand side (labeled here as 192').

[0108] Subsequently, the user-perceivable indication may be discontinued and the apparent sound sources 191, 192 are both located in front of the user 1 (here they are labeled 191" and 192", respectively), in the direction of the user device 5 where accompanying visual content (if any) may be displayed.

[0109] Alternatively, for a more complex trajectory, the first trajectory 331 may include moving the first apparent sound source 191 from the user's right hand side to their left hand side (labeled here as 191), and the second trajectory 332 may include moving the second apparent sound source 192 from the user's left hand side to their right hand side (labeled here as 192), before disconnecting the user-perceivable indication. Figure 12 This can be reversed and repeated. For the intended spatialization of the audio content, the user will not be confused by this unrealistic movement pattern 1 and will therefore be more aware that they are being provided with user-perceivable instructions.

[0110] Figure 13 3 shows examples of trajectories 33 of apparent sound sources 19 for amounts above a threshold of the total energy of the audio content in different dimensions. Unlike the trajectories of the apparent sound sources in the horizontal plane around the user 1, as Figures 9-12 As shown in Figure 13The trajectory 33 of the apparent sound source 19 in the example of takes it out of this plane. The apparent sound source 19 is first located behind the user's head. The height of the apparent sound source 19 is then adjusted so that it is later located above the user's head (labeled here as 19'). In other examples, the apparent sound source 19 may be located above the user's head from the beginning of the user-perceivable indication. At a time after this, the user-perceivable indication may be interrupted and the presentation of the audio content continued with its composer's intended spatialization. For example, and as Figure 13 As illustrated in , this can result in an above-threshold amount of the total energy of the audio content being perceived as originating from in front of the user 1 (labeled here as 19"), from the direction of the user device 5 where accompanying visual content (if any) may be displayed.

[0111] Despite Figure 13 There is no description of Figure 2 and Figure 10 The surround sound speaker system 11 shown in FIG, wherein such speaker system 11 is adapted to provide a planar surround sound presentation, but Figure 13 , or simply positioning the apparent sound source 19 outside the horizontal plane around the user's head (such as above their head), can provide a clear user-perceivable indication that an audio playback device with, for example, full spherical surround sound capabilities is the device responsible for playing back the audio content.

[0112] On the other hand, where such a speaker system 11 is adapted to provide full spherical surround sound presentation, positioning the apparent sound source 19 outside of the horizontal plane around the user's head may not enable the user 1 to identify that another audio playback device capable of full spherical surround sound presentation (such as the headphones 3 they are wearing) is responsible for the playback of the audio content. However, as mentioned previously, the clarity of the perceived trajectory of the apparent sound source 19 provided by the headphones 3 may enable the user 1 to distinguish between the sound produced by the headphones 3 and the sound produced by the speaker system 11. Therefore, Figure 13 The trajectory 33 of the apparent sound source 19 illustrated in FIG. 3 can be used as a user-perceivable indication in these situations.

[0113] Alternatively or additionally, the spatial audio components are temporarily reproduced (downmixed) in a mono or stereo format. Presenting the spatial audio components in a mono or stereo format provides a head internalization effect of the apparent sound source 9 of the audio content or at least the apparent sound source 19 of an amount of the total energy of the audio content that is above a threshold, which is an example of a spatial characteristic that cannot be reproduced by at least one other audio playback device 7, 11, wherein the at least one other audio playback device 7, 11 is not a headphone 3. The head internalization effect is that the apparent sound source of the audio content or at least part of the audio content will not be perceived as originating from a location far away from the head. Head internalization of the apparent sound source in Figure 14 It is marked as 9' / 19'. Figure 14 In the example shown, the apparent sound source 9 or 19 is first positioned behind the user's head. The spatial audio effect is then removed by presenting the spatial audio components of the audio content in mono or stereo format. This can be reversed and repeated. Given the intended spatialization of the audio content, the user 1 will not be confused by this unrealistic movement pattern and will therefore be more aware that they are being provided with user-perceivable instructions.

[0114] It should also be appreciated that the apparent sound source 9 / 19 need not be moved, but instead may temporarily play back the audio content in mono or stereo format from the start of the user-perceivable indication until the user-perceivable indication ceases.

[0115] Another alternative or additional approach for temporarily presenting audio content using spatial characteristics that cannot be reproduced by other audio playback devices 7, 11 (which project sounds into a real room based on room characteristics so that user 1 hears any sounds colored by, for example, reverberation effects and reflections) is to apply a room impulse response (RIR) that does not match the room characteristics to the audio content for the duration of the user-perceivable indication or to adjust the RIR applied to the audio content in a perceptible manner. In some examples, for example, to indicate to user 1 that the playback of the audio content is via headphones 3, the RIR that was otherwise added during the binauralization of the audio content is temporarily removed so that the audio content heard by the user during the user-perceivable indication does not appear as if it had been projected into the room. This will eliminate the perception that an audio playback device 7, 11 at a location far from user 1 may have been responsible for playing back the audio content.

[0116] In some examples, not all components of the audio content may be used to indicate to user 1 that audio playback device 3 is responsible for playback of the audio content. The intended spatialization of the audio content may be recorded in associated metadata. During the user-perceivable indication, components of the audio content marked in the associated metadata as components that should not be modified or whose reproduction should not be adjusted are not modified or adjusted. They retain their intended spatialization throughout the duration of the user-perceivable indication. Figure 15A 、 Figure 15B An example is shown.

[0117] Figure 15A An example of the intended spatialization of two components of audio content is shown. In this example, the apparent sound sources 35, 37 of the two components are located in front of the user 1 in the direction of the user device 5. The first of these is the apparent sound source 35 for a component that is marked in the accompanying metadata and is therefore not available for user-perceivable indication. The second of these is the apparent sound source 37 for a component that is not so marked.

[0118] Figure 15B The diagram illustrates an example of a user-perceivable indication caused by temporarily presenting audio content comprising two components using at least one spatial characteristic that cannot be reproduced by at least one other audio playback device connected to the user device (in this case, the integrated loudspeaker 7 of the user device 5). The apparent sound source 35 of the component marked in the accompanying metadata retains its intended spatialization. The apparent sound source of the component not so marked is located behind the user 1, on the opposite side of the user's head, compared to the relative position of the integrated loudspeaker 7 relative to the user 1, and where there are no real or possibly virtual sound sources associated with the integrated loudspeaker 7. The apparent sound source of the unmarked component in this position behind the user 1 is marked as 37'.

[0119] In some examples, and as Figure 15B As shown in FIG, the energy associated with the component of the audio content perceived as originating from the at least one direction 232 away from the at least one other audio playback device 7, 11 is increased. Because the spatialization is now distributed between intended and unintended directions to emphasize the direction 232 away from the integrated loudspeaker 7, and therefore to emphasize spatial characteristics that cannot be reproduced by the integrated loudspeaker 7, the energy of the apparent sound source 37' located in the direction 232 away from the integrated loudspeaker 7 is increased. This energy can be increased so that an amount of the total energy of the audio content above the threshold is located in the direction 232 away from the integrated loudspeaker 7. It should be understood that this is not required, and in other examples, the energy of the apparent sound source 37' located in the direction 232 away from the integrated loudspeaker 7 is not modified compared to what would otherwise be expected in the absence of a user-perceivable indication.

[0120] In some examples, where metadata marks a component of the audio content as unavailable for a user-perceivable indication, the metadata may identify another component of the audio content to be modified in place of the marked component.

[0121] The components of the audio content that can be used for the indication can be marked by the original content composer or by user 1. User 1 can select individual components (e.g., audio objects) that they do not want to be part of the indication, or if the metadata categorizes the component as, for example, "speech" or "surround effects," user 1 can select the category that they do not want to be part of the indication. User 1's selection can be made for the current playback of the current audio content, or can be made as a setting that is applied to future playbacks of audio content.

[0122] Figure 16 An apparatus 40 according to an example of the present disclosure is schematically illustrated. Figure 16 The apparatus 40 illustrated in FIG may be a chip or a chipset. In some examples, the apparatus 40 may be provided within a user device or an audio playback device.

[0123] The apparatus 40 includes a controller 42. The controller 42 may be implemented as a controller circuit. The controller 42 may be implemented solely in hardware, with certain aspects in software including firmware, or may be a combination of hardware and software (including firmware).

[0124] like Figure 16 As shown in FIG, the controller 42 may be implemented using instructions that implement the hardware functionality, such as by using executable instructions of a computer program 48 in a general or special purpose processor 44, which executable instructions may be stored on a computer-readable storage medium (disk, memory, etc.) for execution by such a processor 44.

[0125] The processor 44 is configured to read from and write to the memory 46. The processor 44 may also include an output interface via which data and / or commands are output by the processor 44 and an input interface via which data and / or commands are input to the processor 44.

[0126] The memory 46 stores a computer program 48 comprising computer program instructions (computer program code) that, when loaded into the processor 44, controls the operation of the apparatus 40. The computer program instructions of the computer program 48 provide logic and routines that enable the apparatus to perform the methods illustrated and described with respect to the preceding figures. By reading the memory 46, the processor 44 is able to load and execute the computer program 48.

[0127] Thus, the apparatus 40 includes at least one processor 44 and at least one memory 46 including computer program code, the at least one memory 46 and the computer program code being configured to, together with the at least one processor 44, cause the apparatus 40 to at least perform: causing a user-perceivable indication that an audio playback device is responsible for playback of audio content received from a user device by temporarily presenting the audio content with at least one spatial characteristic that cannot be reproduced by at least one other audio playback device connected to the user device.

[0128] Computer program 48 may arrive at apparatus 40 via any suitable delivery mechanism 50. Delivery mechanism 50 may be, for example, a machine-readable medium, a computer-readable medium, a non-transitory computer-readable storage medium, a computer program product, a memory device, a recording medium such as a compact disk read-only memory (CD-ROM) or a digital versatile disk (DVD), or a solid-state memory, an article of manufacture including or tangibly embodying computer program 48. The delivery mechanism may be a signal configured to reliably convey computer program 48. Apparatus 40 may propagate or transmit computer program 48 as a computer data signal.

[0129] Computer program instructions for causing an apparatus to perform at least the following or for performing at least the following: causing a user-perceivable indication that an audio playback device is responsible for playback of audio content received from a user device by temporarily presenting the audio content with at least one spatial characteristic that cannot be reproduced by at least one other audio playback device connected to the user device.

[0130] The computer program instructions may be included in a computer program, a non-transitory computer readable medium, a computer program product, a machine readable medium. In some, but not necessarily all, examples, the computer program instructions may be distributed across more than one computer program.

[0131] Although memory 46 is illustrated as a single component / circuitry, it may be implemented as one or more separate components / circuitry, some or all of which may be integrated / removable and / or may provide permanent / semi-permanent / dynamic / cached storage.

[0132] Although processor 44 is illustrated as a single component / circuitry, it may be implemented as one or more separate components / circuitry, some or all of which may be integrated / removable.Processor 44 may be a single-core or multi-core processor.

[0133] References to "computer-readable storage medium," "computer program product," "tangibly embodied computer program," etc., or "controller," "computer," "processor," etc., should be understood to encompass not only computers having different architectures, such as single / multi-processor architectures and serial (von Neumann) / parallel architectures, but also specialized circuits, such as field programmable gate arrays (FPGAs), application specific circuits (ASICs), signal processing devices, and other processing circuit systems. References to computer programs, instructions, code, etc., should be understood to encompass software or firmware for a programmable processor, such as, for example, the programmable content of a hardware device, whether instructions for a processor or configuration settings for a fixed-function device, gate array, or programmable logic device, etc.

[0134] As used in this application, the term "circuitry" may refer to one or more or all of the following:

[0135] (a) pure hardware circuit implementation (such as implementation in analog and / or digital circuitry only) and

[0136] (b) a combination of hardware circuitry and software such as (if applicable):

[0137] (i) a combination of analog and / or digital hardware circuits and software / firmware, and

[0138] (ii) any portion of hardware processor(s) (including digital signal processor(s)), software and memory(s) with software that work together to enable a device such as a mobile phone or server to perform various functions, and

[0139] (c) Hardware circuit(s) and / or processor(s), such as microprocessor(s) or portion(s) of microprocessor(s), that require software (e.g., firmware) to operate, but which may not be present when it is not needed.

[0140] This definition of "circuitry" applies to all uses of the term in this application, including in any claims. As a further example, as used in this application, the term "circuitry" also covers an implementation of merely a hardware circuit or processor and its (or their) accompanying software and / or firmware. By way of example and where applicable to a particular claim element, the term "circuitry" also covers a baseband integrated circuit for a mobile device or a similar integrated circuit in a server, cellular network device, or other computing or networking device.

[0141] The blocks illustrated and described with respect to the foregoing figures may represent steps in a method and / or code sections in a computer program 48. The illustration of a particular order of blocks does not necessarily imply a required or preferred order for the blocks, and the order and arrangement of the blocks may vary. Furthermore, some blocks may be omitted.

[0142] Where a structural feature has been described, it may be replaced with a component for performing one or more of the functions of the structural feature, whether the function or functions are explicitly described or implicitly described.

[0143] Thus, in some examples, such 40 includes means for causing a user-perceivable indication that the audio playback device is responsible for playing back audio content received from the user device by temporarily presenting the audio content using at least one spatial characteristic that cannot be reproduced by at least one other audio playback device connected to the user device.

[0144] The term "comprising" is used in this document in an inclusive, rather than exclusive, sense. That is, any reference to X comprising Y indicates that X may include only one Y or may include more than one Y. If "comprising" is intended to be used in an exclusive sense, this will be clear from the context by reference to "comprising only one" or by use of "consisting of."

[0145] In this specification, reference is made to various embodiments. Descriptions of features or functionality with respect to an example indicate that those features or functionality are present in that example. Whether explicitly stated or not, the use of the term "example" or "for example" or "can" or "may" in the text indicates that such features or functionality are present in at least the example being described, whether or not described as an example, and that they may, but need not, be present in some or all other examples. Thus, "example," "for example," "can" or "may" refers to a particular instance of a class of examples. Attributes of an instance may be attributes of only that instance, or of a class, or of a subclass of a class that includes some but not all instances of the class. Thus, it is implicitly disclosed that features described with reference to one example but not with reference to another example may, where possible, be used in that other example as part of a working combination, but need not necessarily be used in that other example.

[0146] Although the examples have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the claims.

[0147] Features described in the preceding description may be used in combinations other than the combinations explicitly described above.

[0148] Although functions have been described with reference to certain features, those functions may be performable by other features whether described or not.

[0149] Although features have been described with reference to certain examples, those features may also be present in other examples whether described or not.

[0150] The terms "a," "an," and "the" are used herein in an inclusive, rather than exclusive, sense. That is, unless the context clearly indicates otherwise, any reference to X including one Y indicates that X may include only one Y or may include more than one Y. If the exclusive meaning of "a," "an," or "the" is intended, it will be clear from the context. In some cases, the use of "at least one" or "one or more" may be used to emphasize the inclusive meaning, but the absence of these terms should not be construed to imply any exclusive meaning.

[0151] The presence of a feature (or combination of features) in a claim is a reference to that feature (or combination of features) itself and to features that achieve substantially the same technical effect (equivalent features). Equivalent features include, for example, features that are variations and achieve substantially the same result in substantially the same manner. Equivalent features include, for example, features that perform substantially the same function in substantially the same manner to achieve substantially the same result.

[0152] In this specification, reference has been made to various examples using adjectives or adjective phrases that describe characteristics of the examples. Such description of a characteristic associated with an example indicates that the characteristic exists in some examples exactly as described and in other examples substantially as described.

[0153] While efforts have been made in the foregoing description to draw attention to those features regarded as important, it will be understood that the applicant may seek protection by way of claims for any patentable feature or combination of features mentioned above and / or shown in the drawings whether or not emphasis has been placed thereon.

Claims

1. A device for playing back audio content, comprising: at least one processor; as well as at least one memory including computer program code, The at least one memory stores instructions that, when executed by the at least one processor, cause the apparatus to at least: Causing an audio playback device to provide an audible indication perceptible to a user, the audible indication being used to indicate that the audio playback device, and not at least one other audio playback device connected to the user device, is responsible for playing back audio content received from the user device, the audible indication being provided by temporarily presenting the audio content using at least one spatial characteristic that cannot be reproduced by the at least one other audio playback device.

2. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises at least one of: temporarily adjusting the presentation of the audio content so that the audio content is presented utilizing the at least one spatial characteristic, or The audio content is temporarily modified such that the audio content has the at least one spatial characteristic.

3. The apparatus of claim 1 , wherein temporarily presenting the audio content utilizing the at least one spatial characteristic causes: increasing energy perceived by the user as originating from at least one direction away from the at least one other audio playback device relative to energy perceived by the user as originating from one or more directions corresponding to one or more locations of the at least one other audio playback device.

4. The apparatus of claim 3 , wherein the at least one direction away from the at least one other audio playback device comprises: There are no real sound sources associated with the at least one other audio playback device, and there are no directions of possible virtual sound sources associated with the at least one other audio playback device.

5. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: An amount above a threshold of the total energy of the audio content is caused to be directed in at least one direction away from the at least one other audio playback device.

6. The apparatus of claim 5 , configured to discontinue the user-perceivable indication in response to directing an amount of the total energy of the audio content above a threshold into two or more consecutive directions, at least one of the two or more consecutive directions being at least one direction away from the at least one other audio playback device.

7. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: One or more audio objects are repositioned in at least one direction away from the at least one other audio playback device.

8. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: At least one diffuse component of the audio content is converted into directional audio in at least one direction away from the at least one other audio playback device.

9. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: At least one directional component of the audio content in a direction corresponding to a location of another audio playback device is converted into diffuse audio.

10. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporarily render the audio content comprises at least one of: reducing energy of at least one directional component of the audio content in a direction corresponding to a location of the at least one other audio playback device, or increasing the energy of at least one directional component of the audio content in at least one direction away from the at least one other audio playback device.

11. The apparatus of claim 1 , wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: The spatial audio components are presented in mono or stereo format.

12. The apparatus of claim 1 , wherein the at least one memory and the instructions stored in the at least one memory are configured to, with the at least one processor, cause the apparatus to: Temporarily presenting the audio content using the at least one spatial characteristic in response to at least one of: - changing the audio playback device responsible for playback of the audio content among the audio playback devices connected to the user device, or - A request for confirmation that the audio playback device is responsible for the playback of the audio content.

13. The apparatus of claim 1, wherein components of the audio content that are marked in associated metadata as components that should not be modified are not modified.

14. The apparatus of claim 1, wherein the user-perceptible indication that an audio playback device is responsible for playing back audio content received from a user device is caused in the apparatus.

15. The apparatus of claim 1, wherein the user-perceivable indication that the audio playback device is responsible for playing back audio content received from the user device is caused in another apparatus.

16. A method for playback of audio content, comprising: Causing an audio playback device to provide an audible indication perceptible to a user, the audible indication being used to indicate that the audio playback device, and not at least one other audio playback device connected to the user device, is responsible for playing back audio content received from the user device, the audible indication being provided by temporarily presenting the audio content using at least one spatial characteristic that cannot be reproduced by the at least one other audio playback device.

17. The method of claim 16, wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: causing an amount above a threshold of total energy of the audio content to be directed in at least one direction away from the at least one other audio playback device; as well as The method further includes ceasing the user-perceptible indication in response to directing an amount of the total energy of the audio content above a threshold into two or more consecutive directions, at least one of the two or more consecutive directions being at least one direction away from the at least one other audio playback device.

18. The method of claim 16, further comprising temporarily rendering the audio content using the at least one spatial characteristic in response to at least one of: - changing the audio playback device responsible for playback of the audio content among the audio playback devices connected to the user device, or - A request for confirmation that the audio playback device is responsible for the playback of the audio content.

19. The method of claim 16, wherein components of the audio content that are marked in associated metadata as components that should not be modified are not modified.

20. A non-transitory computer-readable medium comprising program instructions stored thereon, the program instructions being configured to at least: Causing an audio playback device to provide an audible indication perceptible to a user, the audible indication being used to indicate that the audio playback device, and not at least one other audio playback device connected to the user device, is responsible for playing back audio content received from the user device, the indication being provided by temporarily presenting the audio content using at least one spatial characteristic that cannot be reproduced by the at least one other audio playback device.

21. The non-transitory computer-readable medium of claim 20, wherein utilizing the at least one spatial characteristic to temporally render the audio content comprises: causing an amount above a threshold of total energy of the audio content to be directed in at least one direction away from the at least one other audio playback device; as well as The program instructions are further configured to: discontinue the user-perceivable indication in response to directing an amount of total energy of the audio content above a threshold in two or more consecutive directions, at least one of the two or more consecutive directions being at least one direction away from the at least one other audio playback device.

22. The non-transitory computer-readable medium of claim 20, wherein the program instructions are further configured to cause the audio content to be temporarily presented utilizing the at least one spatial characteristic in response to at least one of: - changing the audio playback device responsible for playback of the audio content among the audio playback devices connected to the user device, or - A request for confirmation that the audio playback device is responsible for the playback of the audio content.

Citation Information

Patent Citations

  • Audio parameter managing method for application software, application software program thereof and audio reproduction apparatus thereof

    US20030177893A1