Method and apparatus for audio scene interest space - Patents.com

Abstract

Aspects of the present disclosure include a method, an apparatus, and a non-transitory computer-readable storage medium for decoding audio data of an audio scene. One apparatus includes processing circuitry that receives first audio source data and second audio source data. The first audio source data corresponds to a space of interest within the audio scene, and the second audio source data does not correspond to a space of interest within the audio scene. The space of interest of the audio scene is represented by at least one of a listener space, an audio channel, or an audio object. The processing circuitry decodes the first audio source data based on the space of interest.

Description

[Technical field]

[0001] (Reference to Related Application) This application claims benefit of priority to U.S. Provisional Application No. 63 / 177,258, entitled "SPACE OF INTEREST OF AUDIO SPACE," filed on April 20, 2021, which claims benefit of priority to U.S. Provisional Application No. 17 / 499,398, entitled "METHOD AND APPARATUS FOR SPACE OF INTEREST OF AUDIO SCENE," filed on October 12, 2021. The disclosures of the prior applications are incorporated herein by reference in their entireties.

[0002] (Technical field) This disclosure describes embodiments generally relating to audio scene representations. [Background technology]

[0003] The background statement provided herein is intended to generally present the context of the present disclosure. The work of the currently named inventors, to the extent that their work is described in this background section, and aspects of the statement that may not otherwise qualify as prior art at the time of filing, are not admitted explicitly or implicitly as prior art to the present disclosure.

[0004] A region of interest (ROI) is a region of a sample within a dataset that is identified for a particular purpose. The concept of ROI is commonly used in many application areas, such as medical imaging, geographic information systems, computer vision, optical character recognition, and the like.

[0005] Although ROIs can be used for one-dimensional audio signals, in audio scenes such concepts may not be directly applicable. In this disclosure, a method is provided for representing a space of interest of an audio scene. Summary of the Invention

[0006] An aspect of the present disclosure provides an apparatus for decoding audio data of an audio scene. One apparatus includes a processing circuitry that receives first audio source data and second audio source data. The first audio source data corresponds to a space of interest in the audio scene, and the second audio source data does not correspond to a space of interest in the audio scene. The space of interest of the audio scene is represented by at least one of a viewer space, an audio channel, or an audio object. The processing circuitry decodes the first audio source data based on the space of interest.

[0007] In one embodiment, the processing circuitry determines that the second audio source data should not be decoded based on the second audio source data being determined to not correspond to the space of interest.

[0008] In one embodiment, the processing circuitry decodes the first audio source data based on a first decoding scheme and the processing circuitry decodes the second audio source data based on a second decoding scheme that is different from the first decoding scheme.

[0009] In one embodiment, the encoding schemes used in encoding the first audio source data and the second audio source data are different.

[0010] In one embodiment, the bit allocation schemes used in encoding the first audio source data and the second audio source data are different.

[0011] In one embodiment, the processing circuitry renders audio content of the first audio source data based on a first audio rendering scheme, and the processing circuitry renders audio content of the second audio source data based on a second audio rendering scheme that is different from the first audio rendering scheme.

[0012] In one embodiment, the processing circuitry determines that audio content of the first audio source data should be rendered and that audio content of the second audio source data should not be rendered based on determining that the second audio source data does not correspond to the space of interest.

[0013] In one embodiment, the first and second decoding schemes are of different complexity.

[0014] An aspect of the present disclosure provides a method for decoding audio data of an audio scene. In one method, first audio source data and second audio source data are received. The first audio source data corresponds to a space of interest in the audio scene, and the second audio source data does not correspond to a space of interest in the audio scene. The space of interest in the audio scene is represented by at least one of a viewer space, an audio channel, or an audio object. The first audio source data is decoded based on the space of interest.

[0015] An aspect of the present disclosure provides an apparatus for encoding audio data of an audio scene. One apparatus includes a processing circuitry that receives audio content of a plurality of audio sources in the audio scene. The processing circuitry determines, for each of the plurality of audio sources, whether the respective audio source is within a space of interest in the audio scene. The space of interest in the audio scene is represented by at least one of a viewer space, an audio channel, or an audio object. The processing circuitry determines that the audio content of the respective audio source should be encoded according to a first encoding scheme based on the respective audio source being within the space of interest in the audio scene. The processing circuitry determines that the audio content of the respective audio source should be one of (i) not encoded or (ii) encoded according to a second encoding scheme based on the respective audio source not being within the space of interest in the audio scene. The second encoding scheme is different from the first encoding scheme.

[0016] In one embodiment, the audio content of a respective audio source is not encoded based on the respective audio source not being within a space of interest within the audio scene.

[0017] In one embodiment, the audio content of each audio source is encoded according to a second encoding scheme based on the respective audio source not being within a space of interest in the audio scene.

[0018] In one embodiment, the first encoding scheme is a first bit allocation scheme and the second encoding scheme is a second bit allocation scheme that is different from the first bit allocation scheme.

[0019] An aspect of the present disclosure provides a method for encoding audio data of an audio scene. In one method, audio content of a plurality of audio sources in the audio scene is received. For each of the plurality of audio sources, it is determined whether the respective audio source is within a space of interest in the audio scene. The space of interest in the audio scene is represented by at least one of a viewer space, an audio channel, or an audio object. It is determined that the audio content of the respective audio source is encoded according to a first encoding scheme based on the respective audio source being within the space of interest in the audio scene. It is determined that the audio content of the respective audio source is one of (i) not to be encoded or (ii) to be encoded according to a second encoding scheme based on the respective audio source not being within the space of interest in the audio scene. The second encoding scheme is different from the first encoding scheme.

[0020] An aspect of the present disclosure provides a non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform any one or combination of methods for encoding / decoding audio data of an audio scene.

[0021] Further features, nature and various advantages of the disclosed subject matter will become more apparent from the following detailed description and the accompanying drawings. [Brief description of the drawings]

[0022] [Figure 1] 1 illustrates an exemplary sweet spot of an audio scene according to one embodiment of the present disclosure.

[0023] [Diagram 2] 1 illustrates an example of an auditory space with a limited range of altitudes according to one embodiment of the present disclosure.

[0024] [Diagram 3] 1 illustrates an example of a ball-shaped auditory space according to one embodiment of the present disclosure.

[0025] [Figure 4] 1 illustrates an example of an auditory space with a rolling ball shape according to an embodiment of the present disclosure.

[0026] [Diagram 5] 1 illustrates an exemplary flow chart according to one embodiment of the present disclosure.

[0027] [Figure 6] 1 illustrates another exemplary flow chart according to an embodiment of the present disclosure.

[0028] [Figure 7] FIG. 1 is a schematic diagram of a computer system according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] I. Representation of Space of Interest

[0030] This disclosure includes a method of audio scene description. A space of interest within an audio scene is described in this disclosure. The space of interest can be defined as the boundary (or contour or shape) of the space under consideration in the audio scene. The space of interest can be used in audio coding, processing, rendering, and the like.

[0031] It should be noted that the methods contained in this disclosure can be used separately or in combination. The methods can be used in part or as a whole.

[0032] An audio scene is a semantically coherent sound segment characterized by one or more dominant sound sources. An audio scene can be modeled as a collection of sound sources. In some embodiments, an audio scene can be dominated by a subset of the collection of sound sources. The subset of the collection of sound sources can be considered as sound sources in a space of interest.

[0033] In some embodiments, a subset of the collection of sound sources representing an audio scene can be determined based on the positions of the sound sources within the audio scene, i.e. a space of interest can be determined based on the positions of the sound sources within the audio scene.

[0034] In one embodiment, the space of interest can be represented by the space in which the viewer (listener) can move. For example, the entire space can be divided into one or more areas in which the viewer can move and other areas in which the viewer cannot move. Thus, the space of interest can be represented by a collection of areas in which the viewer can move. Sound sources within the areas in which the viewer can move can be considered as sound sources within the space of interest that represent an audio scene, while sound sources within areas in which the viewer cannot move can be considered as sound sources outside the space of interest area and may not represent an audio scene.

[0035] In one embodiment, the space of interest can be represented by sweet spot(s) in the audio scene where an individual (e.g., a listener) can fully hear the audio mix produced by the audio mixer in the way it is intended to be heard. In the case of surround sound, the sweet spot is the focal point between multiple speakers such that all wave fronts arrive at the same time.

[0036] FIG. 1 shows an exemplary sweet spot of an audio scene according to one embodiment of the present disclosure. In FIG. 1, the sweet spot of an audio scene is the intersection of the areas covered by the sound sources labeled 1 to 7. Thus, the sweet spot is shown as a circle around the chair in FIG. 1. In some cases, such as international recommendations, the sweet spot can be called a reference listening point.

[0037] In some embodiments, the space of interest can be represented by an auditory space.

[0038] In one embodiment, the space of interest can be represented by an auditory space with a limited range of elevations, for example, the space of interest can be represented by two numbers, where the auditory space lies within the elevation between these two numbers.

[0039] Figure 2 shows an example of an auditory space with altitudes between 0.0 and 4.0 m.

[0040] In one embodiment, the space of interest can be represented by an auditory space with a rectangular prism. The representation can be the coordinates of two diagonal vertices of the rectangular prism. The representation can be the coordinates of one vertex of the rectangular prism, and the values ​​of the height, width, and length of the rectangular prism. In some cases, the rectangular prism may not always be vertical or horizontal, so directional information of the rectangular prism can be described.

[0041] In one embodiment, the space of interest can be represented by an auditory space having a polyhedral shape. The representation can be the coordinates of the vertices of the polyhedral shape. The representation can be a collection of the surfaces of the polyhedral shape.

[0042] In one embodiment, the interest space can be represented by an auditory space with a ball shape centered at the location of the listener, as shown in Figure 3. The representation can be the coordinates of the center of the ball shape, and the value of the radius of the ball shape.

[0043] In one embodiment, the interest space can be represented by an auditory space with a rolling ball shape. The center of the rolling ball shape can be along the viewer's walking path, as shown in Figure 4. The representation can be a function describing the walking path and the radius of the rolling ball shape.

[0044] In one embodiment, the space of interest can be represented by a combination of audio channels from a multi-channel audio, for example the representation can be a set of front left and front right channels from a 7.1 audio channel.

[0045] In one embodiment, the space of interest can be represented by a combination of audio objects. For example, a hospital audio scene can include the following audio objects: door, table, chair, TV, radio, doctor, and patient. That is, the hospital audio scene can include various audio sources such as sounds of or from the door, table, chair, TV, radio, doctor, and patient. The space of interest in this example can be represented by the set of door, doctor, and patient.

[0046] According to aspects of the disclosure, a space of interest can be represented by a collection of two or three types of items: a space in which a viewer can move (called a viewer space), audio channels, and audio objects. That is, the space of interest of an audio scene can be represented by a collection of viewer spaces, audio channels, and / or audio objects.

[0047] According to some embodiments of the present disclosure, audio content may be encoded based on a space of interest, for example, an audio encoder may apply different encoding strategies to audio content of one or more audio sources within the space of interest and audio content of one or more audio sources outside the space of interest.

[0048] In one embodiment, for audio content of audio sources within the space of interest, the encoder may apply a first bit allocation scheme that is different from a second bit allocation scheme used for audio content of audio sources outside the space of interest, e.g., the number of bits allocated to audio content of audio sources within the space of interest is greater than the number of bits allocated to audio content of audio sources outside the space of interest.

[0049] In one embodiment, the encoder can only encode audio content of audio sources within the space of interest and can discard audio content of audio sources outside the space of interest.

[0050] According to some embodiments of the present disclosure, audio content can be decoded based on a space of interest, for example, an audio decoder can apply different decoding strategies to encoded audio content of audio sources within the space of interest and encoded audio content of audio sources outside the space of interest.

[0051] In one embodiment, the audio decoder can apply one audio decoding scheme to the encoded audio content of the audio source in the space of interest and another audio decoding scheme to the encoded audio content of the audio source outside the space of interest. In one example, the complexity of the two audio decoding schemes can be different. The complexity of the audio decoding scheme applied to the encoded audio content of the audio source in the space of interest is higher than the complexity of the audio decoding scheme applied to the encoded audio content of the audio source outside the space of interest. The decoding complexity in this specification can refer to the number of central processing unit (CPU) instructions consumed by the processor to decode the encoded bitstream.

[0052] In one embodiment, the audio decoder can only decode the encoded audio content of audio sources within the space of interest. The encoded audio content of audio sources outside the space of interest can be discarded.

[0053] According to some embodiments of the present disclosure, audio rendering can be performed based on a space of interest, for example, an audio renderer can apply different audio rendering schemes to decoded audio content of audio sources within the space of interest and decoded audio content of audio sources outside the space of interest.

[0054] In one embodiment, the audio renderer can apply one audio rendering scheme to the decoded audio content of the audio sources within the space of interest and another audio rendering scheme to the decoded audio content of the audio sources outside the space of interest. In one example, the rendering quality of the two audio rendering schemes can be different. For example, the complexity of the audio rendering scheme applied to the decoded audio content of the audio sources within the space of interest is higher than the complexity of the audio rendering scheme applied to the decoded audio content of the audio sources outside the space of interest, so that the rendering quality of the decoded audio content of the audio sources within the space of interest is better than the rendering quality of the decoded audio content of the audio sources outside the space of interest.

[0055] In one embodiment, the audio renderer can only render decoded audio content of audio sources within the space of interest and can discard decoded audio content of audio sources outside the space of interest.

[0056] II. Flowchart

[0057] FIG. 5 shows a flow chart outlining an exemplary process (500) according to one embodiment of the present disclosure. In various embodiments, the process (500) is performed by processing circuitry, such as the processing circuitry shown in Figure 7. In some embodiments, the process (500) is implemented with software instructions, such that when the processing circuitry executes the software instructions, the processing circuitry performs the process (500).

[0058] The process (500) generally begins at step (S510), where the process (500) receives first audio source data and second audio source data. The first audio source data corresponds to a space of interest in an audio scene, and the second audio source data does not correspond to a space of interest in the audio scene. The space of interest in the audio scene is represented by at least one of a viewer space, an audio channel, or an audio object. The process (500) then proceeds to step (S520).

[0059] In step S520, the process 500 decodes the first audio source data based on the space of interest. The process 500 then ends.

[0060] In one embodiment, the process (500) determines that the second audio source data is not to be decoded based on the second audio source data being determined not to correspond to the space of interest.

[0061] In one embodiment, the process (500) decodes first audio source data based on a first decoding scheme and the process (500) decodes second audio source data based on a second decoding scheme that is different from the first decoding scheme.

[0062] In one embodiment, the encoding schemes used in encoding the first audio source data and the second audio source data are different.

[0063] In one embodiment, the bit allocation schemes used in encoding the first audio source data and the second audio source data are different.

[0064] In one embodiment, the process (500) renders audio content of a first audio source data based on a first audio rendering scheme and the process (500) renders audio content of a second audio source data based on a second audio rendering scheme that is different from the first audio rendering scheme.

[0065] In one embodiment, the process (500) determines that the audio content of the first audio source data should be rendered and that the audio content of the second audio source data should not be rendered based on the second audio source data being determined not to correspond to the space of interest.

[0066] In one embodiment, the first and second decoding schemes are of different complexity.

[0067] Figure 6 shows another flow chart outlining an exemplary process (600) according to one embodiment of the present disclosure. In various embodiments, the process (600) is performed by processing circuitry, such as the processing circuitry shown in Figure 7. In some embodiments, the process (600) is implemented with software instructions, such that the processing circuitry performs the process (600) when the processing circuitry executes the software instructions.

[0068] The process (600) generally begins at step (S610) where the process (600) receives audio content from multiple audio sources within an audio scene. The process (600) then proceeds to step (S620).

[0069] In step (S620), the process (600) determines, for each of the multiple audio sources, whether the respective audio source is within a space of interest in the audio scene. The space of interest in the audio scene is represented by at least one of a viewer space, an audio channel, or an audio object. Based on the respective audio source being within the space of interest in the audio scene, the process (600) proceeds to step (S630). Otherwise, the process (600) proceeds to step (S640).

[0070] In step (S630), the process (600) determines that the audio content of each audio source should be encoded according to a first encoding scheme based on the location of each audio source in a space of interest within the audio scene. Then, the process (600) proceeds to step (S640).

[0071] In step (S640), the process (600) determines that the audio content of the respective audio source is either (i) not to be encoded or (ii) to be encoded according to a second encoding scheme based on the respective audio source not being within a space of interest in the audio scene, the second encoding scheme being different from the first encoding scheme.

[0072] The process (600) then ends.

[0073] In one embodiment, the audio content of a respective audio source is not encoded based on the respective audio source not being in a space of interest within the audio scene.

[0074] In one embodiment, the audio content of each audio source is encoded according to a second encoding scheme based on the respective audio source not being in a space of interest within the audio scene.

[0075] In one embodiment, the first encoding scheme is a first bit allocation scheme and the second encoding scheme is a second bit allocation scheme that is different from the first bit allocation scheme.

[0076] III. Computer Systems

[0077] The techniques described above can be implemented as computer software using computer readable instructions and can be physically stored in one or more computer readable media. For example, Figure 7 illustrates a computer system (700) suitable for implementing certain embodiments of the disclosed subject matter.

[0078] Computer software can be coded using any suitable machine code or computer language, which may be subject to assembly, compilation, linking, or similar mechanisms, to produce code containing instructions that can be executed by one or more computer central processing units (CPUs), graphics processing units (GPUs), and the like, either directly, or through interpretation, microcode execution, and the like.

[0079] The instructions may be executed on various types of computers or components thereof, including, for example, personal computers, tablet computers, servers, smart phones, gaming devices, Internet of Things devices, and the like.

[0080] 7 for computer system (700) are exemplary in nature and are not intended to suggest any limitation as to the scope of use or functionality of the computer software implementing the embodiments of the present disclosure. The arrangement of components should not be interpreted as having any dependency or requirement regarding any one or combination of components illustrated in the exemplary embodiment of computer system (700).

[0081] The computer system (700) may include certain human interface input devices. Such human interface input devices may be responsive to input by one or more human users through, for example, tactile input (such as keystrokes, swipes, data glove movements), audio input (such as voice, clapping), visual input (such as gestures), or olfactory input (not shown). Human interface devices may also be used to capture certain media that may not necessarily be directly related to conscious human input, such as audio (such as speech, music, ambient sounds), images (such as scanned images, photographic images obtained from a still image camera), and video (such as two-dimensional video, three-dimensional video including stereoscopic video).

[0082] The input human interface devices may include one or more (one of each is depicted) of a keyboard (701), a mouse (702), a trackpad (703), a touch screen (710), a data glove (not shown), a joystick (705), a microphone (706), a scanner (707), and a camera (708).

[0083] The computer system (700) may also include certain human interface output devices. Such human interface output devices may stimulate one or more of the senses of a human user, for example, through haptic output, sound, light, and smell / taste. Such human interface output devices may include haptic output devices (e.g., haptic feedback via a touch screen (710), data gloves (not shown), or joystick (705), although there may also be haptic feedback devices that do not function as input devices), CRT screens, LCD screens, plasma screens, OLED screens, each with or without touch screen input capability, each with or without haptic feedback capability, some of which may output two-dimensional visual output or output in more than three dimensions through means such as stereoscopic output, audio output devices (such as speakers (709), headphones (not shown)), virtual reality glasses (not shown), holographic displays and smoke tanks (not shown), and printers (not shown). These visual output devices (such as a screen 710 ) can be connected to the system bus 748 through a graphics adapter 750 .

[0084] The computer system (700) may also include human accessible storage devices and their associated media, including CD / DVD ROM / RW (720) with CD / DVD or equivalent media (721), thumb drives (722), removable hard drives or solid state drives (723), legacy magnetic media such as tapes and floppy disks (not shown), specialized ROM / ASIC / PLD based devices such as security dongles (not shown), and the like.

[0085] Those skilled in the art will also understand that the term "computer-readable medium" as used in connection with the presently disclosed subject matter does not encompass transmission media, carrier waves, or other transient signals.

[0086] The computer system (700) may also include a network interface (754) to one or more communication networks (755). The one or more communication networks (755) may be, for example, wireless, wired, optical. The one or more communication networks (755) may further be local, wide area, metropolitan, vehicular and industrial, real-time, delay tolerant, etc. Examples of the one or more communication networks (755) include Ethernet, wireless LAN, cellular networks including GSM, 3G, 4G, 5G, LTE and the like, wired and wireless wide area or digital networks including cable TV, satellite TV, terrestrial broadcast TV, vehicular and industrial including CANBus, etc. Certain networks generally require an external network interface adapter attached to a particular general-purpose data port (e.g., a USB port of the computer system (700)) or peripheral bus (749), while other networks are generally integrated into the core of the computer system (700) by connection to a system bus described below (e.g., an Ethernet interface to a PC computer system or a cellular network interface to a smartphone computer system). Using any of these networks, computer system (700) can communicate with other entities. Such communications can be uni-directional, receive only (e.g., broadcast television), uni-directional transmit only (e.g., CANbus to a particular CANbus device), or bi-directional, for example, to other computer systems using local or wide area digital networks. Specific protocols and protocol stacks can be used with each of these networks and network interfaces, as described above.

[0087] The aforementioned human interface devices, human accessible storage devices, and network interfaces may be attached to the core (740) of the computer system (700).

[0088] The core (740) may include one or more central processing units (CPUs) (741), graphics processing units (GPUs) (742), specialized programmable processing units in the form of field programmable gate areas (FPGAs) (743), hardware accelerators for specific tasks (744), graphics adapters (750), etc. These devices may be connected, for example, through a system bus (748), along with read only memory (ROM) (745), random access memory (746), internal mass storage devices (747) such as internal non-user accessible hard drives, SSDs, and the like. In some computer systems, the system bus (748) may be accessible in the form of one or more physical plugs to allow expansion with additional CPUs, GPUs, and the like. Peripheral devices may be attached directly to the core's system bus (748) or through a peripheral bus (749). In one example, a screen (710) may be connected to the graphics adapter (750). Peripheral bus architectures include PCI, USB, and the like.

[0089] The CPU (741), GPU (742), FPGA (743), and accelerator (744) can execute certain instructions, which in combination can constitute the above-mentioned computer code. The computer code can be stored in ROM (745) or RAM (746). Permanent data can be stored, for example, in internal mass storage device (747), while transient data can also be stored in RAM (746). Rapid storage and retrieval in any of the memory devices can be enabled through the use of cache memory, which can be closely associated with one or more of the CPU (741), GPU (742), mass storage device (747), ROM (745), RAM (746), and the like.

[0090] The computer-readable medium can have computer code thereon for performing various computer-implemented operations. The media and computer code can be those specially designed and constructed for the purposes of the present disclosure, or they can be of the kind well known and available to those skilled in the computer software arts.

[0091] As an example, and not by way of limitation, a computer system having the architecture (700) and specifically the core (740) can provide functionality as a result of a processor (including a CPU, GPU, FPGA, accelerator, and the like) executing software embodied in one or more tangible computer-readable media. Such computer-readable media can be media associated with the user-accessible mass storage devices introduced above, as well as specific storage devices of the core (740) that have a non-transitory nature, such as the core internal mass storage device 747 or the ROM 745. Software implementing various embodiments of the present disclosure can be stored in such devices and executed by the core (740). The computer-readable media can include one or more memory devices or chips according to specific needs. The software can cause the core (740) and specifically the processor therein (including a CPU, GPU, FPGA, and the like) to perform certain processes or certain parts of certain processes described herein, including defining data structures stored in the RAM (746) and modifying such data structures according to processes defined by the software. Additionally or alternatively, the computer system may provide functionality as a result of logic hardwired or otherwise embodied in circuitry (e.g., accelerator (744)), which may operate in place of or in conjunction with software to perform particular processes or particular portions of particular processes described herein. Reference to software includes logic, and vice versa, where appropriate. Reference to computer-readable medium may encompass circuitry (such as an integrated circuit (IC)) that stores software for execution, circuitry that embodies logic for execution, or both, where appropriate. The present disclosure encompasses any suitable combination of hardware and software.

[0092] While this disclosure has described several exemplary embodiments, there are alterations, permutations, and various substitute equivalents which are within the scope of this disclosure. Thus, it will be appreciated that those skilled in the art will be able to devise numerous systems and methods which, although not explicitly shown or described herein, embody the principles of the present disclosure and are therefore within the spirit and scope of the present disclosure.

Claims

1. 1. A method for decoding audio data of an audio scene, comprising the steps of: receiving first audio source data and second audio source data, the first audio source data corresponding to a space of interest in the audio scene and the second audio source data not corresponding to the space of interest in the audio scene, the space of interest in the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; and decoding the first audio source data based on the space of interest; the decoding includes decoding the first audio source data based on a first decoding scheme; The method further includes decoding the second audio source data based on a second decoding scheme different from the first decoding scheme. method.

2. 1. A method for decoding audio data of an audio scene, comprising the steps of: receiving first audio source data and second audio source data, the first audio source data corresponding to a space of interest in the audio scene and the second audio source data not corresponding to the space of interest in the audio scene, the space of interest in the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; and decoding the first audio source data based on the space of interest; the encoding schemes used in encoding the first audio source data and the second audio source data are different. method.

3. 1. A method for decoding audio data of an audio scene, comprising the steps of: receiving first audio source data and second audio source data, the first audio source data corresponding to a space of interest in the audio scene and the second audio source data not corresponding to the space of interest in the audio scene, the space of interest in the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; and decoding the first audio source data based on the space of interest; rendering audio content of the first audio source data based on a first audio rendering scheme; and rendering audio content of the second audio source data based on a second audio rendering scheme different from the first audio rendering scheme. method.

4. The method of claim 2 , further comprising: determining that the second audio source data should not be decoded based on the second audio source data not corresponding to the space of interest.

5. The method according to any one of claims 1 to 3, wherein the bit allocation schemes used in encoding the first audio source data and the second audio source data are different.

6. 3. The method of claim 1, further comprising determining, based on the second audio source data being determined not to correspond to the space of interest, that an audio content of the first audio source data should be rendered and that an audio content of the second audio source data should not be rendered.

7. The method of claim 1 , wherein the first and second decoding schemes have different complexities.

8. 1. A method for encoding audio data of an audio scene, comprising the steps of: receiving audio content for a plurality of audio sources within the audio scene; determining, for each of the plurality of audio sources, whether the respective audio source is within a space of interest within the audio scene, the space of interest within the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; determining, based on the respective audio source being within the space of interest within the audio scene, that the audio content of the respective audio source should be encoded according to a first encoding scheme; determining, based on the respective audio source not being within the space of interest within the audio scene, that the audio content of the respective audio source is one of: (i) not to be encoded; or (ii) to be encoded according to a second encoding scheme, the second encoding scheme being different from the first encoding scheme; method.

9. The method of claim 8 , wherein the audio content of the respective audio source is not encoded based on the respective audio source not being within the space of interest in the audio scene.

10. The method of claim 8 , wherein the audio content of the respective audio source is encoded according to the second encoding scheme based on the respective audio source not being within the space of interest in the audio scene.

11. 9. The method of claim 8, wherein the first encoding scheme is a first bit allocation scheme and the second encoding scheme is a second bit allocation scheme that is different from the first bit allocation scheme.

12. 1. An apparatus for representing a space of interest of an audio scene, the apparatus comprising processing circuitry, the processing circuitry is configured to receive first audio source data and second audio source data, the first audio source data corresponding to a space of interest within the audio scene and the second audio source data not corresponding to the space of interest within the audio scene, the space of interest within the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; the processing circuitry is configured to decode the first audio source data based on the space of interest; The processing circuitry includes: Decoding the first audio source data based on a first decoding scheme; decoding the second audio source data based on a second decoding scheme different from the first decoding scheme; It is configured as follows: Device.

13. 1. An apparatus for representing a space of interest of an audio scene, the apparatus comprising processing circuitry, the processing circuitry is configured to receive first audio source data and second audio source data, the first audio source data corresponding to a space of interest within the audio scene and the second audio source data not corresponding to the space of interest within the audio scene, the space of interest within the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; the processing circuitry is configured to decode the first audio source data based on the space of interest; the encoding schemes used in encoding the first audio source data and the second audio source data are different. Device.

14. 1. An apparatus for representing a space of interest of an audio scene, the apparatus comprising processing circuitry, the processing circuitry is configured to receive first audio source data and second audio source data, the first audio source data corresponding to a space of interest within the audio scene and the second audio source data not corresponding to the space of interest within the audio scene, the space of interest within the audio scene being represented by at least one of a listener space, an audio channel, or an audio object; the processing circuitry is configured to decode the first audio source data based on the space of interest; The processing circuitry includes: Rendering audio content of the first audio source data based on a first audio rendering scheme; rendering audio content of the second audio source data according to a second audio rendering scheme different from the first audio rendering scheme; It is configured as follows: Device.

15. 14. The apparatus of claim 13, wherein the processing circuitry is configured to determine that the second audio source data should not be decoded based on determining that the second audio source data does not correspond to the space of interest.

16. Apparatus according to any one of claims 12 to 14, wherein bit allocation schemes used in encoding the first audio source data and the second audio source data are different.

17. 14. The apparatus of claim 12 or 13, wherein the processing circuitry is configured to determine, based on determining that the second audio source data does not correspond to the space of interest, that audio content of the first audio source data should be rendered and that audio content of the second audio source data should not be rendered.

18. The apparatus of claim 12 , wherein the first and second decoding schemes have different complexities.

19. A non-transitory computer-readable medium storing instructions, comprising: The instructions, when executed by at least one processor, cause the method of any one of claims 1 to 11 to be performed. Non-transitory computer-readable medium.

Images