Codec bitrate selection in audio object coding

Abstract

According to an embodiment of the disclosure, a computer-implemented method may include analyzing, by a computing device, spatial object-based audio content associated with one or more objects. According to an embodiment of the disclosure, a computer-implemented method may include identifying, by the computing device, one or more relative perceptual importance metrics of the one or more objects based on modeling. According to an embodiment of the disclosure, a computer-implemented method may include allocating, by the computing device, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.

Description

CODEC BITRATE SELECTION IN AUDIO OBJECT CODING

[0001] One or more embodiments relate generally to codec bitrates, and in particular, to providing codec bitrate selection in audio object coding.

[0002] Immersive audio is gaining popularity for consumer audio. One important aspect of immersive audio delivery is audio coding, which involves transmission of audio data with an efficient perceptual quality versus bitrate tradeoff. While there are open-source tools such as Opus codec that are competitive for traditional audio formats such as stereo, there are aspects of newer immersive formats that are not well addressed. In fact, the Opus codec, for example, does not handle more than two channels (stereo format) within the core codec itself, and thus cannot optimally exploit correlations and divide bitrates jointly among the channels.

[0003] In addition to new multichannel formats (such as 7.1.4., etc.), and scene-based audio, object-based content may also require special handling. "Audio object" can refer to or can involve a stem track that has both audio data and spatial position metadata. The immersive format uses this positional metadata to render objects so that they remain agnostic to the listening setup, and the same content can be listened with, for example, headphones or a multi-speaker setup.

[0004] Typically, the objects are not interactive in that their relative levels do not change in playback. More than channels, objects can also vary much in their sparsity (e.g., proportion of inactivity) and overall perceptual importance. Also, the number of objects in particular content can potentially be large due to the nature of the content creation process.

[0005] According to an embodiment of the disclosure, a computer-implemented method may include analyzing, by a computing device, spatial object-based audio content associated with one or more objects. According to an embodiment of the disclosure, a computer-implemented method may include identifying, by the computing device, one or more relative perceptual importance metrics of the one or more objects based on modeling. According to an embodiment of the disclosure, a computer-implemented method may include allocating, by the computing device, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.

[0006] According to an embodiment of the disclosure, processor-readable medium that includes a program that when executed by a processor may provide codec bitrate selection in audio object coding. According to an embodiment of the disclosure, the processor may be configured to analyze spatial object-based audio content associated with one or more objects. According to an embodiment of the disclosure, the processor may be configured to identify one or more relative perceptual importance metrics of the one or more objects based on modeling. According to an embodiment of the disclosure, the processor may be configured to allocate based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.

[0007] According to an embodiment of the disclosure, an apparatus comprising a memory storing instructions and at least one processor executes the instructions is provided. According to an embodiment of the disclosure, the at least one processor may be configured to analyze spatial object-based audio content associated with one or more objects. According to an embodiment of the disclosure, the at least one processor may be configured to identify one or more relative perceptual importance metrics of the one or more objects based on modeling. According to an embodiment of the disclosure, the at least one processor may be configured to allocate, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.

[0008] For a fuller understanding of the nature and advantages of the embodiments, as well as a preferred mode of use, reference should be made to the following detailed description read in conjunction with the accompanying drawings, in which:

[0009] FIG. 1 illustrates a block diagram of a method for codec bitrate selection in audio object coding, according to an embodiment;

[0010] FIG. 2 illustrates a block diagram for perceptual importance computation processing, according to an embodiment;

[0011] FIG. 3 illustrates a block diagram for details of the perceptual importance computation processing, according to an embodiment;

[0012] FIG. 4 illustrates a block diagram for perceptual importance computation processing, according to an embodiment;

[0013] FIG. 5 illustrates a block diagram for narrative and perceptual importance computation processing, according to an embodiment; and

[0014] FIG. 6 illustrates a process for codec bitrate selection in audio object coding, according to an embodiment.

[0015] The following description is made for the purpose of illustrating the general principles of one or more embodiments and is not meant to limit the inventive concepts claimed herein. Further, particular features described herein can be used in combination with other described features in each of the various possible combinations and permutations. Unless otherwise specifically defined herein, all terms are to be given their broadest possible interpretation including meanings implied from the specification as well as meanings understood by those skilled in the art and / or as defined in dictionaries, treatises, etc.

[0016] A description of example embodiments is provided on the following pages. The text and figures are provided solely as examples to aid the reader in understanding the disclosed technology. They are not intended and are not to be construed as limiting the scope of this disclosed technology in any manner. Although certain embodiments and examples have been provided, it will be apparent to those skilled in the art based on the disclosures herein that changes in the embodiments and examples shown may be made without departing from the scope of this disclosed technology.

[0017] One or more embodiments relate generally to codec bitrates, and in particular, provides codec bitrate selection in audio object coding. One embodiment provides a computer-implemented method that includes analyzing, by a computing device, spatial object-based audio content associated with one or more objects. One or more relative perceptual importance metrics of the one or more objects are determined, by the computing device, based on modeling. Based on the one or more relative perceptual importance metrics, resources are allocated, by the computing device, for improving overall audio quality relative to bitrate.

[0018] For example, the spatial object-based audio content may include object-based audio content.

[0019] In an embodiment, there may be two main options regarding immersive audio coding: 1) proprietary tools that are tailored for immersive content (these include DOLBY®Audio Compression (DOLBY®AC-4) and Moving Picture Experts Group-High Efficiency 3D (MPEG-H 3D)) audio, or 2) open source tools that are competitive in traditional formats such as stereo, but lack in their handling of immersive audio, with Opus being an example. One solution would be to modify open source code directly. However, this may be inefficient and / or costly. Furthermore, there is inertia in adoption of new audio codecs and formats, and many are inclined to use established tools.

[0020] Some approaches can use pre- and postprocessing tools that work with a legacy tool such as Opus. Such approaches may improve the capabilities of handling something that the legacy system was not designed for. For instance, there can be some tools for scene-based Ambisonics-format audio. So called channel-mapping techniques combine different Ambisonics channels to several mono- or stereo parts that can then be compressed by a standard codec like Opus, and expanded back at the decoding stage.

[0021] An embodiment provides analyzing spatial object-based audio content associated with one or more objects to determine relative perceptual importance metrics of the one or more objects, based on modeling (e.g., rendering-agnostic psychoacoustic modeling, or modelling that is agnostic to the rendering, or modelling that does not necessarily need or require object positional metadata). One or more embodiments provide allocating, based on the relative perceptual importance metrics, resources including a total available bitrate among the one or more objects in a legacy audio codec (e.g., Opus) for improving (e.g., maximizing) overall audio quality relative to bitrate. An embodiment may provide one or more perceptual measures to analyze one or more object signals of the object-based audio content, where the relative perceptual importance metrics include the one or more perceptual measures. In an embodiment, the one or more perceptual measures may be optimized for maximizing local, and overall, audio quality relative to bitrate.

[0022] Rendering is the process of calculating how object-based content is played back in given loudspeaker layout, like stereo, headphones or 5.1. Object audio content need to be rendered in order to listen it as intended, and it can adapt to different layouts. According to an embodiment of the disclosure, the method (e.g., rendering-agnostic psychoacoustic modeling) may do however not require knowledge about the rendering situation because of the assumptions and methods, the method may analyze the input content directly.

[0023] FIG. 1 illustrates a block diagram of a method for codec bitrate selection in audio object coding, according to an embodiment. In one or more embodiments, the method includes, as input, object-based audio content 105, perceptual importance calculation processing 110, bitrate allocation engine 115, legacy audio codec instances 120 and the output of coded object-based audio content 125. In an embodiment, the method analyzes content including one or more audio object time-domain signals. For each object, the method assigns a scalar importance measure from the perceptual importance calculation processing 110. In an embodiment, the set of all these measures is the objects' relative perceptual importance. In an embodiment, a legacy audio codec, such as Opus, is operated as monophonic, one coding instance per object signal. For each codec instance, a target bitrate can be given as one or more parameters. In an embodiment, other codec parameters can also be controlled by the importance. The final assigned bitrates may be allocated based on hyperparameters (including one or more of, but not limited to): total available bitrate for all objects (e.g., whole content); low limit bitrate per object; and / or maximum bitrate per object. In an embodiment, the latter two may depend on the codec, and possibly other aspects in some instances.

[0024] Bitrate (e.g., transmission bandwidth) may be a resource for transmitting multimedia content. According to an embodiment of the disclosure, the method tries to maximize the quality with given bitrate. For example, the resource may be used to describe that the bitrate is allocated a certain limited budget e.g. 256 kbits / second. The resource may be used to improve the quality.

[0025] In an embodiment, an iterative loop assigns the available bit reservoir to each object according to the relative perceptual importance from the perceptual importance calculation processing 110. In case there is overflow over the maximum rate (e.g., maximum bitrate per object), those bits may be set as the new bit reservoir, and the process can be repeated until the reservoir is depleted.

[0026] FIG. 2 illustrates a block diagram for perceptual importance computation processing 110, according to an embodiment. In one or more embodiments, the perceptual importance computation processing 110 includes perceptual frequency banding and weighting processing 205, total energy - factor processing 210, proportion of being unmasked-factor processing 215 and a final measure processing 220. In an embodiment, the disclosure can combine multiple (e.g., two) factors in a perceptual importance measure. First, intuitively a signal that has more total energy would need more bits in order to represent its audio well, compared to a signal that is mostly silent. For this, the total energy - factor processing 210 may compute the total energy - factor as the sum of perceptually weighted band energies (from the perceptual frequency banding and weighting processing 205). The proportion of being unmasked-factor processing 215 may analyze how much each object audio is masked by the other objects. If assuming a masking model in a reverberant room, the masking signal can be approximated by the sum of all objects in the content. The masking signal (e.g., "sum signal") can also include signals that are not in the object content, but are playing simultaneously. Then the proportion of the masker signal can be compared to each individual object signal in perceptual frequency bands and time frames, and the average unmasked perceptually energy of each object signal can be computed. Less artifacts can be assigned if the object is listened solo at any point without any masking signals. An assumption can be that even a temporally local artifact can be detrimental to the overall quality. This can complement the total energy factor with a local unmasking average. While the overall quality impression of an audio segment as a whole is important, there can be another important part of the content that can be very short in duration. In an embodiment, the proportion of being unmasked - factor is more important for some tests (e.g., key tests), so the final measure 220 can be computed as the weighted sum of the two factors with, for example, relations 0.2 and 0.8.

[0027] FIG. 3 illustrates a block diagram 310 for details of the perceptual importance computation processing, according to an embodiment. In one or more embodiments, starting from the audio signal vectors for the individual object 302, and the sum of all signals 301, these are transformed to frequency domain via Short-Time Fourier Transforms (STFT) 303. Each STFT signal is grouped into perceptual frequency bands, that in this case originate from the banding used in the codec. Banding is given a priori via STFT bin indices 311, and the energy of each frequency band normalized by the number of bins in the band is calculated for each time frame 304. A priori relative perceptual importance per frequency band 312 is utilized to weight each band (banding 305) similarly in each sum signal and the individual object signal. This weighting originates from the relative bit assignment in the core audio codec, where typically low-frequency bands are assigned more importance. Total perceptual weighted energy is calculated for the object signal (energy 306). Activity detection block 307 is used to find the non-silent segments of the object signal and at those time frames, the perceptual energy of the frequency bands c compared against the perceptual energy of the sum signal, and averaged over time, and then summed over frequency bands (relation 308). The final scalar importance measure is calculated as the weighted sum of the two factors (total object perceptual energy, and relative energy average compared to sum signal) 309.

[0028] According to an embodiment of the disclosure, 301, 302, 303, 304 and 305 (FIG. 3) may be the part of 205 (FIG. 2). According to an embodiment of the disclosure, 306 (FIG. 3) may be the part of 210 (FIG. 2). According to an embodiment of the disclosure, 307 and 308 (FIG. 3) may be the part of 215 (FIG. 2). According to an embodiment of the disclosure, 309 (FIG. 3) may be the part of 220 (FIG. 2).

[0029] FIG. 4 illustrates a block diagram 410 for perceptual importance computation processing, according to an embodiment. In one embodiment, the disclosure can use a more complicated auditory loudness and masking model 405 that also simulates, for example, cochlea neural activity ("activation") and calculates specific loudness and masking patterns per object signal ( 401, 402, . A higher-level auditory perception model 406 can be utilized to calculate relative object importance measures based on perceptual unmasking. An embodiment can remain rending-agnostic (e.g., may not need or require object positional metadata). In an embodiment, this can be implemented with machine learning (ML) components. In an embodiment, the ML components can be based on (e.g., trained on) given training data. In some instances, based on the relative importance provided by the higher-level auditory perception model 406, the final bitrates can be assigned as with the example associated with the block diagram 310 (FIG. 3), and the final measures are output ( 407, 408, ..., 409).

[0030] FIG. 5 illustrates a block diagram 500 for narrative and perceptual importance computation processing, according to an embodiment. In one or more embodiments, through a plugin software embedded in a Digital Audio Workstation, a content creator can author Narrative Importance (NI) Metadata 503 for certain objects in the object-based audio mix. The NI metadata may be for the whole audio mix or specific to a certain subsection(s) or scene(s). In an embodiment, relevant audio elements may be identified using Audio Classification. NI Metadata may be generated either from a non-context aware approach using an Audio Classification Model (object metadata from Audio classifier 501) and may depend (in an embodiment, may depend only) on the class of each audio object or from a context aware approach: in addition to the audio classification for each object, an Audio Scene Classification Model (scene metadata from audio scene classifier 502) can be used to get the specific context for each scene. The NI of each objects' class is computed relatively to the specific context of the scene and can vary from scene to scene. The NI metadata may be used to adjust particular hyperparameters 505 ( for individual objects during the bitrate per object allocation algorithm 508 after the Scalar measure 506 ( has been computed. These object specific hyperparameters 505 can override global hyperparameters 507 if NI metadata is present. For example, objects marked with NI can be given a higher maximum and minimum individual bitrate than objects without this metadata. This allows for the bit allocation algorithm 508 to prioritize objects with NI while still following the energy-based bit allocation. This results in NI Aware Bit Allocation 509 with output ( 510, 511, ..., 512). Bitrates can be assigned as in block 110 (FIG. 2). For example, the Scalar measure may include the perceptual importance measure.

[0031] FIG. 6 illustrates a process 600 for codec bitrate selection in audio object coding, according to an embodiment. In block 610, process 600 analyzes, by a computing device, spatial object-based audio content associated with one or more objects. In block 620, process 600 determines one or more relative perceptual importance metrics of the one or more objects based on modeling. In block 630, process 600 allocates, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.

[0032] In an embodiment, process 600 includes the feature that the modeling includes rendering-agnostic psychoacoustic modeling.

[0033] In one or more embodiments, process 600 further includes the feature that one or more perceptual measures are provided to analyze one or more object signals of the spatial object-based audio content. The relative perceptual importance metrics include the one or more perceptual measures.

[0034] In one or more embodiments, process 600 additionally provides that improving the overall audio quality relative to bitrate includes maximizing the overall audio quality relative to bitrate.

[0035] In an embodiment, process 600 still further provides the feature that the one or more perceptual measures are optimized for maximizing local and overall audio quality relative to bitrate.

[0036] In one or more embodiments, process 600 additionally provides the feature that the resources include a total available bitrate among the one or more objects in a legacy audio codec.

[0037] In an embodiment, process 600 further provides the feature that the legacy audio codec includes Opus.

[0038] For an embodiment, bitrate / quality tradeoff is significantly improved. In one or more embodiments, the present technology may perform at 480 kbit / s but can still maintain quality as compared to some naive method at 960 kbit / s, which provides a very significant saving. The present technology is suitable to be deployed as a solution for object-based audio, such as in the Version 2 of the Immersive Audio and Formats (IAMF) and in High Dynamic Range10+ (HDR10+) Audio.

[0039] Embodiments have been described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems) and computer program products. Each block of such illustrations / diagrams, or combinations thereof, can be implemented by computer program instructions. The computer program instructions when provided to a processor produce a machine, such that the instructions, which execute via the processor create means for implementing the functions / operations specified in the flowchart and / or block diagram. Each block in the flowchart / block diagrams may represent a hardware and / or software module or logic. In alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures, concurrently, etc.

[0040] The terms "computer program medium," "computer usable medium," "computer readable medium", and "computer program product," are used to generally refer to media such as main memory, secondary memory, removable storage drive, a hard disk installed in hard disk drive, and signals. These computer program products are means for providing software to the computer system. The computer readable medium allows the computer system to read data, instructions, messages or message packets, and other computer readable information from the computer readable medium. The computer readable medium, for example, may include non-volatile memory, such as a floppy disk, ROM, flash memory, disk drive memory, a CD-ROM, and other permanent storage. It is useful, for example, for transporting information, such as data and computer instructions, between computer systems. Computer program instructions may be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0041] As will be appreciated by one skilled in the art, aspects of the embodiments may be embodied as a system, method or computer program product. Accordingly, aspects of the embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit," "module" or "system." Furthermore, aspects of the embodiments may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.

[0042] Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0043] Computer program code for carrying out operations for aspects of one or more embodiments may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0044] Aspects of one or more embodiments are described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems) and computer program products. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0045] These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0046] The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0047] The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustration, and combinations of blocks in the block diagrams and / or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.

[0048] References in the claims to an element in the singular is not intended to mean "one and only" unless explicitly so stated, but rather "one or more." All structural and functional equivalents to the elements of the above-described exemplary embodiment that are currently known or later come to be known to those of ordinary skill in the art are intended to be encompassed by the present claims. No claim element herein is to be construed under the provisions of 35 U.S.C. section 112, sixth paragraph, unless the element is expressly recited using the phrase "means for" or "step for."

[0049] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosed technology. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0050] The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the embodiments has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the embodiments in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the disclosed technology.

[0051] Though the embodiments have been described with reference to certain versions thereof; however, other versions are possible. Therefore, the spirit and scope of the appended claims should not be limited to the description of the preferred versions contained herein.

[0052] According to an embodiment of the disclosure, the modeling may comprise rendering-agnostic psychoacoustic modeling.

[0053] According to an embodiment of the disclosure, a computer-implemented method may include providing one or more perceptual measures to analyze one or more object signals of the spatial object-based audio content. According to an embodiment of the disclosure, relative perceptual importance metrics may include the one or more perceptual measures.

[0054] According to an embodiment of the disclosure, the improving the overall audio quality relative to bitrate may include maximizing the overall audio quality relative to bitrate.

[0055] According to an embodiment of the disclosure, the one or more perceptual measures may be optimized for maximizing local and overall audio quality relative to bitrate.

[0056] According to an embodiment of the disclosure, the resources may include a total available bitrate among the one or more objects in a legacy audio codec.

[0057] According to an embodiment of the disclosure, the legacy audio codec may include Opus.

[0058] According to an embodiment of the disclosure, the processor may be configured to provide one or more perceptual measures to analyze one or more object signals of the spatial object-based audio content. According to an embodiment of the disclosure, relative perceptual importance metrics may include the one or more perceptual measures.

[0059] According to an embodiment of the disclosure, the processor may be configured to maximize the overall audio quality relative to bitrate.

[0060] According to an embodiment of the disclosure, the processor may be configured to optimize the one or more perceptual measures for maximizing local and overall audio quality relative to bitrate.

[0061] According to an embodiment of the disclosure, the at least one processor may be configured to provide one or more perceptual measures to analyze one or more object signals of the spatial object-based audio content. According to an embodiment of the disclosure, the relative perceptual importance metrics include the one or more perceptual measures.

[0062] According to an embodiment of the disclosure, the at least one processor may be configured to maximize the overall audio quality relative to bitrate.

[0063] According to an embodiment of the disclosure, the at least one processor may be configured to optimize the one or more perceptual measures for maximizing local and overall audio quality relative to bitrate.

Claims

1.A computer-implemented method comprising:analyzing, by a computing device, spatial object-based audio content associated with one or more objects;identifying, by the computing device, one or more relative perceptual importance metrics of the one or more objects based on modeling; andallocating, by the computing device, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.2.The method of claim 1, wherein the modeling comprises rendering-agnostic psychoacoustic modeling.3.The method any one of claims 1 and 2, further comprising:providing one or more perceptual measures to analyze one or more object signals of the spatial object-based audio content, wherein the relative perceptual importance metrics include the one or more perceptual measures.4.The method any one of claims 1 to 3, wherein improving the overall audio quality relative to bitrate includes maximizing the overall audio quality relative to bitrate.5.The method any one of claims 1 to 4, wherein the one or more perceptual measures are optimized for maximizing local and overall audio quality relative to bitrate.6.The method any one of claims 1 to 5, wherein the resources include a total available bitrate among the one or more objects in a legacy audio codec.7.The method of claim 6, wherein the legacy audio codec includes Opus.8.A processor-readable medium that includes a program that when executed by a processor provides codec bitrate selection in audio object coding, comprising:analyzing, by the processor, spatial object-based audio content associated with one or more objects;identifying, by the processor, one or more relative perceptual importance metrics of the one or more objects based on modeling; andallocating, by the processor, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.9.An apparatus comprising:a memory storing instructions; andat least one processor executes the instructions including a process configured to:analyze spatial object-based audio content associated with one or more objects;identify one or more relative perceptual importance metrics of the one or more objects based on modeling; andallocate, based on the one or more relative perceptual importance metrics, resources for improving overall audio quality relative to bitrate.10.The apparatus of claim 9, wherein the modeling comprises rendering-agnostic psychoacoustic modeling.11.The apparatus any one of claims 9 and 10, wherein:the process is further configured to:provide one or more perceptual measures to analyze one or more object signals of the spatial object-based audio content; andthe relative perceptual importance metrics include the one or more perceptual measures.12.The apparatus any one of claims 9 to 11, wherein improving the overall audio quality relative to bitrate includes maximizing the overall audio quality relative to bitrate.13.The apparatus any one of claims 9 to 12, wherein the one or more perceptual measures are optimized for maximizing local and overall audio quality relative to bitrate.14.The apparatus any one of claims 9 to 13, wherein the resources include a total available bitrate among the one or more objects in a legacy audio codec, and the legacy audio codec includes Opus.15.The apparatus of claim 14, wherein the legacy audio codec includes Opus.

Images