Determine the encoding and associated decoding of spatial audio parameters

By using discrete cosine transform in the time frequency domain to encode coherent parameters in the multi-channel speaker input, combined with azimuth angle and energy ratio parameters, the problem of low coherent data encoding efficiency in the prior art is solved, and the low bit rate is achieved Efficient encoding and decoding effects.

CN112997248BActive Publication Date: 2024-11-01NOKIA TECHNOLOGIES OY
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN201980072488.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-03-21
Filing Date
2019-10-01
Publication Date
2024-11-01
Estimated Expiration
2039-10-01

AI Technical Summary

Technical Problem

When encoding the frequency domain direction related parameters in the prior art, it is difficult to effectively encode the coherent data in the multi-channel speaker input, especially at lower bit rates, the coherent data is removed or not sent, resulting in the encoding of spatial audio signals. Inefficient.

Method used

Discrete cosine transform (DCT) is used to encode coherent parameters in the time-frequency domain, combining azimuth and energy ratio parameters, and through codebook selection and entropy coding technology, the coded bit rate is optimized to ensure that the spatial signal can still be effectively reconstructed at low bit rate.

Benefits of technology

The encoding efficiency of multi-channel audio signals is improved, and coherent data can be effectively encoded and decoded at lower bit rates, which enhances the reconstruction quality and encoding efficiency of spatial audio signals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112997248B_ABST
    Figure CN112997248B_ABST
Patent Text Reader

Abstract

A device comprising a module for the following operations: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value, and at least one spread and / or surround coherence value for each subband; determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; performing a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encoding a first number of components of the discrete cosine transform vector based on the determined codebook.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to an apparatus and method for encoding sound field related parameters, but is not exclusively directed to encoding time-frequency domain direction related parameters for audio encoders and decoders. Background Art

[0002] Parametric spatial audio processing is the field of audio signal processing in which a set of parameters is used to describe the spatial aspects of the sound. For example, in parametric spatial audio acquisition from a microphone array, a typical and effective choice is to estimate a set of parameters from the microphone array signal, such as the direction of the sound in the frequency band, and the ratio between the directional and non-directional parts of the acquired sound in the frequency band. These parameters are known to describe the perceived spatial properties of the acquired sound at the location of the microphone array well. These parameters can therefore be used in the synthesis of spatial sound for binaural headphones, for loudspeakers, or for other formats such as Ambisonics.

[0003] Therefore, the ratio of directional and direct energy to total energy in a frequency band is a particularly effective parameterization for spatial audio acquisition.

[0004] A parameter set consisting of a directional parameter in a frequency band and an energy ratio parameter in a frequency band (indicating the directionality of the sound) can also be used as spatial metadata for an audio codec (which can also include other parameters such as coherence, extended coherence, number of directions, distance, etc.). For example, these parameters can be estimated from an audio signal captured by a microphone array, and, for example, a stereo signal can be generated from the microphone array signal to be transmitted together with the spatial metadata. The stereo signal can be encoded, for example, with an AAC encoder. The decoder can decode the audio signal into a PCM signal and perform frequency band processing on the sound (using the spatial metadata) to obtain a spatial output, such as a binaural output.

[0005] The above solution is particularly suitable for encoding spatial sound captured from microphone arrays (e.g., in mobile phones, VR cameras, stand-alone microphone arrays). However, for such an encoder, it may be desirable to also have other input types besides the signal captured by the microphone array, such as speaker signals, audio object signals, or panoramic sound signals.

[0006] Analyzing first-order Atmos (FOA) inputs for spatial metadata extraction has been thoroughly documented in the scientific literature related to Directional Audio Coding (DirAC) and Harmonic Plane Wave Expansion (Harpex). This is because there are microphone arrays that directly provide FOA signals (more precisely: its variant, the B-format signal), and analyzing such inputs has therefore been a research focus in this field.

[0007] Another input for the encoder is also a multi-channel speaker input, such as a 5.1 or 7.1 channel surround sound input.

[0008] However, regarding the metadata component, compression is currently a research topic. Summary of the invention

[0009] According to a first aspect, a device is provided, comprising a module for the following operations: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; performing a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encoding a first number of components of the discrete cosine transform vector based on the determined codebook.

[0010] The module for determining a codebook for encoding at least one coherent value for each subband of a frame based on at least one energy ratio value and at least one azimuth value for each subband of a frame can be further used to: obtain an index representing a weighted average of at least one energy ratio value for each subband of a frame; determine whether a measure of the distribution of at least one azimuth value for a subband of a frame is greater than or equal to a determined threshold; and select a codebook based on the index and determining whether the measure of the distribution of at least one azimuth value for a subband of a frame is greater than or equal to the determined threshold.

[0011] The module for selecting the codebook based on the index and determining whether a metric of distribution of at least one azimuth index for a subband of the frame is greater than or equal to the determined threshold can be further configured to select a number of codewords for the codebook based on the index.

[0012] The measure of the distribution can be one of: the mean absolute difference between consecutive azimuth values; the mean absolute difference relative to the mean azimuth value in a subband; the standard deviation of at least one azimuth value for a subband of a frame; and the variance of at least one azimuth value for a subband of a frame.

[0013] The module for encoding a first number of components of the discrete cosine transform vector based on the determined codebook can be further used to: determine that the first number of discrete cosine transform vectors depends on the subband; encode a first component of the first number of discrete cosine transform vector components based on the codebook.

[0014] The module for encoding a first number of components of a discrete cosine transform vector based on a determined codebook can be further used to: determine a codebook for scalar quantization based on the index of the subband, each codebook including a determined number of codewords; based on the determined codebook, generate at least one further index for the component remainder of the first number of discrete cosine transform vector components; generate a mean removal index based on at least one further index for the component remainder of the first number of discrete cosine transform vector components; and entropy encode the mean removal index.

[0015] The module for encoding a first number of components of a discrete cosine transform vector based on a determined codebook can be further used to: determine at least one further index for component residuals of the first number of discrete cosine transform vector components based on a codebook having a defined number of codewords, the codebook being further based on a subband index of the vector; determine a mean removal index based on at least one further index for component residuals of the first number of discrete cosine transform vector components; and entropy encode the mean removal index.

[0016] The module for entropy encoding the mean removed index may be further used for Golomb-Rice encoding the mean removed index.

[0017] The module may further be configured to store and / or transmit an encoded first number of components of the discrete cosine transform vector.

[0018] The module may be further configured to scalar quantize the at least one energy ratio value to generate at least one energy ratio value index suitable for determining a codebook for encoding at least one coherence value for each subband.

[0019] The module can be further used to: estimate the remaining number of bits for encoding at least one azimuth value and at least one elevation angle value based on the target number of bits, the number of bits for encoding a first number of components of a discrete cosine transform vector estimated based on the determined codebook before encoding, the number of bits representing at least one energy ratio index, and the number of bits for entropy encoding representing a mean removal index; encode at least one azimuth value and at least one elevation angle value to generate at least one azimuth value index and at least one elevation value index based on the remaining number of bits, wherein a codebook for encoding at least one coherent value for each subband is determined based on at least one azimuth value index.

[0020] According to a second aspect, a device is provided, comprising a module for the following actions: obtaining coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; determining a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; performing an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and parsing the vector to generate at least one spread and / or surround coherence value for each subband.

[0021] The module for determining a codebook for decoding at least one extension and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index can be further used to: determine whether a measure of the distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold; and select a codebook based on at least one energy ratio index and determining whether a measure of the distribution of at least one azimuth value for a subband of a frame is greater than or equal to the determined threshold.

[0022] The module for selecting a codebook based on at least one energy ratio index and determining whether a metric of distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold can be further used to select a number of codewords for the codebook based on the at least one energy ratio index.

[0023] The measure of the distribution can be one of: the mean absolute difference between consecutive azimuth values; the mean absolute difference relative to the mean azimuth value in a subband; the variance of at least one azimuth value for a subband of a frame; and the variance of at least one azimuth value for a subband of a frame.

[0024] The module for decoding a first number of components of a discrete cosine transform vector based on the determined codebook can be further used to: decode a first component of the first number of discrete cosine transform vector components based on the codebook; decode further components of the first number of discrete cosine transform vector components based on the codebook; and perform inverse cosine transform on the decoded first component and further components.

[0025] According to a third aspect, a method is provided, comprising: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; performing a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encoding a first number of components of the discrete cosine transform vector based on the determined codebook.

[0026] Based on at least one energy ratio value and at least one azimuth value for each subband of a frame, determining a codebook for encoding at least one coherent value for each subband may further include: obtaining an index representing a weighted average of at least one energy ratio value for each subband of the frame; determining whether a measure of the distribution of at least one azimuth value for the subband of the frame is greater than or equal to a determined threshold; and selecting a codebook based on the index and determining whether the measure of the distribution of at least one azimuth value for the subband of the above-mentioned frame is greater than or equal to the determined threshold.

[0027] Selecting a codebook based on the index and determining whether a measure of distribution of at least one azimuth index for a subband of a frame is greater than or equal to the determined threshold may further include selecting a number of codewords for the codebook based on the index.

[0028] The measure of the distribution can be one of: the mean absolute difference between consecutive azimuth values; the mean absolute difference relative to the mean azimuth value in a subband; the standard deviation of at least one azimuth value for a subband of a frame; and the variance of at least one azimuth value for a subband of a frame.

[0029] Encoding a first number of components of a discrete cosine transform vector based on the determined codebook may further include: determining that the first number of discrete cosine transform vectors depends on the subband; encoding a first component of the first number of discrete cosine transform vector components based on the codebook.

[0030] Encoding a first number of components of a discrete cosine transform vector based on the determined codebook may further include: determining a codebook for scalar quantization based on the indices of the subbands, each codebook comprising a determined number of codewords; generating at least one further index for component remainders of the first number of discrete cosine transform vector components based on the determined codebook; generating a mean removal index based on at least one further exponent for the component remainders of the first number of discrete cosine transform vector components; and entropy encoding the mean removal index.

[0031] Encoding a first number of components of a discrete cosine transform vector based on a determined codebook may further include: determining at least one further index for component residuals of the first number of discrete cosine transform vector components based on a codebook having a defined number of codewords, the codebook being further based on a subband index of the vector; determining a mean removal index based on at least one further index for component residuals of the first number of discrete cosine transform vector components; and entropy encoding the mean removal index.

[0032] Entropy encoding the mean removed index may further include Golomb-Rice encoding the mean removed index.

[0033] The method may further comprise storing and / or transmitting the encoded first number of components of the discrete cosine transform vector.

[0034] The method may further include scalar quantizing the at least one energy ratio value to generate at least one energy ratio value index suitable for determining a codebook for encoding the at least one coherence value for each subband.

[0035] The method may further include: estimating the remaining number of bits for encoding at least one azimuth angle value and at least one elevation angle value based on the target number of bits, the number of bits for encoding a first number of components of a discrete cosine transform vector estimated based on the determined codebook before the encoding, the number of bits representing at least one energy ratio index, and the number of bits for entropy encoding representing a mean removal index; encoding at least one azimuth angle value and at least one elevation angle value to generate at least one azimuth angle value index and at least one elevation angle value index based on the remaining number of bits, wherein a codebook for encoding at least one coherent value for each subband is determined based on at least one azimuth angle value index.

[0036] According to a fourth aspect, a method is provided, which includes: obtaining coding values ​​for subbands of a frame of an audio signal, the values ​​including at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; determining a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; performing an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector including at least one spread and / or surround coherence value for the subband of the frame; and parsing the vector to generate at least one spread and / or surround coherence value for each subband.

[0037] Determining a codebook for decoding at least one extension and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index may further include: determining whether a measure of the distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold; and selecting a codebook based on at least one energy ratio index and determining whether a measure of the distribution of at least one azimuth value for a subband of a frame is greater than or equal to the determined threshold.

[0038] Selecting a codebook based on at least one energy ratio index and determining whether a metric of distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold may further include selecting a number of codewords for the codebook based on at least one energy ratio index.

[0039] The measure of the distribution can be one of: the mean absolute difference between consecutive azimuth values; the mean absolute difference relative to the mean azimuth value in a subband; the variance of at least one azimuth value for a subband of a frame; and the variance of at least one azimuth value for a subband of a frame.

[0040] Decoding a first number of components of a discrete cosine transform vector based on the determined codebook may further include: decoding a first component of the first number of discrete cosine transform vector components based on the codebook; decoding further components of the first number of discrete cosine transform vector components based on the codebook; and performing inverse cosine transform on the decoded first component and further components.

[0041] According to a fifth aspect, a device is provided, comprising at least one processor and at least one memory comprising computer program code, wherein the at least one memory and the computer program code are configured to, together with the at least one processor, cause the device to at least: receive values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; determine a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; perform a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encode a first number of components of the discrete cosine transform vector based on the determined codebook.

[0042] The device caused to determine a codebook for encoding at least one coherent value for each subband of a frame based on at least one energy ratio value and at least one azimuth value for each subband of a frame can be further caused to: obtain an index representing a weighted average of at least one energy ratio value for each subband of the frame; determine whether a measure of the distribution of at least one azimuth value for the subband of the frame is greater than or equal to a determined threshold; and select a codebook based on the index and determining whether the measure of the distribution of at least one azimuth value for the subband of the frame is greater than or equal to the determined threshold.

[0043] The apparatus caused to select a codebook based on the index and determining whether a metric of distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold may be further caused to select a number of codewords for the codebook based on the index.

[0044] The measure of the distribution may be one of: the mean absolute difference between consecutive azimuth values; the mean absolute difference relative to the mean azimuth value in a subband; the standard deviation of at least one azimuth value for a subband of a frame; and the variance of at least one azimuth value for a subband of a frame.

[0045] The device caused to encode a first number of components of a discrete cosine transform vector based on the determined codebook may be further caused to: determine that the first number of discrete cosine transform vectors depends on the subband; and encode a first component of the first number of discrete cosine transform vector components based on the codebook.

[0046] The device caused to encode a first number of components of a discrete cosine transform vector based on a determined codebook can be further caused to: determine a codebook for scalar quantization based on the index of the subband, each codebook including a determined number of codewords; generate at least one further index for the component residual part of the first number of discrete cosine transform vector components based on the determined codebook; generate a mean removal index based on at least one further index for the component residual part of the first number of discrete cosine transform vector components; and entropy encode the mean removal index.

[0047] A device caused to encode a first number of components of a discrete cosine transform vector based on a determined codebook can be further caused to: determine at least one further index for component residuals of the first number of discrete cosine transform vector components based on a codebook having a defined number of codewords, the codebook being further based on a subband index of the vector; determine a mean removal index based on at least one further index for component residuals of the first number of discrete cosine transform vector components; and entropy encode the mean removal index.

[0048] The apparatus caused to entropy encode the mean removal index may be further caused to Golomb-Rice encode the mean removal index.

[0049] The apparatus may further be caused to store and / or transmit an encoded first number of components of the discrete cosine transform vector.

[0050] The apparatus may be further caused to scalar quantize the at least one energy ratio value to generate at least one energy ratio value index suitable for determining a codebook for encoding the at least one coherence value for each subband.

[0051] The device can be further caused to: estimate the remaining number of bits for encoding at least one azimuth angle value and at least one elevation angle value based on the target number of bits, the number of bits used to encode a first number of components of a discrete cosine transform vector estimated based on the determined codebook before encoding, the number of bits representing at least one energy ratio index, and the number of bits for entropy encoding representing a mean removal index; encode at least one azimuth angle value and at least one elevation angle value to generate at least one azimuth angle value index and at least one elevation angle value index based on the remaining number of bits, wherein a codebook for encoding at least one coherent value for each subband is determined based on the at least one azimuth angle value index.

[0052] According to a sixth aspect, a device is provided, comprising at least one processor and at least one memory comprising computer program code, wherein the at least one memory and the computer program code are configured to, together with the at least one processor, cause the device to at least: obtain coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; determine a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; perform an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and parse the vector to generate at least one spread and / or surround coherence value for each subband.

[0053] The device caused to determine a codebook for decoding at least one extension and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index can be further caused to: determine whether a measure of the distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold; and select a codebook based on at least one energy ratio index and determining whether a measure of the distribution of at least one azimuth value for a subband of a frame is greater than or equal to the determined threshold.

[0054] The device caused to select a codebook based on at least one energy ratio index and whether a metric determining the distribution of at least one azimuth index for a subband of a frame is greater than or equal to a determined threshold may be further caused to select the number of codewords for the codebook based on the at least one energy ratio index.

[0055] The measure of the distribution may be one of: the mean absolute difference between consecutive azimuth values; the mean absolute difference relative to the mean azimuth value in a subband; the variance of at least one azimuth value for a subband of a frame; and the variance of at least one azimuth value for a subband of a frame.

[0056] The device caused to decode a first number of components of a discrete cosine transform vector based on a determined codebook can be further caused to: decode a first component of the first number of discrete cosine transform vector components based on the codebook; decode further components of the first number of discrete cosine transform vector components based on the codebook; and perform inverse cosine transform on the decoded first component and further components.

[0057] According to the seventh aspect, a device is provided, comprising: a module for receiving values ​​of subbands for a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; a module for determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; a module for performing a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subbands of the frame; and a module for encoding a first number of components of a discrete cosine transform vector based on the determined codebook.

[0058] According to an eighth aspect, a device is provided, comprising: a module for obtaining coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; a module for determining a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; a module for performing an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and a module for parsing the vector to generate at least one spread and / or surround coherence value for each subband.

[0059] According to the ninth aspect, a computer program comprising instructions [or a computer-readable medium comprising program instructions] is provided, which is used to cause the device to perform at least the following operations: receive values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; determine a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; perform a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encode a first number of components of the discrete cosine transform vector based on the determined codebook.

[0060] According to the tenth aspect, a computer program comprising instructions [or a computer-readable medium comprising program instructions] is provided, which is used to cause a device to perform at least the following operations: obtain coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; based on at least one energy ratio index and at least one azimuth index, determine a codebook for decoding at least one spread and / or surround coherence index for each subband; perform an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and parse the vector to generate at least one spread and / or surround coherence value for each subband.

[0061] According to the eleventh aspect, a non-transitory computer-readable medium is provided, comprising program instructions for causing a device to perform at least the following operations: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; performing a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encoding a first number of components of the discrete cosine transform vector based on the determined codebook.

[0062] According to the twelfth aspect, a non-transitory computer-readable medium is provided, comprising program instructions for causing a device to perform at least the following operations: obtaining coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; determining a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; performing an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and parsing the vector to generate at least one spread and / or surround coherence value for each subband.

[0063] According to the thirteenth aspect, a device is provided, comprising: a receiving circuit system configured to receive values ​​of subbands for a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; a determining circuit system configured to determine a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; a transform circuit system configured to perform a discrete cosine transform on at least one vector comprising at least one spread and / or surround coherence value for the subbands of the frame; and an encoding circuit system configured to encode a first number of components of a discrete cosine transform vector based on the determined codebook.

[0064] According to the fourteenth aspect, a device is provided, comprising: an acquisition circuit system configured to obtain coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; a determination circuit system configured to determine a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; a transformation circuit system configured to perform an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and a parsing circuit system configured to parse the vector to generate at least one spread and / or surround coherence value for each subband.

[0065] According to the fifteenth aspect, a computer-readable medium is provided, comprising program instructions for causing a device to perform at least the following operations: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one elevation value, at least one energy ratio value and at least one spread and / or surround coherence value for each subband; determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on at least one energy ratio value and at least one azimuth value for each subband of the frame; performing a discrete cosine transform on at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and encoding a first number of components of the discrete cosine transform vector based on the determined codebook.

[0066] According to the sixteenth aspect, a computer-readable medium is provided, comprising program instructions for causing an apparatus to perform at least the following operations: obtaining coding values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth index, at least one elevation index, at least one energy ratio index and at least one spread and / or surround coherence index for each subband; determining a codebook for decoding at least one spread and / or surround coherence index for each subband based on at least one energy ratio index and at least one azimuth index; performing an inverse discrete cosine transform on at least one spread and / or surround coherence index to generate at least one vector, the at least one vector comprising at least one spread and / or surround coherence value for the subband of the frame; and parsing the vector to generate at least one spread and / or surround coherence value for each subband.

[0067] An apparatus comprises modules for performing the actions of the method as described above.

[0068] An apparatus is configured to perform the actions of the method as described above.

[0069] A computer program includes program instructions for causing a computer to execute the method as described above.

[0070] A computer program product stored on a medium can cause an apparatus to execute the method as described herein.

[0071] An electronic device may include the apparatus described herein.

[0072] A chipset may include the device as described herein.

[0073] The embodiments of the present application are intended to solve the problems associated with the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] For a better understanding of the present application, reference will now be made by way of example to the accompanying drawings, in which:

[0075] Figure 1 A system of apparatus suitable for implementing some embodiments is schematically shown;

[0076] Figure 2 schematically illustrates a metadata encoder according to some embodiments;

[0077] Figure 3 According to some embodiments, Figure 2 A flowchart of the operation of the metadata encoder is shown;

[0078] Figure 4 Schematically illustrates how Figure 2 The coherent encoder shown;

[0079] Figure 5 According to some embodiments, Figure 4 A flowchart of the operation of a coherent encoder is shown;

[0080] Figure 6 A flow chart illustrating the operation of a coherent encoder to encode a first coherent component and a further coherent component according to some embodiments;

[0081] Figure 7 a flowchart illustrating further operation of a coherent encoder to encode a first coherent component and a further coherent component according to some further embodiments;

[0082] Figure 8 schematically illustrates a metadata decoder for coherent decoding according to some embodiments;

[0083] Fig. 9 According to some embodiments, Figure 8 A flowchart of the operation of the metadata decoder is shown; and

[0084] Fig.10 An exemplary device suitable for implementing the illustrated means is schematically illustrated. DETAILED DESCRIPTION

[0085] Suitable devices and possible mechanisms for providing valid spatial analysis derived metadata parameters are described in further detail below. In the following discussion, multi-channel systems are discussed in terms of the implementation of multi-channel microphones. However, as discussed above, the input format can be any suitable input format, such as multi-channel speakers, panoramic sound (FOA / HOA), etc. It should be understood that in some embodiments, the channel position is based on the position of the microphone, or a virtual position or direction. In addition, the output of the example system is a multi-channel speaker arrangement. However, it should be understood that the output can be presented to the user via means other than speakers. In addition, the multi-channel speaker signal can be summarized as two or more playback audio signals.

[0086] For each considered time-frequency block (time / frequency subband), the metadata consists of at least the direction (elevation, azimuth), the energy ratio of the resulting direction, and the extended coherence component of the resulting direction. In addition, independent of the direction, the surround coherence can be determined and included for each time-frequency block. All this data is encoded and sent (or stored) by the encoder so that the spatial signal can be reconstructed at the decoder.

[0087] The typical overall operating bit rate of the codec leaves 3.0 kbps, 4.0 kbps, 8 kbps or 10 kbps for sending / storing metadata. The encoding of directional parameters and energy ratio components has been studied before, but the encoding of coherent data has not been explored, and at lower bit rates, the coherent data is removed and not sent or stored.

[0088] The concept as discussed below is to encode the coherence parameters together with the directional parameters and energy ratio parameters for each time-frequency block. In the following example, the encoding is performed in the discrete cosine transform domain and depends on the current subband index, as well as the current energy ratio and azimuth values. In the following embodiments, the DCT transform is selected because it is optimized for low complexity implementations, however other time-frequency domain transforms may be applied and used instead.

[0089] In some embodiments, the fixed bit rate encoding method can be combined with variable bit rate encoding, which distributes the encoding bits of the data to be compressed between different segments so that the overall bit rate per frame is fixed. Within a time-frequency block, bits can be shifted between frequency sub-bands.

[0090] about Figure 1An example device and system for implementing an embodiment of the present application is shown. The system 100 is shown with an "analysis" part 121 and a "synthesis" part 131. The "analysis" part 121 is the part from receiving a multi-channel loudspeaker signal to encoding metadata and a downmixed signal, and the "synthesis" part 131 is the part from decoding the encoded metadata and downmixed signal to the presentation of the regenerated signal (e.g. in the form of a multi-channel loudspeaker).

[0091] The input to the system 100 and the "analysis" section 121 is a multi-channel signal 102. In the following example, a microphone channel signal input is described, however any suitable input (or synthesized multi-channel) format may be implemented in other embodiments. For example, in some embodiments, the spatial analyzer and spatial analysis may be implemented external to the encoder. For example, in some embodiments, spatial metadata associated with the audio signal may be provided to the encoder as a separate bitstream. In some embodiments, the spatial metadata may be provided as a set of spatial (directional) index values.

[0092] The multi-channel signal is passed to the transmission signal generator 103 and the analysis processor 105 .

[0093] In some embodiments, the transmission signal generator 103 is configured to receive a multi-channel signal, generate a suitable transmission signal including a determined number of channels, and output a transmission signal 104. For example, the transmission signal generator 103 can be configured to generate a 2-audio channel downmix of the multi-channel signal. The determined number of channels can be any suitable number of channels. The transmission signal generator is configured in some embodiments to select or combine the input audio signals in other ways, such as by beamforming technology, to the determined number of channels, and output these signals as transmission signals.

[0094] In some embodiments, the transmit signal generator 103 is optional and the multi-channel signal is passed unprocessed to the encoder 107 in the same manner as the transmit signal in this example.

[0095] In some embodiments, the analysis processor 105 is further configured to receive the multi-channel signal and analyze the signal to generate metadata 106 associated with the multi-channel signal and therefore associated with the transmit signal 104. The analysis processor 105 can be configured to generate metadata, which can include, for each time-frequency analysis interval, a directional parameter 108 and an energy ratio parameter 110 and a coherence parameter 112 (and in some embodiments, a diffuseness parameter). The directional parameter, the energy ratio parameter and the coherence parameter can be considered to be spatial audio parameters in some embodiments. In other words, the spatial audio parameters include parameters intended to characterize the sound field created by the multi-channel signal (or generally two or more playback audio signals).

[0096] In some embodiments, the parameters generated may differ from frequency band to frequency band. Thus, for example, in frequency band X, all parameters are generated and transmitted, while in frequency band Y, only one of the parameters is generated and transmitted, and furthermore in frequency band Z no parameters are generated or transmitted. A practical example of this may be that for some frequency bands, such as the highest frequency band, some of the parameters are not required for perceptual reasons. The transport signal 104 and the metadata 106 may be passed to an encoder 107.

[0097] The encoder 107 may include an audio encoder core 109 configured to receive the transport (e.g., downmixed) signals 104 and generate a suitable encoding of these audio signals. The encoder 107 may be a computer (running suitable software stored on a memory and on at least one processor) in some embodiments, or alternatively a specific device utilizing, for example, an FPGA or ASIC. The encoding may be implemented using any suitable scheme. The encoder 107 may further include a metadata encoder / quantizer 111 configured to receive metadata and output an encoded or compressed form of the information. In some embodiments, the encoder 107 may be configured to receive metadata and output an encoded or compressed form of the information. Figure 1 Before transmission or storage as shown in the dashed line, the metadata is further interleaved, multiplexed into a single data stream, or the metadata is embedded in the coded mixed signal. The multiplexing can be implemented using any suitable scheme.

[0098] In the decoder side, the received or retrieved data (stream) may be received by a decoder / demultiplexer 133. The decoder / demultiplexer 133 may demultiplex the encoded stream and pass the audio encoded stream to a transport extractor 135, which is configured to decode the audio signal to obtain a transport signal. Similarly, the decoder / demultiplexer 133 may include a metadata extractor 137, which is configured to receive the encoded metadata and generate metadata. The decoder / demultiplexer 133 may be a computer (running appropriate software stored on a memory and at least one processor) in some embodiments, or alternatively a specific device utilizing, for example, an FPGA or ASIC.

[0099] The decoded metadata and transmit audio signal may be passed to the synthesis processor 139 .

[0100] The “Synthesis” portion 131 of the system 100 further shows a synthesis processor 139 which is configured to receive the transmission and metadata and, based on the transmission signal and the metadata, recreate synthesized spatial audio in the form of multi-channel signals 110 in any suitable format (these may be a multi-channel speaker format, or in some embodiments may be any suitable output format, such as binaural or panoramic signals, depending on the use case).

[0101] Therefore, in summary firstly the system (analysis part) is configured to receive a multi-channel audio signal.

[0102] The system (analysis part) is then configured to generate a suitable transmit audio signal (eg by selecting or downmixing some of the audio signal channels).

[0103] The system is then configured to encode the transmission signal and metadata for storage / transmission.

[0104] Thereafter, the system may store / send the encoded transmission and metadata.

[0105] The system can retrieve / receive encoded transmissions and metadata.

[0106] The system is then configured to extract the transport and metadata from the encoded transport and metadata parameters, such as demultiplexing and decoding the encoded transport and metadata parameters.

[0107] The system (synthesis section) is configured to synthesize an output multi-channel audio signal based on the extracted transmission audio signal and metadata.

[0108] about Figure 2 , further describing in detail an example analysis processor 105 and metadata encoder / quantizer 111 (eg, Figure 1 shown).

[0109] In some embodiments, the analysis processor 105 comprises a time-frequency domain transformer 201 .

[0110] In some embodiments, the time-frequency domain converter 201 is configured to receive the multi-channel signal 102 and apply a suitable time-frequency domain transform, such as a short-time Fourier transform (STFT), to convert the input time domain signal into a suitable time-frequency signal. These time-frequency signals can be passed to the spatial analyzer 203 and the signal analyzer 205.

[0111] Therefore, for example, the time-frequency signal 202 can be represented in the time-frequency domain by the following formula

[0112] si(b,n),

[0113] Where b is the frequency bin index, and n is the time-frequency block (frame) index, and i is the channel index. In another formulation, n can be considered as a time index with a lower sampling rate than the original time domain signal. The frequency bins can be grouped into subbands that group one or more of the bins into subbands with indices k=0, ..., K-1. Each subband k has a minimum bin b k,low and the highest warehouse b k,high , and the subband contains k,low to bk,high The width of the sub-band can be approximated by any suitable distribution, such as the equivalent rectangular bandwidth (ERB) scale or the Bark scale.

[0114] In some embodiments, the analysis processor 105 comprises a spatial analyzer 203. The spatial analyzer 203 may be configured to receive the time-frequency signals 202 and, based on these signals, estimate the directional parameters 108. The directional parameters may be determined based on any audio-based "direction".

[0115] For example, in some embodiments, the spatial analyzer 203 is configured to estimate the direction using two or more signal inputs. This represents the simplest configuration for estimating "direction", more complex processing can be performed with even more signals.

[0116] Therefore, the spatial analyzer 203 may be configured to provide at least one azimuth and elevation angle for each frequency band and time-frequency block within the audio signal frame, denoted as azimuth and the elevation angle θ(k,n). The direction parameter 108 may also be passed to the direction index generator 205.

[0117] The spatial analyzer 203 may also be configured to determine an energy ratio parameter 110. The energy ratio may be considered as a determination of the energy of an audio signal that may be considered to arrive from a direction. The ratio of direct energy to total energy r(k,n) may be estimated, for example, using a stability measure of the directional estimate, or using any correlation measure, or any other suitable method to obtain a ratio parameter. The energy ratio may be passed to an energy ratio encoder 207.

[0118] The spatial analyzer 203 can further be configured to determine a plurality of coherence parameters 112, which may include surround coherence (γ(k,n)) and extended coherence (ζ(k,n)), both of which are analyzed in the time-frequency domain. The extended coherence parameter may have a value from 0 to 1. An extended coherence value of 0 indicates a point source, in other words, when reproducing an audio signal using a multi-speaker system, the sound should be reproduced with as few speakers as possible (e.g., only the center speaker when the direction is centered). As the extended coherence value increases, more energy is extended to the other speakers surrounding the center speaker, until, at a value of 0.5, the energy is evenly extended between the center speaker and the neighboring speakers. When the value of the extended coherence increases above 0.5, the energy in the center speaker decreases, until, at a value of 1, there is no energy in the center speaker and all the energy is in the neighboring speakers. The surround coherence parameter has a value from 0 to 1. A value of 1 means that there is coherence between all (or almost all) speaker channels. A value of 0 means that there is no coherence between all (or even almost all) speaker channels. This is further explained in GB application number 1718341.9 and PCT application PCT / FI2018 / 050788.

[0119] In summary therefore, the analysis processor is configured to receive a time domain multi-channel or other format such as microphone or panoramic sound audio signal.

[0120] Thereafter, the analysis processor may apply a time-domain to frequency-domain transform (eg, STFT) to generate a suitable time-frequency domain signal for analysis, and then apply directional analysis to determine direction and energy ratio parameters.

[0121] The analysis processor may then be configured to output the determined parameters.

[0122] Although the direction, energy ratio and coherence parameters are expressed here for each time index n, in some embodiments the parameters may be combined over several time indices. The same applies to the frequency axis, as already expressed, the direction of several frequency bins b can be expressed by one direction parameter in a frequency band k consisting of several frequency bins b. The same applies to all spatial parameters discussed herein.

[0123] In some embodiments, the direction data can be represented using 16 bits, so that each azimuth parameter is represented on approximately 9 bits and the elevation is represented on 7 bits. In such embodiments, the energy ratio parameter can be represented on 8 bits. For each frame, there can be N=5 subbands and M=4 time-frequency (TF) blocks. Therefore, in this example, (16+8)×M×N bits are required to store the uncompressed direction and energy ratio metadata for each frame. The coherent data for each TF block can be a floating point representation between 0 and 1 and can be initially represented on 8 bits.

[0124] Likewise Figure 2 , an example metadata encoder / quantizer 111 is shown according to some embodiments.

[0125] The metadata encoder / quantizer 111 may include a direction encoder 205. The direction encoder 205 is configured to receive a direction parameter (such as an azimuth angle). and elevation angle θ(k,n)) 108 (and in some embodiments the expected bit allocation), and thereby generate a suitable encoded output. In some embodiments, the encoding is based on an arrangement of spheres forming a spherical grid, which is arranged in rings on a "surface" sphere, the rings being defined by a lookup table defined by the determined quantization resolution. In other words, the spherical grid uses the idea of ​​covering a sphere with smaller spheres, and considering the centers of the smaller spheres as points defining a grid of almost equidistant directions. The smaller spheres thus define cones or solid angles about a center point, which can be indexed according to any suitable indexing algorithm. Although spherical quantization is described here, any suitable quantization, whether linear or non-linear, may be used.

[0126] Furthermore, in some embodiments, the direction encoder 205 is configured to determine a variance of the azimuth parameter values ​​and pass the variance to the coherence encoder 209 .

[0127] The encoded direction parameter may then be passed to the combiner 211 .

[0128] The metadata encoder / quantizer 111 may include an energy ratio encoder 207. The energy ratio encoder 207 is configured to receive the energy ratio and determine a suitable encoding for compressing the energy ratio for the subband and time-frequency block. For example, in some embodiments, the energy ratio encoder 207 is configured to encode each energy ratio parameter value using 3 bits.

[0129] Furthermore, in some embodiments, instead of sending or storing all energy ratio values ​​for all TF blocks, only a weighted average for each subband is sent or stored. The average can be determined by considering the total energy of each time block, thus favoring the values ​​of subbands with more energy.

[0130] In such embodiments, the quantized energy ratio value is the same for all TF blocks of a given subband.

[0131] In some embodiments, the energy ratio encoder 207 is further configured to pass the quantized (encoded) energy ratio value to the combiner 211 and the coherence encoder 209 .

[0132] The metadata encoder / quantizer 111 may include a coherence encoder 209. The coherence encoder 209 is configured to receive the coherence values ​​and determine suitable encoding for compressing the coherence values ​​for the subbands and time-frequency blocks. 3-bit precision values ​​for the coherence parameter values ​​have been shown to produce acceptable audio synthesis results, but even so, this requires a total of 3×20 bits for the coherence data of all TF blocks (8 subbands and 5 TF blocks per frame in the example).

[0133] As described below, in some embodiments, encoding is implemented in the DCT domain and may depend on the current subband index, as well as the current energy ratio and azimuth angle values.

[0134] The encoded coherence parameter values ​​may then be passed to the combiner 211 .

[0135] The metadata encoder / quantizer 111 may include a combiner 211. The combiner is configured to receive the encoded (or quantized / compressed) direction parameters, energy ratio parameters, and coherence parameters, and combine them to generate a suitable output (e.g., a metadata bitstream, which may be combined with a transmission signal, or sent or stored separately from the transmission signal).

[0136] about Figure 3 , showing how according to some embodiments Figure 2 Example operation of the metadata encoder / quantizer is shown.

[0137] The initial operation is to obtain metadata (such as azimuth value, elevation value, energy ratio, coherence, etc.), such as Figure 3 As shown in step 301.

[0138] The direction values ​​(elevation, azimuth) may then be compressed or encoded (eg by applying spherical quantization, or any suitable compression), such as Figure 3 As shown in step 303.

[0139] The energy ratio values ​​are compressed or encoded (e.g. by generating weighted averages per subband and then quantizing these to 3-bit values), such as Figure 3 As shown in step 305.

[0140] The coherence values ​​are also compressed or encoded (e.g., by encoding in the DCT domain, as indicated below), such as Figure 3 As shown in step 307.

[0141] The encoded direction values, energy ratios, and coherence values ​​are then combined to generate the encoded metadata, e.g. Figure 3 As shown in step 305.

[0142] about Figure 4 It shows that Figure 2An example coherent encoder 209 is shown.

[0143] In some embodiments, the coherence encoder 209 includes a coherence vector generator 401. The coherence vector generator 401 is configured to receive a coherence value 112, which may be an 8-bit floating point representation between 0 and 1.

[0144] The coherence vector generator 401 is configured to generate a vector of coherence values ​​for each subband. Thus, in the example where there are M time-frequency blocks, then the coherence vector generator 401 is configured to generate a coherence data vector 402 of M dimensions.

[0145] The coherent data vector 402 is output to a discrete cosine transformer 403 .

[0146] In some embodiments, the coherent encoder 209 comprises a discrete cosine transformer. The discrete cosine transformer may be configured to receive the M-dimensional coherent data vector 402 and perform a discrete cosine transform (DCT) on the vector.

[0147] Any suitable method for performing DCT may be implemented. For example, in some embodiments, the vectors include 4-dimensional coherent vectors corresponding to the subbands. Then the matrix multiplication of the vector x=(x1, x2, x3, x4)′ and the 4th-order DCT matrix is ​​equal to:

[0148]

[0149] in

[0150] a=x1+x2

[0151] b=x2+x3

[0152] c=x1-x4

[0153] d = x2-x3

[0154] This reduces the number of DCT transform operations from 28 to 14.

[0155] The DCT coherent vector 404 may then be output to a vector encoder 405 .

[0156] In some embodiments, the coherent encoder 209 comprises a vector encoder 405. The vector encoder 405 is configured to receive the DCT coherent vector 404 and encode it by using a suitable codebook.

[0157] In some embodiments, the vector encoder 405 includes a codebook determiner 415. The codebook determiner is configured to receive the coded / quantized energy ratio 412 and the variance of the quantized azimuth angle 414 (which can be determined from the energy ratio encoder and the direction encoder, such as Figure 2as shown), and determines the appropriate codebook to apply to the DCT coherence vector values.

[0158] In some embodiments, the encoding of the first DCT parameters is implemented in a different way than the encoding of the further DCT parameters. This is because the first DCT parameters and the further DCT parameters have significantly different distributions. In addition, the distribution of the first DCT parameters also depends on two factors: the energy ratio for the current subband and the variance of the azimuth within the current subband.

[0159] In some embodiments (and as previously discussed), 3 bits are used to encode each energy ratio value, and only one weighted average is generated and sent (and / or stored) per subband. This means that the quantized energy ratio values ​​are the same for all TF blocks of a given subband.

[0160] Furthermore, the variance of the azimuth angles affects the distribution of the first DCT parameters based on whether the variance of the quantized azimuth angles within a subband is very small (under a determined threshold) or larger than the threshold.

[0161] In some embodiments, furthermore, the number of subbands is selected to be I_N. For example, in some embodiments I_N=3. In such embodiments, subbands up to the selected subband limit are encoded using a first number of secondary DCT parameters, and the remaining subbands are encoded using a second number of secondary DCT parameters. In some embodiments, the first number is 1 and the second number is 2. In other words, in some embodiments, the vector encoder is configured such that subbands <= I_N encode the first 2 components (one primary and one secondary) of the DCT transform vector, and subbands > I_N encode the first 3 components (one primary and two secondary) of the DCT transform vector. These two additional components can be encoded with a 2-dimensional vector quantizer, or they can be added as an additional dimension to the N-dimensional vector quantizer of the second DCT parameter and immediately used with an N+2-dimensional vector quantizer for encoding all secondary parameters.

[0162] The encoding of the coherence parameters is summarized in the flow chart, namely Figure 6 Shown in.

[0163] The first operation is to obtain the relevant parameter values, such as Figure 6 As shown in step 501.

[0164] After obtaining the coherence parameter values ​​for the frame, the next operation is to generate the M-dimensional coherence vector for each subband, such as Figure 6 As shown in step 503.

[0165] The M-dimensional coherence vector is then transformed, for example using a discrete cosine transform (DCT), such as Figure 6 As shown in step 505.

[0166] The DCT representations are then sorted into subbands below the determined subband selection value and subbands above that value, as Figure 6 In other words, it is determined whether the current subband being processed is less than or equal to I_N or greater than IN.

[0167] Then, the DCT representation of the M-dimensional coherence vector for subbands less than or equal to I_N is encoded by encoding the first two components of the DCT transform vector, such as Figure 6 As shown in step 509.

[0168] Then, the DCT representation of the M-dimensional coherence vector for subbands greater than I_N is encoded by encoding the first 3 components of the DCT transform vector, as Figure 6 As shown in step 511.

[0169] For example, this can be summarized in the following pseudocode form.

[0170]

[0171]

[0172] about Figure 5 Shown in further detail is a vector encoder 405 which is shown receiving as input a DCT coherence vector 404 according to some embodiments.

[0173] In some embodiments, the vector encoder includes a DCT 0th order extended coherence bit coding estimator (or first / primary DCT coherence parameter estimator) 451.

[0174] DCT 0th order extended coherence bit coding estimator (or first / primary DCT coherence parameter estimator) 451 is configured to receive DCT coherence vector 404 and determine whether all coherence values ​​are non-null. When at least one coherence value is non-null, DCT 0th order extended coherence bit coding estimator is configured to estimate the number of bits used to code the 0th order DCT parameters for extended coherence, for joint coding: "log2Π i len_cb_dctO[indexER i ]], where indexER i is the index of the quantization energy ratio of subband i, and len-cb_dct0[] = {7, 6, 5, 4, 4, 4, 3, 2}.

[0175] This estimate is passed to a codebook determiner 415 .

[0176] The vector encoder may further include a DCT1 order (and 2 order onwards) extended coherence encoder (or further / secondary DCT coherence parameter encoder) 455 in some embodiments. The DCT1 order (and 2 order onwards) extended coherence encoder 455 is configured to receive the DCT coherence vector 404, and thereby encode the DCT parameters of the 1 order (and 2 order onwards for the subbands encoding the further secondary parameters) for extended coherence, using Golomb Rice encoding to remove the mean of the quantization index. In some embodiments, the index is obtained from a scalar quantization in a codebook depending on the index of the subband. The number of codewords is the same for all subbands, for example 5 codewords.

[0177] The extended coherence parameters encoded by the output encoded DCT1 order (and 2nd order onwards) may be prepared for output as part of the encoded coherence vector 404.

[0178] In some embodiments, the vector encoder may further include a surround coherence encoder 457. The surround coherence encoder 457 is configured to receive surround coherence parameters, and thereby encode the surround coherence parameters and calculate the number of bits used for surround coherence. In some embodiments, the surround coherence encoder 457 is configured to send a surround coherence value per subband. In a manner as described with respect to the encoding of the energy ratio, in some embodiments, the value can be obtained as a weighted average of the time-frequency blocks of the subband, the weight being determined by the signal energy.

[0179] In some embodiments, the average surrounding coherence value is scalar quantized using a codebook whose length (number of codewords) depends on the energy ratio index (for index: 0, 1, 2, 3, 4, 5, 6, 7, codewords 2, 3, 4, 5, 6, 7, 8, 8). In some embodiments, the index is encoded using a Golomb Rice encoder for the mean removed value, or by joint encoding taking into account the number of codewords used (in other words, entropy encoding such as GR encoding, or joint encoding is selected based on which encodes the value into fewer bits).

[0180] In some embodiments, the total number of bits estimated (for encoding the primary extended coherence) and used (for encoding the secondary extended and surround coherence parameters) is determined, and from this the number of remaining bits available for encoding the directional parameters is determined. This can be determined mathematically, for example, as

[0181] ED=B-(EPSC+SSC+SC+EP)

[0182] where ED is the number of remaining bits available, B is the original bit target, EPSC is the estimated number of bits used to encode the primary extended coherence parameters, SSC is the number of bits used to encode the secondary extended coherence parameters, SC is the number of bits used to encode the surround coherence parameters, and EP is the number of bits used to encode the energy ratio.

[0183] The remaining number of bits available may be passed to the direction encoder and determine the number of bits to be used to encode the direction parameter according to any suitable encoding method (eg, as described above).

[0184] In addition, in some embodiments, the vector encoder may further include a codebook determiner 415 as discussed above. In some embodiments, the codebook determiner 415 is configured to receive an estimate of the number of bits used to encode the DCT0-order extended coherent parameters, and further receive the coded / quantized energy ratio 412 and the coded variance of the azimuth 414. The codebook determiner 415 can determine a suitable codebook for encoding the DCT 0-order extended coherent parameters from these inputs. In some embodiments, the determination is based on the energy ratio and the quantized azimuth value (the variance of the quantized azimuth value for the current subband). If the variance of the azimuth for the subband is below a determined threshold (e.g., a threshold of 30), the first determined codebook is used, otherwise another determined codebook is used. In some embodiments, for the 0-order DCT coefficients, there are a total of 16 codebooks (based on 8 indices for the energy ratio and 2 possibilities for the azimuth variance associated with a given threshold).

[0185] The selected codebook is passed to the DCT 0th order extended coherent encoder 453.

[0186] In addition, in some embodiments, the vector encoder may further include a DCT 0-order extended coherence encoder 453. After receiving the determined codebook and the DCT coherence vector, the DCT 0-order extended coherence encoder 453 is configured to encode the DCT 0-order extended coherence using the codebook and output it as an encoded coherence vector 404.

[0187] about Figure 7 , shows a flowchart of a method for encoding an energy ratio parameter and a direction parameter (as shown on the left side of the dashed line) and a coherence parameter (on the right side of the dashed line) according to some embodiments.

[0188] In some embodiments, the energy ratio is encoded using 3 bits per value and by using an optimized scalar quantization (SQ) method, such as Figure 7 As shown in step 601.

[0189] Then, if at least one coherence value is non-null, the number of bits used to encode the 0th-order DCT parameters for the extended coherence is estimated, as Figure 7 , as shown in step 603. Otherwise, if the output is all zero, only one bit is sent to indicate that the value is zero.

[0190] Additionally, the method may include encoding the 1st order DCT parameters for extending the coherence using a Golomb Rice encoding of the mean removed index for the quantization index, such as Figure 7 As shown in step 605. As discussed above, the index may in some embodiments be obtained from a scalar quantization in a codebook depending on the index of the subband. The number of codewords is the same (eg, 5) for all subbands.

[0191] In some embodiments, the method further includes encoding the surround coherence and calculating the number of bits used for the surround coherence, such as Figure 7 In some embodiments, as discussed above, one ambient coherence value is sent for each subband. In some embodiments, the value is obtained in a manner similar to the method used for the energy ratio in step 601, as a weighted average of the time-frequency blocks of the subband, the weight being the signal energy. The averaged ambient coherence value is then scalar quantized using a codebook whose length (number of codewords) depends on the energy ratio index (for index: 0, 1, 2, 3, 4, 5, 6, 7, codewords 2, 3, 4, 5, 6, 7, 8, 8). The index is encoded by Golomb Rice encoding for the mean removed value, or by joint encoding taking into account the number of codewords used.

[0192] In some embodiments, the method includes calculating the number of remaining bits for encoding the direction parameter, such as Figure 7 As shown in step 609.

[0193] After determining the number of remaining bits for encoding the direction parameter, the direction parameter is then encoded, such as Figure 7 As shown in step 611.

[0194] Furthermore, the method comprises encoding the 0th order DCT coefficients for extending the coherence using a codebook depending on the energy ratio and the quantized azimuth value (the variance of the quantized azimuth value for the current subband), such as Figure 7 613. This determination may be based on selecting one or the other of two possible codebooks for a range of energy ratio values, the selection being based on whether the variance of the azimuth angle for the subband is below (or above) a threshold. In this way, there may be a total of 16 codebooks for 0-order DCT coefficients (8 indices for energy ratio and two possibilities for azimuth angle variance associated with a given threshold).

[0195] This operation can be represented by the following code.

[0196]

[0197]

[0198]

[0199]

[0200] about Figure 8 , shows an example metadata extractor 137 as part of the decoder 133 from the perspective of extracting and decoding coherent values ​​according to some embodiments.

[0201] In some embodiments, the encoded data stream is passed to a demultiplexer. The demultiplexer extracts the encoded directional index, energy ratio index and coherence index, and in some embodiments may also extract other metadata and transmit audio signals (not shown).

[0202] The energy ratio index can be decoded by an energy ratio decoder to generate an energy ratio for a frame by performing the inverse of the energy ratio encoding implemented by the energy ratio encoder. In addition, the energy ratio index can be passed to a coherent DCT vector generator (and in some embodiments to a codebook determiner 815).

[0203] The directional index can be decoded by a directional decoder, which is configured to perform the reversal of the encoding of the directional value implemented by the directional encoder. In some embodiments, after the directional value is decoded, the variance of the azimuth value is determined and output to a coherent DCT vector generator (and in some embodiments to a codebook determiner 815).

[0204] The metadata extractor 137 includes, in some embodiments, a coherent DCT vector generator 801 (and in some embodiments, a codebook determiner 815). The coherent DCT vector generator 801 is configured to receive the encoded coherence value 800, and further receive the encoded energy ratio 812 and the variance 814 of the (decoded) azimuth value. A codebook is selected or determined based on these values ​​(e.g., the codebook determiner 815 can be the same as the codebook determiner 415 from the coherent encoder 209).

[0205] After the codebook is determined, the received encoded coherence index is then decoded using the inverse of the encoding method used in the coherence encoder to generate appropriate DCT coherence vectors 802 for the extended and surround coherence values. The DCT coherence vectors 802 are then passed to an inverse discrete cosine transformer 803.

[0206] The metadata extractor 137 in some embodiments comprises an inverse discrete cosine transformer 803. The inverse discrete cosine transformer 803 is configured to receive the (decoded) DCT coherence vector 802 and generate a coherence vector 804, which is output to a vector decoder 805.

[0207] The metadata extractor 137 in some embodiments comprises a vector decoder 805. The vector decoder 805 is configured to receive the decoded coherence vector 804 and extract therefrom coherence parameters 806 for the subband.

[0208] about Fig. 9 A flow chart of a method for decoding extended coherence parameters is shown.

[0209] The first operation is to obtain (eg, receive or retrieve) the encoded extended coherence value, such as Fig. 9 As shown in step 901.

[0210] After obtaining the coded extended coherence value, the next operation is to read the first DCT extended coherence parameter index (primary DCT parameter) for (each) subband, such as Fig. 9 As shown in step 903.

[0211] Despite Fig. 9 The obtained coded extended coherence value is not shown in , but the coded surround coherence value, the coded energy ratio and the coded azimuth and elevation values ​​are obtained.

[0212] The encoded energy ratio and the encoded azimuth and elevation values ​​are decoded by applying the inverse of the encoding process performed in the encoder. The energy ratio is decoded first. The number of bits used for the extended coherent DCT index is known based on the energy ratio value. The index sent to encode the zero-order DCT parameters of the extended coherence is read first and can only be decoded after the azimuth value is decoded.

[0213] Furthermore, the encoded surrounding coherence values ​​are decoded based on applying the inverse of the encoding process in the encoder. For example, this involves selecting an appropriate codebook based on the energy ratio values.

[0214] The next operation is to determine a codebook for the first DCT expansion coherent parameter based on the quantized energy ratio and the decoded azimuth quantization variance. After the codebook is determined, the first DCT expansion coherent parameter index is decoded, such as Fig. 9 As shown in step 905.

[0215] The next operation is to determine whether the current subband being decoded is less than or equal to the subband value (I_N) used in the encoder, such as Fig. 9 As shown in step 907.

[0216] In case the current subband being decoded is less than or equal to the subband value (I_N) used in the encoder, then the next (first secondary) DCT spread coherence parameter is read and decoded using the inverse of the coding implemented in the encoder, e.g. Fig. 9 As shown in step 909.

[0217] In case the current subband being decoded is larger than the subband value (I_N) used in the encoder, then the next two (first and second level) DCT spread coherence parameters are read and decoded using the inverse of the coding implemented in the encoder, e.g. Fig. 9 As shown in step 911.

[0218] After decoding the two (or three) DCT parameters, the next operation is to perform an inverse DCT on the parameters to generate a decoded vector, such as Fig. 9 As shown in step 913.

[0219] The decoded vector can then be read as the time-frequency block spread coherence value for that subband. The next operation is to check if all subbands have been decoded, e.g. Fig. 9 As shown in step 915.

[0220] When there is another subband to decode, the operation may loop back to step 903 .

[0221] When all subbands are decoded, then the next frame decoding can start, such as Fig. 9 As shown in step 917 (in other words, the operation loops back to step 901).

[0222] about Fig.10 , shows an example electronic device that can be used as an analysis or synthesis device. The device can be any suitable electronic device or device. For example, in some embodiments, the device 1400 is a mobile device, user equipment, a tablet computer, a computer, an audio playback device, etc.

[0223] In some embodiments, device 1400 includes at least one processor or central processing unit 1407. Processor 1407 may be configured to execute various program codes such as methods, such as described herein.

[0224] In some embodiments, the device 1400 includes a memory 1411. In some embodiments, at least one processor 1407 is coupled to the memory 1411. The memory 1411 can be any suitable storage means. In some embodiments, the memory 1411 includes a program code section for storing program code that can be implemented on the processor 1407. In addition, in some embodiments, the memory 1411 may further include a storage data section for storing data, such as data that has been processed or is to be processed according to the embodiments described herein. The implemented program code stored in the program code section and the data stored in the storage data section can be retrieved by the processor 1407 via the memory-processor coupling whenever needed.

[0225] In some embodiments, the device 1400 includes a user interface 1405. In some embodiments, the user interface 1405 can be coupled to a processor 1407. In some embodiments, the processor 1407 can control the operation of the user interface 1405 and receive input from the user interface 1405. In some embodiments, the user interface 1405 can enable a user to enter commands to the device 1400, such as via a keyboard. In some embodiments, the user interface 1405 can enable a user to obtain information from the device 1400. For example, the user interface 1405 can include a display configured to display information from the device 1400 to the user. In some embodiments, the user interface 1405 can include a touch screen or touch interface that can both enable information to be input to the device 1400 and further display information to the user of the device 1400. In some embodiments, the user interface 1405 can be a user interface for communicating with a position determiner as described herein.

[0226] In some embodiments, the device 1400 includes an input / output port 1409. In some embodiments, the input / output port 1409 includes a transceiver. In such embodiments, the transceiver can be coupled to the processor 1407 and configured to enable communication with other devices or electronic devices, such as via a wireless communication network. In some embodiments, the transceiver or any suitable transceiver or transmitter and / or receiver means can be configured to communicate with other electronic devices or devices via wires or wired couplings.

[0227] The transceiver may communicate with further devices via any suitable known communication protocol. For example, in some embodiments, the transceiver may use a suitable Universal Mobile Telecommunications System (UMTS) protocol, a Wireless Local Area Network (WLAN) protocol (such as, for example, IEEE 802.X), a suitable short-range radio frequency communication protocol such as Bluetooth, or an infrared data communication path (IRDA).

[0228] The transceiver input / output port 1409 may be configured to receive signals and, in some embodiments, determine parameters as described herein using the processor 1407 executing appropriate code. In addition, the apparatus may generate appropriate downmixed signals and parameter outputs for transmission to a synthesis device.

[0229] In some embodiments, the device 1400 may be used as at least part of a synthesis device. Thus, the input / output port 1409 may be configured to receive a mixed signal and, in some embodiments, receive parameters determined at an acquisition device or processing device as described herein, and generate a suitable audio signal format output using a processor 1407 executing suitable code. The input / output port 1409 may be coupled to any suitable audio output, such as a multi-channel speaker system and / or headphones or similar audio output.

[0230] In general, various embodiments of the present invention may be implemented in hardware or dedicated circuits, software, logic, or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software, which may be executed by a controller, microprocessor, or other computing device, although the present invention is not limited thereto. Although various aspects of the present invention may be shown and described as block diagrams, flow charts, or illustrated and described using some other graphical representation, it is well understood that the blocks, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof as non-limiting examples.

[0231] Embodiments of the present invention may be implemented by computer software executable by a data processor of a mobile device (such as in a processor entity), or by hardware, or by a combination of software and hardware. It should be further noted in this regard that any of the logic flows as in the figure may represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions. The software may be stored on a physical medium, such as a memory chip, or a memory block implemented in a processor, a magnetic medium, such as a hard disk or a floppy disk, and an optical medium, such as, for example, a DVD and its data variants, a CD.

[0232] The memory may be of any type suitable for the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor-based storage devices, magnetic storage devices and systems, optical storage devices and systems, fixed memory, and removable memory. The data processor may be of any type suitable for the local technical environment and may include one or more of the following as non-limiting examples: a general-purpose computer, a special-purpose computer, a microprocessor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a gate-level circuit, and a processor based on a multi-core processor architecture.

[0233] Embodiments of the present invention may be practiced in various components such as integrated circuit modules. The design of integrated circuits is generally a highly automated process. Complex and powerful software tools are available to convert a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate.

[0234] Programs, such as those offered by Synopsys, Inc. of Mountain View, Calif., and Cadence Design Inc. of San Jose, Calif., automatically route conductors and position components on a semiconductor chip using established design rules and a library of pre-stored design modules. Once a design for a semiconductor circuit is complete, the resulting design, in a standardized electronic format (e.g., Opus, GDSII, etc.), can be transmitted to a semiconductor manufacturing facility or "fab" for fabrication.

[0235] The foregoing description has provided a complete and informative description of exemplary embodiments of the present invention by way of exemplary and non-limiting examples. However, in view of the foregoing description, when read in conjunction with the accompanying drawings and the appended claims, various modifications and adaptations may become apparent to those skilled in the relevant art. However, all such and similar modifications to the teachings of the present invention will still fall within the scope of the present invention as defined in the appended claims.

Claims

1. An apparatus comprising means for: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one energy ratio value and at least one extension and / or surround coherence value for each subband; determining a codebook for encoding at least one spread and / or surround coherence value for each subband based on the at least one energy ratio value and the variance of the at least one azimuth angle value for each subband of the frame; performing a discrete cosine transform on at least one vector comprising the at least one extended and / or surround coherence value for a subband of the frame; and A first number of components of the discrete cosine transform vector are encoded based on the determined codebook.

2. The device according to claim 1, wherein: The means for determining a codebook for encoding at least one coherent value for each subband based on the variance of the at least one energy ratio value and the at least one azimuth angle value for each subband of the frame is further configured to: obtaining an index representing a weighted average of the at least one energy ratio value for each subband of the frame; determining whether a variance of the at least one azimuth angle value for the subband of a frame is greater than or equal to a determined threshold; as well as The codebook is selected based on the index and determining whether a variance of the at least one azimuth angle value for the subband of a frame is greater than or equal to a determined threshold.

3. The device according to claim 2, wherein: The module for selecting the codebook based on the index and determining whether a variance of the at least one azimuth angle value for a subband of a frame is greater than or equal to a determined threshold is further configured to select a number of codewords for the codebook based on the index.

4. The device according to any one of claims 1 to 3, wherein: The module for encoding a first number of components of the discrete cosine transform vector based on the determined codebook is further configured to: determining that said first number of components of said discrete cosine transform vector depends on said subband; A first component of the first number of the discrete cosine transform vector components is encoded based on the codebook.

5. The device according to claim 4, wherein: The module for encoding a first number of components of the discrete cosine transform vector based on the determined codebook is further configured to: Determining a codebook for scalar quantization based on the index of the subband, each codebook including a determined number of codewords; generating at least one further index for a component remainder of said first number of said discrete cosine transformed vector components based on said determined codebook; generating a mean removed index based on said at least one further index for said component remainder of said first number of said discrete cosine transformed vector components; as well as The mean removal index is entropy encoded.

6. The device according to claim 4, wherein: The module for encoding a first number of components of the discrete cosine transform vector based on the determined codebook is further configured to: determining at least one further index for said component remainders of said first number of said discrete cosine transformed vector components based on a codebook having a defined number of codewords, said codebook being based on subband indices of said vectors; determining a mean removal index based on said at least one further index of said component remainder for said first number of said discrete cosine transformed vector components; as well as The mean removal index is entropy encoded.

7. The device according to any one of claims 5 and 6, wherein: The module for entropy encoding the mean removal index is further used to perform Golomb-Rice encoding on the mean removal index.

8. The device according to any one of claims 1 to 7, wherein: The module is further configured to store and / or transmit the encoded first number of components of the discrete cosine transform vector.

9. The apparatus according to any one of claims 1 to 8, wherein the module is further used to scalar quantize the at least one energy ratio value to generate at least one energy ratio index suitable for determining the codebook, wherein the codebook is used to encode at least one coherent value for each subband.

10. The apparatus of claim 9 when dependent on claim 5 or 6, wherein the module is further configured to: receiving at least one elevation angle value for each subband; estimating a remaining number of bits for encoding the at least one azimuth angle value and the at least one elevation angle value based on a target number of bits, a number of bits for encoding the first number of components of the discrete cosine transform vector estimated based on the determined codebook before the encoding, a number of bits representing the at least one energy ratio index, and a number of bits for the entropy encoding representing the mean removal index; The at least one azimuth angle value and the at least one elevation angle value are encoded to generate at least one azimuth angle value index and at least one elevation angle value index based on the remaining number of bits, wherein the codebook for encoding at least one coherent value for each subband is determined based on the at least one azimuth angle value index.

11. An apparatus comprising means for: obtaining coded values ​​for subbands of a frame of an audio signal, said values ​​comprising for each subband at least one azimuth index, at least one energy ratio index and at least one spread and / or surround coherence index; decoding the at least one azimuth index to provide at least one azimuth value; determining a codebook for decoding the at least one spreading and / or surround coherence index for each subband based on the at least one energy ratio index and the variance of the at least one azimuth angle value; performing an inverse discrete cosine transform on the at least one spread and / or surround coherence index to generate at least one vector comprising the at least one spread and / or surround coherence value for a subband of the frame; and The vector is parsed to generate at least one extension and / or surround coherence value for each subband.

12. The device according to claim 11, wherein: The means for determining a codebook for decoding the at least one spreading and / or surround coherence index for each subband based on the at least one energy ratio index and the variance of the at least one azimuth angle value is further configured to: determining whether a variance of the at least one azimuth angle value for a subband of the frame is greater than or equal to a determined threshold; as well as The codebook is selected based on the at least one energy ratio index and determining whether a variance of the at least one azimuth angle value for the subband of a frame is greater than or equal to a determined threshold.

13. The device according to claim 12, wherein: The module for selecting the codebook based on the at least one energy ratio index and determining whether a variance of the at least one azimuth angle value for a subband of a frame is greater than or equal to a determined threshold is further configured to select a number of codewords for the codebook based on the at least one energy ratio index.

14. The device according to any one of claims 11 to 13, wherein: The apparatus further includes means for decoding a first number of components of the discrete cosine transform vector based on the determined codebook by: decoding a first component of the first number of discrete cosine transform vector components based on the codebook; decoding further components of the first number of discrete cosine transform vector components based on the codebook; and The decoded first component and further components are inverse cosine transformed.

15. A method comprising: receiving values ​​for subbands of a frame of an audio signal, the values ​​comprising at least one azimuth value, at least one energy ratio value and at least one extension and / or surround coherence value for each subband; determining a codebook for encoding the at least one spread and / or surround coherence value for each subband based on the at least one energy ratio value and the variance of the at least one azimuth angle value for each subband of the frame; performing a discrete cosine transform on at least one vector comprising the at least one extended and / or surround coherence value for a subband of the frame; and A first number of components of the discrete cosine transform vector are encoded based on the determined codebook.

16. The method according to claim 15, wherein: Determining a codebook for encoding at least one coherent value for each subband based on the at least one energy ratio value and the variance of the at least one azimuth value for each subband of the frame further comprises: obtaining an index representing a weighted average of the at least one energy ratio value for each subband of the frame; determining whether a variance of the at least one azimuth angle value for the subband of a frame is greater than or equal to a determined threshold; and The codebook is selected based on the index and determining whether a variance of the at least one azimuth angle value for the subband of the frame is greater than or equal to a determined threshold.

17. The method according to claim 16, wherein: Selecting the codebook based on the index and the determination further includes selecting a number of codewords for the codebook based on the index.

18. The method according to any one of claims 15 to 17, wherein: Encoding the first number of components of the discrete cosine transform vector based on the determined codebook further comprises: determining that said first number of components of said discrete cosine transform vector depends on said subband; A first component of the first number of the discrete cosine transform vector components is encoded based on the codebook.

19. The method according to claim 18, wherein: Encoding the first number of components of the discrete cosine transform vector based on the determined codebook further comprises: Determining a codebook for scalar quantization based on the index of the subband, each codebook including a determined number of codewords; generating at least one further index for a component remainder of said first number of said discrete cosine transformed vector components based on said determined codebook; generating a mean removed index based on at least one further index of said component remainder for said first number of said discrete cosine transformed vector components; and The mean removal index is entropy encoded.

20. The method of claim 19, wherein encoding the first number of components of the discrete cosine transform vector based on the determined codebook further comprises: determining at least one further index for said component remainders of said first number of said discrete cosine transformed vector components based on a codebook having a defined number of codewords, said codebook being based on subband indices of said vectors; determining a mean removal index based on said at least one further index of said component remainder for said first number of said discrete cosine transformed vector components; as well as The mean removal index is entropy encoded.

21. The method according to any one of claims 19 and 20, wherein: Entropy encoding the mean removal index further includes Golomb-Rice encoding the mean removal index.

22. The method according to any one of claims 15 to 21, further comprising: The encoded first number of components of the discrete cosine transform vector are stored and / or transmitted.

23. The method according to any one of claims 15 to 22, further comprising: The at least one energy ratio value is scalar quantized to generate at least one energy ratio value index suitable for determining the codebook for encoding at least one coherence value for each subband.

24. The method of claim 23 when dependent on claim 19 or 20, further comprising: receiving at least one elevation angle value for each subband; estimating a remaining number of bits for encoding the at least one azimuth angle value and the at least one elevation angle value based on a target number of bits, a number of bits for encoding the first number of components of the discrete cosine transform vector estimated based on the determined codebook before the encoding, a number of bits representing the at least one energy ratio index, and a number of bits for the entropy encoding representing the mean removal index; The at least one azimuth angle value and the at least one elevation angle value are encoded to generate at least one azimuth angle value index and at least one elevation angle value index based on the remaining number of bits, wherein the codebook for encoding at least one coherent value for each subband is determined based on the at least one azimuth angle value index.

25. A method comprising: obtaining coded values ​​for subbands of a frame of an audio signal, said values ​​comprising for each subband at least one azimuth index, at least one energy ratio index and at least one spread and / or surround coherence index; decoding the at least one azimuth index to provide at least one azimuth value; determining a codebook for decoding the at least one spreading and / or surround coherence index for each subband based on the at least one energy ratio index and the variance of the at least one azimuth angle value; performing an inverse discrete cosine transform on the at least one spread and / or surround coherence index to generate at least one vector comprising the at least one spread and / or surround coherence value for a subband of the frame; and The vector is parsed to generate at least one extension and / or surround coherence value for each subband.

26. The method according to claim 25, wherein: Determining a codebook for decoding the at least one spreading and / or surround coherence index for each subband based on the at least one energy ratio index and the variance of the at least one azimuth angle value further comprises: determining whether a variance of the at least one azimuth angle value for a subband of the frame is greater than or equal to a determined threshold; and The codebook is selected based on the at least one energy ratio index and determining whether a variance of the at least one azimuth angle value for the subband of a frame is greater than or equal to a determined threshold.

27. The method according to claim 26, wherein: Selecting the codebook based on the at least one energy ratio index and determining whether a variance of the at least one azimuth angle value for a subband of a frame is greater than or equal to a determined threshold further includes selecting a number of codewords for the codebook based on the at least one energy ratio index.

28. A method according to any one of claims 25 to 27, wherein: Decoding the first number of components of the discrete cosine transform vector based on the determined codebook further comprises: decoding a first component of the first number of discrete cosine transform vector components based on the codebook; decoding further components of the first number of discrete cosine transform vector components based on the codebook; and The decoded first component and further components are inverse cosine transformed.

Citation Information

Patent Citations

  • Audio coding

    CN101292286A

  • Audio bandwidth expansion method and expansion apparatus thereof

    CN107221334A

  • Quantization of spatial audio parameters

    CN112219237A

  • Selection of quantisation schemes for spatial audio parameter encoding

    CN113228168A

  • High precision encoding and decoding of video images

    CN1550108A