MULTI-CHANNEL SIGNAL GENERATOR DEPENDING ON A MIXING NOISE SIGNAL, AUDIO ENCODER, AND RELATED METHODS - Patent application

The method addresses the challenge of maintaining a coherent stereo image in DTX systems by modeling channel correlation and using a mixing noise source to decorrelate and correlate audio signals, enhancing user experience and reducing data rate requirements.

JP7584631B2Active Publication Date: 2024-11-15FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023514100
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-08-31
Filing Date
2021-06-30
Publication Date
2024-11-15
Estimated Expiration
2041-06-30

AI Technical Summary

Technical Problem

Existing DTX systems for stereo audio signals face issues in maintaining a coherent stereo image and smooth transitions between active and inactive frames, leading to abrupt audible transitions and loss of spatial impression due to independent generation of background noise in each channel.

Method used

A method for generating stereo comfort noise by modeling the degree of correlation between channels, using a mixing noise source to decorrelate and correlate audio signals based on inter-channel coherence, and encoding parametric noise data to maintain a coherent stereo image.

Benefits of technology

Improves user experience by ensuring smooth transitions and maintaining a coherent stereo image during discontinuous transmission, reducing data rate requirements while preserving spatial impression.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007584631000046
    Figure 0007584631000046
  • Figure 0007584631000047
    Figure 0007584631000047
  • Figure 0007584631000048
    Figure 0007584631000048
Patent Text Reader

Abstract

A multi-channel signal generator (200) and an audio encoder are provided. The multi-channel signal generator (200) is for generating a multi-channel signal (204) having a first channel (201) and a second channel (203). The multi-channel signal generator (200) comprises: a first audio source (211) for generating a first audio signal (221); a second audio source (213) for generating a second audio signal (223); a mixing noise source (212) for generating a mixing noise signal (222); and a mixer (206) for mixing the mixing noise signal (222) with the first audio signal (221) to obtain a first channel (201) and for mixing the mixing noise signal (222) with the second audio signal (222) to obtain a second channel (203).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The invention relates inter alia to Comfort Noise Generation (CNG) enabling Discontinuous Transmission (DTX) in Stereo Codecs. The invention also refers to a multi-channel signal generator, an audio encoder and related methods, e.g., relying on a mixing noise signal. The invention may be implemented in a device, an apparatus, a system, a method, a non-transitory storage unit that stores instructions that, when executed by a computer (processor, controller), cause the computer (processor, controller) to perform a particular method, and an encoded multi-channel audio signal. [Background technology]

[0002] Comfort noise generators are typically used in the intermittent transmission (DTX) of audio signals, especially audio signals containing speech. In such a mode, the audio signal is first classified into active and inactive frames by a voice activity detector (VAD). Based on the results of the VAD, only active speech frames are coded and transmitted at the nominal bit rate. In long pauses where only background noise is present, the bit rate is lowered or made zero, and the background noise is parametrically coded using silence insertion descriptor frames (SID frames). The average bit rate is then significantly reduced.

[0003] The noise is generated in inactive frames at the decoder side by a comfort noise generator (CNG). The size of the SID frame is very limited in practice. Therefore, the number of parameters describing the background noise must be kept as small as possible. For this purpose, the noise estimation is not applied directly on the output of the spectral transformation. Instead, it is applied at a lower spectral resolution by averaging the input power spectrum over groups of bands, for example according to the Bark scale. The averaging can be achieved either by arithmetic or geometric mean. Unfortunately, the number of parameters transmitted in the SID frame is limited, so that the fine spectral structure of the background noise cannot be captured. Therefore, only the smooth spectral envelope of the noise can be reproduced by the CNG. When the VAD triggers a CNG frame, the discrepancy between the smooth spectrum of the reconstructed comfort noise and the spectrum of the actual background noise can become very audible when the transition is made between the active frame (with the normal encoding and decoding of the noisy speech part of the signal) and the CNG frame.

[0004] Some typical CNG techniques are described in ITU-T Recommendations G.729B[1], G.729.1C[2], G.718[3], or in the 3GPP® specifications for AMR[4] and AMR-WB[5]. All these techniques generate comfort noise (CN) by using an analysis-synthesis approach that uses linear prediction (LP).

[0005] To further reduce the transmission rate, the 3GPP communication codec for Enhanced Voice Services (EVS) in LTE [6] provides an Intermittent Transmission (DTX) mode that applies Comfort Noise Generation (CNG) to inactive frames, i.e. frames determined to consist only of background noise. In these frames, a low-rate parametric representation of the signal is conveyed by a Silence Insertion Descriptor (SID) frame at most every 8 frames (160 ms). This allows the CNG at the decoder to generate an artificial noise signal that resembles the real background noise. In EVS, CNG can be achieved using either a linear prediction scheme (LP-CNG) or a frequency domain scheme (FD-CNG), depending on the spectral characteristics of the background noise.

[0006] The LP-CNG approach in EVS[7] works on a split-band basis with encoding consisting of analysis / synthesis encoding stages for both low-band and high-band. In contrast to the low-band encoding, no parametric modeling of the high-band noise spectrum is performed for the high-band signal. Only the energy of the high-band signal is encoded and transmitted to the decoder, while the high-band noise spectrum is generated purely at the decoder side. Both low-band and high-band CNs are synthesized by filtering the excitation through a synthesis filter. The low-band excitation is derived from the received low-band excitation energy and the low-band excitation frequency envelope. The low-band synthesis filter is derived from the received LP parameters in the form of Line Spectral Frequency (LSF) coefficients. The high-band excitation is obtained using the energy extrapolated from the low-band energy, and the high-band synthesis filter is derived from the LSF interpolation at the decoder side. The high-band synthesis is spectrally inverted and added to the low-band synthesis to form the final CN signal.

[0007] The FD-CNG approach [8][9] uses a frequency domain noise estimation algorithm followed by vector quantization of the smoothed spectral envelope of the background noise. The decoded envelope is refined by running a second frequency domain noise estimator at the decoder. Since a purely parametric representation is used for inactive frames, in this case the noise signal is not available at the decoder. In FD-CNG, noise estimation is performed for every frame (active and inactive) at the encoder and decoder side based on a minimum statistics algorithm.

[0008] A method for generating comfort noise in the case of two (or more) channels is described in

[10] . In

[10] , a system for stereo DTX and CNG is described that combines mono SID with band-wise coherence measures calculated on the two input stereo channels at the encoder. At the decoder, the mono CNG information and the coherence values ​​are decoded from the bitstream and target coherence in multiple frequency bands is synthesized. To reduce the bit rate of the resulting stereo SID frame, the coherence values ​​are encoded using a prediction scheme and then entropy coded at a variable bit rate. Comfort noise is generated for each channel by the method described in the previous paragraph, and then the two CNs are mixed band-wise using a formula with weighting based on the transmit band coherence values ​​contained in the SID frame.

[0009] Motivations / Drawbacks of the Prior Art In a stereo system, generating background noise separately produces a completely uncorrelated noise that sounds very different and unpleasant from the actual background noise, causing a sudden audible transition when switching to / from the active mode background to the DTX mode background. In addition, it is not possible to preserve the background stereo image using only two completely uncorrelated noise sources. Finally, when there is a background noise source and the speaker is moving with the handheld device around the noise source, the spatial image of the background noise changes over time, something that cannot be reproduced when reconstructing the background noise for each channel independently. Therefore, a new approach needs to be developed to accommodate the problem for stereophonic signals.

[0010] This is also addressed in

[10] , where in an embodiment the insertion of a common noise source in both channels to mimic correlated noise for generating the final comfort noise plays an important role in mimicking the stereophonic background noise recording.

[0011] Current communication voice codecs typically only code mono signals. Therefore, most existing DTX systems are designed for mono CNG. Simply applying the DTX operation independently on both channels of a stereo signal seems easy, but it contains several problems. First, this approach requires the transmission of two sets of parameters describing the two background noise signals in the two channels. This increases the data rate required for SID frame transmission and reduces the benefit of the load reduction on the network. Another problematic aspect is the VAD decision, which must be synchronized between channels to avoid anomalies and distortions of the spatial image of the stereo signal and to optimize the bit rate reduction of the system. Furthermore, when applying CNG at the receiver side independently on both channels, the two independent CNG algorithms typically generate two random noise signals with zero or very low coherence. This results in a large stereo image in the generated comfort noise. On the other hand, applying only on the noise generator and using the same comfort noise signal in both channels results in a very high coherence and a very narrow stereo image. However, for most stereo signals, the stereo image and its spatial impression lie somewhere between these two extremes. Switching between active frames and DTX mode would result in an abrupt audible transition. Also, if there is a background noise source and the speaker is moving with the handheld device around the noise source, the spatial image of the background noise will change over time, something that cannot be reproduced when reconstructing the background noise for each channel independently. Therefore, a new approach is needed to accommodate the problem for stereophonic signals.

[0012] The system described in

[10] addressed these issues by transmitting information for the mono CNG together with the parameter values ​​used to resynthesize the stereo image of the background noise at the decoder. This type of DTX system is well suited to parametric stereo coders that apply a downmix to the two input channels before encoding and transmission, from which the mono CNG parameters can be derived. However, in discrete stereo coding schemes, the two channels are usually still coded in a joint manner, and upmix parameters such as fine-grained coherence measures are usually not derived. Therefore, for these kinds of stereo coders, a different approach is needed. Summary of the Invention [Problem to be solved by the invention]

[0013] In an embodiment of the present invention, an efficient transmission of a stereo audio signal is provided. Transmitting a stereo signal may significantly improve the user experience and speech intelligibility compared to transmitting only one channel of audio (mono), especially in situations where background noise or other sounds are present. The stereo signal may be coded in a parametric manner, where a mono downmix of the two stereo channels is applied and this single downmix channel is coded and transmitted to the receiver together with side information that is used to approximate the original stereo signal at the decoder. Another approach employs discrete stereo coding, aiming to remove the redundancy between the channels using some signal pre-processing to achieve a more compact two-channel representation of the original signal. The two processed channels are then coded and transmitted. At the decoder, an inverse process is applied. Nevertheless, the side information related to the stereo processing may be transmitted along the two channels. Thus, the main difference between parametric and discrete stereo coding methods lies in the number of channels transmitted.

[0014] Typically, in a conversation there are periods when not all the speakers are actively speaking. Thus, the input signal to the speech coder in these periods consists mainly of background noise or (almost) silence. To save data rates and reduce the load on the transmission network, the speech coder tries to distinguish between frames containing speech (active frames) and frames containing mainly background noise or silence (inactive frames). For inactive frames, the data rate can be significantly reduced by not encoding the audio signal as for active frames, but instead deriving a parametric low bit rate description of the current background noise in the form of a Silence Insertion Descriptor (SID) frame. This SID frame is periodically transmitted to the decoder to update the parameters describing the background noise, while for the intervening inactive frames, either the bit rate is reduced or no information is transmitted at all. At the decoder, the background noise is remodeled using the parameters transmitted in the SID frame by a Comfort Noise Generation (CNG) algorithm. In this way, the transmission rate can be reduced or even zero for inactive frames without the user interpreting it as an interruption or termination of the connection.

[0015] We describe a DTX system for discretely coded stereo signals consisting of stereo SIDs, while maintaining an average bit rate comparable to mono applications, and a method for CNG that generates stereo comfort noise by modeling the spectral characteristics of the background noise in both channels and the degree of correlation between them. [Means for solving the problem]

[0016] According to one aspect, there is provided a multi-channel signal generator for generating a multi-channel signal having a first channel and a second channel, comprising: a first audio source for generating a first audio signal; a second audio source for generating a second audio signal; a mixing noise source for generating a mixing noise signal; A mixer for mixing the mixing noise signal with the first audio signal to obtain a first channel and for mixing the mixing noise signal with the second audio signal to obtain a second channel.

[0017] According to one aspect, the first audio source is a first noise source and the first audio signal is a first noise signal, or the second audio source is a second noise source and the second audio signal is a second noise signal; The first noise source or the second noise source is configured to generate the first noise signal or the second noise signal such that the first noise signal or the second noise signal is decorrelated from the mixing noise signal.

[0018] According to one embodiment, the mixer is configured to generate the first channel and the second channel such that an amount of the mixing noise signal in the first channel is equal to an amount of the mixing noise signal in the second channel or is within a range of 80 percent to 120 percent of the amount of the mixing noise signal in the second channel.

[0019] According to one aspect, the mixer comprises a control input for receiving a control parameter, the mixer configured to control an amount of the mixing noise signal in the first channel and the second channel in response to the control parameter.

[0020] According to one aspect, each of the first audio source, the second audio source, and the mixing noise source is a Gaussian noise source.

[0021] According to one aspect, the first audio source comprises a first noise generator for generating the first audio signal as the first noise signal, the second audio source comprises a decorrelator for decorrelating the first noise signal to generate the second audio signal as the second noise signal, and the mixing noise source comprises a second noise generator; or the first audio source comprises a first noise generator for generating a first audio signal as the first noise signal, the second audio source comprises a second noise generator for generating a second audio signal as the second noise signal, and the mixing noise source comprises a decorrelator for decorrelating the first noise signal or the second noise signal to generate the mixing noise signal, or one of the first audio source, the second audio source and the mixing noise source comprises a noise generator for generating a noise signal, another one of the first audio source, the second audio source and the mixing noise source comprises a first decorrelator for decorrelating the noise signal, and yet another one of the first audio source, the second audio source and the mixing noise source comprises a second decorrelator for decorrelating the noise signal, the first decorrelator and the second decorrelator being different from each other such that output signals of the first decorrelator and the second decorrelator are decorrelated from each other, or The first audio source comprises a first noise generator, the second audio source comprises a second noise generator, and the mixing noise source comprises a third noise generator, and the first noise generator, the second noise generator, and the third noise generator are configured to generate noise signals that are decorrelated with each other.

[0022] According to one aspect, one of the first audio source, the second audio source, and the mixing noise source comprises a pseudo-random sequence generator configured to generate a pseudo-random sequence in response to a seed, and at least two of the first audio source, the second audio source, and the mixing noise source are configured to initialize the pseudo-random sequence generator using different seeds.

[0023] According to one aspect, at least one of the first audio source, the second audio source, and the mixing noise source is configured to operate using a pre-stored noise table; or at least one of the first audio source, the second audio source, and the mixing noise source is configured to generate a complex spectrum for the frame using a first noise value for the real part and a second noise value for the imaginary part; Optionally, the at least one noise generator is configured to generate a complex noise spectral value for frequency bin k using a first random value at index k for one of the real and imaginary parts and a second random value at index (k+M) for the other of the real and imaginary parts, wherein the first noise value and the second noise value are included in a noise array having a range from a start index to an end index derived, for example, from a random number sequence generator or a noise table or a noise process, where the start index is less than M and the end index is less than or equal to 2M, and where M and k are integer values.

[0024] According to one embodiment, the mixer comprises: a first amplitude factor for influencing the amplitude of the first audio signal; a first adder for adding an output signal of the first amplitude element and at least a portion of the mixing noise signal; a second amplitude factor for influencing the amplitude of the second audio signal; a second adder for adding an output of the second amplitude element and at least a portion of the mixing noise signal; The amount of influence action performed by the first amplitude element and the amount of influence action performed by the second amplitude element are equal to each other or the amount of influence action performed by the second amplitude element differs by less than 20% from the amount of influence action performed by the first amplitude element.

[0025] According to one embodiment, the mixer comprises a third amplitude element for influencing the amplitude of the mixing noise signal; The amount of influence action performed by the third amplitude element depends on the amount of influence action performed by the first amplitude element or the second amplitude element, whereby the amount of influence action performed by the third amplitude element is greater when the amount of influence action performed by the first amplitude element or the amount of influence action performed by the second amplitude element is smaller.

[0026] According to one embodiment, the amount of influence performed by the third amplitude element is a value c q , and the amount of influence performed by the first amplitude element and the amount of influence performed by the second amplitude element are 1 and c q is the square root of the difference between

[0027] According to one aspect, an input interface for receiving encoded audio data in a sequence of frames including an active frame and an inactive frame following the active frame; an audio decoder is provided for decoding the encoded audio data for the active frames to generate a decoded multi-channel signal for the active frames; The first audio source, the second audio source, the mixing noise source, and the mixer are active in the inactive frames to generate a multi-channel signal for the inactive frames.

[0028] According to one aspect, the encoded audio signal for the active frame has a first plurality of coefficients describing a first number of frequency bins; the encoded audio signal for the inactive frame has a second plurality of coefficients describing a second number of frequency bins; The first number of frequency bins is greater than the second number of frequency bins.

[0029] According to one aspect, the encoded audio data for the inactive frame includes silence insertion descriptor data including comfort noise data indicating a signal energy for each of the two channels, or a first linear combination of the first and second channels and a second linear combination of the first and second channels, for the inactive frame, and indicating a coherence between the first channel and the second channel in the inactive frame; the mixer is configured to mix the mixing noise signal with the first audio signal or the second audio signal based on comfort noise data indicative of coherence; The multi-channel signal generator further comprises a signal modifier for modifying the first channel and the second channel, or the first audio signal or the second audio signal, or the mixing noise signal, the signal modifier being configured to be controlled by comfort noise data indicative of signal energy for the first audio channel and the second audio channel, or indicative of signal energy for a first linear combination of the first and second channels and a second linear combination of the first and second channels.

[0030] According to one aspect, the audio data for the inactive frames is a first silence insertion descriptor frame for a first channel and a second silence insertion descriptor frame for a second channel, the first silence insertion descriptor frame comprising: comfort noise parameter data for the first channel and / or for a first linear combination of the first channel and the second channel; comfort noise generation side information for the first channel and the second channel; The second silence insertion descriptor frame is comfort noise parameter data for a second channel and / or for a second linear combination of the first and second channels; and coherence information indicating coherence between the first channel and the second channel in the inactive frame; The multi-channel signal generator comprises a controller for controlling generation of the multi-channel signal in inactive frames, which determines comfort noise generation modes for the first channel and the second channel and / or for a first linear combination of the first channel and the second channel and a second linear combination of the first channel and the second channel using comfort noise generation side information for the first silence insertion descriptor frame, sets coherence between the first channel and the second channel in the inactive frames using coherence information in the second silence insertion descriptor frame, and uses comfort noise parameter data from the first silence insertion descriptor frame and sets an energy situation of the first channel and an energy situation of the second channel using comfort noise parameter data from the second silence insertion descriptor frame.

[0031] According to one aspect, the audio data for the inactive frames is at least one silence insertion descriptor frame for a first linear combination of the first channel and the second channel and a second linear combination of the first channel and the second channel; At least one silence insertion descriptor frame must comfort noise parameter data (p_noise) for a first linear combination of the first channel and the second channel; and comfort noise rise side information for a second linear combination of the first channel and the second channel; The multi-channel signal generator comprises a controller for controlling generation of the multi-channel signal in inactive frames, which uses comfort noise generation side information for a first linear combination of the first channel and the second channel and a second linear combination of the first channel and the second channel, uses coherence information in the second silence insertion descriptor frame to set coherence between the first channel and the second channel in the inactive frames, uses comfort noise parameter data from the at least one silence insertion descriptor frame, and uses comfort noise parameter data from the at least one silence insertion descriptor frame to set an energy situation of the first channel and an energy situation of the second channel.

[0032] According to one aspect, a spectral-to-time converter is provided for converting the resulting spectrally adjusted and coherence adjusted first channel and the resulting second channel into corresponding time domain representations to be combined or concatenated with time domain representations of the corresponding channels of the decoded multi-channel signal for the active frame.

[0033] According to one aspect, the audio data for the inactive frames is a silence insertion descriptor frame, the silence insertion descriptor frame including comfort noise parameter data for a first channel and a second channel, comfort noise generation side information for the first channel and the second channel and / or for a first linear combination of the first channel and the second channel and a second linear combination of the first channel and the second channel, and coherence information indicating coherence between the first channel and the second channel in an inactive frame; The multi-channel signal generator comprises a controller for controlling generation of the multi-channel signal in the inactive frame, which determines comfort noise generation modes for the first channel and the second channel using comfort noise generation side information for the silence insertion descriptor frame, sets coherence between the first channel and the second channel in the inactive frame using coherence information in the silence insertion descriptor frame, and sets an energy situation of the first channel and an energy situation of the second channel using comfort noise parameter data from the silence insertion descriptor frame.

[0034] According to one aspect, the encoded audio data for the inactive frame includes silence insertion descriptor data including comfort noise data indicating a signal energy for each channel in a mid / side representation and coherence data indicating a coherence between the first channel and the second channel in a left / right representation, and the multi-channel signal generator is configured to convert the mid / side representation of the signal energy to a left / right representation of the signal energy in the first channel and the second channel; the mixer is configured to mix a mixing noise signal with the first audio signal and the second audio signal based on the coherence data to obtain a first channel and a second channel; The multi-channel signal generator further includes a signal modifier configured to modify the first and second channels by shaping the first and second channels based on signal energy in the left / right regions.

[0035] According to one aspect, the multi-channel signal generator is configured to zero out coefficients of a side channel when the audio data includes signaling indicating that the energy in the side channel is less than a predetermined threshold.

[0036] According to one aspect, the audio data for the inactive frames is at least one silence insertion descriptor frame, the at least one silence insertion descriptor frame including comfort noise parameter data for a mid channel and a side channel, comfort noise generation side information for the mid channel and the side channel, and coherence information indicating coherence between the first channel and the second channel in the inactive frame; The multi-channel signal generator comprises a controller for controlling generation of the multi-channel signal in the inactive frames, which determines comfort noise generation modes for the first channel and the second channel using comfort noise generation side information for the silence insertion descriptor frame, sets coherence between the first channel and the second channel in the inactive frames using coherence information in the silence insertion descriptor frame, and sets the energy situation of the first channel and the energy situation of the second channel using comfort noise parameter data from the silence insertion descriptor frame, or a processed version thereof.

[0037] According to one aspect, the multi-channel signal generator is configured to scale signal energy coefficients for the first and second channels by gain information encoded with comfort noise parameter data for the first and second channels.

[0038] According to one aspect, the multi-channel signal generator is configured to convert the generated multi-channel signal from a frequency domain version to a time domain version.

[0039] According to one aspect, the first audio source is a first noise source and the first audio signal is a first noise signal, or the second audio source is a second noise source and the second audio signal is a second noise signal; the first noise source or the second noise source is configured to generate the first noise signal or the second noise signal such that the first noise signal or the second noise signal are at least partially correlated; the mixing noise source is configured to generate a mixing noise signal including a first mixing noise portion and a second mixing noise portion, the second mixing noise portion being at least partially decorrelated with the first mixing noise portion; The mixer is for mixing a first mixing noise portion of the mixing noise signal with a first audio signal to obtain a first channel, and for mixing a second mixing noise portion of the mixing noise signal with a second audio signal to obtain a second channel.

[0040] According to one aspect, a method for generating a multi-channel signal having a first channel and a second channel is provided, comprising: generating a first audio signal using a first audio source; generating a second audio signal using a second audio source; generating a mixing noise signal using a mixing noise source; mixing the mixing noise signal with the first audio signal to obtain a first channel, and mixing the mixing noise signal with the second audio signal to obtain a second channel.

[0041] According to one aspect, there is provided an audio encoder for generating an encoded multi-channel audio signal for a sequence of frames including active and inactive frames, the audio encoder comprising: an activity detector for analysing the multi-channel signal to determine a frame of the sequence of frames as an inactive frame; a noise parameter calculator for calculating first parametric noise data for a first channel of the multi-channel signal and for calculating second parametric noise data for a second channel of the multi-channel signal; a coherence calculator for calculating coherence data indicative of a coherence situation between the first channel and the second channel in an inactive frame; and an output interface for generating an encoded multi-channel audio signal having encoded audio data for active frames and, for non-active frames, the first parametric noise data, the second parametric noise data, or a first linear combination of the first parametric noise data and the second parametric noise data and a second linear combination of the first parametric noise data and the second parametric noise data, and coherence data.

[0042] According to one aspect, the coherence calculator is configured to calculate a coherence value and quantize the coherence value to obtain a quantized coherence value, and the output interface is configured to use the quantized coherence value as coherence data in the encoded multi-channel signal.

[0043] According to one aspect, the coherence calculator comprises: calculating real and imaginary intermediate values ​​from the complex spectral values ​​for the first and second channels in the inactive frame; Calculating a first energy value for a first channel and a second energy value for a second channel in an inactive frame; calculating coherence data using the real intermediate value, the imaginary intermediate value, the first energy value, and the second energy value; or The method is configured to smooth at least one of the real intermediate value, the imaginary intermediate value, the first energy value, and the second energy value, and to calculate the coherence data using the at least one smoothed value.

[0044] According to one embodiment, the coherence calculator is configured to calculate the real intermediate value as a sum over the real part of the product of the complex spectral values ​​for the corresponding frequency bins of the first channel and the second channel in the inactive frame; or The imaginary intermediate value is configured to be calculated as a sum over imaginary parts of products of complex spectral values ​​for corresponding frequency bins of the first channel and the second channel in the inactive frame.

[0045] According to one aspect, the coherence calculator is configured to: square the smoothed real intermediate value; square the smoothed imaginary intermediate value; and add the squared values ​​to obtain a first component number; The coherence calculator is configured to multiply the smoothed first and second energy values ​​to obtain a second component number and to combine the first and second component numbers to obtain a result number for a coherence value on which the coherence data is based.

[0046] According to one aspect, the coherence calculator is configured to calculate the square root of the result number to obtain a coherence value on which the coherence data is based.

[0047] According to one embodiment, the coherence calculator is configured to quantize the coherence value using a uniform quantizer to obtain the quantized coherence value as an n-bit number as the coherence data.

[0048] According to one aspect, the output interface is configured to generate a first silence insertion descriptor frame for a first channel and a second silence insertion descriptor frame for a second channel, the first silence insertion descriptor frame including comfort noise parameter data for the first channel and comfort noise generation side information for the first channel and the second channel, and the second silence insertion descriptor frame including comfort noise parameter data for the second channel and coherence information indicating coherence between the first channel and the second channel in an inactive frame; or The output interface is configured to generate a silence insertion descriptor frame, the silence insertion descriptor frame including comfort noise parameter data for the first channel and the second channel, comfort noise generation side information for the first channel and the second channel, and coherence information indicating coherence between the first channel and the second channel in an inactive frame; or Or the output interface is configured to generate a first silence insertion descriptor frame for the first channel and the second channel and a second silence insertion descriptor frame for the first channel and the second channel, where the first silence insertion descriptor frame includes comfort noise parameter data for the first channel and the second channel and comfort noise generation side information for the first channel and the second channel, and the second silence insertion descriptor frame includes comfort noise parameter data for the first channel and the second channel and coherence information indicating coherence between the first channel and the second channel in the inactive frame.

[0049] According to one aspect, the uniform quantizer is configured to calculate the number of n bits such that the value of n is equal to the value of bits occupied by the comfort noise generation side information for the first silence insertion descriptor frame.

[0050] According to one aspect, the activity detector comprises: Analyzing a first channel of the multi-channel signal to classify the first channel as active or inactive; analyzing a second channel of the multi-channel signal and classifying the second channel as active or inactive; The method is configured to determine a frame of the sequence of frames to be an inactive frame if both the first channel and the second channel are classified as inactive.

[0051] According to one aspect, the noise parameter calculator is configured to calculate first gain information for the first channel and second gain information for the second channel and provide parametric noise data as the first gain information and the second gain information for the first channel.

[0052] According to one aspect, the noise parameter calculator is configured to convert at least a portion of the first parametric noise data and the second parametric noise data from a left / right representation to a mid / side representation having a mid channel and a side channel.

[0053] According to one aspect, the noise parameter calculator is configured to re-convert a mid / side representation of at least a portion of the first parametric noise data and the second parametric noise data into a left / right representation; The noise parameter calculator is configured to calculate first gain information for the first channel and second gain information for the second channel from the retransformed left and right representations and provide the first gain information for the first channel included in the first parametric noise data and the second gain information included in the second parametric noise data.

[0054] According to one aspect, the noise parameter calculator comprises: The first gain information is a version of the first parametric noise data for the first channel as retransformed from the mid / side representation to the left / right representation; by comparing with a version of the first parametric noise data for the first channel before it has been converted from a mid / side representation to a left / right representation; and / or The second gain information is a version of the second parametric noise data for the second channel as reconverted from the mid / side representation to the left / right representation; By comparing with a version of the second parametric noise data for the second channel before it has been converted from a mid / side representation to a left / right representation, It is configured to calculate

[0055] According to one aspect, the noise parameter calculator is configured to compare an energy of a second linear combination between the first parametric noise data and the second parametric noise data to a predetermined energy threshold; if the energy of the second linear combination between the first parametric noise data and the second parametric noise data is greater than a predetermined energy threshold, coefficients of the side channel noise shape vector are zeroed; If the energy of the second linear combination between the first parametric noise data and the second parametric noise data is less than a predetermined energy threshold, the coefficient of the side channel noise shape vector is retained.

[0056] According to one aspect, the audio encoder is configured to encode the second linear combination between the first parametric noise data and the second parametric noise data with an amount of bits that is less than an amount of bits with which the first linear combination between the first parametric noise data and the second parametric noise data is encoded.

[0057] According to one aspect, the output interface comprises: generating an encoded multi-channel audio signal having encoded audio data for an active frame using a first plurality of coefficients for a first number of frequency bins; configured to generate the first parametric noise data, the second parametric noise data, or a first linear combination of the first parametric noise data and the second parametric noise data and a second linear combination of the first parametric noise data and the second parametric noise data using a second plurality of coefficients describing a second number of frequency bins; The first number of frequency bins is greater than the second number of frequency bins.

[0058] According to one aspect, there is provided a method of audio encoding for generating an encoded multi-channel audio signal for a sequence of frames including active and inactive frames, the method comprising: analyzing the multi-channel signal to determine a frame of the sequence of frames as an inactive frame; calculating first parametric noise data for a first channel of the multi-channel signal and / or a first linear combination of the first and second channels of the multi-channel signal, and calculating second parametric noise data for a second channel of the multi-channel signal and / or a second linear combination of the first and second channels of the multi-channel signal; calculating coherence data indicative of a coherence status between the first channel and the second channel in an inactive frame; generating encoded audio data for the active frames and, for the inactive frames, an encoded multi-channel audio signal having the first parametric noise data, the second parametric noise data, and the coherence data.

[0059] According to one aspect there is provided a computer program for, when run on a computer or processor, carrying out the above or below described method.

[0060] According to one aspect, an encoded multi-channel audio signal is provided that is organized into a sequence of frames, the sequence of frames including active frames and inactive frames, the encoded multi-channel audio signal comprising: encoded audio data for the active frame; first parametric noise data for a first channel in an inactive frame; second parametric noise data for a second channel in the inactive frames; and and coherence data indicating a coherence status between the first channel and the second channel in the inactive frame.

[0061] According to one aspect, the first audio source is a first noise source and the first audio signal is a first noise signal, or the second audio source is a second noise source and the second audio signal is a second noise signal; The first noise source or the second noise source is configured to generate the first noise signal or the second noise signal such that the first noise signal or the second noise signal is decorrelated from the mixing noise signal.

[0062] According to one embodiment, the mixer is configured to generate the first channel and the second channel such that an amount of the mixing noise signal in the first channel is equal to an amount of the mixing noise signal in the second channel or is within a range of 80 percent to 120 percent of the amount of the mixing noise signal in the second channel.

[0063] According to one aspect, the mixer comprises a control input for receiving a control parameter, the mixer configured to control an amount of the mixing noise signal in the first channel and the second channel in response to the control parameter.

[0064] According to one aspect, each of the first audio source, the second audio source, and the mixing noise source is a Gaussian noise source.

[0065] According to one aspect, the first audio source comprises a first noise generator for generating the first audio signal as the first noise signal, the second audio source comprises a decorrelator for decorrelating the first noise signal to generate the second audio signal as the second noise signal, and the mixing noise source comprises a second noise generator; or the first audio source comprises a first noise generator for generating a first audio signal as the first noise signal, the second audio source comprises a second noise generator for generating a second audio signal as the second noise signal, and the mixing noise source comprises a decorrelator for decorrelating the first noise signal or the second noise signal to generate the mixing noise signal, or one of the first audio source, the second audio source and the mixing noise source comprises a noise generator for generating a noise signal, another one of the first audio source, the second audio source and the mixing noise source comprises a first decorrelator for decorrelating the noise signal, and yet another one of the first audio source, the second audio source and the mixing noise source comprises a second decorrelator for decorrelating the noise signal, the first decorrelator and the second decorrelator being different from each other such that output signals of the first decorrelator and the second decorrelator are uncorrelated from each other, or The first audio source comprises a first noise generator, the second audio source comprises a second noise generator, and the mixing noise source comprises a third noise generator, and the first noise generator, the second noise generator, and the third noise generator are configured to generate noise signals that are decorrelated with each other.

[0066] According to one aspect, one of the first audio source, the second audio source, and the mixing noise source comprises a pseudo-random sequence generator configured to generate a pseudo-random sequence in response to a seed; At least two of the first audio source, the second audio source, and the mixing noise source are configured to initialize the pseudo-random sequence generator using different seeds.

[0067] According to one aspect, at least one of the first audio source, the second audio source, and the mixing noise source is configured to operate using a pre-stored noise table; or at least one of the first audio source, the second audio source, and the mixing noise source is configured to generate a complex spectrum for the frame using a first noise value for the real part and a second noise value for the imaginary part; Optionally, the at least one noise generator is configured to generate a complex noise spectrum value for frequency bin k using a first random value at index k for one of the real and imaginary parts and a second random value at index (k+M) for the other of the real and imaginary parts; The first noise value and the second noise value are included in a noise array having a range from a start index to an end index, e.g., derived from a random number sequence generator or a noise table or a noise process, where the start index is less than M and the end index is less than or equal to 2M, and M and k are integer values.

[0068] According to one embodiment, the mixer comprises: a first amplitude factor for influencing the amplitude of the first audio signal; a first adder for adding an output signal of the first amplitude element and at least a portion of the mixing noise signal; a second amplitude factor for influencing the amplitude of the second audio signal; a second adder for adding an output of the second amplitude element and at least a portion of the mixing noise signal; The amount of influence action performed by the first amplitude element and the amount of influence action performed by the second amplitude element are equal to each other or differ by less than 20% of the amount of influence action performed by the first amplitude element.

[0069] According to one embodiment, the mixer comprises a third amplitude element for influencing the amplitude of the mixing noise signal, the amount of influencing action performed by the third amplitude element being dependent on the amount of influencing action performed by the first amplitude element or the second amplitude element, whereby the amount of influencing action performed by the third amplitude element is greater when the amount of influencing action performed by the first amplitude element or the amount of influencing action performed by the second amplitude element is smaller.

[0070] According to one aspect, a multi-channel signal generator is provided, comprising: an input interface for receiving encoded audio data in a sequence of frames including an active frame and an inactive frame following the active frame; an audio decoder for decoding the encoded audio data for the active frames to generate a decoded multi-channel signal for the active frames; The first audio source, the second audio source, the mixing noise source, and the mixer are active in the inactive frames to generate a multi-channel signal for the inactive frames.

[0071] According to one aspect, the encoded audio data for the inactive frame includes silence insertion descriptor data indicating signal energy for each of the two channels for the inactive frame and including comfort noise data indicating coherence between the first channel and the second channel in the inactive frame; the mixer is configured to mix the mixing noise signal with the first audio signal or the second audio signal based on the comfort noise data indicative of coherence, and the multi-channel signal generator further comprises a signal modifier for modifying the first channel and the second channel, or the first audio signal or the second audio signal, or the mixing noise signal; The signal modifier is configured to be controlled by comfort noise data indicative of signal energy for the first audio channel and the second audio channel.

[0072] According to one aspect, the audio data for the inactive frames is a first silence insertion descriptor frame for a first channel and a second silence insertion descriptor frame for a second channel, the first silence insertion descriptor frame including comfort noise parameter data for the first channel and comfort noise generation side information for the first channel and the second channel, the second silence insertion descriptor frame including comfort noise parameter data for the second channel and coherence information indicating coherence between the first channel and the second channel in an inactive frame; The multi-channel signal generator comprises a controller for controlling generation of the multi-channel signal in the inactive frames, which determines comfort noise generation modes for the first channel and the second channel using comfort noise generation side information for the first silence insertion descriptor frame, sets coherence between the first channel and the second channel in the inactive frames using coherence information in the second silence insertion descriptor frame, and sets an energy situation of the first channel and an energy situation of the second channel using comfort noise generation data from the first silence insertion descriptor frame and comfort noise generation parameter data from the second silence insertion descriptor frame.

[0073] According to one aspect, the signal processing device further includes a spectral-temporal converter for converting the resulting spectrally adjusted and coherence adjusted first channel and the resulting second channel into corresponding time domain representations to be combined or concatenated with time domain representations of the corresponding channels of the decoded multi-channel signal for the active frame.

[0074] According to one aspect, the audio data for the inactive frames is a silence insertion descriptor frame, the silence insertion descriptor frame including comfort noise parameter data for a first channel and a second channel, comfort noise generation side information for the first channel and the second channel, and coherence information indicating coherence between the first channel and the second channel in an inactive frame; The multi-channel signal generator comprises a controller for controlling generation of the multi-channel signal in the inactive frames, which determines comfort noise generation modes for the first channel and the second channel using comfort noise generation side information for the silence insertion descriptor frame, sets coherence between the first channel and the second channel in the inactive frames using coherence information in the second silence insertion descriptor frame, and sets an energy situation of the first channel and an energy situation of the second channel using comfort noise generation data from the silence insertion descriptor frame.

[0075] According to one aspect, the first audio source is a first noise source and the first audio signal is a first noise signal, or the second audio source is a second noise source and the second audio signal is a second noise signal; the first noise source or the second noise source is configured to generate the first noise signal or the second noise signal such that the first noise signal or the second noise signal are at least partially correlated; the mixing noise source is configured to generate a mixing noise signal including a first mixing noise portion and a second mixing noise portion, the second mixing noise portion being at least partially decorrelated with the first mixing noise portion; The mixer is configured to mix a first mixing noise portion of the mixing noise signal with a first audio signal to obtain a first channel, and to mix a second mixing noise portion of the mixing noise signal with a second audio signal to obtain a second channel.

[0076] According to one aspect, a method for generating a multi-channel signal having a first channel and a second channel includes: generating a first audio signal using a first audio source; generating a second audio signal using a second audio source; generating a mixing noise signal using a mixing noise source; mixing the mixing noise signal with the first audio signal to obtain a first channel, and mixing the mixing noise signal with the second audio signal to obtain a second channel.

[0077] According to one aspect, there is provided an audio encoder for generating an encoded multi-channel audio signal for a sequence of frames including active and inactive frames, the audio encoder comprising: an activity detector for analysing the multi-channel signal to determine a frame of the sequence of frames as an inactive frame; a noise parameter calculator for calculating first parametric noise data for a first channel of the multi-channel signal and for calculating second parametric noise data for a second channel of the multi-channel signal; a coherence calculator for calculating coherence data indicative of a coherence situation between the first channel and the second channel in an inactive frame; An output interface is provided for generating encoded audio data for active frames and, for non-active frames, an encoded multi-channel audio signal having the first parametric noise data, the second parametric noise data, and the coherence data.

[0078] According to one aspect, the coherence calculator is configured to calculate a coherence value and quantize the coherence value to obtain a quantized coherence value, and the output interface is configured to use the quantized coherence value as coherence data in the encoded multi-channel signal.

[0079] According to one aspect, the coherence calculator comprises: calculating real and imaginary intermediate values ​​from the complex spectral values ​​for the first and second channels in the inactive frame; Calculating a first energy value for a first channel and a second energy value for a second channel in an inactive frame; calculating coherence data using the real intermediate value, the imaginary intermediate value, the first energy value, and the second energy value; or The method is configured to smooth at least one of the real intermediate value, the imaginary intermediate value, the first energy value, and the second energy value, and to calculate the coherence data using the at least one smoothed value.

[0080] According to one embodiment, the coherence calculator is configured to calculate the real intermediate value as a sum over the real part of the product of the complex spectral values ​​for the corresponding frequency bins of the first channel and the second channel in the inactive frame; or The imaginary intermediate value is configured to be calculated as a sum over imaginary parts of products of complex spectral values ​​for corresponding frequency bins of the first channel and the second channel in the inactive frame.

[0081] According to one aspect, the coherence calculator is configured to: square the smoothed real intermediate value; square the smoothed imaginary intermediate value; and add the squared values ​​to obtain a number of first components; The coherence calculator is configured to multiply the smoothed first and second energy values ​​to obtain a second component number and to combine the first and second component numbers to obtain a result number for a coherence value on which the coherence data is based.

[0082] According to one aspect, an audio encoder is provided, where the coherence calculator is configured to calculate a square root of the result number to obtain a coherence value on which the coherence data is based.

[0083] According to one embodiment, the coherence calculator is configured to quantize the coherence value using a uniform quantizer to obtain the quantized coherence value as an N-bit number as the coherence data.

[0084] According to one aspect, an audio encoder is provided, comprising: the output interface is configured to generate a first silence insertion descriptor frame for the first channel and a second silence insertion descriptor frame for the second channel, the first silence insertion descriptor frame including comfort noise parameter data for the first channel and comfort noise generation side information for the first channel and the second channel, and the second silence insertion descriptor frame including comfort noise parameter data for the second channel and coherence information indicating coherence between the first channel and the second channel in the inactive frame; or The output interface is configured to generate a silence insertion descriptor frame, the silence insertion descriptor frame including comfort noise parameter data for the first channel and the second channel, comfort noise generation side information for the first channel and the second channel, and coherence information indicating coherence between the first channel and the second channel in the inactive frame.

[0085] According to one aspect, the uniform quantizer is configured to calculate the number of N bits such that the value of N is equal to the value of bits occupied by the comfort noise generation side information for the first silence insertion descriptor frame.

[0086] According to one aspect, there is provided a method of audio encoding for generating an encoded multi-channel audio signal for a sequence of frames including active and inactive frames, the method comprising: analyzing the multi-channel signal to determine a frame of the sequence of frames as an inactive frame; calculating first parametric noise data for a first channel of the multi-channel signal and calculating second parametric noise data for a second channel of the multi-channel signal; calculating coherence data indicative of a coherence status between the first channel and the second channel in an inactive frame; generating encoded audio data for the active frames and, for the inactive frames, an encoded multi-channel audio signal having the first parametric noise data, the second parametric noise data, and the coherence data.

[0087] According to one aspect, an encoded multi-channel audio signal is provided that is organized into a sequence of frames, the sequence of frames including active frames and inactive frames, the encoded multi-channel audio signal comprising: encoded audio data for the active frame; first parametric noise data for a first channel in an inactive frame; second parametric noise data for a second channel in the inactive frames; and and coherence data indicating a coherence status between the first channel and the second channel in the inactive frame. [Brief description of the drawings]

[0088] [Figure 1] FIG. 2 illustrates an example in an encoder that specifically classifies frames as active or inactive. [Diagram 2] FIG. 2 illustrates an example of an encoder and a decoder. [Figure 3A] FIG. 2 shows an example of a multi-channel signal generator that may be used in a decoder. [Figure 3B] FIG. 2 shows an example of a multi-channel signal generator that may be used in a decoder. [Figure 3C] FIG. 2 shows an example of a multi-channel signal generator that may be used in a decoder. [Figure 3D] FIG. 2 shows an example of a multi-channel signal generator that may be used in a decoder. [Figure 3E] FIG. 2 shows an example of a multi-channel signal generator that may be used in a decoder. [Figure 3F] FIG. 2 shows an example of a multi-channel signal generator that may be used in a decoder. [Figure 4] FIG. 2 illustrates an example of an encoder and a decoder. [Diagram 5] FIG. 2 illustrates an example of a noise parameter quantization stage. [Figure 6] FIG. 2 illustrates an example of a noise parameter inverse quantization stage. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0089] Some aspects that may be implemented in the examples Herein, we describe, inter alia, new techniques for DTX and CNG, for example, for discretely coded stereo signals. Instead of operating on a mono downmix of a stereo signal, noise parameters for both channels are derived, jointly coded, and transmitted. At the decoder (or more generally a multi-channel generator), the three independent comfort noise signals may be mixed, for example, based on a single wideband inter-channel coherence value that is transmitted together with the two sets of noise parameters. Some of the example aspects may, in some examples, be directed to at least one of the following aspects. CNG in the decoder, for example by mixing three independent noise signals. After decoding the stereo SID and reconstructing the noise parameters for the left and right channels, two noise signals can be generated, for example as a mixture of correlated and uncorrelated noise. For this, one common noise source for both channels (acting as a correlated noise source) and two separate noise sources (providing uncorrelated noise) can be mixed together. This mixing process can be controlled by an inter-channel coherence value carried in the stereo SID. After mixing, the two mixed noise signals are spectrally shaped using the reconstructed noise parameters for the left and right channels, respectively. Joint coding of the noise parameters may be derived from the two channels of a stereo signal. To keep the bit rate of the stereo SID low, the noise parameters may be further compressed before encoding in the stereo SID. This may be achieved, for example, by converting the left / right channel representation of the noise parameters into a mid / side representation and encoding the side noise parameters with fewer bits than the mid noise parameters. · SID for two-channel DTX (stereo SID), which may contain noise parameters for both channels of a stereo signal along with a single wideband inter-channel coherence value and a flag indicating that the noise parameters for both channels are equal.

[0090] The following examples are shown to be implemented in devices, apparatus, systems, methods, controllers, and non-transitory storage units that store instructions that, when executed by a processor, cause the processor to perform the disclosed techniques (e.g., methods, such as sequences of operations).

[0091] In particular, at least one of the following blocks may be controlled by the controller: EXAMPLES

[0092] Before describing example aspects of the invention in detail, a brief overview of some of the most important ones will be given. 1) Figures 3A-3F show examples of a multi-channel signal generator (e.g. formed by at least one first signal, or channel, and one second audio signal, or channel), which generates (e.g. at a decoder). The multi-channel audio signal (originally in the form of multiple, uncorrelated channels) may be influenced (e.g. scaled) by an amplitude factor. The amount of influence may be based on coherence data between the first and second audio signals estimated in the encoder. The first and second audio signals may be subjected to a mixing effect with a common mixing signal (which may also be uncorrelated and influenced, e.g. scaled, by the coherence data). The amount of influence on the mixing signal may be such that the first and second audio signals are scaled by a high weight (e.g. 1 or less than 1, but e.g. close to 1) when the mixing signal is scaled by a low weight (e.g. 0 or more than 0, but e.g. close to 0), and vice versa. The amount of influence on the mixing signal may be such that high coherence as measured at the encoder causes the first and second audio signals to be scaled by a low weight (e.g., 0 or greater than 0, but e.g., close to 0), and high coherence as measured at the encoder causes the first and second audio signals to be scaled by a high weight (e.g., 1 or less than 1, but e.g., close to 1). The techniques of Figures 3A-3F may be used to implement a comfort noise generator (CNG). 2) Figures 1, 2 and 4 show examples of encoders. The encoder may classify audio frames as active or inactive. If the audio frame is inactive, only some parametric noise data is encoded into the bitstream (e.g., to provide a parametric noise shape that gives a parametric representation of the shape of the noise without the need to provide the noise signal itself), and coherence data between the two channels may also be provided. 3) Figures 2 and 4 show examples of decoders. The decoder is configured to generate an audio signal (comfort noise), e.g. a. using one of the techniques illustrated in Figures 3A-3F above (point 1) (in particular taking into account the coherence value provided by the encoder and applying it as a weight in the amplitude element); b. This may be done by shaping the generated audio signal (comfort noise) using parametric noise data as encoded in the bitstream.

[0093] In particular, the encoder does not need to provide the complete audio signal for inactive frames, but only the coherence values ​​and a parametric representation of the noise shape, thereby reducing the number of bits to be encoded into the bitstream.

[0094] Signal generator (e.g., decode side), CNG Figures 3A-3F show an example of a CNG, or more generally a multi-channel signal generator 200, for generating a multi-channel signal 204 having a first channel 201 and a second channel 203. (For purposes of this specification, the generated audio signals 221 and 223 are considered to be noise, although different types of signals that are not noise are possible.) Reference is first made to Figure 3F in general, while Figures 3A-3E show specific examples.

[0095] The first audio source 211 may be a first noise source and is shown here generating a first audio signal 221, which may be a first noise signal. The mixing noise source 212 may generate a mixing noise signal 222. The second audio source 213 may generate a second audio signal 223, which may be a second noise signal. The multi-channel signal generator 200 may mix the first audio signal (first noise signal) 221 with the mixing noise signal 222 and mix the second audio signal (second noise signal) 223 with the mixing noise signal 222. (Additionally or alternatively, the first audio signal 221 is mixed with a version 221a of the mixing noise signal 222, and the second audio signal 223 is mixed with a version 221b of the mixing noise signal 222, where the versions 221a and 221b may differ from each other by, for example, 20%, and each of the versions 221a and 221b may be, for example, an upscaled and / or downscaled version of the common signal 222). Thus, the first channel 201 of the multi-channel signal 204 may be obtained from the first audio signal (first noise signal) 221 and the mixing noise signal 222. Similarly, the second channel 203 of the multi-channel signal 204 may be obtained from the second audio signal 223 mixed with the mixing noise signal 222. It should also be noted that the signals may be here in the frequency domain, and k refers to a particular index or coefficient (associated with a particular frequency bin).

[0096] 3A-3F, the first audio signal 221, the mixing noise signal 222, and the second audio signal 223 may be decorrelated with each other, which may be obtained, for example, by decorrelating the same signals (e.g., in a decorrelator) and / or by generating the noise independently (examples are presented below).

[0097] The mixer 208 may be implemented to mix the first audio signal 221 and the second audio signal 223 with a mixing noise signal 222. The mixing may be of the type of adding the signals (adder stages 206-1 and 206-3) after the first audio signal 221, the mixing noise signal 222 and the second audio signal 223 have been weighted by scaling (e.g. in amplitude elements 208-1, 208-2, 208-3). The mixing is of the "weighted and then added" type. Figures 3A-3F show the addition of the noise signal N by a summing (+) element, which represents a sample-by-sample addition of the two signals. l [k] and N r shows the actual signal processing applied to generate [k], where k is the frequency bin index.

[0098] The amplitude elements (or weighting or scaling elements) 208-1, 208-2, 208-3 may for example be obtained by scaling the first audio signal 221, the mixing noise signal 222 and the second audio signal 223 with suitable coefficients to output a weighted version 221' of the first audio signal 221, a weighted version 222' of the mixing noise signal 222 and a weighted version 223' of the second audio signal 223. The suitable coefficients may be sqrt(coh) and sqrt(1-coh) and may for example be obtained from coherence information encoded in signaling a particular descriptor frame (see also below) (sqrt here refers to a square root operation). The coherence "coh" is explained in more detail below and will for example be referred to as "c" or "c" below. ind " or "c q", e.g. encoded in the coherence information 404 of the bitstream 232 (see below in conjunction with Fig. 2 and Fig. 4). In particular, the mixing noise signal 222 may be scaled, e.g. with a weight that is the square root of the coherence value, and the first audio signal 221 and the second audio signal 222 may be scaled with a weight that is the square root of a value complementary to one of the coherences coh. Nevertheless, the mixing noise signal 222 may be considered as a common mode signal, a part of which may be mixed into a weighted version 221' of the first audio signal 221 and a weighted version 223' of the second audio signal 223 to obtain the first channel 201 of the multi-channel signal 204 and the second channel 203 of the multi-channel signal 204, respectively. In some cases, the first noise source 211 or the second noise source 213 may be configured to generate the first noise signal 221 or the second noise signal 223 such that the first noise signal 221 and / or the second noise signal 223 are decorrelated from the mixing noise signal 222 (see Figures 3B-3E and see below).

[0099] At least one (or each) of the first audio source 211, the second audio source 213, and the mixing noise source 212 may be a Gaussian noise source.

[0100] In the example of Figure 3A, the first audio source 211 (here shown as 211a) may comprise or be connected to a first noise generator, and the second audio source 213 (213a) may comprise or be connected to a second noise generator. The mixing noise source 212 (212a) may comprise or be connected to a third noise generator. The first noise generator 211 (211a), the second noise generator 213 (213a), and the third noise generator 212 (212a) may generate noise signals that are mutually decorrelated.

[0101] In an example, at least one of the first audio source 211 (211a), the second audio source 213 (213a), and the mixing noise source 212 (212a) may operate using a pre-stored noise table and thus provide a random sequence.

[0102] In some examples, at least one of the first audio source 211, the second audio source 213, and the mixing noise source 212 may generate a complex spectrum for a frame using a first noise value for the real part and a second noise value for the imaginary part. Optionally, at least one noise generator may generate a complex noise spectrum value (e.g., a coefficient) for a frequency bin k using a first random value at index k for one of the real part and the imaginary part and a second random value at index (k+M) for the other of the real part and the imaginary part. The first noise value and the second noise value may be included in a noise array having a range from a start index to an end index, derived, for example, from a random number sequence generator or a noise table or a noise process, where the start index is less than M and the end index is less than or equal to 2×M (which is twice M). M and k may be integers (k is the index of a particular bit frequency bin in the frequency domain representation of the signal).

[0103] Each of the audio sources 211, 212, 213 may be, for example, 1 [k], N 2 [k], N 3 Regarding [k], it may include at least one audio source generator (noise generator) that generates noise.

[0104] The multi-channel signal generator 200 of Fig. 3A-F may be used, for example, in the decoder 200a, 200b (200'). In particular, the multi-channel signal generator 200 may be seen as part of the comfort noise generator (CNG) 220 of Fig. 4. The decoder 200 may be generally used to decode a signal that has been encoded by an encoder, or by generating a signal that is to be shaped by energy information obtained from a bitstream, thereby generating an audio signal that corresponds to the original input audio signal input to the encoder. In some examples, there is a classification between frames with speech (or generally non-void audio signals) and silence insertion descriptor frames. As explained above and below, silence insertion descriptor frames (SID) (so-called "inactive frames 308", which may be encoded as, for example, SID frames 241 and / or 243) are generally provided with lower bitrate information and therefore less frequently provided than normal speech frames (so-called "active frames 306", see also below). Furthermore, the information present in the silence insertion description frame (SID, inactive frame 308) is generally limited (which may substantially correspond to the energy information on the signal).

[0105] It is nevertheless understood that it is possible to complement the contents of the SID frame with a multi-channel noise 204 generated by a multi-channel signal generator. Essentially, the audio sources 211, 212, 213 are independent of each other and may process signals (e.g., noise) that may be uncorrelated. The first audio signal 221, the mixing noise signal 222, and the second audio signal 223 may nevertheless be scaled by coherence information provided by the encoder and inserted in the bitstream. As can be seen in Figs. 3A-3F, the coherence value may be the same as that of the mixing noise signal 222, which provides a common mode signal for both the first audio signal 221 and the second audio signal 223, thus making it possible to obtain the first channel 201 and the second channel 203 of the multi-channel signal 204. The coherence signal is generally a value between 0 and 1. - coherence equal to 0 means that the original first audio channel (e.g., L, 301) and second audio channel (e.g., R, 303) are completely uncorrelated with each other, the amplitude element 208-2 of the mixing noise signal 222 scales the mixing noise signal 222 by 0, which creates a situation where the first audio signal 221 and the second audio signal 223 are not mixed with any common mode signal (by being mixed with a signal that is always 0), and the output channels 201, 203 become substantially identical to the first noise signal 221 and the second noise signal 223 of the multi-channel signal 204. - Coherence equal to 1 means that the original first audio channel (e.g., L, 301) and the second audio channel (e.g., R, 303) must be the same, and the amplitude elements 208-1 and 208-3 scale the input signal by 0, and then the first and second channels are equal to the mixing noise signal 222 (scaled by 1 in the amplitude element 208-2). - Coherence that is intermediate between 0 and 1 causes intermediate mixing between the two situations above.

[0106] Several embodiments and variations of the mixer 206 and / or the CNG 220 are now described.

[0107] The first audio source (211) may be a first noise source and the first audio signal (221) may be a first noise signal, or the second audio source (213) may be a second noise source and the second audio signal (223) may be a second noise signal. The first noise source (211) or the second noise source (213) may be configured to generate the first noise signal (221) or the second noise signal (223) such that the first noise signal (221) or the second noise signal (223) is decorrelated from the mixing noise signal (222).

[0108] The mixer (206) may be configured to generate the first channel (201) and the second channel (203) such that the amount of the mixing noise signal (222) in the first channel (201) is equal to the amount of the mixing noise signal (222) in the second channel (203) or is within 80 to 120 percent of the amount of the mixing noise signal (222) in the second channel (203) (e.g., portions 221a and 221b differ from each other by a range of 80 to 120 percent and differ from the original mixing noise signal 222).

[0109] In some cases, The amount of influence performed by the first amplitude element (208-1) and the amount of influence performed by the second amplitude element (208-3) are equal to each other (e.g., when there is no distinction between the portions 221a and 221b), or The amount of influence action performed by the second amplitude element (208-3) differs from the amount of influence action performed by the first amplitude element (208-1) by less than 20% (e.g., when the difference between portions 221a and 221b is less than 20%).

[0110] The mixer (206) and / or the CNG 220 may include a control input for receiving the control parameter (404,c). Thus, the mixer (206) may be configured to control the amount of the mixing noise signal (222) in the first channel (201) and the second channel (203) in response to the control parameter (404,c).

[0111] 3A to 3F, the mixing noise signal 222 is shown to follow a coefficient sqrt(coh), and the first and second audio signals 221, 223 follow a coefficient sqrt(1-coh).

[0112] 3A illustrates a CNG 220a in which the first source 211a (211), the second source 213a (213), and the mixing noise source 212a (212) include different generators. This is not strictly necessary, and several variations are possible.

[0113] More generally 1. First Modification CNG 220b (FIG. 3B): a. the first audio source 211b (211) may comprise a first noise generator for generating the first audio signal (221) as a first noise signal; b. the second audio source 213b (213) may comprise a decorrelator for decorrelating the first noise signal (221) to generate a second audio signal (213) as a second noise signal (e.g., the second audio signal is obtained from the first audio signal after decorrelation); c. The mixing noise source 212b (212) may comprise a second noise generator (essentially uncorrelated from the first noise generator); 2. Second Modification CNG 220c (FIG. 3C): a. the first audio source 211c (211) may comprise a first noise generator for generating the first audio signal (221) as a first noise signal; b. the second audio source 213c (213) may comprise a second noise generator for generating the second audio signal (223) as a second noise signal (e.g., the second noise generator is essentially uncorrelated from the first noise generator); c. the mixing noise source 212c (212) may comprise a decorrelator for decorrelating the first noise signal (221) or the second noise signal (223) to generate the mixing noise signal (222); 3. Third Modification CNG220d (FIGS. 3D and 3E): a. one of the first audio source 211d or 211e (211), the second audio source 213d or 213e (213), and the mixing noise source 212d or 212e (212) may comprise a noise generator for generating a noise signal; b. another one of the first audio source 211d or 211e (211), the second audio source 213d or 213e (213), and the mixing noise source 212d or 212e (212) may comprise a first decorrelator for decorrelating a noise signal; c. a further one of the first audio source 211d or 211e (211), the second audio source 213d or 213e (213), and the mixing noise source 212d or 212e (212) may comprise a second decorrelator for decorrelating the noise signal; d. the first decorrelator and the second decorrelator may be different from each other, such that the output signals of the first decorrelator and the second decorrelator are decorrelated from each other; 4. Fourth Modification CNG220 (FIG. 3A): a. The first audio source 211a (211) comprises a first noise generator; b. the second audio source 213a (213) comprises a second noise generator; c. The mixing noise source 212a (212) comprises a third noise generator; d. The first noise generator, the second noise generator, and the third noise generator may generate noise signals that are decorrelated with respect to each other (eg, the tree generators are essentially decorrelated with each other). 5. Fifth Modification: a. the first audio source (211), the second audio source (213), and the mixing noise source (212) may comprise a pseudorandom sequence generator for generating a pseudorandom sequence in response to a seed; b. At least two of the first audio source (211), the second audio source (213), and the mixing noise source (212) may use different seeds to initialize the pseudo-random sequence generator. 6. Sixth Modification: a. at least one of the first audio source (211), the second audio source (213), and the mixing noise source (212) may operate using a pre-stored noise table; b. Optionally, at least one of the first audio source (211), the second audio source (213), and the mixing noise source (212) may generate a complex spectrum for the frame using a first noise value for the real part and a second noise value for the imaginary part; c. Optionally, the at least one noise generator may generate a complex noise spectral value for frequency bin k using a first random value at index k for one of the real and imaginary parts and a second random value at index (k+M) for the other of the real and imaginary parts (the first and second noise values ​​being included in a noise array having a range from a start index to an end index, e.g., derived from a random number sequence generator or a noise table or a noise process, where the start index is less than M and the end index is less than or equal to 2×M, and M and k are integer values).

[0114] As can be seen in FIG. 4, the decoder 200′ (200a, 200b) may also include, in addition to the CNG 220 of FIG. 3, an input interface 210 for receiving encoded audio data in a sequence of frames including an active frame and an inactive frame following the active frame, and an audio decoder for decoding the encoded audio data for the active frames to generate a decoded multi-channel signal for the active frames, wherein the first audio source 211, the second audio source 213, the mixing noise source 212, and the mixer 206 are active in the inactive frames to generate the multi-channel signal for the inactive frames.

[0115] In particular, active frames are frames that are classified by the encoder as having speech (or other types of non-noisy sounds), and inactive frames are frames that are classified as having only silence or noise.

[0116] Any of the instances of CNG 220 (220a-220e) may be controlled by a suitable controller.

[0117] Encoder The encoder is described next. The encoder may encode active and inactive frames. For inactive frames, the encoder may encode parametric noise data (e.g., noise shape and / or coherence value) without fully encoding the audio signal. It should be noted that the encoding of inactive audio frames may be reduced with respect to active audio frames to reduce the amount of information to be encoded in the bitstream. Also, the parametric noise data (e.g., noise shape) for inactive frames may have less information and / or fewer bins for each frequency band compared to that encoded in active frames. The parametric noise data may be provided in the left / right region or another region (e.g., mid / side region) by providing, for example, a first linear combination between the parametric noise data of the first and second channels and a second linear combination between the parametric noise data of the first and second channels (in some cases, it is also possible to provide gain information not related to the first and second linear combination but provided in the left / right region). The first and second linear combinations are, in general, linearly independent of each other.

[0118] The encoder may include an activity detector that classifies a frame as being active or inactive.

[0119] 1, 2 and 4 show examples of encoders 300a and 300b (also referred to as 300 when there is no need to distinguish between the encoders 300a and 300b). Each audio encoder 300 may generate an encoded multi-channel audio signal 232 for a sequence of frames of an input signal 304. The input signal 304 is considered here to be divided into a first channel 301 (also indicated as the left channel or "l", where "l" is the letter with a capital "L" and is the first letter of "left" in English) and a second channel 303 (or "r", where "r" is the letter with a capital "R" and is the first letter of "right" in English).

[0120] The encoded multi-channel audio signal 232 may be defined by a sequence of frames, which may be, for example, in the time domain (e.g., each sample "n" may refer to a particular time instant and the samples of a frame may form a sequence, for example a sampling sequence of the input audio signal or a sequence after filtering the input audio signal).

[0121] The encoder 300 (300a, 300b) may comprise an activity detector 380, as shown in Fig. 1, although not shown in Figs. 2 and 4 (although implemented there in some examples). Fig. 1 shows that each frame of the input signal 304 may be classified as either an "active frame 306" or an "inactive frame 308". Inactive frames 308 are frames where the signal is considered silent (e.g., there is only silence or noise), while active frames 306 may have some detection of a noise-free audio signal (e.g., speech, music, etc.).

[0122] In the encoded multi-audio signal 232 (e.g., a bitstream) as encoded by the encoder 300, information regarding whether a frame is an active frame 306 or a silence frame 308 may be signaled, for example, in the so-called “comfort noise generation side information” 402 (p_frame), also referred to as “side information”.

[0123] FIG. 1 illustrates a pre-processing stage 360 ​​that may determine (e.g., classify) whether a frame is an active frame 306 or a silent frame 308. Note that the channels 301 and 303 of the input signal 304 are designated in upper case, such as L (301, left channel) and R (303, right channel), to indicate that they are in the frequency domain. As can be seen in FIG. 1, a spectral analysis stage 370 may be applied (first spectral analysis 370-1 for the first channel 301, L, and second stage 370-3 for the second channel 303, R). The spectral analysis stage 370 may be performed for each frame of the input signal 304 and may be based, for example, on a harmonicity measurement. Notably, in some examples, the spectral analysis may be performed by the stage 370 on the first channel 301 separately from the spectral analysis performed on the second channel 303 of the same frame.

[0124] In some cases, the spectral analysis stage 370 may include calculation of energy-related parameters such as average energy and total average energy for a range of predefined frequency bands.

[0125] An activity detection stage 380 (which may be considered as voice activity detection when voice is searched for) may be applied. A first activity detection stage 380-1 may be applied to the first channel 301 (and in particular the measurements performed on the first channel) and a second activity detection stage 380-3 may be applied to the second channel 303 (and in particular the measurements performed on the second channel). In an embodiment, the activity detection stage 380 may estimate the energy of the background noise in the input signal 304 and use the estimate to calculate a signal-to-noise ratio, which is compared to a signal-to-noise ratio threshold to determine whether the frame is classified as active or inactive (i.e., a calculated signal-to-noise ratio above the signal-to-noise ratio threshold means that the frame is classified as active, and a calculated signal-to-noise ratio below the signal-to-noise ratio threshold means that the frame is classified as inactive). In an embodiment, stage 380 may compare the harmonicity as obtained by the spectral analysis stages 370-1 and 370-3, respectively, with one or two harmonicity thresholds (e.g., a first threshold for the first channel 301 and a second threshold for the second channel 303). In both cases, it may be possible to classify not only each frame but also each channel of each frame as being either an active channel or an inactive channel.

[0126] A decision 381 may be performed based on which it is possible to decide whether to perform discrete stereo processing 306a or stereo intermittent transmission processing (stereo DTX) 306b (as identified by switch 381'). In particular, for active frames (and discrete stereo processing 306a), the encoding may be performed according to any strategy or processing standard or process, and therefore will not be analyzed in further detail here. Most of the following description is directed to stereo DTX 306b.

[0127] In particular, in an embodiment, a frame is classified as an inactive frame (at stage 381) only if both channels 301 and 303 are classified as inactive by stages 380-1 and 380-3, respectively. Thus, as explained above, problems in activity detection decision are avoided. In particular, there is no need to signal an active / inactive classification for each channel for each frame (thereby reducing signaling), and synchronization between the channels is inherently obtained. Furthermore, if the decoder is as described herein, it is possible to exploit the coherence between the first channel 301 and the second channel 303 to generate several noise signals, which are correlated / decorrelated according to the coherence obtained for the signal 304. Next, the elements (300a, 300b) of the encoder 300 used to encode the inactive frames are described in detail. As explained, any other technique may be used to encode the active frames 308 and therefore will not be described here.

[0128] Broadly speaking, the encoder 300a, 300b (300) may comprise a noise parameter calculator 3040 for calculating parametric noise data 401, 403 for the first and second channels 301, 303. The noise parameter calculator 3040 may calculate the parametric noise data 401, 403 (e.g., index and / or gain) for the first and second channels 301, 303. Thus, the noise parameter calculator 3040 may provide the encoded audio data 232 in a sequence of frames that may include an active frame 306 and an inactive frame 308 (which may follow the active frame 306). In particular, in the case of the inactive frame 308, the encoded audio data 232 may be encoded as one or two silence insertion description frames (SID) 241, 243. In some examples (e.g., in FIG. 2), there is only one single SID frame, and in some other examples, there are two SID frames (e.g., in FIG. 4).

[0129] The inactive frame 308 includes, among other things: - Comfort noise generation side information (e.g., 402, p_frame), - a first linear combination (v l,ind , v m, ind p_noise, gain g l,q ), comfort noise parameter data 403 for the second channel 303 or a second linear combination of the comfort noise parameter data for the first channel 301 and the comfort noise parameter data for the second channel (v r, ind , v s,ind , p_noise, gain g r,q ), - coherence information (coherence data) (c, 404).

[0130] In some examples, the first silence insertion descriptor frame 241 may include the first two items in the above list, and the second silence insertion descriptor frame 243 may include the last two features in a particular data field. Nevertheless, different protocols may provide different data fields or different organizations of the bitstream. However, in some cases (e.g., FIG. 2), there may be only a single inactive frame for the noise parameters of both channels.

[0131] It is shown that the coherence information (e.g. part of the "silence insertion descriptor") may include coherence information (e.g. correlation data), e.g. one single value (e.g. encoded with fewer bits, e.g. four bits) indicating the coherence between the first channel 301 and the second channel 303 of the same inactive frame 308. On the other hand, the comfort noise parameter data 401, 403 may indicate the signal energy for the inactive frame 308 for each channel 301, 303 (e.g. may provide substantially an envelope) or may provide noise shape information anyway. The envelope or noise shape information may be in the form of multiple coefficients for frequency bins and gains for each channel. The noise shape information may be obtained in stage 312 (see below) using the original input channels (301, 303), and then mid / side encoding is performed on the noise shape parameter vector. It is shown that in the decoder, it may be possible to generate several noise channels (e.g., 201, 203 as in FIG. 3) that may be influenced by the coherence information 404. Thus, the noise channels 201, 203 generated by the CNG 220 (220a to 220) are mixed with the first audio channel L. out and the second audio channel R out The signal may be modified by a signal modifier 250 controlled by control noise data (comfort noise parameter data 401, 403, 2312) which indicates the signal energy relative to

[0132] The audio encoder 300 (300a, 300b) may include a coherence calculator 320 that may obtain coherence information (404) to be encoded in a bitstream (e.g., signal 232, frame 241 or 243). The coherence information (c, 404) may indicate a coherence situation between a first channel 301 (e.g., left channel) and a second channel 303 (e.g., right channel) in an inactive frame 308, examples of which are described below.

[0133] The encoder 300 (300a, 300b) may comprise an output interface 310 configured to generate the encoded audio data for the active frames 306 and, for the inactive frames 308, a multi-channel audio signal 232 (bitstream) with a first parametric data (comfort noise parametric data) 401 (p_noise, left), a second parametric noise data (p_noise, right 403) and a coherence data c (404). The first parametric data 401 may be parametric data of a first channel (e.g., left channel) or a first linear combination of the first and second channels (e.g., mid channel). The second parametric data 403 may be parametric data of a second channel (e.g., right channel) or a second linear combination of the first and second channels (e.g., side channel) different from the first linear combination.

[0134] The bitstream 232 may also include side information 402 that includes an indication of whether the current frame is an active frame 306 or an inactive frame 308, for example, thereby informing the decoder of the decoding technique that should be used.

[0135] In particular, Fig. 4 shows the noise parameter calculator (noise parameter calculation stage) 3040 as comprising a first noise parameter calculator stage 304-1 where comfort noise parameter data 401 for the first channel 301 may be calculated, and a second noise parameter calculator stage 304-3 where a second comfort noise parameter 403 for the second channel 303 may be calculated. Fig. 2 shows an example where noise parameters are processed and quantized together. The internals (e.g. converting the noise shape vector to an M / S representation) are shown in Fig. 5. Essentially we may have the noise shape of the first channel M and the noise shape of the second channel S which may be encoded as mid and side indices, but also the gain for the noise shape of the left channel 301 and the gain for the noise shape of the right channel 303 may be encoded.

[0136] The coherence calculator 320 may calculate coherence data (coherence information) c (404) indicative of the coherence situation between the first channel L and the second channel R. In this case, the coherence calculator 320 may operate in the frequency domain.

[0137] As can be seen, the coherence calculator 320 may include a channel coherence calculation stage 320′, where the coherence value c (404) is obtained. Downstream of that, a uniform quantizer stage 320″ may be used, so that a quantized version c of the coherence value c is obtained. ind can be obtained.

[0138] Hereinafter, a method for obtaining and quantizing the coherence will be described.

[0139] The coherence calculator 320 may, in some examples, calculating real mean values ​​and imaginary mean values ​​from the complex spectral values ​​for the first channel and the second channel (303) in the inactive frame; Calculating a first energy value for a first channel and a second energy value for a second channel (303) in an inactive frame; calculating coherence data (404, c) using the real intermediate value, the imaginary intermediate value, the first energy value, and the second energy value; and / or At least one of the real intermediate value, the imaginary intermediate value, the first energy value, and the second energy value may be smoothed, and the coherence data may be calculated using the at least one smoothed value.

[0140] The coherence calculator 320 may square the smoothed real intermediate value, square the smoothed imaginary intermediate value, and add the squared values ​​to obtain a first component number. The coherence calculator 320 may multiply the smoothed first and second energy values ​​to obtain a second component number, and combine the first and second component numbers to obtain a result number for the coherence value on which the coherence data is based. The coherence calculator 320 may calculate the square root of the result number to obtain the coherence value on which the coherence data is based. Example formulas are provided below.

[0141] It will now be explained how the shape of the noise shape (or other signal energy) rendered at the decoder is obtained: what is encoded is essentially the noise shape (or other energy related information) of the original input signal 302, which is then applied at the decoder to the generated noise 203 to shape it and render a noise 252 (output audio signal) that resembles the original noise of the signal 304.

[0142] First, note that such a signal 304 is not encoded by the encoder into the bitstream 232. However, noise information (e.g., energy information, envelope information) may be encoded into the bitstream 232, generating a noise signal having a noise shape that is then encoded by the encoder.

[0143] A noise shape acquisition block 312 may be applied to the input signal 304 of the encoder. The "noise shape acquisition" block 312 may calculate a low-resolution parametric representation 1312 of the spectral envelope of the noise in the input signal 304. This may be done, for example, by calculating energy values ​​in frequency bands of a frequency domain representation of the input signal 304. The energy values ​​may be converted (if necessary) to a logarithmic representation and condensed to a lower number (N) of parameters that are later used in the decoder to generate the comfort noise. These low-resolution representations of the noise are referred to herein as "noise shape" 1312. Thus, what is downstream of the "noise shape acquisition" block 312 should not be understood as representing the input signal 304, but rather its noise shape (a parametric representation of the spectral envelope of the noise in the respective channel). This is important, since the encoder may only transmit this low-resolution representation of the spectral envelope of the noise in the SID frame. Thus, in FIG. 2, all of the "noise parameter calculator" portion (3040) is responsible for calculating these noise-related parameter vectors (e.g., v l , v r , v m,ind and v s,ind ) and not on a signal representation of signal 304.

[0144] 5 shows an example of the "noise parameter calculator" portion 3040 (noise shape concatenation quantization). m (a first linear combination of the noise shapes of channels L and R) and a side-channel representation of the noise shape 1312 v r A L / RM / S conversion stage 314 can be applied to obtain a second linear combination of the noise shapes of the channels L and R. The way to obtain it is shown below. Thus, the noise shape 304 is, as a result, a linear combination of the noise shapes of the two channels v m and v r It can be divided into

[0145] Then, in a normalization stage 316, the mid-channel representation of the noise shape 1312, v m and the side channel representation of the noise shape,v, r At least one of the noise shapes 1312 is normalized to obtain a mid-channel representation v m A normalized version of v m,n and / or a side-channel representation of the noise shape 1312 v r A normalized version of v r,n can be obtained.

[0146] A quantization stage (e.g., vector quantization, VQ) 318 then quantizes the normalized version of the signal 1304, e.g., a normalized mid-channel representation of the noise shape 1312, v m,n The quantized version of v m,ind and the normalized side-channel representation of the noise shape,v s,n The quantized version of v s,ind Vector quantization (e.g., through a multi-stage vector quantizer) may be used. Thus, the index v m,ind [k] (where k is the index of a particular frequency bin) describes the mid-representation of the noise shape, and the index v s,ind [k] can describe the side representation of the noise shape. Therefore, the index v m,ind [k] and v s,ind [k] may be encoded in the bitstream 232 as a first linear combination of the comfort noise parameter data for the first channel and the comfort noise parameter data for the second channel and a second linear combination of the comfort noise parameter data for the first channel and the comfort noise parameter data for the second channel.

[0147] In the inverse quantization step 322, the normalized mid-channel representation v of the noise shape 1312 is m,n The quantized version of v m,ind and the normalized side-channel representation of the noise shape,v s,n The quantized version of vs,ind Inverse quantization may be performed on

[0148] The M / SL / R converter 324 converts the dequantized mid-representation v of the noise shape 1312 into m,q and side expression v s,q is applied to the dequantized version of the original (left and right) channels v' l and v' r We may obtain a version of the noise shape 1312 in

[0149] Then, at stage 326, the gain g l and g r In particular, the gain can be calculated for the same channel (v' l and v' r ) for every sample of the noise shape. l and g r is the noise shape representation v' l and v' r may be obtained by considering all (or almost all) of the frequency bins in

[0150] gain g l teeth, the values ​​of the frequency bins of the noise shape of the first channel 301 in the L / R domain (upstream of the L / RM / S converter 314); - It can be obtained by comparing the values ​​of the frequency bins of the noise shape 1312 of the first channel 301 after being retransformed in the L / R domain (downstream of the M / SL / R converter 324).

[0151] Similarly, the gain g r teeth, the values ​​of the coefficients of the noise shape of the second channel 303 in the L / R domain (upstream of the L / RM / S converter 314); It may be obtained by comparing the values ​​of the coefficients of the noise shape 1312 of the second channel 303 after being retransformed in the L / R domain (downstream of the M / SL / R converter 324).

[0152] In the following, an example of how to obtain the gain is proposed. However, in the linear domain, the gain may be proportional to, for example, the geometric mean of a number of fractions, each fraction being the fraction between the coefficients of the noise shape of a particular channel in the L / R domain (upstream of the L / RM / S converter 314) and the coefficients of the same channel after retransformation in the L / R domain downstream of the M / SL / R converter 324. In the logarithmic domain, for each channel, the gain may be obtained as proportional to the algebraic mean between the differences between the coefficients of the FD version of the noise shape in the L / R domain (upstream of the L / RM / S converter 314) and the coefficients of the noise shape after retransformation in the L / R domain downstream of the M / SL / R converter 324. In general, in the logarithmic or scalar domain, the gain may provide a relationship between the version of the noise shape of the left or right channel before the L / RM / S conversion and quantization and the version of the noise shape of the left or right channel after the inverse quantization and M / SL / R retransformation.

[0153] The quantization stage 328 is l,q to obtain a quantized version of it, denoted by the gain g l , the unquantized gain g r g can be obtained from r,q to obtain a quantized version of it, denoted by the gain g r The gain g l,q and g r,q may be encoded in the bitstream 232 (eg, as comfort noise parameter data 401 and / or 403) and read by a decoder.

[0154] In some examples, it is also possible to compare the energy of the side channel noise shape vector (e.g., before being normalized, e.g., between stages 314 and 316) to a predefined energy threshold α (which may be a positive real value) (in this case 0.1, but may be a different value, such as a value between 0.05 and 0.15). In the comparison block 435, the side representation v of the noise shape of the inactive frame 308 is sIt is possible to determine whether the noise shape side representation v s If the energy of is less than the energy threshold α, then a binary result (the “no side flag”) is signaled in the bitstream 232 as side information 402. Here, the side representation of the noise shape v s If the energy of is less than the energy threshold α, the no-side flag is set to 1, and the side representation of the noise shape v s It is envisioned that the no side flag = 0 if the energy of is greater than an energy threshold α. In some cases, if the energy is exactly equal to the energy threshold, the flag may be 1 or 0 according to the particular application. Block 436 performs a negation on the binary value of no side flag 436 (if the input of block 436 is 1, the output 436' is 0, and if the input of block 436 is 0, the output 436' is 1). Block 436 is shown to provide the opposite value of the flag as output 436'. Thus, the lateral representation of the noise shape v s If the energy of is greater than the energy threshold, the value 436′ may be 1, and the side representation of the noise shape v s If the energy of the dequantized value v is less than a predetermined threshold, then the value 436′ is 0. s,q Note that we can multiply v by the binary value 436′. This gives us the side representation of the noise shape v s If the energy of the dequantized side representation of the noise shape v s,q is just one possible way to obtain that the bins of v are artificially zeroed (the output 437′ of block 437 becomes 0). On the other hand, the side representation of the noise shape v s If the energy of is large enough (>α), the output 437' of block 437 (multiplier) is v s,q Therefore, the side representation of the noise shape v s If the energy of is less than a predefined energy threshold α, the noise shape side representation v s (Especially the dequantized version v s,q) is not considered to obtain the left / right representation of the noise shape. (It will be noted that the decoder may additionally or alternatively have a similar mechanism to zero out coefficients of the side representation of the noise shape.) Note that the no-side flag may also be encoded in the bitstream 232 as part of the side information 402.

[0155] Note that the energy of the side representation of the noise shape is shown as being measured (by block 435) before normalization of the noise shape (in block 316), and the energy is not normalized before comparing to the threshold. It could in principle have been measured by block 435 after normalizing the noise shape (e.g., block 435 could measure v s instead of v s,n could also be entered by

[0156] With regard to the threshold α used to compare the energy of the side representation of the noise shape, the value 0.1 may be arbitrarily selected in some examples. In examples, the threshold α may be selected after experimentation and tuning (e.g., through calibration). In some examples, in principle, any number convenient for the numerical format (floating point or fixed point) or precision of a particular implementation can be used. Thus, the threshold α may be an implementation-specific parameter that may be entered after calibration.

[0157] The output interface (310) generating an encoded multi-channel audio signal (232) having encoded audio data for an active frame (306) using the first plurality of coefficients for the first number of frequency bins; may be configured to generate the first parametric noise data, the second parametric noise data, or a first linear combination of the first parametric noise data and the second parametric noise data and a second linear combination of the first parametric noise data and the second parametric noise data using a second plurality of coefficients describing a second number of frequency bins; Note that the first number of frequency bins is greater than the second number of frequency bins.

[0158] In practice, a lower resolution may be used for the inactive frames, thus further reducing the number of bits used to encode the bitstream. The same applies to the decoder.

[0159] Any of the exemplary encoders may be controlled by a suitable controller.

[0160] decoder Next, a decoder according to an embodiment is described. The decoder may, for example, include the comfort noise generator 220 (220a-220e) illustrated in Figures 3A-3F and described above. The comfort noise 204 (multi-channel audio signal) may be shaped in a signal modifier 250 to obtain an output signal 252. We are interested here in illustrating the operations for generating noise in the inactive frames 308, and not for the active frames 206.

[0161] Figure 4 shows a first example of a decoder 200', here denoted 200' (200b). It is noted that the decoder 200' comprises a comfort noise generator 220, which may include a generator 220 (220a-220e) according to any of Figures 3A-3F. Downstream of the generator 220 (220a-220e) there may be a signal modifier 250 (not shown, but shown in Figure 4), which may shape the generated multi-channel noise 204 according to energy parameters encoded in the comfort noise parameter data (401, 403). Through the decoder input interface 210, the decoder 200' may obtain comfort noise parameter data (401, 403) from the bitstream 232, which may include comfort noise parameter data describing the energy of the signal (e.g., for a first channel and a second channel, or for a first linear combination and a second linear combination of the first channel and the second channel, the first and second linear combinations being linearly independent of each other). Through the decoder input interface 210, the decoder 200' may obtain coherence data 404, indicating the coherence between the different channels. Although FIG. 4 shows that in the bitstream 232, two different silence descriptor frames 241 and 243 are provided for the encoding of the inactive frames, respectively, it is also possible to use more than two descriptor frames or only one single descriptor frame. The output of the decoder 200b is a multi-channel output.

[0162] 2, an example of a decoder 200, designated and shown as 200a, that may be used to generate an output signal 252, for example in the form of noise, is described.

[0163] First, the decoder 200a (200') may comprise an input interface 210 for receiving encoded audio data 232 (bitstream) in a sequence of frames 306, 308, e.g. as encoded by the encoder 300a or 300b. The decoder 200a (200') may be, or more generally be part of, a multi-channel signal generator 200 which may be or include, e.g., a comfort noise generator 220 (220a-220e) of any of Figures 3A-3F.

[0164] First, FIG. 2 shows a stereo comfort noise generator (CNG) 220 (220a-220e). In particular, the comfort noise generator 220 (220a-220e) may be as shown in FIG. 3A-3F or one of its modifications. Here, the coherence information 404 (e.g., c, more precisely, “coh” or c) as obtained from the encoder 300a or 300b is used. ind Shown in c q ) may be used to generate the multi-channel signal 204 (in channels 201, 203) as previously described. The multi-channel signal 204 as generated by the CNG 220 (220a-220e) may in fact be further modified by taking into account, for example, comfort noise parameter data 401 and 403, e.g., noise shape information for the first (left) and second (right) channels of the multi-channel signal to be shaped. In particular, the mid-index v generated by the encoder 300a (in particular by the noise parameter calculator 3040) at stages 316 and / or 318 may be used to generate the multi-channel signal 204 (in channels 201, 203). m,ind (401) and the side index v s,ind (403) and the gain g obtained in stages 326 and / or 328. l,q and g r,q It is shown that there is.

[0165] As shown in Figure 2, the side information 402 may make it possible to determine whether the current frame is an active frame 306 or an inactive frame 308. The elements of Figure 2 refer to the processing of the inactive frame 308, it is intended that any technique may be used for the generation of the output signal in the active frame 306, and therefore this is not the purpose of this specification.

[0166] As shown in Fig. 2, several examples of comfort noise data are obtained from the bitstream 232. The comfort noise data includes, as explained above, coherence information (data) 404, parameters indicating the noise shape 401 and 403 (v m,ind and v s,ind ), and / or gain (g l,q and g r,q ).

[0167] Stage 212-C produces a quantized version of the coherence information 404, c ind is dequantized to obtain the dequantized coherence information c q It may be assumed that the following is obtained.

[0168] Stage 2120 (concatenated noise shape inverse quantization) may make it possible to inverse quantize other comfort noise data obtained from the bitstream 232. See Table 6. The inverse quantization stage 212 is formed by other inverse quantization stages, here indicated 212-M, 212-S, 212-R, 212-L. Stage 212-M inverse quantizes the mid-channel noise shape parameters 401 and 403 to obtain the inverse quantized noise shape parameters v m,q and v s,q Stage 212-S may obtain side channel noise shape parameters 403 (v s,ind ) the dequantized version v s,q In some examples, the noise shape vector v sA no-side flag can be used to zero out the output of stage 212-S if the energy of the noise shape vector v is recognized by block 435 of encoder 300a to be below a predefined threshold α. If the energy is below the predefined threshold α and the no-side flag signals so, then the noise shape vector v s The dequantized version of v s,q can be zeroed (this is conceptually shown as multiplication by a flag 536′ obtained from a block 436 that has the same functionality as block 436 on the encoder side, without any comparison to threshold α, even though block 536 actually reads a no-side flag encoded in the side information of the bitstream 232). Thus, if the energy of the side channel at the encoder is determined to be less than a predefined threshold α, then the noise shape vector v s The dequantized version of v s,q is artificially zeroed, and the value at the output 537′ of the scaler block 537 is zero. Otherwise, if the energy is greater than a predefined threshold, the output 537′ is the side index 403 (v s,ind ) quantized version v s,q In other words, if the side channel energy is less than a certain energy threshold α, the noise shape vector v s,ind The value is ignored.

[0169] In the M / SL / R stage 516, the L / R version of the parametric data (noise shape) v' l ,v' r Then, a M / SL / R conversion is performed to obtain the channel v′. Then, a gain stage 518 (formed by stages 518-L, 518-L) may be used, whereby in stage 518-L, the channel v′ l is the gain g l,d and in stage 518-R, channel v' r is the gain g r,q Therefore, the energy channel vl,q and v r,q may be obtained as the output of the gain stage 518. The stage blocks 518-L and 518-R are denoted with "+" since it is envisaged that the transmission of values ​​is in the logarithmic domain, and therefore the scaling of the values ​​is additionally indicated. However, the gain stage 518 also performs a multiplication of the reconstructed noise shape vector v l,q and v r,q is scaled. The reconstructed noise shape vector v l,q and v r,q is here compositely indicated at 2312 and is the reconstructed version of the noise shape 1312 as originally obtained in the encoder by the "get noise shape" block 312. In general terms, each gain is constant for all indices (coefficients) of the same channel of the same inactive frame.

[0170] Index v m,ind , v s,ind and the gain g l,q , g r,q Note that, v ... r,q and v l,q describes the envelope to be applied to the multi-channel signal 204 generated by the CNG 220.

[0171] Referring again to FIG. 2, the reconstructed noise shape vector v l,q and v r,q (2312) is used in the signal modifier 250 to obtain a modified signal 252 by shaping the noise 204. In particular, the first channel 201 of the generated noise 204 is modulated into the output multi-channel audio signal 252 (L out and R out ) in channel v at stage 250-L. l,q, the generated noise 204 may be shaped by channel 203 in stage 250-R.

[0172] In the example, the comfort noise signal 204 itself does not occur in the logarithmic domain, i.e., only the noise shape may use a logarithmic representation. A conversion from the logarithmic domain to the linear domain may be performed (although not shown).

[0173] A frequency domain to time domain transformation may also be performed (not shown).

[0174] The decoder 200' (200a, 200b) may also include a spectral-temporal converter (e.g., signal modifier 250) to convert the spectrally adjusted and coherence adjusted resultant first channel 201 and resultant second channel 203 into corresponding time domain representations to be combined or concatenated with the time domain representations of the corresponding channels of the decoded multi-channel signal for the active frame. This conversion of the generated comfort noise into a time domain signal occurs after the signal modifier block 250 in FIG. 2. The "combining or concatenating" part essentially means that there may also be an active frame (the other processing path in FIG. 1) before or after the inactive frame employing one of these CNG techniques, and the frames need to be correctly concatenated to produce a continuous output without gaps or audible clicks, etc.

[0175] In some instances, the encoded audio signal (232) for the active frame (306) has a first plurality of coefficients describing a first number of frequency bins; The encoded audio signal (232) for the inactive frame (308) has a second plurality of coefficients describing a second number of frequency bins.

[0176] The first number of frequency bins may be greater than the second number of frequency bins.

[0177] Any of the exemplary decoders may be controlled by a suitable controller.

[0178] Processing Steps: First Version The noise parameters encoded in the two SID frames for the two channels are calculated similarly to EVS [6], such as LP-CNG and / or FD-CNG. The noise energy shaping at the decoder is also the same as EVS, such as LP-CNG and / or FD-CNG.

[0179] At the encoder, the coherence of the two channels is additionally calculated, uniformly quantized using 4 bits, and transmitted in the bitstream 232. At the decoder, the CNG operation can then be controlled by the transmitted coherence value 404. As shown in Figures 3A-3F, three Gaussian noise sources N 1 , N 2 , N 3 (211a, 212a, 213a, 211b, 212b, 213b, 211c, 212c, 213c, 211d, 212d, 213d, 211e, 212e, 213e) may be used. When channel coherence is high, primarily correlated noise may be added to both channels 221′ and 223′, and more uncorrelated noise may be added when coherence 404 is low.

[0180] For every inactive frame 306, parameters for comfort noise generation (noise parameters) may always be estimated in the encoder (e.g., 300, 300a, 300b). This may be done, for example, by applying a frequency domain noise estimation algorithm (e.g., [8]) as described, for example, in [6], separately on both input channels (e.g., 301, 303) to calculate two sets of noise parameters (e.g., 401, 403), also described as parametric noise data. In addition, the coherence (c, 404) of the two channels may be calculated (e.g., in the coherence calculator 320) as follows:M Given an M-point DFT-spectrum of (L, R can be 301, 303), the four intermediate values ​​are, for example,

[0181]

number

[0182]

number

[0183] It may be calculated as follows: The energies of the two channels are

[0184]

number

[0185]

number

[0186] It is.

[0187] Here, M=256, R{·} denotes the real part of a complex number, I{·} denotes the imaginary part of a complex number, and {·} * These intermediate values ​​are then, for example, multiplied by the corresponding values ​​of the previous frame.

[0188]

number

[0189]

number

[0190]

number

[0191]

number

[0192] It can be smoothed using

[0193] This passage may be part of the "Channel Coherence Calculation" block 320' in the encoder. It is a time smoothing of the internal parameters to avoid large sudden jumps in the parameters between frames. In other words, a low pass filter is applied to the parameters here.

[0194] Instead of the constants 0.95 and 0.05, other constants within the intervals 0.95+ / -0.03 and 0.05- / +0.03 may be used.

[0195] Alternatively,

[0196]

number

[0197]

number

[0198]

number

[0199]

number

[0200] It is possible to define

[0201] where β, γ ∈ [0,1] and β+γ=1, e.g., β=0.95 and γ=0.05.

[0202] The coherence (c, 404), which may be between 0 and 1, is then calculated (e.g., in the coherence calculator (320)):

[0203]

number

[0204] It is calculated as follows: (e.g., in quantizer 320"), for example, using 4 bits c ind =0,min(15,floor(15×c+0.5)) It can be uniformly quantized as

[0205] The encoding of the estimated noise parameters 1312, 2312 for both channels may be done separately, for example as specified in [6]. Then two SID frames 241, 243 may be encoded and transmitted to the decoder. The first SID frame 241 may include the estimated noise parameters 401 of channel L and (for example 4) bits of side information 402, for example as described in [6]. In the second SID frame 243, the noise parameters 403 of channel R may be transmitted together with a 4-bit quantized coherence value c, 404 (different numbers of bits may be selected in different examples).

[0206] In the decoder (e.g., 200′, 200a, 200b), both the noise parameters (401, 403) of the SID frame and the side information 402 of the first frame can be decoded, e.g., as described in [6]. The coherence value 404 in the second frame can be decoded in stage 212-C.

[0207]

number

[0208] (In FIG. 2,

[0209]

number

[0210] is q (Replaced by ).

[0211] For comfort noise generation (e.g., in any of generators 220a-220e, which may include generator 220 or any one of FIGS. 3A-3E), according to one example, three Gaussian noise sources 211, 212, 213 may be used, as shown in FIG. 3. The noise sources 211, 212, 213 may be adaptively summed together (e.g., in summer stages 206-1 and 206-3), for example, based on a coherence value (c, 404). The left and right channel noise signals N l [k], N r The DFT spectrum of [k] is

[0212]

number

[0213]

number

[0214] It is often calculated as follows: where k ∈ {0, 1, …, M-1} (the index of a particular frequency bin, each channel has M frequency bins) and j 2 = -1 (i.e., j is the imaginary unit), and "x" is normal multiplication. Here, a "frequency bin" is a frequency bin in the spectrum N l , N rwhere M is the transform length of the FFT or DFT used, and therefore the length of the spectrum is M. Note that the noise inserted in the real part and the noise inserted in the imaginary part can be different. Thus, for a spectrum length of M, we need 2×M values ​​(one real and one imaginary) generated from each noise source. Or, in other words, N l and N r is a complex-valued vector of length M, and N1, N2, and N3 are real-valued vectors of length 2×M.

[0215] The noise signals 204 in the two channels are then spectrally shaped (e.g., in stages 250-L, 250-R in FIG. 2) using their corresponding noise parameters (2312) decoded from the respective SID frames, and then transformed back to the time domain (e.g., as described in [6]) for frequency domain comfort noise generation.

[0216] Any of the example processes may be performed by a suitable controller.

[0217] Processing Steps: Second Version The aspects of the processing steps as described above may be integrated with at least one of the following aspects: Here, reference is mainly made to Figures 2 and 5, but also to Figure 4.

[0218] A block diagram of the general framework of the encoder is depicted in Fig. 1. For each frame in the encoder, the current signal can be classified as either active or inactive by performing VAD for each channel separately, as described in [6]. The VAD decision can then be synchronized between the two channels. In an example, a frame is classified as an inactive frame 308 only if both channels are classified as inactive. Otherwise, it is classified as active and both channels are jointly encoded in an MDCT-based system using M / S per band, as described in

[10] . When switching from an active frame to an inactive frame, the signal may enter a SID encoding path as shown in Fig. 3.

[0219] Parameters for comfort noise generation (e.g., 1312, 401, 403, q l,q , g r,q ) (e.g., noise parameters) may always be estimated in the encoder (e.g., 300, 300a, 300b) for both active and inactive frames (306, 308). This can be done by applying a frequency domain noise estimation process, e.g., as described in [8] and / or as described in [6], separately on both input channels 301, 303 and calculating the spectral noise shape (M i 401 and / or I s or 403).

[0220] In addition, the coherence (404, c) of the two channels may be calculated (e.g., in the coherence calculator 320) as follows: M Given an M-point DFT spectrum of

[0221]

number

[0222]

number

[0223] It is often calculated as follows: The energies of the two channels are

[0224]

number

[0225]

number

[0226] It is.

[0227] where M may be 256 (although other values ​​for M may be used), R{·} represents the real part of the complex number, I{·} represents the imaginary part of the complex number, and {·} * These intermediate values ​​are then smoothed on a 10 ms subframe basis. previous Let denote the corresponding value from the previous subframe, then the smoothed value is

[0228]

number

[0229]

number

[0230]

number

[0231]

number

[0232] It can be calculated as:

[0233] Instead of the constants 0.95 and 0.05, other constants within the intervals 0.95+ / -0.03 and 0.05- / +0.03 may be used.

[0234] Alternatively,

[0235]

number

[0236]

number

[0237]

number

[0238]

number

[0239] It is possible to define

[0240] where β, γ ∈ [0,1] and β+γ=1, e.g., β=0.95 and γ=0.05 (β>γ, e.g., β>3×γ, or β>6×γ).

[0241] The coherence c ∈ [0,1] is then (for example at 320′)

[0242]

number

[0243] is calculated as using 4 bits (but a different number of bits is possible)

[0244]

number

[0245] may be uniformly quantized (e.g., at 320") as |_·_| represents rounding down to the nearest integer (floor function).

[0246] The encoding of the estimated noise shape for both channels can be done jointly. l ) and right (v r ) channel noise shape, the different channels are obtained (e.g., through linear combination) and the mid-channel (v m ) noise shape and side channel (v s ) noise shapes, etc. (e.g., at block 314)

[0247]

number

[0248]

number

[0249] It is often calculated as follows: N represents the length of the noise shape vector, e.g., in the frequency domain (e.g., for each inactive frame 308). N represents the length of the noise shape vector, e.g., as estimated by EVS [6], which may be between 17 and 24. The noise shape vector can be seen as a more compact representation of the spectral envelope of the noise in the input frame, or more abstractly, a parametric spectral description of the noise signal using N parameters. N is not related to the transform length of the FFT or DFT.

[0250] These noise shapes may then be normalized (e.g., at stage 316) and / or quantized. For example, they may be vector quantized (e.g., at stage 318), e.g., using a multi-stage vector quantizer (MSVQ) (one example is described in [6, p. 442]).

[0251] Stage 318 v m Quantize the shape (v m,ind The MSVQ used to obtain the 401 may have, for example, 6 stages (although other numbers of stages are possible) and / or use 37 bits (although other numbers of bits are possible), e.g. as implemented for mono channels in [6], but with v s Quantize the shape (v s,ind 403) has been reduced to 4 stages (or in any case a number of stages less than the number of stages used in stage 318) and / or to a total of 25 bits (or in any case a number of stages less than the number of stages used in stage 318) m 3. For example, stage 318 may use a number of bits less than the number of bits used to encode

[0252] The codebook index for MSVQ may be transmitted in the bitstream (e.g., in the data 232, and more particularly in the comfort noise parameter data 401, 403). The index is then dequantized, resulting in the dequantized noise shape v m,q and v m,q is obtained.

[0253] If the background noise is a single noise source in the center of the stereo image, the estimated noise shape v for both channels m, v s is expected to be very similar, or even equal. The resulting S-channel noise shape will then contain only zeros. However, v sThe vector quantizer (stage 322) currently used to quantize the implementation cannot model an all-zero vector, and after dequantization, the resulting dequantized v s Noise Shape (v s,q ) may no longer be all zero. This may cause perceptual problems involved in representing such central background noise. To avoid this drawback of VQ322, the unquantized v s The energy of the shape vector (e.g., v after stage 314 and / or before stage 316) s Depending on the noise shape vector (energy of the noise shape vector), a no_side value (no_side flag) can be calculated (and may be signaled in the bitstream). The no_side flag is

[0254]

number

[0255] It may be.

[0256] The energy threshold α can be, in one example, 0.1 or another value in the interval [0.05, 0.15]. However, the threshold α is arbitrary and in one implementation may depend on the numerical format used (e.g., fixed point or floating point) and / or possibly the signal normalization used. In an example, a positive real value may be used depending on how strict the adopted definition of a "silent" S channel is. Thus, the interval may be (0, 1). The no_side value is v l and v r To reconstruct the channel noise shape (e.g., at the decoder), s can be used to indicate whether a noise shape should be used. If no_side is 1, the dequantized v s The shape is set to zero (e.g., the logical value NOT (no_side)) by the value of 436' in FIG. 2. s,q, by scaling the dequantized noise shape vector v m,q and v s,q (the latter is applied to the low energy cases, e.g., by replacing them with 0, and thus indicated by 437' in Fig. 2) to obtain the intermediate vector v' l and v' r of

[0257]

number

[0258]

number

[0259] It can be obtained as follows.

[0260] These intermediate vectors v' l and v' r , and the unquantized noise shape vector v l and v r Using

[0261]

number

[0262]

number

[0263] It is calculated as follows:

[0264] The two gain values ​​are then (e.g., at stage 328)

[0265]

number

[0266] It may be linearly quantized as:

[0267] The quantized gain may be stored in the SID bitstream (e.g., as part of the comfort noise parameter data 401 or 403, more specifically g l,q may be part of the first parametric noise data, and g r,q may be part of the second parametric noise data), e.g., the gain value g l,q 7 bits and / or gain value g r,q can be encoded using 7 bits (different amounts are possible for each gain).

[0268] In a decoder (e.g., 200', 200a, 200b), the quantized noise shape vector (e.g., a portion of the comfort noise parameter data 401 or 403, more specifically a portion of the first parametric noise data and the second parametric noise data) may be inverse quantized, for example, in stage 212 (in particular, either of sub-stages 212-M, 212-S).

[0269] The gain value may be, for example, at stage 212 (particularly at any of sub-stages 212-L and 212-R):

[0270]

number

[0271]

number

[0272] (The value 45 depends on the quantization and may be different for different quantizations.) (In Figure 2, g l,deq , g r,deq Instead of g l,d , g r,dis used).

[0273] The coherence value 404 is c q =15×c ind It may be dequantized (eg, at stage 212-C) as follows:

[0274] If the no_side flag (in the side information 402) is 1, then the intermediate vector v' l and v' r Before computing (e.g., at stage 516), we first compute the dequantized v s shape v s,q is set to zero (value 537′). The corresponding gain value is then added to all elements of the corresponding intermediate vector to obtain the dequantized noise shape v l,q and v r,q of

[0275]

number

[0276]

number

[0277] (Addition is done because we are in the log domain, whereas in the linear domain it corresponds to multiplication by a coefficient.)

[0278] For comfort noise generation, three Gaussian noise sources N 1 , N 2 , N 3 (e.g., 211a, 212a, 213a in FIG. 3A, 211b, 212b, 212c in FIG. 3B, etc.) may be used as shown in any of FIGS. 3A-3F (or any of the other techniques may be used). When channel coherence is high, primarily correlated noise is added to both channels, and when coherence is low, more uncorrelated noise is added.

[0279] Using three noise sources, the noise signals N l (201) and N r The DFT spectrum of (203) is

[0280]

number

[0281]

number

[0282] It is often calculated as follows: where k∈{0,1,_,M-1} and j 2 =-1, where M is the block length of the DFT. To generate independent noise in both the real and imaginary parts of the complex spectrum, 2 × M values ​​(two per frequency bin) need to be generated by each noise source per frame. Therefore, N 1 , N 2 , N 3 (at 211, 212, 213, respectively, in FIG. 3F) can be considered as real-valued noise vectors with length 2×M, where N r and N k (at 201, 203 respectively) are complex-valued vectors of length M.

[0283] The noise signals in the two channels are then decoded from the bitstream 232 to obtain their corresponding noise shapes (v l,q or v r,q ) (e.g. in signal modifier 252) and then transformed back from the logarithmic domain to the scalar domain and from the frequency domain to the time domain, e.g. as described in [6], to generate a stereophonic comfort noise signal.

[0284] Any of the example processes may be performed by a suitable controller.

[0285] Some advantages The present invention may provide techniques for stereo comfort noise generation that are particularly suitable for discrete stereo coding schemes. By jointly coding and transmitting noise shape parameters for both channels, stereo CNG may be applied without the need for a mono downmix.

[0286] The blending of one common and two individual noise sources controlled by one single coherence value, together with two separate sets of noise parameters, allows faithful reconstruction of the stereo image of the background noise without the need to transmit fine-grained stereo parameters that are typically only present in parametric audio coders. Since only this one parameter is employed, the encoding of the SID is easy while keeping the SID frame size small without the need for advanced compression methods.

[0287] Some important aspects: In some examples, at least one of the following aspects is obtained: 1. Generating comfort noise for a stereophonic signal by mixing three Gaussian noise sources, one for each channel, with a third common noise source to generate correlated background noise. 2. A method for controlling the mix of noise sources using a coherence value transmitted with the SID frame. 3. Transmitting separate noise shape parameters for both stereo channels by jointly encoding the noise shape in an M / S manner, reducing the SID frame bit rate by encoding the S shape with fewer bits than M.

[0288] Other technologies It is also possible to implement a method for generating a multi-channel signal having a first channel and a second channel, which comprises: generating a first audio signal using a first audio source; generating a second audio signal using a second audio source; generating a mixing noise signal using a mixing noise source; mixing the mixing noise signal with the first audio signal to obtain a first channel, and mixing the mixing noise signal with the second audio signal to obtain a second channel.

[0289] It is also possible to implement a method of audio encoding for generating an encoded multi-channel audio signal for a sequence of frames including active and inactive frames, the method comprising: analyzing the multi-channel signal to determine a frame of the sequence of frames as an inactive frame; calculating first parametric noise data for a first channel of the multi-channel signal and calculating second parametric noise data for a second channel of the multi-channel signal; calculating coherence data indicative of a coherence status between the first channel and the second channel in an inactive frame; generating encoded audio data for the active frames and, for the inactive frames, an encoded multi-channel audio signal having the first parametric noise data, the second parametric noise data, and the coherence data.

[0290] The present invention may also be implemented in a non-transitory storage unit that stores instructions that, when executed by a computer (or processor, or controller), cause the computer (or processor, or controller) to perform the above-described methods.

[0291] The invention may also be implemented with a multi-channel audio signal organized into a sequence of frames, the sequence of frames including active and inactive frames, the encoded multi-channel audio signal being: encoded audio data for the active frame; first parametric noise data for a first channel in an inactive frame; second parametric noise data for a second channel in the inactive frames; and and coherence data indicating a coherence situation between the first channel and the second channel in the inactive frame. The multi-channel audio signal may be obtained by one of the techniques disclosed above and / or below.

[0292] Advantages of the embodiment The insertion of a common noise source in the two channels to mimic correlated noise for generating the final comfort noise plays an important role for the mimicking of the stereophonic background noise recording.

[0293] An embodiment of the invention can be considered as a procedure for generating comfort noise for a stereophonic signal by mixing three Gaussian noise sources, one for each channel, with a third common noise source to generate correlated background noise, or additionally or separately, controlling the mixing of noise sources with a coherence value transmitted with the SID frame, or additionally or separately, as follows: In a stereo system, generating background noise separately generates a completely decorrelated noise, which is an unpleasant sound that is very different from the real background noise that causes a sudden audible transition when switching to / from the background in active mode to the background in DTX mode. In one embodiment, at the encoder side, in addition to the noise parameters, the coherence of the two channels is calculated, uniformly quantized and added to the SID frame. At the decoder, the CNG operation is then controlled by the transmitted coherence value. Three Gaussian noise sources N_1, N_2, N_3 are used, where when the channel coherence is high, mainly correlated noise is added to both channels, and when the coherence is low, more uncorrelated noise is added.

[0294] It should be mentioned that all alternative aspects or aspects as described above, and all aspects as defined by the following independent claims, can be used individually, i.e. without the alternative aspects, objects, or other alternative aspects or objects other than the intended alternative aspects, objects, or independent claims. However, in other embodiments, two or more of the alternative aspects or aspects or independent claims may be combined with each other, and in other embodiments, all aspects, or alternative aspects and all independent claims may be combined with each other.

[0295] An encoded signal according to the present invention may be stored in a digital or non-transitory storage medium or transmitted over a transmission medium, such as a wireless or wired transmission medium, such as the Internet.

[0296] Although some aspects are described in the context of an apparatus, it will be apparent that these aspects also serve as descriptions of a corresponding method, and that a block or apparatus corresponds to a method step or feature of a method step, and similarly, aspects described in the context of a method step also serve as descriptions of a corresponding block or item or feature of a corresponding apparatus.

[0297] Depending on certain implementation requirements, embodiments of the present invention can be implemented in hardware or software. Implementations can be performed using a digital storage medium, such as a floppy disk, DVD, CD, ROM, PROM, EPROM, EEPROM, or FLASH memory, on which electronically readable control signals are stored, which cooperate (or can cooperate) with a programmable computer system on which the respective methods are executed.

[0298] Some embodiments according to the invention include a data carrier carrying electronically readable control signals that can be interfaced with a programmable computer system to perform one of the methods described herein.

[0299] In general, embodiments of the present invention can be implemented as a computer program product with program code operable to perform one of the methods when the computer program product runs on a computer. The program code can, for example, be stored on a machine-readable carrier.

[0300] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier or a non-transitory storage medium.

[0301] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0302] A further embodiment of the inventive method is, therefore, a data carrier (or a digital storage medium or a computer readable medium) having recorded thereon a computer program for performing one of the methods described herein.

[0303] A further embodiment of the inventive method is therefore a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may for example be adapted to be transmitted via a data communication connection, for example the Internet.

[0304] A further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.

[0305] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

[0306] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform one of the methods described herein. In general, the methods are preferably performed by any hardware apparatus.

[0307] The above described embodiments are merely illustrative of the principles of the present invention. It is understood that modifications and variations of the arrangements and details described herein will be apparent to those skilled in the art. It is therefore intended to be limited only by the scope of the following claims, and not by the specific details presented with the description and illustration of the embodiments herein.

[0308] References [Explanation of symbols]

[0309] 200 Multi-Channel Signal Generator 200' Decoder 200a, 200b (200') Decoder 201 First Channel 203 Second Channel 204 Multi-channel Signals 206-1 and 206-3 adder stages 208-1, 208-2, 208-3 Amplitude elements 210 Input Interface 211 1st Audio Source 211a First Source 211b First Audio Source 211c 1st Audio Source 212 Mixing Noise Source 211d or 211e 1st audio source 212a Mixing Noise Source 212b Mixing Noise Source 212c Mixing Noise Source 212d or 212e mixing noise source 212-C Stage 212-M Stage 212-S Stage 213 Secondary Audio Source 213a Second Source 213b Secondary Audio Source 213c Second Audio Source 213d or 213e Second Audio Source 220 Comfort Noise Generator (CNG) 220a CNG 220b CNG 220c CNG 220d CNG 221 and 223 Audio Signals 221' weighted version 221a version 222 Mixing Noise Signal 222' Weighted version 223 Second Audio Signal 223' Weighted version 232 encoded multi-channel audio signal 241 and / or 243 SID frames 250 signal modifier 250-L, 250-R stage 252 Noise 300, 300a and 300b Encoders 301 First Channel 302 original input signal 303 Second Channel 304 Input Signal 304-1 1st noise parameter calculator stage 304-3 Second noise parameter calculator stage 306 Active Frames 306a Discrete Stereo Processing 306b Stereo intermittent transmission processing (stereo DTX) 308 Inactive Frames 310 Output Interface 312 Noise Shape Acquisition Block 314 L / RM / S converter 316 Stages 318 quantization stages (e.g. vector quantization, VQ) 320 Coherence Calculator 320' Channel Coherence Calculation Stage 320" Uniform Quantizer Stage 322 Inverse quantization stage 324 M / SL / R converter 326 Stages 328 Quantization Stage 360 Pre-processing stage 370 Spectral Analysis Stage 370-1 First Spectral Analysis 370-3 Second Stage 380 Activity Detection Stage 380-1 First Activity Detection Stage 380-3 Second Activity Detection Stage 381 Verdict 381' Switch 401, 403 Parametric noise data 402 "Comfort noise generation side information" 404, c Control parameters 436' Output 437' Output 516 M / SL / R Stage 518 Gain Stage 518-L Stage 518-R Stage 536' Flag 537' Output 1312 Low-resolution parametric representation 2120 Stage 2312 Noise parameters 3040 Noise Parameter Calculator

Claims

1. A multi-channel signal generator (200) for generating a multi-channel signal (204) having a first channel (201) and a second channel (203), an input interface (210) for receiving encoded audio data (232) in a sequence of frames (306, 308) including an active frame (306) and an inactive frame (308) following the active frame (306), the inactive frame generating comfort noise; an audio decoder (200', 200a, 200b) for decoding the encoded audio data for the active frame (306) to generate a decoded multi-channel signal for the active frame; a first audio source (211) for generating a first audio signal (221), said first audio source (211) being a first noise source, said first audio signal (221) being a first noise signal; a second audio source (213) for generating a second audio signal (223), said second audio source (213) being a second noise source, said second audio signal (223) being a second noise signal; a mixing noise source (212) for generating a mixing noise signal (222); a mixer (206) for mixing the mixing noise signal (222) with the first audio signal (221) to obtain the first channel (201) and for mixing the mixing noise signal (222) with the second audio signal (222) to obtain the second channel (203); The mixer (206) a first amplitude element (208-1) for influencing the amplitude of the first audio signal (221); a first adder (206-1) for adding the output signal (221) of the first amplitude element and at least a portion of the mixing noise signal (222); a second amplitude element (208-3) for influencing the amplitude of the second audio signal (223); a second adder (206-3) for adding an output (223) of the second amplitude element (208-3) and at least a portion of the mixing noise signal (222); an amount of influence action performed by the first amplitude element (208-1) and an amount of influence action performed by the second amplitude element (208-3) are equal to each other or the amount of influence action performed by the second amplitude element (208-3) differs by less than 20% of the amount of influence action performed by the first amplitude element (208-1); the mixer (206) comprises a third amplitude element (208-2) for influencing the amplitude of the mixing noise signal (222); an amount of the influencing action performed by the third amplitude element (208-2) depends on the amount of the influencing action performed by the first amplitude element (208-1) or the second amplitude element (208-3), whereby the amount of the influencing action performed by the third amplitude element (208-2) is greater when the amount of the influencing action performed by the first amplitude element or the amount of the influencing action performed by the second amplitude element (208-3) is smaller; The first audio source (211), the second audio source (213), the mixing noise source (212), and the mixer (206) are active in the inactive frame (308) to generate the multi-channel signal (204) for the inactive frame. A multi-channel signal generator (200).

2. 2. The multi-channel signal generator of claim 1, wherein the mixer (206) is configured to generate the first channel (201) and the second channel (203) such that an amount of the mixing noise signal (222) in the first channel (201) is equal to an amount of the mixing noise signal (222) in the second channel (203) or is within a range of 80 percent to 120 percent of an amount of the mixing noise signal (222) in the second channel (203).

3. 3. A multi-channel signal generator as claimed in claim 1 or 2, wherein the mixer (206) comprises a control input for receiving a control parameter (404, c), and the mixer (206) is configured to control the amount of the mixing noise signal (222) in the first channel (201) and the second channel (203) in response to the control parameter (404, c).

4. 4. The multi-channel signal generator according to claim 1, wherein each of the first audio source (211), the second audio source (213) and the mixing noise source (212) is a Gaussian noise source.

5. 5. A multi-channel signal generator according to claim 1, wherein the first audio source (211) comprises a first noise generator for generating the first audio signal (221) as a first noise signal, the second audio source (213) comprises a decorrelator for decorrelating the first noise signal (221) to generate the second audio signal (213) as a second noise signal, and the mixing noise source (212) comprises a second noise generator.

6. 5. A multi-channel signal generator according to claim 1, wherein the first audio source (211) comprises a first noise generator (211) for generating the first audio signal (221) as a first noise signal, the second audio source (213) comprises a second noise generator (213) for generating the second audio signal (223) as a second noise signal, and the mixing noise source (212) comprises a decorrelator for decorrelating the first noise signal (221) or the second noise signal (223) to generate the mixing noise signal (222).

7. 5. The multi-channel signal generator of claim 1, wherein one of the first audio source (211), the second audio source (213) and the mixing noise source (212) comprises a noise generator for generating a noise signal, another one of the first audio source (211), the second audio source (213) and the mixing noise source (212) comprises a first decorrelator for decorrelating the noise signal, and a further one of the first audio source (211), the second audio source (213) and the mixing noise source (212) comprises a second decorrelator for decorrelating the noise signal, the first decorrelator and the second decorrelator being different from each other such that output signals of the first decorrelator and the second decorrelator are uncorrelated with each other.

8. 5. The multi-channel signal generator of claim 1, wherein the first audio source (211) comprises a first noise generator, the second audio source (213) comprises a second noise generator, and the mixing noise source (212) comprises a third noise generator, and the first noise generator, the second noise generator, and the third noise generator are configured to generate noise signals that are mutually decorrelated.

9. 9. The multi-channel signal generator of claim 1, wherein one of the first audio source (211), the second audio source (213), and the mixing noise source (212) comprises a pseudo-random sequence generator configured to generate a pseudo-random sequence in response to a seed, and at least two of the first audio source (211), the second audio source (213), and the mixing noise source (212) are configured to initialize the pseudo-random sequence generator using different seeds.

10. 6. The multi-channel signal generator of claim 1, wherein at least one of the first audio source (211), the second audio source (213) and the mixing noise source (212) is configured to operate using a pre-stored noise table.

11. 6. The multi-channel signal generator of claim 1, wherein at least one of the first audio source (211), the second audio source (213) and the mixing noise source (212) is configured to generate a complex spectrum for a frame using a first noise value for a real part and a second noise value for an imaginary part.

12. 12. The multi-channel signal generator of claim 11, wherein at least one noise generator is configured to generate a complex noise spectrum value for frequency bin k using a first random value at index k for one of the real and imaginary parts and a second random value at index (k+M) for the other of the real and imaginary parts, the first noise value and the second noise value being included in a noise array having a range from a start index to an end index derived from a random number sequence generator or a noise table or a noise process, the start index being less than M and the end index being less than or equal to 2M, and M and k being integer values.

13. The amount of influence performed by the third amplitude element (208-2) is a predetermined value (c q ), and the amount of influence performed by the first amplitude element (208-1) and the amount of influence performed by the second amplitude element (208-3) are between 1 and a predetermined value (c q 13. A multi-channel signal generator according to claim 1, wherein the square root of the difference between

14. the encoded audio data (232) for the active frame (306) has a first plurality of coefficients describing a first number of frequency bins; the encoded audio data (232) for the inactive frames (308) has a second plurality of coefficients describing a second number of frequency bins; 2. The multi-channel signal generator of claim 1, wherein the first number of frequency bins is greater than the second number of frequency bins.

15. A multi-channel signal generator (200) for generating a multi-channel signal (204) having a first channel (201) and a second channel (203), an input interface (210) for receiving encoded audio data (232) in a sequence of frames (306, 308) including an active frame (306) and an inactive frame (308) following the active frame (306), the inactive frame generating comfort noise; an audio decoder (200', 200a, 200b) for decoding the encoded audio data for the active frame (306) to generate a decoded multi-channel signal for the active frame; a first audio source (211) for generating a first audio signal (221); a second audio source (213) for generating a second audio signal (223); a mixing noise source (212) for generating a mixing noise signal (222); a mixer (206) for mixing the mixing noise signal (222) with the first audio signal (221) to obtain the first channel (201) and for mixing the mixing noise signal (222) with the second audio signal (222) to obtain the second channel (203); the first audio source (211) is a first noise source and the first audio signal (221) is a first noise signal, or the second audio source (213) is a second noise source and the second audio signal (223) is a second noise signal; the first noise source or the second noise source is configured to generate the first noise signal (201) or the second noise signal (203) such that the first noise signal (201) or the second noise signal (203) are at least partially correlated; the mixing noise source (212) is configured to generate the mixing noise signal (222) including a first mixing noise portion (221a) and a second mixing noise portion (221b), the second mixing noise portion (221b) being at least partially uncorrelated with the first mixing noise portion (221b); the mixer (206) is configured to mix the first mixing noise part (221a) of the mixing noise signal (222) with the first audio signal (221) to obtain the first channel (201) and to mix the second mixing noise part (221b) of the mixing noise signal (222) with the second audio signal (223) to obtain the second channel (203); The first audio source (211), the second audio source (213), the mixing noise source (212), and the mixer (206) are active in the inactive frame (308) to generate the multi-channel signal (204) for the inactive frame. A multi-channel signal generator (200).

16. A method for generating a multi-channel signal having a first channel and a second channel (203), comprising: an input interface (210) for receiving encoded audio data (232) in a sequence of frames (306, 308) including an active frame (306) and an inactive frame (308) following the active frame (306), the inactive frame generating comfort noise; using an audio decoder (200', 200a, 200b) for decoding the encoded audio data for the active frame (306) to generate a decoded multi-channel signal for the active frame; generating a first audio signal (221) using a first audio source (211), the first audio source (211) being a first noise source and the first audio signal (221) being a first noise signal; generating a second audio signal (223) using a second audio source (213), the second audio source (213) being a second noise source and the second audio signal (223) being a second noise signal; generating a mixing noise signal (222) using a mixing noise source (212); mixing the mixing noise signal (222) with the first audio signal (221) to obtain the first channel (201), and mixing the mixing noise signal (222) with the second audio signal (223) to obtain the second channel (202), said method comprising the steps of: using a first amplitude element (208-1) to affect the amplitude of the first audio signal (221); using a first adder (206-1) for adding the output signal (221) of the first amplitude element and at least a portion of the mixing noise signal (222); using a second amplitude element (208-3) for influencing the amplitude of the second audio signal (223); using a second adder (206-3) to add an output (223) of the second amplitude element (208-3) and at least a portion of the mixing noise signal (222); an amount of influence action performed by the first amplitude element (208-1) and an amount of influence action performed by the second amplitude element (208-3) are equal to each other or the amount of influence action performed by the second amplitude element (208-3) differs by less than 20% of the amount of influence action performed by the first amplitude element (208-1); The mixing step (206) uses a third amplitude element (208-2) that affects the amplitude of the mixing noise signal (222); an amount of the influencing action performed by the third amplitude element (208-2) depends on the amount of the influencing action performed by the first amplitude element (208-1) or the second amplitude element (208-3), whereby the amount of the influencing action performed by the third amplitude element (208-2) generates a multi-channel signal that is larger when the amount of the influencing action performed by the first amplitude element or the amount of the influencing action performed by the second amplitude element (208-3) is smaller; The first audio source (211), the second audio source (213), the mixing noise source (212), and the mixing step (206) are active in the inactive frames (308) to generate the multi-channel signal (204) for the inactive frames. method.

17. 17. A computer program for carrying out the method of claim 16 when executed on a computer or processor.

Citation Information

Patent Citations

  • Coding multichannel audio signals

    JP2018515813A

  • Spatial comfort noise

    US20160027447A1

  • Support for generation of comfort noise

    WO2019193156A1