Spatial Audio Parameters

By defining and using parameter fields associated with multi-channel audio signals, the problem of inefficient estimation of sound field-related parameters in the frequency band is solved, and the accurate description of sound space characteristics and the rendering effect is improved, and multiple audio signal types are supported. Render.

CN112513982BActive Publication Date: 2024-11-15NOKIA TECHNOLOGIES OY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980050466.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-05-31
Filing Date
2019-05-29
Publication Date
2024-11-15
Estimated Expiration
2039-05-29

AI Technical Summary

Technical Problem

The prior art has problems with inefficiency in the estimation of sound field-related parameters in the frequency band and audio encoder, especially in microphone array signal processing and spatial audio rendering, and it is difficult to effectively describe the spatial characteristics and rendering effects of sound.

Method used

By defining and using parameter fields associated with multi-channel audio signals, including parameters such as microphone array configuration, direction and energy ratio, control the rendering of the audio signal to achieve accurate description and rendering of the sound field.

Benefits of technology

It improves the spatial characteristic description and rendering effect of audio signals, enhances the accuracy and efficiency of microphone array signal processing, and supports the rendering of a variety of audio signal types, including microphone capture, binaural, panoramic sound, etc.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112513982B_ABST
    Figure CN112513982B_ABST
Patent Text Reader

Abstract

An apparatus includes means for defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; and controlling rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to an apparatus and method for estimating sound field related parameters in a frequency band, but not exclusively for estimating sound field related parameters in the time-frequency domain of an audio encoder and decoder. Background Art

[0002] Parametric spatial audio processing is the field of audio signal processing where spatial aspects of sound are described using sets of parameters. For example, in parametric spatial audio capture from microphone arrays, estimating sets of parameters from the microphone array signal (such as the direction of the sound in a frequency band and the ratio between the directional and non-directional parts of the sound captured in the frequency band) is a typical and effective choice. It is well known that these parameters describe the perceived spatial characteristics of the sound captured at the microphone array positions very well. These parameters can be used accordingly for the synthesis of spatial sound, for binaural headphones, for loudspeakers or other formats such as Ambisonics.

[0003] Therefore, the directional and direct-to-total energy ratios in the frequency bands are particularly effective parameterizations for spatial audio capture. Summary of the invention

[0004] According to a first aspect, an apparatus is provided, comprising means for defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; and controlling rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0005] The module for defining at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe characteristics of the multi-channel audio signal may include at least one first field configured to identify the multi-channel audio signal as a specific type of audio signal.

[0006] The specific type of audio signal may include at least one of: a multi-channel audio signal captured by a microphone; a binaural audio signal; a signal-processed audio signal; an enhanced signal-processed audio signal; a noise-suppressed signal-processed audio signal; a source-separated signal-processed audio signal; a source-tracking signal-processed audio signal; a spatially processed audio signal; an advanced signal-processed audio signal; and an ambient sound audio signal.

[0007] The module for defining at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one second field configured to identify a characteristic associated with the specific type of audio signal.

[0008] When the specific type of audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the specific type of audio signal may include one of: identifying a microphone profile of at least one microphone in a microphone array that is caused to capture the multi-channel audio signal captured by the microphone; identifying a configuration of the microphone array that is caused to capture the multi-channel audio signal captured by the microphone; and identifying the position and / or arrangement of at least two microphones within the microphone array that is caused to capture the multi-channel audio signal captured by the microphone.

[0009] The microphone profile of at least one microphone caused to capture the multi-channel audio signal captured by the microphone may include at least one of: an omnidirectional microphone profile; a subcardoid directional microphone profile; a cardioid directional microphone profile; a hypercardoid directional microphone profile; a supercardoid directional microphone profile; a shotgun directional microphone profile; a figure-8 / midside directional microphone profile; and a boundary directional microphone profile.

[0010] The means for defining at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a characteristic associated with the particular microphone profile.

[0011] The characteristic associated with the particular microphone profile may include at least one of: a distance between at least two microphones of the microphone array; and a direction of the at least one microphone in the microphone array.

[0012] When the particular type of audio signal is a binaural audio signal, the characteristic associated with the particular type of audio signal may include identifying a head related transfer function.

[0013] The means for defining at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a direction associated with the head related transfer function.

[0014] When the particular type of audio signal is a spatially processed audio signal, the characteristic associated with the particular type of audio signal may include identifying parameters for identifying processing variables to assist in the rendering.

[0015] The parameters identifying processing variables to assist in the rendering may include at least one of: beamforming applied to at least two captured audio signals to form the multi-channel audio signal; processing variables applied to at least two captured audio signals to form the multi-channel audio signal; an indicator identifying possible audio rendering signal processing variables that can be selected by the decoder; left-right side focusing; front-rear focusing; noise suppression-residual noise signal; target tracking-remainder signal; main-residual signal; source 1-source 2 signal; and beam 1-beam 2 signal.

[0016] The means for defining at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a focus amount associated with the processing variable.

[0017] When the specific type of audio signal is an Atmos audio signal, the characteristic associated with the specific type of audio signal may include identifying a format of the Atmos audio signal.

[0018] The parameter identifying the format of the Atmos audio signal may include at least one of: an A-format identifier; a B-format identifier; a four-quadrant identifier; and a head transfer function identifier.

[0019] The module for defining at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe the characteristics of the multi-channel audio signal may include at least one third field configured to identify a normalization associated with the panoramic sound audio signal, wherein the normalization includes at least one of the following: B-format normalization; SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D / SN2D normalization.

[0020] The module may be further configured to send the at least one parameter field associated with the input multi-channel audio signal to a renderer for rendering the multi-channel audio signal.

[0021] The means may further be for receiving a user input, wherein the means for defining at least one parameter field associated with the input multi-channel audio signal may be based on the user input.

[0022] The means for defining at least one parameter field associated with the input multi-channel audio signal may be further operable to define the at least one parameter field as a determined default value in the absence of user input based on the user input.

[0023] The at least one spatial audio parameter may include a direction and an energy ratio of at least two frequency bands of the multi-channel audio signal.

[0024] According to a second aspect, an apparatus is provided, comprising means for receiving at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; receiving at least one spatial audio parameter; determining the multi-channel audio signal; and processing the multi-channel audio signal based on the at least one spatial audio parameter and the at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0025] The at least one parameter field associated with the multi-channel audio signal may include at least one first field configured to identify the multi-channel audio signal as a particular type of audio signal.

[0026] The specific type of audio signal may include at least one of: a multi-channel audio signal captured by a microphone; a binaural audio signal; a signal-processed audio signal; an enhanced signal-processed audio signal; a noise-suppressed signal-processed audio signal; a source-separated signal-processed audio signal; a source-tracking signal-processed audio signal; an advanced signal-processed audio signal; a spatially processed audio signal; and an ambient sound audio signal.

[0027] The at least one parameter field associated with the multi-channel audio signal may include at least one second field configured to identify a characteristic associated with the particular type of audio signal.

[0028] When the specific type of audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the specific type of audio signal may include one of the following:

[0029] identifying a microphone profile of at least one microphone in the microphone array that is caused to capture a multi-channel audio signal captured by the microphone;

[0030] identifying a configuration of the microphone array that is caused to capture a multi-channel audio signal captured by the microphone; and

[0031] Positions and / or arrangements of at least two microphones within the microphone array that are caused to capture a multi-channel audio signal captured by the microphones are identified.

[0032] The microphone profile of at least one microphone caused to capture the multi-channel audio signal captured by the microphone may include at least one of: an omnidirectional microphone profile; a sub-cardioid directional microphone profile; a cardioid directional microphone profile; a hypercardioid directional microphone profile; a supercardioid directional microphone profile; a short shot directional microphone profile; a figure-8 / mid-side directional microphone profile; and a boundary directional microphone profile.

[0033] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify characteristics associated with the particular microphone profile.

[0034] The characteristic associated with the particular microphone profile may include at least one of: a distance between at least two microphones of the microphone array; and a direction of the at least one microphone in the microphone array.

[0035] When the particular type of audio signal is a binaural audio signal, the characteristic associated with the particular type of audio signal may include identifying a head related transfer function.

[0036] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify a direction associated with the head related transfer function.

[0037] When the particular type of audio signal is a spatially processed audio signal, the characteristics associated with the particular type of audio signal may include parameters identifying processing variables to assist in the rendering.

[0038] The parameters identifying processing variables to assist in the rendering may include at least one of: beamforming applied to at least two captured audio signals to form the multi-channel audio signal; processing variables applied to at least two captured audio signals to form the multi-channel audio signal; indicators identifying possible audio rendering signal processing variables that can be selected by the decoder; left-right side focusing; front-rear focusing; noise suppression-residual noise signal; target tracking-residual signal; main-residual signal; source 1-source 2 signal; and beam 1-beam 2 signal.

[0039] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify an amount of focus associated with the processing variable.

[0040] When the specific type of audio signal is an Atmos audio signal, the characteristic associated with the specific type of audio signal may include identifying a format of the Atmos audio signal.

[0041] The parameter identifying the format of the Atmos audio signal may include at least one of: an A-format identifier; a B-format identifier; a four-quadrant identifier; and a head transfer function identifier.

[0042] The at least one parameter field may include at least one third field configured to identify normalization associated with the stereo reverberation audio signal, wherein the normalization includes at least one of: B-format normalization; SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D / SN2D normalization.

[0043] The module may be further for receiving user input, wherein the module for processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal may be further based on the user input.

[0044] The module for processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal may also be configured to define the at least one parameter field as a determined default value in the absence of user input.

[0045] According to a third aspect, a device is provided, the device comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code being configured to, together with the at least one processor, cause the device to at least: define at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determine at least one spatial audio parameter associated with the multi-channel audio signal; and control rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0046] The apparatus caused to define at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe characteristics of the multi-channel audio signal may include at least one first field configured to identify the multi-channel audio signal as a specific type of audio signal.

[0047] The specific type of audio signal may include at least one of: a multi-channel audio signal captured by a microphone; a binaural audio signal; a signal-processed audio signal; an enhanced signal-processed audio signal; a noise-suppressed signal-processed audio signal; a source-separated signal-processed audio signal; a source-tracking signal-processed audio signal; a spatially processed audio signal; an advanced signal-processed audio signal; and an ambient sound audio signal.

[0048] The apparatus caused to define at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one second field configured to identify a characteristic associated with the specific type of audio signal.

[0049] When the specific type of audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the specific type of audio signal may include one of: identifying a microphone profile of at least one microphone in a microphone array that is caused to capture the multi-channel audio signal captured by the microphone; identifying a configuration of the microphone array that is caused to capture the multi-channel audio signal captured by the microphone; and identifying the position and / or arrangement of at least two microphones within the microphone array that is caused to capture the multi-channel audio signal captured by the microphone.

[0050] The microphone profile of at least one microphone caused to capture the multi-channel audio signal captured by the microphone may include at least one of: an omnidirectional microphone profile; a sub-cardioid directional microphone profile; a cardioid directional microphone profile; a hypercardioid directional microphone profile; a supercardioid directional microphone profile; a short shot directional microphone profile; a figure-8 / mid-side directional microphone profile; and a boundary directional microphone profile.

[0051] The apparatus caused to define at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a characteristic associated with the specific microphone profile.

[0052] The characteristic associated with the particular microphone profile may include at least one of: a distance between at least two microphones of the microphone array; and a direction of the at least one microphone in the microphone array.

[0053] When the particular type of audio signal is a binaural audio signal, the characteristic associated with the particular type of audio signal may include identifying a head related transfer function.

[0054] The apparatus caused to define at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a direction associated with the head related transfer function.

[0055] When the particular type of audio signal is a spatially processed audio signal, the characteristic associated with the particular type of audio signal may include identifying parameters for identifying processing variables to assist in the rendering.

[0056] The parameters for identifying processing variables to assist in the rendering may include at least one of: beamforming applied to at least two captured audio signals to form the multi-channel audio signal; processing variables applied to at least two captured audio signals to form the multi-channel audio signal; an indicator identifying possible audio rendering signal processing variables that can be selected by the decoder; left-right side focusing; front-rear focusing; noise suppression-residual noise signal; target tracking-residual signal; main-residual signal; source 1-source 2 signal; and beam 1-beam 2 signal.

[0057] The device caused to define at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a focus amount associated with the processing variable.

[0058] When the specific type of audio signal is an Atmos audio signal, the characteristic associated with the specific type of audio signal may include identifying a format of the Atmos audio signal.

[0059] The parameter identifying the format of the Atmos audio signal may include at least one of: an A-format identifier; a B-format identifier; a four-quadrant identifier; and a head transfer function identifier.

[0060] The device is caused to define at least one parameter field associated with the multi-channel audio signal, the at least one parameter field configured to describe the characteristics of the multi-channel audio signal may include at least one third field configured to identify normalization associated with the panoramic sound audio signal, wherein the normalization includes at least one of the following: B-format normalization; SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D / SN2D normalization.

[0061] The apparatus may be further caused to send the at least one parameter field associated with the input multi-channel audio signal to a renderer for rendering the multi-channel audio signal.

[0062] The apparatus may further be caused to receive a user input, wherein the means for defining at least one parameter field associated with the input multi-channel audio signal may be based on the user input.

[0063] The means caused to define at least one parameter field associated with the multi-channel audio signal may be further operable, based on the user input, to define the at least one parameter field as a determined default value in the absence of user input.

[0064] The at least one spatial audio parameter may include a direction and an energy ratio of at least two frequency bands of the multi-channel audio signal.

[0065] According to a fourth aspect, a device is provided, comprising at least one processor and at least one memory comprising computer program code, wherein the at least one memory and the computer program code are configured to, together with the at least one processor, cause the device to at least: receive at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; receive at least one spatial audio parameter; determine the multi-channel audio signal; and process the multi-channel audio signal based on the at least one spatial audio parameter and the at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0066] The at least one parameter field associated with the multi-channel audio signal may include at least one first field configured to identify the multi-channel audio signal as a particular type of audio signal.

[0067] The specific type of audio signal may include at least one of: a multi-channel audio signal captured by a microphone; a binaural audio signal; a signal-processed audio signal; an enhanced signal-processed audio signal; a noise-suppressed signal-processed audio signal; a source-separated signal-processed audio signal; a source-tracking signal-processed audio signal; an advanced signal-processed audio signal; a spatially processed audio signal; and an ambient sound audio signal.

[0068] The at least one parameter field associated with the multi-channel audio signal may include at least one second field configured to identify a characteristic associated with the particular type of audio signal.

[0069] When the specific type of audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the specific type of audio signal may include one of: identifying a microphone profile of at least one microphone in a microphone array that is caused to capture the multi-channel audio signal captured by the microphone; identifying a configuration of the microphone array that is caused to capture the multi-channel audio signal captured by the microphone; and identifying the position and / or arrangement of at least two microphones within the microphone array that is caused to capture the multi-channel audio signal captured by the microphone.

[0070] The microphone profile of at least one microphone caused to capture the multi-channel audio signal captured by the microphone may include at least one of: an omnidirectional microphone profile; a sub-cardioid directional microphone profile; a cardioid directional microphone profile; a hypercardioid directional microphone profile; a supercardioid directional microphone profile; a short shot directional microphone profile; a figure-8 / mid-side directional microphone profile; and a boundary directional microphone profile.

[0071] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify characteristics associated with the particular microphone profile.

[0072] The characteristic associated with the particular microphone profile may include at least one of: a distance between at least two microphones of the microphone array; and a direction of the at least one microphone in the microphone array.

[0073] When the particular type of audio signal is a binaural audio signal, the characteristic associated with the particular type of audio signal may include identifying a head related transfer function.

[0074] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify a direction associated with the head related transfer function.

[0075] When the particular type of audio signal is a spatially processed audio signal, the characteristics associated with the particular type of audio signal may include parameters identifying processing variables to assist in the rendering.

[0076] The parameters identifying processing variables to assist in the rendering may include at least one of: beamforming applied to at least two captured audio signals to form the multi-channel audio signal; processing variables applied to at least two captured audio signals to form the multi-channel audio signal; indicators identifying possible audio rendering signal processing variables that can be selected by the decoder; left-right side focusing; front-rear focusing; noise suppression-residual noise signal; target tracking-residual signal; main-residual signal; source 1-source 2 signal; and beam 1-beam 2 signal.

[0077] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify an amount of focus associated with the processing variable.

[0078] When the specific type of audio signal is an Atmos audio signal, the characteristic associated with the specific type of audio signal may include identifying a format of the Atmos audio signal.

[0079] The parameter identifying the format of the Atmos audio signal may include at least one of: an A-format identifier; a B-format identifier; a four-quadrant identifier; and a head transfer function identifier.

[0080] The at least one parameter field may include at least one third field configured to identify normalization associated with the panoramic audio signal, wherein the normalization includes at least one of: B-format normalization; SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D / SN2D normalization.

[0081] The apparatus may be further caused to receive a user input, wherein the apparatus being caused to process the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal may be further based on the user input.

[0082] The apparatus caused to process the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal may be further caused to define the at least one parameter field as a determined default value in the absence of user input.

[0083] According to a fifth aspect, a method is provided, the method comprising: defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; and controlling rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0084] At least one parameter field associated with the multi-channel audio signal is defined, the at least one parameter field configured to describe characteristics of the multi-channel audio signal may include at least one first field configured to identify the multi-channel audio signal as a specific type of audio signal.

[0085] The specific type of audio signal may include at least one of: a multi-channel audio signal captured by a microphone; a binaural audio signal; a signal-processed audio signal; an enhanced signal-processed audio signal; a noise-suppressed signal-processed audio signal; a source-separated signal-processed audio signal; a source-tracking signal-processed audio signal; a spatially processed audio signal; an advanced signal-processed audio signal; and an ambient sound audio signal.

[0086] At least one parameter field associated with the multi-channel audio signal is defined, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one second field configured to identify a characteristic associated with the particular type of audio signal.

[0087] When the specific type of audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the specific type of audio signal may include one of: identifying a microphone profile of at least one microphone in a microphone array that is caused to capture the multi-channel audio signal captured by the microphone; identifying a configuration of the microphone array that is caused to capture the multi-channel audio signal captured by the microphone; and identifying the position and / or arrangement of at least two microphones within the microphone array that is caused to capture the multi-channel audio signal captured by the microphone.

[0088] The microphone profile of at least one microphone caused to capture the multi-channel audio signal captured by the microphone may include at least one of: an omnidirectional microphone profile; a sub-cardioid directional microphone profile; a cardioid directional microphone profile; a hypercardioid directional microphone profile; a supercardioid directional microphone profile; a short shot directional microphone profile; a figure-8 / mid-side directional microphone profile; and a boundary directional microphone profile.

[0089] At least one parameter field associated with the multi-channel audio signal is defined, the at least one parameter field configured to describe characteristics of the multi-channel audio signal may include at least one third field configured to identify characteristics associated with the particular microphone profile.

[0090] The characteristic associated with the particular microphone profile may include at least one of: a distance between at least two microphones of the microphone array; and a direction of the at least one microphone in the microphone array.

[0091] When the particular type of audio signal is a binaural audio signal, the characteristic associated with the particular type of audio signal may include identifying a head related transfer function.

[0092] At least one parameter field associated with the multi-channel audio signal is defined, the at least one parameter field configured to describe a characteristic of the multi-channel audio signal may include at least one third field configured to identify a direction associated with the head related transfer function.

[0093] When the particular type of audio signal is a spatially processed audio signal, the characteristic associated with the particular type of audio signal may include identifying parameters for identifying processing variables to assist in the rendering.

[0094] The parameters identifying processing variables to assist in the rendering may include at least one of: beamforming applied to at least two captured audio signals to form the multi-channel audio signal; processing variables applied to at least two captured audio signals to form the multi-channel audio signal; indicators identifying possible audio rendering signal processing variables that can be selected by the decoder; left-right side focusing; front-rear focusing; noise suppression-residual noise signal; target tracking-residual signal; main-residual signal; source 1-source 2 signal; and beam 1-beam 2 signal.

[0095] At least one parameter field associated with the multi-channel audio signal is defined, the at least one parameter field configured to describe characteristics of the multi-channel audio signal may include at least one third field configured to identify a focus amount associated with the processing variable.

[0096] When the specific type of audio signal is an Atmos audio signal, the characteristic associated with the specific type of audio signal may include identifying a format of the Atmos audio signal.

[0097] The parameter identifying the format of the Atmos audio signal may include at least one of: an A-format identifier; a B-format identifier; a four-quadrant identifier; and a head transfer function identifier.

[0098] At least one parameter field associated with the multi-channel audio signal is defined, and the at least one parameter field configured to describe the characteristics of the multi-channel audio signal may include at least one third field configured to identify normalization associated with the panoramic sound audio signal, wherein the normalization includes at least one of the following: B-format normalization; SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D / SN2D normalization.

[0099] The method may further comprise sending the at least one parameter field associated with the input multi-channel audio signal to a renderer to render the multi-channel audio signal.

[0100] The method may further comprise receiving a user input, wherein defining at least one parameter field associated with the input multi-channel audio signal may be based on the user input.

[0101] Defining at least one parameter field associated with the input multi-channel audio signal may be based on the user input, further for defining the at least one parameter field as a determined default value in the absence of user input.

[0102] The at least one spatial audio parameter may include a direction and an energy ratio of at least two frequency bands of the multi-channel audio signal.

[0103] According to a sixth aspect, a method is provided, comprising: receiving at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; receiving at least one spatial audio parameter; determining the multi-channel audio signal; and processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0104] The at least one parameter field associated with the multi-channel audio signal may include at least one first field configured to identify the multi-channel audio signal as a particular type of audio signal.

[0105] The specific type of audio signal may include at least one of: a multi-channel audio signal captured by a microphone; a binaural audio signal; a signal-processed audio signal; an enhanced signal-processed audio signal; a noise-suppressed signal-processed audio signal; a source-separated signal-processed audio signal; a source-tracking signal-processed audio signal; an advanced signal-processed audio signal; a spatially processed audio signal; and an ambient sound audio signal.

[0106] The at least one parameter field associated with the multi-channel audio signal may include at least one second field configured to identify a characteristic associated with the particular type of audio signal.

[0107] When the specific type of audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the specific type of audio signal may include one of: identifying a microphone profile of at least one microphone in a microphone array that is caused to capture the multi-channel audio signal captured by the microphone; identifying a configuration of the microphone array that is caused to capture the multi-channel audio signal captured by the microphone; and identifying the position and / or arrangement of at least two microphones within the microphone array that is caused to capture the multi-channel audio signal captured by the microphone.

[0108] The microphone profile of at least one microphone caused to capture the multi-channel audio signal captured by the microphone may include at least one of: an omnidirectional microphone profile; a sub-cardioid directional microphone profile; a cardioid directional microphone profile; a hypercardioid directional microphone profile; a supercardioid directional microphone profile; a shotgun directional microphone profile; a figure-8 / mid-side directional microphone profile; and a boundary directional microphone profile.

[0109] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify characteristics associated with the particular microphone profile.

[0110] The characteristic associated with the particular microphone profile may include at least one of: a distance between at least two microphones of the microphone array; and a direction of the at least one microphone in the microphone array.

[0111] When the particular type of audio signal is a binaural audio signal, the characteristic associated with the particular type of audio signal may include identifying a head related transfer function.

[0112] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify a direction associated with the head related transfer function.

[0113] When the particular type of audio signal is a spatially processed audio signal, the characteristics associated with the particular type of audio signal may include parameters identifying processing variables to assist in the rendering.

[0114] The parameters identifying processing variables to assist in the rendering may include at least one of: beamforming applied to at least two captured audio signals to form the multi-channel audio signal; processing variables applied to at least two captured audio signals to form the multi-channel audio signal; indicators identifying possible audio rendering signal processing variables that can be selected by the decoder; left-right side focusing; front-rear focusing; noise suppression-residual noise signal; target tracking-residual signal; main-residual signal; source 1-source 2 signal; and beam 1-beam 2 signal.

[0115] The at least one parameter field associated with the multi-channel audio signal may include at least one third field configured to identify an amount of focus associated with the processing variable.

[0116] When the specific type of audio signal is a panoramic audio signal, the characteristic associated with the specific type of audio signal may include a format of the panoramic audio signal.

[0117] The parameter identifying the format of the Atmos audio signal may include at least one of: an A-format identifier; a B-format identifier; a four-quadrant identifier; and a head transfer function identifier.

[0118] The at least one parameter field may include at least one third field configured to identify normalization associated with the panoramic audio signal, wherein the normalization includes at least one of: B-format normalization; SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D / SN2D normalization.

[0119] The method may further include receiving user input, wherein processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal may be further based on the user input.

[0120] Processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal may also be used to define the at least one parameter field as a determined default value in the absence of user input.

[0121] According to a seventh aspect, there is provided a computer program [or a computer-readable medium comprising program instructions], the instructions being used to cause an apparatus to perform at least the following operations: define at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determine at least one spatial audio parameter associated with the multi-channel audio signal; and control rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0122] According to an eighth aspect, there is provided a computer program comprising instructions [or a computer-readable medium comprising program instructions], the instructions being used to cause an apparatus to perform at least the following operations: receive at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; receive at least one spatial audio parameter; determine the multi-channel audio signal; and process the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0123] According to a ninth aspect, a non-transitory computer-readable medium is provided, comprising program instructions for causing an apparatus to perform at least the following operations: defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; and controlling rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0124] According to a tenth aspect, a non-transitory computer-readable medium is provided, comprising program instructions for causing an apparatus to perform at least the following operations: receiving at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; receiving at least one spatial audio parameter; determining the multi-channel audio signal; and processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0125] According to an eleventh aspect, a device is provided, comprising: a definition circuit configured to define at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; a determination circuit configured to determine at least one spatial audio parameter associated with the multi-channel audio signal; and a control circuit configured to control rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0126] According to the twelfth aspect, a device is provided, comprising: a receiving circuit configured to receive at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; a receiving circuit configured to receive at least one spatial audio parameter; a determining circuit configured to determine the multi-channel audio signal; and a processing circuit configured to process the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0127] According to a thirteenth aspect, a computer-readable medium is provided, comprising program instructions for causing an apparatus to perform at least the following operations: defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; and controlling rendering of the multi-channel audio signal by processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter.

[0128] According to a fourteenth aspect, a computer-readable medium is provided, comprising program instructions for causing an apparatus to perform at least the following operations: receiving at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe characteristics of the multi-channel audio signal; receiving at least one spatial audio parameter; determining the multi-channel audio signal; and processing the multi-channel audio signal based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to assist in rendering the multi-channel audio signal.

[0129] An apparatus comprises modules for performing the actions of the method as described above.

[0130] An apparatus configured to perform the actions of the method as described above.

[0131] A computer program includes program instructions for causing a computer to execute the method described above.

[0132] A computer program product stored on a medium may cause an apparatus to perform the method described herein.

[0133] An electronic device may include an apparatus as described herein.

[0134] A chipset may include the apparatus as described herein.

[0135] The embodiments of the present application are intended to solve the problems associated with the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0136] For a better understanding of the present application, reference will now be made by way of example to the accompanying drawings, in which:

[0137] Figure 1 A system of apparatus suitable for implementing some embodiments is schematically shown;

[0138] Figure 2 According to some embodiments, Figure 1 A flowchart of the operation of the system shown;

[0139] Figures 3a to 3g shows a focus configuration suitable for indication in some embodiments;

[0140] Figure 4 shows a flow chart of processing operations according to some embodiments;

[0141] Figure 5 A flow chart illustrating a synthesis operation according to some embodiments; and

[0142] Figure 6 An example device suitable for implementing the means described herein is schematically illustrated. DETAILED DESCRIPTION

[0143] Suitable apparatus and possible mechanisms for providing efficient spatial analysis-derived metadata parameters for microphone array input format audio signals are described in further detail below.

[0144] The concepts expressed in the examples below are implementations of appropriate parameters for assisting in describing an audio system defined by spatial metadata.

[0145] about Figure 1 , shows an example device and system for implementing an embodiment of the present application. The system 100 is shown to have an "analysis" part 121 and a "synthesis" part 131. The "analysis" part 121 is the part from receiving the microphone array audio signal until encoding the metadata and the transmission signal, and the "synthesis" part 131 is the part from decoding the encoded metadata and the transmission signal to presenting the regenerated signal (for example, in the form of a multi-channel speaker).

[0146] The input to the system 100 and the "analysis" part 121 is the input channel audio signals 102. These can be any suitable input multi-channel audio signals, such as microphone array audio signals, ambisonic audio signals, spatial multi-channel audio signals. In the following examples, the input is generated by a suitable microphone array, but it will be appreciated that in some other embodiments, other multi-channel input audio formats may be employed in a similar manner. The microphone array audio signals may be obtained from any suitable capture device and may be local or remote to the example apparatus, or may be a virtual microphone recording obtained from, for example, a speaker signal. For example, in some embodiments, the analysis part 121 is integrated on a suitable capture device.

[0147] The microphone array audio signal is passed to the transmission signal generator 103 and the analysis processor 105 .

[0148] In some embodiments, the transmission signal generator 103 is configured to receive the microphone array audio signal and generate a suitable transmission signal 104. The transmission audio signal may also be referred to as an associated audio signal, and is based on a spatial audio signal containing directional information of a sound field and input into the system. For example, in some embodiments, the transmission signal generator 103 is configured to downmix or otherwise select or combine the microphone array audio signal to a determined number of channels, for example, by beamforming technology, and output them as a transmission signal 104. The transmission signal generator 103 may be configured to generate a 2-audio channel output of the microphone array audio signal. The determined number of channels may be two or any suitable number of channels. In some embodiments, the transmission signal generator 103 is optional, and the microphone array audio signal is passed to the encoder without processing in the same manner as the transmission signal. In some embodiments, the transmission signal generator 103 is configured to select one or more microphone audio signals and output the selection as a transmission signal 104. In some embodiments, the transmission signal generator 103 is configured to apply any suitable encoding or quantization to the microphone array audio signal or the processed or selected form of the microphone array audio signal.

[0149] In some embodiments, the analysis processor 105 is also configured to receive the microphone array audio signal and analyze the signal to generate metadata 106 associated with the microphone array audio signal and therefore associated with the transmission signal 104. The analysis processor 105 can be, for example, a computer (running suitable software stored on a memory and at least one processor), or alternatively a specific device utilizing, for example, an FPGA or ASIC. As shown in more detail herein, the metadata can include, for each time-frequency analysis interval, a directional parameter 108, an energy ratio parameter 110, a surround coherence parameter 112, and an extended coherence parameter 114. The directional parameters and the energy ratio parameters can be considered to be spatial audio parameters in some embodiments. In other words, the spatial audio parameters include parameters intended to characterize the sound field captured by the microphone array audio signal.

[0150] In some embodiments, the parameters generated may differ between frequency bands and may depend in particular on the transmission bit rate. Thus, for example, in frequency band X all parameters are generated and transmitted, while in frequency band Y only one parameter is generated and transmitted, and furthermore in frequency band Z no parameters are generated or transmitted. A practical example may be that for certain frequency bands, e.g. the highest frequency band, certain parameters are not required for perceptual reasons. The transmission signal 104 and the metadata 106 may be transmitted or stored, which may be Figure 1107. Before the transport signal 104 and metadata 106 are sent or stored, they are usually encoded to reduce the bit rate and multiplexed into a stream. Any suitable scheme can be used to achieve encoding and multiplexing.

[0151] On the decoder side, the received or retrieved data (stream) can be demultiplexed and the encoded stream can be decoded to obtain the transmission signal and metadata. Figure 1 Such reception or retrieval of transmission signals and metadata is also shown in FIG. 1 relative to the right hand side of the dashed line 107 .

[0152] The "Synthesis" portion 131 of the system 100 shows a synthesis processor 109, which is configured to receive the transmission signal 104 and the metadata 106 and create a suitable multi-channel audio signal output 116 based on the transmission signal 104 and the metadata 106 (which can be any suitable output format, such as binaural, multi-channel speaker or panoramic sound signal, depending on the use case). In certain embodiments with speaker reproduction, the actual physical sound field with the desired perceptual characteristics is reproduced (using the speakers). In other embodiments, the reproduction of the sound field can be understood to refer to the reproduction of the perceptual characteristics of the sound field by other means other than reproducing the actual physical sound field in space. For example, the desired perceptual characteristics of the sound field can be reproduced on headphones using the binaural reproduction method described herein. In another example, the perceptual characteristics of the sound field can be reproduced as panoramic sound output signals, and these panoramic sound signals can be reproduced by a panoramic sound decoding method to provide, for example, a binaural output with the desired perceptual characteristics.

[0153] In some embodiments, the synthesis processor 109 may be a computer (running suitable software stored on a memory and at least one processor), or alternatively a specific device utilizing, for example, an FPGA or ASIC.

[0154] about Figure 2 , showing Figure 1 An example flow chart of the overview shown.

[0155] First, the system (analysis part) is configured to receive microphone array audio signals or suitable multi-channel inputs, such as Figure 2 As shown in step 201.

[0156] The system (analysis part) is then configured to generate a transmission signal channel or transmission signal (e.g., based on downmixing / selection / beamforming of the multi-channel input audio signal), such as Figure 2 As shown in step 203.

[0157] The system (analysis part) is also configured to analyze the audio signal to generate metadata: direction; energy ratio (and other metadata in some embodiments, such as surround coherence; extended coherence), such as Figure 2 As shown in step 205.

[0158] The system is then configured to (optionally) encode the transmission signal and metadata with coherence parameters for storage / transmission, such as Figure 2 As shown in step 207.

[0159] Thereafter, the system can store / send the transmission signal and metadata with coherence parameters, such as Figure 2 As shown in step 209.

[0160] The system can retrieve / receive the transmission signal and metadata with coherence parameters, such as Figure 2 As shown in step 211.

[0161] Then, the system is configured to extract from the transmission signal and metadata with coherence parameters, such as Figure 2 As shown in step 213.

[0162] The system (synthesis part) is configured to synthesize an output spatial audio signal (which, as previously discussed, may be any suitable output format, such as binaural, multi-channel speaker or panoramic sound signal, depending on the use case) based on the extracted audio signal and the metadata with coherence parameters, such as Figure 2 As shown in step 215.

[0163] In some embodiments, the metadata format for each frame may be as follows.

[0164]

[0165]

[0166] The "Configuration" data field may remain stable over some frames (typically thousands of frames). This field may be fixed for the duration of the spatial audio file / call, although in some examples it may be adapted more frequently. Thus, the Configuration field is only sent to the receiver infrequently, e.g., only when it changes. In some embodiments, the "Configuration" field information may not be sent to the receiver at all. Instead, it may be used to at least partially drive encoding mode selection in the encoder. Thus, in these embodiments, the "Configuration" field value may affect the type of encoding performed and / or the type of rendering effect targeted.

[0167] In further embodiments, receiving user input from a user or, for example, a receiver rendering mode selection may result in a mode selection request being transmitted to the sending device / encoder via in-band or out-of-band signaling. This may affect the encoding mode selection, which may depend at least in part on the "Configuration" field.

[0168] In the following embodiments, the encoder 107 is configured to encode an audio signal in a channel + spatial metadata mode. In some embodiments, the encoder 107 receives pulse code modulation (PCM) audio configured in mono, stereo, or multi-channel (first-order panoramic sound (FOA) or channel-based or HOA such as HOA transmission format (HTF)) and accompanying spatial metadata as input. The spatial metadata consists of the sound source direction (azimuth and elevation, or other coordinate systems), diffuse-to-total energy ratio or direct total energy ratio and additional parameters (such as extension and surround coherence), and the sound source distance for each frequency band.

[0169] This implementation can yield perceived performance benefits in the following examples, where multiple source directions can be assigned for each frequency band. This is also advantageous for higher bit rates when high quality is required for even the most difficult audio scenarios (e.g. overlapping speakers in a noisy environment).

[0170] As described below, the concept is that in addition to directional metadata, there is metadata describing the channel portion of the audio representation. The channel audio may include direct microphone signals, or some processed version of that audio, such as a binaural rendered stereo signal or a synthesized FOA or multichannel signal. Furthermore, even in the case of direct microphone signals, there are multiple possibilities, such as omnidirectional / cardioid / figure-of-8 microphone capture implementations. Because, for example, a cardioid is directional, it has an inherent direction that should be known for optimal rendering. There are benefits at the rendering stage if the configuration of the channel data is well known. This enables, for example, different rendering parameters to be identified in omnidirectional stereo and cardioid captured stereo.

[0171] The concepts discussed below can be embodied in a mechanism for carrying spatial audio signals in the channels portion of a metadata format by inserting detailed information in a "configuration" field, which enables the use of advanced audio effects such as focus, noise suppression, tracking and mixing as part of the encoding framework as efficiently as possible.

[0172] In some embodiments, the channel portion of the spatial audio signal may contain audio that does not itself include spatial information (i.e., it does not contain spatial cues such as its direction of arrival). In some embodiments, the spatial cues may be represented and stored / transmitted purely by spatial metadata. In some embodiments, there may also be some spatial cues in the audio signal. For example, by comparing the time difference between the two transmitted channels (left and right), it may be possible to detect that a sound is further to the left.

[0173] This potential or partial separation between spatial cues and audio signals allows the signals to actually carry other aspects or information on the audio, such as focus, audio scaling or noise cancellation. The channel signals can therefore contain other auditory aspects, such as separate front / rear focus signals or primary / secondary signals or noise suppressed / residual background signals or noise suppressed / non-noise suppressed signals. When the renderer determines the channel configuration, it can process the channel signals correctly and can render spatial audio, while allowing adjustment of the front / rear ratio, primary / secondary balance, clean signal / noise ratio or source 1 / source 2 mix based on user preferences.

[0174] In some embodiments where there is no user preference or no preference is set, a default configuration is used. In some embodiments, the default value may be configured to produce a signal similar to an unprocessed captured signal. In some other embodiments, the default setting may be to generate a noise-suppressed audio signal.

[0175] As various aspects or embodiments, there may also be options that may be sent or stored within a "Configuration" field.

[0176] A range of various applications that can be identified in the configuration field are:

[0177] 1. Front / rear enhanced signal situation

[0178] In some embodiments, for example Figure 3aAs shown in , the configuration field can be used to indicate that the audio signal includes a first channel (channel 1) and a second channel (channel 2), rather than a "traditional" left and right audio channel combination, wherein the first channel (channel 1) contains a signal captured from a forward direction (relative to a first direction 300 of the capture device 301, which is usually consistent with the main camera or auxiliary camera field of view), and the second channel (channel 2) contains a signal captured from a backward direction (relative to a second direction 302 of the capture device 301, which is opposite to the first direction). This information can be received on the decoder side to correctly render spatial audio. In addition, using the knowledge of the signal content of the channels, it is possible to emphasize, for example, the front direction or the rear direction or render a spatial image based on user needs. In some embodiments, this indication can be used to enable the rendering of a balanced representation. In some embodiments, the front / rear signal can be stereo, so the amount of the channel signal is 2*stereo for a total of 4 channels. This will achieve higher audio quality than using only two mono signals.

[0179] 2. Noise suppression / residual signal enhancement

[0180] Another way to define channel signals is to send a noise suppression signal and residual noise in channels 1 and 2, respectively. These signals can be combined in the decoder to render a relatively clean main signal, or alternatively the main signal can be ignored and the surrounding environment can be listened to instead. In some embodiments, the signals are combined and a balanced audio (original detection) signal can be rendered. In addition, in some embodiments, the amount of noise suppression can be sent. The amount of noise suppression can vary from frame to frame, and this can be used in advanced rendering to further enhance the rendered signal. In a similar manner to the front / rear enhancement, there can be 2 stereo channels instead of two mono signals for a total of 4 channels.

[0181] 3. Object tracking / residual signal enhancement

[0182] In some embodiments, a single speaker or sound source may be extracted from the audio scene. The sound source may be moved relative to the scene. The audio source may be sent as a first channel in a spatial parameter-encoded audio signal. When the sound source is removed from the audio scene, a second channel may be used to carry a residual signal. At the decoder, when the signals are added together, the original detected sound scene may be rendered. In some embodiments, and based on user or other control inputs, the balance between the separated sound source and the residual signal may be adjusted. In some embodiments, there may be two stereo channels instead of two mono signals.

[0183] 4. Main signal / residual signal

[0184] In some embodiments, microphones and signal processing may be used to extract (sound separation) two different scenes from the audio signal. For example, when using mobile capture to capture a live concert performance, the artist performance from the speakers can be isolated from the audience noise. The two streams can be stored and sent separately. At the renderer, when listening to spatial audio, user or other controls can be used to balance the mix of the two streams.

[0185] 5. Source 1 / Source 2

[0186] In some embodiments, scenarios such as voice conferencing and coding domain audio mixing can benefit from the possibility to send two separate channel audio streams with a unified or two separate sets of spatial parameters. The two streams can be stored and sent separately. At the renderer, when listening to spatial audio, user or other controls can be used to control the balance of the two streams.

[0187] 6. Beam 1 / Beam 2

[0188] In some embodiments, microphones and signal processing algorithms may be used to track and extract (e.g., using beamforming) two different sound sources from the audio signal. For example, when capturing a live performance of a singer and guitarist via mobile capture, the singer's performance may be isolated from the guitarist. The two streams may be stored and sent separately as "channel signals." At the renderer, when listening to spatial audio, user-based or other controls may be used to control the balance of the two streams.

[0189] In some embodiments, the channel configuration field can be represented as a structured table where fields depend on previous fields. An example case with 8 bits for the configuration field is shown below. Note that the configuration field shown is only an example, and in some other embodiments, its structure and bit allocation may be different. However, in the embodiments below, the concept may be reflected in the presence of parameters for signal representation that allow advanced processing such as those described above, such as "front / rear focus", "main signal / residual signal", "noise suppression source / residual noise", "object tracking / residual signal", "main signal 1 / main signal 2"

[0190]

[0191]

[0192] Thus, concepts that will be discussed in further detail in the embodiments below are concepts related to audio encoding and decoding using sound field related parameterization (direction and ratio in frequency bands). In addition, embodiments relate to a solution that enables user-controllable effects on sound fields encoded using the above-mentioned parameterization, and wherein the user-controllable effects are achieved by: transmitting channel signal capture and processing related parameters and directional parameters; and reproducing sound based on the directional parameters, channel signal capture and processing related parameters and user preferences or user control inputs, so that the channel signal capture and processing related parameters and user preferences or user control inputs affect the sound-field synthesis using the direction and ratio in the frequency band.

[0193] In addition, in some embodiments, the renderer and user are provided with the ability to indicate which effects control processing is possible given the channel capture and processing related parameters. The renderer and / or user can then adjust how the audio is rendered, given the possibilities allowed by the channel capture and processing parameters.

[0194] In some embodiments, the channel configuration field contains detailed characteristics about the channel portion of the channel + spatial metadata. In other words, the channel configuration can be considered as metadata for the channel signal representation. Therefore, this field can contain relevant information such as what each signal channel contains, how it was captured or how it was processed, and how it should be rendered (to achieve the best quality). For example, this field can contain information such as front / rear or noise suppression / residual signal, which allows the renderer (with user controls) to perform effects such as audio scaling to the desired direction or removing unwanted signal components.

[0195] In some embodiments, the master metadata channel configuration is defined using 2 bits, as shown in the following table:

[0196]

[0197] The first option (index 0) is the scene captured by the microphone. This option describes the scene where the "channel" contains pure microphone signal and which microphone configuration is used.

[0198] The second option (index 1) is a binaural stereo scenario. The use of binauralization is that even without the aid of spatial metadata, the output produces a reasonable static spatial audio reproduction when rendered or listened to with headphones. However, with the aid of spatial metadata, head tracking can be achieved and related configuration information such as head-related transfer function (HRTF) information can be used to reliably select a personalized HRTF and better quality can be achieved.

[0199] The third option (index 2) selects a mode in which advanced operating modes such as audio zooming, object tracking, or user-adjustable noise suppression are implemented, as further described in the following examples and embodiments.

[0200] The fourth option (index 3) may be reserved for future use to provide appropriate futureproofing of signaling.

[0201] If the advanced configuration field indicates that the scene is a signal captured by a microphone, the next field identifies the microphone type using 3 bits. Example signaling of the microphone type may be as follows:

[0202] index Microphone Type Remark 0 Omnidirectional default 1 Heart Shape 2 Heart 3 High Cardioid 4 Super Cardioid 5 Short gun Far-field audio capture 6 Figure 8 / MS-Stereo Channels intersect at 90 degrees 7 Boundary The back hemisphere is blocked

[0203] For example, the first option (index 0), the omni pattern in Figure 3b , shown by microphone pattern 310. This can be considered the default type.

[0204] The second option (index 1), the sub-cardioid pattern is in Figure 3b This is shown by microphone pattern 320. In addition to omnidirectional, this is also a common type.

[0205] The third option (index 2) has a heart-shaped pattern on Figure 3b This is shown in FIG. 3 by microphone pattern 330. In addition to omnidirectional, this is also a commonly used type.

[0206] The fourth option (index 3), high cardioid pattern in Figure 3b This is shown by microphone pattern 340 .

[0207] The fifth option (index 4), a supercardioid pattern, is Figure 3b This is shown by microphone pattern 350 .

[0208] The sixth option (index 5), the short gun pattern in Figure 3b This is shown by microphone pattern 370 .

[0209] The seventh option (index 6), the figure 8 pattern in Figure 3b This is shown by microphone pattern 360 .

[0210] The eighth option (index 7), a border-style pattern, is a pattern in which half of the sphere is blocked.

[0211] A practical example of the first option (index 0) is in Figure 3c It is shown in Figure 3c The device 301 omnidirectional microphone pair 303, 305 is shown separated by a distance (eg 16 cm in the case of a mobile phone and when the microphones are at the edge of the phone).

[0212] exist Figure 3d Another practical option (index 2) is shown in Figure 3d An apparatus 301 is shown comprising a cardioid microphone pair 307, 309 pointing sideways (and capturing left and right spheres of audio).

[0213] Either omnidirectional or cardioid pairs are capable of producing high-coverage 360-degree spatial audio capture.

[0214] Figure 3e Another alternative practical microphone configuration is shown, with two cardioid microphones 311, 315 pointing in the forward direction. In this example, there is significant suppression in the backward direction. This microphone configuration is not optimal for 360-degree spatial audio. However, with this microphone configuration information, the renderer may be able to enhance the spatial performance.

[0215] Figure 3f Another example microphone configuration is shown where two cardioid microphones 317 and 319 and an omnidirectional microphone 318 are able to produce a mid-stereo configuration. The first channel contains the omnidirectional microphone 318 capture of the audio field, while the second channel contains the side information from the cardioid microphones 317 and 319. In such an embodiment, all sound arrival directions are captured. However, unlike Figure 3d and 3e The rendering process is different compared to the example shown.

[0216] Figure 3g Another practical example microphone configuration is shown, where four cardioid microphones 321, 323, 325 and 327 are capable of producing quadrant sound field capture. This arrangement allows for front / rear adjustment.

[0217] In some embodiments where the signal type is defined as processed, the next field signals or indicates processing options. The following table shows examples of processing options. In some embodiments, the default configuration is left / right focus, which is only left and right stereo with an enhanced stereo image.

[0218]

[0219]

[0220] In some embodiments of binaural stereo, there is a configuration field that describes which algorithm and HRTF are used to generate the binauralization. Since the algorithm is known, the renderer can be configured to process some parameters based on user requests. For example, in some embodiments, the renderer can be configured to change the playback equalization or the renderer HRTF to better suit the listener preference.

[0221] index HRTF Selection 0 HRTF1 default 1 HRTF2 2 HRTF3 3 HRTF4 4 HRTF.. 5 6 7

[0222] In some embodiments, additional information about the microphone locations and where they are pointing or oriented may also be embedded or signaled in the configuration field.

[0223] For example, in some embodiments, the renderer may benefit from knowledge of the direction of audio captured from a microphone having directional properties. For example, in some embodiments, the following index may be used to signal a direction or pointing direction.

[0224]

[0225] In some embodiments, three bits are used to describe the microphone type configuration. In some embodiments where more bits are used for the configuration, more details about the microphone position, beamwidth and / or direction may be provided.

[0226] In some embodiments, for omnidirectional microphones, there may be a descriptive field that signals the approximate omnidirectional microphone distance using three bits (or more if available).In some embodiments, the range axis is LR.

[0227]

[0228]

[0229] In some embodiments where the microphone is front / rear, suppressed noise / residual noise, main signal / residual, or tracked object / residual, the configuration field also includes a field indicating the estimated channel spacing in decibels. This information allows for better rendering on the renderer / decoder and enables the renderer to present the appropriate scale to the user when setting preferences.

[0230] index Processing Gain Remark 0 <3dB Weak processing 1 6dB 2 9dB 3 12dB default 4 15dB 5 18dB 6 21dB 7 >24dB Strong processing

[0231] about Figure 4 , shows a flow chart illustrating an example method according to some embodiments. When the decoder receives the capture and processing related parameters, it determines the appropriate method for synthesizing the signal based on the primary channel configuration index value, such as Figure 4 As shown in step 401.

[0232] If the primary channel configuration index value indicates a 0 index value, i.e., a signal captured by a microphone, the method proceeds to synthesize the audio output using a method dedicated to synthesizing audio with the signal captured by the microphone and the parameter metadata, such as Figure 4 As shown in step 403.

[0233] If the primary channel configuration index value indicates an index value of 1, i.e., a binaural signal, the method continues to render the HRTF-filtered audio signal, such as a binaural output suitable for headphones, such as Figure 4 As shown in step 405.

[0234] If the primary channel configuration index value indicates a 2 index value, i.e. a processed signal, the renderer / decoder may be configured to synthesize an audio output from the processed signal, such as Figure 4 As shown in step 405.

[0235] about Figure 5 , shows an example of a method for synthesizing output, where the main channel index value indicates the processed signal (as shown in the above example, the index value is 2).

[0236] The renderer / decoder 131 may be configured to first obtain the above-mentioned channel capture and processing related parameters, such as Figure 5 As shown in step 501.

[0237] Then, based on capturing and processing the relevant parameters, the renderer / decoder 131 may be configured to determine which audio effects are possible and which parameters may be controlled and the allowed control range, such as Figure 5 As shown in step 503. For example, if no capture and processing related parameters are provided, no effects can be synthesized and no controllable parameters are available. However, if the "Processing Options" field in the configuration information provides options, there may be some effects and parameter controls:

[0238] Front / Back / Focus: Having separate front and back signals enables control of the front / back ratio. This method obtains a default value that reproduces a spatial audio signal close to or identical to the unprocessed version, e.g. 0.5. This method obtains extreme values ​​for the front / back ratio, 1 for full front and 0 for full back.

[0239] Main / Residual: Having separate main and residual signals enables control of the main-to-residual ratio. The default ratio value of 0.5 reproduces a spatial audio signal close to or equivalent to the unprocessed version. This method achieves extreme values ​​of the main-to-residual ratio, with only the main signal being 1 and only the residual signal being 0.

[0240] Noise Suppression / Residual Noise: Having separate noise suppression and residual signals enables control of the noise suppression and residual ratio. The default ratio value of 0.5 reproduces a spatial audio signal close to or identical to the unprocessed version. This method achieves extreme values ​​of the noise suppression and residual ratio, with only noise suppression being 1 and only residual being 0.

[0241] Target Tracking / Residual Signal: Having separate target tracking and residual signals enables control of the target tracking and residual signal ratio. The default ratio value of 0.5 reproduces a spatial audio signal close to or identical to the unprocessed version. This method achieves extreme values ​​of the target tracking and residual signal ratio, with only the target tracking being 1 and only the residual signal being 0.

[0242] Source 1 / Source 2: The two audio sources can be combined into a single spatial audio stream by the sender or some network element (e.g., a voice conference bridge). This allows the spatial audio mixer to work with no additional latency and low computational complexity, since audio stream decoding / encoding can be omitted. Spatial metadata parameters can be combined, or two separate streams can also be received and decoded. The default ratio value of 0.5 reproduces a spatial audio signal close to or identical to the downmix. This method obtains extreme values ​​of the source selection and residual ratios, only source 1 is 1, and only source 2 is 0.

[0243] Beam 1 / Beam 2: Having separate target sources enables the control of the ratio between the sources. The default ratio value of 0.5 reproduces a spatial audio signal close to or identical to the unprocessed version. This method achieves extreme values ​​of source selection to residual ratio, 1 for beam 1 only and 0 for beam 2 only.

[0244] When the controllable audio effects, parameters, and parameter ranges are determined, they can then be depicted or displayed to the user, e.g. Figure 5 As shown in step 507.

[0245] This depiction may be through a slider or other UI control mechanism. This depiction may be through a UI graphic that depicts a visualization related to the range of the effect given a range of adjustable parameters. For example, if the effect is related to audio zooming in a particular direction, the depiction on the UI may indicate the expected virtual microphone pattern obtained using different values ​​of the zoom control parameter.

[0246] When the available effects and their control parameters are depicted to the user, the user can then make adjustments / selections with respect to the effect or parameter values. For example, the user can adjust the audio zoom.

[0247] The decoder / renderer can then determine the parameters related to the effect, either as explicit input from the user or from a generic preference. Generic preferences can be defined by the user as being related to the use case, or they can be the default selection. For example, a preference could describe always applying a certain amount of audio focus to the front when possible. Figure 5 Determining or obtaining parameters based on user input / default selection is shown by step 507 .

[0248] The decoder / renderer may then be configured to receive the channel signals and other metadata such as direction and ratio in the frequency bands, e.g. Figure 5As shown in step 509.

[0249] The decoder / renderer can then be configured to synthesize the audio signal. For audio synthesis, the method requires the received channel signal content and the direction and ratio describing the spatial metadata. Using the channel signals, the direction and ratio in the frequency bands and the provided capture and processing related parameters, the decoder / renderer then synthesizes the audio. The provided capture and processing related parameters indicate which synthesis method is selected, and the provided control parameters adjust the parameters of the synthesis, such as Figure 5 As shown in step 511.

[0250] about Figure 6 , shows an example electronic device that can be used as an analysis or synthesis device. The device can be any suitable electronic device or apparatus. For example, in some embodiments, the device 1400 is a mobile device, a user device, a tablet computer, a computer, an audio playback device, etc.

[0251] In some embodiments, device 1400 includes at least one processor or central processing unit 1407. Processor 1407 may be configured to execute various program codes, such as the methods described herein.

[0252] In some embodiments, the device 1400 includes a memory 1411. In some embodiments, at least one processor 1407 is coupled to the memory 1411. The memory 1411 can be any suitable storage module. In some embodiments, the memory 1411 includes a program code portion for storing program codes that can be implemented on the processor 1407. In addition, in some embodiments, the memory 1411 can also include a stored data portion for storing data (e.g., data processed or to be processed) according to the embodiments described herein. Whenever necessary, the implemented program code stored in the program code portion and the data stored in the stored data portion can be retrieved by the processor 1407 through the memory-processor coupling.

[0253] In some embodiments, device 1400 includes a user interface 1405. In some embodiments, user interface 1405 can be coupled to processor 1407. In some embodiments, processor 1407 can control the operation of user interface 1405 and receive input from user interface 1405. In some embodiments, user interface 1405 can enable a user to enter commands to device 1400, for example, via a keypad. In some embodiments, user interface 1405 can enable a user to obtain information from device 1400. For example, user interface 1405 can include a display configured to display information from device 1400 to a user. In some embodiments, user interface 1405 can include a touch screen or touch interface that can both enable information to be input to device 1400 and display information to a user of device 1400.

[0254] In some embodiments, the device 1400 includes an input / output port 1409. In some embodiments, the input / output port 1409 includes a transceiver. In such embodiments, the transceiver can be coupled to the processor 1407 and configured to enable communication with other devices or electronic devices, for example, via a wireless communication network. In some embodiments, the transceiver or any suitable transceiver or transmitter and / or receiver module can be configured to communicate with other electronic devices or devices via a wire or wired coupling.

[0255] The transceiver can communicate with another device via any suitable known communication protocol. For example, in some embodiments, the transceiver or transceiver module can use a suitable Universal Mobile Telecommunications System (UMTS) protocol, a wireless local area network (WLAN) protocol such as, for example, IEEE 802.X, a suitable short-range radio frequency communication protocol such as Bluetooth, or an infrared data communication path (IRDA).

[0256] The transceiver input / output port 1409 may be configured to receive the speaker signal and, in some embodiments, determine parameters as described herein by executing appropriate code using the processor 1407. In addition, the device may generate appropriate transmission signals and parameter outputs to send to a synthesis device.

[0257] In some embodiments, device 1400 may be used as at least part of a synthesis device. Thus, input / output port 1409 may be configured to receive the transmission signal and, in some embodiments, parameters determined at a capture device or processing device as described herein, and generate an appropriate audio signal format output by executing appropriate code using processor 1407. Input / output port 1409 may be coupled to any suitable audio output, such as to a multi-channel speaker system and / or headphones or the like.

[0258] As used in this application, the term "circuitry" may refer to one or more or all of the following:

[0259] (a) pure hardware circuit implementation (e.g. implementation in analog and / or digital circuits only) and

[0260] (b) a combination of hardware circuitry and software, such as (where applicable):

[0261] (i) a combination of analog and / or digital hardware circuitry and software / firmware, and

[0262] (ii) any portion of a hardware processor with software (including a digital signal processor), software and memory that work together to enable a device such as a mobile phone or server to perform various functions, and

[0263] (c) Hardware circuits and / or processors (e.g., a microprocessor or portion of a microprocessor) that require software (e.g., firmware) for operation, but that software may not be present when it is not required for operation.

[0264] This definition of circuitry applies to all uses of the term in this application, including in any claims. As another example, as used in this application, the term circuitry also covers only an implementation of a hardware circuit or processor and its (or their) accompanying software and / or firmware. The term circuitry also covers, for example and where applicable to a particular claim element, a baseband integrated circuit for a mobile device or a similar integrated circuit in a server, cellular network device, or other computing or network device.

[0265] In general, various embodiments of the present invention may be implemented in hardware or dedicated circuits, software, logic, or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device, but the present invention is not limited thereto. Although various aspects of the present invention may be shown and described as block diagrams, flow charts, or using some other graphical representation, it should be understood that the boxes, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general hardware or controllers or other computing devices, or some combination thereof as non-limiting examples.

[0266] Embodiments of the present invention can be implemented by computer software that can be executed by a data processor of a mobile device (e.g., in a processor entity), or by hardware, or by a combination of software and hardware. In addition, in this regard, it should be noted that any block of the logic flow in the figure can represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions. The software can be stored on a physical medium such as a memory chip or a memory block implemented in a processor, a magnetic medium such as a hard disk or a floppy disk, and an optical medium such as a DVD and its data variant CD.

[0267] The memory may be of any type suitable for the local technical environment and may be implemented using any suitable data storage technology (e.g., semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory). The data processor may be of any type suitable for the local technical environment and may include one or more of a general purpose computer, a special purpose computer, a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a gate level circuit, and a processor based on a multi-core processor architecture, as non-limiting examples.

[0268] Embodiments of the present invention may be practiced in various components such as integrated circuit modules. The design of integrated circuits is essentially a highly automated process. Complex and powerful software tools are available to convert a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate.

[0269] Programs, such as those offered by Synopsys Inc. of Mountain View, Calif., and Cadence Design Inc. of San Jose, Calif., use well-established design rules along with a library of pre-stored design blocks to automatically route conductors and locate components on a semiconductor chip. Once the design of a semiconductor circuit is complete, the resulting design in a standardized electronic format (e.g., Opus, GDSII, etc.) can be transmitted to a semiconductor manufacturing facility, or "fab," for fabrication.

[0270] The foregoing description provides a complete and informative description of exemplary embodiments of the present invention by way of exemplary and non-limiting examples. However, various modifications and adaptations will become apparent to those skilled in the relevant art in view of the foregoing description when read in conjunction with the accompanying drawings and the appended claims. However, all such and similar modifications to the teachings of the present invention will still fall within the scope of the present invention.

Claims

1. An apparatus for audio processing, comprising at least one processor and at least one memory, the at least one memory comprising computer program code, the at least one memory and the computer program code being configured to, together with the at least one processor, cause the apparatus to at least: defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal, wherein The at least one characteristic is configured to identify a type of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; as well as By processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter, rendering of the multi-channel audio signal is controlled.

2. The device according to claim 1, wherein: The type of the multi-channel audio signal includes at least one of the following: Multi-channel audio signals captured by microphones; Binaural audio signal; spatially processed audio signals; and Atmos audio signal.

3. The device according to claim 2, wherein: The at least one parameter field comprises at least one second field configured to identify a characteristic associated with the type of the multi-channel audio signal.

4. The device according to claim 3, wherein: When the type of the multi-channel audio signal is a multi-channel audio signal captured by a microphone, the characteristic associated with the type of the multi-channel audio signal comprises one of the following: identifying a microphone profile of at least one microphone in a microphone array that enables it to capture a multi-channel audio signal captured by the microphone; identifying a configuration of the microphone array that enables it to capture a multi-channel audio signal captured by the microphone; as well as The positions and / or arrangements of at least two microphones within the microphone array are identified such that they capture the multi-channel audio signal captured by the microphones.

5. The device according to claim 4, wherein: The microphone profile includes at least one of the following: Omnidirectional microphone profile; Sub-cardioid directional microphone profile; Cardioid directional microphone profile; Highly cardioid directional microphone profile; Supercardioid directional microphone profile; Shotgun directional microphone profile; Figure-8 / mid-side directional microphone profile; as well as Boundary directional microphone profile.

6. The device according to claim 4, wherein: The at least one parameter field further includes at least one third field configured to identify characteristics associated with a particular microphone profile.

7. The device according to claim 6, wherein: The characteristics associated with the particular microphone profile include at least one of the following: The distance between at least two microphones of the microphone array; and The direction of the at least one microphone in the microphone array.

8. The device according to claim 3, wherein: When the type of the multi-channel audio signal is the binaural audio signal, the characteristic associated with the type of the multi-channel audio signal comprises identifying a head related transfer function.

9. The device according to claim 8, wherein: The at least one parameter field associated with the multi-channel audio signal comprises at least one field further configured to identify a direction associated with the head related transfer function.

10. The device according to claim 3, wherein: When the type of the multi-channel audio signal is a spatially processed audio signal, the characteristics associated with the type of the multi-channel audio signal are configured to identify parameters for determining processing variables to assist in the rendering.

11. The device according to claim 10, wherein: The parameters used to determine the processing variables to assist the rendering include at least one of the following: beamforming applied to at least two captured audio signals to form said multi-channel audio signal; processing variables applied to at least two captured audio signals to form said multi-channel audio signal; an indicator identifying possible audio rendering signal processing variables that may be selected from by a decoder; Left-right focus; Front-back focus; Noise suppression - residual noise signal; Target tracking - residual signal; main-residual signal; Source 1-Source 2 signal; as well as Beam 1 - Beam 2 signal.

12. The device according to claim 10, wherein: The at least one parameter field configured to describe characteristics of the multi-channel audio signal includes at least one field configured to identify an amount of focus associated with the processing variable.

13. The device according to claim 3, wherein: When the type of the multi-channel audio signal is an Atmos audio signal, the characteristics associated with the type of the multi-channel audio signal include identifying a format of the Atmos audio signal.

14. The device according to claim 13, wherein: The parameter identifying the format of the panoramic audio signal includes at least one of the following: A - format identifier; B-format identifier; Four-quadrant identifier; and The header passes the function identifier.

15. The device according to claim 13, wherein: The at least one parameter field configured to describe the characteristics of the multi-channel audio signal includes at least one field configured to identify a normalization associated with the panoramic audio signal, wherein the normalization includes at least one of the following: SN3D normalization; SN2D normalization; maxN normalization; N3D normalization; and N2D normalization.

16. The apparatus of claim 1, further causing the apparatus to send the at least one parameter field associated with the input multi-channel audio signal to a renderer for rendering the multi-channel audio signal.

17. The apparatus of claim 1, further causing the apparatus to perform one of the following operations: Receive user input, where causing the apparatus to define at least one parameter field associated with the input multi-channel audio signal based on the user input; as well as Defining at least one parameter field associated with the input multi-channel audio signal based on the user input causes the apparatus to define the at least one parameter field as a determined default value in the absence of the user input.

18. An apparatus for audio processing, comprising at least one processor and at least one memory, the at least one memory comprising computer program code, the at least one memory and the computer program code being configured to, together with the at least one processor, cause the apparatus to at least: receiving at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe a characteristic of the multi-channel audio signal, wherein: The at least one characteristic is configured to identify a type of the multi-channel audio signal; receiving at least one spatial audio parameter; Determining the multi-channel audio signal; as well as The multi-channel audio signal is processed based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to facilitate rendering of the multi-channel audio signal.

19. A method for audio processing, comprising: defining at least one parameter field associated with an input multi-channel audio signal, the at least one parameter field being configured to describe at least one characteristic of the multi-channel audio signal, wherein the at least one characteristic is configured to identify a type of the multi-channel audio signal; determining at least one spatial audio parameter associated with the multi-channel audio signal; and By processing the input multi-channel audio signal using at least the at least one characteristic of the multi-channel audio signal and the at least one spatial audio parameter, rendering of the multi-channel audio signal is controlled.

20. A method for audio processing, comprising: receiving at least one parameter field associated with a multi-channel audio signal, the at least one parameter field being configured to describe a characteristic of the multi-channel audio signal, wherein the at least one characteristic is configured to identify a type of the multi-channel audio signal; receiving at least one spatial audio parameter; determining the multi-channel audio signal; and The multi-channel audio signal is processed based on the at least one spatial audio parameter and at least one parameter field associated with the multi-channel audio signal to facilitate rendering of the multi-channel audio signal.