Method and device for decoding audio soundfield representation for audio playback

The method employs VBAP and pseudo-inverse mode matrices to decode ambisonics signals, enhancing spatial localization and timbre in 3D audio reproduction by overcoming irregular speaker setups and negative amplitude issues.

JP2024164284AActive Publication Date: 2024-11-26DOLBY INTERNATIONAL AB
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024151868
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2010-03-26
Filing Date
2024-09-04
Publication Date
2024-11-26
Estimated Expiration
2031-03-25

AI Technical Summary

Technical Problem

Existing speaker setups for 3D audio reproduction, such as the 16-speaker configuration, face challenges in decoder design due to irregular spatial distributions, leading to localization and timbre issues, and conventional decoding methods require knowledge of signal source direction or result in erroneous negative amplitudes.

Method used

A method using vector basis amplitude panning (VBAP) to calculate panning functions and a pseudo-inverse mode matrix for decoding ambisonics signals, eliminating the need for signal source direction knowledge and addressing the inverse matrix difficulty.

Benefits of technology

Improves spatial localization and timbre attributes by deriving decoding matrices through a two-step process, resulting in better spatial reproduction quality and reduced timbre alteration compared to conventional methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164284000001_ABST
    Figure 2024164284000001_ABST
Patent Text Reader

Abstract

To provide a method and device for decoding a soundfield representation for non-regular spatial distributions with improved localization and tone coloration properties.SOLUTION: An improved method for decoding an audio soundfield representation for playback of ambisonics soundfield signals comprises: a step (110) of calculating a panning function (W) using a geometrical method based on positions of multiple loudspeakers and multiple source directions; a step (120) of calculating a mode matrix (Ξ) from the loudspeaker positions; a step (130) of calculating a pseudo-inverse mode matrix (Ξ+); and a step (130) of decoding the audio soundfield representation. The decoding is based on a decode matrix D that is obtained from the panning function (W) and the pseudo-inverse mode matrix (Ξ+).SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method and apparatus for decoding an audio sound field representation, and more particularly to an Ambisonics formatted audio representation for audio playback. [Background technology]

[0002] This section is intended to introduce the reader to aspects of art that may be related to various aspects of the present invention, which are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present invention. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art, unless expressly stated otherwise.

[0003] Accurate localisation is the main goal for any spatial audio reproduction system. Such a reproduction system is very practical for conferencing systems, games or other virtual environments that benefit from 3D sound. Sound scenes in 3D can be synthesised or captured as natural sound fields. Sound field signals, for example Ambisonics, carry the representation of the desired sound field. The Ambisonics format is based on a spherical harmonics decomposition of the sound field. The basic Ambisonics format or B-format uses spherical harmonics of orders 0 and 1, while the so-called Higher Order Ambisonics (HOA) also uses further spherical harmonics of at least second order. A decoding process is required to obtain the individual speaker signals. To synthesize an audio scene, panning functions for the spatial speaker arrangement are required to obtain the spatial localisation of a given sound source. If a natural sound field is recorded, a microphone array is required to capture the spatial information. The known Ambisonics method is a very suitable tool to achieve that. An Ambisonics formatted signal carries a representation of the desired sound field. A decoding process is needed to obtain the individual loudspeaker signals from such an Ambisonics formatted signal. Also in this case the panning function is the main issue to describe the task of spatial localization, since it can be derived from the decoding function. The spatial arrangement of the loudspeakers is referred to as the speaker setup in this paper.

[0004] Commonly used speaker setups are the stereo setup with two speakers, the standard surround setup with five speakers and the extended surround setup with more than five speakers. Although these setups are well known, they are limited to two dimensions (2D): for example, no height information is reproduced.

[0005] Loudspeaker setups for three-dimensional (3D) reproduction are described in [1], for example the NHK Ultra High Definition TV in 22.2 format or the 2+2+2 configuration of the Dabringhaus (mdg-musikproduction dabringhaus und grimm, www.mdg.de) and the proposal for a 10.2 setup in [2]. One of the few known systems that mention spatial reproduction and panning strategies is the vector base amplitude panning (VBAP) approach in [3]. VBAP (Vector Base Amplitude Panning) was used by [3] to reproduce virtual acoustic sources with any loudspeaker setup. To place a virtual source in a 2D plane, a pair of loudspeakers is needed. On the other hand, in the 3D case, a triplet of loudspeakers is needed. For each virtual source, a monophonic signal with a different gain (depending on the position of the virtual source) is fed to selected loudspeakers from the full setup. The loudspeaker signals for all virtual sources are then summed. VBAP applies a geometric approach to calculate the gain of speaker signals for panning between speakers.

[0006] The exemplary 3D speaker setup considered in this paper and newly proposed has 16 speakers positioned as shown in Figure 2. This positioning was chosen due to practical considerations, with four pillars with three speakers each, and additional speakers between the pillars. More precisely, the eight speakers are evenly distributed on a circle around the listener's head, with a 45 degree angle between them. The four additional speakers are located at the top and bottom, with a 90 degree azimuth angle between them. For Ambisonics, this setup is irregular, leading to problems in the decoder design, as mentioned in [4].

[0007] Conventional Ambisonics decoding, as described in [5], uses a commonly known mode mapping process. The modes are described by mode vectors that contain the values ​​of spherical harmonics for distinct directions of incidence. The combination of all directions provided by the individual loudspeakers leads to a mode matrix of the loudspeaker setup. The mode matrix thus represents the loudspeaker positions. To reproduce distinct modes of the source signal, the loudspeaker modes are weighted such that the superimposed modes of the individual loudspeakers add up to the desired mode. To obtain the required weights, an inverse matrix representation of the speaker mode matrix needs to be calculated. For signal decoding, the weights represent the driving signals of the loudspeakers, and the inverse speaker mode matrix is ​​called the "decoding matrix", which is applied to decode the Ambisonics formatted signal representation. In particular, for many loudspeaker setups, such as the setup shown in Figure 2, it is difficult to invert the mode matrix.

[0008] As mentioned above, commonly used speaker sets are constrained to 2D, i.e. no height information is reproduced. Mathematically decoding the sound field representation of a speaker setup with a non-regular spatial distribution leads to problems of localization and coloration with commonly known techniques. To decode Ambisonics signals, a decoding matrix (i.e. a matrix of decoding coefficients) is used. At least two problems arise with the normal decoding of Ambisonics signals, especially HOA signals. Firstly, for correct decoding it is necessary to know the direction of the signal source in order to determine the decoding matrix. Secondly, the mapping to existing speaker setups is systematically incorrect due to the following mathematical problem: A mathematically correct decoding gives not only positive speaker amplitudes but also some negative speaker amplitudes. However, these are erroneously reproduced as positive signals, hence the above mentioned problems arise. [Prior art documents] [Non-patent literature]

[0009] [Non-Patent Document 1] K. Hamasaki, T. Nishiguchi, R. Okumaura, and Y. Nakayama, "Wide listening area with exceptional spatial sound quality of a 22.2 multichannel sound system", Audio Engineering Society Preprints, Vienna, Austria, May 2007. [Non-Patent Document 2] T. Holman, "Sound for Film and Television", 2nd ed., Boston, Focal Press, 2002. [Non-Patent Document 3] Pulkki, "Virtual sound source positioning using vector base amplitude panning", Journal of Audio Engineering Society, vol.45, no.6, pp.456-466, June 1997. [Non-Patent Document 4] H. Pomberger and F. Zotter, "An ambisonics format for flexible playback layouts," Proceedings of the 1st Ambisonics Symposium, Graz, Austria, July 2009 [Non-Patent Document 5] M. Poletti, "Three-dimensional surround sound systems based on spherical harmonics", J. Audio Eng. Soc, vol.53, no.11, pp.1004-1025, Nov. 2005 Summary of the Invention [Problem to be solved by the invention]

[0010] The present invention describes a method for decoding sound field representations for non-normal spatial distributions with significantly improved localization and timbre attributes. [Means for solving the problem]

[0011] The method represents an alternative way of obtaining a decoding matrix for sound field data, e.g. data in Ambisonics format, and uses a process in a system estimation manner. Given a set of possible incidence directions, the panning functions related to the desired loudspeakers are calculated. The panning functions are taken as the output of the Ambisonics decoding process. The required input signals are the mode matrices of all possible directions. Thus, the decoding matrix is ​​obtained by right-multiplying the weighting matrix with the inverse version of the mode matrix of the input signal, as shown below:

[0012] Regarding the second problem mentioned above, it has been found that it is also possible to obtain the decoding matrix from the inverse of the so-called mode matrix, which represents the speaker positions, and a position-dependent weighting function ("panning function") W. One aspect of the invention is that these panning functions W can be derived using a different method than is normally used. Advantageously, a simple geometric method is used. Such a method does not require any knowledge of the signal source direction, thus solving the first problem mentioned above. One such method is known as "vector-based amplitude panning" (VBAP). According to the invention, VBAP is used to calculate the required panning functions, which are then used to calculate the Ambisonics decoding matrix. Another problem arises in that the inverse of the mode matrix (which represents the speaker setup) is required. However, the exact inverse is difficult to calculate, which also leads to incorrect audio reproduction. Therefore, an additional aspect is that to obtain the decoding matrix, a pseudo-inverse mode matrix is ​​calculated, which is much easier to calculate.

[0013] The present invention uses a two-stage approach. The first stage is the derivation of panning functions that depend on the speaker setup used for playback. In the second stage, the Ambisonics decoding matrices are calculated from these panning functions for all speakers.

[0014] One advantage of the present invention is that a parametric description of the sound sources is not required, but sound field descriptions such as Ambisonics can be used.

[0015] According to the present invention, a method for decoding an audio sound field representation for audio reproduction comprises the steps of: calculating a panning function for each of a plurality of speakers using a geometric method based on the positions of the speakers and a plurality of source directions; calculating a mode matrix from the source directions; calculating a pseudo-inverse mode matrix of the mode matrix; and decoding the audio sound field representation, wherein the decoding is based on a decoding matrix obtained from at least the panning function and the pseudo-inverse mode matrix.

[0016] According to another aspect, an apparatus for decoding an audio sound field representation for audio reproduction includes a first calculation means for calculating, for each of a plurality of loudspeakers, a panning function using a geometric method based on the positions of the loudspeakers and a plurality of source directions, a second calculation means for calculating a mode matrix from the source directions, a third calculation means for calculating a pseudo-inverse mode matrix of the mode matrix, and a decoder means for decoding the sound field representation, the decoding being based on a decoding matrix, the decoder means obtaining the decoding matrix using at least the panning function and the pseudo-inverse mode matrix. The first, second and third calculation means may be a single processor or two or more separate processors.

[0017] According to yet another aspect, a computer-readable medium has stored thereon executable instructions for causing a computer to execute a method for decoding an audio sound field representation for audio reproduction, the method including: calculating, for each of a plurality of speakers, a panning function using a geometric method based on positions of the speakers and a plurality of source directions; calculating a mode matrix from the source directions; calculating a pseudo-inverse of the mode matrix; and decoding the audio sound field representation, the decoding based on a decoding matrix obtained from at least the panning functions and the pseudo-inverse mode matrix.

[0018] Advantageous embodiments of the invention are disclosed in the dependent claims, the following description and the drawings. [Brief description of the drawings]

[0019] Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings. [Figure 1] 2 is a flow chart of the method. [Diagram 2] FIG. 1 illustrates an exemplary 3D setup with 16 speakers. [Diagram 3] FIG. 1 shows the beam patterns resulting from decoding using non-regularized mode matching. [Figure 4] FIG. 1 shows the beam pattern resulting from decoding using a regularized mode matrix. [Diagram 5] This figure shows the beam patterns resulting from decoding using a decoding matrix derived from VBAP. [Figure 6] FIG. 1 shows the results of a listening test. [Figure 7] FIG. 2 is a block diagram of the device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] As shown in Fig. 1, the audio sound field representation SF for audio playbackc The method of decoding comprises a step 110 of calculating, for each of a number of speakers, a panning function W using a geometric method based on the positions 102 of the speakers (L being the number of speakers) and a number of source directions 103 (S being the number of source directions), a step 120 of calculating a mode matrix Ξ from the source directions and a given order N of the sound field representation, and a step 130 of calculating a pseudo-inverse mode matrix Ξ of the mode matrix Ξ. + and a step 130 of calculating said audio sound field representation SF c Decode the decoded sound data AU dec The decoding includes steps 130, 140, in which at least the panning function W and the pseudo-inverse mode matrix Ξ are obtained. + In one embodiment, the pseudo-inverse mode matrix is + =Ξ H [ΞΞ H ] -1 The order N of the sound field representation may be predefined or may be obtained according to the input signal SF c may be extracted 105 from

[0021] As shown in FIG. 7 , an apparatus for decoding an audio sound field representation for audio reproduction includes a first calculation means 210 for calculating, for each of a plurality of loudspeakers, a panning function W using a geometric method based on the positions 102 of the loudspeakers and a plurality of source directions 103, a second calculation means 220 for calculating a mode matrix Ξ from the source directions, and a pseudo-inverse mode matrix Ξ of the mode matrix Ξ. + and a decoder means 240 for decoding said sound field representation. Said decoding is based on a decoding matrix D, which comprises at least said panning function W and said pseudo inverse mode matrix Ξ + , by a decoding matrix calculation means 235 (e.g., a multiplier). The decoder means 240 uses the decoding matrix D to generate the decoded audio signal AU decThe first, second and third calculation means 220, 230, 240 may be a single processor or two or more separate processors. The order N of the sound field representation may be predefined or may be calculated based on the input signal SF c The order may be obtained by a means 205 for extracting the order from

[0022] A particularly useful 3D speaker setup has 16 speakers. There are four pillars with three speakers each, and additional speakers between the pillars, as shown in Figure 2. The eight speakers are evenly distributed on a circle around the listener's head, at a 45 degree angle. Four additional speakers are placed at the top and bottom, at an azimuth angle of 90 degrees. For Ambisonics, this setup is irregular, which leads to problems in decoder design.

[0023] Below, Vector Basis Amplitude Panning (VBAP) is described in detail. In one embodiment, VBAP is used in this application to position virtual acoustic sources with any speaker setup, where the same distance of the speakers from the listening position is assumed. VBAP uses three speakers to position one virtual source in 3D space. For each virtual source, a monophonic signal with different gain is provided to the speakers to be used. The gain for the different speakers depends on the position of the virtual source. VBAP is a geometric approach to calculate the gain of the speaker signals for panning between speakers. In the 3D case, three speakers arranged in a triangle build a vector basis. Each vector basis is defined by the speaker numbers k, m, n and the speaker position vector l given in Cartesian coordinates normalized to length 1. k ,l m ,l n The vector basis for speakers k, m, and n is L kmn ={l k ,l m ,l n} (1) is defined as follows:

[0024] The desired direction Ω = (θ,φ) of the virtual source needs to be given as an azimuth angle φ and a tilt angle θ. Thus, the position vector p(Ω) of the virtual source of length 1 in Cartesian coordinates is given by p(Ω)={cosφsinθ,sinφsinθ,cosθ} T (2) is defined as follows:

[0025] The virtual source positions are given by the vector basis and the gain factor g(Ω) = ( ~ g k , ~ g m , ~ g n ) T Using p(Ω)=L kmn g(Ω)= ~ g k l k + ~ g m l m + ~ g n l n (3) It can be expressed as:

[0026] By inverting the vector basis matrix, the required gain factor is g(Ω)=L -1 kmn p(Ω) (4) It can be calculated by:

[0027] The vector basis used is determined according to [3]: first, the gains are calculated for all vector bases according to [3]. Then, for each vector basis, the minimum over their gain factors is calculated as ~ g min =min{ ~ g k , ~ g m , ~ g n}. Finally, ~ gmin The vector basis with the highest value of is used. The resulting gain factors must not be negative. Depending on the acoustic properties of the listening room, the gain factors may be normalized for energy conservation.

[0028] In the following, an exemplary sound field format, the Ambisonics format, is described. The Ambisonics representation is a method of describing a sound field using a mathematical approximation of the sound field at a position. Using a spherical coordinate system, the pressure at a point r = (r,θ,φ) in space can be expressed as the spherical Fourier transform

number

[0029] For simplicity, plane waves are often assumed to represent the sound field. s The Ambisonics coefficients describing a plane wave as an acoustic source from are:

[0030]

number

[0031]

number

number

[0032] Mode matching is a commonly used approach to compute loudspeaker signals from an Ambisonics representation of a sound field. The basic idea is to s ) to the speaker's sound field description A(Ω l ) weighted sum

number

[0033] Y(Ω s ) * =Ψw(Ω s ) (9) where Ψ is the mode matrix of the speaker setup Ψ=[Y(Ω 1 ) * ,Y(Ω 2 ) * ,…,Y(Ω L ) * ] (10) and has O×L elements. To obtain the desired weighting vector w, different strategies are known to achieve this. If M=3 is chosen, Ψ can be square and invertible. However, due to non-normal speaker setups, the matrix scales poorly. In such cases, the pseudo-inverse is often chosen. D=[Ψ H Ψ] -1 Psi H (11) gives the L×O decoding matrix D. Finally, w(Ω s )=DY(Ω s )* (12) Here, the weight w(Ω s ) is the minimum energy solution to equation (9). We will see later the consequences of using the pseudoinverse.

[0034] In the following we explain the connection between the panning functions and the Ambisonics decoding matrix. Starting from Ambisonics, the panning functions for the individual speakers can be calculated using equation (12).

[0035] Ξ=[Y(Ω 1 ) * ,Y(Ω 2 ) * ,…,Y(Ω S ) * ] (13) S input signal directions (Ω s ) mode matrix. The input signal directions are, for example, a spherical grid with tilt angles running from 1°...180° in 1 degree increments and azimuth angles running from 1...360°. This mode matrix has O×S elements. Using equation (12), the resulting matrix W has L×S elements. Row l has the S pan weights for each speaker.

[0036] W=DΞ (14) As a representative example, the panning function of a single loudspeaker 2 is shown as a beam pattern in Fig. 3, in this example with a decoding matrix D of order M=3. As can be seen, the panning function values ​​are completely unrelated to the physical positioning of the loudspeakers. This is due to the mathematically non-normal positioning of the loudspeakers, which is not sufficient for the spatial sampling scheme for the chosen order. The decoding matrix is ​​therefore referred to as a non-normalized mode matrix. This problem can be overcome by normalizing the loudspeaker mode matrix Ψ in equation (11). This solution works at the expense of the spatial resolution of the decoding matrix, which can be expressed as a reduction in the Ambisonics order. Fig. 4 shows an exemplary beam pattern resulting from decoding using a normalized mode matrix, in particular using the average of the eigenvalues ​​of the mode matrix for normalization. Compared to Fig. 3, the direction of the targeted loudspeaker is now clearly discernible.

[0037] As outlined in the introduction, another way to obtain the decoding matrix D for the reconstruction of an Ambisonics signal is possible if the panning function is known. The panning function W is seen as the desired signal defined on a set of virtual source directions Ω, and the mode matrix Ξ of these directions acts as the input signal. The decoding matrix can then be calculated using the following formula:

[0038] D=WΞ H [ΞΞ H ] -1 =WΞ + (15) Here, Ξ H [ΞΞ H ] -1 Or just Ξ + is the pseudo-inverse of the mode matrix Ξ. In this new approach, we take the panning functions in W from VBAP and compute the Ambisonics decoding matrix from this.

[0039] The panning function for W is taken as the gain value g(Ω) calculated using equation (4), where Ω is chosen according to equation (13). The resulting decoding matrix using equation (15) is the Ambisonics decoding matrix that facilitates the VBAP panning function. An example showing the beam pattern resulting from decoding using the VBAP derived decoding matrix is ​​depicted in Figure 5. Advantageously, the sidelobe SL is smaller than the sidelobe SL of the normalized mode matching result of Figure 4. reg is significantly smaller than . Furthermore, the VBAP derived beam patterns for individual loudspeakers follow the geometry of the loudspeaker setup, since the VBAP panning function depends on the vector basis of the targeted direction. As a result, the new approach based on the present invention produces better results across all orientations of the loudspeaker setup.

[0040] The source directions 103 can be defined quite freely. The condition for the number of source directions S is that there must be at least (N+1) 2 Therefore, the sound field signal SF c For a given degree N of S, S ≥ (N+1) 2 It is possible to define S according to and distribute the S source directions evenly over the unit sphere. As mentioned above, the result can be a spherical grid with tilt angles running in regular increments of x degrees (e.g. x=1...5 or x=10,20, etc.) from 1°...180° and azimuth angles from 1...360°. Each source direction Ω=(θ,φ) can be given by an azimuth angle φ and a tilt angle θ.

[0041] The beneficial effect was confirmed in listening tests. For the evaluation of single source localization, the virtual source is compared against a real source as a reference. For the real source, a loudspeaker at the desired position is used. The reproduction methods used are VBAP, Ambisonics mode matching decoding and the newly proposed Ambisonics decoding using the VBAP panning function according to the invention. For the second and third methods, a third order Ambisonics signal is generated for each position tested and each input signal tested. This synthesized Ambisonics signal is then decoded using the corresponding decoding matrix. The test signals used are wideband pink noise and a male speech signal. The tested positions are located in the front region with the following orientations:

[0042] Ω1=(76.1°,-23.2°), Ω2=(63.3°,-4.3°) (16) The listening tests were carried out in an acoustic room with a mean reverberation time of about 0.2 s. Nine people participated in the listening tests. The subjects were asked to rate the spatial reproduction performance of all the reproduction methods compared to the reference. A single rating value had to be found to represent the changes in localization and timbre of the virtual sources. Figure 5 shows the results of the listening tests.

[0043] As the results show, the non-normalized Ambisonics mode matching decoding was graded perceptually worse than the other methods tested. This result corresponds to Figure 3. The Ambisonics mode matching method acts as an anchor in this listening test. Another advantage is that the confidence interval for the noise signal is larger for VBAP than for the other methods. The average value is highest for Ambisonics decoding with VBAP panning function. Thus, although the spatial resolution is reduced - due to the Ambisonics order used - this method shows an advantage over the parametric VBAP method. Compared to VBAP, both Ambisonics decoding with robust panning function and with VBAP panning function have the advantage that not only three speakers are used to render the virtual source. VBAP single speaker can dominate when the virtual source position is close to one of the physical positions of the speakers. Most subjects reported less timbre alteration with Ambisonics-driven VBAP than with directly applied VBAP. The problem of timbre alteration for VBAP is already known from [3]. Contrary to VBAP, the newly proposed method uses more than three speakers for the reproduction of one virtual source, but surprisingly, there is less coloration.

[0044] In conclusion, a new method is disclosed to derive Ambisonics decoding matrices from VBAP panning functions. For various loudspeaker setups, this approach has advantages over the matrices of the mode matching approach. The attributes and consequences of these decoding matrices are discussed above. In summary, the newly proposed Ambisonics decoding using VBAP panning functions avoids the typical problems of well-known mode matching methods. Listening tests show that the VBAP derived Ambisonics decoding can produce better spatial reproduction quality than a direct use of VBAP can produce. Whereas VBAP requires a parametric description of the virtual sources to be rendered, the proposed method only requires a sound field description.

[0045] While the fundamental novel features of the invention as applied to the preferred embodiment of the invention have been shown, described and pointed out, it will be understood that various omissions, substitutions and changes may be made in the described apparatus and method in the form and details of the disclosed apparatus and in its operation by those skilled in the art without departing from the spirit of the invention. Any combination of elements performing substantially the same function in substantially the same manner to achieve the same result is expressly intended to be within the scope of the invention. The transfer of elements from one described embodiment to another is also fully intended and contemplated. It will be understood that modifications of detail may be made without departing from the scope of the invention. Each feature disclosed in this document and (where appropriate) in the claims and drawings may be provided independently or in any suitable combination. Features may be implemented in hardware, software or a combination of both, where appropriate. Any reference signs appearing in the claims are merely for illustration and shall have no limiting effect on the scope of the claims.

[0046] Several aspects will be described. [Aspect 1] 1. A method of decoding an audio sound field representation for audio reproduction, comprising: · calculating, for each of a plurality of loudspeakers, a panning function using a geometric method based on the positions of the loudspeakers and a plurality of source directions; calculating a modal matrix from the source directions; calculating a pseudo-inverse modal matrix of the modal matrix; and decoding the audio sound field representation, the decoding being based on a decoding matrix derived from at least the panning function and the pseudo-inverse mode matrix. method. [Aspect 2] 2. The method of embodiment 1, wherein the geometric method used in the step of calculating a panning function is Vector Basis Amplitude Panning (VBAP). [Aspect 3] 3. The method of claim 1 or 2, wherein the sound field representation is in at least second order Ambisonics format. Aspect 4 Ξ is the modal matrix of the multiple source directions, and the pseudo-inverse modal matrix (Ξ + ) is Ξ H [ΞΞ H ] -1 4. The method according to any one of embodiments 1 to 3, obtained according to Aspect 5 The decoding matrix is ​​D=WΞ, where W is the set of panning functions for each speaker. H [ΞΞ H ] -1 =WΞ + The method of embodiment 4, wherein the method is obtained according to Aspect 6 13. An apparatus for decoding an audio sound field representation for audio reproduction, comprising: · first computing means for computing, for each of a plurality of loudspeakers, a panning function using a geometric method based on the positions of the loudspeakers and a plurality of source directions; second calculation means for calculating a modal matrix from said source directions; a third calculation means for calculating a pseudo-inverse modal matrix of the modal matrix; and decoder means for decoding the sound field representation, the decoding being based on a decoding matrix, the decoder means using at least the panning function and the pseudo-inverse mode matrix to obtain the decoding matrix. Device. Aspect 7 7. The apparatus of claim 6, wherein the decoding apparatus further comprises: means for calculating the decoding matrix from the panning function and the pseudo-inverse mode matrix; Device. Aspect 8 8. The apparatus of claim 6 or 7, wherein the geometric method used in the step of calculating a panning function is Vector Basis Amplitude Panning (VBAP). Aspect 9 9. The apparatus of any one of aspects 6 to 8, wherein the sound field representation is in at least second-order Ambisonics format. Aspect 10 Ξ is a modal matrix for the multiple source directions, the pseudo-inverse modal matrix Ξ + Ξ + =Ξ H [ΞΞ H ] -1 10. A device according to any one of embodiments 6 to 9, obtained according to Aspect 11 The decoding matrix is ​​D=WΞ, where W is the set of panning functions for each speaker. H [ΞΞ H ] -1 =WΞ + 11. The apparatus of embodiment 10, wherein the means for calculating a decoding matrix according to Aspect 12 1. A computer-readable medium storing executable instructions for causing a computer to perform a method for decoding an audio sound field representation for audio reproduction, the method comprising: · calculating, for each of a plurality of loudspeakers, a panning function using a geometric method based on the positions of the loudspeakers and a plurality of source directions; calculating a modal matrix from the source directions; calculating a pseudo-inverse modal matrix of the modal matrix; and decoding the audio sound field representation, the decoding being based on a decoding matrix derived from at least the panning function and the pseudo-inverse mode matrix. Computer-readable medium. Aspect 13 13. The computer-readable medium of embodiment 12, wherein the geometric method used in the step of calculating a panning function is Vector Basis Amplitude Panning (VBAP). Aspect 14 14. The computer-readable medium of claim 12 or 13, wherein the sound field representation is in at least second order Ambisonics format. Aspect 15 Ξ is a modal matrix for the multiple source directions, the pseudo-inverse modal matrix Ξ + Ξ + =Ξ H [ΞΞ H ] -1 15. The computer-readable medium of any one of embodiments 12 to 14, obtained according to

Claims

1. 1. A method of decoding an Ambisonics audio sound field representation for playback, the Ambisonics audio sound field representation having order N, the method comprising: receiving the audio sound field representation by a processor configured to decode the audio sound field representation; receiving, by the processor, a decoding matrix for decoding the audio sound field representation to determine a decoded audio signal, the decoding matrix is ​​based on a matrix including panning functions for a first plurality L of speaker positions and a second plurality S of source directions, the matrix having a size of L×S, the plurality S of source directions being distributed on a unit sphere, each direction of the plurality S of source directions including a corresponding azimuth angle and a corresponding tilt angle, S≧(N+1)^2, and the panning functions are indicated by gain values; determining the decoded audio signal based on multiplication of the decoding matrix and the audio sound field representation. method.

2. The method of claim 1 , wherein the decoding matrix is ​​predetermined.

3. The method of claim 1 , wherein each element of the decoding matrix is ​​related to at least a spherical harmonic function of the decoded audio signal.

4. A non-transitory computer readable medium having stored thereon executable instructions for causing a computer to perform the method of decoding an Ambisonics audio sound field representation for audio reproduction according to claim 1.

5. 1. A system for decoding an Ambisonics audio sound field representation for playback, the Ambisonics audio sound field representation having order N, the apparatus comprising: a receiver for receiving said audio sound field representation; a processor receiving a decoding matrix for decoding the audio sound field representation to determine a decoded audio signal, a processor, wherein the decoding matrix is ​​based on a matrix including panning functions for a first plurality L of speaker positions and a second plurality S of source directions, the matrix having a size of L×S, the plurality S of source directions being distributed on a unit sphere, each direction of the plurality S of source directions including a corresponding azimuth angle and a corresponding tilt angle, S≧(N+1)^2, and the panning functions are indicated by gain values; a decoder for determining the decoded audio signal based on multiplication of the decoding matrix and the audio sound field representation. system.

Citation Information

Patent Citations

  • Audio signal, method and apparatus for encoding or transmitting the same and method and apparatus for processing the same

    EP2094032A1

  • A Multichannel Surround Sound Mastering and Playback Method That Preserves 3D Spatial Harmonics

    JP2003531555A

  • Audio image forming device

    JP2008017117A