Apparatus and method for obtaining an audio signal

Abstract

There is provided an apparatus and method for obtaining an audio signal and associated electronic device, wherein the apparatus comprises: processing circuitry; memory circuitry comprising computer program code, the memory circuitry and the computer program code being configured to, with the processing circuitry, cause the apparatus to be able to perform: obtaining spatial information, the spatial information relating to a captured soundfield from a first set of microphones; obtaining one or more signals from a second set of microphones, wherein the one or more signals relate to the captured soundfield; and processing the one or more signals obtained from the second set of microphones using the spatial information obtained from the first set of microphones; wherein the first set of microphones is provided within the electronic device and the second set of microphones is provided external to the electronic device.

Description

[0001] This application is a divisional application of the Chinese Invention Patent Application entitled “Apparatus and method for obtaining an audio signal” (application number 201780041471.9, filing date 20 June 2017). TECHNICAL FIELD

[0002] Examples of the present disclosure relate to apparatuses and methods for obtaining an audio signal. In particular, examples of the present disclosure relate to apparatuses and methods for obtaining a high quality spatial audio signal. BACKGROUND

[0003] Electronic devices comprising microphones and other components are known. For example, image capture devices can comprise one or more cameras and one or more microphones. Integrating microphones into the same electronic device as other components can reduce the quality of audio signals that can be captured by the microphones. SUMMARY

[0004] According to some, but not necessarily all, examples of the present disclosure, an apparatus can be provided comprising: processing circuitry; memory circuitry comprising computer program code, the memory circuitry and the computer program code being configured to, with the processing circuitry, cause the apparatus to perform: obtaining spatial information, the spatial information relating to a soundfield captured from a first set of microphones; obtaining one or more signals from a second set of microphones, wherein the one or more signals relate to the captured soundfield; and processing the one or more signals obtained from the second set of microphones using the spatial information obtained from the first set of microphones; wherein the first set of microphones is provided within an electronic device and the second set of microphones is provided outside the electronic device.

[0005] The spatial information from the first set of microphones can be used to spatially process the one or more signals obtained from the second set of microphones.

[0006] The second set of microphones can be arranged to obtain a higher quality audio signal than the first set of microphones.

[0007] The second set of microphones can comprise one or more higher quality microphones than the first set of microphones.

[0008] The second set of microphones can be separate from components that reduce the quality of audio signals.

[0009] The first set of microphones can be arranged in a predetermined geometry.

[0010] The first set of microphones can be provided within an image capture device.

[0011] The first set of microphones can comprise more microphones than the second set of microphones.

[0012] The second set of microphones can be positioned proximate to the electronic device such that the first set of microphones and the second set of microphones are in a similar sound field.

[0013] The spatial information can be obtained using a spatial audio capture process.

[0014] The spatial information can indicate information of an energy ratio of each microphone in the first set of microphones within each of a plurality of frequency bands, the energy ratio being a function of time.

[0015] The second set of microphones can be coupled to the electronic device.

[0016] According to some but not necessarily all examples of the present disclosure, there can be provided an electronic device comprising an apparatus as described in any preceding example.

[0017] According to some but not necessarily all examples of the present disclosure, there can be provided a method comprising: obtaining spatial information, the spatial information relating to a sound field captured from a first set of microphones; obtaining one or more signals from a second set of microphones, wherein the one or more signals relate to the captured sound field; and processing the one or more signals obtained from the second set of microphones using the spatial information obtained from the first set of microphones; wherein the first set of microphones is provided within an electronic device, and the second set of microphones is provided external to the electronic device.

[0018] The spatial information from the first set of microphones can be used in spatially processing the one or more signals obtained from the second set of microphones.

[0019] The second set of microphones can be arranged to obtain a higher quality audio signal than the first set of microphones.

[0020] The second set of microphones can comprise one or more higher quality microphones than the first set of microphones.

[0021] The second set of microphones can be separate from a component that reduces the quality of an audio signal.

[0022] The first set of microphones can be arranged in a predetermined geometry.

[0023] The first set of microphones can be provided within an image capture device.

[0024] The first set of microphones can comprise more microphones than the second set of microphones.

[0025] The second set of microphones can be positioned proximate to the electronic device such that the first set of microphones and the second set of microphones are in a similar sound field.

[0026] The spatial information related to the audio signal can be obtained using a spatial audio capture process.

[0027] The spatial information can comprise information indicative of an energy ratio for each microphone in the first set of microphones within each of a plurality of frequency bands, the energy ratio being a function of time.

[0028] The second set of microphones can be coupled to the electronic device.

[0029] According to some, but not necessarily all, examples of the present disclosure, a computer program comprising computer program instructions can be provided, which, when executed by processing circuitry, implements obtaining spatial information, the spatial information being related to a sound field captured from a first set of microphones; obtaining one or more signals from a second set of microphones, wherein the one or more signals are related to the captured sound field; and processing the one or more signals obtained from the second set of microphones using the spatial information obtained from the first set of microphones; wherein the first set of microphones is provided within an electronic device, and the second set of microphones is provided outside the electronic device.

[0030] According to some, but not necessarily all, examples of the present disclosure, a computer program comprising program instructions can be provided for causing a computer to perform the methods described above.

[0031] According to some, but not necessarily all, examples of the present disclosure, a physical entity can be provided, embodying a computer program as described above.

[0032] According to some, but not necessarily all, examples of the present disclosure, an electromagnetic carrier signal carrying a computer program as described above can be provided.

[0033] According to some, but not necessarily all, examples of the present disclosure, an apparatus can be provided comprising: means for obtaining spatial information related to a sound field captured from a first set of microphones; means for obtaining one or more signals from a second set of microphones, wherein the one or more signals are related to the captured sound field; and means for processing the one or more signals obtained from the second set of microphones using the spatial information obtained from the first set of microphones; wherein the first set of microphones is provided within an electronic device, and the second set of microphones is provided outside the electronic device.

[0034] According to various, but not necessarily all, examples of the present disclosure, examples are provided as described in the following claims. BRIEF DESCRIPTION OF DRAWINGS

[0035] For a better understanding of the various examples, which serve to illustrate specific embodiments, reference will now be made merely by way of example to the accompanying drawings in which:

[0036] Figure 1 An apparatus is illustrated;

[0037] Figure 2 An electronic device is illustrated;

[0038] Figure 3 An electronic device is illustrated;

[0039] Figure 4A And Figure 4B An electronic device is illustrated;

[0040] Figure 5 A method is illustrated;

[0041] Figure 6 A method is illustrated; and

[0042] Figure 7 A method is illustrated. DETAILED DESCRIPTION

[0043] The accompanying drawings illustrate an apparatus 1 comprising: processing circuitry 5; and memory circuitry 7 comprising computer program code 11, the memory circuitry 7 and the computer program code 11 being configured to, with the processing circuitry 5, enable the apparatus to perform: obtaining 51 spatial information 39 relating to a soundfield captured from a first set of microphones 23; obtaining 53 one or more signals from a second set of microphones 27, wherein the one or more signals relate to the captured soundfield; and processing the one or more signals obtained from the second set of microphones 27 using the spatial information 39 obtained from the first set of microphones 23; wherein the first set of microphones 23 is provided within an electronic device 21, and the second set of microphones 27 is provided externally to the electronic device 21.

[0044] The apparatus 1 can be used to obtain audio signals. The apparatus 1 can be used to obtain high quality spatial audio signals. Such an apparatus 1 can be used in a rendering capture device, an image capture device, a virtual reality system, or any other suitable electronic device or system.

[0045] Figure 1 An example apparatus 1 that can be used in examples of the present disclosure is schematically illustrated. Figure 1 The apparatus 1 illustrated in Fig. is a chip or chip set. In some examples, the apparatus 1 can be provided within an electronic device 21. The electronic device 21 can be a rendering capture device, an image capture device, a virtual reality system, or any other suitable electronic device. In some examples, the apparatus 1 can be provided in an electronic device, such as a processing device or a playback device.

[0046] The example apparatus 1 comprises a control circuit 3. The control circuit 3 can provide means for controlling the electronic device 21. The control circuit 3 can also provide means for performing the method or at least part of the method of the examples of the present disclosure.

[0047] The processing circuit 5 can be configured to read from and / or write to the memory circuit 7. The processing circuit 5 can comprise one or more processors. The processing circuit 5 can further comprise an output interface and an input interface, data and / or commands being output by the processing circuit 5 via the output interface, data and / or commands being input to the processing circuit 5 via the input interface.

[0048] The memory circuit 7 can be configured to store a computer program 9 comprising computer program instructions (computer program code 11) which, when loaded into the processing circuit 5, controls the operation of the apparatus 1. The computer program instructions of the computer program 9 provide the logic and routines which enable the apparatus 1 to perform the example method or at least part of the example method illustrated in Fig. 1. Figures 5 to 7 By reading the memory circuit 7, the processing circuit 5 is able to load and execute the computer program 9.

[0049] In some examples, the computer program 9 can comprise an audio signal processing application. The audio signal processing application can be arranged to obtain spatial information 39 from a first set of microphones 23 and use the spatial information 39 to spatially process 45 one or more signals obtained from a second set of microphones 27. The first set of microphones 23 can be provided within the electronic device 21 and the second set of microphones 27 can be positioned externally to the electronic device 21 such that the second set of microphones 27 obtain higher quality audio signals than the first set of microphones 23. The higher quality audio signals can have a higher signal to noise ratio, can be better protected from external noise such as wind, or can have any other parameter which enables a better audio signal to be provided to a user.

[0050] Thus, the apparatus 1 comprises: processing circuitry 5; and a memory circuit 7 comprising computer program code 11, the memory circuit 7 and the computer program code 11 configured to, with the processing circuitry 5, cause the apparatus 1 at least to perform: obtaining 51 spatial information 39 relating to a sound field captured from a first set of microphones 23; obtaining 53 one or more signals from a second set of microphones, wherein the one or more signals relate to the captured sound field; and processing the one or more signals obtained from the second set of microphones 27 using the spatial information 39 obtained from the first set of microphones 23; wherein the first set of microphones 23 is provided within the electronic device 21 and the second set of microphones 27 is provided externally to the electronic device 21.

[0051] The computer program 9 can arrive at the apparatus 1 via any suitable delivery mechanism. The delivery mechanism can be, for example, a non-transitory computer-readable storage medium, a computer program product, a memory device, a record medium such as a Compact Disc-Read Only Memory (CD-ROM) or Digital Versatile Disc (DVD), or an article of manufacture that tangibly embodies the computer program. The delivery mechanism can be a signal configured to reliably transfer the computer program 9. The apparatus 1 can cause the computer program 9 to be communicated or transferred to the apparatus 1 by any medium such as a communication network. In some examples, the computer program code 11 can be transmitted to the apparatus 1 using a wireless protocol such as Bluetooth, Bluetooth Low Energy, Bluetooth Smart, 6LoWPan (IPv6 over Low power Personal Area Networks), ZigBee, ANT+, Near Field Communication (NFC), Radio Frequency Identification, Wireless Local Area Network (Wireless LAN) or any other suitable protocol.

[0052] Although the memory circuitry 7 is illustrated as a single component in the figure, it will be appreciated that the memory circuitry 7 can be implemented as one or more separate components, some or all of which can be integrated / removable, and / or can provide persistent / semi-persistent / dynamic / cached storage.

[0053] Although the processing circuitry 5 is illustrated as a single component in the figure, it will be appreciated that the processing circuitry 5 can be implemented as one or more separate components, some or all of which can be integrated / removable.

[0054] References to ‘computer-readable storage medium’, ‘computer program product’, ‘tangibly embodied computer program’ etc., or a ‘controller’, ‘computer’, ‘processor’ etc. should be understood to encompass not only computers having different architectures such as single / multi- processor architectures and simplified instruction set computers (RISC) and complex instruction set computers (CISC), but also specialized circuits such as field- programmable gate arrays (FPGA), application specific circuits (ASIC), signal processing devices and other processing circuitry. References to computer program, instructions, code etc. should be understood to encompass software for a programmable processor or firmware such as, for example, the programmable content of a computer

[0055] As used in this application, the term ‘circuitry’ refers to all of the following:

[0056] (a) hardware-only circuitry such as only analog and / or digital circuitry, and

[0057] (b) combinations of circuits and software (and / or firmware), such as (as applicable): (i) to a combination of processor(s) or (ii) to portions of storage that function as a combination of processor(s) / software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions and

[0058] (c) to circuits, such as a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation, even if the software or firmware is not physically present.

[0059] This definition of “circuitry” applies to all uses of this term in this application, including in any claims. As a further example, a

[0060] Figure 2 An example electronic device 21 is schematically illustrated. The electronic device 21 comprises an apparatus 1 comprising a processing circuitry 5 and a memory circuitry 7 as described hereinabove. Corresponding reference numerals are used for corresponding features. In addition to the apparatus 1, Figure 2 The example electronic device of Fig. 1 further comprises a first set of microphones 23, a camera array 25, and an interface 29. It should be understood that the electronic device 21 can comprise Figure 2 other features not illustrated in Fig. 1, such as a power source, a refrigeration component, or any other suitable features.

[0061] Figure 2 A second set of microphones 27 is also illustrated. The second set of microphones 27 is provided external to the electronic device 21. Figure 2 The example electronic device 21 of Fig. 1 can be configured to enable spatial information 39 related to a captured sound field to be obtained. The captured sound field can comprise one or more sound sources. The spatial information 39 can be used to process one or more signals obtained by the second set of microphones 27.

[0062] The first set of microphones 23 can include any components capable of obtaining spatial information 39 related to audio signals. The microphones within the first set of microphones 23 can include any components that can be configured to convert acoustic input signals into electrical output signals. The first set of microphones 23 can be coupled to the apparatus 1 to enable the apparatus 1 to process signals 31 detected by the first set of microphones 23 and obtain spatial information 39 related to the signals 31. The signals 31 can be related to a captured soundfield. The first set of microphones 23 can enable at least a portion of a soundfield to be captured. The first set of microphones 23 can enable signal information from spatially sampled locations in a soundfield to be obtained.

[0063] The first set of microphones 23 includes a plurality of microphones. The plurality of microphones are arranged at different locations within the electronic device 21 to enable spatial information 39 to be obtained by the first set of microphones 23. The spatial information 39 can include any information that can be used for spatial processing 45 of one or more signals 33 obtained by the second set of microphones 27. The spatial information 39 includes information indicative of spatial parameters, such as directional parameters. The spatial information can include information indicative of directional properties of a captured soundfield. In some examples, the spatial information can include a ratio or energy parameter indicative of a directionality of a captured soundfield. The ratio or energy parameter can be indicative of how much of the captured acoustic energy is directional. The ratio or energy parameter can also be indicative of how much of the captured acoustic energy is non-directional. The non-directional acoustic energy can be diffuse acoustic energy, which can include reverberation or other ambient sound. The ratio or energy parameter can vary in time and / or frequency. It will be appreciated that directional parameters can vary in time and / or frequency.

[0064] Figure 2 The example electronic device 21 also includes a camera array 25. The cameras within the array 25 can include components capable of obtaining images. Each camera can include an image sensor that can be configured to convert light incident on the image sensor into an electrical signal to enable an image to be produced. The image sensor can include, for example, a digital image sensor such as a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS).

[0065] The camera array 25 can include a plurality of cameras. The plurality of cameras can be distributed throughout the electronic device 21 such that the camera array 25 can obtain a panoramic image or any other suitable type of image. The images obtained by the camera array 25 can be used for a presentation application, a virtual reality application, or any other suitable application. The camera array 25 can be located within the electronic device 21 to enable high quality images to be obtained. The location of the cameras within the electronic device 21 can limit the locations available for the first array of microphones 23 within the electronic device 21.

[0066] In other examples, the electronic device 21 can include a single camera that can be arranged to obtain a panoramic image or a three-dimensional image or any other suitable type of image. In other examples, the electronic device can include components other than a camera.

[0067] The array of cameras 25 can be arranged to obtain still images and / or video images. The array of cameras 25 can be arranged to obtain images at the same time as the first array of microphones 23 obtains audio signals.

[0068] The array of cameras 25 can be coupled to the apparatus 1 to enable the apparatus 1 to process image signals detected by the array of cameras 25.

[0069] The interface 29 can include any means that can enable the electronic device 21 to exchange information with another electronic device. In Figure 2 In examples in which the interface 29 is arranged to enable the electronic device 21 to exchange information with the second set of microphones 27, the interface 29 can be arranged to enable the electronic device 21 to exchange information with the second set of microphones 27 via a wired connection or other physical connection. In other examples, the interface 29 can be arranged to enable the electronic device 21 to exchange information with the second set of microphones 27 via a wireless communication connection. The wireless communication connection can be a short-range wireless communication connection or any other suitable type of wireless communication connection.

[0070] In some examples, the interface 29 can include a wired connection or other physical connection. In other examples, the interface 29 can include one or more transceivers that can enable a wireless communication connection between the electronic device 21 and the second set of microphones 27. The wireless communication connection can be a short-range wireless communication connection or any other suitable type of wireless communication connection.

[0071] In Figure 2 In examples in which the second set of microphones 27 is provided, the second set of microphones 27 can be provided externally to the electronic device 21. The second set of microphones 27 can be provided externally to the housing of the electronic device 21, while the first set of microphones 23 is provided internally to the housing of the electronic device 21.

[0072] In Figure 2In some examples, the second set of microphones 27 can be provided separate from the electronic device 21. In such examples, there is no physical connection between the second set of microphones 27 and the electronic device 21. In such examples, the electronic device 21 and the second set of microphones 27 can exchange information via a wireless connection. This can enable the second set of microphones 27 to move relative to the electronic device 21.

[0073] In other examples, the second set of microphones 27 can be provided separate from the electronic device 21. In such examples, there is no physical connection between the second set of microphones 27 and the electronic device 21. In such examples, the electronic device 21 and the second set of microphones 27 can exchange information via a wireless connection. This can enable the second set of microphones 27 to move relative to the electronic device 21.

[0074] The second set of microphones 27 is provided in proximity to the electronic device 21. The second set of microphones 27 can be provided in proximity to the electronic device 21 such that the first set of microphones 23 and the second set of microphones 27 are in similar acoustic fields. The second set of microphones 27 can enable at least a portion of an acoustic field to be captured. The second set of microphones 27 can enable signal information from an acoustic field to be obtained. The second set of microphones 27 can be positioned in proximity to the electronic device 21 such that the first set of microphones 23 and the second set of microphones 27 detect the same or substantially the same audio signals from the sound source 47.

[0075] The second set of microphones 27 can include any components that enable signals to be obtained. The microphones within the second set of microphones 27 can include any components that can be configured to convert acoustic input signals into electrical output signals.

[0076] The second set of microphones 27 can be arranged to exchange information with the electronic device 21 via the interface 29. This enables the apparatus 1 within the electronic device 21 to obtain one or more signals 33 relating to a captured acoustic field captured by the second set of microphones 27. The apparatus 1 can then process the one or more signals 33 captured by the second set of microphones 27 using the spatial information 39 obtained from the first set of microphones 23.

[0077] The second set of microphones 27 can include any suitable number of microphones. In some examples, the second set of microphones 27 can include a single microphone. In other examples, the second set of microphones 27 can include two or more microphones.

[0078] The first set of microphones 23 can include more microphones than the second set of microphones 27. The number and position of the microphones in the first set 23 can be arranged to optimize the obtaining 51 of spatial information 39 of the audio signals. The number and position of the microphones in the second set 27 can be optimized to obtain high quality audio signals. The second set of microphones 27 need not be arranged to obtain spatial information, as the spatial information 39 used for spatial processing 45 is obtained from the first set of microphones 23.

[0079] The second set of microphones 27 can be arranged to obtain higher quality audio signals than the first set of microphones 23. In some examples, the second set of microphones 27 can be arranged to obtain higher quality audio signals by being positioned separately from the electronic device 21. In such examples, the audio signals obtained by the first set of microphones 23 will detect noise made by components of the electronic device 21, as the microphones 23 in the first set 23 are positioned close to these components. For example, components such as the camera array 25, a cooling component such as a fan, or any other component of the electronic device 21 can generate noise that will be detected by the first set of microphones 23. This will distort the signals 31 captured by the first set of microphones 23. As the second set of microphones 27 is external to the electronic device 21, the second set of microphones 27 does not detect the noise generated by these components, and therefore, the signal or signals captured by the second set of microphones 27 have a higher signal-to-noise ratio.

[0080] In some examples, the second set of microphones 27 can be arranged to obtain higher quality audio signals, as the second set of microphones 27 can include higher quality microphones than the first set of microphones 23. For example, the second set of microphones 27 can include microphones with larger diaphragms than the first set of microphones 23. A large diaphragm can provide a high signal-to-noise ratio in any captured audio signals. The diameter of a large diaphragm can exceed 2 cm or any other suitable size, while a smaller diaphragm can be approximately 1 mm.

[0081] In some examples, the second set of microphones 27 can be arranged to obtain higher quality audio signals, since the microphones in the second set 27 can be arranged to be protected from parameters that can distort the captured audio signals. For example, the second set of microphones 27 can be shielded to protect the microphones within the set 27 from detecting wind noise. It can not be feasible to provide such shielding for the first set of microphones 23, since such shielding can impede obtaining images by the camera array 25, and / or can increase the complexity of the electronic device 21.

[0082] In Figure 2 examples, the apparatus 1 that obtains signals from the sets of microphones 23, 25 and performs spatial processing 45 is provided within the electronic device 21, which also comprises the first set of microphones 23. It will be appreciated that the apparatus 1 can be provided in any suitable electronic device 21. For example, in some examples, the apparatus 1 can be provided in a remote device, such as a server, a playback device or other processing device. The remote device can be arranged to receive signals comprising spatial information 39 from the first set of microphones, and signals comprising audio signals captured by the second set of microphones 27. Then, some or all of the processing of the audio signals can be performed remotely from the electronic device 21 and the second set of microphones 27.

[0083] Figure 3 An electronic device 21 and a second set of microphones 27 that can be used in some examples of the present disclosure are illustrated.

[0084] In Figure 3 examples, the electronic device 21 comprises a presentation capture device. The presentation capture device comprises a spherical or substantially spherical housing having a set of cameras 25 distributed around the housing. Other shapes of the housing can be used in other examples of the present disclosure. The set of cameras 25 can be arranged to obtain panoramic images (such as 360° degree images) or other suitable images.

[0085] The first set of microphones 23 is provided within the spherical housing of the electronic device 21. The first set of microphones 23 can comprise any suitable number of microphones that enable spatial information to be obtained. In Figure 3 examples, the electronic device 21 can comprise eight microphones. In other examples, the electronic device 21 can comprise at least three microphones to enable sufficient spatial information 39 to be obtained.

[0086] In some examples of the present disclosure, the first set of microphones can be arranged in a predetermined geometry. The predetermined geometry can be fixed within the housing of the electronic device 21. The predetermined geometry can depend on the electronic device 21 and the functions that the electronic device 21 is arranged to perform. For example, inFigure 3 In examples in which the electronic device 21 is arranged for presentation capture, the first set of microphones 23 can comprise eight microphones arranged in a cubic geometry. A microphone can be provided on each corner of the cube. Other geometries can be used in other examples of the disclosure. In Figure 3 In examples in which the electronic device 21 is arranged for presentation capture, the first set of microphones 23 can comprise eight microphones arranged in a cubic geometry. A microphone can be provided on each corner of the cube. Other geometries can be used in other examples of the disclosure. In

[0087] The microphones within the first set of microphones 23 can be small and / or low cost microphones. This can reduce the amount of space required for the microphones within the electronic device 21. This can also keep the cost of the electronic device 21 to a minimum.

[0088] In examples in which the electronic device 21 is arranged for presentation capture, the first set of microphones 23 can comprise eight microphones arranged in a cubic geometry. A microphone can be provided on each corner of the cube. Other geometries can be used in other examples of the disclosure. In Figure 3 In examples in which the electronic device 21 is arranged for presentation capture, the first set of microphones 23 can comprise eight microphones arranged in a cubic geometry. A microphone can be provided on each corner of the cube. Other geometries can be used in other examples of the disclosure. In Figure 3 In examples in which the electronic device 21 is arranged for presentation capture, the first set of microphones 23 can comprise eight microphones arranged in a cubic geometry. A microphone can be provided on each corner of the cube. Other geometries can be used in other examples of the disclosure. In

[0089] The second set of microphones 27 is arranged to obtain high quality audio signals. The high quality audio signals can have a high signal to noise ratio. The high quality audio signals can have a high signal to noise ratio compared to the signals obtained by the first set of microphones 23.

[0090] In some examples, the microphones within the second set of microphones 27 can comprise high quality microphones, such as AKG C414 XLS. These microphones can have a signal to noise ratio of 88dB. The microphones provided within the first set of microphones 23 can comprise small microphones which have a signal to noise ratio of 65dB for the same audio signal level. Even without taking into account factors such as noise from other components in the electronic device 21, the difference in signal to noise ratio can be clearly audible to a user.

[0091] The second set of microphones 27 is positioned sufficiently close to the electronic device 21 so that the first set of microphones 23 and the second set of microphones 27 detect the same audio signal. In some examples, the second set of microphones 27 may be positioned within 0.3m to 0.8m of the electronic device 21. Other distances may be used in other examples of this disclosure.

[0092] The second set of microphones 27 can be positioned at any suitable location relative to the electronic device 21. The second set of microphones 27 can be positioned relative to the electronic device 21 such that it does not obstruct the camera array 25 within the electronic device 21. Figure 3 In this example, the second set 27 of microphones is positioned below the electronic device 21. In other examples, the second set 27 of microphones may be positioned at a different location relative to the electronic device 21.

[0093] exist Figure 3 In the example, the second set 27 of microphones includes two microphones. Using two microphones allows signals suitable for playback in headphones to be captured. Using two microphones enables binaural synthesis of two audio channels captured by the two microphones. Using two microphones avoids the need for a decorrelation unit, which might be required if only one microphone is used. Using a decorrelation unit can negatively impact the perceived quality of some audio signals. In some examples, the second set 27 may include more than two microphones; however, in some examples of this disclosure, the additional information obtained from the additional microphones may not provide any additional useful information.

[0094] exist Figure 3 In the example, signal 31 captured by the first set of microphones 23 and signal 33 captured by the second set of microphones 27 are synchronized 35. Since the two sets of microphones 23, 27 are positioned close to each other, the captured signals 31, 33 can represent audio signals from the same sound source 47.

[0095] Using any suitable procedure, the two captured signals 31, 33 are temporarily synchronized to ensure that spatial processing of signal 33 obtained by the second set 27 of microphones is robust. The synchronization of captured signals 31, 33 can be performed by device 1 within electronic device 21.

[0096] exist Figure 3In the example of FIG. 1, synchronization is performed on signals 31, 33 captured by the set of microphones 23, 27. In other examples, synchronization can be performed at different stages of processing. For example, in some examples, synchronization can be performed on one or more signals captured by the second set of microphones 27 and spatial information 39 obtained from signals 31 captured by the first set of microphones 23. In some examples, synchronization can be performed on one or more signals captured by the second set of microphones 27 and spatial information 39 obtained from signals 31 obtained by the first set of microphones 23.

[0097] Any suitable technique can be used for synchronization. In some examples, synchronization can comprise using offline impulse response measurements, by using correlation measurements between signals 31, 33 captured by respective sets 23, 27, by using time codes that can be attached to signals 31, 33 during audio capture, by manual synchronization or using any other suitable technique.

[0098] Signals 31 captured by the first set of microphones 23 can be processed 37 using any suitable spatial audio capture (SPAC) technique to obtain spatial information 39 relating to the audio signals. The spatial information 39 obtained can comprise directional information. The spatial information 39 can comprise directional properties indicative of the captured soundfield. In some examples, the spatial information can comprise a ratio or energy parameter indicative of the directionality of the captured soundfield. The ratio or energy parameter can be indicative of how much of the captured sound energy is directional. The ratio or energy parameter can vary in time and / or frequency. The information can correspond to how human hearing perceives spatial audio information. The spatial information 39 can thus enable accurate spatial sound reproduction.

[0099] It will be appreciated that any suitable technique can be used for obtaining spatial information 39 from signals 31 captured by the first set of microphones 23. In some examples, the technique can comprise directional audio coding (DirAC). Directional audio coding can comprise adaptively estimating a sound intensity vector in time and frequency. Directional parameters can then be obtained from the sound intensity vector. Directional audio coding can further comprise estimating a ratio parameter based on an absolute value of a soundfield intensity with respect to a soundfield energy in a time-frequency interval.

[0100] In some examples, the technique for obtaining spatial information 39 can comprise Harmonic Planewave Expansion (HARPEX). Harmonic Planewave Expansion can comprise estimating two simultaneous directions of arrival for each of a plurality of time-frequency intervals. In such examples, a ratio parameter based on the absolute value of the soundfield intensity, or other similar parameter, is not estimated as in directional audio coding. In examples using Harmonic Planewave Expansion, this information is inherent within the two directions of arrival, as the directions of arrival will fluctuate rapidly in time-frequency bins where the directional energy is small.

[0101] Other techniques for obtaining spatial information 39 can be used in other examples of the disclosure.

[0102] The one or more signals 33 captured by the second set of microphones 27 are related to the captured soundfield. The one or more signals 33 captured by the second set of microphones 27 can be processed 41 to obtain a high quality audio signal 43. The high quality audio signal 43 can have a high signal to noise ratio, but can not include sufficient information for the spatial audio signal to be rendered. The processing 41 can comprise equalisation, dynamic processing or any other suitable processing. In some examples, the processing 41 of the signals 33 obtained by the second set of microphones can be omitted.

[0103] The high quality audio signal 43 is spatially processed 45 using the spatial information 39. In some examples, the high quality audio signal 43 can be spatially processed by the apparatus 1 within the electronic device 21. In other examples, the high quality audio signal 43 can be spatially processed by a remote apparatus 1.

[0104] In examples where the spatial processing 45 is performed by a remote apparatus 1, the electronic device 21 can be arranged to transmit the spatial information 39 and the high quality audio signal 43 to the remote apparatus 1. In such examples, the spatial information 39 can be associated with the high quality audio signal 43 before the high quality audio signal 43 is transmitted. The association between the high quality audio signal 43 and the spatial information 39 combines the information in the two signals so that they can be transmitted and / or stored together. The spatial information 43 and the high quality audio signal 43 can be encoded and transmitted to the remote apparatus 1. Any suitable technique can be used for encoding and subsequent decoding by the remote apparatus 1.

[0105] In Figure 3In the example of FIG. 1, only the spatial information 39 from the signals 31 captured by the first set of microphones 23 is needed. Other information in the signals 31 is not needed. In such an example, once the spatial information 39 has been obtained, the signals 31 captured by the first set of microphones 23 are not used. This can cause the signals 31 captured by the first set of microphones 23 to be discarded after the spatial information 39 has been obtained. In such an example, the signals 31 captured by the first set of microphones need not be stored in the memory circuit 7 and / or transmitted to the remote device 1.

[0106] The spatial processing 45 can include any processing that combines the spatial information 39 with the high-quality audio signals 43 to provide high-quality spatial audio signals 79. The high-quality spatial audio signals 79 can include both a high signal-to-noise ratio of the signals 33 captured by the second set of microphones 27 and the spatial properties indicated by the spatial information 39 of the signals 31 captured by the first set of microphones 23.

[0107] Any suitable technique can be used for the spatial processing 45. In some examples, the spatial processing 45 can include a least-squares optimization mixing and decorrelation technique. Such a technique can process a spatial covariance matrix of the high-quality audio signals 43 in each of a plurality of frequency bands. The technique can include estimating an input signal covariance matrix and formulating mixing / decorrelation rules to process each of a plurality of frequency bands of the high-quality audio signals 43. This obtains target covariance properties that are indicative of the desired spatial characteristics.

[0108] In some examples, the spatial processing 45 can include dividing a frequency band of the high-quality audio signals 43 into a directional component and a non-directional component. A ratio parameter from the spatial information 39 that can be obtained using directional audio coding techniques can be used to divide the high-quality audio signals 43. The directional component can then be processed to a direction determined by the spatial information 39 using amplitude panning, head-related transfer functions (HRTFs), or any other suitable technique. The non-directional component can be processed to be spatially non-coherent.

[0109] The high-quality spatial audio signals 79 can be provided to an audio output device, such as a loudspeaker, headphones, or any other suitable output device.

[0110] In some examples, the spatial processing 45 can be performed by the apparatus 1 within the electronic device 1. In other examples, the spatial processing can be performed by the apparatus 1 within a remote device. In such examples, the signals obtained by the apparatus 1 of the electronic device 21 are encoded and transmitted to the remote device for processing. The signals can be encoded using any suitable processing, such as audio coding (AAC) or any other suitable technique. In some examples, the signals 33 captured by the second set of microphones 27 can be encoded and transmitted. The spatial information 39 obtained by the first set of microphones 23 can also be quantised and encoded, and associated with the encoded signals 33 captured by the second set of microphones 27. In some examples, the spatial information 39 can be provided as metadata within the encoded signals 33. In some examples, image information obtained from the electronic device 21 can also be included in the encoded signals 33.

[0111] Figure 4A and Figure 4B different arrangements of the electronic device 21 and the second set of microphones 27 are illustrated. In Figure 4A and Figure 4B In examples of the apparatus 1 described above with reference to Figure 3 the two high quality microphones described above with reference to the apparatus 1 can be included. Other electronic devices 21 and sets of microphones 23, 27 can be used in other examples of the disclosure.

[0112] In examples of the apparatus 1 described above with reference to Figure 4A and Figure 4B different distances are provided between the electronic device 21 and the second set of microphones 27. The distance between the electronic device 21 and the second set of microphones 27 can depend on the proximity of the electronic device 21 to the sound source, or the desired distance between the electronic device 21 and one or more sound sources 47 in the captured sound field.

[0113] In examples of the apparatus 1 described above with reference to Figure 4A and Figure 4B In examples of the apparatus 1 described above with reference to

[0114] In examples of the apparatus 1 described above with reference to Figure 4A The electronic device 21 and the second set of microphones 27 can be located remotely from the sound source 47. This arrangement can arise in large rooms, such as theatres or concert halls, where the electronic device 21 can be located tens of metres away from the sound source 47. As the electronic device 21 and the second set of microphones 27 are located remotely from the sound source 47, a large separation can be provided between the electronic device 21 and the second set of microphones 27. This can still enable the first set of microphones 23 and the second set of microphones 27 to substantially detect the same audio signals from the same sound source 47.Figure 4A In examples of the electronic device 21 and the second set of microphones 27 are located close to the sound source 47. This arrangement can arise in small rooms, such as conference rooms, where the electronic device 21 can be located within several metres of the sound source 47. It will be appreciated that in other arrangements the electronic device 21 can be located closer to the sound source 47.

[0115] In Figure 4B In examples of the electronic device 21 and the second set of microphones 27 are located close to the sound source 47. This arrangement can arise in small rooms, such as conference rooms, where the electronic device 21 can be located within several metres of the sound source 47. It will be appreciated that in other arrangements the electronic device 21 can be located closer to the sound source 47.

[0116] As the electronic device 21 and the second set of microphones 27 are located close to the sound source 47, a small separation can be provided between the electronic device 21 and the second set of microphones 27 in order to enable the first set of microphones 23 and the second set of microphones 27 to substantially detect the same audio signals. In Figure 4B In examples of the electronic device 21 and the second set of microphones 27 are located close to the sound source 47. This arrangement can arise in small rooms, such as conference rooms, where the electronic device 21 can be located within several metres of the sound source 47. It will be appreciated that in other arrangements the electronic device 21 can be located closer to the sound source 47.

[0117] It will be appreciated that other separations of the electronic device 21 and the second set of microphones 27 can be used in other examples of the disclosure. In some examples, the distance between the electronic device 21 and the second set of microphones 27 can be adjustable, such that a user can move the second set of microphones 27 relative to the electronic device 21. This can enable a user to vary the relative position in dependence on the relative positions of the electronic device 21 and the sound source 47. In other examples, the distance between the electronic device 21 and the second set of microphones 27 can be fixed. In such examples, the electronic device 21 can be optimised for obtaining images and audio at certain distances from the sound source 47.

[0118] Figure 5 A method according to examples of the disclosure is illustrated. The method can be implemented using the apparatus 1 and the electronic device 21 as described above. In some examples, the method can be implemented using the apparatus 1 within the electronic device 21 as described above. In other examples, the method can be implemented by the apparatus 1 provided remotely from the set of microphones 23, 27.

[0119] The method comprises, at block 51, obtaining spatial information 39 relating to a sound field captured from the first set of microphones 23. The method further comprises, at block 53, obtaining one or more signals from the second set of microphones 27, wherein the one or more signals relate to the captured sound field, and processing the one or more signals obtained from the second set of microphones 27 using the spatial information 39 obtained from the first set of microphones 23. The first set of microphones 23 is provided within the electronic device 21, and the second set of microphones 27 is provided external to the electronic device 21.

[0120] Figure 6 The illustration shows a method that can be used to process signals 31 captured by a first set 23 of microphones to obtain spatial information 39 associated with the audio signal. This method can... Figure 3 The operation was executed at box 37. Figure 6 Before the method is executed, the signal 31 captured by the first set of microphones 23 is synchronized with the signal 33 captured by the second set of microphones 27.

[0121] Figure 6 The example method can be executed by device 1 of electronic device 21. In other examples, signal 31 captured by a first set 23 of microphones can be provided to remote device 1 to enable remote device 1 to execute the method or at least a portion thereof.

[0122] At frame 61, the signal 31 captured by the first set 23 of microphones is received by device 1. Figure 6 In the example, signal 31 can be provided in digital form. Figure 6 In the example, pulse code modulation (PCM) is performed to convert the analog signal captured by the microphone into a digital form. Other techniques may be used in other examples of this disclosure.

[0123] At box 63, signal 31 is decomposed into multiple frequency bands. Signal 31 can be decomposed into multiple frequency bands using any suitable component. Figure 6 In the example, a filter bank is used to decompose signal 31 into frequency bands. The filter bank may include a short-time Fourier transform (STFT), a complex modulation quadrature mirror filter (QMF) bank, or any other suitable component.

[0124] At box 65, the random properties of each of the multiple frequency bands are estimated. These random properties can be used to obtain spatial information.

[0125] exist Figure 6 In the example method, spherical harmonic transformation can also be performed at block 65. The spherical harmonic transformation may include a microphone signal preprocessing application that transforms multiple frequency bands of signal 31 captured by a first set 23 of microphones into spherical harmonics, such as B-format signals. The B-format signals may include four spherical harmonic signals. These four spherical harmonic signals may include an omnidirectional signal and three figure-eight signals orthogonally organized to each other. The three figure-eight signals may be aligned with the x-axis, y-axis, and z-axis. Other directional format signals may be used in other examples of this disclosure.

[0126] exist Figure 6In the example, the directional format signal is used to estimate short-time random properties. Any suitable technique can be used to estimate short-time random properties. In some examples, the technique may include developing a cross-correlation of the omnidirectional signal with respect to each of the figure-eight signals. The result of the cross-correlation is a sound field intensity vector, which is used in techniques such as directional audio coding.

[0127] For each frequency band and for multiple different time intervals, short-time random properties can be estimated. The averaging operator can be used over different frequency intervals and / or time intervals.

[0128] At box 67, once the short-time random estimate has been obtained, spatial information 39 is acquired. Figure 6 In the example, model parameter estimation is used to obtain spatial information 39 from short-time stochastic estimates. Spatial information 39 may include direction of arrival, direct-to-total energy ratio, and any other suitable information. The direction of arrival parameter indicates the direction of arrival of the sound, and the direct-to-total ratio indicates that the proportion of sound energy is directional. Other parameters may be used in other examples of this disclosure. For example, parameters may include information such as the direct-to-ambient ratio or the ambient-to-total ratio. Spatial information 39 can be obtained for each frequency band in the frequency band.

[0129] Spatial information 39 can be stored in the memory circuit 7 of device 1, so that spatial information 39 can be used for spatial processing 45. In some examples, spatial information 39 can be transmitted to another electronic device so that spatial processing 45 can be performed by the other electronic device.

[0130] Figure 7 The illustration depicts a method that can be used for spatial processing of signal 33 captured by a second set 27 of microphones. This method can... Figure 3 Block 45 was executed. Figure 7 Before the method is executed, signal 33 is captured by the second set 27 of microphones and synchronized with signal 31 captured by the first set 23 of microphones.

[0131] Figure 7 The example method can be executed by device 1 of electronic device 21. In other examples, signal 33 obtained by a second set 27 of microphones can be provided to remote device 1 to enable remote device 1 to execute the method or at least a portion thereof.

[0132] At frame 71, signal 33 captured by the second set 27 of microphones is received by device 1.Figure 7 In examples where the signal 33 is provided in digital form, the signal 33 can be provided directly to the filter bank. Figure 7 In examples where the signal 33 is provided in digital form, pulse code modulation (PCM) is performed to convert the analog signal to digital form. Other techniques can be used in other examples of the disclosure.

[0133] At block 73, the signal 33 is decomposed into a plurality of frequency bands. The signal 33 can be decomposed into a plurality of frequency bands using any suitable component. In examples where the signal 33 is provided in digital form, a filter bank is used to decompose the signal 33 into frequency bands. The filter bank can include a short time Fourier transform (STFT), a complex modulated quadrature mirror filter (QMF) bank, or any other suitable component. Figure 7

[0134] At block 75, each of the frequency bands is spatially processed using the spatial information 39 obtained from the first set of microphones 23.

[0135] In some examples, the orientation of the user’s head can also be used to spatially process the frequency bands of the signal 33 captured by the second set of microphones 29. In such examples, an indication of the user’s head position is received at block 75. The indication of the user’s head position can be used to rotate directional parameters within the spatial information 39 so that the directional parameters correspond to the current position of the user’s head. The indication of the user’s head position can be obtained from the head mounted display or any other suitable device. The directional parameters are considered as vectors, and a rotation matrix or any other suitable processing can be used to make the directional parameters of the spatial information 39 correspond to the current position of the user’s head.

[0136] Any suitable technique can be used for spatial processing. In some examples, the spatial processing can include a covariance matrix based technique. In such examples, a mixing rule can be formulated for the input frequency bands so that the output signal has directional properties determined by the spatial information 39. The mixing rule can be determined for each of the output frequency bands.

[0137] At block 77, the spatially processed signal is transformed into a time domain signal. The spatially processed signal can be transformed into the time domain using an inverse filter bank or any other suitable technique.

[0138] This provides a high quality spatial audio signal 79. The high quality spatial audio signal 79 uses the high signal to noise ratio of the signal 33 captured by the second set of microphones 27, and the spatial information 39 obtained from the signal 31 captured by the first set of microphones 23. The high quality audio signal 79 can be provided to an output device, such as a loudspeaker, headphones for playback to the user.

[0139] ​Examples of the present disclosure provide an apparatus 1, an electronic device 21 and a method for providing high quality spatial audio signals 79. In examples of the present disclosure, spatial information 39 is derived from a first set of microphones 23 and high quality audio signals 43 are derived from a second set of microphones 27. As the different sets of microphones 23, 27 can be arranged to obtain different information, the different sets 23, 27 can be optimized for specific purposes. For example, the number and position of the microphones within the first set of microphones 23 can be optimized to enable spatial information 39 to be obtained; while the parameters of the microphones in the second set 27 can be optimized to enable high quality audio signals 43 to be captured, but need not be arranged to obtain spatial information 39.

[0140] Examples of the present disclosure also enable high quality microphones to be used in the second set of microphones 27. High quality microphones can be used to record audio signals during periods of occasional silence or very low signal levels. This can be useful for examples of the present disclosure to obtain high quality spatial audio signals 79 from different types of sound sources 47. For example, the second set of microphones can be suitable for obtaining high quality recordings of classical music or other similar sound sources 47.

[0141] Examples of the present disclosure also allow the second set of microphones 27 to be protected from environmental parameters such as wind. This can be useful for embodiments in which the electronic device 21 is used to capture images of outdoor scenes, as it can not be possible to protect the first set of microphones 23 from these parameters.

[0142] As the second set of microphones 27 is provided externally to the electronic device 21, this can enable different types of microphones to be used with the same electronic device 21. For example, this can enable a user to use a first type of microphone within the second set 27 to record audio from a first sound source 47, and a second different type of microphone to record audio from a second sound source 47. Different types of microphones can be optimized for capturing different types of audio signals from different types of sound sources 47.

[0143] As the second set of microphones 27 is provided externally to the electronic device 21, this can also enable a user to select a directional pick-up pattern for the second set of microphones 27. For example, the user can select a directional pick-up pattern such that sound from a particular direction is attenuated. This can enable sound from the electronic device 21 or other noise sources to be attenuated, such that the second set of microphones 27 can provide a higher signal to noise ratio.

[0144] The term "comprise", used in this document, has the inclusive, rather than the exclusive, meaning. That is, any reference to X comprising Y indicates that X can comprise only one Y or can comprise more than one Y. If it is intended that "comprising" has a exclusive meaning, then the context will make that clear, either by referring to "comprising only one... " or by using "consisting of".

[0145] In this brief description, reference has been made to various examples. The description of features or functions in relation to an example indicates that those features or functions are present in that example. The use of the term "example" or "for example" in the text denotes, whether explicitly stated or not, that these features or functions are among the examples, whether described in that example or not, and that they can be, but not necessarily are, present in some or all other examples. Thus "example", "for example" or "can" are used in the sense of "indicate an example, but not necessarily an example only". An example can be implicit rather than explicit. This shall be understood for the avoidance of doubt. The disclosure of features in the description and / or claims can be phrased using the term "comprising" or "comprises" rather than "consisting of" or "consists of". This should be understood as implying that features other than those expressly stated may also be present. In some examples, a feature can be considered to be "optional". This can apply where the feature is explicit described as being optional, or where the feature is implicit, such as where the feature is described in relation to another feature using the term "comprising" or "comprises".

[0146] Although examples of the disclosure have been described in the preceding paragraphs in the context of various examples, it should be understood that modifications can be made to the given examples without departing from the scope of the disclosure as claimed. For example, in the examples described above, a connection can be provided to enable information to be exchanged between the electronic device 21 and the second set of microphones 27. In other examples, a connection can not be required, as the electronic device 21 and the second set of microphones 27 can be arranged to exchange information using a remote device. The remote device can perform processing of the signals 31, 33 captured by the sets of microphones 23, 27. The processing can be performed in real-time as the signals are received by the remote device. In other examples, the signals 31, 33 can be stored by the remote device and the processing can be performed at a later time.

[0147] Features described in the preceding description can be used in combinations other than the combinations explicitly described.

[0148] Although functions have been described with reference to certain features, those functions can be performed by other features whether described or not.

[0149] Although features have been described with reference to certain embodiments, those features can also be present in other embodiments whether described or not.

[0150] While efforts have been made to accord the invention the attention it deserves, it is to be appreciated that the application is entitled to protection encompassing any legitimate application or combination of the subject matter recited and / or shown in the foregoing disclosure and / or attachments, whether or not it is particularly emphasized.

Claims

1. An apparatus comprising: At least one processor; as well as At least one non-transitory memory, including computer program code. When the computer program code is executed by the at least one processor, the device: Spatial information relating to the captured sound field is obtained, at least in part, based on multiple signals captured by a first set of microphones arranged in a microphone array, wherein the spatial information is based on frequency band analysis of the multiple signals captured for multiple time intervals. One or more signals are obtained from a second set of microphones, wherein the one or more signals are associated with a captured sound field, wherein the second set of microphones is provided outside the microphone arrangement; Encoding the one or more signals and the spatial information; and One or more coded signals and coded spatial information are sent to a remote device, wherein the spatial information is configured to process the one or more signals for reproduction.

2. The apparatus according to claim 1, wherein, The second set of microphones is arranged to obtain an audio signal of higher quality than that obtained with the first set of microphones.

3. The apparatus according to claim 1, wherein, The second set of microphones has at least one of the following: Includes one or more microphones of higher quality than the first set of microphones, and Separate from components that reduce the quality of the one or more signals.

4. The apparatus according to claim 1, wherein, The obtained spatial information includes at least one of the following: At least one reaches the direction of the sound. Information related to the directional and non-directional components of the captured sound field. At least one direct ratio to total energy. At least one direct environmental ratio, At least one environment to total energy ratio, and At least one diffuse sound energy.

5. The apparatus according to claim 1, wherein, The first set of microphones includes more microphones than the second set of microphones.

6. The apparatus according to claim 1, wherein, Obtaining the spatial information includes the computer program code, when executed by the at least one processor, causing the device to: receive the spatial information from another device.

7. The apparatus according to claim 1, wherein, Obtaining the spatial information includes the computer program code, when executed by the at least one processor, causing the device to: perform the frequency band analysis of the captured multiple signals for the multiple time intervals to generate the spatial information.

8. The apparatus according to claim 7, wherein, Performing the frequency band analysis of the captured multiple signals includes determining at least directional parameters and ratio parameters for frequency bands in multiple frequency bands of the captured multiple signals.

9. The apparatus according to claim 7, wherein, Performing the frequency band analysis includes: determining a first direction parameter for a first frequency band of the captured multiple signals for the multiple time intervals, and determining a second direction parameter for a second frequency band of the captured multiple signals for the multiple time intervals.

10. A method comprising: Spatial information relating to the captured sound field is obtained, at least in part, based on multiple signals captured by a first set of microphones arranged in a microphone array, wherein the spatial information is based on frequency band analysis of the multiple signals captured for multiple time intervals. One or more signals are obtained from a second set of microphones, wherein the one or more signals are associated with a captured sound field, wherein the second set of microphones is provided outside the microphone arrangement; Encoding the one or more signals and the spatial information; and One or more coded signals and coded spatial information are sent to a remote device, wherein the spatial information is configured to process the one or more signals for reproduction.

11. An apparatus comprising: At least one processor; as well as At least one non-transitory memory, including computer program code. When the computer program code is executed by the at least one processor, the device: At least in part, based on multiple signals captured by a first set of microphones forming a microphone arrangement, an encoded bitstream comprising spatial information associated with a captured sound field is obtained, wherein the spatial information is based on frequency band analysis of the multiple signals for multiple time intervals, wherein the encoded bitstream further comprises one or more signals from a second set of microphones, wherein the one or more signals are associated with the captured sound field, wherein the second set of microphones is provided outside the microphone arrangement; Decoding the one or more signals and the spatial information; and Based on the decoded spatial information, one or more decoded signals are processed, wherein processing the one or more decoded signals enables the device to: Divide the one or more decoded signals into multiple frequency bands, and The multiple frequency bands are processed based on the decoded spatial information.

12. The apparatus according to claim 11, wherein, Processing the one or more decoded signals based on the decoded spatial information includes: processing the one or more decoded signals in space.

13. The apparatus according to claim 11, wherein, The decoded spatial information includes at least one of the following: At least one reaches the direction of the sound. Information related to the directional and non-directional components of the captured sound field. At least one direct ratio to total energy. At least one direct environmental ratio, At least one environment to total energy ratio, and At least one diffuse sound energy.

14. The apparatus according to claim 11, wherein, The spatial information includes metadata associated with the one or more signals.

15. The apparatus according to claim 11, wherein, The encoded bitstream further includes image information.

16. The apparatus according to claim 11, wherein, The decoded spatial information includes at least a direction parameter and a ratio parameter for the frequency bands in the plurality of frequency bands, wherein processing the plurality of frequency bands based on the decoded spatial information includes: processing the frequency bands in the plurality of frequency bands of the one or more decoded signals based at least on the direction parameter and the ratio parameter.

17. The apparatus according to claim 11, wherein, The decoded spatial information includes at least a first directional parameter for a first frequency band and a second directional parameter for a second frequency band, wherein processing the one or more decoded signals includes the computer program code, when executed by the at least one processor, further causing the apparatus to: The first frequency band of the one or more decoded signals is processed at least in part based on the first direction parameter, and the second frequency band of the one or more decoded signals is processed at least in part based on the second direction parameter.

18. A method comprising: At least in part, based on multiple signals captured by a first set of microphones forming a microphone arrangement, an encoded bitstream comprising spatial information associated with a captured sound field is obtained, wherein the spatial information is based on frequency band analysis of the multiple signals for multiple time intervals, wherein the encoded bitstream further comprises one or more signals from a second set of microphones, wherein the one or more signals are associated with the captured sound field, wherein the second set of microphones is provided outside the microphone arrangement; Decoding the one or more signals and the spatial information; and Based on the decoded spatial information, one or more decoded signals are processed, wherein processing the one or more decoded signals includes: Divide the one or more decoded signals into multiple frequency bands, and The multiple frequency bands are processed based on the decoded spatial information.

19. The method according to claim 18, wherein, Processing the one or more decoded signals based on the decoded spatial information includes: processing the one or more decoded signals in space.

20. The method according to claim 18, wherein, The decoded spatial information includes at least one of the following: At least one reaches the direction of the sound. Information related to the directional and non-directional components of the captured sound field. At least one direct-to-total energy ratio, at least one direct-to-environment ratio, at least one environment-to-total energy ratio, and At least one diffuse sound energy.

Images