Audio device and method for improving the listening experience of a far-end user

Abstract

An audio device (2) is disclosed for improving the listening experience of a far-end user. The audio device (2) includes a millimeter wave (MMW) antenna array (4) that includes two or more MMW antennas. The audio device (2) includes a MMW transducer (6) interconnected with the MMW antenna array (4). The MMW transducer (6) includes a MMW transmitter (8) for transmitting a first MMW signal into a spatial environment and a MMW receiver (10) for receiving a second MMW signal that is a reflected version of the first MMW signal caused by one or more objects in the spatial environment. The audio device (2) includes an audio processor (16) for performing adaptive noise suppression on an audio signal received by a microphone (14). Optionally, the noise suppression is based on an acoustic reverberation timing determined by the MMW processor (12) based on the second MMW signal.

Description

Technical Field

[0001] This invention relates to an audio device and a method performed in the audio device. More specifically, this disclosure relates to an audio device and method thereof, the audio device comprising a millimeter-wave antenna array, a millimeter-wave transducer, a millimeter-wave processor, an audio processor, and a communication management device. Background Technology

[0002] Using audio devices for conference calls or teleconferences can have several drawbacks that can lead to a degraded audio quality, especially for remote users participating in the call. Some common problems associated with the use of audio devices in conference calls include echo and feedback, background noise, reduced audio intelligibility, and speech intelligibility. Beamforming has been applied to the received audio signal to mitigate these problems, but this has proven insufficient to provide the desired overall quality for conference calls. Therefore, there is a need for improved audio devices and methods to implement these improvements. Summary of the Invention

[0003] This invention discloses an audio device for improving the listening experience of remote users. The audio device includes a millimeter-wave (MMW) antenna array comprising two or more MMW antennas. The MMW antenna array is used to receive and transmit MMW signals. The audio device includes an MMW transducer comprising an MMW transmitter and an MMW receiver. The MMW transducer is interconnected with the MMW antenna array. The MMW transmitter is configured to transmit a first MMW signal into a space environment. The MMW receiver is used to receive a second MMW signal. The second MMW signal is a reflected version of the first MMW signal caused by one or more objects in the space environment. The audio device may include an MMW processor configured to determine acoustic reverberation timing based on the second MMW signal. The audio device includes one or more microphones configured to receive the first audio signal from the space environment. The audio device includes an audio processor configured to perform adaptive noise suppression on the first audio signal. The adaptive noise suppression may be based on acoustic reverberation timing. The audio device includes a communication management unit configured to transmit a second audio signal to one or more external devices. The second audio signal includes an adaptive noise-suppressed representation of the first audio signal. The one or more external devices are configured for use by a remote user outside the spatial environment.

[0004] The advantage is that the present invention solves or at least reduces or mitigates at least some of the aforementioned problems. The disclosed invention provides improved audio quality and is therefore advantageous for providing an improved user experience for remote users. An advantage is that suppressing noise originating from reverberation can provide improved speech intelligibility or clarity.

[0005] Audio devices are used to enhance the listening experience for remote users. Audio devices can be audio conferencing equipment, conference room equipment, or speakerphone equipment. Audio devices can be used by both near-end users and remote users. Near-end users are one or more users provided in the same spatial environment as the audio device. Typically, the listening experience refers to the quality and satisfaction derived from the use of the audio device. While the listening experience can often be based on subjective assessments according to user preferences, it depends on objective and technical parameters such as the clarity, depth, and fidelity of the audio signal provided to the remote user. The remote user can include more than one remote user. Thus, the remote user can be one person or two or more individuals. A single remote user may use a hearing device (e.g., a headset) or an audio device (e.g., an audio conferencing device, conference room equipment, or speakerphone equipment). This single remote user may use an audio device included in or connected to an electronic device (such as a laptop or smartphone). The two or more remote users may use similar hearing devices, audio devices, or audio equipment, or any combination thereof, and the two or more remote users may share the same spatial environment, for example, the remote users may be in the same conference room, or the remote users may be in a separate spatial environment, for example, the remote users may be sitting in a separate room.

[0006] The audio device includes an MMW antenna array comprising two or more MMW antennas. The MMW antenna array is used to receive and transmit MMW signals. MMW signals can be defined as electromagnetic signals with frequencies from 26.5 GHz to 300 GHz and / or wavelengths from 1 mm to 11 mm. The relatively high frequency of MMW signals allows for the provision of a compact antenna array that can be easily adapted to the audio device. MMW signals are sensitive to obstacles, and the use of MMW communication typically requires effective line-of-sight communication. However, this is advantageous because it also means that MMW signals are sensitive to detecting one or more objects in the spatial environment. Two or more MMW antennas in the MMW antenna array can be arranged in a specific configuration, such as a phased array antenna, to achieve beamforming and directional control for transmitting or receiving MMW signals.

[0007] The audio device includes an MMW transducer comprising an MMW transmitter and an MMW receiver. The MMW transducer is interconnected with an MMW antenna array. The MMW transmitter is configured to transmit a first MMW signal into a spatial environment. The MMW receiver is configured to receive a second MMW signal. The second MMW signal is a reflected version of the first MMW signal caused by one or more objects in the spatial environment. The second MMW signal may include a second frequency and / or a second amplitude and / or a second phase. The MMW transmitter may include components such as a power amplifier to amplify the signal strength of the first MMW signal before transmission. The MMW receiver may include components such as a low-noise amplifier to amplify the second MMW signal. The MMW receiver may also include filtering and down-conversion components to extract and process the information carried by the second MMW signal. The spatial environment or space can be the environment in which the audio is located or provided, such as a room or conference room. It can be a small and / or confined environment or a large and / or open environment. One or more objects can be furniture, walls, etc., or people or animals.

[0008] The audio device may include an MMW processor configured to determine acoustic reverberation timing based on a second MMW signal. The MMW processor may be a digital signal processor (DSP). The MMW processor can be used to process MMW signals, such as a first MMW signal and a second MMW signal. The MMW processor may be configured to generate the first MMW signal. The audio device may further include an MMW generator configured to generate the first MMW signal. The MMW generator may be included within the MMW processor. The first MMW signal may be generated to include a first frequency and / or a first amplitude and / or a first phase. The MMW processor may include an MMW generator unit configured to generate the first MMW signal, or alternatively, the MMW generator unit may be a separate unit from the MMW processor, which may be included within the audio device. The MMW processor may be configured to provide various signal processing techniques known to those skilled in the art, such as signal modulation and / or demodulation and / or error correction. Acoustic reverberation is generally described as the phenomenon of sound waves reflecting off surfaces in an enclosed space or environment, resulting in the continuation of sound even after the original sound source has stopped producing sound. In other words, it is often described as the continuation of sound in a space due to multiple reflections. Reverberation timing is a parameter used to quantify the duration of reverberant sound in a space and can be measured as the time it takes for the sound level to decrease by 60 dB after the sound source stops. Several factors can affect reverberation timing, such as the size or extent of the space environment, and the surface materials, furniture, and objects within the space environment.

[0009] In order to accurately determine the acoustic reverberation timing based on the second MMW (millimeter wave) signal, the acoustic absorption characteristics of the environment can be considered.

[0010] The following describes a method that can be used to obtain sound absorption data from MMW signals: 1. Interaction of MMW signal with the environment: The MMW signal is transmitted into the environment, where it interacts with various surfaces and materials. As the signal propagates, it may experience attenuation and phase shift due to acoustic absorption by these materials.

[0011] 2. Measurement and Data Collection: The MMW signal is received back after interacting with the environment. The received signal data may include information about amplitude, phase, and frequency variations that indicate the acoustic characteristics of the environment.

[0012] 3. Mathematical Modeling: The variations in the received MMW signal are mathematically modeled in relation to acoustic absorption. The following equation represents this relationship: Received = Atransmitted e -a d

[0013] Areceived is the amplitude of the received MMW signal.

[0014] Atransmitted is the amplitude of the transmitted MMW signal.

[0015] α is the sound absorption coefficient of the material.

[0016] d is the distance the MMW signal travels.

[0017] 4. Algorithm Processing: Advanced algorithms are employed to process the received MMW signal data. These algorithms decompose the signal to identify components corresponding to specific acoustic absorption characteristics. The algorithms may involve Fourier transform, wavelet analysis, or other signal processing techniques for separating absorption effects.

[0018] 5. Calibration and Verification: The accuracy of the method can be verified using a known material with a predetermined sound absorption coefficient. The system can be adjusted to ensure that the extracted acoustic absorption data are accurate and reliable.

[0019] 6. Extraction of acoustic information: The processed data provides a detailed distribution of sound absorption in the environment. This information can then be used to adjust reverberation timing calculations, thereby ensuring that the timing accurately reflects acoustic conditions.

[0020] The audio device includes one or more microphones configured to receive a first audio signal from the space environment. The one or more microphones or one or more input converters may be configured to convert acoustic signals from the space environment into the first audio signal. The first audio signal may be an electrical signal. The first audio signal may be an analog signal. The first audio signal may be a digital signal. The one or more microphones may be coupled to one or more analog-to-digital converters configured to convert the analog signal into a digital signal.

[0021] The audio device includes an audio processor configured to perform adaptive noise suppression on the first audio signal. The adaptive noise suppression may be based on acoustic reverberation timing. The adaptive noise suppression can then eliminate, correct, or at least reduce the effects of reverberation.

[0022] The audio device includes a communication management unit configured to transmit a second audio signal to one or more external devices. The communication management unit may be configured to provide a communication link with one or more external devices. The communication management unit may be configured to transmit and / or receive communication from one or more external devices. Communication may use any protocol or standard known to those skilled in the art, including BT, BLE, WIFI, USB, DECT, ZigBee, PoE, etc.

[0023] The second audio signal includes an adaptive noise-suppressed representation of the first audio signal. The second audio signal may be a modified signal, such as a modified version of the first audio signal. The audio processor may be configured to provide the second audio signal.

[0024] The one or more external devices are configured for use by remote users outside the space environment. Therefore, the one or more external devices can be used by one or more of my remote users.

[0025] According to the present invention, a method for improving the listening experience for a remote user, performed in an audio device, is disclosed. The method includes transmitting a first MMW signal into a space environment via a millimeter-wave MMW transmitter interconnected with an MMW antenna array. The method includes receiving a second MMW signal via an MMW receiver interconnected with the MMW antenna array. The second MMW signal is a reflection of the first MMW signal caused by the space environment. The method may include determining an acoustic reverberation timing based on the second MMW signal via an MMW processor. The method includes receiving a first audio signal from the space environment via one or more microphones. The method includes performing adaptive noise suppression on the first audio signal via an audio processor. The adaptive noise suppression may be based on the acoustic reverberation timing. The method includes transmitting a second audio signal to one or more external devices via a communication management device. The second audio signal includes an adaptive noise-suppressed representation of the first audio signal. The one or more external devices are configured for use by a remote user outside the space environment.

[0026] In some embodiments, the audio device further includes one or more speakers or one or more output transducers. Alternatively, the one or more speakers may be provided separately from the audio device but interconnected with it, for example, via a wired or wireless connection. The communication management device may also be configured to receive one or more third audio signals from one or more external devices. The one or more speakers may be configured to output the one or more third audio signals. The one or more speakers may be configured to convert the one or more third audio signals into acoustic signals. The one or more speakers may be configured to provide the one or more third audio signals to the spatial environment.

[0027] In some embodiments, the audio device further includes an MMW processor configured to determine acoustic reverberation timing based on a second MMW signal.

[0028] In some embodiments, adaptive noise suppression is based on acoustic reverberation timing.

[0029] In some embodiments, the MMW processor is further configured to determine the echo path based on the second MMW signal. The audio processor may be further configured to perform adaptive echo cancellation on the first audio signal. The adaptive echo cancellation may be based on the echo path. The second audio signal may also include an adaptive echo-cancelled representation of the first audio signal. The echo path may be described as a sound or acoustic signal that travels from one or more speakers to one or more microphones, and is thus mistakenly picked up and retransmitted from the audio device to one or more remote users, thereby giving an echo of his / her own speech. Adaptive echo cancellation may subsequently eliminate, correct, or at least reduce the effects of the echo.

[0030] In some embodiments, where the audio processor is configured to perform both adaptive noise suppression and adaptive echo cancellation, adaptive echo cancellation is performed on the first audio signal before or prior to the performance of adaptive noise suppression. Thus, in some embodiments, adaptive echo cancellation on the first audio signal represents the performance of adaptive noise suppression.

[0031] In some embodiments, the MMW processor is further configured to determine a spatial environment model based on the second MMW signal and one or more MMW beamforming filters. The MMW processor may be configured to determine or provide a spatial environment model. In some embodiments, the spatial environment model is a 3D model of a room. The one or more MMW beamforming filters may be digital filters.

[0032] An audio device, or more specifically, an MMW processor, may include a filter bank unit comprising one or more MMW beamforming filters. The MMW can be configured to apply one or more MMW beamforming filters to a second MMW signal. This is advantageous because it allows for the provision of a beamforming pattern based on timing and amplitude differences from the MMW antenna array. This is beneficial because it provides spatial selectivity with respect to the second MMW signal. The one or more MMW beamforming filters may include one or more MMW beamforming filter coefficients. The one or more MMW beamforming filter coefficients can be updated adaptively, or can be updated at specific times or events, such as if more audio devices are added or a conference is initiated. In some embodiments, at least one of the one or more MMW beamforming filters is an adaptive MMW beamforming filter. At least one of the one or more adaptive MMW beamforming filters can be configured to adapt to one or more objects in a spatial environment via an adaptive algorithm. Such adaptation algorithms are well known in the field of MMW antenna arrays and typically involve solving optimization problems. The advantage is that at least one MMW beamforming filter can be an adaptive MMW beamforming filter, because this can provide power that maximizes the desired portion of the second MMW signal and minimizes the power of the undesired portion of the second MMW signal.

[0033] In some embodiments, the space environment model includes orientation data of one or more objects in the space environment. Alternatively or additionally, the space environment model may include position data of one or more objects in the space environment. Additionally or alternatively, the space environment model may include movement data of the one or more objects in the space environment.

[0034] In other words, a space environment model can include one or more of the following data or information about one or more objects in the space environment, such as distance, location, orientation, type, and movement. Data or information about one or more objects can be obtained from an MMW antenna array, such as properties measured in the electromagnetic field of a second MMW signal.

[0035] This distance can be measured using time-of-flight calculations, where the MMW processor measures the time elapsed from the transmission of the first MMW signal to the reception of the second MMW signal. The distance can then be determined accordingly. Timing measurements can be performed with picosecond accuracy using the MMW processor.

[0036] The direction can be measured using angle of arrival calculation, where the angle can be calculated based on the phase difference between one of the two or more MMW antennas and the other one or more MMW antennas. The direction can be determined accordingly, and this can be measured with an accuracy of 1° using an MMW processor.

[0037] This type can be predicted through return loss calculations, where power loss can be calculated based on the difference between the power of the first MMW signal and the power of the second MMW signal when determining the distance and direction. The type of object can be predicted using dielectric properties.

[0038] Motion can be measured using Doppler spectrum calculations, where the first MMW signal can be a fixed-frequency MMW signal to determine distance and direction. Then, a frequency shift can be measured in the second MMW signal, and motion can be identified and determined based on this frequency shift.

[0039] In some embodiments, the MMW processor is further configured to determine a 3D sound field model based on a spatial environment model. In some implementations, a first transfer function is used to determine the 3D sound field model. In other words, the 3D sound field model can be created by the MMW processor based on the spatial environment model using a first transfer function that transforms the spatial environment model from the RF millimeter-wave domain to the 3D sound field model in the audio domain, which is then run in the audio processor. The term transfer function can generally be described as a mathematical representation of the relationship between the inputs and outputs of a system, and can describe how the system responds to different frequencies.

[0040] In some embodiments, the second audio signal can be modified or processed based on a sound field 3D model. For example, the second audio signal can be a modified or processed version of a first audio signal based on the sound field 3D model. The audio processor can be configured to provide the second audio signal based on the sound field 3D model.

[0041] The 3D sound field model can be an acoustic environment model, which can be predicted and transferred from the spatial environment model via a first transfer function. The 3D sound field model may include reverberation timing estimation, echo path estimation, sound source localization, etc. An audio processor can be configured to use audio processing algorithms and techniques to render spatial sound effects based on data included in the 3D sound field model. This can include simulating orientation, distance, and other spatial properties within a room or space environment.

[0042] Advantageously, the sound field 3D model can be used to implement spatial sound reproduction in audio processing for echo cancellation and / or dereverberation algorithms and / or noise suppression and / or spatial sound effects for remote users.

[0043] In some embodiments, the sound field 3D model includes a sound reflection model associated with orientation, position, and / or movement data of one or more objects in a spatial environment. Alternatively, the sound field 3D model may include a loss transfer function associated with orientation, position, and / or movement data of one or more objects in the spatial environment. The loss function can generally be described as a function that measures the difference between predicted and actual values, wherein the objective of the loss function may be to minimize this difference. The sound reflection model can generally be described as a model of how sound waves interact with surfaces and how these sound waves are reflected, thereby including physical laws related to wave propagation, such as reflection, absorption, diffusion, etc.

[0044] In some embodiments, the echo path is further based on a 3D sound field model. Adaptive echo cancellation can be performed using one or more adaptive echo cancellation filters. Thus, echo cancellation can be adapted to an echo path that can be estimated by the 3D sound field model. The one or more adaptive echo cancellation filters can be digital filters. The one or more adaptive echo cancellation filters can include filter coefficients. The 3D sound field model can be used as input to the filter coefficients.

[0045] Echo paths can be based on the orientation, position, and / or movement data of one or more objects in the spatial environment, which can be included in the 3D model of the sound field. This is advantageous because adaptive echo cancellation can take into account the orientation, position, and / or movement data of one or more objects in the spatial environment.

[0046] In some embodiments, acoustic reverberation timing is further based on a 3D sound field model. Adaptive noise suppression can be performed using one or more adaptive noise suppression filters. Thus, after echo cancellation has been applied, ambient noise can be reduced or further reduced through adaptive noise suppression. The one or more adaptive noise suppression filters can be digital filters. The one or more adaptive noise suppression filters can include filter coefficients. The 3D sound field model can be used as input to the filter coefficients. Acoustic reverberation timing can be based on orientation, position, and / or movement data of one or more objects in the spatial environment, which can be included in the 3D sound field model. This is advantageous because adaptive noise suppression can take into account the orientation, position, and / or movement data of one or more objects in the spatial environment.

[0047] One or more adaptive echo cancellation filters and / or said one or more adaptive noise suppression filters may include an input signal, typically denoted as x(n), where n represents a discrete-time sample. The input signal may be a first audio signal. In some embodiments, where the audio processor is configured to perform both adaptive noise suppression and adaptive echo cancellation, adaptive echo cancellation is performed on the first audio signal before or prior to the performance of adaptive noise suppression. Thus, in some embodiments, the adaptive echo cancellation representation of the first audio signal is used to perform adaptive noise suppression. Thus, in some embodiments, the input signal may be an adaptive echo cancellation representation of the first audio signal.

[0048] One or more adaptive echo cancellation filters and / or one or more adaptive noise suppression filters may include a desired signal, typically denoted as d(n). The desired signal may be a modified version of a first audio signal, such as an adaptive noise suppression representation and / or an adaptive echo cancellation representation of the first audio signal. The one or more adaptive echo cancellation filters and / or the one or more adaptive noise suppression filters may include a filtered output, typically denoted as y(n), which may represent the response of the one or more adaptive filters to the input signal. The filter coefficients of the one or more adaptive echo cancellation filters and / or the one or more adaptive noise suppression filters may be configured to be updated to minimize the error between the desired output and the filtered output. The one or more adaptive echo cancellation filters and / or the one or more adaptive noise suppression filters may include an error signal, typically denoted as e(n), which may be used to provide feedback for updating the filter coefficients. A 3D sound field model may be used as further input to the filter coefficients.

[0049] In some embodiments, the audio device further includes a preprocessor. The preprocessor may be configured to provide front-end signal processing to the first audio signal before or prior to adaptive echo cancellation. Alternatively, the preprocessor may be configured to provide front-end signal processing to the first audio signal before or prior to adaptive noise suppression. The preprocessor may be an audio preprocessor. Front-end signal processing may include noise and speech estimation, direction of arrival (DOA), voice activity detection (VAD), adaptive beamforming, etc. The preprocessor may be included within an audio processor.

[0050] In some embodiments, the preprocessor is further configured to determine an initial first estimate of the filter coefficients of one or more adaptive echo cancellation filters. Alternatively, the preprocessor may be further configured to determine an initial first estimate of the filter coefficients of one or more adaptive noise suppression filters.

[0051] In some embodiments, the audio processor is further configured to embed and synchronize the first audio signal into the sound field 3D model. This is advantageous because the first audio signal can be loaded into the sound field 3D model using aligned timing (phase) and amplitude spectrum.

[0052] In some embodiments, the one or more microphones include at least two microphones. A first audio signal may be provided by said at least two microphones. The audio processor may also be configured to apply one or more audio beamforming filters to the first audio signal. This is advantageous because it allows for the provision of a beamforming pattern based on the timing and amplitude differences from the at least two microphones. This is also advantageous because it provides spatial selectivity with respect to the first audio signal. The one or more audio beamforming filters may be digital filters. The one or more audio beamforming filters may include one or more audio beamforming filter coefficients. The one or more audio beamforming filter coefficients may be updated adaptively, or may be updated at specific times or events, such as if the audio device is moved or a conference is initiated.

[0053] In some embodiments, at least one of the one or more audio beamforming filters is an adaptive audio beamforming filter. An adaptive audio beamforming filter can be configured to adapt to one or more objects in a spatial environment via an adaptive algorithm. Such adaptive algorithms are well-known in the field of audio beamforming and typically involve solving optimization problems. An advantage is that at least one audio beamforming filter can be an adaptive audio beamforming filter because this can provide maximum power for the desired portion of the first audio signal and minimum power for the undesired portion of the first audio signal.

[0054] In some embodiments, at least one adaptive audio beamforming filter among the one or more audio beamforming filters is based on a sound field 3D model. This is advantageous because at least one adaptive audio beamforming filter among the one or more audio beamforming filters can take into account the orientation, position, and / or movement data of one or more objects in the spatial environment (which may be included in the sound field 3D model). This is advantageous because at least one adaptive audio beamforming filter among the one or more audio beamforming filters can be adapted based on information obtained using a second MMW signal, such as the second MMW signal and subsequent processing and modeling thereon.

[0055] In some embodiments, the audio device further includes a spatial sound generator configured to determine a spatial sound image based on the sound field 3D model using a second transfer function. This is advantageous because the spatial sound image can provide a remote user with a sense of direction and / or distance to sound sources in the spatial environment. The spatial sound generator may be included in an audio processor. Alternatively, the audio processor itself may be further configured to determine a spatial sound image based on the sound field 3D model using the second transfer function.

[0056] In some embodiments, the second transfer function is a head-related transfer function (HRTF). In this respect, the HRTF can be described as a mathematical representation of how the listener's head, ears, and torso filter sound. This is advantageous because the HRTF can provide directional cues to help a remote user perceive sound in three-dimensional space. The HRTF can be a typical or average HRTF.

[0057] In some embodiments, the second audio signal may be further modified or processed based on the spatial sound image; for example, the second audio signal may be a modified or processed version of the first audio signal further based on the spatial sound image. The audio processor may be configured to provide the second audio signal based on the spatial sound image. The audio processor may also be configured to provide the second audio signal based on both the sound field 3D model and the spatial sound image.

[0058] In some embodiments, the audio device further includes a power management unit. The power management unit can be configured to manage and / or allocate power to various parts and components included in the audio device.

[0059] In some embodiments, the second audio signal is transmitted to one or more external devices via one or more audio channels.

[0060] In some embodiments, the method further includes determining an echo path based on a second MMW signal via an MMW processor. The method may further include performing adaptive echo cancellation on the first audio signal via the audio processor. The adaptive echo cancellation may be based on an acoustic echo path. The second audio signal further includes an adaptive echo-cancelled representation of the first audio signal.

[0061] In some embodiments, the method further includes determining a spatial environment model based on a second MMW signal and one or more MMW beamforming filters via an MMW processor. The method may further include determining a 3D sound field model based on the spatial environment model via the MMW processor and using a first transfer function. Echo paths may be further based on the 3D sound field model. Additionally or alternatively, acoustic reverberation timing may be further based on the 3D sound field model.

[0062] In some embodiments, the method further includes determining a spatial sound image based on the sound field 3D model using a second transfer function via a spatial sound generator.

[0063] In some embodiments, the acoustic reverberation timing is further based on a 3D sound field model. The 3D sound field model can be determined via an MMW processor.

[0064] The present invention relates to various aspects, including the audio apparatus and methods described above and below, and corresponding device components, each device component producing one or more benefits and advantages described in conjunction with the aspects first mentioned, and each device component having one or more embodiments corresponding to the embodiments described in conjunction with the aspects first mentioned and / or disclosed in the appended claims. Attached Figure Description

[0065] The above and other features and advantages will become apparent to those skilled in the art from the following detailed description of exemplary embodiments thereof, with reference to the accompanying drawings, in which: Figure 1 An exemplary audio device is shown schematically.

[0066] Figures 2a to 2d An exemplary audio device is shown schematically.

[0067] Figure 3 An exemplary adaptive filter is illustrated schematically.

[0068] Figure 4 A flowchart of the exemplary method is shown. Detailed Implementation

[0069] Various embodiments are described below with reference to the accompanying drawings. The same reference numerals always denote the same elements. Therefore, the same elements will not be described in detail with respect to each drawing. It should also be noted that the drawings are intended only to facilitate the description of the embodiments. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. Furthermore, the illustrated embodiments do not need to have all the aspects or advantages shown. Aspects or advantages described in connection with a particular embodiment are not necessarily limited to that embodiment and may be practiced in any other embodiment, even if not so stated or explicitly described.

[0070] Figure 1 An exemplary audio device 2 for improving the listening experience for remote users is schematically illustrated. Audio device 2 includes an MMW antenna array 4 comprising two or more MMW antennas. In the figure, the MMW antenna array 4 is schematically shown as comprising eight MMW antennas. The MMW antenna array 4 is used to receive and transmit MMW signals. Audio device 2 includes an MMW transducer 6 comprising an MMW transmitter 8 and an MMW receiver 10. The MMW transducer 6 is interconnected with the MMW antenna array 4. The MMW transmitter 8 is configured to transmit a first MMW signal into a space environment (not shown). The MMW receiver 10 is used to receive a second MMW signal. The second MMW signal is a reflected version of the first MMW signal caused by one or more objects (not shown) in the space environment. Audio device 2 includes an MMW processor 12, which can be configured to determine acoustic reverberation timing based on the second MMW signal. Audio device 2 includes one or more microphones 14 configured to receive a first audio signal from the space environment. In the figure, audio device 2 is schematically shown as including one microphone 14. The audio device 2 includes an audio processor 16 configured to perform adaptive noise suppression on a first audio signal. The adaptive noise suppression may be based on acoustic reverberation timing. The audio device 2 includes a communication management device 18 configured to transmit a second audio signal to one or more external devices (not shown). The second audio signal includes an adaptive noise-suppressed representation of the first audio signal. The one or more external devices are configured for use by a remote user outside the spatial environment.

[0071] include Figures 2a to 2d Figure 2 schematically illustrates an exemplary audio device 2 for improving the listening experience for remote users. The audio device 2 includes one or more microphones 14. Figures 2a to 2b Similar features were shown, however, Figure 2b The diagram schematically shows one or more microphones 14, including at least two microphones. Figures 2c to 2d The spatial environment with near-end user, object, audio device 2 and separate MMW antenna array 4 is schematically shown.

[0072] Audio device 2 includes an MMW antenna array 4 comprising two or more MMW antennas. The MMW antenna array 4 is schematically shown as comprising eight MMW antennas. The MMW antenna array 4 is used to receive and transmit MMW signals. Audio device 2 includes an MMW transducer 6 comprising an MMW transmitter 8 and an MMW receiver 10. The MMW transducer 6 is interconnected with the MMW antenna array 4. The MMW transmitter 8 is configured to transmit a first MMW signal into a space environment (not shown). The MMW receiver 10 is used to receive a second MMW signal. The second MMW signal is a reflected version of the first MMW signal caused by one or more objects (not shown) in the space environment. Audio device 2 includes an MMW processor 12, which can be configured to determine acoustic reverberation timing based on the second MMW signal. The one or more microphones 14 are configured to receive the first audio signal from the space environment. Audio device 2 includes an audio processor 16, which is configured to perform adaptive noise suppression on the first audio signal. The adaptive noise suppression may be based on acoustic reverberation timing. The audio device 2 includes a communication management device 18 configured to transmit a second audio signal to one or more external devices (not shown). The second audio signal includes an adaptive noise suppression representation of the first audio signal. The one or more external devices are configured for use by a remote user outside the space environment.

[0073] In some embodiments, the MMW processor 12 is further configured to determine an echo path based on a second MMW signal. The audio processor 16 may also be configured to perform adaptive echo cancellation on a first audio signal. The adaptive echo cancellation may be based on the echo path. The second audio signal may also include an adaptive echo-cancelled representation of the first audio signal. In some embodiments, the MMW processor 12 is further configured to determine a space environment model based on the second MMW signal and one or more MMW beamforming filters. In some embodiments, the space environment model includes orientation data of one or more objects in the space environment. Alternatively or additionally, the space environment model may include position data of one or more objects in the space environment. Additionally or alternatively, the space environment model may include movement data of the one or more objects in the space environment. In some embodiments, at least one of the one or more MMW beamforming filters is an adaptive MMW beamforming filter.

[0074] In some embodiments, the MMW processor 12 is further configured to determine a 3D sound field model based on a spatial environment model. In some embodiments, a first transfer function is used to determine the 3D sound field model. In some embodiments, the 3D sound field model includes a sound reflection model associated with orientation, position, and / or movement data of one or more objects in the spatial environment. Alternatively or additionally, the 3D sound field model may include a loss transfer function associated with orientation, position, and / or movement data of one or more objects in the spatial environment.

[0075] In some embodiments, the acoustic reverberation timing is further based on a 3D sound field model. Adaptive noise suppression can be performed using one or more adaptive noise suppression filters. See also Figure 3 For example, this kind of adaptive filter.

[0076] In some embodiments, the echo path is further based on a 3D sound field model. Adaptive echo cancellation can be performed using one or more adaptive echo cancellation filters. See also Figure 3 For example, this kind of adaptive filter.

[0077] Audio device 2 is schematically shown as further including preprocessor 20. Preprocessor 20 may be configured to provide front-end signal processing of the first audio signal before or after adaptive echo cancellation. Alternatively, preprocessor 20 may be configured to provide front-end signal processing of the first audio signal before or prior to adaptive noise suppression. In some embodiments, preprocessor 20 is also configured to determine an initial first estimate of the filter coefficients of one or more adaptive echo cancellation filters. Alternatively, preprocessor 20 may be further configured to determine an initial first estimate of the filter coefficients of one or more adaptive noise suppression filters. In some embodiments, audio processor 16 is further configured to embed and synchronize the first audio signal into a sound field 3D model. In some embodiments, audio device 2 further includes spatial sound generator 22, which is configured to determine a spatial sound image based on the sound field 3D model using a second transfer function. In some embodiments, the second transfer function is a head-related transfer function. In some embodiments, the second audio signal is transmitted to one or more external devices via one or more audio channels.

[0078] In some embodiments, the audio device 2 further includes one or more speakers 24. The audio device 2 is schematically shown as including one speaker 24. The communication management device 18 may be further configured to receive one or more third audio signals from one or more external devices. The one or more speakers 24 may be configured to output one or more third audio signals.

[0079] Figure 2b Showing with Figure 2aSimilar features, however, Figure 2b The illustration schematically shows one or more microphones 14, including at least two microphones. Figure 2b In this embodiment, the audio processor 16 may be further configured to apply one or more audio beamforming filters to the first audio signal. In some embodiments, at least one of the one or more audio beamforming filters is an adaptive audio beamforming filter. In some embodiments, at least one of the one or more adaptive audio beamforming filters is based on a sound field 3D model.

[0080] Figure 2c A spatial environment with a near-end user, objects, an audio device 2, and a separate MMW antenna array 4 is schematically shown. Objects include walls, doors, windows, furniture, tables, chairs, etc. The spatial environment is a room, and within the room there is a television set on the wall, and the audio device 2 includes a speakerphone placed on a table.

[0081] The millimeter-wave (MMW) antenna array 4, configured to receive and transmit MMW signals, is also arranged in a spatial environment, such as on a table, and the MMW antenna is separate and not built into the audio device.

[0082] Figure 2c This illustrates how fixed beamforming (shown by the beam lobe) can be applied to directions where near-end users are detected and subsequently tracked by an MMW array in the room.

[0083] Figure 2d A spatial environment with a near-end user, objects, an audio device 2, and a separate MMW antenna array 4 is schematically shown. Objects include walls, doors, windows, furniture, tables, chairs, etc. The spatial environment is a room, and within the room there is a television set on the wall, and the audio device 2 includes a speakerphone placed on a table.

[0084] The millimeter-wave (MMW) antenna array configured to receive and transmit MMW signals is also arranged in the spatial environment, such as on a wall, and the MMW antenna is separate and not built into the audio device.

[0085] Figure 2d This demonstrates that dynamic speaker output channel gain control can be applied to a multichannel audio system by detecting and tracking near-end users in the room via an MMW antenna array.

[0086] Figure 3An exemplary adaptive filter 30 for adaptive noise suppression or adaptive echo cancellation, as described with respect to the audio device in FIG2, is schematically shown. The adaptive filter 30 includes an input signal 32, typically denoted as x(n), where n represents a discrete-time sample. The input signal 32 may be a first audio signal. In some embodiments, where the audio processor is configured to perform both adaptive noise suppression and adaptive echo cancellation, adaptive echo cancellation is performed on the first audio signal before or prior to the performance of adaptive noise suppression. Thus, in some embodiments, the adaptive echo cancellation of the first audio signal represents the performance of adaptive noise suppression. Thus, in some embodiments, the input signal 32 may be the adaptive echo cancellation representation of the first audio signal.

[0087] The adaptive filter 30 includes a desired signal 34, typically denoted as d(n). The desired signal 34 may be a modified version of the first audio signal, such as an adaptive noise suppression representation and / or an adaptive echo cancellation representation of the first audio signal. The adaptive filter 30 includes a filtered output 36, typically denoted as y(n), representing the response of the adaptive filter 30 to the input signal 32. The adaptive filter 30 includes filter coefficients 38 configured to be updated to minimize the error between the desired output 34 and the filtered output 36. The adaptive filter 30 includes an error signal 40, typically denoted as e(n), configured to provide feedback for updating the filter coefficients 38. A 3D sound field model is used as another input 42 to the filter coefficients 38.

[0088] Figure 4 A flowchart is shown of an exemplary method 100 performed in an audio device to improve the listening experience for a remote user. Method 100 includes transmitting a first MMW signal 102 into a space environment via an MMW transmitter interconnected with an MMW antenna array. The method includes receiving a second MMW signal 104 via an MMW receiver interconnected with the MMW antenna array. The second MMW signal is a reflection of the first MMW signal caused by the space environment. Method 100 may include determining an acoustic reverberation timing 106 based on the second MMW signal via an MMW processor. Method 100 includes receiving a first audio signal 108 from the space environment via one or more microphones. Method 100 includes performing adaptive noise suppression 110 on the first audio signal via an audio processor. The adaptive noise suppression may be based on the acoustic reverberation timing. Method 100 includes transmitting a second audio signal 112 to one or more external devices via a communication management device. The second audio signal includes an adaptive noise-suppressed representation of the first audio signal. The one or more external devices are configured for use by a remote user outside the space environment.

[0089] Although certain features have been shown and described, it will be understood that these features are not intended to limit the claimed invention, and that various changes and modifications can be made without departing from the scope of the claimed invention, as will be apparent to those skilled in the art. Therefore, the specification and drawings are to be regarded as illustrative rather than restrictive. The claimed invention is intended to cover all alternatives, modifications, and equivalents.

[0090] Project List 1: 1. An audio device for improving the listening experience for remote users, the audio device comprising: -Millimeter wave-MMW-antenna array, comprising two or more MMW antennas, the MMW antenna array being configured to receive and transmit MMW signals; - An MMW transducer, comprising an MMW transmitter and an MMW receiver, wherein the MMW transducer is interconnected with an MMW antenna array, and wherein: The MMW transmitter is configured to transmit the first MMW signal into the space environment, and • The MMW receiver is configured to receive a second MMW signal, which is a reflected version of the first MMW signal caused by one or more objects in the space environment; - The MMW processor is configured to determine the acoustic reverberation timing based on the second MMW signal; - One or more microphones configured to receive a first audio signal from the spatial environment; - An audio processor configured to perform adaptive noise suppression on a first audio signal, wherein the adaptive noise suppression is based on acoustic reverberation timing; and - A communication management device configured to transmit a second audio signal to one or more external devices, wherein the second audio signal includes an adaptive noise suppression representation of a first audio signal, and wherein the one or more external devices are configured for use by a remote user outside the space environment.

[0091] 2. The audio device according to the foregoing, characterized in that the MMW processor is further configured to determine an echo path based on a second MMW signal; the audio processor is further configured to perform adaptive echo cancellation on a first audio signal, the adaptive echo cancellation being based on the echo path; and wherein the second audio signal further includes an adaptive echo cancellation representation of the first audio signal.

[0092] 3. An audio device according to any of the preceding items, wherein the MMW processor is further configured to determine a spatial environment model based on the second MMW signal and one or more MMW beamforming filters.

[0093] 4. An audio device according to any of the preceding items, wherein the spatial environment model includes orientation, position and / or movement data of the one or more objects in the spatial environment.

[0094] 5. An audio device according to any of the preceding items, wherein at least one of the one or more MMW beamforming filters is an adaptive MMW beamforming filter.

[0095] 6. An audio device according to any of the preceding items, wherein the MMW processor is further configured to determine a sound field 3D model based on the spatial environment model.

[0096] 7. An audio device according to any of the preceding items, wherein a first transfer function is used to determine a 3D model of the sound field.

[0097] 8. An audio device according to any of the foregoing items, wherein the sound field 3D model includes a sound reflection model and / or a loss transfer function associated with the orientation, position and / or movement data of the one or more objects in the spatial environment.

[0098] 9. An audio device according to any of the foregoing items, wherein the acoustic reverberation timing is further based on a sound field 3D model, and wherein one or more adaptive noise suppression filters are used to perform adaptive noise suppression.

[0099] 10. An audio device according to any of the foregoing items, wherein the echo path is further based on a sound field 3D model, and wherein one or more adaptive echo cancellation filters are used to perform echo cancellation.

[0100] 11. An audio device according to any of the preceding items, wherein the audio device further includes a preprocessor, and wherein the preprocessor is configured to provide front-end signal processing to the first audio signal prior to the adaptive echo cancellation and / or adaptive noise suppression.

[0101] 12. An audio device according to any of the foregoing items, wherein the preprocessor is further configured to determine an initial first estimate of the filter coefficients for the one or more adaptive echo cancellation filters and / or the one or more adaptive noise suppression filters.

[0102] 13. An audio device according to any of the preceding items, wherein the audio processor is further configured to embed a first audio signal into a sound field 3D model and synchronize the first audio signal with the sound field 3D model.

[0103] 14. An audio device according to any of the preceding claims, wherein the one or more microphones include at least two microphones, and wherein the audio processor is further configured to apply one or more audio beamforming filters to the first audio signal.

[0104] 15. An audio device according to any of the preceding items, wherein at least one of the one or more audio beamforming filters is an adaptive audio beamforming filter.

[0105] 16. An audio device according to any of the preceding claims, wherein at least one of the one or more audio beamforming filters is an adaptive audio beamforming filter based on a sound field 3D model.

[0106] 17. An audio device according to any of the preceding claims, wherein the audio device further includes a spatial sound generator configured to determine a spatial sound image based on a sound field 3D model using a second transfer function.

[0107] 18. An audio device according to any of the preceding items, wherein the second transfer function is a head-related transfer function.

[0108] 19. An audio device according to any of the preceding items, wherein the second audio signal is transmitted to one or more external devices via one or more audio channels.

[0109] 20. An audio device according to any of the preceding claims, wherein the audio device further includes one or more speakers, wherein the communication management device is further configured to receive one or more third audio signals from the one or more external devices, and wherein the one or more speakers are configured to output the one or more third audio signals.

[0110] 21. A method, executed in an audio device, for improving the listening experience for a remote user, the method comprising: - The first MMW signal is transmitted into the space environment via a millimeter-wave MMW transmitter interconnected with an MMW antenna array; - A second MMW signal is received via an MMW receiver interconnected with an MMW antenna array, wherein the second MMW signal is a reflection of the first MMW signal caused by the space environment; - The acoustic reverberation timing is determined based on the second MMW signal via the MMW processor; - Receive the first audio signal from the spatial environment via one or more microphones; - Adaptive noise suppression is performed on the first audio signal via an audio processor, wherein the adaptive noise suppression is based on acoustic reverberation timing; and - A second audio signal is transmitted to one or more external devices via a communication management device, wherein the second audio signal includes an adaptive noise suppression representation of the first audio signal, and wherein the one or more external devices are configured for use by a remote user outside the space environment.

[0111] 22. The method according to the foregoing item, wherein the method further includes: - The echo path is determined by the MMW processor based on the second MMW signal; - Adaptive echo cancellation is performed on the first audio signal via an audio processor, wherein the adaptive echo cancellation is based on an acoustic echo path; and wherein the second audio signal further includes an adaptive echo cancellation representation of the first audio signal.

[0112] 23. The method according to any one of items 21 to 22 above, wherein the method further comprises: - Determine the space environment model based on the second MMW signal and one or more MMW beamforming filters via the MMW processor; - Determine the 3D sound field model based on the spatial environment model via the MMW processor and using the first transfer function; and The echo path and / or acoustic reverberation timing are further based on the sound field 3D model.

[0113] 24. The method according to any one of items 21 to 23 above, wherein the method further comprises: - Determine the spatial sound image based on the sound field 3D model using a second transfer function via a spatial sound generator.

[0114] 25. The method according to any one of items 21 to 24 above, wherein the acoustic reverberation timing is further based on a sound field 3D model, which is determined by an MMW processor.

[0115] Project List 2: 1. An audio device (2) for improving the listening experience of a remote user, the audio device (2) comprising: - Millimeter wave - MMW - Antenna array (4), including two or more MMW antennas, the MMW antenna array (4) being configured to receive and transmit MMW signals; - An MMW transducer (6) includes an MMW transmitter and an MMW receiver, wherein the MMW transducer is interconnected with an MMW antenna array, and wherein: The MMW transmitter (8) is configured to transmit a first MMW signal into the space environment, and • The MMW receiver (10) is configured to receive a second MMW signal, which is a reflected version of the first MMW signal caused by one or more objects in the space environment; - One or more microphones (14) configured to receive a first audio signal from the spatial environment; - An audio processor (16) configured to perform adaptive noise suppression on a first audio signal; and - Communication management device (18), the communication management device is configured to transmit a second audio signal to one or more external devices, wherein the second audio signal includes an adaptive noise suppression representation of the first audio signal, and wherein the one or more external devices are configured for use by a remote user outside the space environment.

[0116] 2. The audio device (2) according to item 1 further includes an MMW processor (12) configured to determine the acoustic reverberation timing based on a second MMW signal; and wherein adaptive noise suppression is based on the acoustic reverberation timing.

[0117] 3. The audio device (2) according to item 2, wherein the MMW processor (12) is further configured to determine an echo path based on a second MMW signal; wherein the audio processor (16) is further configured to perform adaptive echo cancellation on a first audio signal, the adaptive echo cancellation being based on the echo path; and wherein the second audio signal further includes an adaptive echo cancellation representation of the first audio signal.

[0118] 4. The audio device (2) according to any one of items 2 to 3 above, wherein the MMW processor (12) is further configured to determine a space environment model based on a second MMW signal and one or more MMW beamforming filters.

[0119] 5. The audio device (2) of the previous project, wherein the spatial environment model includes the orientation, position and / or movement data of the one or more objects in the spatial environment.

[0120] 6. The audio device (2) according to any one of items 2 to 5 above, wherein the MMW processor (12) is further configured to determine the sound field 3D model based on the spatial environment model.

[0121] 7. The audio device (2) according to the foregoing, wherein the sound field 3D model is determined using a first transfer function.

[0122] 8. An audio device (2) according to any one of items 6 to 7, wherein the sound field 3D model includes a sound reflection model and / or loss transfer function associated with orientation, position and / or movement data of one or more objects in the spatial environment.

[0123] 9. An audio device (2) according to any one of items 6-8, wherein the acoustic reverberation timing is further based on a sound field 3D model; and wherein adaptive noise suppression is performed using one or more adaptive noise suppression filters.

[0124] 10. The audio device (2) according to any of the preceding items, wherein the audio device (2) further includes a preprocessor (20); and wherein the preprocessor (20) is configured to provide front-end signal processing to the first audio signal prior to adaptive echo cancellation and / or adaptive noise suppression.

[0125] 11. The audio device (2) according to any one of items 6 to 10, wherein the audio processor (16) is further configured to embed and synchronize the first audio signal into the sound field 3D model.

[0126] 12. An audio device (2) according to any of the preceding items, wherein the one or more microphones (14) include at least two microphones; and wherein the audio processor (16) is further configured to apply one or more audio beamforming filters to the first audio signal.

[0127] 13. The audio device (2) according to the foregoing, wherein at least one of the one or more audio beamforming filters is an adaptive audio beamforming filter.

[0128] 14. An audio device (2) according to any one of the preceding items 6 to 11, wherein at least one of the one or more audio beamforming filters is an adaptive audio beamforming filter based on a sound field 3D model.

[0129] 15. The audio device (2) according to any one of items 6 to 14, wherein the audio device (2) further includes a spatial sound generator configured to determine a spatial sound image based on a sound field 3D model using a second transfer function.

[0130] 16. A method (100) performed in an audio device for improving the listening experience for a remote user, the method (100) comprising: - The first MMW signal is transmitted (102) into the space environment via a millimeter-wave MMW transmitter interconnected with the MMW antenna array; - A second MMW signal is received via an MMW receiver interconnected with an MMW antenna array, wherein the second MMW signal is a reflection of the first MMW signal caused by the space environment; - Receive (108) first audio signal from the spatial environment via one or more microphones; - Adaptive noise suppression (110) is performed on the first audio signal via an audio processor; and - Transmit (112) a second audio signal to one or more external devices via a communication management device, wherein the second audio signal includes an adaptive noise suppression representation of the first audio signal, and wherein the one or more external devices are configured for use by a remote user outside the space environment.

[0131] Reference List

[0132] 2 Audio devices

[0133] 4 MMW antenna array

[0134] 6 MMW transducers

[0135] 8 MMW transmitter

[0136] 10 MMW receiver

[0137] 12 MMW processor

[0138] 14. One or more microphones

[0139] 16 Audio Processors

[0140] 18. Communication Management Device

[0141] 20 Preprocessors

[0142] 22 Spatial Sound Generator

[0143] 24 One or more speakers

[0144] 30 Adaptive Filter

[0145] 32 Input Signal

[0146] 34 Expected Signals

[0147] 36. Filtered output

[0148] 38 Filter coefficients

[0149] 40 Error Signal

[0150] 42 Another input from the sound field 3D model

[0151] 100 methods

[0152] 102 Send the first MMW signal

[0153] 104 Receive the second MMW signal

[0154] 106 Determining the acoustic reverberation timing

[0155] 108 Receive the first audio signal

[0156] 110 Perform adaptive noise suppression on the first audio signal

[0157] 112 Transmits the second audio signal to one or more external devices.

Claims

1. An audio device (2) for improving the listening experience of a remote user, the audio device (2) comprising: - A millimeter-wave MMW antenna array (4) comprising two or more MMW antennas, the MMW antenna array (4) being configured to receive and transmit MMW signals; - An MMW transducer (6) includes an MMW transmitter and an MMW receiver, wherein the MMW transducer is interconnected with the MMW antenna array, and wherein: The MMW transmitter (8) is configured to transmit a first MMW signal into the space environment, and • The MMW receiver (10) is configured to receive a second MMW signal, the second MMW signal being a reflected version of the first MMW signal caused by one or more objects in the space environment; - One or more microphones (14) are configured to receive a first audio signal from the spatial environment; - An audio processor (16) is configured to perform adaptive noise suppression on the first audio signal; and - A communication management device (18) is configured to transmit a second audio signal to one or more external devices, wherein the second audio signal includes an adaptive noise suppression representation of the first audio signal, and wherein the one or more external devices are configured to be used by a remote user outside the space environment.

2. The audio device (2) according to claim 1, further comprising an MMW processor (12) configured to determine acoustic reverberation timing based on the second MMW signal; and wherein, The adaptive noise suppression is based on the acoustic reverberation timing.

3. The audio device (2) according to claim 2, wherein, The MMW processor (12) is further configured to determine an echo path based on the second MMW signal; wherein the audio processor (16) is further configured to perform adaptive echo cancellation on the first audio signal, the adaptive echo cancellation being based on the echo path; and wherein the second audio signal further includes an adaptive echo cancellation representation of the first audio signal.

4. The audio device (2) according to any one of claims 2 to 3, wherein, The MMW processor (12) is also configured to determine a space environment model based on the second MMW signal and one or more MMW beamforming filters.

5. The audio device (2) according to the preceding claim, wherein, A space environment model includes orientation, position, and / or movement data of one or more objects within the space environment.

6. The audio device (2) according to any one of claims 2 to 5, wherein, The MMW processor (12) is also configured to determine the 3D model of the sound field based on the spatial environment model.

7. The audio device (2) according to the preceding claim, wherein, The 3D sound field model is determined using the first transfer function.

8. The audio device (2) according to any one of claims 6 to 7, wherein, The sound field 3D model includes a sound reflection model and / or loss transfer function associated with the orientation, position, and / or movement data of the one or more objects in the spatial environment.

9. The audio device (2) according to any one of claims 6 to 8, wherein, The acoustic reverberation timing is further based on the sound field 3D model; and wherein one or more adaptive noise suppression filters are used to perform the adaptive noise suppression.

10. The audio device (2) according to any one of the preceding claims, wherein, The audio device (2) further includes a preprocessor (20); and wherein the preprocessor (20) is configured to provide front-end signal processing of the first audio signal prior to adaptive echo cancellation and / or adaptive noise suppression.

11. The audio device (2) according to any one of claims 6 to 10, wherein, The audio processor (16) is also configured to embed and synchronize the first audio signal into the sound field 3D model.

12. The audio device (2) according to any one of the preceding claims, wherein, The one or more microphones (14) include at least two microphones; and wherein the audio processor (16) is further configured to apply one or more audio beamforming filters to the first audio signal.

13. The audio device (2) according to the preceding claim, wherein, At least one of the one or more audio beamforming filters is an adaptive audio beamforming filter.

14. The audio device (2) according to the preceding claim which depends on any one of claims 6 to 11, wherein, At least one adaptive audio beamforming filter in one or more audio beamforming filters is based on a 3D sound field model.

15. The audio device (2) according to any one of claims 6 to 14, wherein, The audio device (2) further includes a spatial sound generator configured to determine a spatial sound image based on a sound field 3D model using a second transfer function.

16. A method (100) performed in an audio device for improving the listening experience of a remote user, the method (100) comprising: - The first MMW signal is transmitted (102) into the space environment via a millimeter-wave transmitter interconnected with a millimeter-wave MMW antenna array; - Receive (104) a second MMW signal via an MMW receiver interconnected with the MMW antenna array, wherein the second MMW signal is a reflection of the first MMW signal caused by the space environment; - Receive (108) a first audio signal from the space environment via one or more microphones; - Adaptive noise suppression (110) is performed on the first audio signal via an audio processor; and - Transmit (112) a second audio signal to one or more external devices via a communication management device, wherein the second audio signal includes an adaptive noise suppression representation of the first audio signal, and wherein the one or more external devices are configured for use by a remote user outside the space environment.

Images