Hearing aid or hearing aid system supporting wireless streaming

Abstract

The invention discloses a hearing aid or a hearing aid system supporting wireless streaming. The binaural hearing aid system comprises a first hearing aid and a second hearing aid; and a position detector configured to provide an estimate of a current position of the at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate. Each hearing aid comprises: an input transducer for converting an acoustically propagated signal incident on the input transducer into an electrical sound input signal; the wireless receiver is used for receiving signals wirelessly transmitted from the audio transmitter and taking back transmitted audio input signals from the audio transmitter; an input gain controller for controlling a relative weight between the electrical sound input signal and the streaming audio input signal and providing a weighted sum of the input signals; and an output converter configured to convert the weighted sum to a stimulus; wherein at least one of the input gain controllers is configured to provide a relative weight as a function of the position detector control signal.

Description

Technical Field

[0001] The present application relates to the field of hearing aids, and in particular to a hearing aid or a hearing aid system configured to receive one or more streaming audio signals. Background Art

[0002] Many modern hearing aids support wireless streaming of audio from external sources (e.g., located near the hearing aid user), such as from a TV adapter connected to a TV for transmitting TV audio to one or more hearing aids, from remote microphones (buddy microphones, desktop microphones, etc.), and from smartphones. Streaming audio directly to hearing aids improves speech understanding, but can degrade the perception of the spatial direction of the sound source and speech understanding when multiple speakers are present. The increased spatial directionality and possible externalization that spatial audio can produce can give a more natural perception of sound, which is similar to listening without streaming from the target source.

[0003] Streaming of audio from an external device to one or more hearing aids has been covered in a number of references. Some examples are provided below.

[0004] EP 3 270 608 A1 discloses a hearing device comprising a direction estimator configured to estimate a head direction of a hearing device user, wherein the hearing device is configured to select and apply a processing scheme in the hearing device based on the estimated head direction.

[0005] US2013094683A1 discloses applying directional cues to streaming signals in a binaural hearing aid system. The direction of arrival can be determined based on the delay difference. Directional cues (such as HRTF) can be added to the streaming signal.

[0006] EP3716642A1 discloses a hearing system, a hearing device and a plurality of audio transmitters. The hearing device comprises a selector / mixer controlled by a source selection control signal determined based on a comparison of a beamforming signal provided by a microphone of the hearing device and a streaming sound signal received from an audio transmitter in the surroundings of a user wearing the hearing device.

[0007] EP3013070A2 discloses sound source localization in a hearing aid system, wherein streaming sound (eg from a wireless microphone or a TV adapter) is received by the hearing aid together with acoustically propagated sound from a target sound source. Movement of the head can be detected by a head tracker.

[0008] WO2010133246A1 discloses that directional information from an acoustically propagated (target) signal is used in a hearing aid to colorize a wirelessly propagated (usually purer) (target) signal (e.g. by applying an HRTF to the streaming signal). WO2010133246A1 also describes the "opposite" case, where the target signal is estimated using the acoustically propagated signal, and the wirelessly propagated signal is used to "clean up" the acoustically propagated signal.

[0009] US2015003653A1 discloses using sensors to determine the position of a hearing aid relative to a streaming source, such as tracking head position / orientation.

[0010] US2013259237A1 discloses a hearing aid system and method for wireless RF audio signal transmission from at least one audio signal source to an ear-level receiver, wherein a near-natural hearing impression is achieved. The incident angle of the wireless signal is detected by comparing the signal strength received at the left and right ears (reflecting the current head direction relative to the transmitter) and applying a signal reflecting the signal strength difference at the left and right ears.

[0011] US2014348331A1 relates to binaural processing in hearing aid systems (application of HRTFs on monaural (streaming) signals based on the orientation of the user's head relative to the sound source). Summary of the invention

[0012] In the following, some of the problems that arise with the presentation of streaming audio in hearing aids are outlined.

[0013] Example 1: The partner of a hearing aid user wears a partner microphone, but the sound from the partner microphone is typically transmitted as a single signal stream, and the hearing aid user will experience the sound as being presented from inside the user's head, with no spatial perception of where the partner is located.

[0014] Example 2: A hearing aid user is watching TV and may receive a stereo signal from a TV adapter, thus experiencing surround-like sound, but if the user turns his head, the sound image follows the user's head and is no longer perceived as externalized. Additionally, if a hearing aid user watching TV wants to hear another person in the room who is trying to get the user's attention, the streaming sound from the TV will "follow" the user as the user turns his head toward the other person and interfere with the user's ability to hear the other person.

[0015] Example 3: In a conference call with multiple speakers, the voice from the far-end speaker will appear as a single signal in both hearing aids, making it more difficult for the hearing aid user to distinguish between the multiple speakers.

[0016] Example 4: For situations where there are many different spoken notifications available in a hearing aid user interface, it can be difficult to distinguish the many different notifications from each other. By externalizing the spoken notifications (i.e. by assigning each notification to a different point in space), the understanding and recognition of the notifications can be improved (especially during more difficult listening environments, even if it is not possible to fully hear the notification, it can be recognized based on the point of origin).

[0017] Example 5: A streaming sound source may be placed at a given proximity of a user based on the distance between the user and the streaming sound source to provide the user with better spatial depth perception. For applications such as streaming of TV sound, it may be beneficial to be able to attenuate and change the volume of the streaming sound source based on the distance between the streaming device (e.g., a television) and the user wearing the hearing aid. This will increase the natural feeling of the incoming sound, and provide the ability to seamlessly turn up / down the streaming sound source (and vice versa, the hearing aid output) when walking around the room, and in some cases pay attention to the hearing aid output sound (based on the input from the hearing aid's microphone) without having to pause / resume the streaming signal source. The distance between the transmitting device and the receiving device may be estimated, for example, by detecting the signal strength received in the receiving device and the signal strength received transmitted from the transmitting device. Similarly, the Bluetooth parameter "High Accuracy Distance Measurement" (HADM) may be used.

[0018] Example 6: In a classroom with hearing-impaired students and multiple teachers using microphones, it is difficult for the hearing-impaired students to locate and / or distinguish the microphone signals transmitted by multiple streams.

[0019] Our pending patent application EP23199298.3, entitled "Hearing aid comprising a wireless audio receiver and a self-voice detector" filed with the European Patent Office on September 25, 2023, relates to (automatically) controlling the gain applied to the hearing aid microphone input when direct audio input is received, and is incorporated herein by reference.

[0020] In the present invention, it is proposed to ensure that the streaming audio signal is presented to the user in accordance with one or more of the following:

[0021] - being in the correct position in space (e.g. direction and / or distance);

[0022] - Tracking of the user's head to further externalize the streaming sound;

[0023] - Add reverberation that externalizes the sound while maintaining speech understanding. This can be achieved, for example, using Bluetooth distance measurement (HADM). The added reverberation can also be based on the room acoustics as needed;

[0024] -Having additional gain to enhance the desired signal based on the user's head orientation, allowing the user to control what they hear simply by turning their head;

[0025] -Has additional gain to enhance the signal where needed based on the user's proximity to the streaming source.

[0026] Turning the head helps detect small changes in latency and level differences between ears and spectral shaping of incoming sounds as a person typically attempts to localize sounds. Additionally, turning the head can also help better hear another person speaking because the right ear is more sensitive to sounds arriving 30-60 degrees to the right than directly in front of the right ear. Finally, it is easier for the human brain to cognitively separate multiple speakers if they are separated in space than if they are side by side. The present invention attempts to utilize (at least in part) these effects to enhance the user's spatial awareness and / or improve speech understanding. Furthermore, implementation of the present invention may enable a hearing aid user to temporarily cut off an audio stream and focus on the hearing aid microphone input without having to stop or disconnect an active stream. This will provide the user with a more seamless interaction with the streaming source.

[0027] The implementation of this feature can be based on activity data such as walking, distance measurements such as Bluetooth signal strength or HADM (High Accuracy Distance Measurement), relative head direction compared to the direction of the signal source, or general head rotation amount (head still -> increase streaming sound, high head rotation -> increase HA sound).

[0028] Binaural hearing aid system

[0029] In one aspect of the present application, a binaural hearing aid system is provided. The binaural hearing aid system comprises first and second hearing aids adapted to be located at or in the left and right ears of a user, respectively. Each of the first and second hearing aids comprises an input transducer for converting an acoustically propagated signal incident on the input transducer into an electrical sound input signal comprising a target signal from at least one target sound source and other signals from possible other sound sources in the user's surroundings. At least one of the first and second hearing aids, for example each, further comprises a wireless receiver for receiving a signal wirelessly transmitted from an audio transmitter and retrieving a streaming audio input signal comprising a target signal from at least one target sound source and other signals from other sound sources in the surroundings of the audio transmitter from the audio transmitter. Each of the first and second hearing aids comprises an input gain controller for controlling the relative weight between the electrical sound input signal and the streaming audio input signal and providing a weighted sum of the input signals. Each of the first and second hearing aids further comprises an output transducer configured to convert the weighted sum of the input signals or a further processed version thereof into a stimulus that can be perceived as sound by the user. The binaural hearing aid system further comprises a position detector configured to provide an estimate of a current position of at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate. The binaural hearing aid system may further comprise: at least one (e.g., two) of the input gain controllers of the first and second hearing aids are configured to provide the relative weight according to the position detector control signal.

[0030] Thereby an improved hearing aid system may be provided.In particular, binaural processing in a binaural hearing aid system provides input gains to the microphone signals and the streaming signals that are related to the position of the current target sound source relative to the user.

[0031] The first and second hearing aids may comprise first and second ear pieces forming part of or constituting the first and second hearing aids, respectively. The ear pieces may be adapted to be located in an ear of a user, e.g. at least partially in an ear canal of a user, e.g. partially outside the ear canal (e.g. partially in the pinna) and partially in the ear canal.

[0032] As an alternative, the wireless receiver may be located in a separate processing device forming part of a binaural hearing aid system and configured, for example, to serve both earpieces.

[0033] The input transducer may include a noise reduction algorithm configured to reduce noise in the resulting electrical sound input signal (i.e., provide an electrical sound input signal with reduced noise). Similarly, the wireless receiver may include a noise reduction algorithm configured to reduce noise in the resulting streaming audio input signal.

[0034] The input transducer may, for example, include a plurality of microphones and a beamformer filter configured to provide the resulting electrical acoustic input signal as a beamformed signal.

[0035] The at least one target sound source providing the target signal received by the wireless receiver may be the same as the at least one target sound source providing the target signal received by the input transducer (e.g., if the audio transmitter is a microphone unit). However, they may also be different (e.g., if the audio transmitter is a TV sound transmitter).

[0036] The estimation of head movement activity, such as the detection of head movement, may indicate, for example, that the user's attention has changed from one target sound source to another target sound source. The user's surroundings may, for example, include more than one target sound source, such as two. The user's surroundings may, for example, include more than one target sound source that moves relative to the user over time. The user's attention may be transferred from one target sound source to another target sound source over time. The acoustic scene may include more than two target sound sources in a "conversation-like" interaction, such as involving a transfer of "speech rights" (turn-taking), so that these speakers do not speak at the same time (or the simultaneous speech has only a small overlap, such as less than 2 seconds). In a first time period, where the user's head movement activity is quite small, such as below a threshold, it can be assumed that the user pays attention to a specific first target sound source (having a first position relative to the user, corresponding to the user's first viewing direction). When the user's head movement activity is quite large, such as above a threshold, it can be assumed that the user's attention has changed from one target sound source to another target sound source. When the user's head movement activity is (again) quite small, it can be assumed that the user's attention is on the target sound source (e.g., located at a second position, corresponding to the user's second (current) viewing direction).

[0037] The estimate of the position of the at least one target sound source relative to the user's head may include an estimate of the angle between the user's current viewing direction and the direction from the user's head to the at least one target sound source.

[0038] The estimation of the viewing direction and the direction from the user's head to the target sound source may be estimated relative to a common reference direction. The current viewing direction and the direction from the user's head to the target sound source may be estimated relative to a (e.g. common) reference direction. The (e.g. common) reference direction may be the "normal forward viewing direction of the user". In a typical case, the user looks at the target sound source that the user is currently interested in by turning the head towards the target sound source direction, e.g. by turning the head only or by including the torso, so that the current viewing direction is equal to the direction from the user to the target sound source. In other words, the angle between the direction of the target sound source that the user is currently interested in and the current viewing direction is equal to 0 (or close to 0). Other target sound sources located elsewhere than the current source of interest (and e.g. assuming that the user (currently) has little interest in them compared to the "current source of interest") will exhibit an angle different from 0 (e.g. higher than a threshold angle different from 0, e.g. higher than 10°) between the direction of the (other) target sound source involved and the user's current viewing direction.

[0039] "The user's normal forward direction" (see Figure 8B The NLD in Figure 8B The direction in which the user is looking when the user is in the normal forward-looking (looking forward) position, i.e., in the direction along a line passing through the user's shoulders (- torso (TSO)) (see, for example, Fig. 8A , 8B The horizontal direction perpendicular to the y-axis in the Fig. 8A , 8B The predetermined head-related transfer function is usually determined using a model of a human head and torso, wherein the viewing direction of the model is the above-mentioned "normal forward viewing direction of the user". If the user's viewing direction deviates from the normal forward viewing direction, the corresponding head-related transfer function may be assumed to change, but the change may be assumed to be quite small and can be ignored in the context of the present invention.

[0040] The reference direction may be the direction from the user to the transmitter or relative to the user's torso (see e.g. Figure 8B Normal forward-looking position of TSO in .

[0041] The position of the transmitter relative to the user can be estimated by the direction from the user (eg, a wireless receiver worn by the user) to the transmitter or the user's normal forward-looking direction.

[0042] Tracking (estimating) the position of the target audio sound source relative to the orientation of the user's head can be used to control the amplification of the standard amplified sound of the hearing aid (collected by the hearing aid's input transducer) while streaming, in other words, determine the relative weight between the electrical sound input signal and the streaming audio input signal. When the user, for example, looks towards a TV set (including a TV audio sound transmitter), the ambient sound amplification can be automatically reduced (relative to the streaming sound), and when the user looks away from the TV set, the ambient sound amplification can be automatically increased (relative to the streaming sound).

[0043] The input gain controller may be configured to reduce the relative weight of the electric sound input signal as the angle increases. For example, the input gain controller may be configured to reduce the relative weight between the electric sound input signal and the streaming audio input signal as the angle increases. A simple implementation of this approach may be to have full streaming gain (e.g., gain = 1 (0 dB)) when the user's head is facing the desired sound source direction (angle ∼0, within + / -30°); and to successively reduce the gain at larger angular deviations (e.g., -3 dB at + / -45°, e.g., -6 dB at + / -60°, e.g., -12 dB at + / -90°, and up to -18 dB at angles greater than + / -90°). Otherwise, a continuous dependence between gain and angle may be applied, e.g., with a maximum capping attenuation (e.g., 6 dB).

[0044] The modification of the relative weights (gains) may be dependent on a reception control signal indicating that at least one streaming audio input signal is currently being received, eg so that the weights are only modified when a valid streaming audio input signal is retrieved.

[0045] The modification of the relative weights may also or alternatively depend on a voice control signal from a voice activity detector indicating the presence of voice (e.g. the user's voice, or any voice, or other voice than the user) in the electrical sound input signal and / or the streaming audio input signal. The input gain controller may be configured to modify the weights only when the streaming audio input signal comprises speech (e.g. is speech-dominant).

[0046] Modification of the relative weights may also or alternatively depend on a motion control signal from the motion detector indicating whether the user is moving.The input gain controller may be configured to modify the weights only if the user is not moving significantly (motion is below a threshold).

[0047] The position detector may include a head tracker configured to track the rotation angle of the user's head compared to a reference direction to estimate or contribute to the estimation of the position of the target sound source relative to the user's head. The rotation angle of the user's head may be provided, for example, by a head tracker, for example based on a 1D, 2D or 3D gyroscope and / or a 1D, 2D or 3D accelerometer and / or a 1D, 2D or 3D magnetometer. Such a device is sometimes referred to as an "inertial measurement unit" (IMU), see, for example, EP3477964A1. The reference direction of the head tracker may be, for example, the "normal forward viewing direction of the user".

[0048] The head tracker may include a combination of a gyroscope and an accelerometer, such as a combination of a 1D, 2D, or 3D gyroscope and a 1D, 2D, or 3D accelerometer.

[0049] The position detector may include an eye tracker, thereby enabling estimation of the current eye gaze angle of the user relative to the current position of the user's head and thereby fine-tuning the estimate of the position of the target sound source relative to the user's head. The current eye gaze angle of the user relative to the current position of the user's head may be represented by an angle relative to the current rotation angle of the user's head. The eye gaze angle may thus be used as a correction (fine-tuning) for the position of the target sound source relative to the user's head, for example estimated as the sum of the rotation angle of the user's head and the eye gaze angle (calculated with signs such that eye gaze in the same direction as the head rotation has the same sign, and eye gaze in the opposite direction of the head rotation has the opposite sign, θ pos =θ head +θ eye ). The eye tracker may be based on one or more electrodes that collect electrical potentials from the eyeball in contact with the user's skin. The electrodes may be located on the surface of the housing of the first and second hearing aids and may be configured to provide appropriate electro-oculogram (EOG) signals, see for example EP3185590A1.

[0050] An estimate of the location of the target sound source relative to the user's head can be determined as a combination of: a) the angle (θ) between a line from the location of the target sound source to the user's head (e.g., its midpoint) and a line parallel to the user's normal forward direction of vision (both lines are in the horizontal plane); and b) the distance (D) between the target sound source and the user's head. In other words, when the origin of the coordinate system is in (the middle of) the user's head (see, e.g., Figure 8B ), the position of the target sound source can be expressed in polar coordinates as (D,θ).

[0051] The estimate of the current position of at least one target sound source relative to the user's head includes an estimate of the distance between the target sound source and the user's head.

[0052] The estimate of the current position of at least one target sound source relative to the user's head may include an estimate of the distance between the audio transmitter and the wireless receiver. The distance between the transmitting device and the receiving device (of the hearing aid system) may be estimated, for example, by detecting the signal strength received in the receiving device (e.g. a "received signal strength indication" (RSSI) or a "received channel power indication" (RCPI)) and receiving the signal strength (or channel power) of the transmission from the transmitting device. Similarly, the Bluetooth parameter "High Accuracy Distance Measurement" (HADM) may be used.

[0053] The direction from the transmitter to the user (eg to a wireless receiver of a binaural hearing aid system worn by the user) may for example be estimated in the wireless receiver of the binaural hearing aid system.

[0054] The angle of the user's head (see Figure 6 The angle θU in the image may be measured (e.g., using a head tracker) and may be calculated relative to the angle from the user (e.g., the user's head) to the transmitter (e.g., Figure 6 The direction of the stream transmission unit (MA) in is determined.

[0055] The input gain controller may be configured to reduce the relative weight of the electric sound input signal as the distance increases. For example, the input gain controller is configured to reduce the relative weight between the electric sound input signal and the streaming audio input signal as the distance increases. Alternatively, the input gain controller may be configured to increase the relative weight of the streaming audio input signal as the distance increases.

[0056] The estimate of the position of the target sound source relative to the user's head may be provided as user input. The binaural hearing aid system may include a user interface (e.g. implemented in an auxiliary device that communicates with the binaural hearing aid system or forms part of the binaural hearing aid system, see e.g. Fig. 9 ). The user interface may be configured to enable the user to indicate the current position of the target sound source relative to the user's head, for example via a user-operable activation element such as one or more buttons such as a touch screen and / or a keyboard. The user interface may be configured to indicate the angle or position of the sound source relative to a reference direction (or position), for example, the user's head in a normal forward viewing direction (e.g., the direction of the nose). The user interface may be configured to enable the user to select the current angle or position of the target sound source relative to the user based on a plurality of predetermined positions (angles and / or distances), for example by showing the user and a plurality of selectable positions (angles and / or distances, for example, see Fig. 9 ) The user interface may be implemented in a separate processing device forming part of a binaural hearing aid system and may, for example, be configured to serve both ear pieces.

[0057] Each of the first and second hearing aids may comprise a monaural audio signal processor configured to apply one or more processing algorithms to said weighted sum of said input signals and to provide a processed electrical output signal therefrom. The one or more processing algorithms may be configured to compensate for hearing impairment of a user.

[0058] The position detector may be configured to estimate the direction of arrival of the sound from the target sound source based on one or more of the electrical sound input signal and the streaming audio input signal. The direction of arrival of the sound from the target sound source may be equal to the angle of the direction from the user's head to the target sound source relative to a reference direction, such as the user's normal forward viewing direction, e.g., see Fig. 8A , 8B The arrival direction of the sound from the target sound source may be estimated, for example, as disclosed in EP3285500A1. The position detector may include a viewing direction detector configured to provide a viewing direction control signal indicating the current viewing direction of the user. The viewing direction detector may include, for example, one or more of a gyroscope, an accelerometer, a magnetometer, and a direction of arrival (DOA) detector of a wireless signal.

[0059] The binaural hearing aid system may comprise a binaural audio signal processor configured to apply a binaural gain to a streaming audio input signal of the first and second hearing aids. The binaural audio signal processor may be configured to provide respective first and second binaural processed electrical output signals comprising the streaming audio input signals of the first and second hearing aids after the binaural gain has been applied.

[0060] The binaural audio signal processor may be configured to control a binaural gain of the streaming audio input signal applied to the respective first and second hearing aids based on an estimate of the position of the target sound source relative to the user's head. Thus, first and second binaural processed electrical output signals may be provided that provide a spatial perception that the origin of the target sound source is outside the user's head.

[0061] The binaural hearing aid system may include a separate processing device including a monaural and / or binaural audio signal processor and / or a wireless receiver. Each of the first and second hearing aids, such as first and second ear pieces, may include a wireless transceiver adapted to exchange data, such as audio or other data, with the separate processing device.

[0062] The binaural hearing aid system may be configured to provide respective first and second binaural processed electrical output signals based on one or more detectors, including one or more of the following: a wireless reception detector, a gaze detector (estimator), a distance detector (estimator), a voice activity detector (estimator) such as a general voice activity detector (e.g., a speech detector) and / or an own voice detector, a motion detector (providing a motion control signal indicating the current motion of the user), a brain wave detector, etc.

[0063] The "spatial information" ("or spatial cues") that provide the user with a "spatial sense of origin" may include an acoustic transfer function from a target position (i.e., the position of a target sound source) to each of the first and second hearing aids (e.g., ear pieces) (when located at the user's first and second ears, respectively) (or a relative acoustic transfer function from one of the first and second ear pieces (e.g., their microphones) to the other when the sound is transmitted from the target position). The spatial information may, for example, be generated in the audio transmitter based on head orientation data, which is measured in the hearing aid system and forwarded to the transmitter via a "backward link" from the hearing aid system to the audio transmitter. Thus, the streaming audio signal from the audio transmitter may include the spatial information. The streaming audio signal may, for example, be forwarded to a binaural hearing aid system as a stereo signal (e.g., different signals for the first and second hearing aids). If the audio transmitter forms a remote microphone array or a device comprising a microphone array (e.g., a desktop microphone, see, for example Figure 6 or Figure 7H ), which is suitable for example. As an alternative, the spatial information can be generated in a binaural hearing system, for example in a separate processing device or in each of the first and second hearing aids, or in a combination of an audio transmitter and a binaural hearing aid system.

[0064] Spatial orientation data (e.g., head orientation data, or spatial cues) may be applied in the form of a head-related (acoustic) transfer function for the acoustic propagation of sound from a sound source at a given position around a user to different input transducers of a hearing aid of a hearing aid system (e.g., to one or more input transducers located at a first and a second ear of the user). The head-related transfer function may be estimated by a level difference between the two ears. The head-related transfer function may be estimated by a latency difference between the two ears. The head-related transfer function may be represented by a frequency-dependent level difference and latency difference between the two ears. The head-related transfer function may be implemented by applying a specific (e.g., complex) binaural gain correction to the signals presented by the first and second hearing aids (e.g., earpieces) at the left and right ears. The real and imaginary parts of the binaural complex gain correction may represent a level difference (real part of the gain) and a latency difference (imaginary part of the gain). In the case where more than one audio signal is received by the binaural hearing aid system from corresponding one or more audio transmitters (or transmitters that collect target sound sources at different locations, such as desktop microphones), the relevant HRTF for each of the locations of the one or more audio transmitters (or target sound sources) can be applied to the corresponding one or more audio signals before the audio signals are presented to the user. Thereby, a spatial sense of the origin of one or more target sound sources corresponding to the sound provided to the binaural hearing aid system by the audio transmitter is provided outside the user's head. The resulting signal including appropriate acoustic transfer functions (HRTFs) (or impulse responses (HRIRs)) can be provided as a linear weighted combination of the signals from each target sound source, where the weights are appropriate acoustic transfer functions (or impulse responses) of the corresponding sound source locations relative to the user. This can be achieved by identifying the locations of currently existing target sound sources over time as proposed by the present invention and applying appropriate HRTFs to a plurality of different signals currently existing in the streaming audio signal. Also taking into account the assumption that the target sound sources currently existing at a given point in time are of interest to the user, the corresponding weights may also include estimates of the corresponding priorities of these target sound sources (e.g. determined according to the present invention).

[0065] The binaural hearing aid system may comprise a wireless reception detector configured to provide a reception control signal indicating whether at least one stream of transmitted audio signals comprising the target signal and optionally other signals from other sound sources in the user's surroundings is currently received.

[0066] The target sound sources may include sound transmitted from a television (TV) via a TV sound transmitter located with the TV to the binaural hearing aid system and / or sound transmitted from one or more persons to the binaural hearing aid system via a microphone unit located at or near the person or persons involved. Figure 4A , 4B and Figure 7G , 7H, respectively, illustrate a situation in which a user of a binaural hearing aid system is conversing with two persons, each of whom is wearing a companion microphone unit, or is sitting next to a desktop microphone unit, configured to transmit the sound from the persons involved to the binaural hearing aid system.

[0067] The input transducer may include a noise reduction algorithm configured to reduce noise in the resulting electrical sound input signal, and / or wherein the input transducer includes a plurality of microphones and a beamformer filter configured to provide the resulting electrical sound input signal as a beamformed signal based on signals from the plurality of microphones. Similarly, the wireless receiver may include a noise reduction algorithm configured to reduce noise in the resulting streaming audio signal.

[0068] The first and second hearing aids (eg each) may be constituted by an air conduction hearing aid, a bone conduction hearing aid, a cochlear implant hearing aid or a combination thereof, or may include an air conduction hearing aid, a bone conduction hearing aid, a cochlear implant hearing aid or a combination thereof.

[0069] In another aspect of the present application, a binaural hearing aid system is provided. The binaural hearing aid system comprises:

[0070] - first and second ear pieces adapted to be located at or in the left and right ears of a user, respectively, each of the first and second ear pieces comprising

[0071] an input transducer for converting corresponding first and second acoustic propagated signals incident on the first and second ear pieces into first and second electrical sound input signals, respectively, each of the received acoustic propagated signals comprising a target signal from a target sound source and other signals from other sound sources in an environment surrounding the user;

[0072] an output transducer configured to convert the received and first and second binaurally processed electrical output signals of the corresponding earpieces into stimuli perceivable as sound by the user;

[0073] - at least one wireless receiver for receiving the wirelessly transmitted signal from the audio transmitter and retrieving from the audio transmitter at least one stream of transmitted audio input signal comprising said target signal and optionally other signals from other sound sources in the user's surroundings;

[0074] - a position detector configured to provide an estimate of the current position of the target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate; and

[0075] - a binaural audio signal processor configured to receive said at least one stream transmission audio input signal, said first and second electrical sound input signals, and said at least one detector signal and to provide corresponding first and second binaural processed electrical output signals based on these signals;

[0076] Wherein the hearing aid system is configured in an audio streaming reception mode to provide the first and second binaural processed electrical output signals based on the at least one streaming audio input signal and the position detector control signal.

[0077] Thereby an improved hearing aid system may be provided.In particular, binaural processing in a binaural hearing aid system provides spatial cues related to a current target sound source of interest to the user.

[0078] The position detector may be configured to track the position of the user's head relative to the audio transmitter over time. The position detector may be configured to track the position of the user's head relative to the audio transmitter at least from one moment to the next, preferably over a certain time range, e.g. of the order of seconds. The tracking (or the detector control signal) may be smoothed over time, e.g. to avoid or minimize reactions to small (short) changes in motion.

[0079] The position detector may be configured such that the position detector control signal indicates at least one of: a) a current distance between the target sound source and the user's head, and b) a current angle between a direction from the user's head to the target sound source and the user's current viewing direction.

[0080] The correction level or gain applied to the electrical output signals of the first and second binaural processing can be determined based on the current distance between the target sound source and the user's head, so that the correction level or gain increases with decreasing distance and decreases with increasing distance, at least within a certain level or gain correction range.

[0081] The correction level or gain applied to the electrical output signals of the first and second binaural processing can be determined based on the current angle between the direction from the user's head to the target sound source and the user's current viewing direction, so that the correction level or gain increases as the absolute value of the angle decreases and decreases as the absolute value of the angle increases, at least within a certain level or gain correction range.

[0082] The correction level or gain applied to the electrical output signals of the first and second binaural processing can be determined based on the current position of the user's head relative to the audio transmitter, such as the current angle between the direction from the user's head to the target sound source and the user's current viewing direction and the current distance between the target sound source and the user's head.

[0083] In another aspect of the present application, a binaural hearing aid system is provided. The binaural hearing aid system comprises:

[0084] - first and second hearing aids comprising first and second ear pieces adapted to be located at or in the left and right ears of a user, respectively, each of the first and second ear pieces comprising

[0085] an input transducer for converting respective first and second acoustically propagated signals incident on the first and second ear pieces into first and second electrical sound input signals, respectively, each of the received acoustically propagated signals comprising a target signal from a target sound source and other signals from other sound sources in an environment surrounding the user; and

[0086] an output transducer configured to convert the received and first and second binaurally processed electrical output signals of the corresponding earpieces into stimuli perceivable as sound by the user;

[0087] - at least one wireless receiver for receiving the wirelessly transmitted signal from the audio transmitter and retrieving from the audio transmitter at least one stream of transmitted audio input signal comprising said target signal and optionally other signals from other sound sources in the user's surroundings; and

[0088] - a binaural audio signal processor configured to receive said at least one stream transmission audio input signal and said first and second electrical sound input signals and to provide, in dependence thereon, respective first and second binaural processed electrical output signals.

[0089] The binaural audio signal processor is further configured to apply binaural spatial processing to the at least one stream transmission audio input signal and provide respective first and second binaural processed electrical output signals to provide a spatial perception of the target sound source originating outside the user's head according to one or more of:

[0090] - said at least one stream transporting an audio input signal and said first and second electro-acoustic input signals;

[0091] - said at least one stream transports an audio input signal; and

[0092] - a) an estimate of head movement activity, or b) an estimate of the position of a target sound source relative to the user's head and / or an estimate of the position of said audio transmitter relative to the user's head.

[0093] The first and second hearing aids may comprise first and second ear pieces forming part of or constituting the first and second hearing aids, respectively. The ear pieces may be adapted to be located in an ear of a user, e.g. at least partially in an ear canal of a user, e.g. partially outside the ear canal (e.g. partially in the pinna) and partially in the ear canal.

[0094] The at least one wireless receiver may be located in a separate processing device forming part of a binaural hearing aid system and configured to serve both ear pieces. Each of the first and second hearing aids may include a wireless receiver (together forming part of the "at least one wireless receiver", e.g. constituting the "at least one wireless receiver").

[0095] The "spatial information" (or spatial cues) providing the user with a "spatial sense of origin" may comprise an acoustic transfer function from a target location (i.e. the location of a target sound source) to each of the first and second earpieces (when located at the first and second ears of the user, respectively) (or a relative acoustic transfer function from one of the first and second earpieces (e.g. microphones thereof) to the other when sound is transmitted from the target location). The spatial information may for example be generated in the transmitter based on head orientation data, which is measured in the hearing aid system and forwarded to the transmitter via a "backward link" from the hearing aid system to the transmitter. Thus, the streamed audio signal from the transmitter may comprise the spatial information. The streamed audio signal may for example be forwarded to a binaural hearing aid system as a stereo signal. This is for example suitable if the transmitter forms part of a remote microphone array or a device comprising a microphone array (e.g. a desktop microphone). The spatial information may be generated in a binaural hearing system, for example in a separate processing device or in each of the first and second hearing aids, or in a combination of the transmitter and the binaural hearing aid system.

[0096] The estimation of head movement activity, such as the detection of head movement, can for example indicate that the user's attention changes from one target sound source to another target sound source. The user's surrounding environment can for example include more than one target sound source, such as two. The user's surrounding environment can for example include more than one target sound source that moves relative to the user over time. The user's attention can be transferred from one target sound source to another target sound source over time. The acoustic scene can include more than two target sound sources in a "conversation-like" interaction, such as involving the transfer of "speech rights" (turn-taking), so that these speakers do not speak at the same time (or the simultaneous speech has only a small overlap). In a first time period, where the user's head movement activity is quite small, it can be assumed that the user pays attention to a specific first target sound source (having a first position relative to the user, corresponding to the user's first viewing direction). When the user's head movement activity is quite large, the user's attention changes from one target sound source to another target sound source. When the user's head movement activity is (again) quite small, it can be assumed that the user's attention is on the target sound source (e.g., located at a second position, corresponding to the user's second (current) viewing direction).

[0097] The binaural hearing aid system may comprise a monaural audio signal processor configured to apply one or more processing algorithms to the first and second electrical sound input signals, respectively, and optionally to the streaming audio input signal, or a signal derived therefrom. The monaural audio signal processor may comprise a first and a second monaural audio signal processor. The first and second monaural audio signal processors may form part of the binaural audio signal processor. The first and second monaural audio signal processors may be located in the first and second hearing aids, for example in the first and second ear pieces, respectively, or may be located in separate processing devices. The first monaural audio signal processor may be configured to apply one or more processing algorithms to the first electrical sound input signal, and optionally to the streaming audio input signal, or a signal derived therefrom, for example to compensate for hearing loss of the user. Similarly, the second monaural audio signal processor may be configured to apply one or more processing algorithms to the second electrical sound input signal, and optionally to the streaming audio input signal, or a signal derived therefrom. The binaural audio signal processor may be configured to provide a binaural gain suitable for modifying the monaural gain provided by the first and second monaural processors for the first and second electrical sound input signals and optionally the streaming audio input signal or a signal derived therefrom. The binaural gain may for example comprise or may consist of a gain providing a spatial sense of the origin of the target sound source in the first and second binaural processed electrical output signals.

[0098] The binaural audio signal processor can be configured to estimate the arrival direction of the sound from the target sound source based on the streaming audio input signal and the first and second electrical sound input signals. The arrival direction of the sound from the target sound source can be estimated as disclosed in EP3285500A1, for example.

[0099] The binaural audio signal processor may be configured to control the gain applied to at least one streaming audio signal based on an estimate of the position of the target sound source relative to the user's head. Thus, first and second binaural processed electrical output signals may be provided that provide a spatial sense that the target sound source originates outside the user's head. For example, when the user looks in the direction of the streaming sound source, the streaming sound amplification relative to the acoustically propagated sound increases; vice versa, when the user looks away from the streaming sound source, the streaming sound amplification relative to the acoustically propagated sound decreases.

[0100] The binaural hearing aid system may comprise a single processing device including a binaural audio signal processor and / or at least one wireless receiver.

[0101] Each of the first and second hearing aids, eg the first and second earpieces, of the binaural hearing aid system may comprise a wireless transceiver adapted to exchange data, eg audio or other data, with a separate processing device.

[0102] The binaural hearing aid system may be configured to (further) provide the respective first and second binaural processed electrical output signals based on one or more detectors. The one or more detectors may include one or more of the following: a wireless reception detector, a level detector, a viewing direction detector (estimator), a distance detector (estimator), a voice activity detector (estimator) such as a general voice activity detector (e.g. a language detector) and / or an own voice detector, a movement detector, a brain wave detector, etc.

[0103] The binaural hearing aid system may comprise a wireless reception detector configured to provide a reception control signal indicating whether at least one stream transmission audio input signal comprising said target signal and optionally other signals from other sound sources in the user's surroundings is currently received.

[0104] The binaural hearing aid system may include a viewing direction detector configured to provide a viewing direction control signal indicating the current viewing direction of the user relative to the direction of the target sound source position. The viewing direction detector may include, for example, one or more of the following: a gyroscope, an accelerometer, a magnetometer, and a detector of the direction of arrival (DOA) of a wireless signal.

[0105] The binaural hearing aid system may include a motion detector that provides a motion control signal indicative of the user's current motion.

[0106] The levels of the electrical output signals of the first and second binaural processing may be modified according to the difference between the current viewing direction and the direction of the target sound source position. The levels may be modified by applying a (real) gain to the amplitude of the signal concerned. The modification may vary with frequency. The levels of the electrical output signals of the first and second binaural processing may be modified according to a viewing direction control signal, which indicates the current viewing direction of the user relative to the direction of the target sound source position. The modification of the levels may depend on a reception control signal indicating that at least one stream of transmitted audio input signals is currently being received. The level may be increased if the difference between the current viewing direction and the direction of the target sound source position is small, and the level may be decreased if the difference between the current viewing direction and the direction of the target sound source position is large. The level may be modified, for example, within a range, for example between a maximum and a minimum level modification, for example limited to 6 dB.

[0107] The levels of the electrical output signals of the first and second binaural processing may be modified according to the current distance between the target sound source and the user's head. The level may be increased or decreased if the distance between the target sound source and the user's head is smaller or larger. The levels of the electrical output signals of the first and second binaural processing may be modified according to a distance control signal indicating the current distance between the target sound source and the user's head. The modification of the level may also depend on a reception control signal indicating that at least one stream of transmitted audio input signal is currently being received. The modification of the level may also depend on a viewing direction control signal indicating that the current viewing direction is equal to the direction of the position of the target sound source or is within a certain range thereof (e.g., an angle Δθ, e.g., + / -5°).

[0108] The modification of the levels may also or alternatively be dependent on a voice control signal from a voice activity detector indicating the presence of voice (eg the user's voice, or any voice) in the first and second electrical sound input signals.

[0109] Modification of the level may also or alternatively be dependent on a motion control signal from a motion detector indicating whether the user is moving.

[0110] The target sound sources may include sound transmitted from a television (TV) via a TV sound transmitter located with the TV to the binaural hearing aid system and / or sound transmitted from one or more persons to the binaural hearing aid system via a microphone unit located at the person or persons involved, on a table or stand near the persons. Figure 4A , 4B , a situation is shown in which a user of a binaural hearing aid system is conversing with two persons, each person wearing a partner microphone unit configured to transmit the sound from the person concerned to the binaural hearing aid system. Figure 7G , 7H FIG. 4 shows a situation in which a microphone unit collects sounds from two sound sources and transmits the obtained sound signals to a binaural hearing aid system.

[0111] The binaural hearing aid system may be configured to track the position of the user relative to the audio transmitter providing the target signal and to provide a spatial sense that the target sound source originates outside the user's head by applying a head-related transfer function to the electrical output signals of the first and second binaural processes. The head-related transfer function (HRTF) may be estimated by the level difference between the two ears. The head-related transfer function may be estimated by the latency difference between the two ears. The head-related transfer function may be represented by the level difference and latency difference between the two ears as a function of frequency. In the case where more than one audio signal is received by the binaural hearing aid system from the corresponding one or more audio transmitters, the relevant HRTF for each of the positions of the one or more audio transmitters may be applied to the corresponding one or more audio signals before the audio signals are presented to the user. Thus, a spatial sense that one or more target sound sources corresponding to the sound provided to the binaural hearing aid system by the one or more audio transmitters originate outside the user's head may be provided.

[0112] The first and second hearing aids may be composed of, or may include, an air conduction hearing aid, a bone conduction hearing aid, a cochlear implant hearing aid, or a combination thereof.

[0113] Hearing aid system

[0114] In another aspect, a hearing aid system is provided comprising a hearing aid and an audio transmitter. The hearing aid and the audio transmitter are configured to exchange data therebetween (eg comprising appropriate antennas and transmitter-receiver circuits).

[0115] The hearing aid comprises:

[0116] - a wireless receiver for receiving wirelessly transmitted signals from the audio transmitter and retrieving from the audio transmitter a streaming audio input signal comprising at least a target signal and optionally other signals from other sound sources in the surroundings of the target sound source;

[0117] a position detector configured to provide an estimate of a current position of at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate; wherein the hearing aid is configured to transmit the position detector control signal to the audio transmitter;

[0118] - a wireless transmitter for transmitting data to an audio transmitter;

[0119] The audio transmitter comprises:

[0120] - an input unit configured to provide at least one (transmitter) electrical input signal representing a sound;

[0121] - a wireless audio transmitter configured to transmit data, such as audio data, comprising at least one (transmitter) electrical input signal representing sound to the hearing aid;

[0122] - a wireless receiver configured to receive data including position detector control signals from the hearing aid; and

[0123] - a transmission processor configured to determine a transmitter gain based on the position detector control signal and to apply the transmitter gain to at least one (transmitter) electrical input signal.

[0124] The hearing aid may further comprise an input transducer for converting an acoustically propagated signal incident on the input transducer into an electrical sound input signal comprising a target signal from at least one target sound source and other signals from possible other sound sources in the user's surroundings.

[0125] The audio transmitter may, for example, comprise a television (TV) or other video-sound transmitter configured to receive sound from a TV or other video device and transmit the sound to the hearing aid. The audio transmitter may, for example, comprise a microphone unit configured to collect sound from one or more target sound sources in the environment of the microphone unit and transmit the sound. The TV (or video) sound transmitter may, for example, be located together with (or integrated into) a TV (or video device). The target sound source may comprise sound transmitted from a TV or video device to the hearing aid via the TV or video sound transmitter. The microphone unit may be configured to be located at or near a person or a group of persons (e.g., constituting a target sound source). The target sound source may comprise sound transmitted from one or more persons to the hearing aid via the microphone unit (when located at or near the person or persons concerned).

[0126] The estimate of the position of at least one target sound source relative to the user's head may include an estimate of the angle between a reference direction and the direction from the user's head to the at least one target sound source. Thus, the priority between two (or more) sound sources may be implemented in an audio transmitter (e.g. constituting or forming part of a microphone unit such as a desktop microphone (e.g. a "speakerphone")). The reference direction may, for example, be the user's normal forward viewing direction, e.g. see Fig. 8A , 8B , or the direction of the audio transmitter, see e.g. Figure 6 In a typical situation, the user looks at the target sound source that the user is currently interested in by turning the head toward the target sound source, for example, by turning the head alone or by including the torso, so that the current viewing direction is equal to the direction from the user to the target sound source. In other words, the angle between the direction of the target sound source and the current viewing direction is 0 (or close to 0).

[0127] The transmitter gain may comprise spatial information representing the current position of at least one target sound source relative to the user's head. In other words, the spatial information is generated in the audio transmitter based on head orientation data, which is measured in the hearing aid and forwarded to the transmitter via a "backward link" from the hearing aid to the audio transmitter. Thus, the streamed audio signal from the audio transmitter may comprise the spatial information. The streamed audio signal may, for example, be forwarded as a stereo signal to a binaural hearing aid system comprising a first and a second hearing aid. This is, for example, suitable if the audio transmitter forms part of a remote microphone unit (e.g. a desktop microphone) comprising a microphone array, e.g. involving more than one target sound source (e.g. a person) such as a talking subject at different positions around the microphone unit.

[0128] The priority order between the electric sound input signal picked up by the respective input transducers of the first and second hearing aids and the streaming audio input signal according to the position detector control signal can be provided by the respective input gain controllers of the first and second hearing aids, for example as a respective weighted sum of the input signals (out 1,out 2 ). The hearing aid may comprise an input gain controller for controlling the relative weighting between the electrical sound input signal and the streaming audio input signal and providing a weighted sum of these input signals.

[0129] Characteristics of hearing aids used in binaural hearing aid systems or hearing aid systems

[0130] The hearing aid may be adapted to provide frequency dependent gain and / or level dependent compression and / or frequency transposition of one or more frequency ranges to one or more other frequency ranges (with or without frequency compression) to compensate for the hearing impairment of the user. The hearing aid may include a signal processor for enhancing an input signal and providing a processed output signal.

[0131] The hearing aid may comprise an output unit for providing a stimulus perceived by the user as an acoustic signal based on the processed electrical signal. The output unit may comprise a plurality of electrodes of a cochlear implant (of a CI type hearing aid) or may comprise a vibrator of a bone conduction hearing aid. The output unit may comprise an output transducer. The output transducer may comprise a receiver (speaker) for providing the stimulus as an acoustic signal to the user (e.g. in an acoustic (air conduction based) hearing aid). The output transducer may comprise a vibrator for providing the stimulus as a mechanical vibration of the skull to the user (e.g. in a bone attached or bone anchored hearing aid). The output unit may (in addition or as an alternative) comprise a transmitter for transmitting the sound picked up by the hearing aid (e.g. via a network, e.g. in telephone operating mode, or in a headset configuration) to another device, such as a remote communication partner.

[0132] The hearing aid may comprise an input unit for providing an electrical input signal representing a sound. The input unit may comprise an input transducer such as a microphone for converting the input sound into the electrical input signal. The input unit may comprise a wireless receiver for receiving a wireless signal comprising or representing a sound and providing the electrical input signal representing the sound.

[0133] The wireless receiver and / or transmitter may be configured to receive and / or transmit electromagnetic signals in the radio frequency range (3kHz to 300GHz), for example. The wireless receiver and / or transmitter may be configured to receive and / or transmit electromagnetic signals in the optical frequency range (e.g., infrared light 300GHz to 430THz or visible light such as 430THz to 770THz), for example.

[0134] A hearing aid may include a directional microphone system adapted to spatially filter sounds from the environment so as to enhance a target sound source among a plurality of sound sources in the local environment of a user wearing the hearing aid. The directional system may be adapted to detect (e.g., adaptively detect) from which direction a particular portion of the microphone signal originates. This may be implemented in a variety of different ways, such as described in the prior art. In hearing aids, microphone array beamformers are typically used to spatially attenuate background noise sources. The beamformer may include a linear constrained minimum variance (LCMV) beamformer. Many beamformer variants can be found in the literature. Minimum variance distortionless response (MVDR) beamformers are widely used in microphone array signal processing. Ideally, the MVDR beamformer keeps the signal from the target direction (also called the line of sight) unchanged, while maximally attenuating sound signals from other directions. The generalized sidelobe canceler (GSC) structure is an equivalent representation of the MVDR beamformer, which provides computational and digital representation advantages over direct implementation in its original form.

[0135] The hearing aid may include an antenna and transceiver circuitry that enables a wireless link to be established to an entertainment device (e.g. a television), a communication device (e.g. a telephone), a wireless microphone, or another hearing aid. The hearing aid may thus be configured to wirelessly receive a direct electrical input signal from another device. Similarly, the hearing aid may be configured to wirelessly transmit a direct electrical output signal to another device. The direct electrical input or output signal may represent or include an audio signal and / or a control signal and / or an information signal.

[0136] In general, the wireless link established by the antenna and the transceiver circuit of the hearing aid may be of any type. The wireless link may be a link based on near field communication, such as an inductive link based on inductive coupling between antenna coils of a transmitter part and a receiver part. The wireless link may be based on far field electromagnetic radiation. Preferably, the frequency used to establish the communication link between the hearing aid and the other device is lower than 70 GHz, such as in the range from 50 MHz to 70 GHz, such as higher than 300 MHz, such as in the ISM range higher than 300 MHz, such as in the 900 MHz range or in the 2.4 GHz range or in the 5.8 GHz range or in the 60 GHz range (ISM = Industrial, Scientific and Medical, such standardized ranges are defined, for example, by the International Telecommunication Union ITU). The wireless link may be based on standardized or dedicated technologies. The wireless link may be based on Bluetooth technology (such as low power Bluetooth technology, such as LE Audio) or ultra-wideband (UWB) technology.

[0137] The hearing aid may form part of a portable (ie configured to be wearable) device, such as a device comprising a local energy source such as a battery, such as a rechargeable battery. The hearing aid may for example be a low weight, easily wearable device, such as having a total weight of less than 100g, such as less than 20g.

[0138] The hearing aid may include a "forward" (or "signal") path between the input and output of the hearing aid for processing audio signals. A signal processor may be located in the forward path. The signal processor may be adapted to provide a frequency-dependent gain according to the specific needs of the user (e.g. hearing loss). The hearing aid may include an "analysis" path having functional parts for analyzing signals and / or controlling processing of the forward path. Part or all of the signal processing in the analysis path and / or the forward path may be performed in the frequency domain, in which case the hearing aid includes appropriate analysis and synthesis filter banks. Part or all of the signal processing in the analysis path and / or the forward path may be performed in the time domain.

[0139] The analog electrical signal representing the acoustic signal can be converted into a digital audio signal in an analog-to-digital (AD) conversion process, where the analog signal is sampled at a predetermined sampling frequency or sampling rate f. s Sampling, f s For example, in the range from 8 kHz to 48 kHz (adapted to the specific needs of the application) at discrete time points t n (or n) provides digital samples x n (or x[n]), each audio sample is passed through a predetermined N b The bit represents the sound signal at t n The value of N b For example, in the range from 1 to 48 bits, such as 24 bits. Each audio sample thus uses N b bit quantization (resulting in 2 Nb different possible values). A digital sample x has a 1 / f s The time length, such as 50μs, for f s = 20kHz. Multiple audio samples can be arranged in time frames. A time frame can include 64 or 128 audio data samples. Other frame lengths can be used depending on the actual application.

[0140] The hearing aid may include an analog-to-digital (AD) converter to digitize an analog input (e.g., from an input transducer such as a microphone) at a predetermined sampling rate, such as 20 kHz. The hearing aid may include a digital-to-analog (DA) converter to convert the digital signal into an analog output signal, such as for presentation to a user via an output transducer.

[0141] The hearing aid, such as the input unit and / or the antenna and transceiver circuitry, may comprise a transform unit for transforming a time domain signal into a signal in a transform domain (e.g. frequency domain or Laplace domain, Z transform, wavelet transform, etc.). The transform unit may consist of or include a time-frequency (TF) transform unit for providing a time-frequency representation of the input signal. The time-frequency representation may comprise an array or mapping of corresponding complex or real values ​​of the signal concerned in a specific time and frequency range. The TF transform unit may comprise a filter bank for filtering the (time-varying) input signal and providing a plurality of (time-varying) output signals, each output signal comprising a distinct frequency range of the input signal. The TF transform unit may comprise a Fourier transform unit (e.g. a discrete Fourier transform (DFT) algorithm, a short-time Fourier transform (STFT) algorithm, or a similar algorithm) for transforming the time-varying input signal into a (time-varying) signal in the (time-)frequency domain. The minimum frequency f is taken into account by the hearing aid. min To the maximum frequency f max The frequency range of may include a portion of the typical human hearing range from 20 Hz to 20 kHz, for example a portion of the range from 20 Hz to 12 kHz. Typically, the sampling rate f s Greater than or equal to the maximum frequency f max twice, that is, f s ≥2f max The signals of the forward path and / or analysis path of the hearing aid may be split into NI frequency bands (e.g. of uniform width), wherein NI is, for example, greater than 5, such as greater than 10, such as greater than 50, such as greater than 100, such as greater than 500, at least parts of which are processed separately. The hearing aid may be adapted to process the signals of the forward and / or analysis path in NP different frequency channels (NP≤NI). The frequency channels may be of uniform or non-uniform width (e.g. the width increases with frequency), overlapping or non-overlapping.

[0142] The hearing aid may be configured to operate in different modes, such as a normal mode and one or more specific modes, which may be selected by a user or may be automatically selected, for example. The operating mode may be optimized for a specific acoustic situation or environment, such as a communication mode, e.g., a telephone mode. The operating mode may include a low power mode, in which the functionality of the hearing aid is reduced (e.g., to save energy), such as disabling wireless communication and / or disabling specific features of the hearing aid.

[0143] The hearing aid may include a plurality of detectors configured to provide status signals related to the current network environment of the hearing aid (e.g., the current acoustic environment), and / or to the current state of a user wearing the hearing aid, and / or to the current state or operating mode of the hearing aid. Alternatively or additionally, one or more of the detectors may form part of an external device that communicates with the hearing aid (e.g., wirelessly). The external device may, for example, include another hearing aid, a remote control, an audio transmission device, a phone (e.g., a smartphone), an external sensor, etc.

[0144] One or more of the plurality of detectors may operate on a full-band signal (time domain). One or more of the plurality of detectors may operate on a band-split signal ((time-)frequency domain), for example in a limited number of frequency bands.

[0145] The plurality of detectors may include a level detector for estimating the current level of the signal of the forward path. The detector may be configured to determine whether the current level of the signal of the forward path is above or below a given (L-)threshold. The level detector acts on the full-band signal (time domain). The level detector acts on the band-split signal ((time-)frequency domain).

[0146] The hearing aid may comprise a voice activity detector (VAD) for estimating whether (or with what probability) an input signal (at a given point in time) comprises a voice signal. In the present specification, a voice signal may be taken to mean a signal comprising speech from a human being. It may also include other forms of vocalizations (such as singing) produced by a human speech system. The voice activity detector unit may be adapted to classify the user's current acoustic environment as a "voice" or a "no-voice" environment. This has the following advantage: time periods comprising an electric microphone signal of human vocalizations (such as speech) in the user's environment may be identified and thus separated from time periods comprising only (or mainly) other sound sources (such as artificially produced noise). The voice activity detector may be adapted to detect the user's own voice as "voice" as well. As an alternative, the voice activity detector may be adapted to exclude the user's own voice from the detection of "voice".

[0147] The hearing aid may include a self-voice detector for estimating whether (or with what probability) a particular input sound (e.g. voice, such as speech) originates from the voice of a user of the hearing system. The microphone system of the hearing aid may be adapted to be able to distinguish the user's own voice from the voice of another person and possibly from unvoiced sounds.

[0148] The plurality of detectors may include a motion detector, such as an accelerometer. The motion detector may be configured to detect movement of the user's facial muscles and / or bones, such as due to speech or chewing (eg, jaw movement), and provide a detector signal indicative of the movement.

[0149] The hearing aid may comprise a classification unit configured to classify the current situation based on an input signal from (at least part of) the detector and possibly other inputs. In this specification, a "current situation" may be defined by one or more of the following:

[0150] a) the physical environment (e.g. including the current electromagnetic environment, such as the presence of electromagnetic signals (including audio and / or control signals) intended or not intended to be received by the hearing aid, or other properties of the current environment other than acoustics);

[0151] b) Current acoustic conditions (input level, feedback, etc.);

[0152] c) the user’s current mode or state (motion, temperature, cognitive load, etc.);

[0153] d) The current mode or status of the hearing aid and / or another device communicating with the hearing aid (selected program, time elapsed since last user interaction, etc.).

[0154] The classification unit may be based on or may include a neural network, such as a trained neural network.

[0155] Hearing aids may include acoustic (and / or mechanical) feedback control (e.g., suppression) or an echo cancellation system. Adaptive feedback cancellation has the ability to track changes in the feedback path over time. It is usually based on a linear time-invariant filter to estimate the feedback path, but the filter weights are updated over time. The filter updates can be calculated using a stochastic gradient algorithm, including some form of the least mean square (LMS) or normalized LMS (NLMS) algorithm. They all have the property of minimizing the error signal in terms of mean square, with NLMS additionally normalizing the filter updates to the square of the Euclidean norm of a reference signal.

[0156] The hearing aid may also include other appropriate functions for the application in question, such as compression, noise reduction, etc.

[0157] A hearing aid may comprise a hearing instrument, such as a hearing instrument adapted to be located at the user's ear or fully or partially in the ear canal, such as an earphone, a headset, an ear protection device or a combination thereof. A hearing system may comprise a loudspeaker amplifier (comprising a plurality of input transducers and a plurality of output transducers, such as for use in audio conferencing situations), such as comprising a beamformer filter unit, such as providing a plurality of beamforming capabilities.

[0158] Hearing System

[0159] In another aspect, there is provided a hearing aid system comprising the device described above, described in detail in the "Detailed Description of the Invention" and defined in the claims, and a hearing system comprising an auxiliary device.

[0160] The hearing system may be adapted to establish a communication link between the hearing aid and the auxiliary device so that information (eg control and status signals, possibly audio signals) can be exchanged or forwarded from one device to the other.

[0161] The auxiliary device may include a remote control, a smart phone, or other portable or wearable electronic device such as a smart watch.

[0162] The auxiliary device may consist of or comprise a remote control for controlling the functions and operation of the hearing aid. The functions of the remote control are implemented in a smartphone, which may run an APP enabling control of the functions of the audio processing device via the smartphone (the hearing aid comprises a suitable wireless interface to the smartphone, e.g. based on Bluetooth or some other standardized or proprietary solution).

[0163] The auxiliary device may consist of or include an audio gateway device, which is suitable for receiving a plurality of audio signals (e.g. from an entertainment device such as a TV or a music player, from a telephone device such as a mobile phone or from a computer such as a PC) and for selecting and / or combining appropriate signals (or signal combinations) from the received audio signals for transmission to the hearing aid.

[0164] The auxiliary device may consist of or may comprise a further hearing aid.The hearing system may comprise two hearing aids adapted to implement a binaural hearing system, eg a binaural hearing aid system.

[0165] APP

[0166] On the other hand, the present invention also provides a non-transient application called APP. The APP includes executable instructions configured to run on an auxiliary device to implement a user interface for the hearing aid or hearing system described above, described in detail in the "Detailed Description of the Invention" and defined in the claims. The APP can be configured to run on a mobile phone such as a smart phone or another portable device that enables communication with the hearing aid or hearing system.

[0167] definition

[0168] In this specification, a hearing aid, for example, a hearing instrument, refers to a device suitable for improving, enhancing and / or protecting the hearing ability of a user by receiving an acoustic signal from the user's environment, generating a corresponding audio signal, possibly modifying the audio signal, and providing the possibly modified audio signal as an audible signal to at least one ear of the user. The audible signal can be provided, for example, in the form of an acoustic signal radiated into the user's outer ear, an acoustic signal transmitted to the user's inner ear as a mechanical vibration through the bone structure of the user's head and / or through parts of the middle ear, and an electrical signal transmitted directly or indirectly to the user's cochlear nerve.

[0169] The hearing aid may be configured to be worn in any known manner, such as as a unit worn behind the ear (with a tube directing the radiated acoustic signal into the ear canal or with an output transducer such as a loudspeaker arranged close to or in the ear canal), as a unit arranged wholly or partly in the auricle and / or ear canal, as a unit connected to a fixed structure implanted in the skull, such as a vibrator, or as a connectable or wholly or partly implanted unit, etc. The hearing aid may comprise a single unit or several units that communicate with each other (e.g. acoustically, electrically or optically). The loudspeaker may be arranged in a housing together with the other components of the hearing aid, or it may itself be an external unit (possibly in combination with a flexible guiding element such as a dome-shaped element).

[0170] The hearing aid may be adapted to the needs of a specific user, such as hearing loss. The configurable signal processing circuit of the hearing aid may be adapted to apply frequency- and level-dependent compression amplification of the input signal. The customized frequency- and level-dependent gain (amplification or compression) may be determined during the fitting process by the fitting system based on the user's hearing data, such as an audiogram, using the basic principles of fitting (e.g. adaptation to speech). The frequency- and level-dependent gain may, for example, be embodied in a processing parameter, uploaded to the hearing aid, for example, via an interface to a programming device (fitting system), and used by a processing algorithm executed by the configurable signal processing circuit of the hearing aid.

[0171] "Hearing system" refers to a system including one or two hearing aids. "Binaural hearing system" refers to a system including two hearing aids and adapted to provide audible signals to the two ears of a user in a coordinated manner. A hearing system or binaural hearing system may also include one or more "auxiliary devices" that communicate with the hearing aids and affect and / or benefit from the functions of the hearing aids. The aforementioned auxiliary devices may include at least one of the following: a remote controller, a remote microphone, an audio gateway device, an entertainment device such as a music player, a wireless communication device such as a mobile phone (e.g., a smart phone) or a tablet computer or another device, for example, including a graphical interface. Hearing aids, hearing systems or binaural hearing systems may be used, for example, to compensate for the loss of hearing ability of hearing-impaired persons, enhance or protect the hearing ability of normal hearing persons, and / or transmit electronic audio signals to people. Hearing aids or hearing systems may, for example, form part of or interact with a broadcasting system, an active ear protection system, a hands-free telephone system, a car audio system, an entertainment (e.g., television, music playback or karaoke) system, a teleconferencing system, a classroom amplification system, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0172] Various aspects of the present invention will be best understood from the detailed description below in conjunction with the accompanying drawings. For clarity, the drawings are schematic and simplified, and only the details necessary for understanding the present invention are given, while other details are omitted. Throughout the specification, the same reference numerals are used for the same or corresponding parts. The various features of each aspect may be combined with any or all features of the other aspects. These and other aspects, features and / or technical effects will be apparent from and illustrated in conjunction with the following figures, in which:

[0173] Figure 1A shows how streaming sound S arriving from a certain direction, for example 45° to the left relative to the user's viewing direction, may be presented to a user wearing a binaural hearing aid system (comprising left and right hearing instruments HI);

[0174] Figure 1B shows the hearing aid user facing Figure 1A The situation where the sound source in the video turns the head without using head tracking, causing the streaming sound to also be turned and will continue to appear to be coming from a 45° direction relative to the user's left;

[0175] Figure 1C shows a scenario using head tracking (and applying current binaural spatial cues) where the streamed sound can be fixed in space relative to its initial position as the user's head turns;

[0176] Figure 2A A TV use scenario is shown including a user (U) and another person (P), wherein the user (U) wearing a binaural hearing aid system receives streaming sound from a TV adapter (ED) connected to or integrated with the TV, wherein the streaming sound appears to arrive from in front of the user, while the user watches TV and receives airborne sound from the TV speakers (possibly amplified by the hearing aids);

[0177] Figure 2B Shown with Figure 2A , but another person (P) is speaking to the user (U) and the user turns his head towards that person, in which case the streaming sound (S) (if not spatially modified) will still appear to arrive from in front of the user and may therefore interfere with the user's understanding of what the person (P) is saying;

[0178] Figure 2C Shown with Figure 2B Same situation as in , but head tracking (and current application of binaural spatial cues) is used in a binaural hearing aid system to make it possible for the user (U) to perceive the streaming sound (S) as still arriving from the direction of the TV when the user turns his head to listen to another person (P);

[0179] Figure 3A It shows that Figure 2Aa situation in which a surround sound audio signal is streamed from a TV adapter to the user's hearing aids and appears to arrive from standard surround sound speaker positions, here a 5-channel audio signal with front left, front centre and front right (FL, FC and FR) speaker signals and rear left and rear right (SL and SR) speaker signals;

[0180] Figure 3B Shown with Figure 3A The same situation as in , but the user has turned his head away from the TV, where the binaural hearing aid system is not equipped with head tracking capabilities, so that the streamed surround signals will follow the user's head and will not be externally perceived by the user;

[0181] Figure 3C Shown with Figure 3B Same situation as in , but using head tracking in a binaural hearing aid system (and applying current binaural spatial cues) to keep the sound sources in the correct position in space for a better externalized surround sound experience;

[0182] Figure 4A A situation is shown in which a user (U) (looking straight ahead) with a hearing aid (HI) receives a first wireless audio signal (SA) from a partner microphone (PMA) attached to a first person (A) to the left of the user and a second wireless audio signal (SB) from a partner microphone (PMB) attached to a second person (B) to the right of the user, wherein the audio is presented to the user (U) as if arriving from the direction of the external partner microphones (PMA, PMB);

[0183] Figure 4B Shown with Figure 4A the same situation as in , but the user looks towards a second person (B) on the right, wherein the head tracking capability of the binaural hearing aid system (HI) makes it possible to detect the relative angle between the user's hearing aids and the remote partner microphones, so that when the user turns his head towards the second person (B), the streaming sound (SB) from the second person (B) will be perceived as arriving from the front direction and the streaming signal (SA) from the first person (A) will be moved further back;

[0184] Figure 5 A user (U) wearing a binaural hearing aid system (HI) is shown positioned near an external microphone array (MA) capable of beamforming in multiple directions to enhance individual speakers (A, B) present in a room or location;

[0185] Figure 6 It shows that Figure 5a situation including a user (U) wearing a binaural hearing aid system (HI) positioned near an external microphone array (MA) as in , wherein the position of the user relative to the positions of the first and second speakers (A, B) can be measured as θA and θB;

[0186] Fig. 7A A first embodiment of a binaural hearing system according to the present invention is shown;

[0187] Figure 7B A second embodiment of a binaural hearing system according to the present invention is shown;

[0188] Figure 7C schematically shows an embodiment of a detection unit for use in a binaural hearing system according to the invention;

[0189] Fig.7D A third embodiment of a binaural hearing system according to the present invention is shown;

[0190] Fig. 7E A fourth embodiment of a binaural hearing system according to the present invention is shown;

[0191] Figure 7F An embodiment of an input gain controller for a binaural hearing system according to the present invention is shown;

[0192] Figure 7G A fifth embodiment of a binaural hearing system according to the present invention is shown;

[0193] Figure 7H An exemplary configuration of a binaural hearing system according to the present invention is shown, wherein there is more than one target sound source;

[0194] Fig. 8A The definition of the yaw, pitch and roll axes of a moving object is schematically shown;

[0195] Figure 8B schematically showing the location of the target sound source relative to the user;

[0196] Fig. 9 An example of a hearing aid and an auxiliary device implementing a user interface for use in a binaural hearing system according to the present invention is shown;

[0197] Fig.10 shows an example of how the gains applied to the left and right channels from a streaming source may be configured to achieve a spatialization effect as a function of an angle (θ) in a binaural hearing system according to the present invention;

[0198] Fig.11 shows the delay (τ) (applied to the left and right channels from the streaming source) in a binaural hearing system according to the present invention. L(θ) solid line, τ R An example of how (θ) dashed line) can be configured to achieve a spatialization effect as a function of angle (θ);

[0199] Fig.12 An example is shown of how the gain applied to the streaming signal and the gains applied to the individual hearing aid output signals in a binaural hearing system according to the present invention may be configured to achieve an attention-based target steering effect as a function of an angle (θ).

[0200] By the detailed description given below, the further scope of application of the present invention will be apparent. However, it should be understood that while the detailed description and specific examples show the preferred embodiments of the present invention, they are only provided for illustrative purposes. For those skilled in the art, based on the following detailed description, other embodiments of the present invention will be apparent. DETAILED DESCRIPTION

[0201] The detailed description proposed below in conjunction with the accompanying drawings serves as a description of a variety of different configurations. The detailed description includes specific details for providing a thorough understanding of a number of different concepts. However, it is apparent to those skilled in the art that these concepts can be implemented without these specific details. Several aspects of the apparatus and method are described by a number of different blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as "elements"). Depending on the specific application, design limitations or other reasons, these elements can be implemented using electronic hardware, computer programs or any combination thereof.

[0202] The electronic hardware may include microelectromechanical systems (MEMS), (e.g., application specific) integrated circuits, microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gating logic, discrete hardware circuits, printed circuit boards (PCBs) (e.g., flexible PCBs), and other suitable hardware configured to perform a number of different functions described in this specification, such as sensors for sensing and / or recording physical properties of the environment, device, user, etc. Computer programs shall be broadly construed as instructions, instruction sets, codes, code segments, program codes, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, execution threads, programs, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0203] In the present invention, it is proposed to (perceptually) place the streaming audio in the correct (or appropriate) direction in space. To this end, the streaming audio signal can be applied with a head-related transfer function (HRTF). The HRTF (L / R, D, f) is a function of the head side (left and right, L / R), the direction in space (D), and the frequency (f) as dependent variables. In this way, the sound arriving from the right side of the user will arrive at the left ear later than the right ear, and the sound pressure level (SPL) at the left ear is lower than at the right ear, and the SPL difference will be greater at higher frequencies. As an alternative or in addition, panning (including a model including the head shadow) can be used.

[0204] Figure 1A It shows how streaming sound (see dashed arrow denoted “S”) arriving from a certain (fixed) direction, e.g. 45° relative to the left side of the hearing aid user (relative to the direction of the user's head, the direction of the user's head being determined, e.g., by the user's nose) can be presented to a user wearing a binaural hearing aid system (comprising left and right hearing instruments, black rectangles denoted HI) located on the outer ears of the user U.

[0205] Figure 1B It shows that Figure 1A In the case of Figure 1A The streaming sound is also rotated, so that the streaming sound will continue to appear to come from a direction 45° to the left of the user (i.e., from a different direction than the user's surrounding space (such as a room)). Figure 1A another location in the ).

[0206] Figure 1C It shows that Figure 1B , but using head tracking, where the streamed sound can be fixed in space even when the user's head turns (here, 45° to the left).

[0207] Figure 2A A TV usage scenario is shown including a user (U) and another person (P), wherein the user wears a binaural hearing aid system (eg Figure 1A , 1B , 1C, a user (U) including left and right hearing instruments HI) receives streaming sound (see the dashed arrow denoted "S") from a TV adapter (ED) connected to or integrated with a television set TV (and wirelessly transmitting TV sound), wherein the streaming sound appears to arrive from the front of the user, while the user watches TV and receives airborne sound from the TV speakers (in Figure 2A , 2B , denoted "A" in 2C) (possibly amplified by a hearing aid). EP3373603A1 relates to an exemplary processing of simultaneous reception of streaming and acoustic sounds from a TV at a hearing aid.

[0208] Figure 2B Shown with Figure 2A , but another person (P) is speaking to the user (U) (see sound "B" propagating in the direction of user U), and the user turns his head towards that person (P). However, without head tracking capability, the streaming sound (indicated by the dashed arrow "S") will still appear to arrive from in front of the user, and thus roughly coincide with the (acoustically propagated) sound (B) from the other person (P), which may interfere with the user's understanding of what that person (P) is saying.

[0209] Figure 2C Shown with Figure 2B The same situation as in , but head tracking is used in a binaural hearing aid system to make it possible for the user (U) to perceive that the streaming sound (S) is still arriving from the direction of the TV when the user turns his head to listen to the other person (P) speaking. It is also possible to attenuate the streaming signal (S) when the user (U) is not facing the TV to improve speech understanding of what the other person (P) is saying.

[0210] Figure 3A It shows that Figure 2A A situation in which a hearing aid user (U) is looking directly at a television set (TV) (but without another person (P)), wherein surround sound audio signals are streamed from a TV adapter (ED) connected to the television set and configured to stream sound from the TV to the user's hearing aids (HI). The surround sound is arranged to arrive from standard surround sound speaker positions, here a 5-channel audio signal with left front, center front and right front (FL, FC and FR) speaker signals (see the dashed arrows denoted "FL", "FC", "FR") and left rear surround and right rear surround (SL and SR) speaker signals (see the dashed arrows denoted "SL", "SR").

[0211] Figure 3B Shown with Figure 3A The same situation as in , but the user (U) has turned his head away from the TV, where the binaural hearing aid system (HI, HI) is not equipped with head tracking capabilities, so that the streamed surround signals will follow the user's head and will not be externally perceived by the user.

[0212] Figure 3C Shown with Figure 3B Same situation as in the previous example, but using head tracking in a binaural hearing aid system to keep the sound source in the correct position in space (e.g. Figure 3A for a better externalized surround sound experience.

[0213] Figure 4AThe diagram shows a situation in which a user (U) (looking straight ahead) with a hearing aid (HI) receives a first wireless audio signal (see the dotted arrow marked “SA”) from a partner microphone (PMA) of a first person (A) attached to the left of the user and a second wireless audio signal (see the dotted arrow marked “SB”) from a partner microphone (PMB) of a second person (B) attached to the right of the user, where the audio is presented to the user (U) as if it were arriving from the direction of the external partner microphones (PMA, PMB).

[0214] Figure 4B Shown with Figure 4A The same situation as in , but the user looks at a second person (B) to the right, where the head tracking capability of the binaural hearing aid system (HI) makes it possible to detect the relative angle between the user's hearing aid and the remote partner microphone, so that when the user turns his head toward the second person (B), the streaming sound (SB) from the second person (B) will be perceived as arriving from the front direction of the user (nose direction), and the streaming signal (SA) from the first person (A) will be further moved backward. In addition, the streaming sound (SB) from the second person (B) can be further amplified to enhance the speech understanding of the speaker (B), while the streaming signal (SA) from the first person (A) can be attenuated (but not turned off to keep the user (U) aware of the first person (A)).

[0215] Figure 5 A user U wearing a binaural hearing aid system (HI, HI) is shown positioned near an external microphone array MA capable of beamforming in multiple directions to enhance the various speakers (A, B) present in a room or location. The beamformer can collect speech from a first person A with a first beamformer diagram BA and from a second person B with a second beamformer diagram BB. The outputs from the first and second beamformer diagrams (BA, BB) are wirelessly streamed to the binaural hearing aid system (HI, HI) worn by the user U and presented to the user as if arriving from different directions SA and SB. The system is also capable of detecting the orientation of the user's head relative to the external microphone array MA (e.g., using an accelerometer and / or magnetometer and / or gyroscope in the hearing aid) and using that orientation to select which streamed beam pattern to enhance and place them correctly in space. Knowing the orientation of the head relative to the external microphone array, the streamed sound from the MA to the user is presented in a direction close to the true direction of the actual sound source. Additionally, we can extract the user's intention and steer the signal from the MA's external beamformer (thus enhancing the beam in the direction the user is looking).

[0216] An example of detecting the position of the user relative to the external microphone array MA could be using a self-voice detector in the hearing aid as input to the external microphone array to detect the angle relative to the user by correlating with the microphone array beam direction.

[0217] Alternatively or additionally, the external microphone array MA may be configured to emit ultrasonic signals that are picked up by hearing aid microphones, wherein the hearing aid (or hearing aid system) is configured to determine the position of the user's head relative to the external microphone array.

[0218] Alternatively or additionally, the external microphone array MA can be configured to use the Bluetooth 5.1 parameter "angle of arrival" (AOA). Using a Bluetooth connection between the external microphone array (transmitter) and the hearing aids (receivers) of a binaural hearing aid system, a constant tone extension can be added to the communication between the transmitter and the receiver. When receiving a constant phase, the phase change can be measured when switching between different antennas. Knowing the antenna distance, the angle of arrival of the signal from it can be calculated. The formula for estimating the angle of arrival based on the phase difference is given by:

[0219]

[0220] Among them, θ is the arrival angle, ψ is the phase difference, λ is the wavelength, and d is the antenna distance.

[0221] Furthermore, the distance between the transmitter and the receiver, and thus the distance between the hearing aid user and the connected device, can be determined by the time of flight (ToF) (the time difference between signal transmission and reception) determined by the propagation speed of the signal. This can be used to determine the precise position of the user relative to the streaming device (e.g., distance D), which in turn can be used as input to the spatial processing of the streaming sound.

[0222] In another aspect of the invention, some use cases of streaming are enhanced by measuring the relative angle of the hearing aid user with respect to the streaming source. This is useful for the table microphone (MA) and partner microphone (PM) use cases (respectively Figure 5 , 6 and Figure 4A , 4B ) is particularly useful where the user will not necessarily be facing in the direction of the streaming source. In this way, the system can determine which direction the user is in relative to the streaming source and then correctly place the positional audio, such as Figure 6 Additionally, if the streaming source moves or rotates, it can adjust and compensate.

[0223] The system for measuring the relative angle between the streaming source and the user may include, for example, one or more of the following:

[0224] -RF Time of Flight (ToF) technology, which involves using an antenna array on a remote microphone to measure the angle of arrival and departure. RF technology can include

[0225] --Bluetooth

[0226] --WiFi

[0227] --Other 2.4GHz transmission technologies

[0228] Ultra-wideband

[0229] - Sound (possibly ultrasound) transmitted by the hearing aid and picked up by a beamforming microphone of an external microphone array (e.g. a table microphone);

[0230] - User voice recognition, where the user's voice is known and the beamforming microphones locate the direction of the user by identifying where their voice is coming from.

[0231] Figure 6 It shows that Figure 5 A situation such as that in which the user (U) wearing a binaural hearing aid system (HI, HI) is located near an external microphone array (MA), where the position of the user relative to the positions of the first and second speakers (A, B) can be measured (using the external microphone array as a center point, a starting point) as angles θA and θB. The angle of the user's head will also be measured (e.g. with a head tracker) and can be defined relative to the direction of the streaming unit (MA) as θU. These data points can be used to accurately place the speech in space for the user, even if the absolute rotational position of the external microphone array MA is not controlled.

[0232] Figure 5 and Figure 6 The tabletop microphone (MA) use case described in can be implemented, for example, by including a first-order Ambisonics microphone system in the tabletop microphone. A first-order Ambisonics consists of four signals corresponding to one omnidirectional and three figure-of-eight polar plots aligned with the Cartesian axes. These signals are available from a matched pair of dual-diaphragm microphones, where each diaphragm output is individually accessible. Processing of the signals can be performed in the tabletop microphone unit or locally in the hearing aid.

[0233] The system can be configured to support surround codecs on the market (Dolby, DTS, B-format First Order Ambisonics, Opus). From multi-channel to two-channel surround sound.

[0234] In the following Fig. 7A , 7B , 7C, 7D, 7E, 7F, 7G and 7H, describe a number of different embodiments of a binaural hearing system (eg, a binaural hearing aid system) according to the present invention.

[0235] Fig. 7AA first embodiment of a binaural hearing system (e.g. a binaural hearing aid system) according to the invention is shown. The binaural hearing aid system comprises first and second ear pieces (EP1, EP2) adapted to be located at or in the left and right ears of a user, respectively. The first and second ear pieces (EP1, EP2) may form part of or may consist of respective first and second hearing aids. Each of the first and second ear pieces comprises an input transducer (respectively IT1, IT2) for converting respective first and second acoustically propagated signals (x) incident on the first and second ear pieces to a first and second acoustically propagated signal (x) incident on the first and second ear pieces. in1 ,x in2 ) are converted into first and second electric sound input signals (in 1 ,in 2 Each received acoustic propagation signal (x in1 ,x in2 ) may include a target signal from a target sound source S and other signals from other sound sources ((NL, ND)) in the user's surroundings, e.g., representing local or scattered noise. Each of the first and second ear pieces (EP1, EP2) further includes an output transducer (respectively OT1, OT2) configured to receive and transmit the corresponding first and second binaural processed electrical output signals (out 1 ,out 2 ) is converted into a stimulus (s) that can be perceived by the user as sound out1 ,s out2 ).

[0236] The binaural hearing (hearing aid) system further comprises at least one wireless receiver (Rx) for receiving wirelessly transmitted signals from the audio transmitter (AT) and retrieving therefrom at least one stream of transmitted audio input signals (s) comprising a target signal from a target sound source (S) and optionally other signals (or signal components) from other sound sources (NL, ND) in the user's surroundings. aux The audio transmitter (AT) and the binaural hearing aid system (here the audio receiver (Rx)) are connected by Fig. 7A , 7B The audio communication link indicated by the thick dashed arrow from the transmitter (AT) to the receiver (Rx) in 7D, 7E, 7G, and 7H may be based on Bluetooth or similar (relatively short-range) communication technology used in conjunction with a portable (relatively low-power) device, for example.

[0237] The binaural hearing (hearing aid) system further comprises a binaural audio signal processor (AUD-PRO) configured to receive at least one stream transmission audio signal (s aux ) and the first and second electric sound input signals (in 1 ,in 2) (or a signal derived therefrom) and provides corresponding first and second binaural processed electrical output signals (out 1 ,out 2 The binaural audio signal processor (BIN-PRO) is further configured to apply binaural spatial processing to at least one stream transmission audio input signal (s aux ) (or signals derived therefrom) and providing corresponding first and second binaural processed electrical output signals (out 1 ,out 2 ): A) At least one stream transmits the audio input signal (s aux ) and the first and second electric sound input signals (in 1 ,in 2 ); and B) at least one stream transmitting an audio input signal (s aux ) and an estimate of the location (D,θ) of the target sound source (S) relative to the user's head (U), which provides a spatial sense that the target sound source originates from outside the user's head (see, e.g. Figure 8B ).

[0238] Each of the input transducers (IT1, IT2) may include a noise reduction algorithm configured to reduce the resulting electrical sound input signal (in 1 ,in 2 ) in the stream. Similarly, the wireless receiver (Rx) or (Rx1, Rx2) may include a configuration to reduce the resulting stream transmission audio input signal (s aux ;s aux1 ,s aux2 ) is a noise reduction algorithm for noise in .

[0239] Each of the input transducers (IT1, IT2) may, for example, include a plurality of microphones and a device configured to convert the resulting electrical sound input signal (in 1 ,in 2 ) provides a beamformer filter for beamforming a signal.

[0240] The binaural audio signal processor (AUD-PRO) may form part of one or both of the first and second earpieces (EP1, EP2) or may (e.g. primarily, e.g. in addition to) a selector or mixer of the two audio signals (e.g. see Figure 7B The processing unit SEL-MIX1, SEL-MIX2) in the embodiment of the present invention is located in a separate processing device (in this case, for transmitting and receiving the binaurally processed electrical output signal ( Fig. 7A (out 1 ,out 2 )or Figure 7B (s aux,b1 ,saux,b2 ))'s appropriate transmitter and receiver circuits may be included in separate processing devices and first and second ear pieces, respectively).

[0241] Figure 7B Another embodiment of a binaural hearing system (eg a binaural hearing aid system) according to the invention is shown. Figure 7B Embodiments of binaural hearing aid systems and Fig. 7A The embodiment is similar, but Figure 7B An embodiment of a binaural audio signal processor (AUD-PRO) is shown in more detail.

[0242] Figure 7B The binaural hearing aid system embodiment of the present invention is a binaural audio signal processor (AUD-PRO) comprising one or more detectors (DET), for example, consisting of or including position detectors, thereby providing corresponding one or more detector control signals (det). The binaural audio signal processor (AUD-PRO) comprises a binaural controller (B-CTR) configured to transmit audio signals according to one or more detectors (DET) (for example, including position detectors), for example, according to one or more detector control signals (det) (and at least one stream transmission audio input signal (s aux )) provides corresponding first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2 ;out 1 ,out 2 ). One or more detector control signals (det) are indicated by a thick arrow labeled "det" to indicate the selection of the representation of more than one detector control signal (e.g., in Figure 7C In the detector unit (DET) embodiment shown in FIG. 1 , a) direction of arrival, b) range, c) user's line of sight, and d) wireless received signals DOA, DE, LDCS, RCS) from corresponding exemplary detectors

[0243] The one or more detectors (DET) may include one or more of a wireless reception detector (WRD), a position detector (PD), a voice activity detector (estimator) (VAD) (e.g., a general voice activity detector (such as a speech detector) and / or an ego voice detector (OVD)), a motion detector (MD), a brain wave detector (BWD), etc.

[0244] An example of a detection unit (DET) comprising one or more detectors is Figure 7C The detection unit (DET) includes a position detector (PD) providing a plurality of position detector control signals and a wireless receiving detector (WRD) providing a receiving control signal (RCS). The position detector (PD) (see Figure 7CThe dotted box in the figure includes a direction of arrival detector (DOAD), a distance detector (DD) and a viewing direction detector (LDD), thereby providing corresponding detector control signals (DOA, DE and LDCS), as described below. The position detector may also include a level detector for estimating the current level of the input signal or a motion detector for tracking the user's motion.

[0245] The position detector (PD) is configured to estimate the position (TPOS) of the target sound source relative to the user's head (e.g., relative to the earpiece (or hearing aid) of a binaural hearing aid system). The estimate of the position of the target sound source relative to the user's head may be determined as a combination of: a) a1) the angle (θ) between a line from the position of the target sound source (S) to the user's head (U, e.g., its midpoint) and a2) a reference direction, e.g., a line parallel to the user's normal forward vision direction (both lines are in a horizontal plane); and / or b) the distance (D) between the target sound source (S) and the user's head (U) (e.g., its midpoint, or to each of the first and second input transducers (IT1, IT2, respectively)). In other words, when the origin of the coordinate system is in (the middle of) the user's head (e.g., see Figure 8B , such as the thick dot indicating the position of the z-axis in the xy plane), the position (x s ,y s ) can be expressed in polar coordinates as (D,θ).

[0246] The estimated position of the target sound source (S) relative to the user's head (x s ,y s ; D, θ) can be determined in whole or in part as (approximately as) an angle (θ) relative to a reference direction, such as the normal forward viewing direction of the user, for example, see Figure 8B . "The user's normal forward direction" (see Figure 8B The "NLD" in , which is equal to the "current" viewing direction (LDIR)) can be defined as the direction in which the user is looking when the user's head is in a normal forward-looking (looking forward) position relative to the user's torso, that is, perpendicular to a line through the user's shoulders (see, for example, Fig. 8A , 8B The horizontal direction of the axis "y" in Fig. 8A , 8B axis "x" in the image).

[0247] The position detector (PD) may include a view direction detector (LDD) (e.g., a head tracker) configured to provide a direction indicating the position (D,θ) of the user relative to the target sound source (S) (in practice, Figure 8BThe viewing direction detector (LDD) may include, for example, one or more of a gyroscope, an accelerometer and a magnetometer, such as a gyroscope and an accelerometer. The viewing direction detector (LDD) may include a head tracker or may be composed of a head tracker, which is configured to track the rotation angle of the user's head compared to the user's normal forward viewing direction (NLD) so as to estimate or contribute to the estimation of the position of the target sound source relative to the user's head. The rotation angle of the user's head (for example relative to the normal forward viewing direction (NLD)) may be provided by a head tracker, for example based on a 1D, 2D or 3D gyroscope and / or a 1D, 2D or 3D accelerometer and / or a 1D, 2D or 3D magnetometer (such a device is sometimes called an "inertial measurement unit" (IMU)), for example, see EP3477964A1.

[0248] The position detector (PD), such as the viewing direction detector (LDD), may include an eye tracker, thereby enabling estimation of the current eye gaze angle of the user relative to the current position of the user's head and thereby fine-tuning the estimate of the position of the target sound source relative to the user's head. The current eye gaze angle of the user relative to the current position of the user's head may be represented by an angle relative to the current rotation angle of the user's head. The eye gaze angle may thus be used as a correction (fine-tuning) of the position of the target sound source relative to the user's head, for example estimated as the sum of the rotation angle of the user's head and the eye gaze angle (calculated with signs such that eye gaze in the same direction as the head rotation has the same sign, and eye gaze in the opposite direction of the head rotation has the opposite sign, θ). pos =θ head +θ eye ). The eye tracker may be based on one or more electrodes that collect electrical potentials from the eyeball in contact with the user's skin. The electrodes may be located on the surface of the housing of the first and second hearing aids (e.g., earpieces) and may be configured to provide appropriate electro-oculogram (EOG) signals, see, for example, EP3185590A1.

[0249] The position detector (PD) may include a direction of arrival detector (DOAD) configured to detect a direction of arrival of a streaming audio input signal (s aux ) and the first and second electric sound input signals (in 1 ,in 2 ) estimates the direction of arrival (DOA) of the sound from the target sound source (S). The direction of arrival of the sound from the target sound source can be estimated as disclosed in EP3285500A1, for example.

[0250] The estimate of the position of the target sound source (S) relative to the user's head (U) may be determined in whole or in part as (approximately as) the distance (D) between the target sound source and the user's head. The position detector (PD) may comprise a distance detector (estimator) (DD) which provides a distance control signal (DE) indicating a current estimate of the distance (D) between the position of the target sound source and the user's head. The distance between the transmitting device and the receiving device may be determined, for example, by detecting the distance of the receiving device (e.g. Fig. 7A , 7B , Rx in 7D or Fig. 7E , 7G The received signal strength (e.g., "Received Signal Strength Indicator" (RSSI) or "Received Channel Power Indicator" (RCPI)) from the transmitting device (e.g., Rx1, Rx2) Fig. 7A , 7B , 7D, 7E, 7G, 7H) received transmission signal strength estimation. Similarly, the Bluetooth parameter "High Accuracy Distance Measurement" (HADM) can be used. The distance detector (DD) can thus make its estimate (DE) of the distance (D) based on the received wireless signal (at Figure 7C In Chinese, it is denoted as s' aux ) (depending on the protocol of the wireless link). The assumption that the position of the audio transmitter (AT) represents the position of the (acoustically) target audio source (S) works well, at least in certain use cases, e.g. when the audio transmitter is (part of) a microphone unit worn by or positioned close to the target person or a TV sound transmitter (or other audio transmitter associated with (e.g. integrated with) the target sound source).

[0251] Detector control signal ( Figure 7B , 7D , "det" in 7E and Figure 7C The signals DOA, DE, LDCS, RCS in the Binaural Controller (B-CTR) are fed to the Binaural Controller (B-CTR), possibly further processed (e.g. logically combined) and used in the streaming audio input signal (s aux ) provide binaural cues.

[0252] An estimate of the position of the target sound source (S) relative to the user's head (U) may be provided as a user input. The binaural hearing aid system may include a user interface (e.g. implemented in an auxiliary device (e.g. a separate processing device) that communicates with the binaural hearing aid system or forms part of the binaural hearing aid system, see e.g. Fig. 9The user interface (UI) may be configured to enable the user to indicate the current position of the target sound source (S) relative to the user's head, for example via a user-operable activation element such as one or more buttons such as a touch screen and / or a keyboard. The user interface (UI) may be configured to enable indicating the sound source (S) relative to a normal forward-looking direction (e.g., the direction of the nose, see Fig. 9 The user interface may be configured to enable the user to select the current angle or position of the target sound source relative to the user based on a plurality of predetermined positions (angles and / or distances), for example via a touch screen interface showing the user and a plurality of selectable angles or positions (see, for example, Fig. 9 ).

[0253] The wireless receive detector (WRD) may be configured to provide a receive control signal (RCS) indicating whether at least one stream of transmitted audio input signals (s) including a target signal (and possibly a second other signal from other sound sources in the user's surroundings) is currently received. aux ). The wireless receive detector may form part of a wireless receiver (Rx; Rx1, Rx2) which, depending on the wireless communication protocol used, may provide a "no signal" indication if the receiver (Rx) does not receive a valid (e.g. Bluetooth) signal. The receive control signal (RCS) may be based on the received wireless signal (in Figure 7C In Chinese, it is denoted as s' aux ), for example, in at least one stream transmitting an audio input signal (s aux ) before demodulation and extraction. The receive control signal (RCS) can be used as an electrical output signal (s) to provide binaural processing aux,b1 ,s aux,b2 ;out 1 ,out 2 )'s enable ("valid signal received") parameter or disable ("valid signal not received") parameter.

[0254] Figure 7B The binaural audio signal processor (AUD-PRO) of the embodiment further comprises corresponding first and second selector / mixer units (SEL-MIX1, SEL-MIX2) configured to select two inputs (respectively (in 1 or aux,b1 ) and (in 2 or aux,b2 )) or a (e.g. weighted) mix of two inputs (out 1 =w 11 *in 1 +w 12 *s aux,b1 and out 2 =w 21 *in 2+w 22 *s aux,b2 ) are provided as outputs (respectively out 1 ,out 2 In other words, in the "select" operating mode, the outputs (out 1 ,out 2 ) may be equal to the corresponding first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2 ) or equal to the corresponding first and second electric sound input signals (x 1 ,x 2 In the "mixing" operating mode, the outputs (out 1 ,out 2 ) is equal to the (first, second) electric sound input signal (in 1 ,in 2 ) or its processed version and the (first, second) binaural processed electrical output signal (s aux,b1 ,s aux,b2 ), which is based on at least one stream transmission audio input signal (s aux ) is modified to provide a spatial sense of the origin (outside the user's head) of the target sound source (S). The first and second selector / mixer units (SEL-MIX1, SEL-MIX2) can be controlled by corresponding select-mix control signals (smc 1 ,smc 2 ) is controlled, for example, by a receive control signal (RCS) from a wireless receive detector (WRD). The start value of RCS (indicating "valid signal received") can start the "mixing" operating mode of the selector / mixer unit (or at the output (out) of the corresponding first and second selector / mixer units (SEL-MIX1, SEL-MIX2) 1 ,out 2 ) is equal to the corresponding first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2 ) in "select mode". The inhibit value of RCS ("no valid signal received") enables the "select" operating mode of the selector / mixer unit, in which the output (out 1 ,out 2 ) are set equal to respective first and second electrical sound input signals (x ) corresponding to independent (monaural) operation of the first and second earpieces (EP1, EP2), such as hearing aids. 1 ,x 2 ).

[0255] Tracking the position of the target sound source (S) relative to the position of the user's head (U) can be used to control the amplification of the standard amplified sound of the hearing aid while streaming. For example, when the user looks towards the TV (including the TV audio sound transmitter), the ambient sound amplification (based on the microphone input) can be automatically reduced, and when the user looks away from the TV, the ambient sound amplification can be automatically increased.

[0256] The binaural audio signal processor (AUD-PRO) is configured to control the gain applied to at least one stream of the transmitted audio signal based on an estimate of the position of the target sound source (S) relative to the user's head (U). Thus, first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2 ) or (out 1 ,out 2 ) thereby providing a spatial sense that the origin of the target sound source is outside the user's head. For example, when the user looks in the direction of the target sound source (S) of the streaming sound, the streaming sound amplification may increase (and vice versa, decrease if the user's viewing direction deviates from the direction of the target sound source).

[0257] The first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2 ) can be adjusted based on the current viewing direction (LDIR) and the target sound source (S, see Figure 7H The angle θ sq or Figure 8B The difference between the direction (D) of the angle θ in the first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2 ) can be provided according to a viewing direction control signal (LDCS=θ), which indicates the current viewing direction (LDIR) of the user (U) relative to the direction (D) of the target sound source position. The level modification can depend on a signal indicating whether at least one stream of transmitted audio input signal (s aux ) receiving control signal (RCS). If the difference between the current viewing direction and the direction of the target sound source position is small, the level can be increased; if the difference between the current viewing direction and the direction of the target sound source position is large, the level can be reduced. The level can be corrected within a range, such as between a maximum and a minimum level correction, such as limited to 6dB.

[0258] The first and second binaural processed electrical output signals (s aux,b1 ,s aux,b2) can be modified according to the current distance (D) between the target sound source (S) and the user's head (U). The level can be increased or decreased if the distance (D) between the target sound source (S) and the user's head (U) is smaller or larger. The level of the first and second binaural processed electrical output signals can be modified according to the distance control signal (DE) indicating the current distance (D) between the target sound source (S) and the user's head (U). The modification of the level can also depend on whether at least one stream of transmitted audio input signal (s) is currently being received. aux The level modification may also depend on a viewing direction control signal (LDCS=θ) indicating that the current viewing direction (LDIR) is equal to the direction (D) of the target sound source (S) position or is within a certain distance thereof (e.g., angle Δθ, e.g., + / -5°).

[0259] The level modification may also or alternatively be dependent on the indication of the first and second electrical sound input signals (x 1 ,x 2 ) contains a voice control signal in which there is voice (such as user voice, or any voice).

[0260] Modification of the level may also or alternatively be dependent on a motion control signal from a motion detector indicating whether the user is moving.

[0261] The binaural hearing aid system may comprise a separate processing device including a binaural audio signal processor (AUD-PRO) and / or at least one wireless receiver (Rx).

[0262] Each of the first and second ear pieces (EP1, EP2) may include a wireless transmitter adapted to exchange data, such as audio or other data, with a separate processing device (and / or directly with each other).

[0263] The binaural audio signal processor (AUD-PRO) may form part of one or both of the first and second earpieces (EP1, EP2) or may (e.g. primarily, e.g. in addition to a selector or mixer of two audio signals located in the respective earpiece, e.g. see Figure 7B The units SEL-MIX1, SEL-MIX2 in the embodiment of the present invention are located in a separate processing device (in this case, for transmitting and receiving binaurally processed electrical output signals ( Fig. 7A (out 1 ,out 2 )or Figure 7B (s aux,b1 ,s aux,b2 ))'s appropriate transmitter and receiver circuits may be included in a separate processing device and in the first and second ear pieces, respectively).

[0264] Fig.7D A third embodiment of a binaural hearing system (eg a binaural hearing aid system) according to the invention is shown. Fig.7D Embodiments of binaural hearing aid systems and Figure 7B The embodiment is similar, but Fig.7D The embodiment further comprises a corresponding monaural audio signal processor (M-PRO1, M-PRO2). Each of the first and second monaural audio signal processors is configured to apply one or more processing algorithms to the signal (sm) provided by the corresponding first and second selector / mixer units (SEL-MIX1, SEL-MIX2). 1 ,sm 2 ), for example to compensate for a hearing loss (at the respective first and second ears) of a user. In other words, the first and second monaural audio signal processors (M-PRO1, M-PRO2) are configured to apply one or more processing algorithms to A) the first and second electrical sound input signals (x 1 ,x 2 ) (or a signal derived therefrom), or B) streaming the audio input signal (s aux ) is a binaural processed version (s aux,b1 ,s aux,b2 ), or C) a mixture of the two (sm 1 ,sm 2 ) (in "Mixed Mode").

[0265] like Fig.7D In the embodiment shown in FIG. 1 , the first and second monaural audio signal processors (M-PRO1, M-PRO2) may form part of a binaural audio signal processor (AUD-PRO). Fig.7D In the embodiment of the present invention, the first and second monaural audio signal processors (M-PRO1, M-PRO2) are located after (downstream of) the first and second selector / mixer units (SEL-MIX1, SEL-MIX2), respectively. However, they may be located elsewhere in the forward path, for example before the respective selector / mixer units (in which case any hearing loss compensation should be applied to the streaming audio input signal (s in the binaural controller (B-CTR)). aux )). If the monaural audio signal processor is located before the selector / mixer unit, the binaural audio signal processor may be configured to provide binaural gains suitable for modifying the monaural gains provided by the first and second monaural processors for the first and second electrical sound input signals and / or the streaming audio input signals or signals derived therefrom (e.g. a mix). The binaural gains may, for example, consist of or include gains that provide a spatial sense of the origin of the target sound source in the electrical output signals of the first and second binaural processes.

[0266] The first and second monaural audio signal processors (M-PRO1, M-PRO2) may be configured to independently estimate the direction of arrival (DOA) of the sound from the target sound source (S). In other words, DOA1 is estimated in M-PRO1 (e.g., in EP1) based on s aux and in 1 Determine that DOA2 is in M-PRO2 (e.g. in EP2) according to s aux and in 2 The arrival direction of the sound from the target sound source may be equal to the angle of the target sound source direction relative to the normal forward viewing direction of the user, for example, see Fig. 8A , 8B A logical combination of the corresponding "local" DOAs may be determined and used to estimate appropriate spatial cues (eg, head-related transfer functions) to be applied to the signals presented to the user at the user's left and right ears.

[0267] The target sound source (S) may be, for example, the sound transmitted from a television set (TV) via a TV sound transmitter (ED) placed together with the TV set to a binaural hearing aid system (see, for example, Figures 2A-2C and Figures 3A-3C ) and / or sound transmitted from one or more persons via microphone units (PMA, PMB) at the persons (A, B) concerned to a binaural hearing aid system (see, for example Figure 4A , 4B ) or sound from a microphone unit (including a microphone array and a beamformer) that collects sound from several sound sources around the microphone unit and transmits the resulting sound signal to a binaural hearing aid system (see, for example, Figure 5 and Figure 7G , 7H ).

[0268] Fig. 7E A fourth embodiment of a binaural hearing system (e.g. a binaural hearing aid system) according to the present invention is shown. The binaural hearing aid system comprises first and second hearing aids (HI) adapted to be located at or in the first and second ears of a user, respectively. l ,HI r Each of the first and second hearing aids comprises an input transducer (IT1; IT2) for converting an acoustically propagated signal (x) incident on the input transducer in1 ;x in2 ) is converted into an electric sound input signal (in) comprising a target signal from at least one target sound source (S) and other signals from possible other sound sources (NL, ND) in the user's surrounding environment 1 ;in 2Each of the first and second hearing aids further comprises a wireless receiver (Rx1; Rx2) for receiving a wirelessly transmitted signal from the audio transmitter (AT) and retrieving therefrom a streaming audio input signal (s) comprising the target signal and optionally other signals from other sound sources in the surroundings of the target sound source (S). aux1 ;s aux2 Each of the first and second hearing aids further comprises an input gain controller (IGC1; IGC2) for controlling the electric sound input signal (in 1 ;in 2 ) and streaming audio input signal(s) aux1 ;s aux2 ) and provides the weighted sum of these input signals (out 1 ,out 2 Each of the first and second hearing aids further comprises an output transformer (OT1; OT2) configured to convert the weighted sum of the input signals (out 1 ,out 2 ) or a further processed version thereof into a stimulus that can be perceived by the user as sound.

[0269] The binaural hearing aid system further comprises a position detector (DET) configured to provide an estimate of a current position of at least one target sound source (S) relative to the user's head and to provide a position detector control signal (det) indicative of the estimate. The first and second hearing aids (HI l ,HI r ) is configured to provide an electric sound input signal (in) according to a position detector control signal (det) at least one (eg each) of the input gain controllers (IGC1; IGC2) 1 ;in 2 ) and streaming audio input signal(s) aux1 ;s aux2 ) between the two.

[0270] First and second hearing aids (HI l ,HI r ) may comprise first and second ear pieces (e.g. Fig. 7A , 7B , EP1, EP2 in 7D). The earpiece may be adapted to be located in the ear of the user, such as at least partially in the ear canal of the user, such as partially outside the ear canal (such as partially in the auricle) and partially in the ear canal.

[0271] Figure 7FAn embodiment of an input gain controller (IGCq,q=1,2) for a binaural hearing system according to the present invention is shown. The first and second hearing aids (HI l ,HI r Each of the input gain controllers (IGC1; IGC2) of the invention comprises a gain estimator for controlling the electric sound input signal (in) according to the detector control signal (det) 1 ;in 2 ) and streaming audio input signal(s) aux1 ;s aux2 ) between the relative weights (G m,q ,G aux,q ) and provides a weighted sum of these input signals (out 1 ,out 2 Each of the input gain controllers (IGC1; IGC2) further comprises a first and a second combining unit (here a multiplication unit "X") for combining the relative weights (G m,q ,G aux,q ,q=1,2) is applied to the corresponding input signal (in q ;s aux,q ,q=1,2) to provide the corresponding weighted signal (G m,q ·in q and G aux,q ·s aux,q ,q=1,2). Each of the input gain controllers (IGC1; IGC2) further comprises a combining unit (here a summing unit “+”) for providing a weighted sum of the input signals (out q ,q=1,2). In other words, the first and second input gain controllers (IGC1; IGC2) provide a weighted sum of the input signals as output, where the weights (G m,q ,G aux,q ) is determined based on a detector control signal (det), for example a position detector control signal, that is,

[0272] out 1 =G m,1 ·in 1 +G aux,1 ·s aux,1

[0273] out 2 =G m,2 ·in 2 +G aux,2 ·s aux,2

[0274] The weight may be determined based on an angle between the user's current viewing direction and a reference direction and / or an estimated distance between the user and the target sound source.

[0275] Figure 7G A fifth embodiment of a binaural hearing system (eg a binaural hearing aid system) according to the invention is shown. Figure 7G Embodiments of binaural hearing aid systems and Fig. 7E The embodiment is similar, but Figure 7G The binaural hearing aid system embodiment of the present invention comprises a "backward link" from the binaural hearing aid system to the audio transmitter (AT). The binaural hearing aid system comprises a wireless transmitter for transmitting data to the audio transmitter (AT). The binaural hearing aid system is configured to transmit a detector control signal (det3), such as a position detector control signal, to the audio transmitter. The audio transmitter may comprise a transmission controller (e.g., see Figure 7H PRI in the figure) is configured to determine and apply microphone gains to an electrical input signal representing sound (e.g. from a microphone or microphone array, e.g. a beamforming signal) based on a position detector control signal before the electrical input signal representing sound is transmitted to the binaural hearing aid system. Thus, the audio transmitter may be configured to a) provide several target sound sources (e.g. Figure 7G , for example by a microphone array such as a tabletop microphone unit (see e.g. Figure 7H ) of beams in different directions ( Figure 7G Beam 1, Beam 2 in the binaural hearing aid system) providing, and / or b) applying directional cues to the electrical input signal before the electrical input signal is transmitted to the first and second hearing aids of the binaural hearing aid system.

[0276] First and second hearing aids (HI l ,HI r ) of the corresponding input converter (IT1, IT2) to collect the electric sound input signal (in 1 ;in 2 ) and streaming audio input signal(s) aux1 ;s aux2 ) can be prioritized by the first and second hearing aids (HI l ,HI r ) are provided according to the detector control signal (det; det1, det2), for example, respectively, the input signal (in 1 ,s aux1 ) and (in 2 ,s aux2 )'s corresponding weighted sum (out 1 ,out 2 ).

[0277] Figure 7H An exemplary configuration of a binaural hearing system according to the present invention is shown, wherein there is more than one target sound source (S1, S2). Figure 7HShows the use of Figure 7G The case of a binaural hearing system is shown in , but the geometric relationship between the user's head and the first and second target sound sources (S1, S2) is described therein. Figure 8B The geometric "terms" (based on polar coordinates, with the center of the coordinate system in the user's head) are Figure 7H The audio transmitter (AT) comprises a microphone unit, for example a desktop microphone (or a loudspeaker) comprising a microphone array (MA) and a beamformer filter configured to focus its sensitivity (beam) in a plurality of (fixed or adaptively determined) different directions around the microphone unit (AT). Thus, a plurality of sound sources can be collected individually and transmitted to the binaural hearing aid system, or the signals can be transmitted individually or as a stream, for example providing a combination of individual signals representing different sound sources. The combination can be, for example, a weighted sum of the individual signals of two sound sources, as indicated above (cf. Figure 7F , 7G ).

[0278] exist Figure 7H In the context of , the estimate of the current position of at least one target sound source relative to the user's head includes the user's current viewing direction (LDIR) and the direction from the user's head to the at least one target sound source (S1, S2) (see Figure 7H The angle (θ) between the point line from the user's head to the corresponding sound source (S1, S2) S1 ,θ S2 , see θ Sq ,q=1,2). The viewing direction and the target sound source direction can be expressed as angles relative to a reference direction, such as the user’s normal viewing direction (NLD). In this framework, the user’s current viewing direction (in Figure 7H (-Δθ sc1 ), the direction of the target sound source S1 can also be expressed by (-Δθ sc1 ), the direction of the target sound source S2 can be expressed by (Δθ sc2 ). The difference between the directions from the user's head to the first and second target sound sources (S1, S2) can be expressed as Δθ S1-S2 =Δθ sc2 –(-Δθ sc1 )=Δθ sc2 +Δθ sc1 .exist Figure 7H In the context of (assuming it is at time t1), the estimated angles of the positions of the target sound sources S1 and S2 (at time t1) are θ S1 =0 and θ S2 =Δθ sc2 +Δθ sc1 .

[0279] Thus, the priority between two (or more) sound sources (given by the gain G1, G2 = f(θ Sq (t),q=1,2 reflects, t indicates θ Sq The time difference of the target sound source (e.g. constituting or forming part of a microphone unit such as a desktop microphone unit (e.g. a loudspeaker amplifier)) is implemented in the audio transmitter (e.g. constituting or forming part of a microphone unit such as a desktop microphone unit (e.g. a loudspeaker amplifier)). The direction of a given target sound source can be compared with the user's current viewing direction to assess the target sound source that the user is currently interested in. In a typical case, the user looks at the target sound source by turning the head towards the direction of the target sound source that the user is currently interested in, for example either by turning the head alone or by including the torso so that the current viewing direction is equal to the direction from the user to the target sound source of interest. In other words, the angle between the target sound source direction and the current viewing direction is 0 (or close to 0). The highest priority should therefore be associated with the smallest angle between the current viewing direction and the target sound source of current interest. For example, an algorithm can be implemented that provides the maximum gain to the signal transmitted to the binaural hearing aid system sound source associated with the smallest angle and the minimum gain to all other target sound sources provided by the audio transmitter (AT).

[0280] The binaural hearing aid system may include a motion sensor that provides a motion control signal indicative of the user's current motion. The binaural hearing aid system may be configured to track the user's relative motion to provide a target signal (s aux ) and providing a spatial sense that the target sound source originates outside the user's head by applying a head-related transfer function to the electrical output signals of the first and second binaural processes. The head-related transfer function (HRTF) can be estimated by the level difference between the two ears. The head-related transfer function can be estimated by the latency difference between the two ears. The head-related transfer function can be represented by the level difference and latency difference between the two ears as a function of frequency. In the case where more than one audio signal is received by the binaural hearing aid system from the corresponding one or more audio transmitters, the relevant HRTF for each of the positions of the one or more audio transmitters can be applied to the corresponding one or more audio signals before the audio signals are presented to the user. Thereby, a spatial sense that one or more target sound sources corresponding to the sounds provided to the binaural hearing aid system by the one or more audio transmitters originate outside the user's head can be provided.

[0281] The binaural hearing aid system may include first and second hearing aids. The first and second hearing aids may include first and second ear pieces. The first and second hearing aids may be composed of air conduction hearing aids, bone conduction hearing aids, cochlear implant hearing aids, or a combination thereof, or may include air conduction hearing aids, bone conduction hearing aids, cochlear implant hearing aids, or a combination thereof.

[0282] According to the invention, it is possible to place the streaming sound signal in space at a desired angle. For example, if a user is having a conference call with two speakers, one speaker may be (perceptually) placed at -45 degrees in horizontal space and the other speaker at +45 degrees (see, for example, Figure 4A , 4B ), simply by applying an appropriate (time domain) head-related impulse response (HRIR) to each streaming loudspeaker and each ear side (e.g. applied to the left and right (e.g. first and second) binaural processed electrical output signals (Signal in the expression below L-ear ,Signal R-ear ) thereby providing a spatial sense that the target sound source originates outside the user's head).

[0283] Signal L-ear (t) = HRIR L,-45° *Signal Spkr1 (t)+HRIR L,+45° *Signal Spkr2 (t)

[0284] Signal R-ear (t) = HRIR R,-45° *Signal Spkr1 (t)+HRIR R,+45° *Signal Spkr2 (t)

[0285] Where t represents time and HRIR*Signal represents the convolution of the impulse response HRIR and the signal. Similarly, to achieve the same effect, the corresponding transfer function HRTF can be multiplied with the signal "Signal" in the (time-) frequency domain (k,m) (where k and m are the frequency index and time index respectively). Signal Spkrl and Signal Spkr2 Represents "at least one stream of transmitted audio input signal" wirelessly received from the corresponding transmitters (here, two speakers (of the conference call)).

[0286] Deviations from the head orientation (or reference direction) can be any of the following:

[0287] - with respect to external streaming devices (e.g. companion microphone, desktop microphone, TV adapter, phone, etc.);

[0288] - the direction of the external streaming device at the start of the streaming signal;

[0289] - Reset to the "average" direction for the last X time periods (where X ≤ 20 seconds, for example).

[0290] The HRTF and / or HRIR functions may be selected from a predetermined set of transfer functions (HRTF) and / or impulse responses (HRIR) stored in a lookup table based on the input angle, frequency and distance. Alternatively, the binaural signals may be calculated using a parametric model that includes the level and latency differences between the two ears as a function of angle, frequency and distance. Parametric models are easier to implement in hearing aid systems with limited storage and processing capabilities. An example of such a system may be formulated as:

[0291] Signal L-ear (t) = G L,angle ×Signal(t+τ L，angle )

[0292] Signal R-ear (t) = G R,angle ×Signal(t+τ R，angle )

[0293] Among them, × represents multiplication, Signal(t+τ L,angle ) and Signal(t+τ R,angle ) is the signal wirelessly received from a given target sound source (model) at time t plus the appropriate (acoustic) delay τ for the angle θ at the left and right ears (see, for example, Figure 8B ). Coefficient G L，angle (G L (θ)) and G R,angle (G R (θ)) is the angle at which the signal is to be used relative to the head position of the hearing aid user based on the estimate / requirement (see e.g. Figure 8B , angle θ(θ sl ,θ sr ))The gain / level applied to the left and right channels of the streaming signal. The electrical output signal of the binaural processing (Signal L-ear , Signal R-ear ) can thus use a predetermined or adaptively determined head-related transfer function (or gain G ) based on information about the current angle θ between the direction of the target sound source streamed to the binaural hearing aid system and the normal forward viewing direction of the user. L , G R ) confirm (see Fig. 8A , 8B ), such as compensating for head rotation and / or eye gaze angles that deviate from zero.

[0294] Fig.10 shows the gain (G) applied to the left and right channels from the streaming source L , G R) can be configured to achieve a spatialization effect as a function of angle (θ). Here, angle "0" represents a reference or desired angle of the streaming source relative to the angle of the user's head. To change the perceived position of the streaming source, the gain curves for left and right can be shifted along this axis.

[0295] Similarly, the coefficient τ L，angle (=τ L (θ)) and T R，angle (=τ R (θ)) is the delay difference to be applied to the left and right channels of the streaming signal based on the estimated / expected angle of the signal relative to the head position of the hearing aid user.

[0296] Fig.11 The delay (τ) applied to the left and right channels from the streaming source is shown. L (θ) solid line, τ R 1 , 2, and 3. An example of how the angle (θ) (dashed line) can be configured to achieve a spatialization effect as a function of angle (θ). Here, angle "0" represents a reference or desired angle of the streaming source relative to the angle of the user's head. To change the perceived position of the streaming source, the gain curves for left and right can be shifted along this axis.

[0297] The solution ensures low implementation complexity, processing power and storage costs by applying wideband signal gain and delay differences while providing a degree of spatial orientation awareness. Spatial depth perception can be added by including distance-based corrections (attenuation) in the coefficient values, and room acoustics can also be added by reverberation-based corrections.

[0298] Solution complexity and perception of the target sound source can also be enhanced by adding spectrum / frequency-based corrections to the gain and delay variations between the right and left ears. One way to achieve this is to expand each coefficient into a vectorized set of values ​​at discrete multiple frequencies, thereby providing frequency-based variations in the gain and delay differences between the left and right ears. Another way is to apply the head-related impulse response to the left and right signals at discrete multiple angles, as expressed in the following formula.

[0299] Signal L-ear (t) = G L,angle ×Signal(t+τ L，angle )*HRIR L,angle

[0300] Signal R-ear (t) = G R,angle ×Signal(t+τ R,angle )*HRIR R,angle

[0301] The head-related impulse response (HRIR) provides the user with an appropriate sense of space, and the gain G L and G R The additional gain applied to better hear the desired sound source (usually the sound source in front of the user). This enables the system to attenuate other sound sources in the space, but not completely eliminate them and maintain their position in the space.

[0302] If the streaming sound includes multiple target sound sources or speakers that should be separated, this can be done by adding gain and delay factors and the HRIR to the signals for the left and right ears with their respective reference angle inputs.

[0303] In a specific example, it is proposed to apply additional gain to the streaming sound and / or the hearing aid output depending on the user's head orientation. A simple implementation of this method can be to have full streaming gain (e.g. gain = 1 (0 dB)) when the user's head is facing the desired sound source direction (+ / - 30°), and successively reduce the gain at larger deviation angles (e.g. -3 dB at + / - 45°, e.g. -6 dB at + / - 60°, e.g. -12 dB at + / - 90°, up to -18 dB at angles greater than + / - 90°). As an alternative, the implementation can be a more continuous dependence of the angle. An example of this is shown in Figure 2A , 2B , 2C, where the user can experience the audio transmission device from the TV ( Figures 2A-2C and Figures 3A-3C When the user faces the TV ( Figure 2A ), the additional gain of the streamed TV sound is 0dB. At the same time, the gain of the amplified sound from the internal hearing aid microphone is reduced (e.g. -6dB to -12dB) to allow the user to better focus on the TV sound. If the user then wants to talk to the person next to him / her ( Figure 2B , 2C ), when the user turns his / her head away from the TV, the streaming TV sound is reduced (e.g., -12dB) and the amplified sound from the hearing aid microphone is turned up (e.g., to 0dB) so that the user can better hear the person he / she is talking to.

[0304] The system can be described as an attention-based gain control system, where the signal of interest (either the streaming signal or the hearing aid output) is amplified while the other signal is attenuated to achieve optimal listening conditions based on intent. This is illustrated by adding a coefficient to the total gain applied to the right and left channels of the streaming sound source and the hearing aid HI output. This can be illustrated by adding the HI output (based on the microphone signal) to the streaming signal source in the equation above, which is renamed Signal in the formula below L，Stream and Signal R,Stream .

[0305] Signal L-ear (t)

[0306] =Signal L，Stream (t)×G Stream,Attention

[0307] +HI L，Output (t)×G HI,Attention

[0308] Signal R-ear (t)

[0309] =Signal R，Stream (t)×G Stream,Attention

[0310] +HI R，Output (t)×G HI,Attention

[0311] Coefficient G Stream，Attention and G HI，Attention The gain / level to be applied to the streaming audio signal and the HI output signal based on the hearing aid user's attention / engagement estimated by the angle of the streaming source relative to the hearing aid user's head position.

[0312] Fig.12 shows the application to the streaming signal (Signal L,Stream ,Signal R,Stream ) gain (G Stream,Attention =G S,A ) and applied to the HI output signal (HI L,Output ,HI R,Output ) gain (G HI,Attention =G HI,A ) can be configured to achieve an attention-based target steering effect as a function of angle (θ). Here, angle "0" represents a reference or desired angle of the streaming source relative to the angle of the user's head. The advantage of providing two separate streaming signals is that it is easier to apply spatial information to the streaming signal in the transmitter (of the external microphone) and then stream the result in stereo format, hence the two streams.

[0313] It has further been proposed to track the orientation of the user's head to place the streamed sounds in space and keep them in place as the user turns his head, e.g. Figure 1C , 2C , 3C, 4B, 5, 6. The position of the user's head can be tracked, for example, using the following means:

[0314] - a gyroscope placed in at least one hearing aid;

[0315] - Accelerometer (ideally, one in each hearing aid);

[0316] - Magnetometer (sensing the Earth's magnetic field);

[0317] - Radio connection to an external device that detects the direction of arrival (DOA) of a target sound and / or the time of flight (ToF) of a wirelessly received target signal (e.g. using Bluetooth Low Energy (BLE) or LE Audio or Ultra-Wideband (UWB));

[0318] - A combination of two or more of the above.

[0319] Head tracking can be measured using a three-axis coordinate system with the origin at the center of the user's head. The rotational forces on the head are expressed as rotations about each of these axes and can be termed yaw, pitch, and roll, e.g. Fig. 8A As shown in (see, for example, US20150230036A1).

[0320] Head tracking using motion sensing technologies, namely accelerometers, gyroscopes and magnetometers, can be done in several different ways. Some algorithms include only a single motion sensing technology mentioned above, while other algorithms require multiple such technologies. These include, but are not limited to:

[0321] - direction and magnitude of the gravity vector;

[0322] - integral of angular velocity over time;

[0323] - Absolute orientation given by the Earth's magnetic field;

[0324] -Sensor fusion algorithm

[0325] --Complementary filter implementation

[0326] -- Kalman filter implementation

[0327] --Quaternion implementation

[0328] --Euler angle implementation

[0329] --Mahony filter implementation

[0330] --Madgwick filter implementation

[0331] - Machine learning algorithms based on single or combined sensor data. In hearing aid systems with limited capabilities, it is appropriate to use machine learning with a limited number of sensors. Gyroscopes for example are quite power hungry.

[0332] Complementary filter implementation example: The complementary filter fuses the accelerometer and integrated gyroscope data by passing the former through a first-order low-pass filter and the latter through a first-order high-pass filter and adding the outputs. The angular output for each of these axes can be calculated separately by:

[0333] θ k =α(θ k-1 +ω k Δt)+(1-α)a k

[0334] Among them, θ k is the angle (between x and y, x and z, or y and z), ω k is the gyroscope data after high-pass filtering, k is the accelerometer data after low-pass filtering, k is the sample index, Δt is the time between samples, and the filter conversion factor α can be calculated by the following formula:

[0335]

[0336] Where T determines the filter cutoff frequency.

[0337] Machine Learning Algorithms: Examples of neural networks trained to determine the orientation angle θ of the head relative to a target direction may include extracting data from one or more sensors and using the extracted parameters as input and determining the orientation angle θ as output using a pre-trained neural network. Gyroscopes are the best sensors for detecting head orientation, but are very power hungry for hearing systems. Accelerometers are good at detecting gravity, but not good at detecting head orientation in the horizontal plane. Here, machine learning can help extract information about the head orientation based on the accelerometer data. Combining accelerometer data and magnetometer data can improve the performance of the machine learning model.

[0338] An example of how to train a machine learning model can be to collect data from a set of prototype hearing aids including gyroscopes, accelerometers and / or magnetometers. On this basis, well-known and commonly used algorithms for orientation estimation, such as Madgwick filter implementations, can be used to estimate the "true" orientation and can be used as response / target values ​​when training a machine learning model. In order to have a head orientation model based on accelerometer data, the model may include raw measurements from one or more axes of the accelerometer and values ​​calculated based on the features of the data. Examples of feature data include raw or filtered signal point metrics, signal distance metrics, signal statistics, signal spectra, and other signal characteristics. The signal may consist of data from a single axis or any combination of 3 available axes. The machine learning model may use signals and features sample by sample or sequentially based on the implemented model structure. The model can be configured as a discrete classification model or a continuous recursive model based on solution intent. Specific examples may include sequential signal data used in a two-level convolutional neural network (CNN) for discrete classification of angular data.

[0339] The choice of what head tracking algorithm to use may be based on the motion sensing hardware technology available in the device being used, as well as the desired implementation complexity and computational load.

[0340] Fig. 8A The definition of the rotational motion parameters pitch, yaw and roll relative to the x, y and z axes of the orthogonal coordinate system is shown in FIG. Roll is defined as a rotation about the x-axis. Pitch is defined as a rotation about the y-axis. Yaw is defined as a rotation about the z-axis.

[0341] refer to Fig. 8A The placement of the orthogonal coordinate system relative to the user's head:

[0342] Pitch is defined as the rotation of the head about the y-axis (e.g. nodding (head movement in the xz plane)). It can be measured by a single or a pair of hearing aid devices. Gyroscopes in hearing aid devices can measure it directly. The measurements from the pair of gyroscopes in each hearing aid device can be averaged to provide higher accuracy. The accelerometer will measure the direction of the gravity field, and pitch is determined by calculating the difference between the actual direction of gravity and the previously determined "normal" direction, i.e. the established z-axis. If both hearing aids estimate pitch, they can combine their results for better accuracy.

[0343] Yaw is defined as the rotation of the head about the z-axis (e.g., the head moves from one end to the other in the horizontal (xy) plane). It can be measured by a single or a pair of hearing aid devices. A gyroscope in a hearing aid device can measure it directly. Measurements from a pair of gyroscopes (one in each hearing aid device) can be compared (e.g., averaged) to provide greater accuracy. Using an accelerometer, there are two ways to estimate yaw, or more precisely, angular velocity ω.

[0344] Rollover is defined as a rotation of the head about the x-axis (eg, the head moves from one end to the other in the vertical (yz) plane).

[0345] Figure 8B The position of the target sound source relative to the user is schematically shown. Figure 8B Shown is a left and right hearing aid (HI l ,HI r ) and a target sound source (S) located in front of the left of the user (e.g. a loudspeaker, as shown in the figure, or a person speaking, or any other (local) sound source of interest to the user). The left and right microphones of the left and right hearing aids receive acoustically propagated sound signals from the sound source (S). These sound signals are received by the corresponding microphones and converted into electrical input signals and, for example, represented in a time-frequency representation as (complex) digital signals (X sl [l,k] and X sr [l,k]) or time domain signal (x 1 ,x2 ) in the form of left and right hearing aids (HI l ,HI r ), l is a time index, k is a frequency index (for example, provided by a corresponding time domain to time-frequency domain conversion unit (for example, an analysis filter bank)). The sound wavefront is transmitted from the sound source (S) to the corresponding left and right microphone units (mic l ,mic r ) is transmitted from the left and right hearing aids (HI l ,HI r ) between the center (0,0,0) of the orthogonal coordinate system (x,y,z) (denoted as d sl and d sr , for example, to represent a vector. The microphone and the sound source (S) are assumed to be located in the xy plane (z = 0, ), however, this is not necessarily the case. From the sound source (S) to the two microphones (mic l ,mic r ) at different distances (d sl ,d sr ) and angle (θ sl ,θ sr ) leads to ITD(D,θ, )(ITD=Interaural Time Difference). Similarly, the different configurations of the propagation paths from the sound source to the left and right hearing aids cause the levels of the signals received at the two microphones to differ (to the right hearing aid (HI r ) is affected by the user's head (such as vector (d sr ) and to the left hearing aid (HI l ) pathway (d sl ) is not affected by the user’s head. In other words, the observed ILD(D,θ, )(ILD=Interaural Level Difference). These differences (perceived as localization cues by normal hearing people) are reflected to some extent (depending on the actual position of the microphone on the hearing aid) in the microphone input signal (X sl [m,k] and X sr [m,k], or x 1 and x 2 ) and can be used to extract head-related transfer functions and apply these spatial cues to wirelessly received signals (s aux ) to provide the given geometry at (D,θ, ) at a point source, for example represented by vector D.

[0346] Fig. 9An embodiment of a hearing aid according to the invention is shown, comprising a BTE part located behind the ear and an ITE part located in the ear canal of the user. Fig. 9 An exemplary hearing aid (HI) formed as a receiver-in-the-ear (RITE) type hearing aid is shown, comprising a BTE portion (BTE) adapted to be located behind the pinna and a portion (ITE) adapted to be located in the ear canal of a user including an output transducer (OT, e.g., a speaker / receiver) (e.g., as exemplified in FIG. Fig. 7A , 7B The hearing aid (HI) shown in FIG. 1 is a hearing aid (HI) shown in FIG. 1 ). The BTE part (BTE) and the ITE part (ITE) are connected (eg, electrically connected) via a connector (IC). Fig. 9 In the hearing aid embodiment of the present invention, the BTE part (BTE) includes two input transducers (here, microphones) (M BTE1 ,M BTE2 ), each used to provide a representation from the environment (in Fig. 9 In the case of BTE ) of the electrical input audio signal. Fig. 9 The hearing aid also includes two wireless receivers (WLR 1 ,WLR 2 ) for providing corresponding directly received auxiliary audio and / or information signals. The hearing aid (HI) also includes a substrate (SUB) on which a plurality of electronic components are mounted, which are functionally divided according to the application involved (analog, digital, passive components, etc.), and include a configurable signal processing unit (SPU), a beamformer filter unit (BFU), and a memory unit (MEM) connected to each other and to the input unit and the output unit via electrical conductors (Wx). The mentioned functional units (and other elements) can be divided into circuits and elements according to the application involved (for example, for size, power consumption, analog-digital processing, etc.), for example, integrated in one or more circuits, or as a combination of one or more integrated circuits and one or more separate electronic components (for example, inductors, capacitors, etc.). The configurable signal processing unit (SPU) provides an enhanced audio signal (see Fig. 7A , 7B The signal OUT in is used to present it to the user. Fig. 9 In an embodiment of the hearing aid, the ITE part (ITE) comprises an output unit (SPK) in the form of a loudspeaker (receiver) for converting an electrical signal (OUT) into an acoustic signal (providing or contributing to an acoustic signal (S) at the eardrum) ED )). Fig. 9 The ITE part also includes an input unit (M) including an input transducer (such as a microphone) ITE ) for providing an input sound signal (S) representing the environment at or in the ear canal ITE) of the electrical input audio signal. In another embodiment, the hearing aid may include only a BTE microphone (M BTE1 ,M BTE2 In yet another embodiment, the hearing aid may include a combination of an input unit located somewhere other than the ear canal and one or more input units located in the BTE part and / or the ITE part. The ITE part also includes a guiding element such as a dome (DO) for guiding and positioning the ITE part in the ear canal of the user.

[0347] Fig. 9 The hearing aid (HI) illustrated in FIG. 4 is a portable device and further comprises a battery (BAT) for powering the electronic components of the BTE part and the ITE part.

[0348] A hearing aid (HI) comprises a directional microphone system (beamformer filter unit (BFU)) adapted to enhance a target sound source among a plurality of sound sources in the local environment of a user wearing the hearing aid. The directional system may be adapted to detect (e.g. adaptively detect) from which direction a specific part of the microphone signal (e.g. the target part and / or the noise part) originates and / or receive input from a user interface (UI, e.g. a remote control or a smartphone) regarding the current target direction (see Fig. 9 Auxiliary device (AUX) in the lower part). The memory unit (MEM) may include predetermined (or adaptively determined) complex, frequency-dependent constants that define a predetermined (or adaptively determined) "fixed" beam pattern according to the present invention and define the beamforming signal.

[0349] Fig. 9 The hearing aid may constitute or form part of a hearing aid and / or a binaural hearing aid system according to the invention.

[0350] The hearing aid (HI) according to the invention may comprise a user interface (UI), e.g. Fig. 9 As shown in the embodiment, it is implemented in an auxiliary device (AUX) such as a remote controller, for example, it is implemented as an APP in a smart phone or other portable (or stationary) electronic device. Fig. 9 In an embodiment of the present invention, a screen of a user interface (UI) shows a target position APP. The position (e.g., direction (θ) and distance (D)) of the current target sound source (S) can be selected from the user interface (e.g., from a limited number of predetermined options (θ, D)), for example, by dragging the sound source symbol (S) to the current relevant position (θ', D') relative to the user. The currently selected target position (symbol S) is placed to the left of a reference direction (here, the front direction relative to the user's nose) (e.g., an angle θ relative to the reference direction). 1The reference direction is indicated by a thick arrow starting from the reference point of the user's head. The auxiliary device (AUX) and the hearing aid (HI) are adapted to enable data representing the currently selected position (if it deviates from a predetermined position (already stored in the hearing aid)) to be transmitted to the user via, for example, a wireless communication link (see Fig. 9 The communication link WL2 may be implemented, for example, based on far-field communication such as Bluetooth or Bluetooth Low Energy (e.g. LE Audio or similar technologies), via appropriate antennas and transceiver circuits in the hearing aid (HI) and the auxiliary device (AUX), and by a transceiver unit WLR in the hearing aid. 2 Mark.

[0351] Neural networks may be used to determine the head orientation of a user of a hearing aid or hearing aid system.

[0352] In the following, some combinations of applications of the inventive concept in hearing aids are mentioned:

[0353] 1. Use spatial audio on streaming sound in hearing aid systems (HI+ set-top boxes, remote microphones and / or smartphones)

[0354] 2. Using spatial audio on integrated microphone sound in hearing aid systems (e.g. enhanced hearing)

[0355] 3. Combine spatial audio and head tracking to render streaming sound to approach the user from outside the desired direction

[0356] 4. Use head tracking to control the amplification of streaming sound (e.g., increase streaming sound amplification when the user looks in the direction of the streaming sound source)

[0357] 5. Use head tracking to control the amplification of standard HI amplified sounds while streaming (e.g., reduce ambient sound amplification when the user is looking toward the TV / STB; increase ambient sound amplification when the user is looking away from the TV / STB)

[0358] 6. Use distance estimation metrics such as RSSI between connected devices to control amplification or externalization of streaming sound

[0359] 7. Head tracking using gyroscope

[0360] 8. Head tracking using accelerometer

[0361] 9. Head tracking using magnetometer

[0362] 10. Head tracking using DOA on wireless signals

[0363] 11. Combine two or more of the above 7-10 to achieve head tracking

[0364] 12. Use available motion and sound environment data to automatically control the level of spatial audio and the mix between the streaming sound and the integrated microphone sound presented to the user

[0365] 13. Set the direction of the streamed sound relative to the transmitter, the direction at the beginning, or the average direction over the last X amount of time, manually / manual calibration

[0366] 14. Track the user's position relative to the streaming device and render spatial sound accordingly. Spatial audio is implemented using a simple HRTF that only adjusts the level difference between the two ears

[0367] 15. Implementing spatial audio using a simple HRTF that only adjusts the latency difference between the two ears

[0368] 16. Use a simple HRTF with combination 14+15 to achieve spatial audio

[0369] 17. Spatial audio using a simple HRTF with frequency-dependent level and latency differences between the two ears

[0370] 18. Use proprietary integrated hearing aid features to achieve spatial audio through differential binaural processing between the two ears over any other means

[0371] The structural features of the apparatus described above, described in detail in the “Detailed Description of the Invention” and defined in the claims may be combined with the steps of the method of the present invention when appropriately replaced by corresponding processes.

[0372] Unless expressly stated, the singular forms "one", "the" used herein include the plural form (i.e., have the meaning of "at least one"). It should be further understood that the terms "having", "including" and / or "comprising" used in the specification indicate the presence of the described features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or combinations thereof. It should be understood that, unless expressly stated, when an element is referred to as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate intervening element. As used herein, the term "and / or" includes any and all combinations of one or more listed related items. Unless expressly stated, the steps of any method disclosed herein do not have to be performed in the exact order disclosed.

[0373] It should be appreciated that reference to "an embodiment" or "embodiment" or "aspect" or features that "may" include in this specification means that the specific features, structures or characteristics described in conjunction with the embodiment are included in at least one embodiment of the present invention. In addition, the specific features, structures or characteristics may be appropriately combined in one or more embodiments of the present invention. The foregoing description is provided to enable those skilled in the art to implement the various aspects described herein. Various modifications will be apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects.

[0374] The claims are not limited to the various aspects shown herein, but rather have the full scope consistent with the claim language wherein, unless expressly stated otherwise, elements referred to in the singular do not mean "one and only one" but rather "one or more." Unless expressly stated otherwise, the term "some" means one or more.

[0375] Examples of products (hearing aids) according to the invention are presented in the following project:

[0376] Item 1. A binaural hearing aid system, comprising:

[0377] - first and second hearing aids adapted to be located at or in the left and right ears of a user, respectively, each of the first and second hearing aids comprising

[0378] an input transducer for converting an acoustically propagated signal incident on said input transducer into an electrical sound input signal comprising a target signal from at least one target sound source and other signals from possible other sound sources in the user's surroundings;

[0379] a wireless receiver for receiving a signal wirelessly transmitted from an audio transmitter and retrieving from the audio transmitter a streaming audio input signal comprising a target signal from at least one target sound source and optionally other signals from other sound sources in the surroundings of the audio transmitter;

[0380] - an input gain controller for controlling the relative weight between the electric sound input signal and the streaming audio input signal and providing a weighted sum of the input signals;

[0381] - an output transformer configured to convert the weighted sum of the input signals or a further processed version thereof into a stimulus perceivable as sound by a user;

[0382] The binaural hearing aid system further comprises:

[0383] a position detector configured to provide an estimate of a current position of at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate;

[0384] Wherein at least one of the input gain controllers of the first and second hearing aids is configured to provide the relative weighting in dependence on the position detector control signal.

[0385] Item 2. A binaural hearing aid system according to Item 1, wherein the estimate of the position of at least one target sound source relative to the user's head includes an estimate of the angle between the user's current viewing direction and the direction from the user's head to the at least one target sound source.

[0386] Item 3. A binaural hearing aid system according to Item 2, wherein an estimate of the angle between a user's current viewing direction and a direction from the user's head to a target sound source of at least one target sound source is estimated relative to a common reference direction.

[0387] Item 4. A binaural hearing aid system according to Item 3, wherein the common reference direction is the direction from the user to the audio transmitter or a normal forward-looking position relative to the user's torso.

[0388] Item 5. The binaural hearing aid system according to Item 2, wherein the input gain controller is configured to reduce the relative weight between the electrical sound input signal and the streaming audio input signal as the angle increases.

[0389] Item 6. A binaural hearing aid system according to Item 1, wherein the position detector comprises a head tracker configured to track a rotation angle of the user's head compared to a reference direction so as to estimate or contribute to an estimate of a position of the target sound source relative to the user's head.

[0390] Item 7. The binaural hearing aid system of Item 6, wherein the head tracker comprises a combination of a gyroscope and an accelerometer.

[0391] Item 8. A binaural hearing aid system according to Item 1, wherein the position detector includes an eye tracker, thereby enabling estimation of the user's current eye gaze angle relative to the current position of the user's head to refine the estimate of the position of the target sound source relative to the user's head.

[0392] Item 9. A binaural hearing aid system according to Item 1, wherein the estimate of the current position of at least one target sound source relative to the user's head includes an estimate of the distance between the target sound source and the user's head.

[0393] Item 10. The binaural hearing aid system of Item 1, wherein the estimate of the current position of at least one target sound source relative to the user's head includes an estimate of the distance between the audio transmitter and the wireless receiver.

[0394] Item 11. The binaural hearing aid system according to Item 1, wherein the input gain controller is configured to reduce the relative weight between the electrical sound input signal and the streaming audio input signal as the distance increases.

[0395] Item 12. A binaural hearing aid system according to Item 1, wherein an estimate of the position of the target sound source relative to the user's head is provided as user input.

[0396] Item 13. A binaural hearing aid system according to Item 1, wherein each of the first and second hearing aids comprises a monaural audio signal processor configured to apply one or more processing algorithms to the weighted sum of the input signals and to provide a processed electrical output signal therefrom.

[0397] Item 14. The binaural hearing aid system according to Item 1, wherein the position detector is configured to estimate the arrival direction of the sound from the target sound source based on one or more of the electrical sound input signal and the streaming audio input signal.

[0398] Item 15. The binaural hearing aid system according to Item 1, comprising a binaural audio signal processor configured to apply a binaural gain to the streaming audio input signal of the first and second hearing aids.

[0399] Item 16. A binaural hearing aid system according to Item 15, wherein the binaural audio signal processor is configured to control binaural gains of the streaming audio input signals applied to the respective first and second hearing aids based on an estimate of the position of the target sound source relative to the user's head.

[0400] Item 17. A binaural hearing aid system according to Item 1, comprising a wireless reception detector configured to provide a reception control signal indicating whether at least one stream of transmitted audio signals including the target signal and optionally other signals from other sound sources in the user's surrounding environment is currently received.

[0401] Item 18. A binaural hearing aid system according to Item 1, wherein the target sound source includes sound transmitted from a television set TV via a TV sound transmitter located together with the TV to the binaural hearing aid system and / or sound transmitted from one or more persons via a microphone unit located at or near the person or persons involved to the binaural hearing aid system.

[0402] Item 19. A binaural hearing aid system according to Item 1, wherein the input transducer includes a noise reduction algorithm configured to reduce noise in the resulting electrical sound input signal, and / or wherein the input transducer includes multiple microphones and a beamformer filter configured to provide the resulting electrical sound input signal as a beamformed signal based on signals from the multiple microphones.

[0403] Item 20. A binaural hearing aid system according to Item 1, wherein the first and second hearing aids are composed of air conduction hearing aids, bone conduction hearing aids, cochlear implant hearing aids or a combination thereof, or include air conduction hearing aids, bone conduction hearing aids, cochlear implant hearing aids or a combination thereof.

[0404] Item 21. A hearing aid adapted to be located at or in an ear of a user, the hearing aid comprising:

[0405] - an input transducer for converting an acoustically propagated signal incident on the input transducer into an electrical sound input signal comprising a target signal from at least one target sound source and other signals from possible other sound sources in the user's surroundings;

[0406] - a wireless receiver for receiving a signal wirelessly transmitted from an audio transmitter and retrieving from the audio transmitter a streaming audio input signal comprising said target signal and optionally other signals from other sound sources in the surroundings of the target sound source;

[0407] - an input gain controller for controlling the relative weighting between the electric sound input signal and the streaming audio input signal and providing a weighted sum of these input signals;

[0408] - an output transducer configured to convert said weighted sum of said input signals or a further processed version thereof into a stimulus perceivable as sound by a user; and

[0409] a position detector configured to provide an estimate of a current position of at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate;

[0410] Wherein, the input gain controller is configured to provide the relative weight according to the position detector control signal.

[0411] Item 22. A hearing aid system comprising a hearing aid and an audio transmitter, the hearing aid and the audio transmitter being configured to exchange data therebetween,

[0412] The hearing aid comprises:

[0413] - a wireless receiver for receiving wirelessly transmitted signals from the audio transmitter and retrieving from the audio transmitter a streaming audio input signal comprising at least a target signal and optionally other signals from other sound sources in the surroundings of the target sound source;

[0414] a position detector configured to provide an estimate of a current position of at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate; wherein the hearing aid is configured to transmit the position detector control signal to the audio transmitter;

[0415] - a wireless transmitter for transmitting data to an audio transmitter;

[0416] The audio transmitter comprises:

[0417] - an input unit configured to provide at least one electrical input signal representing a sound;

[0418] - a wireless audio transmitter configured to transmit data, such as audio data, comprising at least one electrical input signal representing sound to the hearing aid;

[0419] - a wireless receiver configured to receive data including position detector control signals from the hearing aid; and

[0420] - a transmission processor configured to determine a transmitter gain based on the position detector control signal and to apply the transmitter gain to at least one electrical input signal.

[0421] Item 23. The hearing aid system according to Item 22, wherein the hearing aid further comprises:

[0422] - an input transducer for converting an acoustically propagated signal incident on the input transducer into an electrical sound input signal comprising a target signal from at least one target sound source and other signals from possible other sound sources in the user's surroundings.

[0423] Item 24. A hearing aid system according to Item 22, wherein the audio transmitter includes a television or other video-sound transmitter configured to receive sound from a television or other video device and transmit the sound to the hearing aid, or a microphone unit configured to collect sound from one or more target sound sources in the environment of the microphone unit and transmit the sound.

[0424] Item 25. A hearing aid system according to Item 22, wherein the estimate of the position of at least one target sound source relative to the user's head includes an estimate of the angle between a reference direction and a direction from the user's head to the at least one target sound source.

[0425] Item 26. A hearing aid system according to Item 22, wherein the transmitter gain includes spatial information representing a current position of at least one target sound source relative to the user's head.

[0426] Item 27. The hearing aid system of Item 22, wherein the first and second hearing aids (HI l ,HI r ) of the corresponding input converter (IT1; IT2) to collect the electric sound input signal (in 1 ;in 2 ) and the streaming audio input signal (s) according to the position detector control signal (det; det1, det2)aux ;s aux1 ;s aux2 ) can be prioritized by the first and second hearing aids (HI l ,HI r ) of the corresponding input gain controller (IGC1, IGC2) is provided as an input signal (in 1 ,s aux1 ) and (in 2 ,s aux2 )'s corresponding weighted sum (out 1 ,out 2 ).

[0427] References

[0428] ·EP3270608A1(GN Hearing)17.01.2018.

[0429] ·US2013094683A1(Oticon)18.04.2013.

[0430] ·EP3716642A1(Oticon)30.09.2020.

[0431] ·EP3013070A2(Oticon)27.04.2016.

[0432] ·WO2010133246A1(Oticon)25.11.2010.

[0433] ·US2015003653A1(Starkey)01.01.2015.

[0434] ·US2013259237A1(Phonak)03.10.2013.

[0435] ·US2014348331A1(GN Resound)27.11.2014.

[0436] ·US20150230036A1(Oticon)13.08.2015.

[0437] ·US2015189449A1(GN Resound)02.07.2015.

[0438] ·EP3373603A1(Oticon)12.09.2018.

[0439] ·EP3185590A1(Oticon)28.06.2017.

[0440] ·EP3285500A1(Oticon)21.02.2018.

[0441] ·EP3477964A1(Oticon)01.05.2019.

Claims

1. A binaural hearing aid system, comprising: - first and second hearing aids adapted to be located at or in the left and right ears of a user, respectively, each of the first and second hearing aids comprising an input transducer for converting an acoustically propagated signal incident on said input transducer into an electrical sound input signal comprising a target signal from at least one target sound source and other signals from possible other sound sources in the user's surroundings; a wireless receiver for receiving a signal wirelessly transmitted from an audio transmitter and retrieving from the audio transmitter a streaming audio input signal comprising a target signal from at least one target sound source and optionally other signals from other sound sources in the surroundings of the audio transmitter; - an input gain controller for controlling the relative weight between the electric sound input signal and the streaming audio input signal and providing a weighted sum of the input signals; - an output transformer configured to convert the weighted sum of the input signals or a further processed version thereof into a stimulus perceivable as sound by a user; The binaural hearing aid system further comprises: a position detector configured to provide an estimate of a current position of at least one target sound source relative to the user's head and to provide a position detector control signal indicative of the estimate; Wherein at least one of the input gain controllers of the first and second hearing aids is configured to provide the relative weighting in dependence on the position detector control signal.

2. The binaural hearing aid system according to claim 1, wherein: The estimate of the position of at least one target sound source relative to the user's head includes an estimate of the angle between the user's current viewing direction and the direction from the user's head to the at least one target sound source.

3. The binaural hearing aid system according to claim 2, wherein: An estimate of an angle between a user's current viewing direction and a direction from the user's head to a target sound source of at least one target sound source is estimated relative to a common reference direction.

4. The binaural hearing aid system according to claim 3, wherein: The common reference direction is the direction from the user to the audio transmitter or the normal forward-looking position relative to the user's torso.

5. The binaural hearing aid system according to claim 2, wherein: The input gain controller is configured to reduce the relative weight between the electric sound input signal and the streaming audio input signal as the angle increases.

6. The binaural hearing aid system according to claim 1, wherein: The position detector comprises a head tracker configured to track a rotation angle of the user's head compared to a reference direction so as to estimate or contribute to an estimate of a position of a target sound source relative to the user's head.

7. The binaural hearing aid system according to claim 1, wherein: The position detector includes an eye tracker, thereby enabling estimation of the user's current eye gaze angle relative to the current orientation of the user's head and thereby refining the estimate of the position of the target sound source relative to the user's head.

8. The binaural hearing aid system according to claim 1, wherein: The estimate of the current position of at least one target sound source relative to the user's head includes an estimate of the distance between the target sound source and the user's head.

9. The binaural hearing aid system according to claim 1, wherein: The estimate of the current position of the at least one target sound source relative to the user's head includes an estimate of the distance between the audio transmitter and the wireless receiver.

10. The binaural hearing aid system according to claim 1, wherein: The input gain controller is configured to reduce the relative weight between the electric sound input signal and the streaming audio input signal as the distance increases.

11. The binaural hearing aid system according to claim 1, wherein: An estimate of the position of a target sound source relative to the user's head is provided as user input.

12. The binaural hearing aid system according to claim 1, wherein: Each of the first and second hearing aids comprises a monaural audio signal processor configured to apply one or more processing algorithms to said weighted sum of said input signals and to provide a processed electrical output signal therefrom.

13. The binaural hearing aid system according to claim 1, wherein: The position detector is configured to estimate an arrival direction of a sound from a target sound source based on one or more of the electrical sound input signal and the streaming audio input signal.

14. The binaural hearing aid system of claim 1, comprising a binaural audio signal processor configured to apply a binaural gain to the streaming audio input signal of the first and second hearing aids.

15. The binaural hearing aid system according to claim 14, wherein: The binaural audio signal processor is configured to control binaural gains of the streaming audio input signal applied to the respective first and second hearing aids based on an estimate of the position of the target sound source relative to the user's head.

Images