Hearing aid accelerometer data-based artifact rejection

Abstract

The application discloses artifact rejection based on hearing aid accelerometer data, wherein a hearing aid comprises: an input unit; an output unit; a sensor element for detecting a movement of the user and / or an orientation of the head of the user; the sensor element includes an accelerometer configured to provide accelerometer data; the hearing aid is configured to convert accelerometer data to quantify the motion and / or orientation as counts in the X-axis, Y-axis and Z-axis and differentiate between transverse head motions defined as counts in the X-axis and Y-axis and longitudinal head motions defined as counts in the X-axis and Z-axis; the hearing aid further comprises a decision module configured to filter the accelerometer data by calculating at least a sample-by-sample minimum of the count of the X-axis and the Y-axis, and configured to estimate a listening intent of the user based on the sample-by-sample minimum; the hearing aid further comprises a processing unit, wherein the hearing aid is configured to set signal processing parameters of the processing unit based on the estimated listening intent of the user.

Description

Technical Field

[0001] The present application relates to the field of hearing aids.

[0002] The present application relates to a hearing aid adapted to be located at or in an ear of a user.

[0003] The present application also relates to a method.

[0004] The present application also relates to a computer program product. Background Art

[0005] Sensor elements, such as accelerometers, integrated into hearing aids to detect the hearing aid user's movements serve as valuable tools for interpreting the hearing aid user's listening intent. Typically, hearing aid users orient their heads toward the person they wish to converse with or discuss with. Consequently, conversations characterized by focused attention are often associated with minimal or negligible head movement. On the other hand, when a hearing aid user is conversing with several people or a group, the user may find it necessary to occasionally adjust their head laterally, either for social reasons or to read the speaker's lips.

[0006] Ideally, the above motion patterns can be classified using axis or plane data or information collected from the hearing aid's sensor elements. This enables more efficient determination of the user's listening intent and focus during conversations.

[0007] The user's listening intent can be interpreted from the data or information collected from the sensor elements by quantifying the movement as "counts" in three different axis directions. Conversations characterized by high focus are associated with low or zero counts. This in turn prompts the Multi-Channel Enhancement (MCE) system to provide enhanced assistance such as high directionality and noise reduction. Conversely, lateral head movement results in higher counts in the XY plane, which triggers the MCE system to provide default directionality and noise reduction.

[0008] In a one-on-one conversation, hearing aid users naturally respond by nodding. While serving as a form of body gesture, nodding also serves as a marker of focused conversation. Even though hearing aid users gain increased directionality due to focused conversation (primarily characterized by minimal or zero counts (movements)), nodding should be considered a gesture of focused conversation involving movement in a plane perpendicular to the lateral plane of motion.

[0009] In theory, if the accelerometer coordinate system is aligned with the body coordinate system, with the X axis pointing forward, the Y axis pointing to the left, and the Z axis oriented opposite to gravity, then a lateral head turn will have centrifugal acceleration in the XY plane. Similarly, a nod gesture will be reflected in the XZ plane.

[0010] However, due to the placement of the accelerometers, the assumption described above is only partially true. Since the hearing aid is not at the center of rotation, the two perpendicular movements cannot be clearly distinguished. For nodding and lateral head rotation, the activity in the X axis usually dominates over the activity in the Y and Z axes. Therefore, the activity in the X+Y axes is usually not very different from the activity in the X+Z axes, which should ideally separate nodding from lateral head rotation. There is a possibility of misclassifying nodding as head rotation. Sometimes nodding can trigger the MCE system to exit focus mode due to the associated movement. Therefore, there is a need for a reliable method to filter out nodding, i.e. to keep the hearing aid user in focus mode during the "artifacts" related to nodding. Summary of the Invention

[0011] hearing aids

[0012] In one aspect of the present application, a hearing aid is provided.

[0013] The hearing aid may be adapted to be positioned at or in the ear of a hearing aid user.

[0014] The hearing aid may comprise an input unit for receiving an input sound signal from the acoustic environment of the hearing aid user.

[0015] The input unit may be adapted to provide at least one electrical input signal representing the input sound signal.

[0016] The input unit may comprise an input transducer such as a microphone for converting input sound into an electrical input signal. The input unit may comprise a wireless receiver for receiving a wireless signal comprising or representing sound and providing an electrical input signal representing said sound.

[0017] The hearing aid may comprise an output unit for providing at least one set of stimuli perceivable as sounds by a hearing aid user based on a processed version of the at least one electrical input signal.

[0018] The output unit may comprise a vibrator of a bone conduction hearing aid. The output unit may comprise an output transducer. The output transducer may comprise a receiver (loudspeaker) for providing the stimulus as an acoustic signal to the user (e.g. in an acoustic (air conduction based) hearing aid). The output transducer may comprise a vibrator for providing the stimulus as a mechanical vibration of the skull to the user (e.g. in a bone attached or bone anchored hearing aid). The output unit may (in addition or as an alternative) comprise a (e.g. wireless) transmitter for transmitting the sound picked up by the hearing aid (e.g. via a network, e.g. in phone operating mode, or in a headset configuration) to another device, such as a remote communication partner.

[0019] The hearing aid may comprise a sensor element for detecting movement of the user.

[0020] A hearing aid may comprise a sensor element for detecting the orientation / head direction of a user.

[0021] The sensor element (motion detector) may be configured to detect movement of the user's facial muscles and / or bones, eg due to speech or chewing (eg jaw movement) and to provide a detector signal indicative of the movement.

[0022] The sensor element may include an accelerometer configured to provide accelerometer data including at least one signal representing motion in an X-axis, a Y-axis, and a Z-axis of an XYZ coordinate system.

[0023] The sensor element may include an accelerometer configured to provide accelerometer data including at least one signal representing the orientation of an X-axis, a Y-axis, and a Z-axis in an XYZ coordinate system.

[0024] The hearing aid may be configured to convert the accelerometer data to quantify the movement and / or orientation as counts in the X-axis, Y-axis and Z-axis.

[0025] The hearing aid may also be configured to differentiate between lateral head motion, defined as counts in the X and Y axes, and longitudinal head motion, defined as counts in the X and Z axes.

[0026] The hearing aid may further comprise a decision module configured to filter the accelerometer data by computing at least a sample-by-sample minimum of counts of the X-axis and the Y-axis.

[0027] The decision module may be further configured to estimate a listening intention of the hearing aid user based on the sample-by-sample minimum value.

[0028] A module may refer to a unit within this specification.

[0029] Thus, a module may refer to a software module, or may refer to a physical unit in the hearing aid.

[0030] The hearing aid may further comprise a processing unit.

[0031] The hearing aid may be configured to set signal processing parameters of the processing unit based on the estimated listening intention of the user.

[0032] In other words, the decision module may be configured to estimate the hearing aid user's listening intention based on the determined motion deviation.

[0033] The hearing aid may be configured to determine the motion deviation from a sample-by-sample minimum of the counts of the X-axis and the Y-axis.

[0034] Thus, in the case where the motion deviation is 1, the decision module may be configured to estimate that the user's listening intention is fully focused (e.g., a one-on-one conversation). Consequently, the processing unit (or hearing aid) may be configured to set the signal processing parameters (of the processing unit) to provide an increased degree of directionality and / or noise reduction.

[0035] Thus, in the case where the motion deviation is 0, the decision module may be configured to estimate that the user's listening intention is not fully focused. Thus, the processing unit (or hearing aid) may be configured to set the signal processing parameters (of the processing unit) to provide default directionality and / or noise reduction.

[0036] Thus, the signal processing parameters of the processing unit can be set more efficiently according to the estimated listening intention of the hearing aid user.

[0037] The hearing aid may include a pre-processing module.

[0038] The pre-processing module may be configured to perform a filtering step of the accelerometer data and an alignment of the XYZ coordinate system of the accelerometer with a normalized coordinate frame using a rotation matrix.

[0039] The hearing aid may comprise a motion module arranged upstream of the decision module.

[0040] The motion module may be configured to perform quantization of the accelerometer data to estimate the motion and / or orientation as counts for the X-axis, Y-axis, and Z-axis.

[0041] The motion module may be configured to perform a distinction between lateral head motion, defined as counts of the X and Y axes, and longitudinal head motion, defined as counts of the X and Z axes.

[0042] The decision module may include a minimum (X, Y) module.

[0043] The Min(X,Y) module can be configured to calculate the sample-by-sample minimum of counts on the X-axis and the Y-axis.

[0044] The decision module may be configured to process the sample-by-sample minimum of the counts in the X-axis and the Y-axis in an input / output (I / O) module.

[0045] The decision module can provide I / O mapping through the I / O module.

[0046] The decision module may be configured to perform truncation processing on the counts of the Z axis.

[0047] The decision module may be configured to process the Z-axis counts in the I / O module to provide an I / O map.

[0048] The hearing aid may be adapted to filter out artifacts due to nodding and other responsive gestures based on calculation of the sample-by-sample minimum of the counts on the X and Y axes.

[0049] The decision module may be configured to filter out transient motion in the Z-axis.

[0050] Thus, smaller or sudden movements will not drastically change the motion bias. In other words, if the movement is instantaneous and unintentional, which may accidentally change the motion bias, such movement will be filtered out.

[0051] The decision module may be configured to determine the motion deviation by estimating the sample-by-sample minimum values of counts in the X-axis and Y-axis, and the count in the Z-axis, respectively, relative to a predetermined I / O mapping threshold for a hearing aid user, after the sample-by-sample minimum values of the X-count and Y-count have been processed in the I / O module.

[0052] The decision module may be configured to calculate the sum of the motion deviations of the X-axis, the Y-axis, and the Z-axis of the XYZ coordinate system.

[0053] The decision module may include a mode switch.

[0054] The mode switch may be configured to switch between a focused listening mode and an unfocused listening mode.

[0055] The mode switch can be configured to categorize the listening mode into one of the following four categories:

[0056] - value equal to 0, defined as motion deviation;

[0057] - A value equal to 1 is defined as focused listening mode;

[0058] - value equal to 2, defined as the default listening mode;

[0059] - A value equal to 3 is defined as the aware listening mode.

[0060] Thus, the mode switch may be configured to switch to the focused listening mode when the motion deviation is equal to 1.

[0061] Furthermore, the mode switch may be configured to switch to the unfocused listening mode when the motion deviation is equal to zero.

[0062] The hearing aid may be configured to set the signal processing parameters of the processing unit.

[0063] The hearing aid may be configured to set a multi-channel enhancement (MCE) system of the processing unit to provide greater directionality and noise reduction when the motion bias is equal to 1 compared to when the motion bias is equal to 0.

[0064] The step of setting (and further optimizing) the signal processing parameters of the hearing aid may include controlling and enhancing beamforming.

[0065] The step of setting (and further optimizing) signal processing parameters of the hearing aid may include increasing noise reduction according to different noise classification levels, adjusting SNR levels, and optimizing directionality by setting and further optimizing signal processing parameters.

[0066] The hearing aid may be adapted to provide frequency dependent gain and / or level dependent compression and / or frequency transposition of one or more frequency ranges to one or more other frequency ranges (with or without frequency compression) to compensate for the user's hearing impairment.

[0067] The wireless receiver and / or transmitter may be configured to receive and / or transmit electromagnetic signals in the radio frequency range (3 kHz to 300 GHz), for example. The wireless receiver and / or transmitter may be configured to receive and / or transmit electromagnetic signals in the optical frequency range (e.g., infrared light 300 GHz to 430 THz or visible light such as 430 THz to 770 THz), for example.

[0068] A hearing aid may include a directional microphone system adapted to spatially filter ambient sound to enhance a target sound source among multiple sound sources in the local environment of a user wearing the hearing aid. The directional system may be adapted to detect (e.g., adaptively detect) the direction from which a particular portion of the microphone signal originates. This can be achieved in a variety of different ways, such as those described in the prior art. In hearing aids, microphone array beamformers are commonly used to spatially attenuate background noise sources. The beamformer may include a linearly constrained minimum variance (LCMV) beamformer. Many beamformer variants are available in the literature. Minimum variance distortionless response (MVDR) beamformers are widely used in microphone array signal processing. Ideally, an MVDR beamformer leaves the signal from the target direction (also known as the line-of-sight direction) unchanged while maximally attenuating sound signals from other directions. The generalized sidelobe canceler (GSC) structure is an equivalent representation of the MVDR beamformer, offering computational and digital representation advantages over a direct implementation of the original form.

[0069] Most sound signal sources (except the user's own voice) are relatively small compared to the size of the hearing aid, such as the distance d between the two microphones of a directional system. mic Located away from the user. The typical microphone distance in a hearing aid is on the order of 10 mm. The minimum distance from the user's sound source of interest (e.g., the sound from the user's mouth or the sound from the audio transmission device) is 0.1 m (>10 d mic ) level. For such a minimum distance, the hearing aid (microphone) will be in the acoustic near field of the sound source and the level difference of the sound signal incident on the respective microphones may be significant. The typical distance of the communication partner is greater than 1m (>100d mic The hearing aid (microphone) will be in the acoustic far field of the sound source, and the level difference of the sound signals incident on the corresponding microphones will not be obvious. The arrival time difference of the sound incident in the direction of the microphone axis (for example, in front of or behind a normal hearing aid) is ΔT = d mic / v sound =0.01 / 343[s]=29μs, where v sound The speed of sound in air at 20°C (343 m / s).

[0070] The hearing aid may include an antenna and transceiver circuitry that enables a wireless link to an entertainment device (e.g., a television), a communication device (e.g., a telephone), a wireless microphone, a separate (external) processing device, or another hearing aid. The hearing aid may thus be configured to wirelessly receive a direct electrical input signal from another device. Similarly, the hearing aid may be configured to wirelessly transmit a direct electrical output signal to another device. The direct electrical input or output signal may represent or include an audio signal and / or a control signal and / or an information signal.

[0071] In general, the wireless link established by the antenna and transceiver circuitry of the hearing aid may be of any type. The wireless link may be a link based on near field communication, for example an inductive link based on inductive coupling between antenna coils of a transmitter part and a receiver part. The wireless link may be based on far-field electromagnetic radiation. Preferably, the frequency used to establish the communication link between the hearing aid and the other device is below 70 GHz, for example in the range from 50 MHz to 70 GHz, for example above 300 MHz, for example in the ISM range above 300 MHz, for example in the 900 MHz range or in the 2.4 GHz range or in the 5.8 GHz range or in the 60 GHz range (ISM = Industrial, Scientific and Medical, such standardized ranges are defined, for example, by the International Telecommunication Union ITU). The wireless link may be based on standardized or proprietary technologies. The wireless link may be based on Bluetooth technology (for example Bluetooth Low Energy technology, for example LE Audio) or Ultra-Wideband (UWB) technology.

[0072] The hearing aid may consist of or form part of a portable (i.e. configured to be wearable) device, for example a device comprising a local energy source such as a battery, for example a rechargeable battery. The hearing aid may, for example, be a low-weight, easily wearable device, for example having a total weight of less than 100 g, such as less than 20 g, for example less than 5 g.

[0073] A hearing aid may include a "forward" (or "signal") path between the input and output of the hearing aid for processing audio signals. A signal processor may be located in this forward path. The signal processor may be adapted to provide frequency-dependent gain according to the specific needs of the user (e.g., hearing loss). The hearing aid may include an "analysis" path having functional components for analyzing signals and / or controlling processing of the forward path. Some or all of the signal processing in the analysis path and / or the forward path may be performed in the frequency domain, in which case the hearing aid includes appropriate analysis and synthesis filter banks. Some or all of the signal processing in the analysis path and / or the forward path may be performed in the time domain.

[0074] The analog electrical signal representing the acoustic signal can be converted into a digital audio signal in an analog-to-digital (AD) conversion process, where the analog signal is sampled at a predetermined frequency or sampling rate f. s Sampling, f sFor example, in the range from 8 kHz to 48 kHz (adapted to the specific needs of the application) at discrete time points t n (or n) provides digital samples x n (or x[n]), each audio sample is passed through a predetermined N b The bit represents the sound signal at t n The value when N b For example, in the range from 1 to 48 bits, such as 24 bits. Each audio sample thus uses N b bit quantization (resulting in 2 Nb different possible values). A digital sample x has a 1 / f s The length of time, such as 50μs, for f s = 20kHz. Multiple audio samples can be arranged in time frames. A time frame can include 64 or 128 audio data samples. Other frame lengths can be used depending on the actual application.

[0075] The hearing aid may include an analog-to-digital (AD) converter to digitize an analog input (e.g., from an input transducer such as a microphone) at a predetermined sampling rate, such as 20 kHz. The hearing aid may also include a digital-to-analog (DA) converter to convert the digital signal into an analog output signal, such as for presentation to the user via an output transducer.

[0076] The hearing aid, such as the input unit and / or the antenna and the transceiver circuit, may comprise a transform unit for converting a time domain signal into a signal in a transform domain (e.g. the frequency domain or the Laplace domain, a Z transform, a wavelet transform, etc.). The transform unit may be constituted by or include a time-frequency (TF) transform unit for providing a time-frequency representation of the input signal. The time-frequency representation may comprise an array or mapping of corresponding complex or real values of the signal in question in a specific time and frequency range. The TF transform unit may comprise a filter bank for filtering the (time-varying) input signal and providing a plurality of (time-varying) output signals, each output signal comprising a distinct frequency range of the input signal. The TF transform unit may comprise a Fourier transform unit (e.g. a discrete Fourier transform (DFT) algorithm, a short-time Fourier transform (STFT) algorithm, or a similar algorithm) for converting the time-varying input signal into a (time-varying) signal in the (time-)frequency domain. The frequency domain considered by the hearing aid, from the minimum frequency f min To the maximum frequency f max The frequency range of may include a portion of the typical human hearing range from 20 Hz to 20 kHz, for example a portion of the range from 20 Hz to 12 kHz. Typically, the sampling rate f s Greater than or equal to the maximum frequency f max twice, that is, f s ≥2f maxThe signals of the forward and / or analysis paths of the hearing aid may be split into NI frequency bands (e.g., of uniform width), where NI is, for example, greater than 5, such as greater than 10, such as greater than 50, such as greater than 100, such as greater than 500, at least parts of which are processed separately. The hearing aid may be adapted to process the signals of the forward and / or analysis paths in NP different frequency channels (NP ≤ NI). The frequency channels may be of uniform or non-uniform width (e.g., increasing width with frequency), overlapping or non-overlapping.

[0077] A hearing aid can be configured to operate in different modes, such as a normal mode and one or more special modes, which can be selected by the user or automatically. The operating modes can be optimized for specific acoustic situations or environments, such as a communication mode, for example, a telephone mode. The operating modes can include a low-power mode, in which the functionality of the hearing aid is reduced (e.g., to save energy), such as disabling wireless communication and / or disabling specific features of the hearing aid.

[0078] The hearing aid may include a plurality of detectors configured to provide status signals related to the current network environment of the hearing aid (e.g., the current acoustic environment), and / or the current state of the user wearing the hearing aid, and / or the current state or operating mode of the hearing aid. Alternatively or additionally, one or more of the detectors may form part of an external device that communicates with the hearing aid (e.g., wirelessly). The external device may include, for example, another hearing aid, a remote control, an audio transmission device, a phone (e.g., a smartphone), an external sensor, etc.

[0079] One or more of the plurality of detectors may operate on a full-band signal (time domain). One or more of the plurality of detectors may operate on a band-split signal ((time-)frequency domain), eg in a limited number of frequency bands.

[0080] The plurality of detectors may include a level detector for estimating the current level of the signal in the forward path. The detector may be configured to determine whether the current level of the signal in the forward path is above or below a given (L-)threshold. The level detector operates on the full-band signal (time domain). The level detector operates on the band-split signal ((time-)frequency domain).

[0081] A hearing aid may include a voice activity detector (VAD) for estimating whether (or with what probability) an input signal (at a given point in time) includes a voice signal. In this specification, a voice signal may be understood to include a speech signal from a human. It may also include other forms of vocalizations (such as singing) produced by the human speech system. The voice activity detector unit may be adapted to classify the user's current acoustic environment as a "voice" or "no-voice" environment. This has the advantage that time periods containing electrical microphone signals of human vocalizations (such as speech) in the user's environment can be identified and thus separated from time periods containing only (or primarily) other sound sources (such as artificially generated noise). The voice activity detector may be adapted to also detect the user's own voice as "voice." Alternatively, the voice activity detector may be adapted to exclude the user's own voice from the "voice" detection.

[0082] A hearing aid may include a self-voice detector for estimating whether (or with what probability) a particular input sound (e.g., voice, such as speech) originates from the voice of a user of the hearing system. The microphone system of the hearing aid may be adapted to be able to distinguish the user's own voice from the voice of another person and possibly from unvoiced sounds.

[0083] The hearing aid may comprise a classification unit configured to classify the current situation based on input signals from (at least part of) the detector / sensor and possibly other inputs. In this specification, "current situation" may be defined by one or more of the following:

[0084] a) the physical environment (e.g., including the current electromagnetic environment, such as the presence of electromagnetic signals (including audio and / or control signals) intended or unintended for reception by the hearing aid, or other properties of the current environment other than acoustics);

[0085] b) Current acoustic conditions (input level, feedback, etc.);

[0086] c) the user’s current mode or state (motion, temperature, cognitive load, etc.);

[0087] d) The current mode or status of the hearing aid and / or another device communicating with the hearing aid (selected program, time elapsed since last user interaction, etc.).

[0088] The classification unit may be based on or may comprise a neural network, such as a recurrent neural network, such as a trained neural network.

[0089] Hearing aids may include acoustic (and / or mechanical) feedback control (e.g., suppression) or an echo cancellation system. Adaptive feedback cancellation has the ability to track changes in the feedback path over time. It is typically based on a linear time-invariant filter to estimate the feedback path, but the filter weights are updated over time. The filter updates can be calculated using a stochastic gradient algorithm, including some form of least mean square (LMS) or normalized LMS (NLMS) algorithm. They all have the property of minimizing the difference signal in terms of mean square, with NLMS additionally normalizing the filter updates by the square of the Euclidean norm of a reference signal.

[0090] The hearing aid may also include other appropriate functions for the application in question, such as compression, noise reduction, etc.

[0091] A hearing aid may comprise a hearing instrument, such as a hearing instrument adapted to be positioned at the ear of a user or fully or partially positioned in the ear canal, such as an earphone, a headset, an ear protection device, or a combination thereof. A hearing system may comprise a loudspeaker amplifier (comprising a plurality of input transducers (e.g. a microphone array) and a plurality of output transducers such as one or more loudspeakers, and one or more audio (and possibly video) transmitters, such as for use in an audio conferencing situation), such as comprising a beamformer filter unit, such as to provide multiple beamforming capabilities.

[0092] application

[0093] In one aspect, a hearing aid system and hearing aid applications as described above, in detail in the "Detailed Description" section, and in the claims are provided. Applications can be provided in hearing aid systems that include one or more hearing aids (e.g., hearing instruments), headphones, headsets, active ear protection systems, and the like, such as hands-free telephone systems, teleconferencing systems (e.g., including loudspeakers), public address systems, karaoke systems, classroom amplification systems, and the like.

[0094] method

[0095] In one aspect of the present application, a method is provided.

[0096] The method may include receiving an input sound signal from an acoustic environment of a hearing aid user.

[0097] The method may comprise providing at least one electrical input signal representative of said input sound signal.

[0098] The method may include providing at least one set of stimuli perceivable as sound to a hearing aid user based on a processed version of the at least one electrical input signal.

[0099] The method may include detecting motion of a user.

[0100] The method may include detecting the orientation of the user's head.

[0101] The method may include providing accelerometer data including at least one signal representing motion and / or orientation about an X-axis, a Y-axis, and a Z-axis of an XYZ coordinate system.

[0102] The method may include converting accelerometer data to quantify the motion and / or orientation as counts in the X-axis, Y-axis, and Z-axis.

[0103] The method may include distinguishing between lateral head motion, defined as counts in the X and Y axes, and longitudinal head motion, defined as counts in the X and Z axes.

[0104] The method may include filtering the accelerometer data by computing at least a sample-by-sample minimum of counts in the X-axis and the Y-axis.

[0105] The method may include estimating a user's listening intention based on the sample-by-sample minimum.

[0106] The hearing aid may include setting signal processing parameters of the processing unit based on an estimated listening intention of the hearing aid user.

[0107] When appropriately replaced by corresponding procedures, some or all of the structural features of the hearing aid described above, described in detail in the "Detailed Description of the Invention", or defined in the claims may be combined with the implementation of the method, and vice versa. The implementation of the method has the same advantages as the corresponding hearing aid.

[0108] Computer readable medium or data carrier

[0109] The present invention further provides a tangible computer-readable medium (data carrier) storing a computer program including program code (instructions), which, when the computer program is run on a data processing system (computer), causes the data processing system to perform (implement) at least part (such as most or all) of the steps of the method described above, described in detail in the "Specific Implementation Methods" and defined in the claims.

[0110] By way of example and not limitation, the aforementioned tangible computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage device, or any other medium that can be used to execute or store the desired program code in the form of instructions or data structures and that can be accessed by a computer. As used herein, disks include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks, and Blu-ray disks, wherein these disks typically reproduce data magnetically, while these disks can reproduce data optically with lasers. Other storage media include storage in DNA (e.g., in synthetic DNA chains). Combinations of the above disks are also intended to be included within the scope of computer-readable media. In addition to being stored on tangible media, computer programs can also be transmitted via transmission media such as wired or wireless links or networks such as the Internet and loaded into a data processing system to be run at a location different from the tangible media.

[0111] computer program

[0112] Furthermore, the present application provides a computer program (product) comprising instructions, which, when executed by a computer, such as a processing unit of the hearing aid described above, causes the computer to perform (the steps of) the method described above, described in detail in the "Detailed Description of the Invention" and defined in the claims.

[0113] The computer program may cause the hearing aid to convert at least the accelerometer data to quantify the movement and / or orientation as counts in the X-axis, the Y-axis and the Z-axis.

[0114] The computer program may cause the hearing aid to at least distinguish between lateral head movements defined as counts in the X and Y axes and other head movements defined as counts in the Z axis.

[0115] The computer program may cause the hearing aid to filter the accelerometer data at least by computing at least a sample-by-sample minimum of counts in the X-axis and the Y-axis.

[0116] The computer program may cause the hearing aid to estimate the user's listening intention based at least on the sample-by-sample minimum.

[0117] The computer program may cause the hearing aid to set signal processing parameters based at least on the estimated listening intention of the user.

[0118] Data processing system

[0119] On the one hand, the present invention further provides a data processing system comprising a processor and program code, wherein the program code causes the processor to perform at least part (such as most or all) of the steps of the method described above, described in detail in the "Specific Implementation Methods" and defined in the claims.

[0120] Hearing system

[0121] In another aspect, there is provided a hearing aid comprising the device described above, in detail in the "Detailed Description of the Invention" and in the claims, and a hearing system comprising an auxiliary device.

[0122] The hearing system may be adapted to establish a communication link between the hearing aid and the auxiliary device so that information (eg control and status signals, possibly audio signals) can be exchanged or forwarded from one device to the other.

[0123] The auxiliary device may include or may consist of a remote control, a smart phone, or other portable or wearable electronic device such as a smart watch.

[0124] The auxiliary device may consist of or include a remote control for controlling the functions and operation of the hearing aid. The functions of the remote control are implemented in a smartphone, which may run an app that enables the functions of the audio processing device to be controlled via the smartphone (the hearing aid includes a suitable wireless interface to the smartphone, for example based on Bluetooth or some other standardized or proprietary solution).

[0125] The auxiliary device may be constituted by or include an audio gateway device, which is suitable for receiving multiple audio signals (for example from an entertainment device such as a TV or music player, from a telephone device such as a mobile phone, or from a computer such as a PC, a wireless microphone, etc.) and is suitable for selecting and / or combining appropriate signals (or signal combinations) from the received audio signals for transmission to the hearing aid.

[0126] The auxiliary device may consist of or may comprise a further hearing aid.The hearing system may comprise two hearing aids adapted to implement a binaural hearing system, eg a binaural hearing aid system.

[0127] APP

[0128] In another aspect, the present invention further provides a non-transient application, referred to as an App. The App comprises executable instructions configured to run on an auxiliary device to implement a user interface for a hearing aid or hearing system as described above, in detail in the Detailed Description of the Invention, and in the claims. The App can be configured to run on a mobile phone, such as a smartphone, or another portable device that enables communication with the hearing aid or hearing system.

[0129] definition

[0130] As used herein, a hearing aid, such as a hearing instrument, refers to a device adapted to improve, enhance, and / or protect a user's hearing ability by receiving acoustic signals from the user's environment, generating corresponding audio signals, possibly modifying the audio signals, and providing the possibly modified audio signals as audible signals to at least one ear of the user. The audible signals may be provided, for example, in the form of acoustic signals radiated into the user's outer ear, acoustic signals transmitted to the user's inner ear as mechanical vibrations through bony structures of the user's head and / or through portions of the middle ear, and electrical signals transmitted directly or indirectly to the user's cochlear nerve.

[0131] The hearing aid may be configured to be worn in any known manner, such as as a unit worn behind the ear (with a tube that directs the radiated acoustic signal into the ear canal or with an output transducer, such as a loudspeaker, arranged close to or in the ear canal), as a unit arranged entirely or partially in the pinna and / or ear canal, as a unit connected to a fixed structure implanted in the skull, such as a vibrator, as a connectable or fully or partially implanted unit, etc. The hearing aid may comprise a single unit or several units that communicate with each other (e.g. acoustically, electrically or optically). The loudspeaker may be arranged in a housing together with the other components of the hearing aid, or it may itself be an external unit (possibly in combination with a flexible guiding element, such as a dome-shaped element).

[0132] Hearing aids can be adapted to the needs of specific users, such as hearing loss. The configurable signal processing circuitry of the hearing aid can be adapted to apply frequency- and level-dependent compression and amplification of the input signal. The customized frequency- and level-dependent gain (amplification or compression) can be determined during the fitting process by the fitting system based on the user's hearing data, such as an audiogram, using basic fitting principles (e.g., adaptation to speech). The frequency- and level-dependent gain can, for example, be reflected in processing parameters, uploaded to the hearing aid via an interface to a programming device (fitting system), and used by a processing algorithm executed by the configurable signal processing circuitry of the hearing aid.

[0133] A "hearing system" refers to a system that includes one or two hearing aids. A "binaural hearing system" refers to a system that includes two hearing aids and is adapted to collaboratively provide audible signals to both ears of a user. A hearing system or binaural hearing system may also include one or more "auxiliary devices" that communicate with the hearing aids and influence and / or benefit from the hearing aids' functionality. Such auxiliary devices may include at least one of the following: a remote control, a remote microphone, an audio gateway device, an entertainment device such as a music player, a wireless communication device such as a mobile phone (e.g., a smartphone) or a tablet, or another device, such as one that includes a graphical interface. A hearing aid, hearing system, or binaural hearing system may be used, for example, to compensate for the hearing loss of a hearing-impaired person, enhance or protect the hearing ability of a person with normal hearing, and / or transmit electronic audio signals to a person. A hearing aid or hearing system may, for example, form part of or interact with a public address system, active ear protection system, hands-free phone system, car audio system, entertainment (e.g., television, music playback, or karaoke) system, teleconferencing system, classroom amplification system, and the like. BRIEF DESCRIPTION OF THE DRAWINGS

[0134] Various aspects of the present invention will be best understood from the following detailed description in conjunction with the accompanying drawings. For clarity, the drawings are schematic and simplified, showing only the details necessary for understanding the present invention and omitting other details. Throughout the specification, the same reference numerals are used for identical or corresponding parts. The various features of each aspect may be combined with any or all features of the other aspects. These and other aspects, features, and / or technical effects will be apparent from and elucidated in conjunction with the following figures, in which:

[0135] Figure 1A shows an exemplary representation of an accelerometer coordinate system according to the present invention;

[0136] Figure 1B Examples of four different movements of hearing aid users are shown;

[0137] Figure 2 An exemplary correlation of counts in the X and Y axes during lateral and longitudinal head motion is shown;

[0138] Figure 3 An exemplary block diagram for estimating the listening intention of a hearing aid user is shown;

[0139] Figure 4 An exemplary determination of a motion deviation is shown.

[0140] By the detailed description provided below, the further scope of application of the present invention will be apparent. However, it should be understood that while the detailed description and specific examples indicate the preferred embodiments of the present invention, they are provided for illustrative purposes only. For those skilled in the art, based on the following detailed description, other embodiments of the present invention will be apparent. DETAILED DESCRIPTION

[0141] The detailed description presented below in conjunction with the accompanying drawings serves as a description of a variety of different configurations. The detailed description includes specific details for providing a thorough understanding of a plurality of different concepts. However, it will be apparent to those skilled in the art that these concepts can be implemented without these specific details. Several aspects of the apparatus and method are described by a plurality of different blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as "elements"). Depending on the specific application, design limitations or other reasons, these elements may be implemented using electronic hardware, computer programs or any combination thereof.

[0142] The electronic hardware may include microelectromechanical systems (MEMS), (e.g., application specific) integrated circuits, microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gating logic, discrete hardware circuits, printed circuit boards (PCBs) (e.g., flexible PCBs), and other suitable hardware configured to perform the various functions described in this specification, such as sensors for sensing and / or recording physical properties of the environment, device, user, etc. A computer program shall be construed broadly to mean instructions, an instruction set, code, a code segment, program code, a program, a subroutine, a software module, an application, a software application, a software package, a routine, a subroutine, an object, an executable, a thread of execution, a program, a function, or the like, whether referred to as software, firmware, middleware, microcode, a hardware description language, or otherwise.

[0143] The present application relates to the field of hearing aids.

[0144] Figure 1A An exemplary representation of an accelerometer coordinate system according to the present invention is shown.

[0145] exist Figure 1AIn FIG, a first hearing aid 1A and a second hearing aid 1B are positioned at or in the ears of the hearing aid users. Each of the first hearing aid 1A and the second hearing aid 1B includes a sensor element, exemplified as an accelerometer. The hearing aids 1A and 1B are shown as BTE devices, but other hearing aid types are also contemplated. The accelerometers of the hearing aids 1A and 1B are configured to provide accelerometer data comprising at least one signal representing motion and / or orientation along the X, Y, and Z axes of a coordinate system. Coordinate systems 3A and 3B are shown for the first hearing aid 1A and the second hearing aid 1B, respectively. The coordinate systems 3A and 3B can be aligned with a body coordinate system, with the Z axis aligned with the direction of gravity g.

[0146] Figure 1B Examples of four different movements of a hearing aid user are shown.

[0147] exist Figure 1B , a coordinate system 3A of one of the hearing aids of the hearing aid user 2 is shown.

[0148] In a first movement scenario 4 , the hearing aid user 2 is sitting still, and therefore the accelerometer detects no movement in the X-axis, Y-axis and Z-axis of the XYZ coordinate system 3A.

[0149] In a second movement scenario 5 , the hearing aid user 2 eats and nods his head, for which the accelerometer detects longitudinal head movements in the X and Z axes of the XYZ coordinate system 3A.

[0150] In a third movement scenario 6 , the hearing aid user 2 turns his head, for which the accelerometer detects lateral head movements in the X and Y axes of the XYZ coordinate system 3A.

[0151] In a fourth movement scenario 7 , the hearing aid user 2 is running or walking, for which purpose the accelerometer detects a longitudinal movement about the Z axis of the XYZ coordinate system 3A.

[0152] Because the hearing aid is not at the center of rotation, the two perpendicular movements cannot be clearly distinguished. For nodding and lateral head rotation, activity in the Z axis often dominates activity in the Y and Z axes. Therefore, activity in the X+Y axes is often not very different from activity in the X+Z axes, which ideally should separate nodding from lateral head rotation. Consequently, there is a possibility of misclassifying a nod as a head rotation. Consequently, nodding can sometimes trigger a hearing aid to exit focus mode, for example.

[0153] Figure 2 An exemplary correlation of counts in the X and Y axes during lateral and longitudinal head motion is shown.

[0154] exist Figure 2In

[15] , the coordinate system of the accelerometer is aligned with the body coordinate system. Therefore, it is possible to distinguish between lateral head turns and, for example, longitudinal gestures by the relative properties of the counts (units of motion measured from the accelerometer) in the X and Y axes.

[0155] In the upper panel 8, it is shown that the counts on the X-axis (marked in red) and the counts on the Y-axis (marked in blue) for lateral head motion are highly correlated, while the counts on the Z-axis (marked in green) are close to zero.

[0156] The lower panel (9) depicts a one-on-one conversation listening scenario, which involves a lot of nodding and shaking. As shown, the counts on the X and Y axes are not very correlated. Similar to the upper panel (8), the counts on the Z axis are close to zero.

[0157] Figure 3 An exemplary block diagram for estimating a hearing aid user's listening intention is shown.

[0158] To reduce computational load, the accelerometer data, including at least one signal representing motion and / or orientation in the X-axis, Y-axis, and Z-axis, may be pre-processed.

[0159] The pre-processing module 10 may receive the accelerometer data X, Y, and Z. In the pre-processing module 10, the accelerometer data may be filtered in a low-pass filter 11. The filtered accelerometer data may be aligned to a normalized coordinate frame using a rotation matrix 12.

[0160] The motion module 13 may receive the filtered and aligned accelerometer data X', Y' and Z'. In the motion module 13, non-body motion may be filtered out.

[0161] In other words, motion module 13 may perform quantization of accelerometer data to estimate the motion and / or orientation as counts in the X, Y, and Z axes, as well as distinguish between lateral head motion, defined as counts in the X and Y axes, and longitudinal head motion, defined as counts in the X and Z axes.

[0162] The output counts for the X, Y, and Z axes can be sent to the decision module 14. In the decision module 14, the counts for the X and Y axes are fed into the minimum (X, Y) module 15a. The minimum (X, Y) module 15a can be configured to calculate the sample-by-sample minimum of the counts for the X and Y axes. The step of determining the minimum does not significantly reduce the amplitude. Therefore, the energy of the minimum (X, Y) represents the counts for the X and Y axes.

[0163] The decision module 14 of the hearing aid may further include a truncation Z-axis module 15b configured to truncate the counts of the Z-axis.

[0164] The sample-by-sample minimum of the X-axis and Y-axis counts and the truncated Z-axis count are received by an input / output (I / O) module 16 and processed therein to provide an I / O map.

[0165] Optionally, the deviation maintaining module 17 may be configured to filter out small movements in the Z axis. Thus, transient and unintentional movements that may accidentally change the movement deviation may be filtered out.

[0166] Therefore, the decision module 14 is configured to determine the motion deviation by estimating the sample-by-sample minimum values of the counts in the X-axis and the Y-axis, and the counts in the Z-axis, respectively, relative to a predetermined I / O mapping threshold value for the hearing aid user, after the sample-by-sample minimum values of the X-count and the Y-count have been processed in the I / O module.

[0167] In other words, the decision module 14 may be configured to estimate the user's listening intention based on the determined motion deviation.

[0168] Figure 4 An exemplary determination of a motion deviation is shown.

[0169] The left and right figures show the processing of X counts and Y counts (see 18 in the upper part of the figure) measured by an accelerometer, for example during a one-to-one conversation involving nodding, without and with the minimum (X,Y) module (e.g. Figure 3 Thus, in the right panels (19; 22; 24), the X count and the Y count 18 are processed in a min(X,Y) module, providing a graph 19 showing the minimum of the X count and the Y count. The minimum of the X count and the Y count essentially results in the Y count.

[0170] In the left panels (21; 23), the X count and Y count of 18 are not processed in the minimum (X, Y) module.

[0171] After the minimum operation is performed in the Min(X,Y) block, the X count and Y count are fed into the I / O map (e.g., by Figure 3 The X count and Y count are converted to motion deviation based on the I / O map threshold (horizontal line 20 in the count plot).

[0172] In the left panel, graph 21 shows the motion deviation after the I / O map is generated but before the minimum values of the X count and Y count are determined.

[0173] In the right panel, graph 22 shows the motion deviation after the I / O map is generated and the minimum values of the X count and Y count have been determined.

[0174] Below the two figures, graphs 23, 24 show the calculated total motion deviation (i.e. the sum of the motion deviations in all three axes). A motion deviation of 1 means that the hearing aid user is fully focused, a motion deviation of 0 means that the hearing aid user is not fully focused in a one-to-one conversation, for which the default MCE applies.

[0175] In other words, the decision module 14 may be configured to estimate the user's listening intention based on the determined motion deviation.

[0176] Thus, in the case where the motion deviation is 1, the decision unit 14 may be configured to estimate that the user's listening intention is fully focused (e.g., a one-on-one conversation). Consequently, the processing unit (or hearing aid) may be configured to set the signal processing parameters (of the processing unit) to provide an increased degree of directionality and / or noise reduction.

[0177] Thus, in the case where the motion deviation is 0, the decision unit 14 may be configured to estimate that the user's listening intention is not fully focused. Thus, the processing unit (or hearing aid) may be configured to set the signal processing parameters (of the processing unit) to provide default directionality and / or noise reduction.

[0178] It is expected that when a hearing aid user is having a focused one-on-one conversation, he / she should be in full focus mode (motion bias 1). However, as can be seen in the lower left figure 23, the motion bias transitions between 0 and 1 due to the X count. This is an unexpected behavior.

[0179] It can be seen that the motion deviation is more stable in the lower right image 24 than in the lower left image 23, thereby remaining in focus mode more. Therefore, by taking the minimum value of X count and Y count, the artifacts caused by nodding and other response gestures have been successfully filtered out.

[0180] In other words, the lower left graph 23 shows that the hearing aid user was in focus mode 26% of the time during the 3 minute conversation, while the lower right graph 24 shows that the hearing aid user was in focus mode almost 78% of the time during the duration of the conversation.

[0181] The structural features of the hearing aid / device described above, described in detail in the "Detailed Description of the Invention" and defined in the claims may be combined with the steps of the method of the present invention when appropriately replaced by corresponding procedures.

[0182] Unless expressly stated otherwise, the singular forms "a", "the" and "the" used herein include the plural form (i.e., having the meaning of "at least one"). It should be further understood that the terms "having", "including" and / or "comprising" used in the specification indicate the presence of the described features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or combinations thereof. It should be understood that, unless expressly stated otherwise, when an element is referred to as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate intervening element. The term "and / or" as used herein includes any and all combinations of one or more listed related items. Unless expressly stated otherwise, the steps of any method disclosed herein do not have to be performed in the exact order disclosed.

[0183] It should be understood that references in this specification to "an embodiment," "an embodiment," "an aspect," or features that "may" include, mean that the specific features, structures, or characteristics described in conjunction with that embodiment are included in at least one embodiment of the present invention. Furthermore, the specific features, structures, or characteristics may be combined as appropriate in one or more embodiments of the present invention. The foregoing description is provided to enable those skilled in the art to practice the various aspects described herein. Various modifications will be apparent to those skilled in the art.

[0184] The claims are not limited to the aspects shown herein, but rather have the full scope consistent with the claim language in which, unless expressly stated otherwise, elements referred to in the singular do not mean "one and only one" but rather "one or more." Unless expressly stated otherwise, the term "some" means one or more.

Claims

1. A hearing aid adapted to be positioned at or in an ear of a user, the hearing aid comprising: an input unit for receiving an input sound signal from an acoustic environment of a hearing aid user and providing at least one electrical input signal representing the input sound signal; an output unit for providing at least one set of stimuli perceivable as sound to a user of the hearing aid based on a processed version of the at least one electrical input signal; a sensor element for detecting movement of the user and / or orientation of the user's head; wherein the sensor element comprises an accelerometer configured to provide accelerometer data, the accelerometer data comprising at least one signal representing motion and / or orientation about an X-axis, a Y-axis, and a Z-axis of an XYZ coordinate system; wherein the hearing aid is configured to convert the accelerometer data to quantify the motion and / or orientation as counts in the X-axis, the Y-axis, and the Z-axis, and to distinguish between lateral head motion defined as counts in the X-axis and the Y-axis and longitudinal head motion defined as counts in the X-axis and the Z-axis; wherein the hearing aid further comprises a decision module configured to filter the accelerometer data by calculating at least a sample-by-sample minimum of counts of the X-axis and the Y-axis, and configured to estimate the user's listening intention based on the sample-by-sample minimum; The hearing aid further comprises a processing unit, wherein the hearing aid is configured to set signal processing parameters of the processing unit based on the estimated listening intention of the user.

2. The hearing aid according to claim 1, wherein The hearing aid comprises a pre-processing module configured to perform a filtering step of the accelerometer data and an alignment of the XYZ coordinate system of the accelerometer with a standardized coordinate frame using a rotation matrix.

3. The hearing aid according to claim 1, wherein The hearing aid comprises a motion module arranged upstream of the decision module, the motion module being configured to perform quantization of the accelerometer data to estimate the motion and / or orientation as counts of the X-axis, Y-axis and Z-axis and to perform a distinction between lateral head motion defined as counts of the X-axis and Y-axis and longitudinal head motion defined as counts of the X-axis and Z-axis.

4. The hearing aid according to claim 1, wherein The decision module includes a min(X,Y) module configured to calculate a sample-by-sample minimum of counts on the X-axis and the Y-axis.

5. The hearing aid according to claim 4, wherein The decision module is configured to process the sample-by-sample minimums of the counts in the X-axis and the Y-axis in an input / output (I / O) module to provide an I / O map.

6. The hearing aid according to claim 5, wherein The decision module is configured to truncate the counts of the Z axis and process the counts in the input / output module to provide an I / O map.

7. The hearing aid according to claim 1, wherein The hearing aid is adapted to filter out artifacts due to nodding and other responsive gestures based on calculation of the sample-by-sample minimum of the counts in the X-axis and the Y-axis.

8. The hearing aid according to claim 1, wherein The decision module is configured to filter out transient motion in the Z axis.

9. The hearing aid according to any one of claims 5 to 8, wherein: The decision module is configured to determine the motion deviation by estimating the sample-by-sample minimum values of counts in the X-axis and Y-axis, and the count in the Z-axis, respectively, relative to a predetermined I / O mapping threshold for a hearing aid user, after the sample-by-sample minimum values of the X-count and Y-count have been processed in the input / output module.

10. The hearing aid according to claim 9, wherein The decision module is configured to calculate the sum of motion deviations of the X-axis, the Y-axis, and the Z-axis of the XYZ coordinate system.

11. The hearing aid according to claim 1, wherein The decision module comprises a mode switch, wherein the mode switch is configured to switch between a focused listening mode and a non-focused listening mode.

12. The hearing aid according to claim 9, wherein The hearing aid is configured to set signal processing parameters of the processing unit, in particular to set a multi-channel enhancement (MCE) system of the processing unit to provide higher directionality and noise reduction when the motion deviation is equal to 1 compared to when the motion deviation is equal to 0.

13. The hearing aid according to claim 1, wherein Setting and further optimizing signal processing parameters includes controlling and enhancing beamforming, adding noise reduction based on different noise classification levels, adjusting SNR levels, and optimizing directionality.

14. A method comprising: receiving an input sound signal from an acoustic environment of a hearing aid user; providing at least one electrical input signal representing the input sound signal; providing at least one set of stimuli perceivable as sound to a hearing aid user based on a processed version of the at least one electrical input signal; detecting movement of the user and / or orientation of the user's head; providing accelerometer data including at least one signal representing motion and / or orientation about an X-axis, a Y-axis, and a Z-axis of an XYZ coordinate system; converting accelerometer data to quantify the motion and / or orientation into counts in the X, Y, and Z axes; Distinguishing between lateral head movement, defined as counts in the X and Y axes, and longitudinal head movement, defined as counts in the X and Z axes; filtering the accelerometer data by computing at least a sample-by-sample minimum of counts in the X and Y axes; estimating the user's listening intention based on the sample-by-sample minimum; and Signal processing parameters are set based on the estimated listening intention of the user.

15. A computer program product comprising a computer program containing instructions, wherein when the computer program is executed by a processing unit of a hearing aid according to any one of claims 1 to 13, the instructions cause the hearing aid to perform at least the following steps: converting accelerometer data to quantify the motion and / or orientation into counts in the X, Y, and Z axes; Distinguishing between lateral head movements, defined as counts in the X and Y axes, and other head movements, defined as counts in the Z axis; filtering the accelerometer data by computing at least a sample-by-sample minimum of counts in the X and Y axes; estimating the user's listening intention based on the sample-by-sample minimum; and Signal processing parameters are set based on the estimated listening intention of the user.

Images