Hearing aid comprising a physiological sensor

Abstract

A hearing aid comprising a physiological sensor is disclosed, the hearing aid being comprised in a system comprising an input unit, an output unit, a signal-to-noise ratio estimator, a processing unit, a memory unit, at least a first and a second physiological sensor; the system being configured to: determine, based on the first physiological sensor, a first time point corresponding to a first maximum upstroke point of a first measured parameter; determine, based on the second physiological sensor, a second time point corresponding to a second maximum upstroke point of a second measured parameter; determine a current pulse transit time by calculating a time difference between the first time point and the second time point; and determine a current listening effort of a hearing aid user based on the current pulse transit time and a stored reference set of signal-to-noise ratios and pulse transit times.

Description

TECHNICAL FIELD

[0001] The present application relates to a hearing aid configured to be worn at or in the ear of a user or to be fully or partially implanted in the head of a user. The present application also relates to a system. BACKGROUND

[0002] There is an increasing interest in incorporating different types of physiological sensors that measure one or more physiological signals of a user in a system, such as a system comprising a hearing aid, such as an electrocardiogram (ECG), a photoplethysmogram (PPG), an electroencephalography (EEG), etc.

[0003] However, it is not clear how to apply the measurements of the physiological sensors to the audiological outcome of the hearing aid in a system comprising a hearing aid.

[0004] Hearing effort (may also be referred to as hearing fitting effort, listening effort, or listening effort) has been shown to have physiological markers such as pupillometry and cardiac parameters such as PEP (pre-ejection period), but there is a lack of scientific evidence whether ear-level sensors (physiological sensors mounted in or at the ear or fully or partially implanted in the head of a user) can be used to estimate hearing effort.

[0005] Furthermore, the fact that some hearing aid users always wear a wearable device, such as a smartwatch, is not currently exploited.

[0006] Thus, there is a need for effort-driven control of a system (or a hearing aid) based on sensor data from a physiological sensor. SUMMARY

[0007] In an aspect of the present application, a system comprising a hearing aid is provided. The hearing aid can be configured to operate based on an estimate of a current hearing effort of a user of the hearing aid.

[0008] The system can comprise an input unit for receiving input sound signals from an environment of a user of the hearing aid and providing at least one electrical input signal representing the input sound signals.

[0009] The environment can refer to the surroundings, i.e. the surrounding space of the user of the hearing aid.

[0010] The system can comprise an output unit for providing at least one set of stimuli perceivable as sound to the user of the hearing aid based on a processed version of the at least one electrical input signal.

[0011] The system can comprise a signal-to-noise ratio (SNR) estimator for determining an SNR in the environment of the user of the hearing aid.

[0012] The SNR estimator can determine the SNR based on a processed version of the at least one electrical input signal (e.g., provided by a processing unit).

[0013] The SNR estimator can determine the SNR based on at least one electrical input signal from the input unit.

[0014] An SNR estimator can determine the SNR based on at least one electrical input signal (such as its processed version) from at least one input converter, such as at least one microphone, of an input unit.

[0015] The system may include a processing unit.

[0016] The processing unit can be connected to the input unit.

[0017] The processing unit can be connected to the output unit.

[0018] The processing unit may include the system's signal processing parameters to provide a processed version of at least one electrical input signal.

[0019] The processing unit of the system may include an SNR estimator.

[0020] The system may include a memory unit.

[0021] The memory unit can be configured to store a reference set of the hearing aid user's SNR and pulse transition time (PTT).

[0022] The reference sets for SNR and PTT can be individualized.

[0023] For example, the reference sets for SNR and PTT can be determined based on a pre-defined set of input sound signals exposed to a specific hearing aid user.

[0024] For example, the reference set for SNR and PTT can be determined based on a predetermined set of input sound signals (such as speech and noise) exposed to multiple hearing aid users, such that the reference set includes a range of PTT values ​​for each SNR value.

[0025] For example, the reference sets for SNR and PTT can be determined during fitting.

[0026] For example, a hearing aid can be configured to trigger PTT determination after the user has been in a quiet environment (an environment with low noise signals) for a period of time (such as after a certain time interval). Thus, a reference set (baseline value) for SNR and PTT can be determined. For example, a change in the baseline value can indicate that the hearing aid user has experienced prolonged stress.

[0027] This helps to quickly determine the current listening effort of hearing aid users.

[0028] PTT can refer to the time it takes for a pulse wave to travel between two arterial sites. It can be the time it takes for a pulse wave to travel from the aortic valve to the peripheral region (i.e., the measurement point, such as at least one ear).

[0029] Generally, it can be the time difference between the R-wave peak of the ECG and the maximum upswing point (also known as the upswing point) of the PPG signal. Existing technology shows that PTT has an inverse relationship with human exposure to stress [1].

[0030] Traditional PTT requires ECG and ear-level PPG recording.

[0031] However, advantageously, PTT can be measured from two different points on the body, such as from an ear-level PPG sensor or from an ear-level ECG sensor (such as an in-ear ECG sensor).

[0032] PTT measurements based on ECG and PPG may require ear-level sensors capable of capturing both ECG and PPG. Alternatively, PPG sensors may be needed in each ear to provide ear-to-ear PTT signals.

[0033] For conventional PTT measurements using ECG and PPG, the system can be fitted with sensors such as the TI AFE4900, which provides both ECG and PPG signals and is therefore suitable for ear-level PTT measurements.

[0034] The system may include at least first and second physiological sensors. The first and second physiological sensors may be electrophysiological sensors.

[0035] For example, at least the first and second physiological sensors may include an ECG sensor, a PPG sensor, and / or an EEG sensor, etc.

[0036] The system can be configured to determine a first time point corresponding to a first maximum uplink point of a first measured parameter based on a first physiological sensor.

[0037] The system can be configured to determine the second time point corresponding to the second maximum uplink point of the second measured parameter based on the second physiological sensor.

[0038] The system can be configured to determine the first time point corresponding to the maximum value of the first derivative of the first measured parameter based on the first physiological sensor.

[0039] The system can be configured to determine the second time point corresponding to the maximum value of the second derivative of the second measured parameter based on the second physiological sensor.

[0040] The system can be configured to determine the current PTT by calculating the time difference between a first time point and a second time point.

[0041] For example, the system can be configured to determine the current PTT by calculating the time difference between two successive moments of the hearing aid user's systolic blood pressure.

[0042] The system can be configured to determine the current PTT by cross-correlating a first signal (e.g., waveform) measured by a first physiological sensor with a second signal (e.g., waveform) measured by a second physiological sensor.

[0043] For example, the maximum lag (time interval) of cross-correlation can be about 100ms, meaning we can obtain the current PTT (such as binaural PTT, BinPTT) in less than 100ms.

[0044] Cross-correlation can be performed based on signals selected from short time intervals (e.g., 60 seconds). This allows determination of the current average PTT, yielding a stable estimate of the current PTT.

[0045] The system can be configured to determine the current PTT by estimating the time difference (time delay) between the first and second signals.

[0046] The system can be configured to determine the hearing aid user's current hearing effort based on the current PTT and a stored reference set of SNR and PTT.

[0047] Therefore, the optimal hearing aid settings (signal processing parameters) can be determined and applied based on the hearing aid user's hearing effort.

[0048] The reference set for SNR and PTT can be updated and / or adjusted when the system determines a set of SNRs and the corresponding current PTT. The system can be configured to update and / or adjust the reference set of SNR and PTT stored in the system's memory cells based on the set of SNRs and the corresponding current PTT.

[0049] For example, the updating and / or adjustment of the reference set can be based on machine learning (e.g., utilizing neural networks such as deep neural networks).

[0050] A system configured to determine the current listening effort may include identifying the current hearing difficulty region.

[0051] Four regions with hearing difficulties can be defined.

[0052] The first hearing difficulty region can be defined as having an SNR higher than a first SNR threshold and a PTT higher than a first PTT threshold. For example, in the first region, the PTT can decrease as a function of the decreasing SNR. The first region can indicate that the hearing aid user is providing only a small amount of listening effort because of the high SNR.

[0053] The second hearing difficulty region can be defined as having an SNR below the first SNR threshold but above the second SNR threshold, and a PTT below the first PTT threshold. For example, in the second region, the PTT can decrease as a function of the decreasing SNR. The second region can indicate the increasing effort the hearing aid user makes to hear.

[0054] The third hearing difficulty region can be defined as having an SNR below the second SNR threshold but above the third SNR threshold, and a PTT below the first PTT threshold. For example, in the third region, the PTT can increase as a function of decreasing SNR. The third region can indicate when a hearing aid user begins to withdraw and provides decreasing hearing effort.

[0055] The fourth hearing difficulty region can be defined as having an SNR below the third SNR threshold and a PTT above the first PTT threshold. For example, in the fourth region, the PTT can increase as a function of decreasing SNR. The fourth region can indicate that the hearing aid user has completely discontinued the service and provides the minimum effort required to hear.

[0056] The system can be configured to operate in a first listening mode when the current hearing difficulty region is in a first region, in a second listening mode when the current hearing difficulty region is in a second region, in a third listening mode when the current hearing difficulty region is in a third region, and in a fourth listening mode when the current hearing difficulty region is in a fourth region.

[0057] Thus, the PTT determined based on at least the first and second physiological sensors and the SNR estimator provides a characterization of the hearing aid user's current listening effort.

[0058] Determining a hearing aid user’s current hearing effort may include determining the system’s hearing pattern.

[0059] The system can be configured to adjust the signal processing parameters of the processing unit based on a determined current hearing effort.

[0060] Adjusting the signal processing parameters of the processing unit may include adjusting the noise reduction of the system.

[0061] Adjusting the signal processing parameters of the processing unit may include adjusting the gain of the system.

[0062] Adjusting the signal processing parameters of the processing unit may include adjusting the directivity of the system.

[0063] Adjusting the signal processing parameters of the processing unit may include adjusting the enhancements of the system (such as spectral shaping).

[0064] The system may include a first wearable device.

[0065] The system may include a second wearable device.

[0066] The system may include a first wearable device and a second wearable device.

[0067] The first wearable device may include a first physiological sensor.

[0068] The second wearable device may include a second physiological sensor.

[0069] The first and / or second wearable device may be a device / assistive device configured to be worn on the body of a hearing aid user. The first and / or second wearable device may be a hearing aid and / or a watch and / or a sensor device.

[0070] The system may include at least one accelerometer. The accelerometer may be configured to detect movement of the hearing aid user. The accelerometer may be configured to detect movement in the vertical and / or horizontal directions. The accelerometer may be configured to detect movement and / or acceleration and / or orientation and / or position of the hearing aid.

[0071] The system (such as its processing unit) can be configured to determine whether the startup requirements are met.

[0072] Startup requirements can refer to one or more conditions that must be met. Therefore, startup requirements can refer to one or more thresholds, limits, boundaries, etc., that must be met before startup can occur.

[0073] The activation requirements may include the motion detected by the accelerometer being below a first motion threshold.

[0074] The first motion threshold can refer to the accelerometer not detecting, or detecting a limited amount of motion per unit of time, or only a limited scale / degree of motion. Detecting a limited scale or amount of motion would indicate that the hearing aid user is likely stationary or at least in a roughly the same area.

[0075] When no motion is detected, the accelerometer may be below the first motion threshold.

[0076] When less than 200 motion counts per minute are detected, the accelerometer may fall below the first motion threshold.

[0077] For example, a hearing aid user might be standing in a room with several other people. When trying to talk to one of the other people or when trying to follow a speech, the hearing aid user might move slightly, resulting in a limited amount of movement per unit of time or a limited scale of movement. However, the hearing aid user might be in roughly the same area.

[0078] Startup requirements may include an SNR below the fourth threshold.

[0079] The fourth threshold can refer to a level where the signal power is at a level relative to the noise power in the hearing aid user's environment, such that the user cannot hear another person speaking clearly enough and / or the speech intelligibility is too low.

[0080] When the SNR is below 0dB, the SNR may be below the fourth threshold.

[0081] When the SNR is below -5dB, the SNR may be below the fourth threshold.

[0082] In response to meeting the activation requirements, the processing unit can be configured to change the activation mode of at least one of the first and second physiological sensors.

[0083] Thus, the power consumption of the system can be minimized because the activation mode (and therefore power consumption) of at least one of the first and second physiological sensors can be controlled based on the user's movement and the user's environment.

[0084] Configuring to change the activation mode of at least one of the first and second physiological sensors may include configuring to activate at least the first and second physiological sensors.

[0085] For example, when a hearing aid user suddenly stands still (i.e. no movement is detected) to talk to another person in a noisy environment (i.e., low SNR), it may be necessary to activate the first and second physiological sensors to determine the hearing effort and thus determine the possible changes in the signal processing parameters of the system (such as the hearing aid in the system).

[0086] Configuring to change the activation mode of at least one of the first and second physiological sensors may include configuring to change the activation mode of at least one of the first and second physiological sensors from a standby mode to an operating mode.

[0087] When the activation requirements are not met, the processing unit can be configured to change or maintain the mode of at least one of the first and second physiological sensors to a standby mode or a deactivated mode.

[0088] The shutdown mode can refer to the off or power-off mode. When the first and second physiological sensors are deactivated, the power consumption of the sensors is zero.

[0089] This allows the first and second physiological sensors to be configured to be in standby mode when the activation requirements are not met, minimizing sensor power consumption. Simultaneously, the sensors can quickly switch to operational mode once the activation requirements are met. This rapid-action capability facilitates optimal signal processing for hearing aid users and / or, when appropriate, the detection and / or monitoring of their physiological parameters.

[0090] The first wearable device and / or the second wearable device may be a hearing aid.

[0091] Therefore, the system may include a first hearing aid and / or a second hearing aid.

[0092] The first wearable device and / or the second wearable device may be headphones.

[0093] The first wearable device and / or the second wearable device may be a headset.

[0094] The first wearable device and / or the second wearable device may be an ear protection device.

[0095] The first wearable device and / or the second wearable device may include a combination of hearing aids, headphones, headsets and / or ear protection devices.

[0096] The system may include a first hearing aid and / or a second hearing aid.

[0097] The first hearing aid may include a first physiological sensor.

[0098] The second hearing aid may include a second physiological sensor.

[0099] The first and / or second physiological sensors can be PPG sensors.

[0100] PPG sensors can provide non-invasive monitoring of hearing aid users' physiological parameters. PPG sensors are particularly useful for monitoring the hearing aid user's heart rate.

[0101] Each of the first and second hearing aids may include an antenna and transceiver circuitry for establishing a communication link to the other hearing aid, thereby enabling the exchange of information between the two hearing aids.

[0102] Therefore, the PTT value can be determined based on a first physiological sensor in the first hearing aid and a second physiological sensor in the second hearing aid. For example, the first and second hearing aids can be placed in the user's right and left ears, respectively.

[0103] Hearing aid

[0104] In one aspect of this application, a hearing aid is provided, configured to be worn by a user in or in the user's ear, or to be wholly or partially implanted in the user's head.

[0105] A hearing aid may include an input unit for receiving an input sound signal from the environment of the hearing aid user and providing at least one electrical input signal representing the input sound signal.

[0106] Hearing aids may include an output unit for providing a user with at least one set of stimuli that can be perceived as sound, based on a processed version of at least one electrical input signal.

[0107] Hearing aids may include an accelerometer. The accelerometer can be configured to detect movement of the hearing aid.

[0108] Hearing aids may include an SNR estimator for determining the SNR in the environment of the hearing aid (the hearing aid user).

[0109] The SNR estimator can determine the SNR based on a processed version of the at least one electrical input signal (e.g., provided by a processing unit).

[0110] The SNR estimator can determine the SNR based on at least one electrical input signal from the input unit.

[0111] An SNR estimator can determine the SNR based on at least one electrical input signal (such as its processed version) from at least one input converter, such as at least one microphone, of an input unit.

[0112] Hearing aids may include a processing unit.

[0113] The processing unit can be connected to the input unit.

[0114] The processing unit can be connected to the output unit.

[0115] The processing unit may include signal processing parameters of the hearing aid to provide a processed version of at least one electrical input signal.

[0116] The processing unit may include an SNR estimator.

[0117] The processing unit can be configured to determine whether the startup requirements are met.

[0118] Startup requirements can refer to one or more conditions that must be met. Therefore, startup requirements can refer to one or more thresholds, limits, boundaries, etc., that must be met before startup can occur.

[0119] The activation requirements may include the motion detected by the accelerometer being below a first motion threshold.

[0120] The first motion threshold can refer to the accelerometer not detecting, or detecting a limited amount of motion per unit of time, or only a limited scale / degree of motion. Detecting a limited scale or amount of motion would indicate that the hearing aid user is likely stationary or at least in a roughly the same area.

[0121] When no motion is detected, the accelerometer may be below the first motion threshold.

[0122] When less than 200 motion counts per minute are detected, the accelerometer may fall below the first motion threshold.

[0123] Startup requirements may include an SNR below the fourth threshold.

[0124] The fourth threshold can refer to a level where the signal power is at a level relative to the noise power in the hearing aid user's environment, such that the user cannot hear another person speaking clearly enough and / or the speech intelligibility is too low.

[0125] When the SNR is below 0dB, the SNR may be below the fourth threshold.

[0126] When the SNR is below -5dB, the SNR may be below the fourth threshold.

[0127] In response to meeting the activation requirements, the processing unit can be configured to change the mode of at least one PPG sensor of the hearing aid.

[0128] The processing unit is configured to automatically change the mode of the PPG sensor in response to meeting the startup requirements.

[0129] Advantageously, changing the mode of the PPG sensor or any other type of sensor can be done when the motion detected by the accelerometer is below a first threshold. For example, this could indicate that the hearing aid user is quite passive or standing still, so that the changes in the hearing aid user's heart rate are not caused by changes in the user's physical activity, but rather by changes in tension levels, concentration, etc.

[0130] The processing unit is configured to change the mode of at least one PPG sensor, which may include being configured to activate at least one PPG sensor.

[0131] The processing unit is configured to change the mode of at least one PPG sensor, which may include being configured to change the mode of at least one PPG sensor from a standby mode to an operating mode.

[0132] Hearing aids may include a switch configured to control changes in the mode of at least one PPG sensor.

[0133] The PPG sensor enables the hearing aid to activate and / or change / switch to its operating mode only in response to the fulfillment of activation requirements, thus minimizing the power consumption of the hearing aid. Minimizing the power consumption of the hearing aid is important for providing stable operation, as it allows the hearing aid to provide sufficient power for numerous signal processing tasks and a large number of sensors.

[0134] This allows the PPG sensor to be configured to shut down when startup requirements are not met, minimizing the power consumption of the PPG sensor.

[0135] This allows the PPG sensor to be configured to operate in standby mode when startup requirements are not met, minimizing power consumption. Simultaneously, the PPG sensor can quickly switch to operational mode once startup requirements are met. This rapid-start PPG sensor facilitates optimal signal processing and / or, when appropriate, detection and / or monitoring of the hearing aid user's physiological parameters.

[0136] In response to meeting the activation requirements, the processing unit can be configured to change the signal processing parameters of the hearing aid.

[0137] Changing the signal processing parameters of a hearing aid may include one or more of the following: increasing noise reduction, changing gain, changing directionality, and / or enhancing (such as spectral shaping).

[0138] When the startup requirements are not met, the processing unit can be configured to switch the mode of at least one PPG sensor to standby mode.

[0139] For example, when a hearing aid user is walking from one place to another, the activation requirements may no longer be met (the use of the PPG sensor may be inappropriate). Therefore, the mode of at least one PPG sensor can advantageously switch to a standby mode during walking to reduce power consumption, and based on the standby mode, it can be quickly restarted when the activation requirements are met (again).

[0140] When the startup requirements are not met, the processing unit can be configured to change the mode of at least one PPG sensor to a disabled mode.

[0141] For example, when startup requirements have not been met for an extended period, such as when user activity and / or SNR have been high for a prolonged period, at least one PPG sensor can be deactivated to reduce power consumption (compared to standby mode).

[0142] When the startup requirements are not met, the processing unit can be configured to keep the mode of at least one PPG sensor in standby mode.

[0143] For example, the PPG sensor can be kept in standby mode as long as the startup requirements are not met.

[0144] When the startup requirements are not met, the processing unit can be configured to keep the mode of at least one PPG sensor in the disabled mode.

[0145] For example, a PPG sensor can be kept in a disabled mode as long as the startup requirements are not met.

[0146] Hearing aids can be replaced by headphones.

[0147] Hearing aids can be replaced by headsets.

[0148] Hearing aids can be replaced by ear protection devices.

[0149] Hearing aids may consist of or may include a combination of hearing aids, headphones, headsets and / or ear protection devices.

[0150] In one aspect of this application, a binaural system is provided.

[0151] A binaural system may include two hearing aids as described above.

[0152] For example, one or both hearing aids may include an accelerometer, and one or both hearing aids may include at least one PPG sensor.

[0153] Each hearing aid may also include an antenna and transceiver circuitry for establishing a communication link to the other hearing aid. This enables the exchange of information between the two hearing aids. The information to be exchanged may include information about the corresponding PPG and / or accelerometer measurements and / or signal processing to be performed, such as based on the PPG and / or accelerometer measurements. The processing unit performing the signal processing may be one or both of the processing units of the two hearing aids in a binaural system.

[0154] Hearing aids may be adapted to provide frequency-varying gain and / or level-varying compression and / or frequency shifting (with or without frequency compression) from one or more frequency ranges to one or more other frequency ranges to compensate for a user's hearing loss. Hearing aids may include a signal processor for amplifying the input signal and providing a processed output signal.

[0155] Hearing aids may include an output unit for providing stimulation, perceived as an acoustic signal by a user, based on processed electrical signals. The output unit may include multiple electrodes of a cochlear implant (for CI-type hearing devices / aids) or a vibrator of a bone conduction hearing aid. The output unit may include an output transducer. The output transducer may include a receiver (speaker) for providing the stimulation as an acoustic signal to the user (e.g., in acoustic (air conduction-based) hearing aids). The output transducer may also include a vibrator for providing the stimulation as mechanical vibrations of the skull to the user (e.g., in bone-attached or bone-anchored hearing aids).

[0156] Hearing aids may include an input unit for providing an electrical input signal representing sound. The input unit may include an input transducer, such as a microphone, for converting the input sound into an electrical input signal. The input unit may include a wireless receiver for receiving wireless signals that include or represent sound and providing an electrical input signal representing said sound. The wireless receiver may, for example, be configured to receive electromagnetic signals in the radio frequency range (3 kHz to 300 GHz). The wireless receiver may, for example, be configured to receive electromagnetic signals in the optical frequency range (e.g., infrared light 300 GHz to 430 THz or visible light such as 430 THz to 770 THz).

[0157] Hearing aids may include directional microphone systems adapted to spatially filter sound from the environment, thereby enhancing a target sound source among multiple sound sources in the local environment of the hearing aid wearer. The directional system is adapted to detect (e.g., adaptive detection) the direction from which a specific portion of the microphone signal originates. This can be achieved, for example, in a variety of different ways described in the prior art. In hearing aids, microphone array beamformers are commonly used to spatially attenuate background noise sources. Many beamformer variations can be found in the literature. Minimum variance distortionless response (MVDR) beamformers are widely used in microphone array signal processing. Ideally, an MVDR beamformer keeps the signal from the target direction (also known as the line of sight) unchanged while attenuating sound signals from other directions to the greatest extent possible. A generalized sidelobe canceller (GSC) structure is an equivalent representation of an MVDR beamformer, offering computational and digital representation advantages over a direct implementation of the original form.

[0158] Hearing aids may include antennas and transceiver circuitry (such as a wireless receiver) for wirelessly receiving direct electrical input signals from another device, such as an entertainment device (e.g., a television), a communication device, a wireless microphone, or another hearing aid. The direct electrical input signal may represent or include audio signals and / or control signals and / or information signals. Hearing aids may include demodulation circuitry for demodulating the received direct electrical input signal, thereby providing a direct electrical input signal representing audio signals and / or control signals, such as for setting operating parameters (e.g., volume) and / or processing parameters of the hearing aid. Generally, the wireless link established by the antenna and transceiver circuitry of the hearing aid can be of any type. The wireless link is established between two devices / hearing aids, such as between an entertainment device (e.g., a TV) and a hearing aid, or between two hearing aids, such as via a third intermediary device (e.g., a processing device, such as a remote control, smartphone, etc.). The wireless link is used under power-limited conditions, for example because the hearing aid may constitute or include a portable (typically battery-powered) device. Wireless links are based on near-field communication, such as inductive links based on inductive coupling between the antenna coils of the transmitter and receiver. Wireless links can also be based on far-field electromagnetic radiation. Communication via a wireless link is arranged according to a specific modulation scheme, such as analog modulation schemes like FM (Frequency Modulation), AM (Amplitude Modulation), or PM (Phase Modulation), or digital modulation schemes like ASK (Amplitude Shift Keying) such as On-Key, FSK (Frequency Shift Keying), PSK (Phase Shift Keying) such as MSK (Minimum Frequency Shift Keying), or QAM (Quadrature Amplitude Modulation), etc.

[0159] Communication between the hearing aid and another device can be in baseband (audio frequency range, such as between 0 and 20 kHz). Preferably, the communication between the hearing aid and the other device is based on some type of modulation at a frequency higher than 100 kHz. Preferably, the frequency used to establish a communication link between the hearing aid and the other device is below 70 GHz, for example, in the range from 50 MHz to 70 GHz, for example, above 300 MHz, for example, in the ISM range above 300 MHz, for example, in the 900 MHz range, or in the 2.4 GHz range, or in the 5.8 GHz range, or in the 60 GHz range (ISM = Industrial, Scientific and Medical, such standardized ranges are defined, for example, by the International Telecommunication Union ITU). The wireless link is based on standardized or proprietary technologies. The wireless link is based on Bluetooth technology (such as Bluetooth Low Energy technology).

[0160] Hearing aids and / or communication devices may include electrically small antennas. In this specification, "electrically small antenna" means an antenna whose spatial extension (such as its maximum physical size in any direction) is much smaller than the wavelength λ of the transmitted electrical signal. Tx The spatial extension of the antenna is a factor of 10, 50, 100, or more, for example, 1000 or more, smaller than the carrier wavelength λ of the transmitted signal. Tx Hearing aids are relatively small devices. In this specification, "relatively small device" means that its maximum physical size (and therefore the maximum physical size of the antenna used to provide the wireless interface to the hearing aid) is less than 10 cm, such as less than 5 cm. In this specification, "relatively small device" can also mean that its maximum physical size is much smaller than the operating wavelength of the wireless interface to which the antenna is intended to connect (e.g., more than 3 times smaller, more than 10 times smaller, more than 20 times smaller) (ideally, an antenna used to radiate electromagnetic waves at a given frequency should be greater than or equal to half the wavelength of the radiated wave at that frequency). At 860 MHz, the vacuum wavelength is approximately 35 cm. At 2.4 GHz, the vacuum wavelength is approximately 12 cm. Hearing aids have a maximum external size in the 0.15 m class (e.g., a handheld mobile phone). Hearing aids have a maximum external size in the 0.08 m class (e.g., headphones). Hearing aids have a maximum external size in the 0.04 m class (e.g., hearing instruments).

[0161] Hearing aids can be portable (i.e., configured to be wearable) devices or integral to them, such as devices that include an internal power source, such as a battery, for example a rechargeable battery. Hearing aids can be, for example, lightweight, easy-to-wear devices, such as having a total weight of less than 100g.

[0162] Hearing aids may include a forward or signal path between an input unit (such as an input converter, for example a microphone or microphone system and / or a direct electrical input (such as a wireless receiver)) and an output unit such as an output converter. A signal processor is located in this forward path. The signal processor is adapted to provide frequency-varying gain according to the user's specific needs. Hearing aids may include an analysis path with functionalities for analyzing the input signal (such as determining level, modulation, signal type, acoustic feedback estimate, etc.). Some or all of the signal processing of the analysis path and / or signal path may be performed in the frequency domain. Some or all of the signal processing of the analysis path and / or signal path may be performed in the time domain.

[0163] Analog electrical signals representing sound signals can be converted into digital audio signals during analog-to-digital (AD) conversion, where the analog signal is sampled at a predetermined sampling frequency or sampling rate f. s Perform sampling, f s For example, in the range from 8kHz to 48kHz (to suit specific application needs) at discrete time points t n (or n) provides digital samples x n (or x[n]), each audio sample passes through a predetermined N b Bit represents the acoustic signal at t n The value of N at time b For example, in a range from 1 to 48 bits, such as 24 bits. Each audio sample therefore uses N. b Bit quantization (resulting in 2^n voltammetry of audio samples) Nb (Number of different possible values). The numerical sample x has 1 / f s The duration of the time, such as 50 μs, for f s =20kHz. Multiple audio samples can be arranged in time frames. A time frame can include 64 or 128 audio data samples. Other frame lengths can be used depending on the application.

[0164] Hearing aids may include analog-to-digital (AD) converters to digitize analog inputs (e.g., from an input converter such as a microphone) at a predetermined sampling rate such as 20 kHz. Hearing aids may also include digital-to-analog (DA) converters to convert digital signals into analog output signals, for example, for presentation to the user via an output converter.

[0165] Hearing aids, such as input units and / or antenna and transceiver circuitry, include a time-frequency (TF) conversion unit for providing a time-frequency representation of the input signal. The time-frequency representation may include an array or mapping of corresponding complex or real values ​​of the signal in question over a specific time and frequency range. The TF conversion unit may include a filter bank for filtering the (time-varying) input signal and providing multiple (time-varying) output signals, each output signal encompassing a distinctly different frequency range of the input signal. The TF conversion unit may include a Fourier transform unit for converting the time-varying input signal into a (time-varying) signal in the (time-frequency) domain. The hearing aid considers a frequency range starting from the minimum frequency f. min up to the maximum frequency f max The frequency range can include a portion of the typical human hearing range from 20Hz to 20kHz, such as a portion of the range from 20Hz to 12kHz. Typically, the sampling rate f... s Greater than or equal to the maximum frequency f max twice, that is, f s ≥2f max The signals from the forward and / or analysis pathways of the hearing aid can be divided into NI (e.g., uniformly wide) frequency bands, where NI is, for example, greater than 5, greater than 10, greater than 50, greater than 100, or greater than 500, and at least some of them are processed individually. The hearing aid is adapted to process the signals from the forward and / or analysis pathways (NP≤NI) in NP different channels. The channels can be of uniform or inconsistent width (e.g., width increases with frequency), overlapping or non-overlapping.

[0166] Hearing aids can be configured to operate in different modes, such as a normal mode and one or more specific modes, which may be user-selectable or automatically selectable. Operating modes can be optimized for specific acoustic conditions or environments. Operating modes may include low-power modes, where the hearing aid's functionality is reduced (e.g., for energy saving), such as disabling wireless communication and / or disabling specific features of the hearing aid.

[0167] Hearing aids may include multiple detectors configured to provide status signals relating to the hearing aid's current network environment (such as the current acoustic environment), and / or the current state of the user wearing the hearing aid, and / or the current state or operating mode of the hearing aid. Alternatively or additionally, one or more detectors may form part of an external device that communicates with the hearing aid (e.g., wirelessly). External devices may include, for example, another hearing aid, a remote control, an audio transmission device, a telephone (e.g., a smartphone), external sensors, etc.

[0168] One or more of a plurality of detectors can operate on a full-band signal (time domain). One or more of a plurality of detectors can operate on a band-split signal ((time-)frequency domain), for example, in a finite number of frequency bands.

[0169] Multiple detectors may include level detectors for estimating the current level of the signal in the forward path. Detectors may be configured to determine whether the current level of the signal in the forward path is above or below a given (L-) threshold. Level detectors operate on full-band signals (time domain). Level detectors operate on band-split signals ((time-)frequency domain).

[0170] Hearing aids may include a voice activity detector (VAD) for estimating whether (or with what probability) an input signal (at a specific point in time) includes a voice signal. In this specification, a voice signal includes speech signals from humans. It may also include other forms of vocalization produced by the human speech system (such as singing). The voice activity detector unit is adapted to classify the user's current acoustic environment as a "voice" or "no-voice" environment. This has the advantage that time periods including electrophonic signals of human vocalizations (such as speech) in the user's environment can be identified and thus separated from time periods that include only (or primarily) other sound sources (such as artificially generated noise). The voice activity detector may be adapted to also detect the user's own voice as "voice." Alternatively, the voice activity detector may be adapted to exclude the user's own voice from the detection of "voice."

[0171] Hearing aids may include a self-voice detector for estimating whether (or with what probability) a particular input sound (such as speech) originates from the user of the hearing aid system. The microphone system of the hearing aid may be adapted to distinguish between the user's own voice and the voice of another person, and possibly between the user's own voice and non-voice sounds.

[0172] Multiple detectors may include motion detectors, such as accelerometers. The motion detectors are configured to detect movements of the user's facial muscles and / or bones, such as those caused by speech or chewing (e.g., jaw movements), and provide detector signals that identify the movements.

[0173] The hearing aid may include a classification unit configured to classify the current situation based on input signals from (at least partially) a detector and possibly other inputs. In this specification, "current situation" is defined by one or more of the following:

[0174] a) Physical environment (including the current electromagnetic environment, such as the presence of electromagnetic signals (including audio and / or control signals) that are planned or unplanned to be received by the hearing aid, or other properties of the current environment that are different from acoustics);

[0175] b) Current acoustic conditions (input level, feedback, etc.); and

[0176] c) The user's current mode or state (movement, temperature, cognitive load, etc.);

[0177] d) The current mode or state of the hearing aid and / or another device communicating with the hearing aid (selected program, time elapsed since the last user interaction, etc.).

[0178] The classification unit may be based on or include a neural network, such as a trained neural network.

[0179] Hearing aids may include acoustic (and / or mechanical) feedback control (such as suppression) or echo cancellation systems. Acoustic feedback occurs when the output speaker signal from an audio system that amplifies the signal picked up by the microphone returns to the microphone via an acoustic coupling section through air or other media. This portion of the speaker signal returning to the microphone is then amplified again by the audio system before reappearing at the speaker, and returns to the microphone again. As this cycle continues, the acoustic feedback effect becomes audible, such as unnatural signals or even worse, howling, when the audio system becomes unstable. This problem typically arises when the microphone and speaker are placed close together, such as in hearing aids or other audio systems. Some other typical applications with feedback problems include telephone systems, broadcast systems, headsets, audio conferencing systems, etc. Adaptive feedback cancellation is capable of tracking changes in the feedback path over time. It estimates the feedback path based on a linear time-invariant filter, but its filter weights are updated over time. The filter updates can be computed using stochastic gradient algorithms, including some form of least mean square (LMS) or normalized LMS (NLMS) algorithms. They all have the property of minimizing the mean square of the error signal, and NLMS further normalizes the filter update with respect to the square of the Euclidean norm of some reference signal.

[0180] The feedback control system may include a feedback estimation unit for providing a feedback signal representing an estimate of the acoustic feedback path, and a combination unit, such as a subtraction unit, for subtracting the feedback signal from a signal in the forward path (e.g., picked up by an input converter of a hearing aid). The feedback estimation unit may include an update section comprising an adaptive algorithm and a variable filter section for filtering the input signal according to variable filter coefficients determined by the adaptive algorithm, wherein the update section is configured to update at a configurable update frequency f. upd Update the filter coefficients of the variable filter section. The hearing aid is configured such that the configurable update frequency f upd It has a maximum value f upd,max Maximum value f upd,max The sampling frequency f of the AD converter for the hearing aid s A small part (f upd,max =f s / D).

[0181] The updating section of the adaptive filter may include an adaptive algorithm for calculating updated filter coefficients and passing them to the variable filter section of the adaptive filter. The calculation of the updated filter coefficients and / or the timing of their transmission from the updating section to the variable filter section may be controlled by a start control unit. The timing of the updates (e.g., their specific time points and / or their update frequency) is preferably influenced by multiple different characteristics of the signal in the forward path. The update control scheme is preferably supported by one or more detectors of the hearing aid, and is preferably included in a predetermined criterion containing detector signals.

[0182] Hearing aids may also include other suitable functions for the application in question, such as compression and noise reduction.

[0183] Hearing aids may be replaced by hearing devices, which may include hearing devices such as hearing aids, hearing instruments, such as hearing instruments adapted to be located at the user's ear or wholly or partially in the ear canal, such as headphones, headsets, ear protection devices, or combinations thereof. Hearing aid systems may include loudspeaker amplifiers (including multiple input converters and multiple output converters, for example, for use in audio conferencing situations), and may include beamforming filter units, for example, providing multiple beamforming capabilities.

[0184] Application

[0185] On the one hand, applications of the hearing aids as described above, in detail in the "Detailed Description" section, and as defined in the claims are provided. Applications can be provided in systems including audio distribution. Applications can be provided in systems including one or more hearing aids (hearing instruments), headphones, headsets, active ear protection systems, etc., for example, in hands-free telephone systems, teleconferencing systems (e.g., including loudspeaker amplifiers), broadcasting systems, karaoke systems, classroom amplification systems, etc.

[0186] Method

[0187] In one aspect of this application, a method is provided for operating a system including a hearing aid based on an estimate of the current hearing effort of the hearing aid user.

[0188] The method may include receiving an input sound signal from the environment of the hearing aid user via an input unit and providing at least one electrical input signal representing the input sound signal.

[0189] The method may include providing a hearing aid user with at least one set of stimuli that can be perceived as sound via an output unit based on a processed version of at least one electrical input signal.

[0190] The method may include determining the signal-to-noise ratio (SNR) in the environment of the hearing aid user using an SNR estimator.

[0191] The method may include providing a processed version of at least one electrical input signal through a processing unit connected to the input unit and the output unit and including signal processing parameters of the system.

[0192] The method may include storing a reference set of the hearing aid user's SNR and pulse delivery time (PTT) via a memory unit.

[0193] The method may include providing at least first and second physiological sensors.

[0194] The method may include determining a first time point corresponding to a first maximum uplink point of a first measured parameter based on a first physiological sensor.

[0195] The method may include determining a second time point corresponding to a second maximum uplink point of a parameter of a second measurement based on a second physiological sensor.

[0196] The method may include determining the current PTT by calculating the time difference between a first time point and a second time point.

[0197] This method may include determining the hearing aid user's current hearing effort based on the current PTT and a stored SNR and PTT reference set.

[0198] In one aspect of this application, a method of operating a system is provided, which is based on an estimate of the current hearing effort of a hearing aid user monitored by a first physiological sensor and a second physiological sensor.

[0199] The method may include determining a first time point corresponding to a first maximum uplink point of a first measured parameter based on a first physiological sensor.

[0200] The method may include determining a second time point corresponding to a second maximum uplink point of a parameter of a second measurement based on a second physiological sensor.

[0201] The method may include determining the current PTT by calculating the time difference between a first time point and a second time point.

[0202] The method may include determining the current hearing difficulty region based on the current PTT as a function of the signal-to-noise ratio (SNR), wherein four hearing difficulty regions are defined.

[0203] The first region can be defined as having an SNR higher than the first SNR threshold and a PTT higher than the first PTT threshold.

[0204] The second region can be defined as having an SNR that is lower than the first SNR threshold but higher than the second SNR threshold and a PTT that is lower than the first PTT threshold.

[0205] The third region can be defined as having an SNR that is lower than the second SNR threshold but higher than the third SNR threshold and a PTT that is lower than the first PTT threshold.

[0206] The fourth region can be defined as having an SNR lower than the third SNR threshold and a PTT higher than the first PTT threshold.

[0207] The system can be configured to operate in a first listening mode when the current hearing difficulty region is in a first region, in a second listening mode when the current hearing difficulty region is in a second region, in a third listening mode when the current hearing difficulty region is in a third region, and in a fourth listening mode when the current hearing difficulty region is in a fourth region.

[0208] When appropriately replaced by a corresponding process, some or all of the structural features of the hearing aid described above, in detail in the "Detailed Description," or as defined in the claims can be combined with the implementation of the method of the present invention, and vice versa. The implementation of the method has the same advantages as the corresponding hearing aid.

[0209] Computer readable medium or data carrier

[0210] The present invention further provides a tangible computer-readable medium (data carrier) storing a computer program including program code (instructions), which, when the computer program is run on a data processing system (computer), causes the data processing system to perform (implement) at least some (such as most or all) of the steps of the methods described above, in detail in the "Detailed Description" and as defined in the claims.

[0211] By way of example, but not limitation, the aforementioned tangible computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to execute or store required program code in the form of instructions or data structures and is accessible by a computer. As used herein, disks include compact discs (CDs), laser discs, optical discs, digital multipurpose discs (DVDs), floppy disks, and Blu-ray discs, wherein these disks typically magnetically copy data while simultaneously being optically copied using lasers. Other storage media include those stored in DNA (e.g., in synthetic DNA strands). Combinations of the aforementioned disks should also be included within the scope of computer-readable media. In addition to being stored on tangible media, computer programs may also be transmitted via transmission media such as wired or wireless links or networks such as the Internet and loaded into data processing systems to run at locations other than tangible media.

[0212] Computer program

[0213] In addition, this application provides a computer program (product) including instructions that, when run by a computer, cause the computer to perform the steps of the methods (methods) described above, in detail in the "Detailed Description" section, and as defined in the claims.

[0214] Data processing system

[0215] In one aspect, the present invention further provides a data processing system, including a processor and program code, the program code causing the processor to perform at least some (such as most or all) of the steps of the methods described above, in detail in the "Detailed Description" section, and as defined in the claims.

[0216] Hearing system

[0217] On the other hand, hearing aids and hearing systems including assistive devices are provided, including those described above, described in detail in the "Detailed Description" section, and defined in the claims.

[0218] Hearing systems are adapted to establish communication links between hearing aids and assistive devices so that information (such as control and status signals, and possibly audio signals) can be exchanged or forwarded from one device to another.

[0219] Auxiliary devices may include remote controls, smartphones, or other portable or wearable electronic devices such as smartwatches.

[0220] The assistive device may consist of or include a remote control for controlling the functions and operation of the hearing aid. The remote control functionality is implemented in a smartphone, which may run an app that enables control of the audio processing device via the smartphone (the hearing aid includes a suitable wireless interface to the smartphone, such as Bluetooth or some other standardized or proprietary solution).

[0221] The assistive device may be constituted by or include an audio gateway device, which is adapted to receive multiple audio signals (e.g., from an entertainment device such as a TV or music player, from a telephone device such as a mobile phone, or from a computer such as a PC) and to select and / or combine appropriate signals (or combinations of signals) from the received audio signals to transmit to the hearing aid.

[0222] The assistive device may consist of or include another hearing aid. The hearing system may include two hearing aids suitable for implementing a binaural hearing system, such as a binaural hearing aid system.

[0223] For example, a hearing system may include assistive devices, such as wearable devices configured to determine the PTT and provide the determined PTT to the hearing aid.

[0224] PPG measurements are highly energy-intensive and can have a significant impact on hearing aid battery life. High energy consumption may be caused by continuous data acquisition and processing, as well as the power supply to the LEDs used for illumination and sensing blood flow.

[0225] Therefore, for example, the asymmetry of computing and energy resources in Body Area Networks can be leveraged to allow continuous data acquisition and processing, as well as LED power supply, to be delegated to other wearable devices (such as smartwatches) and provided to the hearing aid via a common gateway (such as a mobile phone). PTT determination can then be completely offloaded to the wearable device and used as input to the hearing aid, or determined collaboratively, such that PTT is determined via electrical measurement of the pulse at the wearable device and via a PPG sensor at the hearing aid (or vice versa), assuming synchronized measurements (see below). This enables PTT determination in several configurations: two hearing aids and one wearable device, or one hearing aid and one wearable device.

[0226] Furthermore, PTT measurements performed by hearing aids can be complementary to measurements from a second source, such as assistive devices (e.g., wearable devices). This increases the robustness of the measurements and simplifies signal processing.

[0227] For example, PPG sensors may appear in many other wearable products, such as smartwatches. The different body positions of other PPG-capable wearables make them ideal for acquiring additional PTT measurements aimed at determining hearing effort. However, a challenge here may be time synchronization between readings taken across wearable devices. Time synchronization can be achieved using the new Bluetooth Low Energy (BLE) service. This requires implementing BLE service in the peripheral device performing data acquisition (i.e., hearing aids and smartwatches) and in a BLE host (such as the user's mobile phone), which provides host recording of time to synchronize measurement results.

[0228] For example, possible synchronization methods between hearing aids and / or assistive devices may include:

[0229] - PPG sensor in synchronized hearing aids: By using an existing near link (NL) system embedded in the hearing aid, the maximum deviation between hearing aids will be between 10 and 100 microseconds. This provides a sufficiently accurate common time record for PTT measurements;

[0230] - Synchronizing PPG sensors in hearing aids and wearable devices: To synchronize PPG measurements from hearing aids and wearable devices, clock synchronization can be implemented via BLE services mentioned above (such as CheepSync5 or similar technologies). The maximum time deviation using these specific technologies can be as low as 10 microseconds.

[0231] App

[0232] On the other hand, the present invention also provides a non-transitory application called an APP. The APP includes executable instructions configured to run on an assistive device to implement a user interface for the hearing aid or hearing system described above, in detail in the "Detailed Description," and as defined in the claims. The APP is configured to run on a mobile phone, such as a smartphone, or another portable device enabled to communicate with said hearing aid or hearing system.

[0233] Definition

[0234] In this specification, "hearing device" refers to a device suitable for improving, enhancing, and / or protecting a user's hearing ability, such as a hearing aid (e.g., a hearing instrument), an active ear protection device, or other audio processing device, which achieves this by receiving sound signals from the user's environment, generating corresponding audio signals, possibly modifying the audio signals, and providing the possibly modified audio signals as audible signals to at least one ear of the user. "Hearing device" can also refer to a device suitable for electronically receiving audio signals, possibly modifying the audio signals, and providing the possibly modified audio signals as audible signals to at least one ear of the user, such as a headset or headphones. The audible signals can be provided, for example, as sound signals radiated into the user's outer ear, sound signals transmitted as mechanical vibrations through the bone structures of the user's head and / or through parts of the middle ear to the user's inner ear, and electrical signals transmitted directly or indirectly to the user's cochlear nerve.

[0235] Hearing aids can be configured to be worn in any known manner, such as as a unit worn behind the ear (having a tube that directs radiated sound signals into the ear canal or having an output transducer, such as a speaker, arranged close to or located within the ear canal), as a unit wholly or partially arranged in the auricle and / or ear canal, as a unit connected to a fixed structure implanted in the skull, such as a vibrator, or as a connectable unit that is wholly or partially implanted. Hearing aids may include a single unit or several units that communicate with each other (e.g., acoustically, electrically, or optically). The speaker may be housed within the housing along with other components of the hearing aid, or it may be an external unit (possibly combined with a flexible guiding element such as a dome-shaped element).

[0236] More generally, a hearing aid includes an input transducer for receiving sound signals from the user's environment and providing a corresponding input audio signal, and / or a receiver for receiving the input audio signal electronically (i.e., wired or wirelessly); signal processing circuitry (typically configurable) for processing the input audio signal (such as a signal processor, for example including a configurable (programmable) processor, such as a digital signal processor); and an output unit for providing an audible signal to the user based on the processed audio signal. The signal processor may be adapted to process the input signal in the time domain or in multiple frequency bands. In some hearing aids, amplifiers and / or compressors may constitute the signal processing circuitry. The signal processing circuitry typically includes one or more (integrated or separate) storage elements for executing programs and / or for storing parameters used (or potentially used) in the processing and / or for storing information suitable for the hearing aid's functionality and / or for storing information used, for example, in conjunction with an interface to the user and / or an interface to a programming device (such as processed information, for example, provided by the signal processing circuitry). In some hearing aids, the output unit may include an output transducer, such as a loudspeaker for providing airborne sound signals or a vibrator for providing sound signals propagating through structures or fluids. In some hearing aids, the output unit may include one or more output electrodes for providing electrical signals to electrically stimulate the cochlear nerve (e.g., to a multi-electrode array) (cochlear implant hearing aids). Hearing aids may include a loudspeaker amplifier (including multiple input converters and multiple output converters), for example, in audio conferencing scenarios.

[0237] In some hearing aids, the vibrator may be adapted to transmit structurally propagated sound signals to the skull transdermally or through the skin. In some hearing aids, the vibrator may be implanted in the middle ear and / or inner ear. In some hearing aids, the vibrator may be adapted to provide structurally propagated sound signals to the middle ear bones and / or cochlea. In some hearing aids, the vibrator may be adapted to provide fluid-propagated sound signals to the cochlear fluid, for example, through the oval window. In some hearing aids, the output electrode may be implanted in the cochlea or on the medial side of the skull and may be adapted to provide electrical signals to the hair cells of the cochlea, one or more auditory nerves, the auditory brainstem, the auditory midbrain, the auditory cortex, and / or other parts of the cerebral cortex.

[0238] Hearing devices, such as hearing aids, can be adapted to the specific needs of users, such as those with hearing loss. The configurable signal processing circuitry of a hearing aid can be adapted to apply frequency- and level-variable compression and amplification of the input signal. Customized frequency- and level-variable gain (amplification or compression) can be determined during the fitting process by the fitting system based on the user's hearing data, such as an audiogram, using basic fitting principles (e.g., speech adaptation). This frequency- and level-variable gain can be reflected, for example, in processing parameters, uploaded to the hearing aid via an interface to a programming device (fitting system), and used by a processing algorithm executed by the hearing aid's configurable signal processing circuitry.

[0239] A “hearing system” refers to a system that includes one or two hearing aids. A “binaural hearing system” refers to a system that includes two hearing aids and is adapted to work together to provide audible signals to both of a user’s ears. A hearing system or a binaural hearing system may also include one or more “assistive devices” that communicate with the hearing aids and influence and / or benefit from the functionality of the hearing aids. The aforementioned assistive devices may include at least one of the following: a remote control, a remote microphone, an audio gateway device, an entertainment device such as a music player, a wireless communication device such as a mobile phone (e.g., a smartphone), or a tablet computer, or another device, such as one that includes a graphical interface. Hearing aids, hearing systems, or binaural hearing systems may be used, for example, to compensate for hearing loss in individuals with hearing impairments, enhance or protect the hearing ability of individuals with normal hearing, and / or transmit electronic audio signals to individuals. Hearing aids or hearing systems may, for example, be part of or interact with broadcasting systems, active ear protection systems, hands-free telephone systems, car audio systems, entertainment systems (such as TV, music playback, or karaoke), teleconferencing systems, classroom amplification systems, etc. Attached Figure Description

[0240] Various aspects of the invention will be best understood from the following detailed description taken in conjunction with the accompanying drawings. For clarity, these drawings are schematic and simplified, showing only the details necessary for understanding the invention while omitting other details. Throughout the specification, the same reference numerals are used for the same or corresponding parts. Features of each aspect may be combined with any or all features of other aspects. These and other aspects, features, and / or technical effects will be apparent from and illustrated in the following figures, wherein:

[0241] Figure 1A Exemplary application scenarios of the system according to the present invention are shown;

[0242] Figure 1B An exemplary ear-to-ear determination of the system according to the present invention is shown;

[0243] Figure 2 An exemplary PTT monitoring of hearing effort based on the system according to the present invention is shown;

[0244] Figure 3 An exemplary flowchart illustrating an application scenario of the system according to the present invention is shown;

[0245] Figure 4A A Poincaré diagram illustrating an exemplary application scenario of the system according to the present invention is shown;

[0246] Figure 4B Exemplary application scenarios of the system according to the present invention are shown;

[0247] Figure 4CThe spectrum of exemplary application scenarios of the system according to the present invention is shown.

[0248] The further applicability of the invention will become apparent from the detailed description given below. However, it should be understood that while the detailed description and specific examples illustrate preferred embodiments of the invention, they are given for illustrative purposes only. Other embodiments of the invention will become apparent to those skilled in the art based on the following detailed description. Detailed Implementation

[0249] The detailed description below, taken in conjunction with the accompanying drawings, serves as a description of various different configurations. This detailed description includes specific details to provide a thorough understanding of several different concepts. However, it will be apparent to those skilled in the art that these concepts can be implemented without these specific details. Several aspects of the apparatus and method are described by various different blocks, functional units, modules, elements, circuits, steps, processes, algorithms, etc. (collectively, “elements”). Depending on the specific application, design constraints, or other reasons, these elements may be implemented using electronic hardware, computer programs, or any combination thereof.

[0250] Electronic hardware may include microelectromechanical systems (MEMS), (e.g., application-specific integrated circuits), microprocessors, microcontrollers, digital signal processors (DSPs), field-programmable gate arrays (FPGAs), programmable logic devices (PLDs), gating logic, discrete hardware circuits, printed circuit boards (PCBs) (e.g., flexible PCBs), and other suitable hardware configured to perform the various functions described in this specification, such as sensors for sensing and / or recording the physical properties of the environment, devices, users, etc. Computer programs should be interpreted broadly as instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, programs, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description languages, or other names.

[0251] Figure 1A An exemplary application scenario of the system according to the present invention is shown.

[0252] exist Figure 1A The image shows a hearing aid user 1. The hearing aid user 1 is wearing a system 2 (such as a hearing aid system). Figure 1A System 2 includes a first hearing aid 3 in the right ear and a second hearing aid 4 in the left ear. However, it is also foreseeable that it may include systems such as assistive devices or systems that include only one hearing aid and one or more assistive devices.

[0253] The first hearing aid 3 and the fourth hearing aid 4 can be configured to be worn by the user 1 in or in the ear of the user 1, or to be completely or partially implanted in the head of the hearing aid user 1.

[0254] The first hearing aid 3 and the fourth hearing aid 4 may include an input unit (not shown) for receiving an input sound signal from the environment of the hearing aid user 1 and providing at least one electrical input signal representing the input sound signal.

[0255] The first hearing aid 3 and the fourth hearing aid 4 may include an output unit (not shown) for providing at least one set of stimuli that can be perceived as sound to the hearing aid user 1 based on a processed version of at least one electrical input signal.

[0256] Each of the first hearing aid 3 and the fourth hearing aid 4 may include signal processing units 5 and 6, respectively. Signal processing units 5 and 6 may be connected to the input unit and the output unit and include the signal processing parameters of system 2 to provide a processed version of at least one electrical input signal.

[0257] Each of the first hearing aid 3 and the fourth hearing aid 4 may include an SNR estimator (not shown) for determining the SNR in the environment of system 2.

[0258] Each of the first hearing aid 3 and the fourth hearing aid 4 may include a memory unit (not shown) configured to store a reference set of the hearing aid user 1's SNR and PTT.

[0259] However, it is foreseeable that only one of the first and second hearing aids 3 and 4 includes a processing unit, an SNR estimator, and / or a memory unit.

[0260] For example, the processing unit, SNR estimator, and / or memory unit may include signal processing parameters, a reference set for determining SNR, and a reference set for storing SNR and PTT for the first hearing aid 3 and the second hearing aid 4, respectively.

[0261] The first hearing aid 3 or the second hearing aid 4 may include a physiological sensor.

[0262] Each of the first hearing aid 3 and the second hearing aid 4 may include a physiological sensor.

[0263] For example, physiological sensors can refer to ECG sensors, PPG sensors, and / or EEG sensors.

[0264] When hearing aid user 1 wears system 2, the physiological sensor can be configured to make contact with the skin of the external ear canal of hearing aid user 1.

[0265] exist Figure 1A In the diagram, the first hearing aid 3 and the second hearing aid 4 are shown, each including PPG sensors 7 and 8 respectively.

[0266] The first hearing aid 3 or the second hearing aid 4 may include a synchronization unit.

[0267] Each of the first hearing aid 3 and the second hearing aid 4 may include a synchronization unit.

[0268] exist Figure 1A In the diagram, the first hearing aid 3 and the second hearing aid 4 are shown, each including synchronization units 9 and 10 respectively.

[0269] The audio synchronization achieved by the synchronization units 9 and 10 across the first hearing aid 3 and the second hearing aid 4 can be used to synchronize two PPG signals, since the sampling rate of these PPG signals can be ~250Hz.

[0270] Each of the first hearing aid 3 and the second hearing aid 4 may include an antenna (not shown) and transceiver circuitry (not shown) for establishing a (wired or wireless) communication link 11 to the other hearing aid, thereby enabling the exchange of information between the two hearing aids 3 and 4.

[0271] Therefore, such as Figure 1A As shown, system 2 can be configured to determine the heartbeat of user 1's heart 12 via the PPG sensor 7 of the first hearing aid 3. Additionally, system 2 can be configured to determine the heartbeat of user 1's heart 12 via the PPG sensor 8 of the second hearing aid 4.

[0272] For example, when system 2 includes an ECG sensor for determining the heartbeat of user 1's heart 12, PTT can be determined based on each of PPG sensors 7 and 8, namely the first PTT 13 and the second PTT 14.

[0273] Based on the PPG sensor 7 of the first hearing aid 3 and the PPG sensor 8 of the second hearing aid 4, the system 2 can be configured to determine the ear-to-ear PTT 15, which is the time delay of the arrival of the pulse between the two ears of the hearing aid user 1.

[0274] Figure 1B An exemplary ear-to-ear determination of the system according to the present invention is shown.

[0275] exist Figure 1B The diagram shows a portion of PPG (amplitude as a function of time) 16 determined by the PPG sensor 7 of the first hearing aid 3 and a portion of PPG 17 determined by the PPG sensor 8 of the second hearing aid 4.

[0276] The required ear-to-ear PTT (BinPTT) can be determined in a variety of different ways.

[0277] In the first approach (as indicated), the time delay between the first time point corresponding to the first maximum uplink point 16A of the first measured parameter (determined by the PPG sensor 7 of the first hearing aid 3) and the second time point corresponding to the second maximum uplink point 17A of the second measured parameter (determined by the PPG sensor 8 of the second hearing aid 4) can be the desired ear-to-ear PTT.

[0278] In the second approach, the time delay between the cardiac contraction (maximum) point 16B determined by the PPG sensor 7 of the first hearing aid 3 and the cardiac contraction (maximum) point 17B determined by the PPG sensor 8 of the second hearing aid 4 can be the desired ear-to-ear PTT.

[0279] In the third approach, the time delay between the lowest point 16C of the amplitude determined by the PPG sensor 7 of the first hearing aid 3 and the lowest point 17C of the amplitude determined by the PPG sensor 8 of the second hearing aid 4 can be the desired ear-to-ear PTT.

[0280] Figure 2 An exemplary PTT monitoring of hearing effort based on the system according to the present invention is shown.

[0281] exist Figure 2 In this context, PTT is shown as a function of SNR level.

[0282] To test speech in the presence of noise, an experiment was designed to estimate hearing effort based on physiological sensor data. Test subjects had ECG and PPG sensors implanted in their ears and glasses to capture pupil dilation.

[0283] In this experiment, two reference measures of hearing effort were recorded: pre-ejection phase (PEP)[2] and pupillary dilation[3]. PEP can be defined as the time delay between the Q point of the ECG and the B point of the impedance cardiography (ICG) signal.

[0284] Pupil dilation is the gold standard for estimating auditory effort, and therefore can be a reference for any physiological measurement that can be interpreted as an auditory effort result. Similarly, PEP, a purely sympathetic measure of heart rate, is also related to auditory effort.

[0285] It has been found that ear-level PTT is correlated with hearing effort when assessed based on corresponding pupillary dilation and PEP.

[0286] When hearing conditions are very difficult (SNR below 0dB), both PEP and pupil dilation measure show a maximum effort of about 0dB and "give up".

[0287] By analyzing individual hearing aid user profiles based on PTT-SNR within the system, it may be possible to monitor, for example...Figure 2 The "abandon" point is shown in the image.

[0288] This analysis can be used in at least two ways.

[0289] In the first approach, if the user has passed the give-up point (when the SNR is lower than the user's desired effort), the system processing unit can be configured to reduce the listening effort required by the hearing aid user. For example, the processing unit can apply beamforming or noise reduction (e.g., using machine learning, such as deep neural networks, to provide separation of noise and speech).

[0290] In the second approach, if the user has spent a long time “giving up” on SNR, the system (such as the processing unit) can provide suggestions on what to do (e.g., coping with known strategies for moving to a better SNR region, which can be estimated based on input from the direction of sound arrival, the signal strength received in the hearing aid antenna, and the magnetic field map, where the hearing aid is less affected by magnetic interference).

[0291] exist Figure 2 The diagram illustrates how to determine the current listening effort. Determining the current listening effort may include identifying the current area of ​​difficulty in listening.

[0292] Four regions with hearing difficulties can be defined.

[0293] The first hearing difficulty region can be defined as having an SNR higher than a first SNR threshold of 18 and a PTT higher than a first PTT threshold of 19. For example, in the first region, the PTT can decrease as a function of the decreasing SNR. The first region can indicate that the hearing aid user is providing only a small amount of hearing effort because of the high SNR.

[0294] The second hearing difficulty region can be defined as having an SNR below the first SNR threshold of 18 but above the second SNR threshold of 20, and a PTT below the first PTT threshold of 19. For example, in the second region, the PTT can decrease as a function of the decreasing SNR. The second region can indicate the increasing effort the hearing aid user makes to hear.

[0295] The third hearing difficulty region can be defined as having an SNR below the second SNR threshold 20 but above the third SNR threshold 21 and a PTT below the first PTT threshold 19. For example, in the third region, the PTT can increase as a function of decreasing SNR. The third region can indicate that the hearing aid user is beginning to withdraw and provides decreasing hearing effort.

[0296] The fourth hearing difficulty region can be defined as having an SNR below the third SNR threshold of 21 and a PTT above the first PTT threshold of 19. For example, in the fourth region, the PTT can increase as a function of decreasing SNR. The fourth region can indicate that the hearing aid user has completely discontinued the activity and provides the minimum effort required to hear.

[0297] The system (processing unit) can be configured to be in a first listening mode when the current hearing difficulty region is in a first region, in a second listening mode when the current hearing difficulty region is in a second region, in a third listening mode when the current hearing difficulty region is in a third region, and in a fourth listening mode when the current hearing difficulty region is in a fourth region.

[0298] Figure 3 An exemplary flowchart illustrating an application scenario of the system according to the present invention is shown.

[0299] Another technique to reduce sensor power consumption over time is to activate the PPG sensor only when an event is expected to be sensed (in this case, a point in the PPG reading related to the PTT measurement, an uphill point). Between successive readings, the PPG sensor can be completely off or in a low-power mode (if the sensor offers this mode). Naturally, since the hearing aid user's heart rate varies over time due to different physiological factors, this "sleep window" must be adjusted accordingly to avoid missing relevant measurement points.

[0300] Furthermore, power consumption can be reduced by determining the PTT only periodically, rather than for every heartbeat. Applying this additional power reduction strategy to... Figure 3 The flowcharts shown in the diagrams have requirements for the accuracy and resolution of the corresponding algorithms.

[0301] In step S1, the system can determine whether the hearing aid user is stationary using at least one accelerometer; in other words, whether the hearing aid user is standing still or has moved less than a predetermined threshold (such as a first motion threshold). If not, step S1 can be repeated (e.g., at predetermined time intervals).

[0302] In step S2, the system can determine whether the environment in which the hearing aid user is located is a difficult hearing situation (e.g., SNR is below a threshold (e.g., 0 dB)) by at least one SNR estimator (e.g., by the microphone of at least one input unit). If not, step S2 can be repeated (e.g., at predetermined time intervals).

[0303] If steps S1 and S2 are satisfied, the system can be configured to activate (or maintain the already activated) at least the first and second physiological sensors. Thus, in step S3, the system can determine the hearing aid user's ear-to-ear PTT and current hearing effort.

[0304] In step S4, based on the current hearing effort, the system can adjust or maintain the signal processing parameters of the system's processing unit (according to the current signal processing parameters). For example, steps S1, S2, S3, and S4 can be repeated after a predetermined time interval.

[0305] If the first step S1 and / or the second step S2 are not satisfied, the system may be configured to change the activation mode of at least the first and second physiological sensors (e.g., deactivate the sensors that have already been activated).

[0306] Figure 4A , 4B Figures 4C illustrate exemplary application scenarios of the system according to the present invention.

[0307] If there is a reliable way to automatically detect the increased listening effort of a hearing aid user, such as when he / she tries to keep up with a conversation in a difficult sound environment, the hearing aid (system) software (or connected smartphone app) can help the user by dynamically adjusting hearing aid parameters (signal processing parameters).

[0308] The solution can be based on different combinations of inputs and on the known correlation between stress / effort and heart rate changes: if the end user (such as a hearing aid user) is under stress / effort, it may be possible to analyze the end user's heart rate changes and determine the stress index.

[0309] Pulse rate and heart rate variability can be measured using hearing aids, for example, with the aid of optical sensors (such as in-ear PPG sensors) placed in the hearing aid speaker unit. Alternatively, heart rate and heart rate variability can also be measured using an accelerometer placed in the hearing aid. However, it should be noted that measuring heart rate variability with an accelerometer is more prone to detecting unnatural motion signals than using a pulse oximeter.

[0310] Acute stress can have many different causes, and auditory effort is one of them. For example, a person might be trying to solve a math problem, going through a job interview, or giving a public speech. In some cases, the degree of acute stress can be estimated by investigating the end-user's autonomic nervous system (ANS) activity.

[0311] We can estimate the ANS activity of end users by analyzing heart rate variability (HRV).

[0312] ANS branches: The sympathetic nervous system (SNS) and parasympathetic nervous system (PNS) are responsible for sympathetic-vagal balance [4]. The dynamics of heart rate are affected by the activity of the SNS and PNS. Therefore, HRV signal may be a good indicator of ANS activity and can also reflect a stress state.

[0313] HRV can be analyzed in the time and frequency domains to quantify SNS and PNS estimators and implicitly estimate stress.

[0314] Temporal characteristics:

[0315] In the time domain, Poincaré plotting analysis is a geometric and nonlinear method for evaluating the dynamics of HRV. In this plot, the continuous heart rate is drawn, resulting in a point cloud. The point cloud is then plotted as an ellipse, the width of which is a measure of short-term variation, reflecting the effects of the parasympathetic nervous system. The length of the ellipse is known as the total variation.

[0316] SD is the standard deviation operator. SD1 and SD2 are calculated using [5]:

[0317]

[0318]

[0319] During periods of stress, the effects of the parasympathetic nervous system are suppressed, and the effects of the sympathetic nervous system become dominant. Therefore, the width of the Poincaré diagram will decrease during periods of stress.

[0320] exist Figure 4A The diagram shows an illustrative example of a Poincaré plot. The X-axis shows the interval between two consecutive heartbeats at time k, and the Y-axis shows the interval between consecutive heartbeats at time k+1 (RR is the time interval between consecutive R spikes of the ECG wave, or it could be the Inter Beat Interval (IBI) parameter defining the time between consecutive heartbeats of the PPG signal). The width W and corresponding standard deviation SD1 of the plot, and the length L and corresponding standard deviation SD2 are indicated.

[0321] exist Figure 4B The text illustrates an example of how to determine the Poincaré estimator of stress. Heart rate changes in hearing aid users can be measured using the following paradigm: 1 minute rest, 1 minute of somatic stress, and 1 minute rest. Figure 4B The diagram shows how the width of the Poincaré drawing and the corresponding SD1 can change significantly in these situations: the relaxed state (above), the stressed state (middle), and the post-stressed state (below).

[0322] Frequency domain characteristics:

[0323] exist Figure 4C The diagram shows that the low-frequency (LF) and high-frequency (HF) components of the HRV spectrum reflect SNS and PNS activity. The LF (0.04–0.15 Hz) component of the HRV reflects both SNS and PNS activity, while the HF component of the HRV purely reflects PNS activity. Therefore, the LF / HF ratio is an estimate of stress.

[0324] Stress caused by hearing:

[0325] Heart rate variation parameters can clearly show the hearing effort of hearing aid users (but not for normal hearing)[6]. As hearing conditions become more and more difficult, the parasympathetic markers of HRV (HF power) decrease.

[0326] From HRV, the ANS parameters SD1, SD2, SD1 / SD2, LF (power), HF (power), and LF / HF can be determined. Since HRV dynamics do not occur instantaneously, data with a duration of at least 60 seconds is required [7]. Classification parameters (LDA, naive bias, etc.) can be developed based on these parameters to determine stress / non-stress states based on individual baselines.

[0327] Therefore, hearing aids can be configured to reduce the user's hearing effort when high hearing effort is required. Once the time series of the Poincaré width is determined, situations requiring high hearing effort can be identified by combining this HRV metric with other objective measures that can infer stress. These other objective measures include, for example:

[0328] SNR of the surrounding sound environment (e.g., measured using a hearing aid microphone);

[0329] The relatively elevated sound pressure level at typical speech frequencies (“speech in noise”);

[0330] User movement (or no movement) detected by an accelerometer embedded in the hearing aid;

[0331] The person did not speak, but primarily listened (self-voice can be detected with good approximation from the sound input of the hearing aid, possibly confirmed by accelerometer data (e.g., measured by an in-ear accelerometer)).

[0332] HRV can be influenced by many factors: running, taking exams, etc. However, not all of these situations necessarily mean that the hearing aid user is under a hearing task requiring effort. By combining HRV analysis with other sound-related objective indicators mentioned above, it is possible to estimate high-efficiency hearing tasks and adjust the hearing aid to minimize hearing effort (e.g., maximize the Poincaré width).

[0333] There are other methods for analyzing HR, with the goal of estimating the stress level of end users in a given situation. Figures 4A-4C The exemplary applications provided by the Poincaré plot can be used to combine HR change measures with one or more other measures to identify high-difficulty hearing situations and adjust hearing aid signal processing parameters accordingly.

[0334] Therefore, a system including a hearing aid can be provided, wherein the hearing aid can be configured to operate based on an estimate of the hearing aid user's current hearing effort (as described above), wherein the estimate of the hearing aid user's current hearing effort can be based on determining the hearing aid user's HRV, as described above.

[0335] When appropriately replaced by a corresponding process, the structural features of the system / device / hearing aid described above, in detail in the "Detailed Description," and as defined in the claims can be combined with the steps of the method of the present invention.

[0336] Unless explicitly stated otherwise, the singular forms “a” and “the” used herein include the plural forms (i.e., meaning “at least one”). It should be further understood that the terms “having,” “comprising,” and / or “including” as used in the specification indicate the presence of the stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or combinations thereof. It should be understood that, unless explicitly stated otherwise, when an element is referred to as “connected” or “coupled” to another element, it may be a direct connection or coupling to the other element, or there may be intermediate inserting elements. The term “and / or” as used herein includes any and all combinations of one or more of the listed related items. Unless explicitly stated otherwise, the steps of any method disclosed herein do not necessarily have to be performed in the exact order disclosed.

[0337] It should be understood that references to "an embodiment," "an embodiment," "an aspect," or "may" in this specification mean that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment of the invention. Furthermore, particular features, structures, or characteristics may be suitably combined in one or more embodiments of the invention. The foregoing description is provided to enable those skilled in the art to implement the various aspects described herein. Various modifications will be apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects.

[0338] The claims are not limited to the aspects shown herein, but encompass the full scope consistent with the language of the claims, wherein, unless expressly stated, an element referred to in the singular does not mean "one and only one," but rather "one or more." Unless expressly stated, the term "some" means one or more.

[0339] Therefore, the scope of this invention should be determined based on the claims.

[0340] References

[0341] [1]S.Hey,A.Gharbi,BvHaaren,K.Walter,N. and S. "Continuous Noninvasive Pulse Transit Time Measurement for Psycho-Physiological Stress Monitoring," 2009 International Conference on eHealth, Telemedicine, and Social Medicine, Cancun, 2009, pp. 113-116. doi:10.1109 / eTELEMED.2009.35.

[0342] [2] Richter M. The moderating effect of success importance on the relationship between listening demand and listening effort. Ear and Hearing. 2016;37:111S–117S. doi:10.1097 / AUD.0000000000000295.

[0343] [3] Ohlenforst, B., Zekveld, A.A., Lunner, T., Wendt, D., Naylor, G., Wang, Y., Versfeld, N.J., Kramer, S.E., 2017. Impact of stimulus-related factors and hearing impairment on listening effort as indicated by pupil dilation. Hear Res. 351, 68e79.

[0344] [4] Goldberger JJ. Sympathovagal balance: how should we measure it?. Am J Physiol. 1999 Apr;276(4 Pt 2):H1273-80.

[0345] [5]Hoshi,R.A.,Pastre,C.M.,Vanderlei,L.C.M.,&Godoy,M.F.(2013).Poincareplots indexes of heart rate variability:relationship with other nonlinearvariables.Autonomic neuroscience.

[0346] [6]Hsu CH,Tsai MY,Huang GS,Poincaré plot indexes of heart ratevariability detect dynamic autonomic modulation during general anesthesiainduction.Acta Anaesthesiol Taiwan.2012 Mar;50(1):12-8.

[0347] [7]Esco MR,Flatt AA,Ultra-short-term heart rate variability indexesat rest and post-exercise in athletes:evaluating the agreement with acceptedrecommendations.J Sports Sci Med.2014 Sep 1;13(3):535-41.eCollection 2014Sep.

Claims

1. A system including a hearing aid, the hearing aid being configured to operate based on an estimate of the hearing aid user's current hearing effort, the system comprising: An input unit is configured to receive an input sound signal from the environment of a hearing aid user and provide at least one electrical input signal representing the input sound signal; An output unit is configured to provide a hearing aid user with at least one set of stimuli that can be perceived as sound, based on a processed version of the at least one electrical input signal. Signal-to-noise ratio estimator is used to determine the signal-to-noise ratio in the environment of a hearing aid user; A processing unit, connected to the input unit and the output unit, and including the system's signal processing parameters to provide a processed version of the at least one electrical input signal; The memory unit is configured to store a reference set of signal-to-noise ratio and pulse delivery time for the hearing aid user; At least the first and second physiological sensors; The system is configured as follows: - The first time point corresponding to the first maximum uplink point of the first measured parameter is determined based on the first physiological sensor; - The second time point corresponding to the second maximum ascending point of the second measured parameter is determined based on the second physiological sensor; - Determine the current pulse delivery time by calculating the time difference between the first and second time points; - Determine which hearing-disorder region the user is currently in based on the current pulse delivery time, wherein the hearing-disorder region is predefined based on a stored reference set of signal-to-noise ratio and pulse delivery time; and - Determine the hearing aid user's current listening effort based on the area where the user is currently experiencing hearing difficulties.

2. The system according to claim 1, wherein, Four predefined areas of hearing difficulty: - The first region is defined as having a signal-to-noise ratio higher than a first signal-to-noise ratio threshold and a pulse delivery time higher than a first pulse delivery time threshold; - The second region is defined as having a signal-to-noise ratio lower than the first signal-to-noise ratio threshold but higher than the second signal-to-noise ratio threshold and a pulse delivery time lower than the first pulse delivery time threshold; - The third region is defined as having a signal-to-noise ratio lower than the second signal-to-noise ratio threshold but higher than the third signal-to-noise ratio threshold and a pulse delivery time lower than the first pulse delivery time threshold; - The fourth region is defined as having a signal-to-noise ratio below the third signal-to-noise ratio threshold and a pulse delivery time above the first pulse delivery time threshold; and The system is configured to operate in a first listening mode when the current hearing difficulty region is in a first region, in a second listening mode when the current hearing difficulty region is in a second region, in a third listening mode when the current hearing difficulty region is in a third region, and in a fourth listening mode when the current hearing difficulty region is in a fourth region.

3. The system according to claim 2, wherein, Determining the hearing aid user's current hearing effort includes determining the system's hearing pattern.

4. The system according to claim 1, wherein, The system is configured to adjust the signal processing parameters of the current hearing effort adjustment processing unit based on the determined current hearing effort.

5. The system according to claim 1, wherein, The system includes a first wearable device and a second wearable device, wherein the first wearable device includes a first physiological sensor and the second wearable device includes a second physiological sensor.

6. The system according to claim 1, wherein, The system includes at least one accelerometer configured to detect the movement of a hearing aid user.

7. The system according to claim 6, wherein, The system is configured to determine whether startup requirements are met, including: - The motion detected by the accelerometer is below a first motion threshold; and - Signal-to-noise ratio below the fourth threshold; and In response to meeting the activation requirements, the processing unit is configured to change the activation mode of at least one of the first and second physiological sensors.

8. The system according to claim 7, wherein, Configuring to change the activation mode of at least one of the first and second physiological sensors includes configuring to activate at least the first and second physiological sensors.

9. The system according to claim 7 or 8, wherein, Configuring to change the activation mode of at least one of the first and second physiological sensors includes configuring to change the activation mode of at least one of the first and second physiological sensors from a standby mode to an operating mode.

10. The system according to claim 7, wherein, When the activation requirements are not met, the processing unit is configured to change or maintain the mode of at least one of the first and second physiological sensors to a standby mode or a deactivated mode.

11. The system according to claim 5, wherein, The first wearable device and / or the second wearable device is a hearing aid, headphones, headset, ear protection device, or a combination thereof.

12. The system according to claim 1, wherein, The first and / or second physiological sensor is a photoplethysmography sensor.

13. The system according to claim 11 or 12, wherein, Each of the first and second hearing aids includes an antenna and transceiver circuitry for establishing a communication link to the other hearing aid, thereby enabling the exchange of information between the two hearing aids.

14. A method for operating a system including a hearing aid based on an estimate of the hearing aid user's current hearing effort, the method comprising: The input unit receives input sound signals from the hearing aid user's environment and provides at least one electrical input signal representing the input sound signals; The output unit provides the hearing aid user with at least one set of stimuli that can be perceived as sound based on a processed version of at least one electrical input signal. The signal-to-noise ratio in the environment of a hearing aid user is determined using a signal-to-noise ratio estimator; A processed version of at least one electrical input signal is provided by a processing unit connected to the input unit and the output unit and including the signal processing parameters of the system; The memory unit stores a reference set of the signal-to-noise ratio and pulse delivery time for hearing aid users; Provide at least first and second physiological sensors; The first time point corresponding to the first maximum uplink point of the first measured parameter is determined based on the first physiological sensor; The second time point corresponding to the second maximum ascending point of the second measured parameter is determined based on the second physiological sensor; The current pulse transmission time is determined by calculating the time difference between the first time point and the second time point; The user is currently in a hearing-difficult region based on the current pulse delivery time, wherein the hearing-difficult region is predefined based on a stored reference set of signal-to-noise ratio and pulse delivery time. The user's current hearing effort is determined based on the area where they currently experience hearing difficulties.

15. A data processing system comprising a processor and a computer program, the computer program causing the processor to perform at least some of the steps of the method according to claim 14.

Images