Self-adjusting hearing compensation device, method and computer program product

Abstract

A self-adjustable hearing compensation device, method, and computer program product include: a first transducer for converting a first test signal of the device into a first electrical signal; a first hearing compensation module for performing gain compensation on the first electrical signal; a second transducer for converting the gain-compensated first electrical signal into sound and transmitting it into the ear canal; and a third transducer for simultaneously converting the sound transmitted in the ear canal into a second electrical signal and transmitting it to the device via a wireless transmission network. The device calculates the energy distribution of the second electrical signal in each frequency band and compares the energy distribution with the target gain and hearing threshold error through the second hearing compensation module. If the error does not meet the error target, the error is quantified, and modified filter parameters are generated using a compensation gain conversion model. The modified filter parameters are then transmitted to the first hearing compensation module via the wireless transmission network to perform hearing gain compensation.

Description

Technical Field

[0001] The present invention relates to a hearing compensation technology, and more particularly to a self-fitting hearing compensation device with real ear measurement (REM) analysis and a self-fitting hearing compensation method thereof. Background Art

[0002] According to statistics, there are more than 120,000 people with hearing impairments in Taiwan who have certificates of physical and mental disability. Hearing problems will cause invisible or obvious obstacles in important aspects of life such as language communication, career adaptation, social participation, school learning, and life safety.

[0003] Furthermore, Taiwan is about to enter a super-aged society, and hearing loss ranks among the top three chronic diseases among the elderly. Currently, due to the advancement of modern hearing aids and hearing assistive devices on the market, the negative impact and burden of hearing impairment on individuals, families, communities, and even society as a whole can be greatly alleviated.

[0004] However, modern hearing aid and assistive device technology still requires real-ear analysis for tuning. Existing real-ear analysis instruments use a probe tube with a first microphone and a second microphone. The first microphone collects sound near the ear canal opening, while the second microphone collects sound near the eardrum. During real-ear testing and analysis, the probe tube is inserted into the ear canal, with the tip approximately 5mm from the eardrum. The changes in sound in the ear canal are measured both before and after the hearing aid is worn, resulting in the Real Ear Insertion Response (REIR). Specifically, the operating steps of the existing real ear test are: 1) when there is no hearing aid placed at the ear canal opening, that is, the ear canal opening is open, the sound field emits sound (including all frequencies and the same sound pressure level), and the sound pressure level difference curve recorded by the first microphone and the second microphone is called the real ear unaided hearing response REUR (also called the real ear unaided hearing gain REUG); and 2) when a hearing aid is placed at the ear canal opening, the sound field emits sound, and the sound pressure level difference curve recorded by the first microphone and the second microphone is called the real ear aided hearing response REAR (also called the real ear aided hearing gain REAG). However, since the real ear test must be performed in a listening room using instruments and with the assistance of hearing professionals, it is less efficient and less immediate.

[0005] Furthermore, the measured real-ear response often differs from the results expected by the fitting software. This is primarily due to the fact that the acoustic characteristics of the hearing-impaired individual's outer and inner ears (e.g., resonance, volume, impedance, etc.) may differ from the "average ear" data used in the software's predictions. When performing real-ear testing, the hearing-impaired individual's unique ear canal characteristics are reflected, leading to errors. Furthermore, hearing-impaired individuals may have different hearing aid acoustic parameters, such as vent size or eardrum depth. Therefore, real-ear testing requires additional gain adjustment to match the specified or expected target gain.

[0006] Insertion gain measurement is a common method for verifying hearing aid performance characteristics. However, as mentioned above, insertion gain has many limitations when fitting hearing aids, which can still lead to errors.

[0007] For the reasons stated above, there is an urgent need in the industry to provide a hearing compensation device and method that does not require a real ear analyzer or a probe transducer (i.e., a probe microphone), does not require real ear measurement and analysis to be performed in a professional listening space (e.g., a listening room), and does not require the assistance of a hearing professional (e.g., a professional tuner) to effectively address the above-mentioned issues. This device and method can provide users (especially hearing-impaired patients) with accurate, immediate, automated, and customized hearing aids (e.g., hearing aids, hearing assistive devices, or hearing devices such as headphones and glasses with hearing aid functions, ANC headphones, or TWS headphones, etc.) in the current real environment outside a listening room. Summary of the Invention

[0008] To solve the aforementioned existing technical problems or provide related effects, the present invention provides a self-adjusting hearing compensation device, method and computer program product with real ear measurement to at least partially solve the problems in the existing technology.

[0009] The self-adjustable hearing compensation device with real-ear measurement of the present invention includes: a first transducer that receives a first test signal from a device and converts the first test signal into a first electrical signal; a hearing compensation module that is connected to the first transducer and performs gain compensation on the first electrical signal; a second transducer that is connected to the hearing compensation module and converts the gain-compensated first electrical signal into sound and transmits the sound into the ear canal; and a third transducer that simultaneously converts the sound transmitted in the ear canal into a second electrical signal, which is then transmitted to the device via a wireless transmission network. The device calculates the energy distribution of the second electrical signal in each frequency band and compares the energy distribution with the target gain and the hearing threshold. If the error does not meet the error target, the device quantifies the error, generates modified filter parameters using a compensation gain conversion model, and transmits the modified filter parameters to the hearing compensation module via the wireless transmission network for hearing gain compensation.

[0010] The present invention also provides a self-adjustable hearing compensation method with real-ear measurement, comprising the following steps: receiving a first test signal from a device via a first transducer and converting the first test signal into a first electrical signal; performing gain compensation on the first electrical signal via a hearing compensation module connected to the first transducer; converting the gain-compensated first electrical signal into sound via a second transducer connected to the hearing compensation module, and transmitting the sound into the ear canal; synchronously converting the sound transmitted in the ear canal into a second electrical signal via a third transducer, and transmitting the second electrical signal to the device via a wireless transmission network; calculating, by the device, the energy distribution of the second electrical signal in each frequency band and comparing the error between the energy distribution and a target gain and a hearing threshold; and if the error does not meet the error target, quantifying the error, generating modified filter parameters using a compensation gain conversion model, and transmitting the modified filter parameters to the hearing compensation module via the wireless transmission network for hearing gain compensation.

[0011] In addition, in one embodiment, the present invention also provides a self-adjusting hearing compensation method with real ear measurement, comprising the following steps: receiving a first test signal from a device by a first transducer and converting the first test signal into a first electrical signal; performing gain compensation on the first electrical signal by a hearing compensation module connected to the first transducer; converting the gain-compensated first electrical signal into sound by a second transducer connected to the hearing compensation module, and transmitting the sound into the ear canal; synchronously converting the sound transmitted in the ear canal into a second electrical signal by a third transducer, and transmitting the second electrical signal to the device via a wireless transmission network; and calculating the second electrical signal by the device. The device calculates the energy distribution in each frequency band and compares the energy distribution with the target gain and the hearing threshold error; calculates the required gain compensation based on the hearing threshold using a compensation prescription, and transmits the required gain compensation to a compensation gain conversion model; calculates the required auditory dynamic range application optimization parameters based on the hearing threshold using auditory dynamic range application optimization, and transmits the required auditory dynamic range application optimization parameters to the compensation gain conversion model; and if the error does not meet the error target, quantifies the error, generates modified filter parameters using the compensation gain conversion model, and transmits the modified filter parameters to the hearing compensation module via the wireless transmission network to perform hearing gain compensation.

[0012] In one embodiment, the hearing compensation module is disposed in an active noise reduction chip or a digital signal processing circuit chip.

[0013] In one embodiment, the modified filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit.

[0014] In one embodiment, the filter parameters of the gain compensation of the active noise cancellation are audio gain compensation filter unit parameters. In other words, the gain compensation unit of the active noise cancellation technology is an audio gain compensation filter unit of the active noise cancellation technology, such as an SZ or APT filter, and the filter parameters of the audio gain compensation filter unit are, for example, SZ or APT filter parameters.

[0015] In one embodiment, the present invention further includes a storage module, wherein if the error meets the error target, the apparatus stores the modified filter parameters in the storage module.

[0016] In one embodiment, the apparatus stores the original filter parameters or the modified filter parameters to a device having a sound source processing capability, wherein the device has a hearing compensation module for performing hearing gain compensation.

[0017] In one embodiment, the hearing compensation module in the device automatically searches for optimal filter parameter values ​​from multiple sets of filter parameters using noise reduction technology combined with an optimization method and a loss function based on a real-time customized audiogram or audiometer obtained by the user in a current real-world environment. However, the present invention is not limited to this.

[0018] In one embodiment, the present invention further includes a wireless transmission and reception module that receives a second test signal from the device via the wireless transmission network to perform hearing gain compensation. Furthermore, the first test signal is transmitted in the air, while the second test signal is transmitted via wireless communication.

[0019] In one embodiment, if the error still does not meet the error target, the device further quantizes the error and transmits the quantized error and auditory dynamic range optimization parameters to the compensation gain conversion model. After generating another modified filter parameter using the compensation gain conversion model, the device transmits the another modified filter parameter to the hearing compensation module via the wireless transmission network to perform the hearing gain compensation.

[0020] In one embodiment, the device further comprises: a probe or an elongated earplug, one end of which is connected to the third transducer, and the other end of which is as short as the ear canal opening and as long as near the eardrum (e.g., 1 mm or closer), wherein the closer the other end is to the eardrum, the more accurate the high-frequency audio quality obtained.

[0021] In another embodiment, one end of the probe or the long earplug is connected to the third transducer, and the other end is connected to the first bend of the external auditory canal or to a distance of about several mm (such as 5 mm) from the eardrum, so that the high-frequency audio quality obtained is more accurate than the existing technology.

[0022] In one embodiment, the self-adjustable hearing compensation device with real ear measurement and the self-adjustable hearing compensation method with real ear measurement perform a hearing test (audiometry) in a non-audiometry room environment.

[0023] In one embodiment, the self-adjustable hearing compensation device with real ear measurement is arranged in a hearing aid with active noise reduction or digital signal processing circuit, and the self-adjustable hearing compensation method with real ear measurement is applied to the self-adjustable hearing compensation device. The self-adjustable hearing compensation device is not a dedicated earphone for the hearing examination room and does not require the assistance of a hearing professional to be implemented; in another embodiment, the self-adjustable hearing compensation method with real ear measurement is applied to a hearing aid with active noise reduction or digital signal processing circuit.

[0024] In one embodiment, the self-adjustable hearing compensation device with real ear measurement and the self-adjustable hearing compensation method with real ear measurement are automatically, instantly and / or synchronously processed by an application of the device in combination with the compensation gain conversion model and wireless communication technology.

[0025] Accordingly, the present invention provides a method for effectively solving the above-mentioned problems by performing real ear measurement and analysis without the need for a real ear analyzer, a probe transducer (i.e., a probe microphone), being limited to a professional listening space, and requiring no assistance from a hearing professional. Real ear measurements can be performed using a hearing aid device through wireless communication technology in the current real environment outside a hearing examination room, and a hearing aid device can be provided that is accurate, instant, automated, and customized for the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 FIG. 4 is a block diagram of a self-adjusting hearing compensation device with real ear measurement according to the present invention.

[0027] Figure 2 、 2-1 2-2 is a schematic diagram of an embodiment of the self-adjusting hearing compensation device with real ear measurement combined with an intelligent device of the present invention.

[0028] Figure 3 The present invention is a flowchart of steps of implementing the compensation gain conversion model technology and active noise cancellation (ANC) technology in the hearing compensation module of the self-adjustable hearing compensation device with real ear measurement.

[0029] Figure 4 FIG. 4 is a schematic diagram showing model training of a compensation gain conversion model according to an embodiment of the present invention.

[0030] Figure 5 According to an embodiment of the present invention, a log-power spectrum (LPS) extraction method is shown.

[0031] Figure 6 FIG. 4 is a block diagram illustrating model training of a compensation gain conversion model according to an embodiment of the present invention.

[0032] Figure 7A The application terminal of the present invention receives the electrical signal Flowchart of the following steps.

[0033] Figure 7B Schematic diagram of the target gain, hearing threshold and energy distribution of the self-adjustable hearing compensation device with real ear measurement of the present invention.

[0034] Figure 8 4 is a flowchart of the steps of the self-adjusting hearing compensation method with real ear measurement of the present invention.

[0035] Main component symbols

[0036] 1 Self-adjusting hearing compensation device with real ear measurement

[0037] 11. First transducer

[0038] 12. First Hearing Compensation Module

[0039] 13 Second transducer

[0040] 14 Wireless transmission and reception modules

[0041] 15 Third transducer

[0042] 16 Storage Modules

[0043] 10 Devices

[0044] 102 Second hearing compensation module

[0045] 110 Equipment or Device

[0046] 120 probe

[0047] 122 Long Earplugs

[0048] 21 Window Frame

[0049] 22 Discrete Fourier Transform (DFT)

[0050] 23 |·| 2

[0051] 24 Logarithm (log(·))

[0052] 31 Hearing threshold A f

[0053] 32 Compensation Prescription

[0054] 33 Compensation Gain Conversion Model

[0055] 34 Headphones

[0056] 35 Calculation The error between

[0057] 36 Determine whether the error target is met

[0058] 37 Auditory dynamic range application optimization ( Percentage exceeding Af) parameter

[0059] Steps S1-S6

[0060] Steps S11-S17

[0061] Steps S21-S27. DETAILED DESCRIPTION

[0062] The following describes the implementation of the present invention by means of specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification.

[0063] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings in this specification are only used to match the contents disclosed in the specification for understanding and reading by people familiar with this technology, and are not used to limit the conditions under which the present invention can be implemented. Therefore, they have no substantive technical significance. Any structural modification, change in proportional relationship or adjustment of size should still fall within the scope of the technical content disclosed in the present invention without affecting the efficacy and purpose that can be achieved by the present invention.

[0064] Figure 1 FIG. 1 is a block diagram of a self-adjusting hearing compensation device with real ear measurement according to the present invention. Figure 1 As shown, the self-adjustable hearing compensation device 1 with real ear measurement of the present invention includes a first transducer (Ref.Mic) 11, a first hearing compensation module 12, a second transducer (i.e., a speaker) 13, a wireless transmission and reception module 14, a third transducer (Err.Mic) 15, and a storage module 16, wherein the first transducer (Ref.Mic) 11 receives a test signal S from a device (such as a smart device or a mobile device) and converts the test signal S into an electrical signal; the first hearing compensation module 12 is connected to the first transducer (Ref.Mic) 11 and performs gain compensation on the electrical signal; the second transducer 13 is connected to the first hearing compensation module 12 and converts the gain-compensated electrical signal into sound and transmits the sound into the ear canal; the wireless transmission and reception module 14 is connected to the first hearing compensation module 12; and the third transducer (Err.Mic) 15 simultaneously converts the sound transmitted in the ear canal into an electrical signal. The electrical signal is transmitted through the wireless transmitting and receiving module 14 and the wireless transmission network (not shown in the figure) To the device (not shown in the figure), wherein the device uses an application (app), its firmware, or cloud technology to calculate the energy distribution of the electrical signal in each frequency band, and compares the energy distribution with the target gain and the hearing threshold error through the second hearing compensation module 102. If the error does not meet the error target, the device quantifies the error using the application, its firmware, or cloud technology, and generates a set of modified filter parameters using a compensation gain conversion model. The modified filter parameters are then transmitted via a wireless transmission network to the first hearing compensation module 12, the second hearing compensation module, or other equipment or devices with sound source processing capabilities (or hearing compensation modules) to perform hearing gain compensation.

[0065] In one embodiment of the present invention, the first hearing compensation module 12 is disposed in an active noise reduction chip or a digital signal processing circuit chip, while the second hearing compensation module is disposed in the device (such as a smart device or a mobile device) and implemented via an application, its firmware, or cloud technology. The first hearing compensation module 12 and the second hearing compensation module are synchronized.

[0066] In one embodiment of the present invention, the set of modified filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit, wherein the filter parameters for gain compensation of active noise reduction are parameters of an audio gain compensation filter unit (such as an SZ or APT filter).

[0067] in accordance with Figure 1 As shown, the self-adjustable hearing compensation device 1 with real ear measurement of the present invention further includes a storage module 16, wherein if the above-mentioned error meets the error target, the device uses an application, its firmware or cloud technology to store the set of corrected filter parameters in the storage module 16.

[0068] Furthermore, the device stores the original filter parameters and / or the modified filter parameters in a device or apparatus with sound processing capabilities, wherein the device or apparatus includes a hearing compensation module for performing hearing gain compensation. In one embodiment, the device or apparatus with sound processing capabilities can select the original filter parameters or the modified filter parameters and perform hearing gain compensation through the hearing compensation module to personalize and enhance the listening experience.

[0069] In one embodiment, the device or apparatus with sound source processing capability stores the original filter parameters and / or the modified filter parameters in a chip with active noise reduction or a chip with a digital signal processing circuit to perform hearing gain compensation.

[0070] Furthermore, in one embodiment of the present invention, if the error still does not meet the error target, the device further quantifies the error using an application, its firmware, or cloud technology to generate another set of modified filter parameters using a compensation gain conversion model. The modified filter parameters are then transmitted via a wireless transmission network to the first hearing compensation module, the second hearing compensation module, or other equipment or devices with sound source processing capabilities (or hearing compensation modules) for hearing gain compensation. The compensation gain conversion model may be located in the cloud, a server, or a smart device, but the present invention is not limited thereto.

[0071] According to another embodiment of the present invention, Figure 1 and Figure 2 As shown, the wireless transmitting and receiving module of the self-adjusting hearing compensation device with real ear measurement 1 of the present invention can also receive a test signal S from a device (such as a smart device or a mobile device) 10 via a wireless transmission network (not shown in the figure). Similar to the above embodiment, if the wireless transmission and reception module of the self-adjusting hearing compensation device 1 with real ear measurement receives a test signal S from the device 10 through a wireless transmission network (not shown in the figure), the first hearing compensation module 12 performs gain compensation on the test signal S; the second transducer 13 is connected to the first hearing compensation module 12, and converts the gain-compensated test signal into sound, and transmits the sound into the ear canal; the wireless transmission and reception module 14 is connected to the first hearing compensation module 12; the third transducer (Err.Mic) 15 simultaneously converts the sound transmitted in the ear canal into an electrical signal, and transmits the electrical signal to the device 10 through the wireless transmission and reception module 14 and the wireless transmission network, wherein the device 10 uses an application (app), its firmware or cloud technology to calculate the energy distribution (energy) of the electrical signal in each frequency band. The device 10 generates a power distribution and compares the error between the power distribution and the target gain and hearing threshold through the second hearing compensation module 102. If the error does not meet the error target, the device 10 quantifies the error using an application, its firmware, or cloud technology. After generating a set of modified filter parameters using a compensation gain conversion model, the device 10 transmits the modified filter parameters via a wireless transmission network to the first hearing compensation module 12, the second hearing compensation module 102, or other equipment or devices with sound source processing capabilities (or hearing compensation modules) for hearing gain compensation.

[0072] In another embodiment of the present invention, the first hearing compensation module 12 is disposed in an active noise reduction chip or a digital signal processing circuit chip, while the second hearing compensation module 102 is disposed in the device 10 (such as a smart device or a mobile device) and implemented via an application, its firmware, or cloud technology. The first hearing compensation module 12 and the second hearing compensation module 102 are synchronized.

[0073] In one embodiment of the present invention, the set of modified filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit, wherein the filter parameters for gain compensation of active noise reduction are parameters of an audio gain compensation filter unit (such as an SZ or APT filter).

[0074] However, in another embodiment of the present invention, if the error still does not meet the error target, the device further quantifies the error using an application, its firmware, or cloud technology to generate another set of modified filter parameters using a compensation gain conversion model. The modified filter parameters are then transmitted via a wireless transmission network to the first hearing compensation module, the second hearing compensation module, or other equipment or devices with sound source processing capabilities (or hearing compensation modules) for hearing gain compensation. The compensation gain conversion model may be located in the cloud, a server, or a smart device, but the present invention is not limited thereto.

[0075] In an embodiment of the present invention, the self-adjusting hearing compensation device with real ear measurement of the present invention is disposed in a hearing aid with an active noise reduction or digital signal processing circuit.

[0076] Furthermore, the aforementioned modules can be either hardware or firmware. If hardware, they can implement various circuits or hardware units with similar technologies for hearing gain compensation, wireless transmission and reception, and storage. If firmware, they can implement various firmware units for hearing gain compensation, wireless transmission and reception, and storage. In one embodiment, the hearing compensation module can be a hearing compensation circuit or a hearing compensation hardware / firmware unit, the wireless transmission and reception module can be a wireless transmission and reception circuit or a wireless transmission and reception hardware / firmware unit, and the storage module can be a storage circuit or a storage hardware / firmware unit. The self-adjusting hearing compensation device of the present invention includes, but is not limited to, ANC.

[0077] The self-adjustable hearing compensation device with real ear measurement of the present invention is set in the hearing aid, without the need for an additional probe transducer (i.e., a probe microphone), so as to provide an accurate, instant, automated and customized hearing aid in the current real environment outside the hearing examination room through wireless communication technology.

[0078] Specifically, the present invention mainly combines noise reduction (e.g., ANC) technology with application technology and compensation gain conversion model technology. In the user's current real environment, there is no need to use additional probe transducers. The self-adjusting hearing compensation device with real ear measurement of the present invention already includes a wireless transmission and reception module, a hearing compensation module, a transducer (i.e., a speaker), a transducer (Err.Mic), a transducer (Ref.Mic) and a storage module, wherein the transducer (Ref.Mic) receives a test signal S from a device and converts the test signal S into an electrical signal; the hearing compensation module is connected to the transducer (Ref.Mic) and performs gain compensation on the electrical signal; the transducer is connected to the hearing compensation module and converts the gain-compensated electrical signal into sound and transmits the sound into the ear canal; and the transducer (Err.Mic) synchronously converts the sound transmitted in the ear canal into an electrical signal And transmit electrical signals through wireless transmitting and receiving modules and wireless transmission network (not shown in the figure) The device (not shown in the figure) calculates the energy distribution of the electrical signal in each frequency band and compares the energy distribution with the target gain and hearing threshold error through the hearing compensation module in the device. If the error does not meet the error target, the device quantifies the error and generates a set of modified filter parameters using a compensation gain conversion model. The modified filter parameters are then transmitted via a wireless transmission network to the hearing compensation module or other equipment or device with sound source processing capabilities (or hearing compensation module) for further hearing gain compensation.

[0079] In another embodiment of the present invention, Figure 2-1 As shown in 2-2, the self-adjusting headphone device with real ear measurement of the present invention can also use a probe tube 120 or a long earplug 122. One end of the probe tube or the long earplug can be connected to the transducer (Err. Mic), and the other end of the probe tube or the long earplug is as short as the ear canal opening and as long as near the eardrum (such as 1 mm or closer). The closer the other end is to the eardrum, the more accurate the high-frequency audio quality obtained, so as to provide an accurate, real-time, automated and customized headphone device through wireless communication technology in the current real environment.

[0080] In addition, in another embodiment, one end of the probe or the long earplug is connected to the third transducer, and the other end is connected to the first bend of the external auditory canal or to a position about several mm (such as 5 mm) away from the eardrum, so that the high-frequency audio quality obtained is more accurate than the existing technology.

[0081] It should be noted that Figure 2-1 2-2 is for illustration only and is not intended to be limiting.

[0082] Figure 3 The present invention is a flowchart of steps of implementing the compensation gain conversion model technology and active noise cancellation (ANC) technology in the hearing compensation module of the self-adjustable hearing compensation device with real ear measurement.

[0083] First, in step S1, the application (app) transmits a test signal S through the speaker of the smart device (or through a wireless transmission network), and then the transducer (Ref.Mic) of the ANC headset (or a wireless transmission and reception module) receives the test signal S.

[0084] Next, in step S2 , the filter circuit (or digital signal processing (DSP) circuit) of the ANC headset performs hearing gain compensation through the hearing compensation module, and the transducer (ie, speaker) in the ANC headset broadcasts the sound.

[0085] Then, in step S3, the ANC earphone end converts the sound signal in the ear canal into an electrical signal by the transducer (Err.Mic) And transmit the electrical signal through wireless transmission network The data is sent back to the application of the smart device.

[0086] In step S4, the application will synchronously consider the calculated electrical signal The characteristics of energy distribution, target gain and hearing threshold in each frequency band, that is, the electrical signal is compared by the hearing compensation module. The energy distribution and the error between the target gain and the hearing threshold.

[0087] In step S5, the compensation gain conversion model automatically generates the modified filter parameters.

[0088] Finally, in step S6, if the error does not meet the error target, the application automatically quantifies the error, generates modified filter parameters by means of a compensation gain conversion model, and transmits the modified filter parameters to the hearing compensation module via a wireless transmission network to perform hearing gain compensation again; if the error meets the error target, the application automatically stores the modified filter parameters to the storage module in the ANC headset and / or the smart device. Furthermore, in another embodiment, the application automatically stores the original filter parameters or the modified filter parameters to a device or apparatus with sound source processing capabilities (such as Figure 2 The device 110 shown is, for example, a smart device, a mobile device, a speaker or a sound box), wherein the device or apparatus has a hearing compensation module for performing hearing gain compensation.

[0089] It is worth mentioning that if the above error still does not meet the error target, the application will quantify the error again to generate another set of corrected filter parameters through the compensation gain conversion model. The other set of corrected filter parameters is then transmitted to the hearing compensation module via the wireless transmission network for another hearing gain compensation.

[0090] In one embodiment of the present invention, Figure 4 Schematic diagram showing model training of the compensation gain conversion model. The energy distribution characteristics, target gain, hearing threshold and auditory dynamic range are optimized, and the compensation gain conversion model will automatically generate multiple groups (or n groups) of ANC filter parameters through model training, which can provide ANC headphones with hearing gain compensation.

[0091] The following are for electrical signals The calculation of the energy distribution and the calculation of compensation parameters through the compensation gain conversion model architecture are described in detail.

[0092] electrical signals Calculation of energy distribution

[0093] Figure 5 The log-power spectrum (LPS) acquisition method is shown. In an embodiment of the present invention, the transducer (Err.Mic) receives the electrical signal The data is first sent to the APP for acoustic feature extraction, and the log-power spectrum (LPS) method is used to calculate the electrical signal over a period of time. When extracting features, the input signal is subjected to a short-time Fourier transform (STFT) by calculating the discrete Fourier transform (DFT) 22 of each overlapping window frame 21. That is, the speech signal is converted from the time domain to the frequency domain using formula (1), which is as follows:

[0094]

[0095] Among them, Y t (l) represents the input signal (i.e., electrical signal ) In the time domain, the lth sample, Y f(k) represents the spectrum of the input signal, k is the frequency index, h(l) represents the Hamming window function, and the logarithmic power spectrum is defined as shown in formula (2):

[0096]

[0097] Among them, Y l (k) represents the logarithmic power spectrum of the input signal, as shown in formula (2), the spectrum Y of the input signal f (k) Conduct |·| 2 23, and take the logarithm (log(·))24 to obtain the electrical signal The logarithmic power spectrum Y l (k).

[0098] At this time, the logarithmic power spectrum under the n overlapping window frames is accumulated to obtain the electrical signal energy distribution characteristics.

[0099] Compensation gain parameters are converted into compensation gain model architecture

[0100] Figure 6 A block diagram showing the model training of the compensation gain conversion model. f After 31, the user's required hearing gain compensation G is calculated using the compensation prescription 32 (e.g., NAL-R, NAL-RP, DSL, NAL-NL1, NAL-NL2, AescuHRL-1, etc.) f Then, the compensation gain is converted into the filter parameter gain G′ required by the circuit through the compensation gain conversion model 33 (for example, deep learning method, machine learning method, mathematical statistics method, etc.) N , and transmits it to the ANC headphone device 34. The above process can be trained through the compensation gain conversion model architecture and implemented through the target loss function (cost function), as shown in formula (3):

[0101]

[0102] Here, N indicates that the model will generate multiple sets (obtain N sets) of filter parameters, M indicates the number of samples used to train the model, and i indicates the number of gain data in the training.

[0103] When the compensation gain conversion model is trained, the error is back-propagated to update the model parameters and the parameter weights are adjusted to find the optimal compensation gain, as shown in formula (4):

[0104]

[0105] Then, the ANC device's transducer transmits the electrical signal in the ear canal to the After recording and target voice signal T f The distribution is calculated 35 to obtain the error between the two signals The error calculation method includes the following methods: minimum mean-square error, objective evaluation index (e.g., HASQI, HASPI, STOI, NCM, PESQ, etc.), but the present invention is not limited thereto. Afterwards, it is determined whether the current error is within an acceptable range by judging 36. If the error If it is within the acceptable range, it means the matching is completed; otherwise, the error and auditory dynamic range application optimization parameters The compensation gain is then transferred to the compensation gain conversion model to generate another set of modified compensation gains. It is worth noting that the auditory dynamic range applies optimization parameters for More than A f After the above process, the above process can be repeated to make the error Continue to converge to meet the set requirements, thereby completing the automated matching process.

[0106] It is worth mentioning that the DSP circuit can also perform electrical signal processing through the above process. The energy distribution is calculated and the gain compensation parameters are converted into gain compensation model architecture.

[0107] Figure 7A The application terminal of the present invention receives the electrical signal Flowchart of the steps after Figure 7B Schematic diagram of the target gain, hearing threshold and energy distribution of the self-adjustable hearing compensation device with real ear measurement of the present invention.

[0108] like Figure 7A As shown, in step S11, the ANC earphone end transmits the electrical signal through the transducer (Err.Mic) Send to the application side of the smart device.

[0109] Then, in step S12, the application receives the electrical signal (e.g., a test statement of about 10 seconds).

[0110] Then, in step S13, n sound frames are taken, each sound frame is Fourier transformed, and the energy under n sound frames is accumulated to obtain the electrical signal energy distribution.

[0111] In step S14, the current electrical signal is calculated and compared. The error between the energy distribution and the hearing threshold and the target gain, etc., is calculated. If the error does not meet the error target, the error is further quantized and the quantized error and the auditory dynamic range are applied to the compensation gain conversion model to generate another set of modified filter parameters.

[0112] In step S15, the gain amount in each frequency band is adjusted.

[0113] In step S16, the trained compensation gain conversion model is used to generate modified ANC filter parameters (or gain compensation parameters of the DSP circuit).

[0114] Finally, in step S17, if the above error meets the error target, the ANC filter parameters are written into the chip of the ANC headset (i.e., stored in the storage module of the ANC headset) and / or the smart device; alternatively, the gain compensation parameters of the DSP circuit are written into the chip of the headset having the DSP circuit.

[0115] It's worth noting that the self-adjustable hearing compensation device with real-ear measurement of the present invention utilizes active noise cancellation (ANC) technology. However, various embodiments employing the same or similar noise cancellation technologies may be applicable, and the present invention is not limited thereto. In this embodiment, filter parameters (e.g., FF, FB, SZ, APT, etc.) are set using information from the "mechanical acoustic characteristics" and the "hearing compensation prescription." Specifically, the filter parameters in the ANC technology are set using the mean-squared error (MSE) method, thereby enabling the ANC technology to compensate for the gain of different frequencies of the sound source transmitted by the transducer. In one embodiment, the filters described above may be a feedforward (FF) filter, a feedback (FB) filter, and an audio gain compensation filter unit (e.g., an SZ filter or an APT filter). The FF filter receives an electrical signal from a transducer (Ref.Mic) to eliminate external noise. The FB filter receives an electrical signal from a transducer (Err.Mic) (i.e., the transducer (Err.Mic) converts internal ear canal noise into an electrical signal) to eliminate internal ear canal noise. The audio gain compensation filter units (e.g., the SZ filter and the APT filter) receive appropriate target curves to amplify signals in various frequency bands within the electrical signal. Furthermore, within the DSP circuit, time-domain (or frequency-domain) gain amplification units within the processing architecture, such as EQ, filters, wide dynamic range compression, and adaptive dynamic range optimization, can be adjusted.

[0116] Because the present invention is applicable to various smart devices, the self-adjusting hearing compensation device can be used to perform audiometry in environments other than a hearing room (e.g., residential buildings, outdoors, in cars, parks, etc.) without the assistance of a hearing professional. In other words, the self-adjusting hearing compensation device of the present invention need not be limited to performing audiometry and real-ear measurement analysis in a hearing room in conjunction with real-ear measurement instruments. It can provide automated, instant, and customized hearing aids, hearing assistive devices, or devices with hearing-assistive functions in the real-world environment outside of a hearing room.

[0117] In one embodiment, the hearing compensation device with real-ear measurement of the present invention is disposed in a hearing aid, such as headphones (including but not limited to dynamic, balanced iron, piezoelectric, pneumatic, electrostatic, wired, or wireless headphones), hearing aids, noise-canceling headphones, monitoring headphones, smart glasses, wearable devices, or combinations thereof. In another embodiment, the hearing compensation device with real-ear measurement of the present invention is also a hearing device, equipped with the aforementioned hearing compensation device, wherein the hearing compensation device is disposed in and connected to the hearing device.

[0118] Furthermore, the self-adjustable hearing compensation device with real-ear measurement of the present invention utilizes a smart device application (app) combined with compensation gain conversion model technology and wireless communication technologies (e.g., Bluetooth, Wi-Fi, near-field communication (NFC), ultra-wideband (UWB), IEEE 802.15.4, etc.) to directly synchronize the user's (particularly hearing-impaired) real-time customized audiogram or audiometer with the noise reduction module and / or hearing compensation module installed in the same or a single chip, thereby providing the user (particularly hearing-impaired) with an instant and comfortable listening experience. Furthermore, according to the above-described embodiments of the present invention, since hearing-impaired individuals can use their own hearing devices or equipment (e.g., various smart devices or equipment combined with ANC headphones or TWS headphones) to perform hearing tests in various real-world environments (i.e., quiet or noisy environments) rather than in an audiology test room, they can choose to enable or disable the noise reduction module during the self-adjustable hearing compensation of the present invention according to their needs.

[0119] It is worth noting that the self-adjustable hearing compensation device with real ear measurement of the present invention not only does not need to be limited to the hearing test room for hearing testing and / or hearing gain compensation and does not require the assistance of a hearing professional, but also does not require the use of additional probe transducers. Instead, it can automatically, instantly and customize hearing aids, hearing assistive devices or headphones with hearing aid functions for hearing-impaired patients through its own devices (e.g., hearing aids, hearing assistive devices, headphones, etc.) and through the use of smart devices combined with compensation gain conversion model technology and wireless communication technology.

[0120] Figure 8 1 is a flowchart of the steps of the self-adjusting hearing compensation method with real ear measurement of the present invention, which is combined with the description of the above embodiment. The method flow at least includes the following steps S21 to S27.

[0121] In step S21 , a first test signal from a device (such as a smart device or a mobile device) is received by a first transducer, and the first test signal is converted into a first electrical signal.

[0122] In step S22 , the first electrical signal is gain compensated by a first hearing compensation module connected to the first transducer.

[0123] In step S23 , the gain-compensated first electrical signal is converted into sound by a second transducer connected to the first hearing compensation module, and the sound is transmitted into the ear canal.

[0124] In step S24 , the sound transmitted in the ear canal is converted into a second electrical signal by the third transducer, and the second electrical signal is transmitted to the device via the wireless transmitting and receiving module and the wireless transmission network.

[0125] In step S25 , the device calculates the energy distribution of the second electrical signal in each frequency band using an application, its firmware, or cloud technology, and compares the energy distribution with the target gain and the hearing threshold error using a second hearing compensation module.

[0126] In step S26, if the error does not meet the error target, the device quantifies the error using an application, its firmware, or cloud technology to generate a set of modified filter parameters using a compensation gain conversion model. The modified filter parameters are then transmitted to the first hearing compensation module and the second hearing compensation module via the wireless transmission network to perform hearing gain compensation.

[0127] In step S27 , if the error meets the error target, the device stores the modified set of filter parameters in a storage module using an application, its firmware, or cloud technology.

[0128] In another embodiment, in addition to storing the set of modified filter parameters in a storage module, the device may also utilize an application, its firmware, or cloud technology to store the original filter parameters or the modified filter parameters in a device or apparatus with sound source processing capabilities, wherein the device or apparatus has a hearing compensation module for performing hearing gain compensation.

[0129] In addition to the first transducer receiving a first test signal from a device (such as a smart device or mobile device), the wireless transmission and reception module can also receive a second test signal from the device via a wireless transmission network to perform the hearing gain compensation described above. Furthermore, the first test signal is transmitted through air, while the second test signal is transmitted via wireless communication.

[0130] In the aforementioned method flow, if the error still does not meet the error target, the device re-quantizes the error using an application, its firmware, or cloud technology, and transmits the quantized error and the auditory dynamic range optimization parameters to the compensation gain conversion model. After the compensation gain conversion model generates another set of modified filter parameters, the device transmits the another set of modified filter parameters to the first hearing compensation module and the second hearing compensation module via the wireless transmission network to perform the hearing gain compensation.

[0131] In the above method flow, the first hearing compensation module is installed in an active noise reduction chip or a digital signal processing circuit chip, while the second hearing compensation module is installed in the device (such as a smart device or mobile device) and implemented via an application, its firmware, or cloud technology. The first hearing compensation module and the second hearing compensation module are synchronized.

[0132] In one embodiment, the set of modified filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit, wherein the filter parameters for gain compensation of active noise reduction are parameters of an audio gain compensation filter unit (such as an SZ or APT filter).

[0133] In addition, the above method flow is applied to a self-adjusting hearing compensation device, and can also be applied to a hearing aid with an active noise reduction or digital signal processing circuit.

[0134] It is worth noting that if the above error still does not meet the error target, the device uses an application, its firmware, or cloud technology to re-quantify the error, and then generates another set of modified filter parameters using the compensation gain conversion model. The other set of modified filter parameters is then transmitted to the hearing compensation module via the wireless transmission network to perform another hearing gain compensation.

[0135] In summary, the self-adjustable hearing compensation device with real ear measurement and the self-adjustable hearing compensation method with real ear measurement of the present invention combine active noise reduction (ANC) technology with digital network technology and wireless transmission technology. Not only can the earphones emit reverse waves (or forward waves) with the same energy as the current noise to eliminate ambient noise in the ear canal, but when performing real ear measurement (REM), the hearing compensation module can also directly perform hearing gain compensation on the user's (especially the hearing-impaired patient's) instantly customized audiogram or audiometer (thereby amplifying the signals of each frequency band (such as forward signals and / or reverse signals)). It has the effect of automatically, instantly and customized hearing aids, hearing assistive devices or earphones with hearing aid functions for hearing-impaired patients.

[0136] In addition, the self-adjustable hearing compensation device with real ear measurement and the self-adjustable hearing compensation method with real ear measurement of the present invention consider the hearing loss characteristics of the hearing-impaired person through the compensation gain conversion model technology to provide representative test sentences for the hearing-impaired person, and then perform real ear measurement, thereby achieving the effect of automated, instant and customized hearing aids, hearing assistive devices or headphones with hearing aid functions for the hearing-impaired person.

[0137] Furthermore, in an embodiment of the present invention, the compensation gain conversion model can also automatically modify the compensation parameters of a self-adjusting hearing compensation device (e.g., SII (speech intelligibility index), HASQI, HASPI, etc.). The compensation gain conversion model can be set in a cloud, a server, or a smart device, but the present invention is not limited thereto.

[0138] Finally, in an embodiment of the present invention, a computer program product utilizes the application program, firmware or cloud technology of the device to execute the above contents, and can automatically store the original filter parameters or the modified filter parameters to a device or apparatus with sound source processing capability (such as Figure 2 110, such as a smart device, mobile device, speaker, or sound box, wherein the device or apparatus has a hearing compensation module for performing hearing gain compensation. Therefore, the computer program product can selectively synchronize the modified filter parameters to the self-adjusting hearing compensation device or synchronize the original filter parameters / the modified filter parameters to the device or apparatus with audio processing capabilities for audio processing and playback.

[0139] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the present invention. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be as set forth in the claims.

Claims

1. A self-adjusting hearing compensation device with real ear measurement, comprising: a first transducer receiving a first test signal from an electronic device and converting the first test signal into a first electrical signal; a first hearing compensation module connected to the first transducer and performing gain compensation on the first electrical signal; a second transducer connected to the first hearing compensation module, converting the gain-compensated first electrical signal into sound and transmitting the sound into the ear canal; as well as a third transducer, which simultaneously converts the sound transmitted in the ear canal into a second electrical signal, and transmits the second electrical signal to the electronic device via a wireless transmission network; The electronic device calculates the energy distribution of the second electrical signal in each frequency band and compares the energy distribution with the target gain and the hearing threshold error through the second hearing compensation module. If the error does not meet the error target, the electronic device quantifies the error and generates corrected filter parameters using a compensation gain conversion model. The corrected filter parameters are then transmitted to the first hearing compensation module via the wireless transmission network to perform hearing gain compensation.

2. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The first hearing compensation module is disposed in an active noise reduction chip or a digital signal processing circuit chip, and the second hearing compensation module is disposed in the electronic device.

3. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The modified filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit.

4. The self-adjusting hearing compensation device with real ear measurement according to claim 3, wherein: The filter parameters of the gain compensation of the active noise reduction are audio gain compensation filter unit parameters.

5. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The self-adjusting hearing compensation device further includes a storage module, wherein if the error meets the error target, the electronic device stores the modified filter parameters in the storage module.

6. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The electronic device stores the original filter parameters or the modified filter parameters in a device with a sound source processing capability, wherein the device has a third hearing compensation module for performing hearing gain compensation.

7. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The self-adjusting hearing compensation device further includes a wireless transmitting and receiving module, wherein the wireless transmitting and receiving module receives a second test signal from the electronic device through the wireless transmission network to perform hearing gain compensation.

8. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: If the error still does not meet the error target, the electronic device further quantizes the error and transmits the quantized error and auditory dynamic range application optimization parameters to the compensation gain conversion model. After generating another modified filter parameter using the compensation gain conversion model, the electronic device transmits the another modified filter parameter to the first hearing compensation module via the wireless transmission network to perform the hearing gain compensation.

9. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The self-adjusting hearing compensation device is arranged on a hearing aid with an active noise reduction or digital signal processing circuit.

10. The self-adjusting hearing compensation device with real ear measurement according to claim 1, wherein: The self-adjusting hearing compensation device also includes: a probe tube or an elongated earplug, one end of which is connected to the third transducer, and the other end of which is connected to the first bend of the external auditory canal or to a distance of 5 mm from the eardrum.

11. A self-adjusting hearing compensation method with real ear measurement, comprising: Receiving a first test signal from an electronic device via a first transducer and converting the first test signal into a first electrical signal; Performing gain compensation on the first electrical signal by a first hearing compensation module connected to the first transducer; The second transducer connected to the first hearing compensation module converts the gain-compensated first electrical signal into sound and transmits the sound into the ear canal; The sound transmitted in the ear canal is converted into a second electrical signal by a third transducer, and the second electrical signal is transmitted to the electronic device via a wireless transmission network; Calculating the energy distribution of the second electrical signal in each frequency band by the electronic device, and comparing the energy distribution with the target gain and the hearing threshold error by the second hearing compensation module; as well as If the error does not meet the error target, the electronic device quantifies the error to generate modified filter parameters using a compensation gain conversion model, and then transmits the modified filter parameters to the first hearing compensation module via the wireless transmission network to perform hearing gain compensation.

12. The self-adjusting hearing compensation method with real ear measurement according to claim 11, wherein: The modified filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit.

13. The self-adjusting hearing compensation method with real ear measurement according to claim 12, wherein: The filter parameters of the gain compensation of the active noise reduction are audio gain compensation filter unit parameters.

14. The self-adjusting hearing compensation method with real ear measurement according to claim 11, further comprising: If the error meets the error target, the electronic device stores the modified filter parameters in a storage module.

15. The self-adjusting hearing compensation method with real ear measurement according to claim 11, wherein: The electronic device stores the original filter parameters or the modified filter parameters in a device with a sound source processing capability, wherein the device has a third hearing compensation module for performing hearing gain compensation.

16. The self-adjusting hearing compensation method with real ear measurement according to claim 11, wherein: If the error still does not meet the error target, the electronic device further quantizes the error and transmits the quantized error and auditory dynamic range application optimization parameters to the compensation gain conversion model. After generating another set of modified filter parameters using the compensation gain conversion model, the electronic device transmits the another set of modified filter parameters to the first hearing compensation module via the wireless transmission network to perform the hearing gain compensation.

17. The self-adjusting hearing compensation method with real ear measurement according to claim 11, wherein: The self-adjusting hearing compensation method is applied to a self-adjusting hearing compensation device, or to a hearing aid with an active noise reduction or digital signal processing circuit.

18. The self-adjusting hearing compensation method with real ear measurement according to claim 11, wherein: The first hearing compensation module is disposed in an active noise reduction chip or a digital signal processing circuit chip, and the second hearing compensation module is disposed in the electronic device.

19. The self-adjusting hearing compensation method with real ear measurement according to claim 11, wherein: After calculating the energy distribution of the second electrical signal in each frequency band by the electronic device and comparing the energy distribution with the target gain and the hearing threshold error by the second hearing compensation module, the method further includes: Calculating a required gain compensation using a compensation prescription based on the hearing threshold, and transmitting the required gain compensation to a compensation gain conversion model; and calculating required auditory dynamic range application optimization parameters using auditory dynamic range application optimization based on the hearing threshold, and transmitting the required auditory dynamic range application optimization parameters to the compensation gain conversion model; and If the error does not meet the error target, the electronic device quantifies the error and transmits the error to the compensation gain conversion model. After the compensation gain conversion model generates modified filter parameters, the modified filter parameters are transmitted to the first hearing compensation module via the wireless transmission network to perform hearing gain compensation.

20. A computer program product for executing the self-adjusting hearing compensation method with real ear measurement according to any one of claims 11 to 19.

Images