Systems and methods for validating hearing aids for young children using speech signals - Patents.com

By placing electrodes on the scalp of children with hearing impaired hearing, and recording auditory responses using natural sound stimulation, the problem of inability to effectively evaluate hearing assistive devices in the prior art is solved, and objective performance verification of hearing assistive devices is achieved.

JP7626567B2Active Publication Date: 2025-02-04INTERACOUSTICS
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023177625
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2018-06-29
Filing Date
2023-10-13
Publication Date
2025-02-04
Estimated Expiration
2039-06-28

AI Technical Summary

Technical Problem

The prior art is difficult to verify the performance of effective hearing assistive devices (i.e., hearing headphones) in children with hearing impairments, especially the inability to effectively evaluate the performance of their hearing assistive devices through active physical or verbal responses.

Method used

A diagnostic device and method is used to record auditory evoked responses by placing electrodes on the child's scalp using natural sound stimuli (such as native voice) to generate amplitude and/or frequency modulated natural sound stimuli, ensuring that the stimuli are not recognized as noise by the hearing assisting device, thereby recording auditory evoked responses and achieving objective evaluation of the hearing assisting device.

Benefits of technology

It can objectively evaluate the performance of hearing assist devices, ensure their hearing assist effects on children, avoid misleading assessments of children who cannot actively respond, and provide more accurate performance verification of hearing assist devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007626567000004
    Figure 0007626567000004
  • Figure 0007626567000005
    Figure 0007626567000005
  • Figure 0007626567000006
    Figure 0007626567000006
Patent Text Reader

Abstract

To provide a system for validation of performance of hearing aids, especially in infants.SOLUTION: The validation of performance of hearing aids after being fitted to a child who is not able to subjectively provide responses to sounds presented to the child via the hearing aids is instead done in an objective manner by using a naturally occurring signal, which has been modulated to create an ASSR-evoking speech stimulus which is not regarded as noise by a hearing aid.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a hearing diagnostic system configured to perform an objective validation of hearing aid performance by presentation of sounds to the ears of a human test subject in the absence of an active, intentional response from the test subject. More particularly, the present disclosure relates to a system including a diagnostic apparatus and method that allows validation of hearing aid performance, particularly in infants and young children, by measures of auditory evoked responses from the human scalp. [Background technology]

[0002] Children who are diagnosed with possible hearing loss through hearing screening performed early after birth are referred for further diagnostic testing to assess the cause of the hearing loss and the degree of hearing loss present. In particular, it is important to assess the degree of hearing loss, and tests have been developed that indicate the degree of hearing loss from measurements of neural activity evoked by hearing. One challenge is that small children - whether with normal hearing or those with reduced or lost hearing - are physically unable to provide an answer as to whether they hear a sound or not, so objective neurological tests are performed instead. Such tests include, among other tests, measurements of brain activity related to hearing, called evoked potentials, such as the auditory brain response (ABR) or auditory steady-state response (ASSR). In such tests, stimuli designed to produce an auditory evoked response from the brain are delivered to the child's ears, and electrodes placed on the child's scalp record the brain responses resulting from the stimuli. From these responses given at various frequencies of hearing, the degree of hearing loss for each frequency can be assessed with an audiogram, and hearing aids can be programmed to compensate for the measured hearing loss indicated by the audiogram data. Another type of stimulus signal used in a similar test is the Cortical Auditory Evoked Potential (CAEP) test. These signals are structured as several different speech sounds, called phonemes, such as m, g, t, which are presented through a speaker at various levels. The evoked responses to these sounds are recorded from the surface of the head, recorded through electrodes, and analyzed by computer. Thus, the CAEP test signal is simply a signal containing phonemes and is not structured as continuous speech. More specifically, the phonemes used as stimuli in CAEP measurements are short speech fragments.

[0003] Once a hearing aid has been programmed to compensate for the measured hearing loss, the compensation provided by the hearing aid must be verified and further validated to ensure that the hearing loss is properly compensated and that the child can actually hear the relevant sounds played through the hearing aid. The verification process aims to provide an objective estimate of the sound that the hearing aid produces in the human ear. This process ensures that the hearing aid works as intended and programmed. However, once it has been ensured that the hearing aid is working as intended (e.g., meeting a predefined target gain, etc.), it is then necessary to perform a more subjective evaluation of whether the hearing aid performance actually meets the needs of the hearing impaired person. This procedure is called validation. Traditionally, this validation process requires the hearing impaired person to actively provide verbal or other physical responses to assess whether certain sounds, sound levels, noises, etc. meet the needs of the hearing impaired person (i.e., "subjective evaluation"). When fitting children, especially infants and very young children, these physical responses or reactions to sounds played to the child's ears cannot be fully evaluated because the child may not be able to speak or express purposefully in response to the sounds played to the child. Thus, the effectiveness of the amplification settings should be evaluated by other means. For children, current methods rely on the child's understanding and active participation, which is not a given for young children and infants. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Wouter A. Dreschler, Hans Verschuure, Carl Ludvigsen & Soeren Westermann (2001) ICRA Noises: Artificial Noise Signals with Speech-like Spectral and Temporal Properties for Hearing Instrument Assessment: Ruidos ICRA: Senates de ruido artificial con espectro similar al habla y propiedades temporales para pruebas de instrumentos auditivos, Audiology, 40:3, 148-157, DOI: 10.3109 / 00206090109073110 Summary of the Invention [Problem to be solved by the invention]

[0005] There is therefore a need to provide systems, methods and tools that allow for the assessment and validation of the "subjective" hearing performance of a hearing aid when subjective physical, verbal or active intentional responses cannot be obtained from a test subject, e.g., a young child with a hearing impairment. [Means for solving the problem]

[0006] The present disclosure provides systems, methods and tools that allow hearing care professionals to objectively validate the performance of hearing aids for children, for example, when an active, intentional response from the child being treated for hearing impairment cannot be expected. The system is configured to perform a hearing test, and a validation mode is used to evaluate the hearing of a person, for example, a small child, when the person is in an assisted state (i.e., when the child is wearing a hearing aid). To perform such an objective evaluation, the system has one or more electrodes configured to be placed on the scalp of the person under test, and the one or more electrodes are configured to be connected to a diagnostic device. It should be noted that the term "person under test", "hearing impaired person" or other similar terms referring to a test subject in this context mainly relate to small children who are unable to provide an intentional physical response to a stimulation signal. However, it can also include other hearing impaired people who have difficulty expressing themselves physically or verbally. Similarly, a "hearing aid" should be understood to be any hearing prosthetic device, including cochlear implants, bone-anchored hearing aids, etc.

[0007] For generating the stimulus signal used in the objective validation mode, the system further comprises a sound-emitting device connected to the diagnostic device and configured to transmit the generated sound stimuli to the aided ear of the person.Furthermore, the diagnostic device is set at least in a validation mode, and for transmitting the sound stimuli and recording and processing response data received from the hearing test, the diagnostic tool comprises a signal generator configured to transmit the generated stimuli to the sound-emitting device, a recording processor configured to receive response signals from one or more electrodes placed on the scalp of the test subject, and a control unit configured to control an operation mode of the diagnostic device, wherein in the validation operation mode, the signal generator is configured to generate the sound stimuli and transmit the generated sound stimuli to the sound-emitting device, the generated sound stimuli being configured as amplitude and / or frequency modulated naturally occurring sounds.

[0008] In other words, a system is provided that includes a diagnostic device and one or more electrodes configured to record an auditory evoked response from the human brain. The diagnostic device is configured to transmit stimuli generated from naturally occurring sounds. The naturally occurring sounds are input to the diagnostic tool or are already provided in a sound processor of the diagnostic tool, and the naturally occurring sounds are amplitude and / or frequency modulated, thus generating frequency and / or amplitude modulated stimuli from the naturally occurring sounds. Sound stimuli that can be generated by using such amplitude and / or frequency modulated naturally occurring sounds can evoke an auditory brain response and at the same time are not merely "speech-like" but are actually generated, for example, from a speech signal, and thus have less distortion than known types of speech-like stimuli used to detect auditory evoked responses.

[0009] Thus, the definition of naturally occurring sound should be interpreted as a sound that exists naturally in the human environment and is not processed by any machine, computer, processor, etc. In this application, natural means "naturally occurring or created by nature (as opposed to artificial)". Thus, naturally occurring sounds can be human spoken speech signals, bird calls, dogs barking, children playing, live music, piano music, etc. In other words, naturally occurring sounds are interpreted as "continuous speech" in the case of speech, which is defined as a continuous sound of spoken dialogue in which the listener can identify individual words and sentences. Thus, the stimuli used in this setup are naturally occurring sounds, such as continuous speech, modulated in frequency and / or amplitude, in the preferred embodiment. The stimuli are stimuli that include continuous speech, as opposed to, for example, CAEPs (fragments of speech used as stimuli as described above), and not just selected fragments (phonemes) of continuous speech.

[0010] It should be noted that in a preferred embodiment, the auditory evoked response detected is the auditory steady-state response (ASSR) or the envelope tracking response (EFR).

[0011] More specifically, when the "subjective" performance of the hearing aid is evaluated for its validity, and no subjective physical, verbal or active intentional response is obtained from the test subject, e.g., a small child with hearing impairment, it is important that the test stimulus is sufficiently speech-like to be classified as speech by one or more hearing aids placed behind the child's ear. It should be noted that the application described herein can be used for in-the-ear hearing aids as well. When normally used auditory evoked response stimuli are presented to a hearing aid, they are treated by the hearing aid as noise, which can lead to misleading results in the validation process. Instead, according to the present disclosure, it has been found that it is possible to provide speech-like naturally occurring sounds and generate frequency and / or amplitude modulated versions of these naturally occurring sounds to generate auditory evoked response stimuli that are not considered noise by the hearing aid. Thus, in the validation process of the hearing aid, such stimuli are presented to the hearing aid and include components of the stimulus signal that are not modified or removed from the stimulus by the hearing aid, as is the case for example with standard chirp stimuli. In this way, by providing frequency and / or amplitude modulated stimuli based on naturally occurring signals, e.g. speech, during the validation phase of hearing aid testing, it is possible to obtain auditory evoked responses from the test subject's brain to objectively and accurately assess the "subjective" performance of the hearing aid with respect to the selection of hearing aid gain and signal processing features.

[0012] It should be noted that in the following the generated sound stimuli should be understood to be sound stimuli based purely on naturally occurring sounds (see definition above), preferably speech signals, amplitude and / or frequency modulated to create the required auditory evoked components in the signal.

[0013] In some embodiments, the sound emitting device may be configured as one or more hearing aids that are placed on the ear or ears of the test subject in a validation mode of the diagnostic device in order to transmit the generated stimuli based on naturally occurring sounds to a hearing aid. Thus, in some embodiments, the generated sound stimuli may be transmitted directly to the ear of the hearing aid user via the hearing aid.

[0014] In a more preferred embodiment, the sound emitting device is configured as a loudspeaker, which in this embodiment is connected to the diagnostic device and is arranged externally with respect to said one or more hearing aids. By arranged externally, it should be understood that the loudspeaker is located in the surrounding environment with respect to the hearing aids. That is to say, the loudspeaker in this embodiment may be arranged at a distance from the hearing aids arranged on the patient / child in the "test room". The loudspeaker is configured to receive the generated sound stimuli from the signal generator and to play the generated sound stimuli to one or more hearing aids arranged on the human ear. Presenting the sound stimuli to the hearing aids via the loudspeaker ensures that the sound presented to the user's ear is processed in the normal way in the hearing aid. In this way, when the sound is presented to the user's ear, it undergoes the same hearing aid processing as used in daily life for real speech signals, and due to the fact that the sound stimuli are generated from naturally occurring sounds, the sound is not considered as noise by the hearing aid and is therefore transmitted to the user's ear with substantially the full frequency content and with sufficient amplification for real speech. Amplitude and / or frequency modulation applied to the naturally occurring sound then acts to elicit an auditory brain response, which can be recorded by electrodes placed on the scalp of the hearing aid user.

[0015] The fact that the proposed stimuli are not only speech-like but are based on real naturally occurring signals, e.g. speech, has the added advantage of supporting the face validity of the validation test for both the clinician and the parent / caregiver of the child being tested. Thus, in the validation mode, the diagnostic tool is configured to transmit the generated sound stimuli to one or more hearing aids via the hearing aid or via an externally placed loudspeaker, so that the hearing aid presents the transmitted generated sound stimuli at the person's ears, such that an auditory evoked response is generated and recorded by an electrode placed on the scalp. The recorded evoked response is transmitted to the diagnostic device as an auditory evoked response (AER), such as an auditory steady state response (ASSR).

[0016] The naturally occurring sounds processed with amplitude and / or frequency modulation are preferably sounds recorded in the testing environment of the child being tested. That is, in one embodiment, the sound stimuli are generated from recordings of naturally occurring sounds input to the diagnostic device. That is, for example, the child's parent may speak into an external microphone, whereby the parent's speech is recorded and used as input to the sound stimuli generation. Thus, the naturally occurring sounds are provided as human speech in one embodiment, and the recorded naturally occurring sounds are transmitted to the diagnostic device by wire or wirelessly. In the diagnostic device, a sound stimulus generator processes the recorded human speech to generate amplitude and / or frequency modulation of the recorded naturally occurring sounds, and the resulting sound stimuli are transmitted to a loudspeaker or directly to the hearing aid of the child being tested, as described above. By enabling the possibility of recording speech from, for example, a parent, it is ensured that a child fitted with a hearing aid and being tested for hearing impairment is presented with the voice of, for example, the child's mother or father, and not with an artificially generated speech signal (for example the international speech test signal (ISTS)) which may be constructed from the voices of several different speakers. The ISTS signal is an internationally recognised test signal that can be used for the technical evaluation of hearing instruments and for probe-microphone measurements. The ISTS si is based on natural recordings of speech that is unintelligible due to remixing and segmentation. In contrast, the voice presented to the child is as close as possible to the child's normal everyday life, and at the same time the child's mother or father can actually experience, during validation testing, how the child can hear their voice as a direct result of hearing aid fitting.

[0017] In another embodiment, the naturally occurring sounds may be recorded via a computer or another external device and then transmitted to the diagnostic tool. That is, the sound stimulus generation of the recorded naturally occurring sounds, preferably speech signals, may be performed within the diagnostic tool, but also within a device external to the diagnostic tool, such as a computer, a mobile phone app or a similar device. In this way, independent of the medium on which the sound stimulus generation (processing of the recorded sounds) is performed, the processing steps performed on the recorded naturally occurring signals are the same.

[0018] Thus, in an embodiment, a recorded naturally occurring sound is received in a sound signal generator (e.g., in a diagnostic tool or other medium capable of processing signals), and the recorded naturally occurring sound is processed in the following steps: first, the recorded naturally occurring sound is filtered into a number of frequency subbands, second, each of the number of frequency subbands is independently amplitude and / or frequency modulated, and in a third step, the amplitude and / or frequency modulated subbands are combined to form a sound stimulus. Thus, a natural recorded sound, preferably a speech signal, is divided into different frequency subbands, allowing multiple, smaller ranges of the full frequency range of hearing to be tested simultaneously by the sound stimulus. Thus, each band is frequency and / or amplitude modulated to ensure that each subband contains a component capable of eliciting an auditory evoked response, preferably an auditory steady-state response.

[0019] In an alternatively preferred embodiment, a recorded naturally occurring sound is received at a sound signal generator (e.g., at a diagnostic tool or other medium capable of processing signals) and the recorded naturally occurring sound is processed in the following steps: First, the recorded naturally occurring sound is frequency or amplitude modulated by a plurality of modulator functions having different modulation rates; secondly, each of the plurality of amplitude and / or frequency modulated recorded naturally occurring sounds is then filtered by one of a plurality of frequency sub-bands selected for each of the modulations of the recorded naturally occurring sounds; Further, the amplitude and / or frequency modulated sub-bands are combined to form said sound stimulus.

[0020] For each of the above alternatives, more specifically, the amplitude and / or frequency modulated frequency subbands may be adjusted in magnitude to align with a predefined set of values ​​to ensure that the subband magnitudes are in accordance with the desired test target levels for each stimulus subband in question, or to ensure that the stimuli generated resemble natural speech signals. The latter approach serves two purposes: 1) to further ensure that the hearing aid processes the stimuli as speech and not as noise, and 2) to ensure that a validation test indeed indicates whether or not a real speech signal is heard when the hearing aid is used.

[0021] Thus, in one embodiment, the predetermined set of values ​​is provided as a set of band powers of a standardized speech test signal in any frequency subband, or the predetermined set of values ​​is provided as band powers of recorded naturally occurring sounds. It should be understood that the standardized speech test signal in one embodiment may be the International Speech Test Signal (ISTS), or, for example, the ICRA 1-talker babble (Non-Patent Document 1). In this way, it can be ensured that the sound stimuli generated from naturally occurring sounds have a sufficient magnitude to resemble a normal speech signal, thereby eliciting an auditory evoked response representative of real speech input, while at the same time the hearing aid processes the entire stimulus signal as speech and not as noise.

[0022] It should be noted that in any of the above embodiments, a standardized speech signal can also be used as an input signal to the signal generator.

[0023] Due to frequency and / or amplitude modulation of recorded sounds or naturally occurring sounds, e.g. standardized speech signals, the signal may be somewhat distorted compared to a clean speech signal. However, in order to improve the speech content of the resulting stimuli, the processing step of generating the sound stimuli may include a further step of setting the amplitude and / or frequency modulation rate for one or more of said subbands to zero, so as to leave the respective subband unmodified. This effectively ensures that the frequency and / or amplitude modulation does not affect the particular subband whose speech content is left unmodified. This may be advantageous to enforce that the stimuli are (very close to) real speech. Authenticity (closeness to authenticity) is a potentially important feature of the proposed validation method with regard to counseling the parents / guardians of the child under test as well as the clinician performing the validation test.

[0024] The system is configured such that an auditory evoked response, preferably an auditory steady-state response, can be detected from measurements with electrodes placed on the scalp of a test subject, preferably a small child. Thus, the system is configured such that the diagnostic tool in a validation mode controls the transmission of a sound stimulus to the child's ear via the hearing aid. The stimulation signal is transmitted continuously until responses are measured for all tested subband frequencies or until the test is terminated for reasons of futility (i.e. no detection is expected after prolonged testing). Thus, in an embodiment, the diagnostic tool is configured to control a first transmission, in which the entire frequency band of the sound stimulus is played to the hearing aid. Upon detecting a response from the electrodes in a particular frequency subband, that particular frequency subband is switched off (i.e. set to 0), removing that particular frequency subband in which a response is detected from the stimulation. This is done to minimize stimulation band interactions, or spreading of excitation in the cochlea, which may prevent detection of frequency subbands that have not yet been detected. In this way, the remaining subband evoked responses can be detected faster. Thus, each time a response from an electrode is detected for a particular frequency, the respective sub-band for that frequency is turned off and the remaining frequency content of the stimulation signal is presented to the small child's ear via the hearing aid.

[0025] In principle, any frequency can be tested in the described setup. However, the frequencies that are most interesting for characterizing hearing impairments are the main focus of this application. Thus, in one embodiment, naturally occurring sounds may be band-pass filtered into four octave-wide frequency sub-bands with center frequencies of 500 Hz, 1 kHz, 2 kHz and 4 kHz.

[0026] Preferably, each subband may be amplitude and / or frequency modulated by a modulator function having a different modulation rate for each subband, allowing separation in the frequency domain of the auditory evoked responses from each stimulation subband.

[0027] In general, as described in more detail herein, each of the modulator functions applied to generate sound stimuli from naturally occurring sounds is preferably configured as a sine wave.

[0028] Furthermore, the most interesting auditory evoked response for this application is, as already suggested, the auditory steady-state response, which is why the response signal recorded from the electrodes is preferably the auditory steady-state response (ASSR).

[0029] The embodiments of the present disclosure may be best understood from the following detailed description taken in conjunction with the accompanying drawings, which are schematic and simplified for clarity, and which only show details to improve understanding of the claims, with other details omitted. The same reference characters are used throughout for identical or corresponding parts. Each individual feature of each embodiment may be combined with any or all features of the other embodiments. [Brief description of the drawings]

[0030] Embodiments, features and / or technical advantages will become apparent from and be elucidated with reference to the drawings described below. [Figure 1] FIG. 1 illustrates various portions of a system according to an embodiment of the present disclosure. [Diagram 2] FIG. 1 illustrates portions of a system according to an embodiment of the present disclosure. [Diagram 3] FIG. 2 shows different parts of the system according to FIG. 1, where naturally occurring sounds are recorded, for example speech from a mother to her child. [Figure 4] FIG. 3 shows various parts of the system according to FIG. 2, where naturally occurring sounds are recorded, for example speech from a mother to her child. [Diagram 5] 1 shows an example of a speech signal in the time domain. [Figure 6] 6 shows the frequency spectrum of the speech signal in FIG. [Figure 7]6 shows a modulation function and the resulting signal from applying the modulation function to the speech signal of FIG. [Figure 8] 8 shows the frequency spectrum of the modulated signal of FIG. [Figure 9] 1 illustrates a schematic of a preferred embodiment of a method for generating ASSR speech stimuli. [Figure 10] 4 illustrates an exemplary modulation power of a bandpass filtered version of an international standardized speech signal. [Figure 11] 1 shows exemplary modulation power of a bandpass filtered version of a four-band modulated international standardized speech signal. [Figure 12] Figure 1 shows the long-term one-octave power spectrum of the international normalized speech signal and the four-band modulated international normalized speech signal after adjusting the amplitudes of each of the four component bands. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031] Referring initially to Figure 1, a diagram of various parts of a system according to one embodiment of the present disclosure is shown. As seen in Figure 1, the system 1 comprises a diagnostic device 2, one or more electrodes 31, 32, and a sound-emitting device 4. Furthermore, Figure 1 shows the setup of the system 1 in a diagnostic validation mode. In this mode, a child 3 is presented with sound stimuli via the sound-emitting device 4, one or more electrodes 31, 32 are placed on the scalp 33, and the system may perform a hearing test, in particular a validation test, to evaluate the performance of a hearing aid that can compensate for the child's hearing loss.

[0032] As shown, one or more electrodes 31, 32 are configured to be placed on the scalp 33 of a test child 3 (or other hearing-impaired test subject) and are configured to be connected (e.g. via wires 42, or alternatively wirelessly) to a diagnostic device 2. In the embodiment shown in Figure 1, a sound-emitting device 4 is configured as a probe connected to the diagnostic device 2 and configured to deliver sound stimuli 41 to the ears of the child 3. The sound stimuli 41 may be generated within the diagnostic device 2 or externally, as will be apparent in the following description of the embodiments.

[0033] The diagnostic tool 2 is more particularly configured to be set in at least a validation mode. Thus, the diagnostic tool 2 may have a control unit 24 configured to control one or more operating modes, but for the present application, the validation mode is considered in more detail in the context of validating the performance of a hearing aid after fitting it to a child, for example. Furthermore, the diagnostic tool has a signal generator (SG) 22 configured to transmit generated stimuli to the sound-emitting device 4. To record responses obtained from the electrodes 31, 32 placed on the scalp 33 of the child 3, the diagnostic device is configured with a recording processor (RP) 23 receiving as input the responses obtained by the electrodes 31, 32. Thus, the diagnostic tool 2 is configured to be controlled by a user, for example a hearing care professional, a doctor or other professional, who intends to test, screen and, most importantly for the present application, validate a hearing aid to be fitted to, for example, a small child with hearing impairment. As will be apparent, when the diagnostic tool is controlled to be in a validation mode, it is configured to cause the signal generator 22 to generate an audio stimulus and to transmit the generated audio stimulus to the sound-emitting device 4, where the generated audio stimulus is configured as an amplitude and / or frequency modulated naturally occurring sound.

[0034] A few remarks should be made here. First, it should be noted that the sound stimuli can be generated within the diagnostic tool, but also externally. Second, the sound-emitting device can be a probe, as shown diagrammatically in FIG. 1, but also a loudspeaker, as shown in FIG. 2. In addition, it should be noted that the sound emitted to the ear should preferably undergo a processing scheme corresponding to the processing performed by a hearing aid before the sound is presented to the ear. Thus, in a preferred embodiment, the child to be tested should have a hearing aid placed in the ear and the sound should be emitted to the ear via the aid. When the sound is presented via a loudspeaker, one ear should be tested at a time, and the non-tested ear should be plugged, for example, with a foam ear-plug.

[0035] In general, the system described herein allows the performance of a hearing aid to be evaluated for children who are hearing impaired and cannot provide a response to the signal sent to the child's ear. Thus, this objective validation setup provided by the present system allows for stimuli that are not considered noise when processed by the hearing aid, but activate the child's brain and allow electrodes to record the auditory steady-state response that the stimuli elicit. Whereas current validation methods rely solely on facial changes, noise, or similar spontaneous physical changes that a child exhibits when presented with different stimuli, this system and method allows for an objective evaluation of the performance of a hearing aid, rather than a subjective evaluation based on facial expressions, etc., from the child under test.

[0036] In the following, we will describe in more detail the various system setups and finally, how to generate the sound stimuli, which may be based on naturally occurring sounds, preferably speech. Note that corresponding features of each embodiment are numbered the same in the following description of the various embodiments.

[0037] A preferred set-up of the system will now be described with reference to Fig. 2. Here, the set-up is more or less as described in relation to the embodiment of Fig. 1, with the difference that the sound emitting device is configured as a loudspeaker 25, which is connected wired or wirelessly to the diagnostic tool 2 and emits the generated sound stimuli 41. In this embodiment, the child 3 is wearing the hearing aid(s) 104 whose performance is to be evaluated. In the set-up according to Fig. 2, as explained above, only one ear is tested at a time, while the second ear is preferably plugged. Thus, in this set-up, the diagnostic tool 2 is set in a validation mode 21 via the control unit 24 and is configured to generate sound stimuli configured as amplitude and / or frequency modulated naturally occurring signals. The generated stimuli are transmitted wirelessly or wired to the loudspeaker 25, which emits the sound stimuli 41. The emitted sound stimuli are picked up by the hearing aid 104, which processes the sound stimuli as usual according to the hearing aid settings and then emits the sound stimuli to the ear 34 of the child 3.

[0038] The emitted sound stimuli elicit a brain response known as the Auditory Steady-State Response (ASSR), which is picked up by electrodes 31, 32 placed on the scalp 33 of the child 3. The ASSR signal picked up by the electrodes 31, 32 is transmitted to the diagnostic device 2, where a detection scheme is used to detect whether a response is present or not. An important note here, and for all other embodiments described, is that the sound stimuli are processed by the hearing aid in a similar manner to normal speech and at the same time are capable of eliciting an ASSR.

[0039] In another embodiment shown in Fig. 3, most of the features described in the previous embodiment are present and are numbered accordingly. In Fig. 3, an embodiment is shown in which the sound stimuli are generated from recordings of naturally occurring sounds. Here, the naturally occurring sounds are configured as speech signals 7, which are recorded via a recording device 5. The recorded speech signals 7 are input to the diagnostic device 2 via a transmission line 51, e.g. a wired or wireless transmission. In the diagnostic device 2, the recorded speech signals 7 are input to a sound stimuli generator 22, which generates an amplitude and / or frequency modulation of the speech. This generates a sound stimulus 41 that is delivered to the child 3 via a probe as shown in Fig. 3, or preferably via a loudspeaker 25 and a hearing aid 104, as shown in the embodiment of Fig. 4. By providing a system setup in which the voice of the parent, e.g. the mother's voice, can be recorded, processed and used as a frequency and / or amplitude modulated stimulus signal, it is ensured that from an early stage the child 3 hears a known voice and at the same time the parents actually experience that the child can hear their own voice.

[0040] As implied, the embodiment of FIG. 4 shows a similar setup as described in relation to FIG. 3, but in the embodiment of FIG. 4, sound stimuli 41 are presented to the hearing aid 104 via a loudspeaker, as also described in relation to FIG. 2. Thus, in this system setup, a parent 6 (illustrated as a mother) provides a speech signal 7 that is recorded by a microphone 5. The signal is transmitted (51) wired or wirelessly to a diagnostic device 2, where a sound stimulus generator 22 generates sound stimuli 41 that are used to elicit a brain response, such as an auditory steady-state response. The remaining process is similar to that described in the previous embodiment and will therefore not be described in further detail. As also described in relation to the embodiment of FIG. 2, in this setup, preferably only one ear is tested at a time, while the second ear is occluded.

[0041] It should be noted that for each of the system setups described in the above embodiments, the diagnostic device is shown diagrammatically as a computer, however, this should not be limiting and it will be appreciated that the diagnostic device may equally well be comprised by a dedicated handheld or benchtop diagnostic device incorporating the same functionality.

[0042] In addition, the naturally occurring sounds used to generate the sound stimuli that elicit the ASSR signals may be standardized speech signals, which are stored in the memory of the diagnostic device 2.

[0043] On another note, it should be noted that in the case of a recorded speech signal, e.g., as described in relation to Figures 2 and 4, this recorded speech signal can be processed in the auxiliary device of the diagnostic tool and then, after undergoing the necessary processing (described below), input into the memory of the diagnostic device or into said signal generator to generate a naturally occurring speech signal, having characteristics that enable the speech stimuli to elicit ASSR signals in the brain without being classified as noise by the hearing aid.

[0044] Up to now, we have provided a detailed description of the system set up in its diagnostic validation mode. Below, we provide a detailed description of the actual processing of naturally occurring sounds required to generate naturally occurring sounds, preferably speech, that can be used as ASSR elicitation stimuli.

[0045] Referring initially to Figures 5 and 6, a time series of a naturally occurring sound, such as speech 7, is shown together with its frequency spectrum 71. Such a speech signal is preferably used in the system described herein, since speech is of primary importance to hearing. Thus, the speech signal shown in Figure 5 can be, for example, a recorded speech signal as shown in Figures 2 and 4. Alternatively, it can be a standardized speech signal, for example stored in a diagnostic device.

[0046] In Fig. 7 it is shown how amplitude modulation of a speech signal can be performed: an ASSR-eliciting stimulus may be generated from a speech signal g(t) by multiplying the speech signal g(t) with a sinusoidal amplitude modulation to generate a stimulus as given in equation (1).

[0047] s(t)=[1+cos(2πf R t)]·g(t) (1) where f R is the "repetition rate" or modulation frequency, e.g., 90 Hz. In the frequency domain, this corresponds to equation (2) and the diagram shown in FIG. S(f)=G(f)+(1 / 2)[G(ff R )+G(f+f R )] (2) where S and G are the spectra of s and g, respectively, and f is the frequency. In this example, the speech signal is amplitude modulated across the frequency range of the speech signal.

[0048] However, in a preferred embodiment, a speech signal (i.e., naturally occurring sound) is received at the speech signal generator (from a recording of speech or from a memory, e.g. as described above). Generally speaking, it should be understood that for all of the described embodiments, the speech signal (i.e., the naturally occurring signal) is modified to become the ASSR stimulus, as shown in Figure 9. Amplitude and / or frequency modulation of the naturally occurring sound can be performed in two alternative ways.

[0049] In a first preferred alternative shown in Figure 9, a sound stimulus 41 is generated in a sound signal generator in the following steps: First, a recorded naturally occurring sound (such as speech 7) is frequency or amplitude modulated (220) with multiple modulator functions 221, 222, 223, 224 having different modulation rates. Secondly, each of the plurality of amplitude and / or frequency modulated recorded naturally occurring sounds 221, 222, 223, 224 is filtered by one of a plurality of band pass filters 225, 226, 227, 228 selected for each of the modulations 221, 222, 223, 224 of the recorded naturally occurring sounds, and further, the amplitude and / or frequency modulated sub-bands are combined (229) to form the sound stimulus 41.

[0050] More specifically, in the context of the system setup, the recorded speech signal 7 is input to a signal generator 22 (see other embodiments described). In the signal generator, the speech signal 7 is amplitude or frequency modulated (220) using, for example, four modulator functions 221, 222, 223, 224 with different modulation rates. This ensures that the recorded auditory evoked responses for the different stimulus subbands (described below) can be separated in the frequency domain. If the speech signal 7 is modulated, for example, by four modulator functions 221, 222, 223, 224 as shown in FIG. 9, each of the four modulated speech signals is input to a filtering process 230. In this filtering process, a specific band-pass filter 225, 226, 227, 228 is selected for each individual modulated speech signal 221, 222, 223, 224. This ensures that four sub-bands of the modulated speech signal are generated for the purpose of testing hearing in corresponding specific frequency ranges. The sub-bands are then summed (229) (i.e., combined) to generate the speech ASSR stimulus that is used to detect ASSR in the described setup. As mentioned above, the speech ASSR stimulus thus generated is transmitted to the ear, preferably via a hearing aid, by a speaker, such as the loudspeaker described in connection with Figures 2 and 4.

[0051] In a second alternative (not shown in more detail), naturally occurring sounds (i.e. speech) are processed in the speech signal generator in the following steps. First, the speech signal is filtered into a number of frequency subbands by a number of corresponding bandpass filters. Secondly, the frequency subbands are amplitude and / or frequency modulated, i.e. each subband is amplitude and / or frequency modulated, thereby generating different frequency or amplitude modulated subbands of the speech signal which are combined in a final stage to form the sound stimulus.

[0052] In a first preferred alternative, a frequency specific embodiment of the present invention comprises:

number

[0053] For the second alternative, a frequency-specific embodiment of the present invention divides the speech signal into I subbands g i (t)=h BPi (t)*g(t) and imposing amplitude modulation with different repetition rates independently on each subband, e.g.

number

[0054] Different modulation patterns can be achieved in the frequency domain by adding more subbands to the frequency modulated speech signal S(f) or by substituting, for example, 0<A≦1およびN> 0, we use a different modulator function in the time domain, e.g. [1+A·cos(2πf R t)] N It should be noted that by using , a shallower or sharper peaked modulation pattern can be generated.

[0055] In order to ensure that the generated sound stimuli are sufficiently close to the original speech signal after processing with frequency and / or amplitude modulation of the frequency sub-bands, the amplitude and / or frequency modulated stimuli are adjusted in absolute value to align with a set of predefined values. This is preferably done by adjusting the level of each band-pass filtered component of the combined stimuli as follows for the two alternatives mentioned above, respectively:

number

[0056] Here, the value B i , i=1,…,I is a set of predetermined values ​​as mentioned above. As an example, FIG. 12 shows the amplitude B i , i=1,…,4 after adjustment.

[0057] Similarly, although not shown, the modulated modified naturally occurring speech signal may be adjusted in band power to ensure that the speech content corresponds to the actual unmodified recorded speech signal.

[0058] The advantage of an amplitude modulated speech signal (such as an ISTS signal) over a known signal is that it preserves important characteristics of speech that are critical for the classification algorithms of hearing aids. One of the most important characteristics of speech used for signal classification in hearing aids is the modulation power. The modulation power spectrum is determined by estimating the envelope of the signal and taking the Fourier transform of the envelope. As an illustration of how the disclosed method preserves the modulation power structure of a speech signal, examples in Figs. 13 and 14 are provided. Figs. 13 and 14 show modulation spectra calculated in 1 / 3 octave wide frequency bands for both the original ISTS and the four-band modulated ISTS. For the latter, the ISTS was filtered into four one-octave wide frequency bands centered at 500 Hz, 1 kHz, 2 kHz and 4 kHz, with each band being 100% amplitude modulated at 90.82 Hz, 97.66 Hz, 88.87 Hz and 92.77 Hz, respectively. The results in Figures 13 and 14 show only minor changes to the modulation spectrum between the original ISTS and the 4-band modulated ISTS. The sound quality of the original speech (or any other carrier signal) is affected by the amplitude modulation, but the stimuli are easily recognized.

[0059] It should be noted that in further steps of stimulus generation, one or more subbands may be left unmodified, thereby preserving a more natural sound quality of the speech signal. Thus, in a processing step, the amplitude and / or frequency modulation factor for one or more of the subbands is set to 0, so as to leave the respective subband unmodified.

[0060] It should be noted that upon detection of a response, the particular frequency subband in which the response is detected is set to 0 (i.e., turned off) in one embodiment, thereby removing the particular frequency band in which the response is detected from the stimulus. This allows for stronger contributions from undetected frequency subbands in the sound stimulus, and potentially allows for faster detection rates for the remaining frequency subbands. Thus, the stimuli are presented to the child's ears until all necessary responses are detected to assess the entire hearing range.

[0061] In summary, it should be apparent that the inventors have provided a way to validate hearing aid performance in an objective manner, for example, by using modulated naturally occurring and / or recorded speech signals to generate speech stimuli that elicit ASSR that are not perceived as noise by the hearing aid.

[0062] As used herein, "a," "an," and "the" are intended to include the plural (i.e., have the meaning of "at least one") unless expressly stated otherwise. It will be further understood that the terms "comprise," "have," "including," and / or "having" as used herein specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It will also be understood that when an element is said to be "connected" or "coupled" to another element, it can be directly connected or coupled to the other element, but intervening elements may be present unless expressly stated otherwise. Furthermore, as used herein, "connected" or "coupled" may include wirelessly connected or coupled. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. The steps of the disclosed methods are not limited to the exact order described herein, unless expressly stated otherwise.

[0063] Reference throughout this specification to a feature included as "one embodiment" or "an embodiment" or "aspect" or "may" or "can" should be understood to mean that the particular feature, structure or characteristic described in connection with that embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as appropriate in one or more embodiments of the disclosure. The above description is provided to enable one skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.

[0064] The claims are not intended to be limited to the aspects set forth herein, but are to be accorded full scope consistent with the language of the claims, wherein reference to an element in the singular is not intended to mean "one and only one" unless specifically so stated, but rather is intended to mean "one or more." Unless expressly stated otherwise, the term "some" refers to one or more.

[0065] Therefore, the scope should be determined based on the appended claims.

Claims

1. 1. A system configured to perform at least a validation mode of operation of a hearing test, the system comprising: A diagnostic device; one or more electrodes configured to be placed on the person's scalp and configured to be connected to the diagnostic device; a sound emitting device connected to the diagnostic device and configured to transmit the generated sound stimuli to a human ear; The diagnostic device comprises: a recording processor configured to receive response signals from the one or more electrodes disposed on the person's scalp; a control unit configured to control an operation mode of the diagnostic device; a signal generator configured to communicate the generated sound stimulus to the sound-emitting device; In the validity check operation mode, The signal generator includes: recording naturally occurring sounds provided as naturally occurring speech from a human and / or receiving recordings of such naturally occurring sounds; configured to input a recording of the naturally occurring sound into the signal generator; The signal generator is configured to generate, from the recording of the naturally occurring sound, an amplitude and / or frequency modulation of the recording as the generated sound stimulus, the generation of the amplitude and / or frequency modulation comprising: filtering the recording of the naturally occurring sound into a plurality of frequency subbands; Amplitude and / or frequency modulating each of said plurality of frequency subbands; by combining the amplitude and / or frequency modulated subbands to form the sound stimulus, the recording of the naturally occurring sounds is recorded via the diagnostic device and / or transmitted by wire or wirelessly from an auxiliary device to the diagnostic device; the signal generator sets an amplitude and / or frequency modulation rate for one or more of the plurality of subbands to zero, thereby causing the respective subband to be unmodified when generating the sound stimulus; Naturally occurring sounds are defined as unprocessed speech signals that naturally occur in the human environment. system.

2. The system of claim 1 , wherein the sound emitting device is configured as one or more hearing aids configured to be placed at an ear or both ears of the person in the validated mode of operation.

3. 2. The system of claim 1, wherein the sound emitting device is configured as a loudspeaker, the loudspeaker is connected to the diagnostic device and is disposed in an environment surrounding one or more hearing aids, and the loudspeaker is configured to receive the generated sound stimuli from the signal generator and to play the generated sound stimuli to the one or more hearing aids configured to be disposed at the ears of a person.

4. in the validation mode of operation, the diagnostic device is configured to transmit the generated sound stimuli to the one or more hearing aids, via the hearing aids and / or via an external loudspeaker, the hearing aid(s) presenting the transmitted generated sound stimuli at the person's ears; the diagnostic device is configured to record the response signal from the one or more electrodes placed on the person's scalp, the response signal being provided as an Auditory Evoked Response (AER); 4. A system according to claim 2 or 3.

5. The recorded naturally occurring sounds are received at the signal generator, and the diagnostic device derives the recorded naturally occurring sounds as: - processing the recorded naturally occurring sounds by amplitude and / or frequency modulation using a plurality of modulator functions having different modulation rates; - filtering each of the modulated recorded naturally occurring sounds that have been processed by amplitude and / or frequency modulation using a plurality of modulator functions, with one of a plurality of frequency subbands selected for each of the modulations of the recorded naturally occurring sounds; - combining said amplitude and / or frequency modulated frequency sub-bands to form said sound stimulus The system of claim 1 , configured to process by:

6. The system of claim 5 , wherein the amplitude and / or frequency modulated frequency subbands are adjusted in magnitude to align with a predetermined value.

7. 7. The system of claim 1, wherein the naturally occurring sounds are International Sound Test Signals (ISTS).

8. 8. The system of claim 1 , wherein the diagnostic device is configured to adjust the amplitude and / or frequency modulation rate for one or more of the plurality of frequency subbands to 0, thereby leaving the respective frequency subband unmodified.

9. 6. A system as claimed in any one of claims 1 to 5, wherein in a first transmission, the entire frequency band of the sound stimulus is played to the hearing aid(s) and upon detection of a response from the electrode within a specified frequency subband, the particular frequency subband is set to 0 (turned off), thereby removing from the sound stimulus the particular frequency band in which a response was detected.

10. 7. The system of claim 6, wherein the set of predetermined values ​​is provided as a set of band powers of an International Speech Test Signal (ISTS) in any of the frequency subbands, or the set of predetermined values ​​is provided as band powers of the recorded naturally occurring sounds.

11. 6. The system of claim 1 or 5, wherein the naturally occurring sounds are band-pass filtered into at least four frequency bands having center frequencies of 500 Hz, 1 kHz, 2 kHz and 4 kHz.

12. 12. The system of claim 1, wherein the response signal recorded from the electrodes is an auditory steady-state response (ASSR).

13. 13. The system according to claim 1, wherein each of the frequency sub-bands is amplitude and / or frequency modulated with a modulator function having a different modulation rate for each of the frequency sub-bands.

14. The system of claim 13 , wherein the modulator function is configured as a sine wave.

15. 1. A method for performing a validation mode of a hearing test for a person unable to provide an active, intentional response, the method comprising: placing one or more electrodes on the person's scalp; recording naturally occurring sounds provided as naturally occurring speech from a human and / or receiving a recording of such naturally occurring sounds; generating, from said recording of said naturally occurring sound, an amplitude and / or frequency modulation of said recording as a generated sound stimulus, said generating said amplitude and / or frequency modulation comprising: filtering the recording of the naturally occurring sound into a plurality of frequency subbands; Amplitude and / or frequency modulating each of the plurality of frequency sub-bands, wherein a percentage of amplitude and / or frequency modulation for one or more of the plurality of sub-bands is set to zero, thereby causing the respective sub-band to be unmodified when generating the sound stimulus; by combining the amplitude and / or frequency modulated subbands to form the sound stimulus; transmitting the generated sound stimulus to an ear of the person; and receiving a response signal from the one or more electrodes. method.

16. 1. A diagnostic device configured to perform a validation mode of a hearing test for a person unable to provide an active, intentional response, the diagnostic device comprising: a recording processor configured to receive response signals from one or more electrodes positioned on the person's scalp; a control unit configured to control an operation mode of the diagnostic device; a signal generator configured to communicate the generated stimulus to a sound-emitting device; In a validation mode of operation, the diagnostic device: recording naturally occurring sounds provided as naturally occurring speech from a human and / or receiving a recording of such naturally occurring sounds; inputting the recording of the naturally occurring sound into the signal generator to generate sound stimuli; and transmitting the generated sound stimulus to an ear of the person. The signal generator is configured to generate, from the recording of the naturally occurring sound, an amplitude and / or frequency modulation of the recording as the generated sound stimulus, the generation of the amplitude and / or frequency modulation comprising: filtering the recording of the naturally occurring sound into a plurality of frequency subbands; Amplitude and / or frequency modulating each of the plurality of frequency sub-bands, wherein a percentage of amplitude and / or frequency modulation for one or more of the plurality of sub-bands is set to zero, thereby causing the respective sub-band to be unmodified when generating the sound stimulus; by combining the amplitude and / or frequency modulated subbands to form the sound stimulus, Diagnostic equipment.

Citation Information

Patent Citations

  • A system and method for generating and recording auditory steady-state responses with a speech-like stimulus

    EP3281585A1

  • Objective measurement system and method for individual hearing

    JP2010521906A

  • Hearing aids and methods for enhancing sound playback

    JP2014500676A

  • Frequency-multiplexed speech-sound stimuli for hierarchical neural characterization of speech processing

    US20170196519A1

  • Multimodal prescription techniques

    US20180050202A1