Hearing assessment system and artificial hearing device

Abstract

This invention provides an auditory assessment system and an artificial hearing device. The system includes: a signal source configured to acquire external signals; a signal processing module configured to determine whether the external signals are suitable for auditory center testing and assessment; if so, to encode the external signals into electrical stimulation signals using selected stimulation strategy encoding parameters, and to send an auditory center signal acquisition command to a control module; the control module is configured to control the stimulation module to output corresponding electrical pulse signals and to output an acquisition command to the signal acquisition module; the signal acquisition module is configured to call a corresponding acquisition array to acquire target auditory center signals; the signal processing module is further configured to assess the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the target auditory center signals. This invention can monitor the user's auditory-related electroencephalogram (EEG) signals daily to objectively assess the auditory effect of the stimulation strategy encoding parameters and the user's speech rehabilitation progress.

Description

Technical Field

[0001] This invention relates to the field of medical device technology, and in particular to a hearing assessment system and an artificial hearing device. Background Technology

[0002] Implantable hearing devices such as cochlear implants and brainstem implants are currently the most effective solution for hearing loss reconstruction in patients with hearing impairment. The working principle of these devices is generally as follows: they pick up external signals, process and encode these signals into digital signals, and output electrical stimulation signals. The acoustic signal processing and strategy encoding parameters are usually programmed / adjusted by a professional audiologist. Patients use several pre-set encoding parameters during daily listening practice to reconstruct their hearing.

[0003] The stimulation strategy coding parameters set during offline device setup are most suitable for the patient's auditory nerve electrophysiological state at the time of setup. Audiologists will guide patients to switch program numbers at specific times (especially in the early stages of implantation) based on the expected rhythm of changes in the patient's auditory nerve. In the later stages of implantation, audiologists will also preset multiple program numbers to suit different hearing scenarios based on the patient's daily situation. The auditory effect and speech rehabilitation effect of a program number (stimulation strategy coding parameters) often need to be evaluated through the patient's subjective feedback and behavioral response tests. However, a certain number of patients are young prelingual hearing-impaired patients who cannot use language to express themselves or cooperate with tests, and initial users who are not used to artificial auditory sound. Audiologists also need to combine auditory central response tests to objectively evaluate the auditory and rehabilitation effects.

[0004] Auditory electroencephalography (EEG) primarily assesses a patient's initial perception of sound pitch, rhythm, and timbre, as well as higher-level cognitive processing responses such as attention and emotional responses, through simple paradigm-evoked event-related potentials (ERPs) or frequency domain analysis. However, EEG measurements typically require additional third-party equipment and time to complete, and therefore are not widely used in routine consultations. Summary of the Invention

[0005] The purpose of this invention is to provide an auditory assessment system and an artificial hearing device that can monitor the user's auditory-related EEG signals daily without the need for additional implantation or wearing of accessories outside the artificial hearing device, so as to objectively assess the auditory effect of stimulation strategy encoding parameters and the user's speech rehabilitation process.

[0006] To achieve the above objectives, the present invention provides an auditory assessment system integrated with an artificial hearing device. The auditory assessment system includes a signal source, a signal processing module, a control module, a stimulation module, and a signal acquisition module. The signal source, the control module, and the signal acquisition module are all communicatively connected to the signal processing module. The stimulation module and the signal acquisition module are both communicatively connected to the control module. The signal source is configured to acquire external signals and transmit them to the signal processing module. The external signals include at least one of external natural sound signals and external digital audio signals. The signal processing module is configured to analyze and identify the external signals to determine whether they are suitable for auditory central nervous system testing and assessment. If so, it encodes the external signals using selected stimulation strategy parameters. The signal is encoded as an electrical stimulation signal and transmitted to the control module, and an auditory center signal acquisition command is sent to the control module. The control module is configured to control the stimulation module to output a corresponding electrical pulse signal based on the electrical stimulation signal, and to output an acquisition command to the signal acquisition module based on the auditory center signal acquisition command. The signal acquisition module is configured to call the corresponding acquisition array to acquire the target auditory center signal based on the acquisition command, and transmit it to the signal processing module. The acquisition array includes acquisition electrodes, ground electrodes, and reference electrodes, all of which are electrodes of the artificial hearing device itself. The signal processing module is further configured to evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the target auditory center signal.

[0007] Optionally, the analysis and identification of the external signal to determine whether the external signal is suitable for auditory central nervous system testing and evaluation includes: if the external signal is an external natural sound signal and the external natural sound signal meets preset sound conditions, then the external signal is determined to be suitable for auditory central nervous system testing and evaluation, wherein the preset sound conditions include the external natural sound signal being a speech signal in a quiet environment, a speech signal in a noisy environment, or a music signal; if the external signal is an external digital audio signal, and the external digital audio signal is an auditory event-related potential paradigm test digital signal or an auditory brainwave paradigm test digital signal, then the external signal is determined to be suitable for auditory central nervous system testing and evaluation, wherein the auditory event-related potential paradigm test digital signal includes signals used to induce... The test includes at least one of the following: a passive skewer paradigm test digital signal for mismatched negative waves, an active skewer paradigm test digital signal for inducing P300 waves, and an auditory semantic misalignment paradigm test digital signal for inducing N400 waves; the auditory EEG paradigm test digital signal includes at least one of a speech stimulation paradigm test digital signal and a music stimulation paradigm test digital signal; when the external signal is an auditory event-related potential paradigm test digital signal, the target auditory center signal acquired by the signal acquisition module is an event-related potential signal; when the external signal is a speech signal in a quiet environment, a speech signal in a noisy environment, a music signal, or an auditory EEG paradigm test digital signal, the target auditory center signal acquired by the signal acquisition module is an EEG signal.

[0008] Optionally, when the external signal is a passive spherical paradigm test digital signal used to induce mismatch negative waves, the signal acquisition module is configured to mark the time point of stimulus occurrence when acquiring event-related potential signals; the signal processing module is configured to determine the amplitude and latency of the mismatch negative waves based on the event-related potential signals acquired by the signal acquisition module, and calculate the first speech discrimination ability score based on the amplitude and latency of the mismatch negative waves.

[0009] Optionally, calculating the first speech discrimination ability score based on the amplitude and latency of the mismatched negative wave includes: calculating the first speech discrimination ability score using the following formula:

[0010]

[0011] In the formula, Score_MMN is the first speech discrimination ability score, max indicates taking the maximum value, min indicates taking the minimum value, and A current_MMN A represents the amplitude of the mismatched negative wave obtained from the current measurement. baseline_MMN A is the amplitude of the mismatch negative waveform recorded during the user's initial device setup. target_MMN For the target mismatch negative wave amplitude, L current_MMNL represents the currently measured latency of the mismatched negative wave. baseline_MMN L is the latency period of the mismatch negative wave recorded during the user's first implantation and tuning. target_MMN For the target mismatch negative wave latency, w A_MMN For the mismatched negative wave amplitude weight, w L_MMN For mismatched negative wave latent options, 0 < w A_MMN <1, 0 <w L_MMN <1, and w A_MMN +w L_MMN =1.

[0012] Optionally, when the external signal is an active spherical paradigm test digital signal used to induce the P300 wave, the signal acquisition module is configured to mark the time point of stimulus occurrence when acquiring event-related potential signals; the signal processing module is configured to determine the P300 wave amplitude and P300 wave latency based on the event-related potential signals acquired by the signal acquisition module, and calculate a second speech discrimination ability score based on the P300 wave amplitude, the P300 wave latency, and the user's behavioral response accuracy.

[0013] Optionally, the calculation of the second speech discrimination ability score based on the P300 wave amplitude, the P300 wave latency, and the user's behavioral response accuracy includes: calculating the second speech discrimination ability score using the following formula:

[0014]

[0015] In the formula, Score_P300 is the second speech discrimination ability score, max indicates taking the maximum value, min indicates taking the minimum value, and A current_P300 For the currently measured P300 wave amplitude, A baseline_P300 The P300 waveform amplitude recorded during the user's initial device setup, A target_P300 For the target P300 wave amplitude, L current_P300 L represents the currently measured latency of the P300 wave. baseline_P300 The latency of the P300 wave recorded during the user's initial device setup, L target_P300 For the target P300 wave latency period, w A_P300 For the P300 wave amplitude weight, w L_P300 For P300 wave latent options, P be For the accuracy of user behavior response, w B_P300 For behavioral response weights, 0 < w A_P300 <1, 0 <w L_P300 <1, 0 <w B_P300 <1, and w A_P300 +w L_P300 +w B_P300 =1.

[0016] Optionally, when the external signal is a digital signal used to induce the N400 wave in an auditory semantic misalignment paradigm test, the signal acquisition module is configured to mark the occurrence time of key ending words in each trial when acquiring event-related potential signals; the signal processing module is configured to determine the N400 wave latency under the conditions of N400 difference wave amplitude and semantic inconsistency based on the event-related potential signals acquired by the signal acquisition module, and to evaluate semantic understanding ability based on the N400 difference wave amplitude and the N400 wave latency.

[0017] Optionally, when the external signal is a speech stimulus paradigm test digital signal, a speech signal in a quiet environment, or a speech signal in a noisy environment, the signal processing module is configured to: extract the Delta wave actual speech envelope and the Theta wave actual speech envelope based on the speech stimulus paradigm test digital signal, the speech signal in a quiet environment, or the speech signal in a noisy environment; extract Delta wave data and Theta wave data based on the EEG signals acquired by the signal acquisition module; reconstruct the Delta wave reconstructed speech envelope and the Theta wave reconstructed speech envelope based on the extracted Delta wave data and Theta wave data; and calculate a third speech discrimination ability score based on the correlation coefficient between the Delta wave reconstructed speech envelope and the Delta wave actual speech envelope, and the correlation coefficient between the Theta wave reconstructed speech envelope and the Theta wave actual speech envelope.

[0018] Optionally, calculating the third speech discrimination ability score based on the correlation coefficient between the Delta wave reconstructed speech envelope and the Delta wave actual speech envelope, and the correlation coefficient between the Theta wave reconstructed speech envelope and the Theta wave actual speech envelope, includes: calculating the third speech discrimination ability score using the following formula:

[0019]

[0020] In the formula, Score_EEG is the third speech discrimination ability score, and C Delta C is the correlation coefficient between the reconstructed speech envelope of the Delta wave and the actual speech envelope of the Delta wave. Theta The correlation coefficient between the reconstructed speech envelope of the Theta wave and the actual speech envelope of the Theta wave. For Theta wave weights, and .

[0021] Optionally, when the external signal is a music signal or a digital signal from a music stimulation paradigm test, the signal processing module is configured to: extract baseline Beta wave data and baseline Gamma wave data based on the EEG signals acquired by the signal acquisition module before music stimulation; perform time-frequency analysis on the baseline Beta wave data and the baseline Gamma wave data respectively to obtain corresponding baseline Beta wave time-frequency data and baseline Gamma wave time-frequency data; obtain baseline Beta wave time-frequency energy based on the baseline Beta wave time-frequency data, and obtain baseline Gamma wave time-frequency energy based on the baseline Gamma wave time-frequency data; and extract music-period Beta wave data and music-period Gamma wave data based on the EEG signals acquired by the signal acquisition module during music stimulation. Time-frequency analysis is performed on the music period Beta wave data and the music period Gamma wave data to obtain the corresponding music period Beta wave time-frequency data and music period Gamma wave time-frequency data. Based on the music period Beta wave time-frequency data, the music period Beta wave time-frequency energy is obtained, and based on the music period Gamma wave time-frequency data, the music period Gamma wave time-frequency energy is obtained. Based on the music period Beta wave time-frequency energy and the baseline period Beta wave time-frequency energy, the percentage change in Beta wave time-frequency energy is obtained, and based on the music period Gamma wave time-frequency energy and the baseline period Gamma wave time-frequency energy, the percentage change in Gamma wave time-frequency energy is obtained. Based on the percentage change in Beta wave time-frequency energy and the percentage change in Gamma wave time-frequency energy, a music appreciation ability assessment value is calculated.

[0022] Optionally, calculating the music appreciation ability assessment value based on the percentage change in the time-frequency energy of the Beta wave and the percentage change in the time-frequency energy of the Gamma wave includes: calculating the music appreciation ability assessment value using the following formula:

[0023]

[0024] In the formula, P out P is the assessment value for music appreciation ability. Beta P represents the percentage change in time-frequency energy of the Beta wave. Gamma The percentage change in time-frequency energy of the Gamma wave. For Beta wave weights, and .

[0025] Optionally, the signal processing module is further configured to test the speech discrimination ability assessment results under digital signal and / or external natural sound signal stimulation based on speech stimulation paradigms of speech scenarios with different levels of signal-to-noise ratio, and comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect. The different levels of signal-to-noise ratio speech scenarios include quiet speech scenarios, slightly noisy speech scenarios, moderately noisy speech scenarios, and highly noisy speech scenarios.

[0026] Optionally, the assessment results of speech discrimination ability under digital signal and / or external natural sound signal stimulation based on speech stimulation paradigms in speech scenarios with different signal-to-noise ratios, and the comprehensive evaluation of the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, include: using the following formula to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect:

[0027]

[0028] In the formula, Score_EEG_synthetic represents the comprehensive speech discrimination ability score based on EEG signals; Score_EEG_silent represents the speech discrimination ability score in quiet speech scenarios; Score_EEG_mild represents the speech discrimination ability score in mildly noisy speech scenarios; Score_EEG_medium represents the speech discrimination ability score in moderately noisy speech scenarios; and Score_EEG_intense represents the speech discrimination ability score in highly noisy speech scenarios. silent For quiet speech scenarios, w mild For weighting in mildly noisy speech scenarios, w medium For moderately noisy speech scenarios, w intense For weights in highly noisy speech scenarios, 0 < w silent <1, 0 <w mild <1, 0 <w medium <1, 0 <w intense <1, and w silent +w mild +w medium +w intense =1.

[0029] Optionally, the signal processing module is further configured to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the speech discrimination ability assessment results stimulated by the passive skein-ball paradigm test digital signal used to induce mismatch negative waves and the active skein-ball paradigm test digital signal used to induce P300 waves.

[0030] Optionally, the assessment of speech discrimination ability based on the results of the passive monster ball paradigm test digital signal used to induce mismatch negative waves and the active monster ball paradigm test digital signal used to induce P300 waves, and the comprehensive evaluation of the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, includes: using the following formula to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect:

[0031]

[0032] In the formula, Score_ERP is the comprehensive speech discrimination ability score based on event-related potential signals, Score_MMN is the speech discrimination ability assessment result under digital signal stimulation of the passive spherical paradigm test used to induce mismatch negative waves, and Score_P300 is the speech discrimination ability assessment result under digital signal stimulation of the active spherical paradigm test used to induce P300 waves. MMN For the mismatched negative wave weights, w P300 For P300 wave weights, 0 < w MMN <1, 0 <w P300 <1, and w MMN +w P300 =1.

[0033] Optionally, the signal processing module is further configured to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the speech discrimination ability assessment results stimulated by the digital signals of the auditory event-related potential paradigm test and the digital signals of the auditory EEG paradigm test.

[0034] Optionally, the assessment of speech discrimination ability based on the results of auditory event-related potential paradigm test digital signals and auditory EEG paradigm test digital signals, comprehensively evaluating the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, includes: using the following formula to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect:

[0035]

[0036] In the formula, Score_ is the comprehensive speech discrimination ability score that integrates event-related potential signals and EEG signals; Score_ERP is the comprehensive speech discrimination ability score based on event-related potential signals; Score_EEG_ is the comprehensive speech discrimination ability score based on EEG signals; and w ERP For event-related potential weights, w EEG For brainwave weights, 0 < w ERP <1, 0 <w EEG <1, and w ERP +wEEG =1.

[0037] Optionally, when the artificial hearing device is a fully implanted cochlear implant, the acquisition electrode is an external cochlear electrode, the reference electrode is an internal cochlear electrode or an external cochlear electrode spaced apart from the acquisition electrode, and the grounding electrode is an internal cochlear electrode or external cochlear electrode that is not used as an acquisition electrode, reference electrode, or stimulation module.

[0038] Optionally, when the artificial hearing device is a semi-implanted cochlear implant, the acquisition electrode is an external cochlear electrode or an external scalp electrode, the reference electrode is an internal cochlear electrode, an external scalp electrode, or an external cochlear electrode spaced apart from the acquisition electrode, and the grounding electrode is an internal cochlear electrode or external cochlear electrode that is not used as the acquisition electrode, the reference electrode, or the stimulation module.

[0039] Optionally, when the artificial hearing device is an auditory brainstem implantation device, the acquisition electrode is a brainstem external electrode, the reference electrode is a cochlear nucleus electrode or a brainstem external electrode spaced apart from the acquisition electrode, and the grounding electrode is a cochlear nucleus electrode or brainstem external electrode that is not used as the acquisition electrode, the reference electrode, or the stimulation module.

[0040] To achieve the above objectives, the present invention also provides an artificial hearing device, which includes the hearing assessment system described above.

[0041] Compared with existing technologies, the auditory assessment system and artificial hearing device provided by this invention have the following beneficial effects: The auditory assessment system provided by this invention, by being integrated into an artificial hearing device, allows for daily monitoring of the user's auditory-related EEG signals without the need for additional implantation or wearing of accessories outside the artificial hearing device. This objectively assesses the auditory effect of stimulation strategy encoding parameters and the user's speech rehabilitation progress. The assessment results can be directly applied to the application of program numbers after daily scene recognition and to tracking the user's rehabilitation level. Furthermore, the auditory assessment system provided by this invention can effectively reduce the cost of manual device adjustment and improve user rehabilitation efficiency. Moreover, the auditory assessment system provided by this invention is applicable to most commercially available and mature artificial hearing devices, exhibiting strong scalability.

[0042] Since the artificial hearing device provided by this invention and the hearing assessment system provided by this invention belong to the same inventive concept, the artificial hearing device provided by this invention has at least all the beneficial effects of the hearing assessment system provided by this invention. For details, please refer to the relevant description above. Therefore, the beneficial effects of the artificial hearing device provided by this invention will not be elaborated here. Attached Figure Description

[0043] Figure 1This is a block diagram of the hearing assessment system provided in one embodiment of the present invention.

[0044] Figure 2 This is a schematic diagram of an auditory central nervous system testing and evaluation link provided in one embodiment of the present invention.

[0045] Figure 3 This is a schematic diagram of a hearing reconstruction pathway provided in one embodiment of the present invention.

[0046] Figure 4 This is a schematic diagram of the rectangular structure of a fully implanted cochlear implant.

[0047] Figure 5 This is a schematic diagram of the box structure of a semi-implanted cochlear implant.

[0048] Figure 6 A schematic diagram of the block structure of an auditory brainstem implantation device.

[0049] The reference numerals in the attached diagrams are explained as follows: Signal source - 110; Signal processing module - 120; Control module - 130; Stimulation module - 140; Signal acquisition module - 150; Implantable sound processor - 210; Stimulator - 220; Acquisition device - 230; External cochlear electrode array - 240; Internal cochlear electrode array - 250; Mobile terminal software - 260; External sound processor - 310; External scalp electrode array - 320; External brainstem electrode array - 330; Cochlear nucleus electrode array - 340. Detailed Implementation

[0050] The auditory assessment system and artificial hearing device proposed in this invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0051] To facilitate understanding, a brief explanation of the research background of this invention will be given first.

[0052] As described in the background section, auditory EEG primarily assesses a patient's initial perception of sound pitch, rhythm, timbre, etc., and higher cognitive processing feedback such as attention and emotional response to sound through simple paradigm-evoked event-related potentials (ERPs) or band frequency domain analysis.

[0053] Auditory-related ERPs, in terms of the evoked temporal sequence, reflect different levels of auditory cognitive processing:

[0054] 1) P50 is a positive wave that occurs about 50 ms after auditory stimulation, reflecting the brain's early pre-attentive processing of the stimulus. P50 is generated in the auditory cortex and is most prominently detected at the central electrode (Cz). It is usually induced by the paired-stimulus paradigm and detects the brain's sensory gating function for repetitive stimuli.

[0055] 2) N100 is a negative wave induced approximately 100 ms after auditory stimulation. It is also a waveform induced by pre-attentional processing, but it varies with the loudness, frequency, interval, predictability, and voice onset time (VOT) of the auditory stimulus, and also with an individual's ability to perceive pitch. N100 is generated in the auditory cortex and is associated with occipital and prefrontal cortex activity. It can be detected by electrodes in the central (Cz), frontal (Fz, FCz), and temporal (T7 / 8, more pronounced at T8) regions.

[0056] 3) P200 is a positive wave evoked about 200ms after auditory stimulation. It is usually used together with N100 (and sometimes P100 and N200) as an evoked marker of auditory perception. However, it can also change independently with auditory attention, type of auditory stimulus, memory relevance, etc. It is usually used as an objective auditory threshold marker for patients who cannot provide subjective feedback or conduct behavioral tests (such as schizophrenia, stuttering, cognitive impairment, etc.).

[0057] 4) MMN is a mismatched negative waveform induced by the Oddball paradigm. 100ms-250ms after the abnormal stimulus, a negative waveform larger than the standard stimulus waveform can be induced, and the difference in amplitude between the two is the MMN. MMN can reflect auditory perception processing disorders and is related to perceptual memory and attention, originating from neural network activity in the temporal lobe and prefrontal lobe.

[0058] 5) P300 is a positive wave induced approximately 300 ms after stimulation. It is induced by decision processing and is related to attention and cognitive load. The elicitation source is also related to the aforementioned cognitive networks. P300 is most prominent in the parietal bone (P) and central electrode (C), and is usually induced by the Oddball paradigm.

[0059] 6) N400 is induced approximately 400ms after speech stimulation, reflecting the brain's semantic processing. N400 can be detected at the central (C) and top (P) electrodes, and unfamiliar words and illogical statements will induce a larger amplitude of N400.

[0060] Different types of brainwaves, in terms of frequency domain speed, also reflect different levels of auditory cognition:

[0061] 1) Delta wave (0.5-4Hz): related to speech processing, it can reflect speech comprehension in noisy environments.

[0062] 2) Theta waves (4-8Hz): are associated with sound imagery and primary auditory cognition, and can reflect higher cognitive functions such as attention to sound, clarity of speech perception in noise, and emotional response to sound.

[0063] 3) Alpha waves (8-12Hz): are usually associated with higher cognitive processes such as filtering out unnecessary information and emotional responses to sound.

[0064] 4) Beta wave (12-30Hz): related to objective characteristics such as sound loudness and frequency.

[0065] 5) Gamma waves (>30Hz): Related to advanced speech processing, such as the subjective comfort and naturalness of speech, as well as the subjective aesthetic appreciation of music.

[0066] However, EEG measurements typically require additional third-party equipment and time to complete the tests, thus limiting their widespread use in routine testing. On the other hand, for patients with implanted auditory neuromodulation devices, the devices themselves have electrodes located close to the cortex, providing better support for measuring auditory pathway-related responses, and some studies have preliminarily demonstrated the feasibility of this method. Nevertheless, most studies still rely on some external devices (such as external grounding electrodes), and this method has not yet been practically translated into applications for artificial hearing products.

[0067] In summary, during the adjustment and rehabilitation process of artificial hearing devices, it is necessary to objectively assess the hearing effect and rehabilitation progress through auditory center measurements in order to reduce the time cost for audiologists and the expenses for patients. However, at present, relevant tests are still conducted using third-party external equipment and have not been widely promoted.

[0068] Based on this, the core idea of ​​the present invention is to provide an auditory assessment system and an artificial hearing device that can monitor the user's auditory-related EEG signals in daily life without the need for the user to have additional implants or wear accessories outside the artificial hearing device, so as to objectively evaluate the auditory effect of the stimulation strategy encoding parameters and the user's speech rehabilitation process.

[0069] To achieve the above-mentioned goals, this invention provides a hearing assessment system integrated with an artificial hearing device. Please refer to [reference needed]. Figure 1 This is a block diagram of the auditory assessment system provided in one embodiment of the present invention. Figure 1As shown, the auditory assessment system provided by the present invention includes a signal source 110, a signal processing module 120, a control module 130, a stimulation module 140, and a signal acquisition module 150. The signal source 110, the control module 130, and the signal acquisition module 150 are all communicatively connected to the signal processing module 120, and the stimulation module 140 and the signal acquisition module 150 are all communicatively connected to the control module 130. The signal source 110 is configured to acquire external signals and transmit them to the signal processing module 120. The external signals include at least one of external natural sound signals and external digital audio signals. The signal processing module 120 is configured to analyze and identify the external signals to determine whether the external signals are suitable for auditory center testing and assessment; if so, it encodes the external signals into electrical stimulation signals using selected stimulation strategy encoding parameters. The signal is transmitted to the control module 130, and an auditory center signal acquisition command is sent to the control module 130. The control module 130 is configured to control the stimulation module 140 to output a corresponding electrical pulse signal based on the electrical stimulation signal, and to output an acquisition command to the signal acquisition module 150 based on the auditory center signal acquisition command. The signal acquisition module 150 is configured to call the corresponding acquisition array to acquire the target auditory center signal based on the acquisition command, and transmit it to the signal processing module 120. The acquisition array includes acquisition electrodes, ground electrodes, and reference electrodes, all of which are electrodes of the artificial hearing device itself. The signal processing module 120 is further configured to evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the target auditory center signal.

[0070] Therefore, the auditory assessment system provided by this invention, by being integrated into an artificial hearing device, allows for daily monitoring of the user's auditory-related EEG signals without the need for additional implants or external accessories. This objectively assesses the auditory effect of stimulus strategy encoding parameters and the user's speech rehabilitation progress. The assessment results can be directly applied to routine scene recognition and tracking of the user's rehabilitation level. Furthermore, the auditory assessment system provided by this invention effectively reduces the cost of manual device adjustments and improves user rehabilitation efficiency. Moreover, the auditory assessment system provided by this invention is applicable to most commercially available and mature artificial hearing devices, exhibiting strong scalability.

[0071] Specifically, the stimulation module 140 is responsible for outputting stimulation and forming a stimulation circuit, including stimulation electrodes and ground electrodes. The stimulation electrodes are distributed around the target nerve to be stimulated, while the ground electrodes are distributed around the target nerve and / or on the skull surface. The combination of stimulation electrodes is determined by the stimulation mode (monopolar mode, bipolar mode, multipolar mode, common-ground mode, etc.) and the stimulation signal. It should be noted that the same electrode can be switched between being a stimulation electrode and a ground electrode, but it cannot be used as both simultaneously.

[0072] The signal acquisition module 150 is responsible for acquiring signals from the auditory center and includes acquisition electrodes, reference electrodes, and ground electrodes. The acquisition array is determined by the type of signal to be acquired. The acquisition electrodes are distributed around the stimulated target nerve, on the surface of the skull, and / or on the surface of the scalp, while the reference and ground electrodes are also distributed around the target nerve, on the surface of the skull, and / or on the surface of the scalp. The same electrode can be switched between being an acquisition electrode, a reference electrode, or a ground electrode, and will not simultaneously function as another functional electrode when serving as an acquisition electrode.

[0073] It should be noted that the above module classification does not necessarily represent physical separation in the hardware modules. Furthermore, the stimulation module 140 and the signal acquisition module 150 can be the same component or different components within the system; the same electrode generally will not be part of both the stimulation module 140 and the signal acquisition module 150 simultaneously. It should also be noted that once sufficient auditory center signal data has been acquired, comparative analysis can be performed. The acquired auditory center signals can be used to compare the objective auditory effects under different stimulation strategy coding parameters. After comparison, the user can choose to enable automatic coding parameter application. The signal processing module 120 identifies the current acoustic scene through external signal analysis and applies the stimulation strategy coding parameters that provide the best auditory effect under that scene. The acquired auditory center signals can also be used to compare the speech rehabilitation effects at different stages of the user's rehabilitation period. The comparison results of the stimulation strategy coding parameters and rehabilitation effects can be stored in the signal processing module 120.

[0074] Please continue to refer to this. Figure 2 This is a schematic diagram of the auditory central nervous system testing and evaluation chain provided in one embodiment of the present invention. Figure 2As shown, the signal processing module 120 performs strategy encoding on external signals suitable for auditory central nervous system testing and evaluation, and outputs the encoded signal to the control module 130, which then outputs a current pulse signal via the stimulation module 140. Simultaneously, the signal processing module 120 sends an auditory central nervous system signal acquisition command to the control module 130, and the control module 130 outputs an acquisition command to the signal acquisition module 150. The signal acquisition module 150, according to the specific requirements of the acquisition command, activates the acquisition array and acquisition parameters required for acquiring specific auditory central nervous system signals (including auditory ERP (Event-Related Potential) signals and auditory EEG (Electroencephalogram) signals). The acquired auditory central nervous system signals are returned to the signal processing module 120, which performs real-time decoding to evaluate the objective auditory effect. The analysis results are stored in the signal processing module 120. When the amount of data is sufficient for statistical analysis, the signal processing module 120 performs the following two comparative analyses:

[0075] (1) By comparing similar auditory center signals measured under different stimulus strategy coding parameters within the same time period (test time difference not exceeding 1 week), the signal processing module 120 can recommend stimulus strategy coding parameters with the best listening effect in different scenarios (such as speech in a quiet environment, speech or music in a noisy environment, etc.). This result can be directly applied to the signal processing module 120 after user operation. That is, during daily listening, the signal processing module 120 judges the current acoustic scenario through signal recognition and applies the best coding parameters. The comparison results are stored in the signal processing module 120 and can be fed back to the audiologist during setup.

[0076] (2) By comparing similar auditory center signals measured under the same stimulus strategy coding parameters at different time periods (test time difference greater than 1 week), the signal processing module 120 can provide feedback to the user on the auditory rehabilitation progress. This result is stored in the signal processing module 120 and can be fed back to the audiologist during device adjustment.

[0077] In some exemplary embodiments, the signal processing module 120 is further configured to encode the external signal into an electrical stimulation signal using selected stimulation strategy encoding parameters when it is determined that the external signal is not suitable for auditory central nervous system testing and evaluation. Thus, this configuration can meet the user's daily hearing needs.

[0078] Please continue to refer to this. Figure 3 This is a schematic diagram of a hearing reconstruction pathway provided by an embodiment of the present invention. Figure 3As shown, when the external signal is not suitable for auditory central nervous system testing and evaluation, the signal processing module 120 encodes the external signal and outputs it to the control module 130. The stimulation module 140 then outputs a current pulse signal, and the signal acquisition module 150 remains off. In this configuration, the user can perform hearing reconstruction. The external signal is encoded into an electrical signal by the system and transmitted to the stimulation target nerve. It should be noted that during hearing reconstruction, the user can manually select a set of stimulation strategy encoding parameters stored in the signal processing module 120. Furthermore, the hearing reconstruction and auditory central nervous system testing and evaluation links can be interleaved.

[0079] In some exemplary embodiments, the signal processing module 120 is further configured to store multiple sets of stimulus strategy encoding parameters for users to select. Thus, by pre-storing multiple sets of stimulus strategy encoding parameters in the signal processing module 120, common usage scenarios of artificial hearing devices can be covered, thereby meeting users' personalized listening needs in different acoustic environments and effectively improving users' auditory comfort.

[0080] Specifically, the signal processing module 120 stores multiple sets of program numbers (stimulation strategy encoding parameters), which are typically set by audiologists during offline setup. Users can select one of these program numbers to run during daily use. The parameters in a program number include speech strategy, stimulation mode, reference electrode, stimulation rate, pulse width, T-value (minimum threshold), C-value (comfort value), single-channel gain, clipping, etc. The signal processing module 120 encodes the sound / audio signal according to the currently running program number.

[0081] In some exemplary embodiments, the analysis and identification of the external signal to determine whether the external signal is suitable for auditory central nervous system testing and evaluation includes: if the external signal is an external natural sound signal and the external natural sound signal meets preset sound conditions, then the external signal is determined to be suitable for auditory central nervous system testing and evaluation, wherein the preset sound conditions include the external natural sound signal being a speech signal in a quiet environment, a speech signal in a noisy environment, or a music signal; if the external signal is an external digital audio signal, and the external digital audio signal is an auditory event-related potential paradigm test digital signal or an auditory brainwave paradigm test digital signal, then the external signal is determined to be suitable for auditory central nervous system testing and evaluation, wherein the auditory event-related potential paradigm test digital signal includes signals used for... The system includes at least one of the following: a passive skein-of-the-ball paradigm test digital signal for inducing mismatch negative waves; an active skein-of-the-ball paradigm test digital signal for inducing P300 waves; and an auditory semantic misalignment paradigm test digital signal for inducing N400 waves. The auditory EEG paradigm test digital signal includes at least one of a speech stimulation paradigm test digital signal and a music stimulation paradigm test digital signal. When the external signal is an auditory event-related potential paradigm test digital signal, the target auditory center signal acquired by the signal acquisition module 150 is an event-related potential signal. When the external signal is a speech signal in a quiet environment, a speech signal in a noisy environment, a music signal, or an auditory EEG paradigm test digital signal, the target auditory center signal acquired by the signal acquisition module 150 is an EEG signal.

[0082] Therefore, by automatically using real-life sound signals from daily life as auditory central response measurement stimuli when external signals are identified as speech signals in quiet environments, speech signals in noisy environments, or music signals, the user's real auditory responses in actual scenarios can be collected. By automatically using standardized paradigm test digital signals (ERP or EEG) as auditory central response measurement stimuli when external signals are identified as auditory event-related potential (ERP) or auditory brainwave (EEG) paradigm test digital signals, the authenticity of daily assessments and the accuracy of professional tests can be balanced.

[0083] In some exemplary embodiments, when the external signal is a passive spherical paradigm test digital signal used to induce mismatch negative waves, the signal acquisition module 150 is configured to mark the time point of stimulus occurrence when acquiring event-related potential signals; the signal processing module 120 is configured to determine the amplitude and latency of the mismatch negative waves based on the event-related potential signals acquired by the signal acquisition module 150, and calculate a first speech discrimination ability score based on the amplitude and latency of the mismatch negative waves.

[0084] Therefore, by calculating the first speech discrimination score based on MMN amplitude and MMN latency, an objective assessment of auditory effects and / or auditory rehabilitation effects can be achieved. Furthermore, by marking the time points of stimulus occurrence, ERP signals under each stimulus type (standard stimulus or deviated stimulus) can be precisely distinguished.

[0085] It should be noted that because the passive odddball paradigm requires patients to remain resting, or even watch silent videos to ignore sound, this approach is particularly suitable for young infants who are unable or unwilling to cooperate with subjective testing, and initial users who have difficulty adapting to cochlear implant electrical stimulation.

[0086] Specifically, the passive skewer paradigm test digital signal contains two types of sound stimuli: standard stimuli (80%-85%) and biased stimuli (15%-20%). Standard and biased stimuli differ in a certain acoustic dimension, including the four tones of Mandarin (e.g., first tone vs. third tone), initial consonants of monosyllabic words (e.g., bo vs. po), final vowels (e.g., ba vs. bo), and sound frequencies (e.g., / a / vs. / i / in the "Lin's Six Tones"). There are 200-500 sound stimuli in total, each lasting 50ms-200ms, with intervals of 500ms-1500ms. The sound stimuli are played continuously in a random order, while biased stimuli cannot appear consecutively (at least two standard stimuli must be present at the interval). Users do not need to respond to the sounds but must remain silent and watch a silent video provided by the mobile software, ignoring the sound stimuli.

[0087] Furthermore, when the artificial hearing device is a fully implanted cochlear implant, the acquisition electrode is any external cochlear electrode (preferably close to the central brain region), the reference electrode is any internal cochlear electrode (not used as a stimulation electrode or acquisition electrode) or any external cochlear electrode (not used as a acquisition electrode, and at a certain distance from the acquisition electrode so that an effective waveform can be detected), and the ground electrode is any internal or external cochlear electrode (not used as a stimulation electrode, the ground electrode of the stimulation module 140, or the acquisition electrode). When the artificial hearing device is a partially implanted cochlear implant, the acquisition electrode can be any external cochlear electrode or any external scalp electrode, the reference electrode is any internal cochlear electrode (not used as a stimulation electrode) or any external cochlear electrode or external scalp electrode (not used as a acquisition electrode, and at a certain distance from the acquisition electrode so that an effective waveform can be detected), and the ground electrode is any internal or external cochlear electrode (not used as a stimulation electrode, the ground electrode of the stimulation module 140, or the acquisition electrode). When the artificial hearing device is an auditory brainstem implantation device, the acquisition electrode is any external brainstem electrode, the reference electrode is any cochlear nucleus electrode or any external brainstem electrode (not used as an acquisition electrode, and is at a certain distance from the acquisition electrode so that it can detect an effective waveform), and the ground electrode is any cochlear nucleus electrode or any external brainstem electrode (not used as a stimulation electrode, the ground electrode of the stimulation module 140, or the acquisition electrode).

[0088] Furthermore, the acquisition precision of the event-related potential (ERP) signal can be, but is not limited to, 12 bits, the sampling frequency can be, but is not limited to, 500 Hz, and the gain can be, but is not limited to, 80 dB. The time points of stimulus occurrence need to be marked during acquisition. To reduce interference from the digital signal of the passive glitch ball paradigm test on the ERP signal acquisition, methods such as coherent superposition and low-pass filtering can be used to remove artifacts.

[0089] Furthermore, for each sound stimulus, the signal processing module 120 takes the instant the stimulus begins as the zero point and extracts the ERP signal from 200ms before the stimulus to 500ms after the stimulus, as a complete analysis time history. Then, the extracted ERP signal is sequentially bandpass filtered (filtering frequency from 1Hz to 30Hz), followed by artifact removal, baseline correction, and reference electrode correction.

[0090] Furthermore, the MMN waveform equals the average ERP evoked by the deviated stimulus minus the average ERP evoked by the standard stimulus. Since the MMN latency is 100ms-250ms, the MMN amplitude and latency can be measured by finding the most prominent negative peak within this window in the MMN waveform. Significantly larger MMN amplitudes and significantly shorter MMN latencies reflect stronger auditory perception differences and faster perception and processing speeds between the standard and deviated stimuli, respectively. Therefore, for the same paradigm within the same time period, program numbers with larger MMN amplitudes and / or shorter MMN latencies are better in speech environments. Moreover, as rehabilitation time increases, if the user's MMN amplitude gradually increases and the MMN latency gradually decreases, it indicates that the user's speech discrimination ability is gradually improving.

[0091] In some exemplary embodiments, calculating the first speech discrimination score based on the amplitude and latency of the mismatched negative wave includes: calculating the first speech discrimination score using the following formula:

[0092]

[0093] In the formula, Score_MMN is the first speech discrimination ability score, max indicates taking the maximum value, min indicates taking the minimum value, and A current_MMN A represents the amplitude of the mismatched negative wave obtained from the current measurement. baseline_MMN A is the amplitude of the mismatch negative waveform recorded during the user's initial device setup. target_MMN For the target mismatch negative wave amplitude, L current_MMN L represents the currently measured latency of the mismatched negative wave. baseline_MMN L is the latency period of the mismatch negative wave recorded during the user's first implantation and tuning. target_MMN For the target mismatch negative wave latency, w A_MMN For the mismatched negative wave amplitude weight, w L_MMN For mismatched negative wave latent options, 0 < w A_MMN <1, 0 <w L_MMN <1, and w A_MMN +w L_MMN =1.

[0094] Therefore, by using the above formula to calculate the first speech discrimination ability score (Score_MMN), not only can the two different physical quantities, MMN amplitude and MMN latency, be weighted and fused on the same scale, thus enabling a more accurate assessment of speech discrimination ability, but it also helps to achieve individualized and dynamic precision assessment of speech discrimination ability. Simultaneously, it ensures that the calculated first speech discrimination ability score (Score_MMN) is between 0 and 1; the closer the score is to 1, the better the speech discrimination ability (better auditory effect / rehabilitation effect); the closer the score is to 0, the worse the speech discrimination ability (worse auditory effect / rehabilitation effect).

[0095] It should be noted that this invention relates to w A_MMN and w L_MMN The specific value is not limited, for example, w A_MMN The value of w can be 0.6. L_MMN The value can be 0.4.

[0096] In some exemplary embodiments, when the external signal is an active spherical paradigm test digital signal used to induce the P300 wave, the signal acquisition module 150 is configured to mark the time point of stimulus occurrence when acquiring event-related potential signals; the signal processing module 120 is configured to determine the P300 wave amplitude and P300 wave latency based on the event-related potential signals acquired by the signal acquisition module 150, and calculate a second speech discrimination ability score based on the P300 wave amplitude, the P300 wave latency, and the user's behavioral response accuracy.

[0097] Therefore, by calculating the second speech discrimination ability score based on the P300 wave amplitude, P300 wave latency, and the accuracy of the user's behavioral response, a dual-modal verification of neural and behavioral aspects can be achieved, effectively improving the accuracy of speech discrimination ability assessment results.

[0098] Specifically, the digital signal of the active skewer paradigm test is the same as that of the passive skewer paradigm test mentioned above, but the user needs to respond to the sound, such as pressing a button on the mobile software interface when hearing the skewer stimulus.

[0099] Furthermore, the acquisition method of ERP signals under active quagmire ball paradigm test digital signal stimulation is the same as that under passive quagmire ball paradigm test digital signal stimulation, but the acquisition electrodes are preferably selected from those located near the central or parietal brain regions.

[0100] Furthermore, for each sound stimulus, the signal processing module 120 takes the instant the stimulus begins as the zero point and extracts the ERP signal from 200ms before the stimulus to 600ms after the stimulus, as a complete analysis time history. Then, the extracted ERP signal is sequentially bandpass filtered (filtering frequency from 1Hz to 30Hz), followed by artifact removal, baseline correction, and reference electrode correction.

[0101] Furthermore, the P300 waveform equals the average ERP evoked by the deviated stimulus minus the average ERP evoked by the standard stimulus. Since the P300 wave latency is 250ms-500ms, the P300 wave amplitude and latency can be measured by finding the most prominent positive peak within this window in the P300 waveform. Significantly larger P300 wave amplitudes, significantly shorter P300 wave latencies, and higher accuracy in behavioral responses all reflect a user's stronger ability to distinguish between standard and deviated stimuli. Furthermore, higher accuracy in user behavioral responses indicates stronger cognitive abilities. Therefore, for the same paradigm within the same time period, program numbers with larger P300 wave amplitudes and / or shorter P300 wave latencies are better in a verbal context. Moreover, as rehabilitation time increases, if the user's P300 wave amplitude gradually increases and the P300 wave latency gradually decreases, it indicates that the user's verbal discrimination ability is gradually improving.

[0102] In some exemplary embodiments, calculating the second speech discrimination score based on the P300 wave amplitude, the P300 wave latency, and the user's behavioral response accuracy includes: calculating the second speech discrimination score using the following formula:

[0103]

[0104] In the formula, Score_P300 is the second speech discrimination ability score, max indicates taking the maximum value, min indicates taking the minimum value, and A current_P300 For the currently measured P300 wave amplitude, A baseline_P300 The P300 waveform amplitude recorded during the user's initial device setup, A target_P300 For the target P300 wave amplitude, L current_P300 L represents the currently measured latency of the P300 wave. baseline_P300 The latency of the P300 wave recorded during the user's initial device setup, L target_P300 For the target P300 wave latency period, w A_P300 For the P300 wave amplitude weight, w L_P300 For P300 wave latent options, P be For the accuracy of user behavior response, w B_P300 For behavioral response weights, 0 < w A_P300<1, 0 <w L_P300 <1, 0 <w B_P300 <1, and w A_P300 +w L_P300 +w B_P300 =1.

[0105] Therefore, by using the above formula to calculate the second speech discrimination ability score Score_P300, not only can the three different physical quantities of P300 wave amplitude, P300 wave latency and behavioral response accuracy be weighted and fused on the same scale, thus enabling a more accurate assessment of speech discrimination ability, but it can also help to achieve a precise assessment of speech discrimination ability in an individualized and dynamic way.

[0106] It should be noted that this invention relates to w A_P300 w L_P300 and w B_P300 The specific value is not limited, for example, w A_P300 The value of w can be 0.5. L_P300 The value of w can be 0.3. B_P300 The value can be 0.2.

[0107] In some exemplary embodiments, the signal processing module 120 is further configured to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the speech discrimination ability assessment results stimulated by the passive skein-skewers paradigm test digital signal for inducing mismatch negative waves and the active skein-skewers paradigm test digital signal for inducing P300 waves.

[0108] Because the MMN can assess the brain's ability to keenly capture subtle changes in sound during the unconscious, automatic pre-attentional stage, and the P300 can assess the brain's ability to efficiently distinguish and make decisions when consciously paying attention, the combined assessment results of speech discrimination ability under the passive Oddball paradigm and the active Oddball paradigm can achieve a complete two-level assessment of auditory function, effectively improving the accuracy of the assessment results of hearing effect and / or rehabilitation effect.

[0109] Specifically, the assessment of speech discrimination ability based on the results of the passive skein-the-ball paradigm test digital signal used to induce mismatch negative waves and the active skein-the-ball paradigm test digital signal used to induce P300 waves, and the comprehensive evaluation of the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, includes: using the following formula to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect:

[0110]

[0111] In the formula, Score_ERP is the first comprehensive speech discrimination ability score based on event-related potential signals, Score_MMN is the first speech discrimination ability score (used to assess speech discrimination ability under digital signal stimulation of the passive spherical paradigm test to induce mismatch negative waves), and Score_P300 is the second speech discrimination ability score (used to assess speech discrimination ability under digital signal stimulation of the active spherical paradigm test to induce P300 waves), w MMN For the mismatched negative wave weights, w P300 For P300 wave weights, 0 < w MMN <1, 0 <w P300 <1, and w MMN +w P300 =1.

[0112] It should be noted that the weighting of MMN and P300 waves depends on the user's autonomy. Specifically, for younger or older users, the weighting of MMN (w) is different. MMN ) higher, for example, w MMN The value of w can be 0.7. P300 The value can be 0.3; for teenage or young adult users, the weight of P300 (w) P300 ) higher, for example, w MMN The value of w can be 0.3. P300 The value can be 0.7.

[0113] In some exemplary embodiments, when the external signal is a digital signal used to induce an auditory semantic misalignment paradigm test for N400 waves, the signal acquisition module 150 is configured to mark the occurrence time of key ending words in each trial when acquiring event-related potential signals; the signal processing module 120 is configured to determine the N400 difference amplitude and N400 wave latency under semantic inconsistency conditions based on the event-related potential signals acquired by the signal acquisition module 150, and to evaluate semantic understanding ability based on the N400 difference amplitude and the N400 wave latency.

[0114] Therefore, by assessing semantic understanding ability based on N400 difference wave amplitude and N400 wave latency, objective quantification of the highest level of auditory function (semantic understanding) can be achieved, providing a deeper neurological basis for evaluating the effectiveness of artificial hearing devices and guiding user rehabilitation. Furthermore, by marking the occurrence time of key ending words in each trial, accurate classification of ERP signals under semantically consistent and semantically inconsistent conditions can be achieved, thus laying a solid foundation for the extraction of N400 difference waves.

[0115] Specifically, the digital signal used to induce the N400 wave in the auditory semantic misalignment paradigm test comprises trials consisting of two types of stimuli: semantically consistent statements and semantically inconsistent statements, each accounting for 50%. In a trial, the user's semantic expectation is established by first playing the first part of a short sentence (excluding the last keyword) (e.g., "This is too..."), followed by the final keyword. In semantically consistent statements, the final keyword conforms to the contextual expectation (e.g., "Okay"); in semantically inconsistent statements, the final keyword does not conform to the contextual expectation (e.g., "ran away"). The stimulus data can be derived from Mandarin Chinese CMnBio, Mandarin speech audiometry materials (MSTMs), etc. The total number of trials can be, but is not limited to, 200. The stimuli of semantically consistent and semantically inconsistent statements are balanced in terms of key linguistic attributes such as word frequency, length, and abstraction, and are randomly mixed in the experiment to avoid forming a predetermined strategy. The trial interval can be, but is not limited to, 1500 ms. The user does not need to react to the sound but must remain seated.

[0116] Furthermore, the acquisition method for ERP signals under the auditory semantic misalignment paradigm test digital signal is consistent with the acquisition method under the passive quirk ball paradigm test digital signal. During acquisition, the occurrence time of key ending words in each trial needs to be marked.

[0117] Furthermore, for each trial, the signal processing module 120 uses the instant of the key ending word as the time zero point and extracts the ERP signal from 200ms before the stimulus begins to 800ms after the stimulus begins, as a complete analysis time history. Then, the extracted ERP signal is sequentially subjected to bandpass filtering (filtering frequency 0.1Hz-30Hz), artifact removal, baseline correction, and reference electrode correction. Since the N400 wave latency is 250ms-600ms, the N400 wave amplitude and latency can be measured by finding the most prominent negative peak within this window.

[0118] Furthermore, the N400 results under semantically consistent and semantically inconsistent conditions were averaged separately, and the difference waveforms (the amplitude of the N400 waveform under the semantically inconsistent condition minus the amplitude of the N400 waveform under the semantically consistent condition) were analyzed. If the N400 difference waveform amplitude is significant, the user's semantic processing and cognitive abilities are normal; otherwise, under that time period or specific program number encoding, the user cannot correctly distinguish Chinese words, affecting semantic understanding.

[0119] Furthermore, the N400 difference amplitude value can be calculated using the following formula:

[0120]

[0121] In the formula, Amp diff The difference amplitude value is N400.incong For the N400 wave amplitude under semantic inconsistency conditions, Amp cong The amplitude of the N400 wave under the condition of semantic consistency.

[0122] Furthermore, if the N400 difference amplitude value Amp diff N400 wave latency less than or equal to a preset differential amplitude value (e.g., -3.5 μV) and under semantically inconsistent conditions. incong If the latency is greater than or equal to the first preset latency (e.g., 400ms) and less than or equal to the second preset latency (e.g., 550ms), it indicates that the user's semantic processing and cognitive abilities are normal (test passed), and no specific program number needs to be recommended in this case. Otherwise, the program number needs to be changed before conducting the N400 test again, until the changed program number passes the test. If all existing program numbers fail the test, it indicates that the user's vocabulary discrimination and semantic comprehension will be significantly affected. In this case, it is recommended that the user strengthen speech rehabilitation training, and it is also recommended that an audiologist assist in further adjusting the program number.

[0123] In some exemplary embodiments, when the external signal is a speech stimulus paradigm test digital signal, a speech signal in a quiet environment, or a speech signal in a noisy environment, the signal processing module 120 is configured to: extract the Delta wave actual speech envelope and the Theta wave actual speech envelope based on the speech stimulus paradigm test digital signal, the speech signal in a quiet environment, or the speech signal in a noisy environment; extract Delta wave data and Theta wave data based on the EEG signals acquired by the signal acquisition module 150; reconstruct the Delta wave reconstructed speech envelope and the Theta wave reconstructed speech envelope based on the extracted Delta wave data and Theta wave data; and calculate a third speech discrimination ability score based on the correlation coefficient between the Delta wave reconstructed speech envelope and the Delta wave actual speech envelope, and the correlation coefficient between the Theta wave reconstructed speech envelope and the Theta wave actual speech envelope.

[0124] Due to the correlation coefficient C between the Delta wave reconstructed speech envelope and the Delta wave actual speech envelope... Delta The correlation coefficient C between the Theta wave reconstructed speech envelope and the Theta wave actual speech envelope can significantly predict the user's comprehension of the target speech. Theta It can significantly predict speech clarity, thereby through C-based Delta and C Theta Calculating the third speech discrimination ability score can effectively improve the accuracy of speech discrimination ability assessment results.

[0125] It should be noted that C can be calculated using the Pearson product-moment correlation coefficient formula, which is well known to those skilled in the art. Delta and C Theta .

[0126] Specifically, in the auditory semantic misalignment paradigm test digital signal, the target speech stimulus is a Chinese sentence, and the material can be derived from the Mandarin Chinese version of CMnBio, Mandarin speech audiometry materials MSTMs, etc. In the quiet scene paradigm, only the target speech stimulus needs to be played; in the noisy scene paradigm, in addition to playing the target speech stimulus, background noise also needs to be added. The noise material comes from a noise material library of daily life scenes (such as restaurants, roads, subway stations, etc.) (i.e., speech scenes under daily life noise) or the Chinese sentence material library mentioned above (i.e., speech scenes under noise from multiple people communicating), so that the signal-to-noise ratio ranges from 5~10dB (mild noise), 0~5dB (moderate noise), and -5~0dB (high noise).

[0127] Furthermore, when the signal source 110 picks up external natural sound signals, the signal processing module 120 determines whether the current scene is a speech scene through scene recognition, and evaluates whether the signal-to-noise ratio of the current external natural sound signal is greater than 10dB (i.e., a quiet scene) or falls within the three signal-to-noise ratio ranges of a noisy scene. If so, the current natural scene can be used for central assessment. One paradigm lasts for about 10 minutes. The user needs to remain in a resting state and does not need to react to the sound, but needs to maintain attention to the target speech stimulus.

[0128] Furthermore, when the artificial hearing device is a fully implanted cochlear implant, the acquisition electrode is any external cochlear electrode (preferably close to the central brain region), the reference electrode is any internal cochlear electrode (not used as a stimulation electrode or acquisition electrode) or any external cochlear electrode (not used as a acquisition electrode, and at a certain distance from the acquisition electrode so that an effective waveform can be detected), and the ground electrode is any internal or external cochlear electrode (not used as a stimulation electrode, the ground electrode of the stimulation module 140, or the acquisition electrode). When the artificial hearing device is a partially implanted cochlear implant, the acquisition electrode can be any external cochlear electrode or any external scalp electrode, the reference electrode is any internal cochlear electrode (not used as a stimulation electrode) or any external cochlear electrode or external scalp electrode (not used as a acquisition electrode, and at a certain distance from the acquisition electrode so that an effective waveform can be detected), and the ground electrode is any internal or external cochlear electrode (not used as a stimulation electrode, the ground electrode of the stimulation module 140, or the acquisition electrode). When the artificial hearing device is an auditory brainstem implantation device, the acquisition electrode is any external brainstem electrode, the reference electrode is any cochlear nucleus electrode or any external brainstem electrode (not used as an acquisition electrode, and is at a certain distance from the acquisition electrode so that it can detect an effective waveform), and the ground electrode is any cochlear nucleus electrode or any external brainstem electrode (not used as a stimulation electrode, the ground electrode of the stimulation module 140, or the acquisition electrode).

[0129] Furthermore, the acquisition precision of the electroencephalogram (EEG) signal can be, but is not limited to, 24 bits, the sampling frequency can be, but is not limited to, 500 Hz, and the gain can be, but is not limited to, 80 dB. During the acquisition of the EEG signal, the stimulation module 140 and the signal acquisition module 150 need to operate simultaneously. To avoid the influence of stimulation on signal acquisition artifacts, template subtraction can be used to remove artifacts.

[0130] Furthermore, Delta wave data can be extracted by performing bandpass filtering of the EEG signal at a frequency of 1Hz-4Hz, followed by artifact removal, baseline correction, and reference electrode correction; Theta wave data can be extracted by performing bandpass filtering of the EEG signal at a frequency of 4Hz-8Hz, followed by artifact removal, baseline correction, and reference electrode correction.

[0131] Furthermore, the original external signal (digital signal of speech stimulus paradigm test, speech signal in a quiet environment or speech signal in a noisy environment) can be preprocessed by downsampling and full-wave rectification, and then the preprocessed external signal can be filtered to the target EEG frequency band (1Hz-4Hz, 4Hz-8Hz), and finally downsampled to 50Hz to extract the Delta wave actual speech envelope and Theta wave actual speech envelope.

[0132] Furthermore, an inverse linear model can be used to reconstruct the speech envelope of the extracted Delta and Theta wave data, thereby obtaining the reconstructed Delta and Theta wave speech envelopes. Specifically, regarding how to use an inverse linear model to reconstruct the speech envelope of the extracted Delta and Theta wave data, please refer to relevant materials known to those skilled in the art for an adaptive understanding; further explanation is not provided here.

[0133] In some exemplary embodiments, calculating the third speech discrimination ability score based on the correlation coefficient between the Delta wave reconstructed speech envelope and the actual Delta wave speech envelope, and the correlation coefficient between the Theta wave reconstructed speech envelope and the actual Theta wave speech envelope, includes: calculating the third speech discrimination ability score using the following formula:

[0134]

[0135] In the formula, Score_EEG is the third speech discrimination ability score, and C Delta C is the correlation coefficient between the reconstructed speech envelope of the Delta wave and the actual speech envelope of the Delta wave. ThetaThe correlation coefficient between the reconstructed speech envelope of the Theta wave and the actual speech envelope of the Theta wave. For Theta wave weights, and .

[0136] Therefore, by using the above formula to calculate the third speech discrimination ability score, a weighted score can be dynamically optimized according to the different auditory rehabilitation stages or hearing impairment types of different patients, thereby providing better data support for the optimization of stimulus strategy coding parameters and the tracking of user rehabilitation.

[0137] It should be noted that, within the same time period, for speech stimuli with the same signal-to-noise ratio, a program number with a higher Score_EEG is better in this type of speech environment; furthermore, as the rehabilitation time increases, if the Score_EEG gradually increases for speech stimuli with the same signal-to-noise ratio, it indicates that the user's auditory clarity and speech discrimination ability gradually improve in quiet or noisy environments. It should also be noted that this invention... The specific value is not limited. The value can be, but is not limited to, 0.5.

[0138] In some exemplary embodiments, the signal processing module 120 is further configured to test the speech discrimination ability assessment results under digital signal and / or external natural sound signal stimulation based on speech stimulation paradigms of different signal-to-noise ratio speech scenarios, and comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect. The different signal-to-noise ratio speech scenarios include quiet speech scenarios, slightly noisy speech scenarios, moderately noisy speech scenarios, and highly noisy speech scenarios.

[0139] Therefore, this setup enables full-scene coverage assessment of the real auditory world, which can better provide data support for optimizing stimulus strategy coding parameters and providing precise rehabilitation guidance.

[0140] Specifically, the speech discrimination ability assessment results under digital signal and / or external natural sound signal stimuli can be tested based on speech stimulus paradigms in speech scenarios with different signal-to-noise ratios, and the following formula can be used for comprehensive evaluation:

[0141]

[0142] In the formula, Score_EEG_synthetic represents the second comprehensive speech discrimination ability score based on EEG signals, Score_EEG_silent represents the third speech discrimination ability score in quiet speech scenarios, Score_EEG_mild represents the third speech discrimination ability score in mildly noisy speech scenarios, Score_EEG_medium represents the third speech discrimination ability score in moderately noisy speech scenarios, and Score_EEG_intense represents the third speech discrimination ability score in highly noisy speech scenarios. silent For quiet speech scenarios, w mild For weighting in mildly noisy speech scenarios, w medium For moderately noisy speech scenarios, w intense For weights in highly noisy speech scenarios, 0 < w silent <1, 0 <w mild <1, 0 <w medium <1, 0 <w intense <1, and w silent +w mild +w medium +w intense =1.

[0143] It should be noted that this invention relates to w silent w mild w medium w intense The specific value is not limited, for example, w silent The value of w can be 0.4. mild The value of w can be 0.2. medium The value of w can be 0.2. intense The value can be 0.2.

[0144] In some exemplary embodiments, the signal processing module 120 is further configured to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the speech discrimination ability assessment results stimulated by the digital signals of the auditory event-related potential paradigm test and the digital signals of the auditory brainwave paradigm test.

[0145] Therefore, this setup enables comprehensive, multi-dimensional assessment across all levels, from the brainstem to the cortex, from automatic perception to active understanding, and from basic discrimination to real-world scene tracking, thereby significantly improving the accuracy and reliability of the assessment results.

[0146] Specifically, a comprehensive assessment can be conducted based on the first comprehensive speech discrimination ability score (Score_ERP) and the second comprehensive speech discrimination ability score (Score_EEG_Comprehensive), using the following formula:

[0147]

[0148] In the formula, Score_ is the third comprehensive speech discrimination ability score that integrates event-related potential signals and electroencephalogram (EEG) signals, and w ERP For event-related potential weights, w EEG For brainwave weights, 0 < w ERP <1, 0 <w EEG <1, and w ERP +w EEG =1.

[0149] It should be noted that this invention relates to w ERP and w EEG The specific value is not limited, for example, w ERP The value of w can be 0.4. EEG The value can be 0.6.

[0150] In some exemplary embodiments, when the external signal is a music signal or a digital signal from a music stimulation paradigm test, the signal processing module 120 is configured to: extract baseline Beta wave data and baseline Gamma wave data based on the EEG signals acquired by the signal acquisition module 150 before music stimulation; perform time-frequency analysis on the baseline Beta wave data and the baseline Gamma wave data respectively to obtain corresponding baseline Beta wave time-frequency data and baseline Gamma wave time-frequency data; obtain baseline Beta wave time-frequency energy based on the baseline Beta wave time-frequency data, and obtain baseline Gamma wave time-frequency energy based on the baseline Gamma wave time-frequency data; and extract music-period Beta wave data and music-period Gamma wave data based on the EEG signals acquired by the signal acquisition module 150 during music stimulation. Gamma wave data; Time-frequency analysis is performed on the music period Beta wave data and the music period Gamma wave data respectively to obtain the corresponding music period Beta wave time-frequency data and music period Gamma wave time-frequency data; Based on the music period Beta wave time-frequency data, the music period Beta wave time-frequency energy is obtained, and based on the music period Gamma wave time-frequency data, the music period Gamma wave time-frequency energy is obtained; Based on the music period Beta wave time-frequency energy and the baseline period Beta wave time-frequency energy, the percentage change in Beta wave time-frequency energy is obtained, and based on the music period Gamma wave time-frequency energy and the baseline period Gamma wave time-frequency energy, the percentage change in Gamma wave time-frequency energy is obtained; Based on the percentage change in Beta wave time-frequency energy and the percentage change in Gamma wave time-frequency energy, a music appreciation ability assessment value is calculated.

[0151] Therefore, this setup can eliminate the influence of individual differences, thus providing an objective basis for optimizing the coding parameters of stimulation strategies in music scenarios and tracking users' auditory rehabilitation. Furthermore, since the energy enhancement of Beta waves is generally associated with music-induced attention, alertness, and rhythm perception, and the energy enhancement of Gamma waves is closely related to higher-level perceptual integration, subjective pleasure, and the aesthetic experience of music, an objective assessment of music appreciation ability can be achieved by calculating music appreciation ability based on the percentage changes in Beta wave and Gamma wave time-frequency energy.

[0152] Specifically, in the digital signal test of the music stimulus paradigm, the target music stimulus is instrumental music without lyrics (keyboard instruments, strings, wind instruments, etc.). When the signal source 110 picks up external natural sound signals, the signal processing module 120 determines whether the current scene is a music scene through scene recognition. One paradigm lasts approximately 10 minutes. The user needs to remain still and does not need to react to the sound, but must maintain attention to the music stimulus.

[0153] Furthermore, the acquisition method of EEG signals under music signal or music stimulus paradigm test digital signal stimulation is the same as the acquisition method of EEG signals under speech stimulus paradigm test digital signal, speech signal in quiet environment or speech signal in noisy environment stimulation. For details, please refer to the relevant description above, and will not be repeated here.

[0154] Furthermore, by applying a bandpass filter (13Hz-30Hz) to the EEG signals acquired before music stimulation, followed by artifact removal, baseline correction, and reference electrode correction, baseline Beta wave data can be extracted. Similarly, by applying a bandpass filter (30Hz-49Hz) to the EEG signals acquired before music stimulation, followed by artifact removal, baseline correction, and reference electrode correction, baseline Gamma wave data can be extracted. Likewise, by applying a bandpass filter (13Hz-30Hz) to the EEG signals acquired during music stimulation, followed by artifact removal, baseline correction, and reference electrode correction, music-phase Beta wave data can be extracted; and by applying a bandpass filter (30Hz-49Hz) to the EEG signals acquired during music stimulation, followed by artifact removal, baseline correction, and reference electrode correction, music-phase Gamma wave data can be extracted.

[0155] By performing ZAM (Zhao-Atlas-Marks) time-frequency analysis on the extracted baseline Beta wave data, the baseline Gamma wave time-frequency data can be obtained; similarly, by performing ZAM (Zhao-Atlas-Marks) time-frequency analysis on the extracted baseline Gamma wave data, the music-period Beta wave time-frequency data can be obtained; and by performing ZAM (Zhao-Atlas-Marks) time-frequency analysis on the extracted music-period Gamma wave data, the music-period Gamma wave time-frequency data can be obtained. It should be noted that the specific details of ZAM time-frequency analysis can be found in relevant materials known to those skilled in the art, and will not be elaborated upon here.

[0156] In some exemplary embodiments, calculating the music appreciation ability assessment value based on the percentage change in the time-frequency energy of the Beta wave and the percentage change in the time-frequency energy of the Gamma wave includes: calculating the music appreciation ability assessment value using the following formula:

[0157]

[0158] In the formula, P out P is the assessment value for music appreciation ability. Beta P represents the percentage change in time-frequency energy of the Beta wave. Gamma The percentage change in time-frequency energy of the Gamma wave. For Beta wave weights, and .

[0159] Therefore, by using the above formula to calculate the music appreciation ability assessment value, the music appreciation ability can be accurately quantified, which can provide an objective basis for optimizing the coding parameters of the stimulation strategy in music scenarios and tracking the user's auditory rehabilitation.

[0160] It should be noted that musical stimuli targeting the same instrument within the same time period have a greater P-value. out The program number is better suited to this type of music listening environment; and as the duration of rehabilitation increases, P out The gradual increase indicates that the user's music appreciation ability is gradually improving. It should also be noted that this invention... The specific value is not limited. The value can be, but is not limited to, 0.5.

[0161] Based on the same inventive concept, the present invention also provides an artificial hearing device, including the hearing assessment system described above. Since the artificial hearing device and the hearing assessment system provided by the present invention belong to the same inventive concept, the artificial hearing device provided by the present invention possesses at least all the beneficial effects of the hearing assessment system provided by the present invention. For details, please refer to the relevant descriptions above; therefore, the beneficial effects of the artificial hearing device provided by the present invention will not be elaborated upon here.

[0162] Furthermore, the artificial hearing device can be a fully implanted cochlear implant, a partially implanted cochlear implant, or an auditory brainstem implant.

[0163] Please continue to refer to this. Figure 4 This is a schematic diagram of the rectangular structure of a fully implantable cochlear implant. Figure 4 As shown, the fully implantable cochlear implant includes an implantable sound processor 210, a stimulator 220, a collector 230, an external cochlear electrode array 240, and an internal cochlear electrode array 250. The implantable sound processor 210 includes a signal source 110, which can pick up external natural sound signals subcutaneously via a microphone and / or receive audio digital signals transmitted via Bluetooth from a mobile application 260. The implantable sound processor 210 also includes a signal processing module 120, which can analyze and identify external signals, encode them into electrical signals, and perform closed-loop tuning. The signal processing module 120 stores multiple program numbers (stimulation strategy encoding parameters), which are usually set by an audiologist during offline setup. Patients can select one of these program numbers to run during daily use. Parameters in a program number include speech strategy, stimulation mode, reference electrode, stimulation rate, pulse width, T-value, C-value, single-channel gain, clipping, etc. The signal processing module 120 encodes external signals according to the currently running program number.

[0164] The stimulator 220 includes a control module 130, which is connected to the implanted sound processor 210 via a cable and receives stimulation signals transmitted by the implanted sound processor 210. Both the intracochlear electrode array 250 and the extracochlear electrode array 240 contain multiple electrodes. The intracochlear electrode array 250 is implanted within the cochlear duct (typically in the scala tympani); the extracochlear electrodes can be in array form and / or located on the surface of the stimulator 220, implanted subcutaneously in the temporal scalp or on the surface of the temporal bone. The stimulation electrodes in the stimulation module 140 consist of intracochlear electrodes, and the grounding electrode can consist of one or more intracochlear or extracochlear electrodes (depending on the stimulation mode). The stimulator 220 transmits encoded external stimulation signals to the stimulation electrodes, forming a stimulation circuit with the grounding electrode.

[0165] When the signal acquisition module 150 needs to operate, different acquisition arrays are activated according to the type of signal to be acquired. The electrical signals acquired by the acquisition arrays are returned to the implantable sound processor 210 for decoding, analysis, and storage via the acquisition unit 230 (which is the same module as the stimulator 220). The signal decoding, analysis, and storage functions can also be transferred to the mobile software 260 for execution. The implantable sound processor 210 and the mobile software 260 communicate wirelessly via Bluetooth (i.e., the mobile software 260 is part of the signal processing module 120). By comparing the same type of auditory center signals measured under different program numbers within the same time period, the implantable sound processor 210 or the mobile software 260 recommends program numbers with the best listening effect in different acoustic scenarios to the user. The user can choose whether to apply the result to the implantable sound processor 210, which can automatically switch to the best program number according to the current acoustic environment. The implantable sound processor 210 or mobile software 260 can also compare similar auditory center signals measured under the same program number at different time periods, providing feedback to the user on the auditory rehabilitation progress. The auditory center signal analysis results are all stored in the implantable sound processor 210 or mobile software 260, which audiologists can access and view when needed.

[0166] Please continue to refer to this. Figure 5 This is a schematic diagram of the rectangular structure of a semi-implanted cochlear implant. Figure 5 As shown, the semi-implantable cochlear implant includes an external sound processor 310, a stimulator 220, a collector 230, an external cochlear electrode array 240, an internal cochlear electrode array 250, and a scalp external electrode array 320. The external sound processor 310 includes a signal source 110, which can pick up external natural sound signals externally via a microphone and / or receive digital signals transmitted via Bluetooth from a mobile terminal software 260. The external sound processor 310 also includes a signal processing module 120, which can analyze and identify external signals, encode them into electrical signals, and perform closed-loop tuning. The signal processing module 120 stores multiple program numbers (stimulation strategy encoding parameters), which are usually set by the audiologist during offline adjustments. Patients can select one of these program numbers to run during daily use. Parameters in a program number include speech strategy, stimulation mode, reference electrode, stimulation rate, pulse width, T-value, C-value, single-channel gain, clipping, and current mapping curve. The signal processing module 120 encodes the signal according to the currently running program number.

[0167] The stimulator 220 is separated from the external sound processor 310 by the scalp and is coupled and wirelessly transmits signals via a magnet and a radio frequency (RF) coil. It receives stimulation signals and closed-loop adjustment commands transmitted by the external sound processor 310. Both the intracochlear electrode array 250 and the extracochlear electrode array 240 contain multiple electrodes. The intracochlear electrode array 250 is implanted within the cochlear duct (typically in the scala tympani); the extracochlear electrodes can be in array form and / or located on the surface of the stimulator 220, implanted under the temporal scalp or on the surface of the temporal bone. The stimulation electrodes in the stimulation module 140 consist of intracochlear electrodes, and the grounding electrode can consist of one or more intracochlear or extracochlear electrodes (depending on the stimulation mode). The stimulator 220 transmits the encoded external stimulation signal to the stimulation electrodes, forming a stimulation circuit with the grounding electrode.

[0168] When the signal acquisition module 150 needs to operate, different acquisition arrays are activated according to the type of signal to be acquired. The electrical signals acquired by the in vivo electrode array (including the intracochlear electrode array 250 and the extracochlear electrode array 240) are returned to the external sound processor 310 for decoding, analysis, and storage via the acquisition unit 230 (which is the same module as the stimulator 220). Furthermore, the external sound processor 310 may include an external scalp electrode array 320 on the scalp side as part of the signal acquisition module 150. The signal decoding, analysis, and storage functions can also be transferred to the mobile software 260 for execution, and the external sound processor 310 and the mobile software 260 communicate wirelessly via Bluetooth (i.e., the mobile software 260 is part of the signal processing module 120). The external sound processor 310 or mobile software 260 compares similar auditory center signals measured under different program numbers within the same time period and recommends the program number with the best hearing effect in different acoustic scenarios. The user can choose whether to apply the result to the external sound processor 310, which can automatically switch to the best program number according to the acoustic environment. The external sound processor 310 or mobile software 260 can also compare similar auditory center signals measured under the same program number within different time periods and provide feedback to the user on the hearing rehabilitation progress. The auditory center signal analysis results are all stored in the external sound processor 310 or mobile software 260, which audiologists can access and view when needed.

[0169] Please continue to refer to this. Figure 6 This is a schematic diagram of the block structure of an auditory brainstem implantation device. Figure 6As shown, the auditory brainstem implantation device includes an external sound processor 310, a stimulator 220, a collector 230, a brainstem external electrode array 330, a cochlear nucleus electrode array 340, and a scalp external electrode array 320. The cochlear nucleus electrode array 340 is implanted on the ventral and dorsal surfaces of the cochlear nucleus in the brainstem. The brainstem external electrodes can be in array form and / or located on the surface of the stimulator 220, implanted under the scalp in the temporal region or on the surface of the temporal bone. The stimulation electrodes in the stimulation module 140 consist of cochlear nucleus electrodes, and the grounding electrodes can consist of one or more electrodes from the cochlear nucleus or outside the brainstem (depending on the stimulation mode).

[0170] It should be noted that the auditory brainstem implant device is similar in composition to the semi-implantable cochlear implant, the difference being that the internal electrode array consists of a cochlear nuclear electrode array 340 and a brainstem external electrode array 330. The function of the intracochlear electrodes in the stimulation module 140 and signal acquisition module 150 of the semi-implantable cochlear implant is replaced by the cochlear nuclear electrodes in the auditory brainstem implant device. Similarly, the function of the extracochlear electrodes in the stimulation module 140 and signal acquisition module 150 of the semi-implantable cochlear implant is replaced by the brainstem external electrodes in the auditory brainstem implant device.

[0171] In summary, compared with existing technologies, the auditory assessment system and artificial hearing device provided by this invention have the following beneficial effects: This invention allows users to monitor auditory-related EEG signals daily without the need for additional implantation or wearing of accessories outside the artificial hearing device, objectively assessing the auditory effect of stimulus strategy encoding parameters and the user's speech rehabilitation progress. The assessment results can be directly applied to the application of program numbers after daily scene recognition and to tracking the user's rehabilitation level. Furthermore, this invention can effectively reduce the cost of manual device adjustment and improve user rehabilitation efficiency. Moreover, this invention is applicable to most commercially available and mature artificial hearing devices, exhibiting strong scalability.

[0172] It should be noted that the above description is only a description of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention in any way. Any changes or modifications made by those skilled in the art based on the above disclosure shall fall within the protection scope of the present invention.

Claims

1. An auditory assessment system, characterized in that, The auditory assessment system is integrated with an artificial hearing device. The auditory assessment system includes a signal source, a signal processing module, a control module, a stimulation module, and a signal acquisition module. The signal source, the control module, and the signal acquisition module are all communicatively connected to the signal processing module. The stimulation module and the signal acquisition module are all communicatively connected to the control module. The signal source is configured to acquire external signals and transmit them to the signal processing module. The external signals include at least one of external natural sound signals and external digital audio signals. The signal processing module is configured as follows: The external signals are analyzed and identified to determine whether they are suitable for auditory center testing and evaluation. If so, the external signal is encoded into an electrical stimulation signal using the selected stimulation strategy encoding parameters and transmitted to the control module, and an auditory center signal acquisition command is sent to the control module. The control module is configured to control the stimulation module to output a corresponding electrical pulse signal based on the electrical stimulation signal, and to output an acquisition command to the signal acquisition module based on the auditory center signal acquisition command; The signal acquisition module is configured to call the corresponding acquisition array to acquire the target auditory center signal based on the acquisition command, and transmit it to the signal processing module. The acquisition array includes acquisition electrodes, ground electrodes and reference electrodes, and the acquisition electrodes, the ground electrodes and the reference electrodes are all electrodes of the artificial hearing device itself. The signal processing module is further configured to: evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the target auditory center signal.

2. The auditory assessment system according to claim 1, characterized in that, The process of analyzing and identifying the external signals to determine whether they are suitable for auditory central nervous system testing and evaluation includes: If the external signal is an external natural sound signal and the external natural sound signal meets the preset sound conditions, then the external signal is determined to be suitable for auditory center testing and evaluation. The preset sound conditions include the external natural sound signal being a speech signal in a quiet environment, a speech signal in a noisy environment, or a music signal. If the external signal is an external digital audio signal, and the external digital audio signal is an auditory event-related potential paradigm test digital signal or an auditory brainwave paradigm test digital signal, then the external signal is determined to be suitable for auditory central nervous system testing and evaluation. The auditory event-related potential paradigm test digital signal includes at least one of the following: a passive trolley paradigm test digital signal for inducing mismatch negative waves, an active trolley paradigm test digital signal for inducing P300 waves, and an auditory semantic misalignment paradigm test digital signal for inducing N400 waves; the auditory brainwave paradigm test digital signal includes at least one of the following: a speech stimulation paradigm test digital signal and a music stimulation paradigm test digital signal. When the external signal is a digital signal of the auditory event-related potential paradigm test, the signal of the target auditory center acquired by the signal acquisition module is an event-related potential signal; When the external signal is a speech signal in a quiet environment, a speech signal in a noisy environment, a music signal, or a digital signal from an auditory EEG paradigm test, the target auditory center signal acquired by the signal acquisition module is an EEG signal.

3. The auditory assessment system according to claim 2, characterized in that, When the external signal is a passive spherical paradigm test digital signal used to induce mismatch negative waves, the signal acquisition module is configured to mark the time point of stimulus occurrence when acquiring event-related potential signals; the signal processing module is configured to determine the amplitude and latency of the mismatch negative waves based on the event-related potential signals acquired by the signal acquisition module, and calculate the first speech discrimination ability score based on the amplitude and latency of the mismatch negative waves.

4. The auditory assessment system according to claim 3, characterized in that, The calculation of the first speech discrimination ability score based on the mismatch negative wave amplitude and the mismatch negative wave latency includes: The first speech discrimination score is calculated using the following formula: In the formula, Score_MMN is the first speech discrimination ability score, max indicates taking the maximum value, min indicates taking the minimum value, and A current_MMN A represents the amplitude of the mismatched negative wave obtained from the current measurement. baseline_MMN A is the amplitude of the mismatch negative waveform recorded during the user's initial device setup. target_MMN For the target mismatch negative wave amplitude, L current_MMN L represents the currently measured latency of the mismatch negative wave. baseline_MMN L is the latency period of the mismatch negative waveform recorded during the user's first implantation and tuning. target_MMN For the target mismatch negative wave latency, w A_MMN For the mismatched negative wave amplitude weight, w L_MMN For mismatched negative wave latent options, 0 < w A_MMN <1, 0 <w L_MMN <1, and w A_MMN +w L_MMN =1.

5. The auditory assessment system according to claim 2, characterized in that, When the external signal is an active spherical paradigm test digital signal used to induce the P300 wave, the signal acquisition module is configured to mark the time point of stimulus occurrence when acquiring event-related potential signals; the signal processing module is configured to determine the P300 wave amplitude and P300 wave latency based on the event-related potential signals acquired by the signal acquisition module, and calculate the second speech discrimination ability score based on the P300 wave amplitude, the P300 wave latency, and the user's behavioral response accuracy.

6. The auditory assessment system according to claim 5, characterized in that, The calculation of the second speech discrimination ability score based on the P300 wave amplitude, the P300 wave latency, and the user's behavioral response accuracy includes: The second speech discrimination score is calculated using the following formula: In the formula, Score_P300 is the second speech discrimination ability score, max indicates taking the maximum value, min indicates taking the minimum value, and A current_P300 For the currently measured P300 wave amplitude, A baseline_P300 The P300 waveform amplitude recorded during the user's initial device setup, A target_P300 For the target P300 wave amplitude, L current_P300 L represents the currently measured latency of the P300 wave. baseline_P300 The latency of the P300 wave recorded during the user's initial device setup, L target_P300 For the target P300 wave latency period, w A_P300 For the P300 wave amplitude weight, w L_P300 For P300 wave latent options, P be For the accuracy of user behavior response, w B_P300 For behavioral response weights, 0 < w A_P300 <1, 0 <w L_P300 <1, 0 <w B_P300 <1, and w A_P300 +w L_P300 +w B_P300 =1.

7. The auditory assessment system according to claim 2, characterized in that, When the external signal is a digital signal used to induce the N400 wave in an auditory semantic misalignment paradigm test, the signal acquisition module is configured to mark the occurrence time of key ending words in each trial when acquiring event-related potential signals; the signal processing module is configured to determine the N400 wave latency under the conditions of N400 difference wave amplitude and semantic inconsistency based on the event-related potential signals acquired by the signal acquisition module, and to evaluate semantic understanding ability based on the N400 difference wave amplitude and the N400 wave latency.

8. The auditory assessment system according to claim 2, characterized in that, When the external signal is a digital signal from a speech stimulus paradigm test, a speech signal in a quiet environment, or a speech signal in a noisy environment, the signal processing module is configured as follows: Based on the speech stimulus paradigm, test digital signals, speech signals in quiet environments, or speech signals in noisy environments, extract the Delta wave actual speech envelope and the Theta wave actual speech envelope. Based on the EEG signals acquired by the signal acquisition module, Delta wave data and Theta wave data are extracted. Based on the extracted Delta wave data and Theta wave data, the Delta wave reconstructed speech envelope and the Theta wave reconstructed speech envelope are reconstructed. The third speech discrimination ability score is calculated based on the correlation coefficient between the Delta wave reconstructed speech envelope and the Delta wave actual speech envelope, and the correlation coefficient between the Theta wave reconstructed speech envelope and the Theta wave actual speech envelope.

9. The auditory assessment system according to claim 8, characterized in that, The calculation of the third speech discrimination ability score based on the correlation coefficient between the Delta wave reconstructed speech envelope and the Delta wave actual speech envelope, and the correlation coefficient between the Theta wave reconstructed speech envelope and the Theta wave actual speech envelope, includes: The third speech discrimination ability score is calculated using the following formula: In the formula, Score_EEG is the third speech discrimination ability score, and C Delta C is the correlation coefficient between the reconstructed speech envelope of the Delta wave and the actual speech envelope of the Delta wave. Theta The correlation coefficient between the reconstructed speech envelope of the Theta wave and the actual speech envelope of the Theta wave. For Theta wave weights, and .

10. The auditory assessment system according to claim 2, characterized in that, When the external signal is a music signal or a digital signal from a music stimulus paradigm test, the signal processing module is configured as follows: Based on the EEG signals acquired by the signal acquisition module before music stimulation, baseline Beta wave data and baseline Gamma wave data are extracted. Time-frequency analysis was performed on the baseline period Beta wave data and the baseline period Gamma wave data respectively to obtain the corresponding baseline period Beta wave time-frequency data and baseline period Gamma wave time-frequency data; Based on the baseline period Beta wave time-frequency data, the baseline period Beta wave time-frequency energy is obtained; based on the baseline period Gamma wave time-frequency data, the baseline period Gamma wave time-frequency energy is obtained. Based on the EEG signals acquired by the signal acquisition module during music stimulation, Beta wave data and Gamma wave data during music stimulation are extracted. Time-frequency analysis was performed on the music period Beta wave data and the music period Gamma wave data respectively to obtain the corresponding music period Beta wave time-frequency data and music period Gamma wave time-frequency data; Based on the music period Beta wave time-frequency data, obtain the music period Beta wave time-frequency energy; based on the music period Gamma wave time-frequency data, obtain the music period Gamma wave time-frequency energy. Based on the Beta wave time-frequency energy during the music period and the Beta wave time-frequency energy during the baseline period, the percentage change in Beta wave time-frequency energy is obtained; based on the Gamma wave time-frequency energy during the music period and the Gamma wave time-frequency energy during the baseline period, the percentage change in Gamma wave time-frequency energy is obtained. The music appreciation ability assessment value is calculated based on the percentage change in time-frequency energy of the Beta wave and the percentage change in time-frequency energy of the Gamma wave.

11. The auditory assessment system according to claim 10, characterized in that, The calculation of the music appreciation ability assessment value based on the percentage change in time-frequency energy of the Beta wave and the percentage change in time-frequency energy of the Gamma wave includes: The following formula is used to calculate the assessment score for music appreciation ability: In the formula, P out P is the assessment value for music appreciation ability. Beta P represents the percentage change in time-frequency energy of the Beta wave. Gamma The percentage change in time-frequency energy of the Gamma wave. For Beta wave weights, and .

12. The auditory assessment system according to claim 2, characterized in that, The signal processing module is also configured to test the speech discrimination ability assessment results under digital signal and / or external natural sound signal stimulation based on speech stimulation paradigms of different signal-to-noise ratio speech scenarios, and comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect. The different signal-to-noise ratio speech scenarios include quiet speech scenarios, slightly noisy speech scenarios, moderately noisy speech scenarios and highly noisy speech scenarios.

13. The auditory assessment system according to claim 12, characterized in that, The speech discrimination ability assessment results based on the speech stimulation paradigm test under digital signal and / or external natural sound signal stimulation in speech scenarios with different signal-to-noise ratios are used to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, including: The auditory effect or the user's auditory rehabilitation effect of the stimulation strategy encoding parameters is comprehensively evaluated using the following formula: In the formula, Score_EEG_synthetic represents the comprehensive speech discrimination ability score based on EEG signals; Score_EEG_silent represents the speech discrimination ability score in quiet speech scenarios; Score_EEG_mild represents the speech discrimination ability score in mildly noisy speech scenarios; Score_EEG_medium represents the speech discrimination ability score in moderately noisy speech scenarios; and Score_EEG_intense represents the speech discrimination ability score in highly noisy speech scenarios. silent For quiet speech scenarios, w mild For weighting in mildly noisy speech scenarios, w medium For moderately noisy speech scenarios, w intense For weights in highly noisy speech scenarios, 0 < w silent <1, 0 <w mild <1, 0 <w medium <1, 0 <w intense <1, and w silent +w mild +w medium +w intense =1.

14. The auditory assessment system according to claim 2, characterized in that, The signal processing module is further configured to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the speech discrimination ability assessment results stimulated by the passive spherical paradigm test digital signal used to induce mismatch negative waves and the active spherical paradigm test digital signal used to induce P300 waves.

15. The auditory assessment system according to claim 14, characterized in that, The assessment of speech discrimination ability based on the results of the passive monster ball paradigm test digital signal used to induce mismatch negative waves and the active monster ball paradigm test digital signal used to induce P300 waves comprehensively evaluates the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, including: The auditory effect or the user's auditory rehabilitation effect of the stimulation strategy encoding parameters is comprehensively evaluated using the following formula: In the formula, Score_ERP is the comprehensive speech discrimination ability score based on event-related potential signals, Score_MMN is the speech discrimination ability assessment result under digital signal stimulation of the passive spherical paradigm test used to induce mismatch negative waves, and Score_P300 is the speech discrimination ability assessment result under digital signal stimulation of the active spherical paradigm test used to induce P300 waves. MMN For the mismatched negative wave weights, w P300 For P300 wave weights, 0 < w MMN <1, 0 <w P300 <1, and w MMN +w P300 =1.

16. The auditory assessment system according to claim 2, characterized in that, The signal processing module is also configured to comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect based on the speech discrimination ability assessment results stimulated by the digital signals of the auditory event-related potential paradigm test and the digital signals of the auditory EEG paradigm test.

17. The auditory assessment system according to claim 16, characterized in that, The assessment results of speech discrimination ability under stimulation by digital signals from the auditory event-related potential paradigm test and the auditory electroencephalogram paradigm test comprehensively evaluate the auditory effect of the stimulation strategy encoding parameters or the user's auditory rehabilitation effect, including: The auditory effect or the user's auditory rehabilitation effect of the stimulation strategy encoding parameters is comprehensively evaluated using the following formula: In the formula, Score_ is the comprehensive speech discrimination ability score that integrates event-related potential signals and EEG signals; Score_ERP is the comprehensive speech discrimination ability score based on event-related potential signals; Score_EEG_ is the comprehensive speech discrimination ability score based on EEG signals; and w ERP For event-related potential weights, w EEG For brainwave weights, 0 < w ERP <1, 0 <w EEG <1, and w ERP +w EEG =1.

18. The auditory assessment system according to claim 1, characterized in that, When the artificial hearing device is a fully implanted cochlear implant, the acquisition electrode is an external cochlear electrode, the reference electrode is an internal cochlear electrode or an external cochlear electrode spaced apart from the acquisition electrode, and the grounding electrode is an internal or external cochlear electrode that is not used as the acquisition electrode or the stimulation module.

19. The auditory assessment system according to claim 1, characterized in that, When the artificial hearing device is a semi-implanted cochlear implant, the acquisition electrode is an external cochlear electrode or an external scalp electrode, the reference electrode is an internal cochlear electrode, an external scalp electrode, or an external cochlear electrode spaced apart from the acquisition electrode, and the grounding electrode is an internal cochlear electrode or external cochlear electrode that is not used as the acquisition electrode or the stimulation module.

20. The auditory assessment system according to claim 1, characterized in that, When the artificial hearing device is an auditory brainstem implantation device, the acquisition electrode is a brainstem external electrode, the reference electrode is a cochlear nucleus electrode or a brainstem external electrode spaced apart from the acquisition electrode, and the grounding electrode is a cochlear nucleus electrode or brainstem external electrode that is not used as the acquisition electrode or the stimulation module.

21. An artificial hearing device, characterized in that, Including the auditory assessment system as described in any one of claims 1 to 20.

Images