An audio-visual multi-modal neuromodulation wearable system and a method of modulating the same

Abstract

The application discloses a kind of hearing visual multi-modal neural regulation wearable system and its regulation method, including acoustic stimulation instrument, digital hearing aid and LED visual light stimulation glasses three parts, wherein acoustic stimulation instrument is central control unit, built-in rhythm signal generation, modulation and synthesis, digital-analog conversion and Bluetooth communication module, realize sound-light synchronous control by unified clock synchronization module, digital hearing aid is used for voice enhancement and hearing compensation, rhythm sound signal output is received simultaneously, LED visual light stimulation glasses generate programmable frequency and phase difference flicker signal by PWM drive, system can output 30-50 Hz range gamma rhythm sound-light stimulation, realize the cross-modal neural regulation of auditory and visual pathway, by physiological signal feedback and App closed-loop management, system can dynamically adjust stimulation parameter, realize individualized neural regulation and safety protection, the system structure is compact, high synchronization accuracy, with hearing compensation, neural regulation treatment and remote management function.

Description

Technical Field

[0001] This invention relates to the technical field of diagnostic and treatment system equipment, and in particular to a wearable system for auditory and visual multimodal neural modulation and its modulation method. Background Technology

[0002] Numerous neuroimaging and EEG studies have shown that gamma rhythm (approximately 30–50 Hz) activity is closely related to cognition, attention, and memory. Abnormalities in gamma rhythm are often accompanied by functional imbalances in the auditory cortex and limbic system. Transmodal gamma rhythm stimulation through auditory and visual means can induce phase synchronization of neurons in the cerebral cortex, improve cortical plasticity, and thus alleviate neurological and cognitive dysfunction.

[0003] An MIT research team (Iaccarino et al., Nature, 2016) discovered that 40 Hz light stimulation can significantly reduce β-amyloid protein deposition in the brains of mice. Subsequent studies further indicated that combined sound and light stimulation can more effectively improve brain functional connectivity than a single mode. Multicenter clinical observations in China have also confirmed that low-frequency gamma rhythmic sound stimulation has a significant effect on improving subjective annoyance level (THI) and sleep quality (PSQI) in tinnitus patients.

[0004] However, existing audio-visual stimulation devices, such as the published patent "Eyeglass-type Alzheimer's Disease Audio-visual Therapy Device" (CN110639131A), and many single-mode design devices, have the following main shortcomings: (1) Simple structure: lacks hearing compensation function, and cannot accurately control the intensity of acoustic stimulation in patients with different hearing levels; (2) Asynchronous timing: audio-visual signals are driven independently, lacking a unified clock synchronization module and cross-modal synchronization mechanism; (3) Insufficient individualization: stimulation frequency, phase and waveform parameters are fixed, and individual differences in auditory sensitive frequency band and neural response are not considered; (4) Lack of safety control: light intensity, sound pressure and duration of action lack coordinated limits and protection mechanisms; (5) Lack of closed-loop feedback: fails to combine physiological signals such as electroencephalogram (EEG), heart rate or skin conductance for dynamic adjustment. Summary of the Invention

[0005] To solve the above-mentioned technical problems, one technical solution adopted by the present invention is to provide a wearable system for multimodal auditory and visual neuromodulation, including: an acoustic stimulator, a digital hearing aid, and LED vision stimulation glasses;

[0006] (1) The acoustic stimulator serves as a central control unit and has a built-in multimodal signal generation module, a unified clock synchronization module, and a Bluetooth low-power communication module. The multimodal signal generation module is used to generate programmable acoustic-optical rhythm signals. Acoustic stimulation and visual stimulation are kept synchronized under the control of the unified clock synchronization module to achieve synergistic neural modulation of the auditory cortex and visual cortex of the brain. The Bluetooth low-power communication module is connected to each terminal to perform signal generation, synchronization control, and security management. It is used to perform bidirectional synchronous communication with the digital hearing aid and LED vision stimulation glasses.

[0007] (2) The digital hearing aid has a built-in multi-channel digital signal processor, which simultaneously receives and superimposes the rhythm signal of the acoustic stimulator to achieve parallel output of hearing compensation and neural modulation.

[0008] (3) The LED visual stimulation glasses include: independent red, green and blue LED array units for the left and right eyes, pulse width modulation driving unit and brightness adaptive adjustment unit, which are used to generate a flicker signal with adjustable frequency, variable phase and duty cycle of 5-95% to realize multi-mode visual stimulation such as in-phase, out-of-phase and dynamic phase scanning.

[0009] In an embodiment of the present invention, the acoustic stimulator generates programmable acoustic-optic rhythmic stimulation signals with a frequency range of 0.5–10000 Hz, and achieves cross-modal synchronous output of acoustic and optical signals and independent left and right control through timestamp broadcasting and phase correction, thereby realizing the coordinated regulation of the auditory and visual nervous systems.

[0010] In an embodiment of the present invention, the acoustic stimulator includes a rhythm signal generation module, a modulation and synthesis module, a digital-to-analog conversion module, a Bluetooth communication module, a unified clock synchronization module, a synchronization module, and a safety protection module; the rhythm signal generation module is used to generate amplitude-modulated or frequency-modulated pure tones, binaural beats, and composite acoustic stimulation signals;

[0011] The modulation and synthesis module is used to modulate the amplitude, frequency and phase of the basic waveform to adapt to the individual's hearing curve and stimulation target, while superimposing a multi-band envelope to enhance the intensity of the neural response.

[0012] The digital-to-analog converter module is used to convert digital waveforms into analog sound signals for output, maintaining high fidelity and low distortion characteristics;

[0013] The Bluetooth communication module uses the BLE protocol to distribute acoustic stimulation signals and synchronization control signals to the digital hearing aid and LED vision stimulation glasses; the unified clock synchronization module provides a master-slave clock source to ensure that the synchronization delay of the acoustic and optical signals is less than 1 millisecond, and realizes cross-modal phase locking; the safety protection module sets up a multi-limit control mechanism for sound pressure, light intensity, temperature and duration of action to ensure physiological safety and output stability.

[0014] In an embodiment of the present invention, the multi-channel digital signal processor receives acoustic stimulation signals through an I²C interface and supports independent gain control and phase difference adjustment for the left and right ear channels.

[0015] In embodiments of the present invention, a mobile app client is also included for individualized parameter setting, mode selection, remote upgrade and data recording; the app client is connected to the central control unit via Bluetooth and receives data from physiological sensors such as EEG, heart rate and skin conductance in real time to achieve closed-loop feedback and adaptive control; the app client also includes a doctor login interface for remote monitoring and treatment management.

[0016] In embodiments of the present invention, multiple operating modes are also included: (1) Hearing aid mode – only the hearing amplification function is enabled; (2) Acoustic-optical stimulation mode – γ rhythm or α rhythm signals are output synchronously with sound and light for neuromodulation of tinnitus, sleep disorders and cognitive dysfunction; (3) Bluetooth audio mode – external audio signals are received and output through a digital hearing aid; (4) Hybrid mode – the acoustic-optical stimulation signal and the Bluetooth audio signal are superimposed and output; the acoustic stimulator automatically switches the operating state according to the ambient noise, user settings or doctor instructions, and uploads the usage parameter log to the cloud server.

[0017] In embodiments of the present invention, the system reserves a multimodal expansion interface for integration with electrical stimulation, vibration stimulation or EEG acquisition modules; through a unified clock synchronization module and control bus, it realizes synchronous control and timing management of sound, light, electricity and tactile multimodal stimulation, thereby expanding into a cross-sensory neuromodulation platform.

[0018] In another specific embodiment, an auditory-visual multimodal neural modulation method includes the following steps: (1) collecting the user's hearing curve, EEG signal and physiological parameters; (2) generating individualized acoustic-optical rhythmic stimulation data based on the collected data; (3) synchronously triggering the output stimulation signals of the digital hearing aid and LED vision stimulation glasses via Bluetooth to achieve synchronous or asynchronous auditory and visual stimulation; (4) dynamically adjusting the stimulation frequency, phase and intensity based on real-time physiological feedback to achieve closed-loop individualized neural modulation.

[0019] In an embodiment of the present invention, the acoustic stimulator employs a parameter optimization algorithm based on AI reinforcement learning to extract features and recognize patterns from the user's physiological response signals. The stimulation parameter matrix is ​​dynamically updated through a policy network π(a|S) to optimize the neuromodulation effect and improve user compliance. The adjustment step size is limited to a set safety threshold range to prevent overstimulation.

[0020] In embodiments of the present invention, the method further includes steps of remote monitoring, parameter configuration, and efficacy management through a cloud database and a doctor's app. The cloud database automatically generates individualized treatment curves, EEG neural response maps, and usage reports, and achieves integrated intelligent operation of hearing compensation, acoustic and opto-optical neuromodulation, and cognitive rehabilitation management through periodic updates.

[0021] The beneficial effects of this invention are as follows: This invention achieves a unified hearing compensation, gamma rhythm neural modulation, and individualized closed-loop control by forming a multimodal neuromodulation system that integrates an acoustic stimulator, a digital hearing aid, and LED glasses into a unified clock synchronization module. This enables cross-modal neural modulation of the auditory and visual pathways. Through physiological signal feedback and App closed-loop management, the system can dynamically adjust stimulation parameters to achieve individualized neural modulation and safety protection. It breaks through the limitations of traditional single-mode stimulation devices and possesses high safety, intelligent closed-loop, and individualized adaptability. The system has a compact structure, high synchronization accuracy, and combines hearing compensation, neural modulation, and remote management functions. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort, wherein:

[0023] Figure 1 This is a schematic diagram of the overall structure of a wearable system for multimodal auditory and visual neuromodulation.

[0024] Figure 2 A schematic diagram of the appearance of a wearable system for auditory and visual multimodal neuromodulation;

[0025] Figure 3 Block diagram of signal generation and transmission;

[0026] Figure 4 This is a schematic diagram of independent control on the left and right sides;

[0027] Figure 5 This is a diagram illustrating the switching of working modes. Detailed Implementation

[0028] The technical solutions in the embodiments of the present invention will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0029] The present invention includes: a wearable system for auditory and visual multimodal neuromodulation, comprising: an acoustic stimulator, a digital hearing aid, and LED vision stimulation glasses;

[0030] like Figure 1 As shown, the acoustic stimulator, acting as the central control unit, incorporates a unified clock synchronization module and a Bluetooth Low Energy communication module. Acoustic and visual stimuli are synchronized under the control of the unified clock synchronization module, achieving coordinated neuromodulation of the auditory and visual cortices of the brain. This module facilitates bidirectional synchronous communication with digital hearing aids and LED vision stimulation glasses. The Bluetooth Low Energy communication module connects to each terminal, performing signal generation, synchronization control, and security management. It sends synchronization signals to the digital hearing aids and LED glasses. The acoustic stimulator generates programmable acoustic-optical rhythmic stimulation signals with a frequency range of 0.5–10000 Hz, more preferably 30–50 Hz. Through timestamp broadcasting and phase correction, it achieves cross-modal synchronous output of acoustic and optical signals and independent left and right control, thereby realizing coordinated modulation of the auditory and visual nervous systems.

[0031] Furthermore, such as Figure 3 As shown, the acoustic stimulator includes a rhythm signal generation module, a modulation and synthesis module, a digital-to-analog conversion module, a Bluetooth communication module, a unified clock synchronization module, a synchronization module, and a safety protection module; the rhythm signal generation module is used to generate amplitude-modulated or frequency-modulated pure tones, binaural beats, and composite acoustic stimulation signals;

[0032] The modulation and synthesis module is used to modulate the amplitude, frequency and phase of the basic waveform to match the individual's hearing curve and stimulation target, while superimposing multi-band envelopes to enhance the intensity of the neural response.

[0033] The digital-to-analog converter module is used to convert digital waveforms into analog sound signals for output while maintaining high fidelity and low distortion.

[0034] The Bluetooth communication module uses the BLE protocol to distribute acoustic stimulation signals and synchronization control signals to the digital hearing aid and LED vision stimulation glasses; the unified clock synchronization module provides master and slave clock sources to ensure that the synchronization delay of the acoustic and optical signals is less than 1 millisecond, and realizes cross-modal phase locking; the safety protection module sets up a multi-limit control mechanism for sound pressure, light intensity, temperature and duration of action to ensure physiological safety and output stability.

[0035] like Figure 4As shown, the system of this application supports independent left and right control functions for auditory and visual channels. The central control unit generates two independent stimulation signals for the left and right ears according to preset parameters or individualized physiological feedback: it outputs acoustic stimulation signals for the left and right ears, which are output to the user's left and right ears via digital hearing aids to achieve auditory control of specific frequency, phase or intensity; it outputs visual stimulation signals for the left and right eyes, which are output to the left and right eyes via LED glasses driver module to achieve visual rhythmic stimulation that is synchronized with the auditory signals or has a controllable phase difference.

[0036] The independent left and right control mechanism allows the system to set stimulation parameters (such as frequency, phase difference, intensity and rhythm waveform) on both sides separately, supporting multiple combination modes such as in-phase, out-of-phase and phase scanning. Through differential stimulation, it can further enhance the interactive synchronization between the auditory and visual cortex of the brain, and improve the targeting and individual adaptability of neural modulation.

[0037] Furthermore, such as Figure 2 As shown, the digital hearing aid has a built-in multi-channel digital signal processor that simultaneously receives and superimposes rhythmic signals from the acoustic stimulator, achieving parallel output of hearing compensation and neural modulation. The digital hearing aid is used to digitally amplify and output the acoustic stimulus signal for hearing compensation, while simultaneously transmitting the rhythmic sound signal to the user's auditory system. The multi-channel digital signal processor receives the acoustic stimulus signal through the I²C interface and supports independent gain control and phase difference adjustment for the left and right ear channels. After receiving the acoustic stimulus signal, the digital hearing aid performs multi-channel DSP processing and outputs the rhythmic sound signal after hearing compensation. The LED glasses generate synchronously flashing visual rhythmic stimulus signals according to the same control parameters. The two stimuli maintain phase consistency or controllable phase difference output through Bluetooth Low Energy communication, realizing the coordinated modulation of the auditory and visual cortex of the brain.

[0038] In closed-loop control, the system can collect the user's EEG signals, heart rate, or skin conductance parameters through external sensors, and dynamically adjust the output phase and stimulation intensity based on the feedback signals to achieve individualized closed-loop neuromodulation.

[0039] Furthermore, the LED visual stimulation glasses include: independent red, green, and blue LED array units for the left and right eyes, a pulse width modulation driving unit, and a brightness adaptive adjustment unit, used to generate flicker signals with adjustable frequency, variable phase, and duty cycle of 5–95%, to achieve multi-mode visual stimulation such as in-phase, out-of-phase, and dynamic phase scanning.

[0040] Its working principle is as follows:

[0041] 1. Receive the synchronization signal sent by the acoustic stimulator via BLE;

[0042] 2. Generate programmable frequency and phase difference flicker signals based on preset frequency and phase difference parameters to achieve gamma rhythm visual stimulation;

[0043] 3. The left and right eye channels can be controlled independently to achieve in-phase, out-of-phase, or phase difference stimulation.

[0044] By controlling the flicker frequency within the γ rhythm range (approximately 40 Hz), phase-locked neural synchronization activity can be guided in the visual cortex, which, together with auditory stimulation, promotes the plasticity regulation of the cortical neural network.

[0045] like Figure 5 As shown, the auditory-visual multimodal neural modulation wearable system of the present invention has four main working modes, namely:

[0046] 1. Hearing Aid Mode: The system only activates the digital hearing aid function, amplifying and compensating for ambient sounds for hearing compensation and speech enhancement.

[0047] 2. Acoustic and photostimulation therapy mode: The central control unit outputs specific gamma rhythmic acoustic and photostimulation signals, which act synchronously on the auditory and visual pathways through digital hearing aids and LED glasses to achieve neural modulation and tinnitus relief (including various neurological and cognitive dysfunctions);

[0048] 3. Bluetooth Audio Mode: The acoustic stimulator switches to a wireless audio receiver, which can receive Bluetooth audio signals from mobile phones or other terminals for entertainment or communication scenarios;

[0049] 4. Hybrid Mode: The rhythmic sound and light stimulation signal is superimposed with the external Bluetooth audio signal for output, realizing the integrated functions of hearing compensation, neural modulation and daily hearing.

[0050] The system can automatically switch between the above modes based on user settings, environmental detection, or remote instructions from doctors, and record the mode usage time and parameter logs for personalized data analysis and efficacy tracking.

[0051] Furthermore, embodiments of the present invention also include a mobile App client for individualized parameter setting, mode selection, remote upgrade and data recording. The App client is connected to the central control unit via Bluetooth and receives data from physiological sensors such as EEG, heart rate and skin conductance in real time to achieve closed-loop feedback and adaptive control. The App client also includes a doctor login interface for remote monitoring and treatment management.

[0052] Furthermore, the system reserves a multimodal expansion interface for integration with electrical stimulation, vibration stimulation, or EEG acquisition modules; through a unified clock synchronization module and control bus, it realizes the synchronous control and timing management of sound, light, electricity, and tactile multimodal stimulation, thereby expanding into a cross-sensory neuromodulation platform.

[0053] A multimodal neural modulation method for auditory and visual perception includes the following steps: (1) collecting the user's hearing curve, EEG signal and physiological parameters; (2) generating individualized acoustic-optical rhythmic stimulation data based on the collected data; (3) synchronously triggering the output stimulation signals of the digital hearing aid and LED vision stimulation glasses via Bluetooth to achieve synchronous or asynchronous auditory and visual stimulation; (4) dynamically adjusting the stimulation frequency, phase and intensity based on real-time physiological feedback to achieve closed-loop individualized neural modulation.

[0054] This system uses an acoustic stimulator as the central control core, with a built-in high-precision clock source (24 MHz ± 10ppm). It achieves cross-modal timing synchronization and closed-loop control of auditory and visual stimulation terminals through a master-slave Bluetooth Low Energy (BLE 5.2) communication protocol.

[0055] 1. Bluetooth synchronization and timing coordination: The central control unit is equipped with a master BLE module, while the digital hearing aid and LED vision stimulation glasses each have built-in slave BLE modules, establishing a secure pairing connection (AES-128 encryption, GATT service architecture). Upon system startup:

[0056] (1) The rhythm signal generation module outputs a reference waveform (the frequency can be set from 0.5 to 100 Hz, with a default of 40 Hz γ rhythm).

[0057] (2) The central control unit generates a synchronization trigger packet (including timestamp, mode identifier, and phase offset) based on the built-in clock and broadcasts it to each terminal via BLE;

[0058] (3) After receiving the synchronization signal, each terminal device corrects its local clock according to the timestamp, and the phase-locked error is ≤1 ms, thereby ensuring strict time consistency of auditory and visual stimuli.

[0059] (4) The acoustic stimulation signal is transmitted to the acoustic output of the digital hearing aid via the I²C interface (maximum bandwidth 8 kHz), and the light stimulation control signal drives the LED matrix via PWM (frequency 0.5–100 Hz, adjustable duty cycle 5–95%).

[0060] 2. Closed-loop feedback of physiological signals

[0061] To achieve personalized neuromodulation, the central control unit can collect users' physiological signals (sampling rate 250–500 Hz) through sensors such as electroencephalography (EEG), heart rate (HR), and electrical conductance on skin (EDA), calculate the power spectrum changes and phase differences of the target frequency band in real time, and dynamically adjust the frequency, amplitude, and phase of the audio-visual output based on a reinforcement learning algorithm (policy network π(a|S)) to achieve real-time adaptive closed-loop regulation. The Bluetooth link has a latency of less than 20 ms at the transmission control layer, ensuring a closed-loop update rate of ≥10 Hz, which can meet the real-time requirements of neuromodulation.

[0062] Furthermore, to ensure the long-term, stable, and safe operation of this system in medical and home settings, the central control unit, digital hearing aid, and LED vision stimulation glasses all adopt multi-layered safety and human-computer interaction designs, providing comprehensive protection from four aspects: communication security, electrical safety, physiological safety, and user interaction.

[0063] 1. Communication and Data Security

[0064] (1) Bluetooth communication adopts the BLE 5.2 specification. All commands and data are encrypted with AES-128 and CRC verification to prevent unauthorized connections and data tampering;

[0065] (2) The system has a two-way authentication mechanism (Device ID + UUID token), which only allows pairing and communication between registered devices;

[0066] (3) The control signals use GATT custom service channels to distinguish different levels such as “stimulus control”, “mode switching” and “status feedback” to avoid command conflicts;

[0067] (4) During data transmission, RSSI and link quality (LQI) are monitored in real time. When the signal interruption exceeds 500 ms or the packet loss rate is >5%, the system automatically enters the safe pause mode to prevent abnormal output.

[0068] 2. Electrical and Hardware Safety

[0069] (1) Both the digital hearing aid and the LED glasses are powered by low-voltage DC (3.7 V lithium battery, current limit ≤500 mA), which complies with IEC 60601-1 and GB 9706.1-2020 medical electrical safety standards;

[0070] (2) The output channel has built-in hardware and software dual limiting protection:

[0071] Acoustic output voltage limit ≤85 dB SPL;

[0072] The light stimulation brightness is automatically limited to below the safe illuminance threshold (<300 cd / m², in compliance with GB / T 7247.1 laser and high light safety standards).

[0073] (3) When over-temperature (>45°C), over-current, or abnormal battery voltage is detected, the system immediately shuts down the output and issues an alarm.

[0074] 3. Physiological and Algorithm Safety

[0075] (1) During the closed-loop control process, the AI ​​algorithm is equipped with dynamic amplitude limiter and rate limiter to prevent the output frequency and amplitude from changing beyond the human nerve tolerance threshold.

[0076] (2) A sliding window smoothing and outlier removal mechanism is used for EEG / HR / EDA signals to avoid single abnormal triggering of stimulus adjustment;

[0077] (3) If a significant increase in heart rate (>120 bpm) or abnormal increase in skin conductance (Δ>2 μS) is detected, the system will enter "physiological delay mode", pause output and prompt the user to rest.

[0078] 4. User interaction and operation feedback

[0079] (1) The control unit is equipped with a touch screen or mobile APP interface, which adopts a graphical UI design to display the real-time working mode, connection status, output strength, remaining power and safety prompts;

[0080] (2) Mode switching supports dual confirmation via voice broadcast and visual indicator lights to avoid accidental operation;

[0081] (3) The system supports remote diagnosis and treatment and data uploading (encrypted cloud transmission after Bluetooth to mobile terminal), and doctors can remotely adjust stimulation parameters and view usage records;

[0082] (4) All operations are recorded in the event log, and users can view historical patterns, usage duration and physiological response summaries.

[0083] The beneficial effects of the wearable system and its modulation method for auditory and visual multimodal neural modulation of the present invention are as follows:

[0084] (1) Innovation in cross-modal synchronous control: Sub-millisecond synchronization with an audio-visual output delay of <1 ms is achieved through a unified clock synchronization module, realizing the neural rhythm fusion of auditory and visual stimuli for the first time;

[0085] (2) Integrated hearing compensation and modulation mechanism: An adjustable rhythm signal is embedded in the DSP hearing aid channel to take into account both hearing compensation and acoustic stimulation neuromodulation therapy.

[0086] (3) Intelligent closed-loop individualized control: The system collects physiological signals in real time and uses AI algorithms to dynamically optimize stimulation parameters, thereby improving both individual compliance and safety;

[0087] (4) Scalable multimodal interface: The system architecture supports the expansion of multimodal stimulation such as sound, light, electricity, and vibration, providing a platform-based intervention solution for a variety of neuropsychiatric diseases;

[0088] (5) High safety and clinical applicability: Multiple limit protections, low power Bluetooth communication and wearable structure, suitable for clinical, home, travel and rehabilitation environments.

[0089] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention specification, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

[0090] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention specification, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A wearable system for auditory and visual multimodal neural modulation, comprising: Acoustic stimulator, digital hearing aid and LED vision stimulation glasses, characterized in that: (1) The acoustic stimulator serves as a central control unit and includes a multimodal signal generation module, a unified clock synchronization module, and a Bluetooth low-power communication module. The multimodal signal generation module generates programmable acoustic-optical rhythm signals. Acoustic stimulation and visual stimulation are synchronized under the control of the unified clock synchronization module, thereby achieving synergistic neural modulation of the brain's central nuclei and auditory cortex stimulation with visual cortex stimulation. The Bluetooth low-power communication module connects to each terminal and performs signal generation, synchronization control, and security management. It is used for bidirectional synchronous communication with the digital hearing aid and LED vision stimulation glasses. (2) The digital hearing aid has a built-in multi-channel digital signal processor that simultaneously receives and superimposes the rhythm signal from the acoustic stimulator to achieve parallel output of independent hearing compensation and neural modulation in both ears. (3) The LED visual stimulation glasses include: independent red, green and blue LED array units for the left and right eyes, pulse width modulation driving unit and brightness adaptive adjustment unit, which are used to generate a flicker signal with adjustable frequency, variable phase and duty cycle of 5-95% to realize multi-mode visual stimulation such as in-phase, out-of-phase and dynamic phase scanning.

2. The wearable system for auditory and visual multimodal neural modulation according to claim 1, characterized in that, The acoustic stimulator generates programmable acoustic-optic rhythmic stimulation signals with a frequency range of 0.5–10000 Hz. It achieves cross-modal synchronous output of acoustic and optical signals and independent control of the left and right sides through timestamp broadcasting and phase correction, thereby realizing the coordinated regulation of the auditory and visual nervous systems.

3. The wearable system for auditory and visual multimodal neural modulation according to claim 2, characterized in that, The acoustic stimulator includes a rhythm signal generation module, a modulation and synthesis module, a digital-to-analog conversion module, a Bluetooth communication module, a unified clock synchronization module, and a safety protection module; the rhythm signal generation module is used to generate amplitude-modulated or frequency-modulated pure tones, broadband noise or binaural beats, envelope-modulated noise, and composite acoustic stimulation signals. The modulation and synthesis module is used to modulate the amplitude, frequency and phase of the basic waveform to adapt to the individual's hearing curve and stimulation target, while superimposing a multi-band envelope to enhance the intensity of the neural response. The digital-to-analog converter module is used to convert digital waveforms into analog sound signals for output, maintaining high fidelity and low distortion characteristics; The Bluetooth communication module uses the BLE protocol to distribute acoustic stimulation signals and synchronization control signals to the digital hearing aid and LED vision stimulation glasses. The unified clock synchronization module provides a master-slave clock source to ensure that the synchronization delay of the acoustic and optical signals is less than 1 millisecond, and realizes cross-modal phase locking; the safety protection module sets up a multi-limit control mechanism for sound pressure, light intensity, temperature and duration of action to ensure physiological safety and output stability.

4. The wearable system for auditory and visual multimodal neural modulation according to claim 1, characterized in that, The multi-channel digital signal processor receives acoustic stimulation signals through a bus control (I²C) interface and supports independent gain control and phase difference adjustment for the left and right ear channels.

5. The wearable system for auditory and visual multimodal neuromodulation according to claim 1, characterized in that, It also includes a mobile app client for individualized parameter settings, mode selection, remote upgrades, and data recording. The app client connects to the central control unit via Bluetooth and receives data from physiological sensors such as EEG, heart rate, and skin conductance in real time to achieve closed-loop feedback and adaptive control. The app client also includes a doctor login interface for remote monitoring and treatment management.

6. The wearable system for auditory and visual multimodal neural modulation according to claim 1, characterized in that, It also includes multiple operating modes: (1) Hearing aid mode - only the hearing amplification function is enabled; (2) Acoustic and light stimulation mode - synchronous output of gamma rhythm or alpha rhythm signals for the neural modulation of tinnitus, sleep disorders and cognitive dysfunction; (3) Bluetooth audio mode - receiving external audio signals and outputting them through the digital hearing aid; (4) Hybrid mode - superimposing the acoustic and light stimulation signals with the Bluetooth audio signals; The acoustic stimulator automatically switches the operating state according to the ambient noise, user settings or doctor instructions, and uploads the usage parameter log to the cloud server.

7. The wearable system for auditory and visual multimodal neural modulation according to claim 1, characterized in that, The system has reserved a multimodal expansion interface for integration with electrical stimulation, vibration stimulation or EEG acquisition modules. Through a unified clock synchronization module and control bus, it realizes the synchronous control and timing management of sound, light, electricity and touch multimodal stimulation, thereby expanding into a cross-sensory neuromodulation platform.

8. A method for multimodal auditory and visual neural modulation based on any one of claims 1 to 7, characterized in that, Includes the following steps: (1) Collect the user's hearing curve, EEG signal and physiological parameters; (2) The acoustic stimulator generates individualized acoustic-optical rhythmic stimulation data based on the collected data; (3) Synchronously trigger the output stimulation signal of the digital hearing aid and LED vision stimulation glasses through Bluetooth to achieve synchronous or asynchronous auditory and visual stimulation; (4) Dynamically adjust the stimulation frequency, phase and intensity based on real-time physiological feedback to achieve closed-loop individualized neuromodulation.

9. The auditory-visual multimodal neural modulation method according to claim 8, characterized in that, The acoustic stimulator employs an AI-based reinforcement learning-based parameter optimization algorithm to extract features and recognize patterns from the user's physiological response signals. It uses a policy network π(a|S) to dynamically update the stimulation parameter matrix, thereby optimizing the neuromodulation effect and improving user compliance. The adjustment step size is limited to a set safety threshold range to prevent overstimulation.

10. A method for multimodal auditory and visual neural modulation according to claim 8 or 9, characterized in that, It also includes steps for remote monitoring, parameter configuration, and treatment management through a cloud database and a doctor's app. The cloud database automatically generates individualized treatment curves, EEG neural response maps, and usage reports, and through periodic updates, it achieves integrated intelligent operation of hearing compensation, acoustic and opto-optical neuromodulation, and cognitive rehabilitation management.

Images