Nervous system closed-loop regulation and control system based on transcranial opto-acoustic synergy

Abstract

The invention provides a nervous system closed-loop regulation and control system based on transcranial opto-acoustic cooperation. The nervous system closed-loop regulation and control system is composed of EEG monitoring equipment, personal information data, an opto-acoustic cooperation system, a multi-mode large model and a psychological disease database. Aiming at a transcranial infrared light and ultrasonic co-stimulation technology of a patient, through optimization of stimulation parameters, photoacoustic bidirectional regulation and control are realized, a multi-modal large model is used as a base, multi-modal data fusion and reinforcement learning are used as technical means, closed-loop photoacoustic co-stimulation system equipment is designed, and intervention parameters are automatically optimized; an effective regulation and control method for psychological diseases is realized through a non-intrusive brain stimulation technology, and adaptive adjustment and closed-loop feedback of parameters are realized. Brain waves of a patient are detected in real time, personal information of the patient is collected, the information is integrated and transmitted into the system after evaluation, intervention is adjusted in real time according to different brain states, and feedback is utilized to adjust parameters of next intervention and stimulate the precise regulation and control process.

Description

Technical Field

[0001] The present invention relates to the field of large language model medicine, and in particular to a closed-loop control system of a nervous system based on transcranial photoacoustic collaboration. Background Art

[0002] In recent years, light and sound stimulation have received increasing attention as a means of regulating neural activity and cognitive function. Transcranial light stimulation uses laser or LED light sources to penetrate the scalp and skull to induce neurobiological changes in the brain. Compared with light of other frequencies, mid- and far-infrared light (3-15um) can regulate neural activity in a relatively specific non-thermal manner. The mechanism is that the vibration frequency of photons resonates with the key chemical bonds of functional proteins, promoting or inhibiting the release of neuronal action potentials and the differentiation of glial cells, thereby regulating brain function or intervening in brain diseases. Transcranial ultrasound stimulation (TUS) uses low-intensity focused ultrasound, which has high penetration and high focus, and can penetrate the skull to accurately regulate brain areas. It has been shown to induce action potentials and promote the release of synaptic vesicles, and stimulating the corresponding brain areas can induce corresponding behaviors. In China, mental health issues are receiving more and more attention, especially depression, anxiety, and addiction. According to the Blue Book of China's Mental Health in 2023, China's attention to mental health is increasing, investment is increasing, and the market size is also expanding. National mental health issues are becoming more prominent and attention is being paid to them, but the supply of mental health services is relatively insufficient, supply and demand are unbalanced, service levels vary, and service quality needs to be improved.

[0003] The current treatment options include the following:

[0004] Transcranial magnetic stimulation: A non-invasive technique that uses strong magnetic fields to generate electric currents in the cerebral cortex to regulate neuronal activity, but it can only stimulate the surface of the brain and cannot effectively regulate deep structures.

[0005] Transcranial direct current stimulation: It changes the excitability of the brain's nerves by applying low-intensity direct current to the scalp, and is usually used to improve cognitive function, memory, and emotional regulation. However, the effect is unstable, the results of clinical studies are inconsistent, and the effects of different patients may vary greatly.

[0006] Transcranial alternating current stimulation: An attempt to synchronize or modulate brainwave activity by applying alternating current to the brain. Aims to enhance or suppress specific brainwave frequencies. Some patients experience headaches, scalp irritation, or tingling.

[0007] Traditional open-loop stimulation, transcranial acoustic stimulation therapy, and transcranial light stimulation therapy have problems such as the inability to monitor and adjust interventions in real time, the inability to dynamically adjust the stimulation parameters of ultrasound and infrared light, the inability to perform transcranial photoacoustic synergistic stimulation, and the inability to identify and predict addictive behaviors by integrating multiple data types. Summary of the invention

[0008] The present invention combines transcranial ultrasound stimulation, transcranial infrared light stimulation, electroencephalogram, large language model, RAG and other technologies, mainly targeting transcranial infrared light and ultrasound synergistic stimulation technology for patients with mental illnesses such as addictive diseases, anxiety, depression and the like, and realizes photoacoustic bidirectional regulation by optimizing stimulation parameters to achieve the best regulation effect. With a multimodal large model as the base, multimodal data fusion and reinforcement learning as technical means, an efficient and real-time closed-loop photoacoustic synergistic stimulation system device is designed and intervention parameters are automatically optimized. An effective regulation method for mental illness is realized through non-invasive brain stimulation technology, and adaptive adjustment of parameters and closed-loop feedback are realized. By real-time detection of the patient's brain waves and collection of the patient's personal information, the multimodal large model is integrated into the system after evaluation, and the multimodal large model diagnoses and provides treatment plans based on the patient's multidimensional information. After implementation, the patient's brain condition is monitored, and the intervention is adjusted in real time according to different brain states, and feedback is used to adjust the parameters of the next intervention and the precise regulation process of stimulation, i.e., closed-loop stimulation.

[0009] The present invention provides a closed-loop control system of the nervous system based on transcranial photoacoustic collaboration, which is composed of EEG monitoring equipment, personal information data, photoacoustic collaboration system, multimodal large model and mental disease database; wherein,

[0010] EEG monitoring equipment uses electrophysiological indicators to record brain activity, which is used to monitor an individual's delta wave, theta wave, alpha wave, and beta wave in real time, and transmits the monitored data to a multimodal large model for analysis;

[0011] Personal information provided by users, including their medical history, imaging data, and psychological data, and passing their personal information to multimodal large models for analysis;

[0012] The photoacoustic synergy system consists of two devices, an ultrasonic transducer and an infrared light source. The ultrasonic transducer emits ultrasonic pulses of different frequencies to stimulate and treat patients with mental illnesses. The infrared light source emits infrared light of different wavelengths to suppress the background neural activity of the excited cortex and increase the gain of the ultrasonic stimulation effect. The photoacoustic synergy system is dynamically controlled by a multimodal large model, and the intervention parameters are continuously adjusted to find the most suitable personalized treatment plan.

[0013] The multimodal large model is used to process and evaluate multidimensional data including brain activity data and personal information, and formulate corresponding treatment plans according to individual conditions, make decisions to generate corresponding intervention parameters, and dynamically adjust the photoacoustic collaborative system in real time;

[0014] The mental illness database is a database that centrally stores knowledge about mental illnesses, making up for the fact that the multimodal large model does not have a deep enough understanding of certain mental illnesses. It also stores previous users' data and simulates a reinforcement learning mechanism, allowing the large model to continuously learn and optimize, automatically guide execution, and continuously track feedback.

[0015] The present invention has the following beneficial technical effects:

[0016] The present invention uses an ultrasonic transducer device: used to convert electrical energy into sound energy (especially ultrasonic waves). In the present application, the ultrasonic transducer device is used to generate ultrasonic pulses of a specific frequency, and the frequency parameters are adjustable to achieve dynamic brain neuromodulation. The present invention uses transcranial ultrasound stimulation technology (TUS). Compared with other neuromodulation technologies, TUS has the advantages of being non-invasive, having a large stimulation depth, and having a high spatial resolution.

[0017] The present invention uses an infrared light source device: a device that emits infrared light. In the present application, the infrared light source device is used to generate an infrared light source of a specific wavelength to suppress or excite, and the wavelength parameter is adjustable to achieve dynamic brain neuroregulation of cortical background neural activity and improve the gain of the ultrasonic stimulation effect. The present invention uses transcranial infrared light stimulation technology, which has the advantages of non-invasiveness, bidirectional regulation, and deep penetration.

[0018] The present invention realizes the process from perception to decision-making and then to intervention, forming an efficient closed-loop neural feedback control loop and building a "perception-assessment-decision-intervention" platform. Continuous data feedback enables the large model to continuously learn and optimize, adjust the treatment plan in real time, ensure accuracy and personalization, and automatically guide execution and track feedback. Real-time monitoring of patient clinical manifestations helps understand the clinical markers and mechanisms of addictive diseases and improve the safety and effectiveness of treatment. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is a system framework diagram of the present invention;

[0020] Figure 2 Schematic diagram of modulation mode optimization and neural regulation of photoacoustic synergy system;

[0021] Figure 3 Schematic diagram of photoacoustic synergy neural regulation;

[0022] Figure 4 This is a functional diagram of the large model. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical scheme and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. In addition, the technical features involved in each embodiment of the present invention described below can be combined with each other as long as they do not conflict with each other. To achieve the above-mentioned purpose, the present invention adopts the following technical scheme.

[0024] The invention provides a closed-loop control system framework of the nervous system based on transcranial photoacoustic synergy. Figure 1 As shown, it consists of EEG monitoring equipment, personal information data, photoacoustic collaborative system, multimodal large model and mental disease database.

[0025] EEG monitoring equipment: Use electrophysiological indicators to record brain activity, to monitor an individual's delta wave, theta wave, alpha wave, and beta wave in real time, and pass the monitored data to a multimodal large model for analysis. EEG monitoring equipment monitors electroencephalograms, which are a technology for recording electrical activity in the brain. It captures electrical signals inside the brain through electrodes placed on the scalp. These electrodes are attached to the scalp and analyze the spectral components of the signal, such as alpha waves, beta waves, theta waves, delta waves, etc., through Fourier transform.

[0026] Personal information: Personal information provided by users, including the user's medical history, imaging data, psychological data, etc., and the user's personal information is passed to the multimodal large model for analysis.

[0027] Photoacoustic synergistic system: It consists of two major devices, namely ultrasonic transducer equipment and infrared light source equipment. The ultrasonic transducer equipment adopts transcranial ultrasound stimulation technology (TUS), using low-intensity, low-frequency focused ultrasound to stimulate specific nerves or functional areas in the brain. The ultrasonic transducer equipment can emit ultrasonic pulses of different frequencies to stimulate and treat patients with mental illness. The infrared light source equipment adopts transcranial infrared light stimulation technology, which uses low-intensity infrared light to regulate brain neural activity. By focusing infrared light of a specific wavelength on the cerebral cortex or deeper brain tissue, it can effectively achieve the excitation or inhibition of neurons, thereby regulating the activity of specific functional areas. The infrared light source equipment emits infrared light of different wavelengths to inhibit / excite cortical background neural activity and increase the gain of the ultrasonic stimulation effect. The photoacoustic synergistic system is dynamically controlled by a multimodal large model, and the intervention parameters are continuously adjusted to find the most suitable personalized treatment plan.

[0028] Ultrasonic transducer device: used to convert electrical energy into sound energy (especially ultrasound). In this application, the ultrasonic transducer device is used to generate ultrasonic pulses of a specific frequency, and the frequency parameters are adjustable to achieve dynamic brain neuromodulation.

[0029] Infrared light source device: a device that emits infrared light. In this application, the infrared light source device is used to generate infrared light sources of a specific wavelength to suppress or excite, and the wavelength parameters are adjustable to achieve dynamic brain neuromodulation of cortical background neural activity and improve the gain of the ultrasound stimulation effect.

[0030] Multimodal large model: The core of the system framework of the present invention is used to process and evaluate multidimensional data such as brain activity data and personal information, formulate corresponding treatment plans based on individual conditions, make decisions to generate corresponding intervention parameters, and dynamically adjust the photoacoustic collaborative system in real time.

[0031] RAG is a natural language processing technology that combines information retrieval and text generation. It retrieves documents or fragments that are highly relevant to user queries from a large knowledge base and combines this information with a generative model to generate more accurate, factually based, and relevant answers or content. This method not only improves the quality and reliability of generated content, but also expands the knowledge coverage of the model. It is widely used in intelligent question-and-answer systems, conversational robots, and content creation, and effectively solves the limitations of traditional generative models in knowledge depth and accuracy. RAG combines large models and databases.

[0032] Mental illness database: A vector database that centrally stores knowledge about mental illnesses. This makes up for the fact that the multimodal large model may not have a deep enough understanding of a certain mental illness and may produce hallucinations. At the same time, it stores previous user data and simulates a reinforcement learning mechanism, allowing the large model to continuously learn and optimize, automatically guide execution, and continuously track feedback.

[0033] The specific operation process of the system is as follows: patients with mental illness first upload their personal information to the multimodal large model, such as patient medical history, imaging data, psychological data, etc. Then, by wearing an EEG monitoring device to detect brain activity in real time, the detected EEG band is transmitted to the multimodal large model, and the multimodal large model comprehensively evaluates the user's multidimensional data and makes decisions. First, the intervention parameters are generated, and then the photoacoustic synergy system is turned on. The photoacoustic synergy system contains an ultrasonic transducer device and an infrared light source device. The ultrasonic transducer device is set at a selected position on the head. The selected position is coated with an ultrasonic coupling agent to enhance the ultrasonic transmission effect, and the infrared light source device is set on both sides of the ultrasonic coupling agent bounded by the ultrasonic transducer device to increase the gain of the ultrasonic stimulation effect. The brain activity of addicts will change at any time according to the state. For example, the reward system is usually characterized by low function (needs to be continuously improved), and when it is exposed to relevant clues, it will produce a transient and strong rise (needs to be instantly suppressed). The ultrasonic transducer device emits pulses of a specific frequency, and the infrared light source device emits infrared light of a specific wavelength. The two work together to stimulate the patient's brain. After the stimulation, the EEG monitoring device performs real-time detection and transmits the data generated after the brain stimulation to the multimodal large model. The large model makes decisions after evaluation of the intervention, regenerates the photoacoustic intervention parameters, and dynamically adjusts the mid- and far-infrared and ultrasonic frequency emission and control components to form a real-time data feedback loop.

[0034] The optimization of the modulation mode of the photoacoustic synergistic system and its neural regulation are as follows: Figure 2 As shown: The efficient and real-time closed-loop neural feedback control loop is a multi-stage process, covering multimodal data application, real-time monitoring, feedback and precise control. At the large model characterization decision end, a multimodal large model is used to realize data processing based on core physiological markers, and the patient's status and condition changes are analyzed in real time through a deep learning algorithm. At the same time, RAG technology is integrated, and the addiction case database and knowledge base are integrated to build an accurate neural intervention plan, thereby improving the evidence-based interpretation and medical evaluation capabilities of photoacoustic parameter decision-making.

[0035] The multi-dimensional clinical data sensing end continuously collects patient data (such as changes in brain activity, behavior, and physiological state), connects to the large model to make photoacoustic parameter decisions and perform interventions, forming a real-time data feedback loop. The photoacoustic collaborative regulation intervention end autonomously generates and adjusts intervention parameters based on the neural oscillation mechanism, customizes treatment plans, directly affects the patient's nervous system, alleviates symptoms or promotes recovery. When the data reaches the trigger condition, the large model re-evaluates the patient's status in real time and updates the photoacoustic stimulation parameters to ensure the timeliness and accuracy of the intervention.

[0036] From perception to decision-making to intervention, an efficient closed-loop neural feedback control loop is formed to build a "perception-decision-intervention" platform. Continuous data feedback enables the large model to continuously learn and optimize, adjust the treatment plan in real time, ensure accuracy and personalization, and automatically guide execution and track feedback. Real-time monitoring of patient clinical manifestations helps understand the clinical markers and mechanisms of addictive diseases and improve the safety and effectiveness of treatment.

[0037] The neural regulation of photoacoustic synergy is Figure 3 As shown: Several studies have used transcranial light and sound stimulation to intervene in patients with addiction. For example, transcranial ultrasound acting on the nucleus accumbens of addicted patients can safely and effectively regulate the reward circuit, reduce psychological craving and relapse rate; transcranial light stimulation acting on the dorsolateral prefrontal cortex of opium users can alleviate their craving symptoms. The mechanism of addictive diseases is very complex, involving cortical brain areas such as the dorsolateral prefrontal cortex and nucleus accumbens and deep nuclei. This requires that neuromodulation technology can produce a strong stimulation effect on both the large surface cortex and the small deep nuclei, and can achieve bidirectional regulation (inhibition or enhancement) of neural electrical activity in specific brain areas. By using transcranial ultrasound and transcranial infrared light stimulation in synergistic manner, infrared light can inhibit cortical background neural activity, increase the gain of transcranial ultrasound on cortical stimulation effect, and transcranial ultrasound can also inhibit / enhance neural activity in deep nuclei. This photoacoustic synergistic stimulation technology is expected to provide a new solution for the intervention of addictive diseases.

[0038] Single-target intervention: Synergistic stimulation of infrared light and unfocused ultrasound at a single target in the cortex. Transcranial light stimulation has a wide range of action and a regulatory effect of "the weak becomes weaker, the strong becomes stronger". Unfocused ultrasound is used to stimulate the cerebral cortex, and transcranial light stimulation is performed on the cerebral cortex simultaneously to enhance the excitatory or inhibitory effect of transcranial ultrasound stimulation, achieving an effect stronger than transcranial light or sound stimulation alone.

[0039] Multi-target intervention: Based on the circuit-based bidirectional photoacoustic synergistic stimulation of multiple targets in the cortex and deep brain areas, focused ultrasound is used to stimulate the deep target brain areas in the addiction-related circuits, and "light + unfocused ultrasound" is used to stimulate cortical targets to inhibit overly excited brain areas in the addiction circuits and enhance underexcitable brain areas in the addiction circuits.

[0040] The functions of the large model are as follows: Figure 4As shown: The multimodal addiction model will combine the patient's medical history, imaging data, and mental health data to perceive clinical parameter information, quickly integrate neural activity, behavioral information, and clinical manifestations, and transmit them to the large model for data fusion analysis. Analyze the patient's status in real time, generate and optimize the photoacoustic intervention plan. The intervention after the decision is implemented by the photoacoustic control device, which adjusts the treatment parameters according to the neural oscillation mechanism, directly acts on the patient's nervous system, alleviates symptoms or promotes recovery. After the large model intervenes, it will conduct a post-intervention evaluation based on the patient's withdrawal status, addiction level, and psychological state, and store the evaluation results in the vector database. According to the results of the evaluation, the current photoacoustic synergistic stimulation plan is dynamically updated and improved to find the optimal intervention plan and implement it.

Claims

1. A closed-loop control system for the nervous system based on transcranial photoacoustic collaboration, characterized in that: It consists of EEG monitoring equipment, photoacoustic collaborative system, multimodal large model and mental illness database; Among them, EEG monitoring equipment uses electrophysiological indicators to record brain activity, which is used to monitor the individual's delta wave, theta wave, alpha wave, and beta wave in real time, and transmits the monitored data to the multimodal large model for analysis; The photoacoustic synergy system consists of two devices: an ultrasonic transducer and an infrared light source. The ultrasonic transducer emits ultrasonic pulses of varying frequencies to stimulate and treat patients with mental illnesses. The infrared light source emits infrared light of varying wavelengths to suppress background neural activity in the excitatory cortex, increasing the gain of the ultrasound stimulation effect. The photoacoustic synergy system is dynamically controlled by a large multimodal model, continuously adjusting intervention parameters to find the most suitable personalized treatment plan. The multimodal large model is used to process and evaluate multidimensional data including brain activity data and personal information, formulate corresponding treatment plans based on individual conditions, make decisions and generate corresponding intervention parameters, and dynamically adjust the photoacoustic collaborative system in real time; The mental illness database is a database that centrally stores knowledge about mental illnesses, making up for the fact that the multimodal large model does not have a deep enough understanding of certain mental illnesses. It also stores previous user data and simulates a reinforcement learning mechanism, allowing the large model to continuously learn and optimize, automatically guide execution, and continuously track feedback.

2. A closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 1, characterized in that: The user's personal information is passed to the multimodal large model, and the personal information includes the user's medical history, imaging data, and psychological data.

3. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 1, characterized in that: The user first uploads their personal information to the multimodal big model, including patient medical history, imaging data, and psychological data. Then, they wear an EEG monitoring device to detect brain activity in real time and transmit the detected EEG bands to the multimodal big model. The multimodal big model comprehensively evaluates the user's multidimensional data and makes decisions. First, it generates intervention parameters and then turns on the photoacoustic collaborative system. The photoacoustic collaborative system contains an ultrasonic transducer device and an infrared light source device. The ultrasonic transducer device is set at a selected position on the head, which is coated with ultrasonic coupling agent, and the infrared light source device is set on both sides of the ultrasonic coupling agent bounded by the ultrasonic transducer device to increase the gain of the ultrasonic stimulation effect. The ultrasonic transducer device emits pulses of a specific frequency, and the infrared light source device emits infrared light of a specific wavelength. The two work together to stimulate the patient's brain. After receiving the stimulation, the EEG monitoring device performs real-time detection and transmits the data generated after the brain stimulation to the multimodal big model. The big model makes a decision after evaluation of the intervention, generates photoacoustic intervention parameters again, and dynamically adjusts the mid- and far-infrared and ultrasonic frequency emission and control components to form a real-time data feedback loop.

4. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 1, characterized in that: Closed-loop feedback control is a multi-stage process, including the large model characterization decision-making stage, the multi-dimensional clinical data perception stage, and the optoelectronic coordinated regulation intervention stage.

5. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 4, characterized in that: At the large-scale model characterization and decision-making end, a multimodal large model is used to process data based on physiological markers, and deep learning algorithms are used to analyze patient status and condition changes in real time. Continuously collect patient data at the multi-dimensional clinical data sensing end, including changes in brain activity, behavior, and physiological state, and connect to the large model to make photoacoustic parameter decisions and perform interventions, forming a real-time data feedback loop; The optoelectronic coordinated control intervention end autonomously generates and adjusts intervention parameters based on the neural oscillation mechanism, personalizes treatment plans, directly affects the patient's nervous system, alleviates symptoms or promotes recovery; when the data reaches the trigger condition, the large model re-evaluates the patient's status in real time and updates the photoacoustic stimulation parameters to ensure the timeliness and accuracy of the intervention.

6. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 1, characterized in that: Among them, photoacoustic synergistic stimulation includes: single-target photoacoustic synergistic intervention, including synergistic stimulation of infrared light and unfocused ultrasound at a single target in the cortex. Transcranial photostimulation has a wide range of action and a regulatory effect of "the weak becomes weaker and the strong becomes stronger". Unfocused ultrasound is used to stimulate the cerebral cortex, and transcranial photostimulation is performed on the cerebral cortex simultaneously to enhance the excitatory or inhibitory effect of transcranial ultrasound stimulation, achieving an effect stronger than that of transcranial light or sound stimulation alone.

7. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 4, characterized in that: Among them, photoacoustic synergistic stimulation also includes multi-target photoacoustic synergistic intervention, including: circuit-based multi-target bidirectional photoacoustic synergistic stimulation of the cortex and deep brain areas, the use of focused ultrasound to stimulate deep target brain areas in addiction-related circuits, and the use of light + unfocused ultrasound to stimulate cortical targets, inhibiting overly excited brain areas in addiction circuits and enhancing underexcitable brain areas in addiction circuits.

8. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 5, characterized in that: The functions of the large model include: combining the patient's medical history, imaging data, and mental health data, perceiving clinical parameter information, integrating neural activity, behavioral information, and clinical manifestations, and transmitting them to the large model for data fusion analysis, real-time analysis of the patient's status, and generating and optimizing photoacoustic intervention plans. The intervention after the decision is implemented by the photoacoustic collaborative system, which personalizes the treatment parameters according to the neural oscillation mechanism, directly acting on the patient's nervous system to alleviate symptoms or promote recovery.

9. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 8, characterized in that: After the large model intervention, the patient's withdrawal status, addiction level and psychological state are evaluated after the intervention, and the evaluation results are stored in the vector database. According to the evaluation results, the current photoacoustic synergistic stimulation program is dynamically updated and improved to find the optimal intervention program and implement it.

10. The closed-loop control system for the nervous system based on transcranial photoacoustic collaboration according to claim 5, characterized in that: RAG technology is used to integrate large models and databases; RAG technology specifically retrieves documents or fragments that are highly relevant to user queries from the data, and combines this information with the large model to generate answers or content that are fact-based and more relevant.

Images