Double-closed-loop ultrasonic stimulation regulation and control system and method based on gait and electroencephalogram
By designing a dual-closed-loop ultrasound stimulation modulation system based on gait and EEG, and combining PID control algorithm and ultrasound technology, precise modulation of EEG signals and behavioral gait was achieved. This solves the problem that existing technologies cannot simultaneously monitor and modulate EEG and gait, and provides a new research perspective and treatment support.
Patent Information
- Application Number
- CN202410921045.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-10
- Publication Date
- 2024-11-08
AI Technical Summary
Current technology does not yet have devices or systems that can simultaneously combine EEG and behavioral gait for dual closed-loop regulation, making it impossible to intuitively observe the real-time changes and intrinsic connections between EEG signals and behavioral gait, thus limiting a deeper understanding of the complex interaction between the brain and movement.
A dual-closed-loop ultrasound stimulation modulation system based on gait and EEG is designed, including an ultrasound stimulation module, a behavioral gait acquisition module, an EEG signal acquisition module, a data analysis module, and a PID feedback control module. The system achieves precise modulation of EEG signals and behavioral gait through PID control algorithm and ultrasound technology.
It enables precise control of EEG signals and behavioral gait, allowing for a more intuitive observation of the correlation between the two. This provides a powerful tool for biomedical research, enabling in-depth exploration of the behavioral and EEG activity patterns of experimental subjects and supporting research into disease mechanisms and the development of treatment methods.
Smart Images

Figure CN118903720A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of biomedical technology, and in particular relates to a dual-closed-loop ultrasonic stimulation control system and method based on gait and electroencephalogram. Background Art
[0002] Transcranial Ultrasound Stimulation (TUS) is a neuromodulatory technology that uses ultrasound to penetrate the skull and directly act on brain tissue. It can stimulate relevant brain areas, improve nerve conduction and muscle function, and thus help restore or improve motor function. It has attracted much attention in the fields of neuroscience and biomedicine because compared with traditional stimulation technologies (such as electrical stimulation or magnetic stimulation), TUS has the advantages of being non-invasive, having high spatial resolution, strong deep penetration, and high safety.
[0003] Electroencephalogram (EEG) refers to the electrical signal of brain electrical activity measured by electrodes on the surface of the scalp. EEG reflects the collective electrical activity of the brain's neuron population and can be used to study the function, state and disease of the brain. EEG is formed by the propagation of weak currents generated by the discharge of neurons in the cerebral cortex on the scalp. These currents produce micro-potential changes on the electrodes on the scalp, which are recorded and converted into digital signals for analysis. It has the following characteristics: high temporal resolution, low spatial resolution, and spectral characteristics.
[0004] Behavioral gait refers to the specific behavioral patterns or gait characteristics exhibited by animals (such as mice, rats, humans, etc.) when walking or moving. These characteristics usually include parameters such as gait cycle, step length, step frequency, posture, etc. In mouse or rat research, behavioral gait is often used to evaluate the animal's motor ability, neural function and behavioral characteristics. By recording the gait characteristics of animals when walking, we can analyze the animal's motor behavior under different conditions, compare the behavioral differences of animals in different groups or under different treatment conditions, evaluate the effect of drug treatment, and explore the pathogenesis of neurological diseases.
[0005] EEG analysis involves a comprehensive evaluation of the frequency, amplitude and other characteristics of the signal, and generally includes four aspects: noise and artifact identification, frequency analysis, amplitude analysis, and comparison and reference. Noise and artifact identification: Since EEG signals are usually weak and easily interfered by noise and artifacts, attention should be paid to identifying and eliminating these interferences during the analysis process; frequency analysis: EEG signals can be divided into different frequency bands according to frequency to see whether they are consistent with the EEG characteristics of normal mice; amplitude analysis: changes in amplitude can reflect the intensity and synchronization of EEG activity, so attention should be paid to amplitude fluctuations; comparison and reference: refer to relevant research literature or databases to understand the characteristics and range of normal mouse EEG signals for comparison.
[0006] Behavioral gait analysis mainly relies on image processing technology, which usually includes the following steps: image acquisition, preprocessing, feature extraction, feature matching, target recognition and segmentation, image enhancement, image classification and recognition, post-processing and result analysis, etc., which can analyze and extract data features.
[0007] The PID control algorithm is a classic feedback control algorithm, which consists of three parts: proportional, integral, and derivative, which correspond to the proportional term, integral term, and derivative term of the controller output respectively. The output of the PID control algorithm is obtained by weighted summation of these three terms. The output of the PID control algorithm can be expressed as:
[0008]
[0009] Chinese patent document CN117726651A discloses a video-based mouse multi-part trajectory detection method and device. Although it can extract the trajectory information of the mouse's head, left leg, and right leg in each frame of the video, it only performs multi-trajectory joint smoothing processing based on the trajectory information of the mouse's head, left leg, and right leg to obtain the mouse's motion trajectory, and cannot accurately identify the foot features of the mouse's limbs, which is not conducive to the mouse gait analysis.
[0010] Chinese patent document CN115512439A discloses a method for real-time analysis of the spontaneous gait of mice in a narrow runway, including designing a transparent narrow runway device with a width sufficient for mice to move forward and backward freely; using a light source for illumination, a camera to obtain a gait image of the mouse, and inputting it into a computer; constructing and training a target detection network model, using the trained target detection network model to perform mouse target detection and key point regression on each frame image obtained by the camera, and outputting the coordinate information of eight key points including the mouse's limbs, nose tip, mouth, abdomen and tail root in real time, and performing real-time analysis of the mouse's gait; and real-time calculation and output of gait characteristic parameters such as moving distance, speed, and step length. Although the mouse gait characteristic data can be obtained, gait adjustment cannot be performed.
[0011] Chinese patent document CN116171885A discloses a closed-loop ultrasound stimulation system and method that is dependent on the behavior state of freely moving mice, including an ultrasound stimulation control platform, an animal behavior acquisition device, and a visualization analysis platform. The visualization analysis platform analyzes the mouse behavior information sent by the animal behavior acquisition device in real time and obtains the behavioral characteristic data of the mice. The ultrasound stimulation control platform applies different ultrasound stimulations to the mice based on the mouse behavior characteristic data presented by the visualization analysis platform, and the behavioral information of the stimulated mice is fed back to the visualization analysis platform. It is only a single closed-loop control of gait, and the correlation between EEG signals and gait cannot be seen.
[0012] Chinese patent document CN219183791U discloses a device for transmitting EEG / EMG signals of freely moving mice using a small conductive slip ring. The wire at the stator end of the small conductive slip ring is welded to a double row of pins, which is the EEG / EMG signal output end; the wire at the rotor end of the slip ring is welded to the pin header, which is the EEG / EMG signal input end; the main body of the slip ring is fixed to an acrylic shelf. Although the device can rotate 360 degrees to achieve long-term continuous transmission of EEG / EMG signals of freely moving mice and provide hardware support for EEG acquisition of freely moving mice, it cannot perform EEG regulation on freely moving mice.
[0013] Chinese patent document CN115445087A discloses a wireless battery-free brain nerve stimulator and a preparation method. The brain nerve stimulator can be driven by a mobile phone speaker, and the designed resonator can effectively amplify the piezoelectric signal. The brain nerve stimulator includes two parts: a base with implantable nerve stimulation electrodes and a resonant cavity device connected by magnetic coupling. Although the stimulation mode is wirelessly transmitted and controlled by audio, the brain nerve stimulator can be extended to the deep or surface areas of the target brain and the peripheral nervous system, but the function is relatively fixed and can only alleviate epileptic seizure events in epileptic mice in vivo.
[0014] Chinese patent document CN115430070A discloses a closed-loop ultrasound simulation method, comprising the following steps: S1, obtaining an expected value for a first operation to obtain a peak-to-peak value of a first ultrasound stimulation; S2, importing the peak-to-peak value of the first ultrasound stimulation into an animal simulation model, and the animal simulation model outputs a neural signal; S3, collecting neural signals and calculating characteristic values; S4, calculating the error between the characteristic value and the expected value and importing it into a control module, and the control module outputs an ultrasonic adjustment factor u; S5, performing a second operation on the ultrasonic adjustment factor u to obtain a peak-to-peak value of a second ultrasound stimulation; S6, importing the peak-to-peak value of the second ultrasound stimulation into an animal simulation model, and the animal simulation model outputs a neural signal of this cycle; S7. Repeat S3 to S6, and record the characteristic values of each repeated cycle. Although the control algorithm is introduced into the closed-loop LITUS system, and the neural signal is used as the feedback value to import into the control algorithm, the ultrasonic parameters are updated in real time to perform ultrasonic stimulation. It has unique EEG observation and analysis functions and can adjust the EEG state accordingly. However, its application scope is currently limited to closed-loop regulation of the EEG of mice, and has not yet been combined with gait analysis. That is to say, although it can deeply explore the EEG activity of mice, it cannot further analyze the potential connection between EEG and gait. Therefore, there are still limitations in gait research, and it cannot provide a comprehensive perspective on the mutual influence between EEG and gait.
[0015] Chinese patent document CN116649983A discloses a device for detecting and stimulating abnormal EEG of mice and ultrasound based on CNN technology, which includes four parts: an EEG acquisition module, a computer host, an ultrasound stimulation module and a mouse fixing platform. The EEG acquisition module is used to collect and process the EEG signals of mice and transmit them to the computer host; the ultrasound stimulation module is used to perform targeted transcranial ultrasound stimulation on mice with abnormal EEG signals to achieve the effect of brain nerve regulation; the mouse fixing platform is used to fix the mice to be tested; the computer host is used for filtering and training and applying a convolutional neural network model (CNN). Although the EEG state can be observed and analyzed and corresponding adjustments can be made, it can only realize the function of closed-loop regulation of the EEG of mice, without integration with the gait aspect, and cannot observe and analyze the relationship between EEG and gait.
[0016] 1) Movement trajectory and gait detection only detects and records the movement trajectory of mice and roughly analyzes the gait of mice. It does not obtain detailed foot characteristics such as the mouse's walking speed, stride, and suspension time, and cannot adjust abnormal gait; 2) Gait closed-loop control is based on the current foot characteristics of the mouse, and ultrasonic stimulation is performed on the mouse to adjust and control the mouse's gait so that its foot characteristics reach the expected value. Its function is only a single gait monitoring and adjustment, and it is not integrated with other values; 3) EEG open-loop control can collect EEG of freely moving mice and perform nerve stimulation on epileptic mice to alleviate epileptic symptoms. It only studies EEG signals and does not conduct joint research on gait; 4) EEG closed-loop control is limited to closed-loop regulation of mouse EEG, and gait analysis has not yet been included in its application scope, and it is impossible to gain insight into the subtle connection between EEG and gait;
[0017] In the existing control technologies, although there are separate means of EEG control and behavioral gait control, they are often limited to the control of a single quantity or only use open-loop methods for adjustment. Unfortunately, there are currently no devices and systems that can simultaneously combine EEG and behavioral gait for dual closed-loop joint control. This makes it impossible to intuitively observe the real-time changes and their intrinsic connection between EEG signals and behavioral gait, thereby limiting our in-depth understanding of the complex interactions between the brain and movement.
[0018] Therefore, there is a need for a dual closed-loop ultrasonic stimulation control system and method based on gait and EEG that can simultaneously monitor and control EEG signals and behavioral gait and accurately and effectively control both. Summary of the invention
[0019] The purpose of the present invention is to provide a dual closed-loop ultrasonic stimulation and control system and method based on gait and EEG, which can simultaneously monitor and control EEG signals and behavioral gait and accurately and effectively control both, generate appropriate ultrasonic parameters according to the experimental subject's behavioral gait and EEG signals, use ultrasonic stimulation to adjust and improve the experimental subject's behavioral gait and EEG signals, and more intuitively observe the correlation between EEG and gait.
[0020] To achieve the above object, the technical solution adopted by the present invention is:
[0021] A double closed-loop ultrasonic stimulation and control system based on gait and EEG comprises an ultrasonic stimulation module for ultrasonically stimulating an experimental subject, a behavior and gait acquisition module for carrying the experimental subject, an EEG signal acquisition module connected to the experimental subject, a data analysis module for receiving data information transmitted by the behavior and gait acquisition module and the EEG signal acquisition module and performing processing and analysis, and a PID feedback control module for unified control; the outputs of the behavior and gait acquisition module and the EEG signal acquisition module are both connected to the input of the data analysis module, the output of the data analysis module is connected to the input of the PID feedback control module, the output of the PID feedback control module is connected to the input of the ultrasonic stimulation module, and the ultrasound output by the ultrasonic stimulation module regulates the behavior and gait and EEG signals of the experimental subject.
[0022] A further improvement of the technical solution of the present invention is that the ultrasonic stimulation module includes two function signal generators, a radio frequency power amplifier whose input is connected to the output of one of the function signal generators, an ultrasonic transducer whose input is connected to the output of the radio frequency power amplifier, and a collimator whose input is connected to the output of the ultrasonic transducer and whose output is aligned with the head of the experimental subject.
[0023] A further improvement of the technical solution of the present invention is that the behavior and gait acquisition module includes a free-moving treadmill for carrying experimental subjects, an electric lamp placed under the free-moving treadmill, a camera placed on one side of the free-moving treadmill and whose output is connected to the input of the data analysis module, a plane mirror tilted under the free-moving treadmill, and an anti-interference copper mesh covering the outer surface of the free-moving treadmill; a running room adapted to the experimental subjects is provided on the free-moving treadmill.
[0024] A further improvement of the technical solution of the present invention is that the EEG acquisition module includes an electrode in contact with the head of the experimental subject, a preamplifier whose input is connected to the output of the electrode, a signal transmission line whose input is connected to the output of the preamplifier, and a data acquisition system whose input is connected to the output of the signal transmission line and whose output is connected to the data analysis module. The data acquisition system converts the analog signal into a digital signal through an analog-to-digital converter ADC and transmits it to the data analysis module.
[0025] A further improvement of the technical solution of the present invention is that the data analysis module includes two submodules, namely a behavior gait analysis module that uses OpenCV to load and process videos and an EEG signal analysis module that uses MATLAB to draw graphics of the collected EEG data.
[0026] A further improvement of the technical solution of the present invention is that the EEG signal analysis includes the following steps: loading the data file using the load function according to the data saving path; filtering the loaded EEG data by creating a filter according to the sampling rate, low-pass and high-pass filter functions; dividing the filtered data into windows, and calculating the root mean square value of each window, evaluating the strength of the EEG signal and abnormality detection, and eliminating abnormal data; saving normal data and drawing graphs of the normal data.
[0027] A further improvement of the technical solution of the present invention is that the behavior gait analysis includes the following steps: cv::BackgroundSubtractorMOG2 performs background elimination; cv::GaussianBlur performs filtering and image denoising; v::equalizeHist performs image and contrast enhancement; after cv::filter2D performs image sharpening, cv::morphologyEx and cv::findContours identify the foot image of the experimental subject through the cross segmentation method; and cv::SURF extracts the behavior gait feature data.
[0028] A further improvement of the technical solution of the present invention is that the PID feedback control module includes a PID controller for EEG signals and a PID controller for gait data, wherein the PID control of EEG signals includes the following steps:
[0029] The actual EEG signal is compared with the set target EEG signal and the deviation is calculated. The specific calculation formula is as follows:
[0030] e 脑电 (t) = target EEG - actual EEG (t)
[0031] The output of the PID controller is calculated based on the deviation and the ultrasonic parameters are adjusted. The specific calculation formula is as follows:
[0032]
[0033] PID control of gait data includes the following steps:
[0034] The actual gait data is compared with the set target gait data and the deviation is calculated. The specific calculation formula is as follows:
[0035] e 步态 (t) = target gait - actual gait (t)
[0036] The output of the PID controller is calculated based on the deviation and the ultrasonic parameters are adjusted. The specific calculation formula is as follows:
[0037]
[0038] A dual closed-loop ultrasound stimulation control method based on gait and EEG, which performs control operations based on a control system, includes the following steps:
[0039] Step S1: Connect the electrodes in the EEG acquisition module to the head of the experimental subject, and place the experimental subject in the running room of the free-motion treadmill in the behavior gait acquisition module, and start the camera and the light at the same time;
[0040] Step S2: using two function signal generators to set initial ultrasound stimulation parameters in the ultrasound stimulation module, and using an ultrasound transducer via a collimator to perform precise ultrasound stimulation on the cerebellum of the experimental subject;
[0041] Step S3: The camera in the behavior and gait acquisition module records the behavior and gait data of the experimental subject and transmits it to the behavior and gait analysis module in the data analysis module. At the same time, the data acquisition system in the EEG acquisition module transmits the EEG signal data collected by the electrodes to the EEG signal analysis module in the data analysis module.
[0042] Step S4: the behavior gait analysis module in the data analysis module analyzes and processes the behavior gait data while the EEG signal analysis module analyzes and processes the EEG signal data, and compares the behavior gait parameters and EEG signal data obtained by the analysis with the preset target values;
[0043] Step S5: If the behavior gait parameters and the EEG signals are consistent with the preset target values, the control is terminated; if the behavior gait parameters and the EEG signals are inconsistent with the preset target values, the data analysis module transmits the deviation between the behavior gait parameters and the EEG signals and the preset target values to the PID feedback control module, and the PID feedback control module recalculates and adjusts the ultrasonic stimulation parameters according to the deviation, and transmits the ultrasonic stimulation parameters to the ultrasonic stimulation module to generate a new ultrasonic stimulation signal, and then repeats steps S2-S4 to perform multiple ultrasonic stimulation cycles on the experimental subject until the behavior gait parameters and the EEG signals are consistent with the preset target values, and the control is terminated.
[0044] A further improvement of the technical solution of the present invention is that: in step S4, the actually acquired behavioral gait parameters and EEG signal data are converted into an array, multiple deviation category ranges are defined, the difference between the actual behavioral gait parameters and EEG signals and the target value is calculated, the categories are matched according to the results, and the deviation of each category is specified to be passed to the PID feedback control module as input.
[0045] Due to the adoption of the above technical solution, the technical progress achieved by the present invention is:
[0046] The dual closed-loop ultrasonic stimulation control system and method based on gait and EEG of the present invention can generate appropriate ultrasonic parameters according to the experimental subject's behavior, gait and EEG signals, and use ultrasonic stimulation to adjust and improve the experimental subject's behavior, gait and EEG signals, so as to more intuitively observe the correlation between EEG and gait, providing a powerful tool and platform for biomedical research, and can deeply explore the laws of experimental subject behavior and EEG activities, providing important support for disease mechanism research and the development of treatment methods.
[0047] The present invention integrates the two key elements of EEG and gait, realizes the close connection between the two, and uses PID control algorithm and ultrasonic technology to construct a dual closed-loop control system of EEG and gait, which can not only monitor and analyze EEG signals and gait data in real time, but also accurately and effectively regulate the two. The use of PID control algorithm ensures the accuracy and stability of regulation, while the introduction of ultrasonic technology further improves the efficiency and precision of regulation. It not only provides a new research perspective, but also provides strong technical support for future fields such as brain-computer interaction and gait rehabilitation.
[0048] The behavior and gait acquisition module in the present invention provides a space for free movement for the experimental subjects through a camera and a free-movement treadmill, and records the behavior and gait data of the experimental subjects in real time. The obtained data is an important basis for subsequent analysis and provides key clues for analyzing the behavioral characteristics of the experimental subjects.
[0049] The EEG acquisition module in the present invention uses electrodes to collect the EEG signals of the experimental subject during exercise, displays basic information such as the amplitude of the EEG signals through an interactive interface, stores the EEG signals, and transmits them to the data analysis module. Through this module, detailed information on the EEG activities of the experimental subject can be obtained, providing important data support for studying the neural activities of the experimental subject.
[0050] The data analysis module in the present invention can perform in-depth analysis and processing on the collected data, and can not only identify the behavioral characteristics of the experimental subjects, but also analyze the EEG data to determine the current situation of the experimental subjects' gait and EEG.
[0051] The PID feedback control module in the present invention analyzes data in real time and uses the deviation between the detected data and the target value to perform PID algorithm feedback to adjust the relevant parameters of the ultrasonic stimulation to ensure the accuracy and effectiveness of the ultrasonic stimulation, adjust the gait and EEG signals of the experimental subject, and thus achieve dual closed-loop control of the experimental subject's behavior, gait and EEG.
[0052] The ultrasonic stimulation module in the present invention can set appropriate ultrasonic stimulation parameters according to the current state of the experimental subject, stimulate the head movement-related areas of the experimental subject, adjust the EEG signals and behavioral gait, and also set safety numerical limits to ensure the life safety of the experimental subject. It can accurately control the frequency, energy and direction of the ultrasonic wave while achieving precise stimulation of the relevant brain tissue of the experimental subject. As a core component, it not only undertakes the important task of transmitting ultrasonic stimulation, but also can ensure the accuracy, precision and safety of the ultrasonic wave, and effectively adjust the EEG and behavior of the experimental subject. BRIEF DESCRIPTION OF THE DRAWINGS
[0053] Figure 1 It is a framework diagram of the dual closed-loop ultrasound stimulation control system based on gait and EEG of the present invention;
[0054] Figure 2 It is a structural schematic diagram of a dual closed-loop ultrasonic stimulation and control system based on gait and EEG of the present invention;
[0055] Figure 3 It is a flow chart of the dual closed-loop ultrasonic stimulation control method based on gait and EEG of the present invention. DETAILED DESCRIPTION
[0056] The present invention is further described in detail below in conjunction with embodiments:
[0057] Example 1
[0058] like Figure 1 and Figure 2 As shown, this embodiment provides a dual closed-loop ultrasonic stimulation and control system based on gait and EEG, including an ultrasonic stimulation module for ultrasonically stimulating an experimental subject, a behavior and gait acquisition module carrying the experimental subject, an EEG signal acquisition module connected to the experimental subject, a data analysis module that receives data information transmitted by the behavior and gait acquisition module and the EEG signal acquisition module and performs processing and analysis, and a PID feedback control module for unified control, and the PID feedback control module and the data analysis module are both based on a computer, wherein the outputs of the behavior and gait acquisition module and the EEG signal acquisition module are both connected to the input of the data analysis module, the output of the data analysis module is connected to the input of the PID feedback control module, the output of the PID feedback control module is connected to the input of the ultrasonic stimulation module, and the ultrasound output by the ultrasonic stimulation module regulates the behavior and gait and EEG signals of the experimental subject mouse, thereby forming a dual closed-loop control.
[0059] The ultrasonic stimulation module includes two function signal generators, a radio frequency power amplifier whose input is connected to the output of one of the function signal generators, an ultrasonic transducer whose input is connected to the output of the radio frequency power amplifier, and a collimator whose input is connected to the output of the ultrasonic transducer and whose output is aimed at the head of the experimental subject. The specific steps of the ultrasonic stimulation module for ultrasonic stimulation of the experimental subject mouse include: first, one of the function signal generators generates a square wave in an internal triggering manner, and the other function signal generator is externally triggered so that the sine wave generated by it is amplified by the radio frequency power amplifier; secondly, the output of the radio frequency power amplifier drives the ultrasonic transducer to generate pulsed ultrasonic waves, and the function of the ultrasonic transducer is to convert the pulsed electrical signal into a mechanical ultrasonic wave, and finally the mechanical ultrasonic wave generated by the ultrasonic transducer is converged to the part of the experimental subject to be stimulated through the collimator to complete the ultrasonic stimulation.
[0060] After the two function signal generators in the ultrasonic stimulation module receive the ultrasonic stimulation parameters (base frequency, pulse repetition frequency, duty cycle, continuous stimulation time, signal source strength) set according to the current state of the mouse as fed back by the PID feedback control module, ultrasonic stimulation is performed on the areas related to the mouse's head movement to regulate the EEG signals and behavioral gait. At the same time, safety numerical limits are set to ensure the life safety of the mouse. While accurately controlling the frequency and energy of the ultrasonic wave, precise stimulation of the relevant brain tissue of the mouse is achieved, effectively regulating the EEG and behavior of the mouse.
[0061] The behavior and gait acquisition module includes an electric light, a camera whose output is connected to the input of the data analysis module, a plane mirror, a free-moving treadmill carrying the experimental subject mouse, and an anti-interference copper mesh, wherein the electric light is placed below the free-moving treadmill, the camera is placed on one side of the free-moving treadmill, the plane mirror is tilted below the free-moving treadmill with an inclination angle of 45°, and the anti-interference copper mesh covers the outer surface of the free-moving treadmill. The electric light is used to provide lighting for the activity area, making the video image captured by the camera clearer; the camera is used to capture and record videos of mice during their activities, providing a behavioral gait video basis for subsequent behavioral analysis. The user can use Visual Studio in the computer to write a gait acquisition parameter setting interface to adjust the camera exposure time, frame rate and other parameters, video image position and the light intensity of the electric light to ensure clear recording of the mouse's behavioral gait. After drawing the ROI area with the mouse, the mirror imaging principle is used to record the video of the mouse in motion, and the recorded behavioral gait data is transmitted to the data analysis module; the free-movement treadmill is equipped with a running room adapted to the experimental subject mice, which provides space for the mice to move freely, and has a certain restriction effect on the mice to avoid the loss of the mice, while ensuring that the camera completely records the mouse's movement video; the anti-interference copper mesh eliminates external interference signals to effectively prevent the mice from being affected by them, while ensuring that the EEG acquisition signal is not disturbed by external interference signals.
[0062] The EEG acquisition module consists of several key components, including electrodes, preamplifiers whose input is connected to the output of the electrodes, signal transmission lines whose input is connected to the output of the preamplifier, and a data acquisition system whose input is connected to the output of the signal transmission line and whose output is connected to the data analysis module. The electrodes directly contact the head of the experimental subject, the mouse, to detect brain activity and convert it into a voltage signal; the preamplifier amplifies these weak signals for subsequent processing; the signal transmission line connects the electrodes, preamplifier, and data acquisition system to ensure that the signal transmission process is not disturbed; the data acquisition system converts the analog signal into a digital signal through an analog-to-digital converter (ADC) and transmits it to the data analysis module.
[0063] The data analysis module consists of two submodules: a behavior gait analysis module that uses OpenCV to load and process videos and an EEG signal analysis module that uses MATLAB to draw graphs of the collected EEG data.
[0064] The specific steps of EEG signal analysis include: loading the data file using the load function according to the data saving path; filtering the loaded EEG data according to the sampling rate, low-pass and high-pass filter functions to remove unnecessary frequency components; dividing the filtered data into windows and calculating the root mean square value of each window to evaluate the strength of the EEG signal and detect anomalies, and eliminate abnormal data; saving normal data (for pid algorithm) and drawing graphs of the processed normal data (users can directly observe EEG information).
[0065] The specific steps of behavioral gait analysis include: using cv::BackgroundSubtractorMOG2 for background removal; using cv::GaussianBlur for filtering (Gaussian filtering is used to remove noise and small burrs); image denoising; using v::equalizeHist for image enhancement and contrast enhancement; using cv::filter2D for image sharpening, and then using cv::morphologyEx (morphological operation function, used for opening and closing operations) and cv::findContours (contour detection function, used to find contours in the image) to identify the foot image of the experimental subject mouse through the cross segmentation method; finally, using cv::SURF to extract the behavioral gait feature data (used for the pid algorithm).
[0066] The data analysis module can deeply analyze and process the collected behavior gait data and EEG signal data, and transmit the deviation between the analyzed behavior gait effect value and EEG signal effect value and the preset target value to the PID feedback control module. The data analysis module can not only identify the behavioral characteristics of mice, but also analyze EEG data, thereby revealing the laws and characteristics of the mouse's neural activity.
[0067] The PID feedback control module is a key link in achieving closed-loop control, including proportional, integral, and derivative for adjustment. This module uses the deviation obtained by comparing the actual EEG signal effect value and behavioral gait effect value of the mouse stored in the data analysis module with the target value as input, and feeds back the calculated new ultrasonic stimulation parameters (base frequency, pulse repetition frequency, duty cycle, continuous stimulation time, signal source strength) as output to the ultrasonic stimulation module to achieve gait and EEG dual closed-loop control. Specifically, two PID controllers are designed for adjustment, including a PID controller for EEG signals and a PID controller for gait data, in which,
[0068] The PID control of EEG signals includes the following steps:
[0069] Error calculation: Compare the actual EEG signal with the set target EEG signal to obtain the error value (deviation). The specific calculation formula is as follows:
[0070] e 脑电 (t) = target EEG - actual EEG (t)
[0071] PID controller: Calculate the output of the PID controller based on the error and adjust the ultrasonic parameters (such as frequency, intensity, etc.). The specific calculation formula is as follows:
[0072]
[0073] PID control of gait data includes the following steps:
[0074] Error calculation: Compare the actual gait data (such as step length, gait cycle) with the set target gait data to obtain the error value (deviation). The specific calculation formula is as follows:
[0075] e 步态 (t) = target gait - actual gait (t)
[0076] PID controller: Calculate the output of the PID controller based on the error and adjust the ultrasonic parameters (such as frequency, intensity, etc.). The specific calculation formula is as follows:
[0077]
[0078] The PID feedback control module analyzes data in real time and uses the deviation between the detected data and the target value to perform PID algorithm feedback adjustment to ensure the accuracy and effectiveness of ultrasonic stimulation, thereby achieving dual closed-loop control of mouse behavior, gait and EEG.
[0079] Example 2
[0080] like Figure 2 and Figure 3 As shown, this embodiment provides a dual closed-loop ultrasound stimulation control method based on gait and EEG, and performs control operations based on the control system of Example 1, including the following steps:
[0081] Step S1: Connect the electrodes in the EEG acquisition module to the head of the experimental mouse, and place the mouse in the running room of the free-movement treadmill in the behavior gait acquisition module, start the camera and the light at the same time, and adjust the exposure time, frame rate and light intensity of the light through the VisualStudio interactive interface;
[0082] Step S2: using two function signal generators to set initial ultrasound stimulation parameters in the ultrasound stimulation module, and using an ultrasound transducer via a collimator to perform precise ultrasound stimulation on the cerebellum of the experimental mouse;
[0083] Step S3: The camera in the behavior and gait acquisition module uses the mirror imaging principle to record the video of the mouse in motion, and transmits the recorded behavior and gait data of the mouse to the behavior and gait analysis module in the data analysis module. At the same time, the data acquisition system in the EEG acquisition module transmits the EEG signal data collected by the electrodes to the EEG signal analysis module in the data analysis module.
[0084] Step S4: the behavior gait analysis module in the data analysis module analyzes and processes the behavior gait data while the EEG signal analysis module analyzes and processes the EEG signal data, and compares the behavior gait parameters and EEG signal data obtained by the analysis with the preset target values;
[0085] Specifically, the actually acquired behavior gait parameters and EEG signal data are converted into an array, multiple deviation category ranges are defined, the difference between the actual behavior gait parameters and EEG signals and the target value is calculated, the categories are matched according to the results, and the deviation of each category is specified to be passed to the PID feedback control module as input;
[0086] Step S5: If the behavior gait parameters and the EEG signals are consistent with the preset target values, the control is terminated; if the behavior gait parameters and the EEG signals are inconsistent with the preset target values, the data analysis module transmits the deviation between the behavior gait parameters and the EEG signals and the preset target values to the PID feedback control module, and the PID feedback control module recalculates and adjusts the ultrasonic stimulation parameters according to the deviation, and transmits the ultrasonic stimulation parameters to the ultrasonic stimulation module to generate a new ultrasonic stimulation signal, and then repeats steps S2-S4 to perform multiple ultrasonic stimulation cycles on the experimental subject mice until the behavior gait parameters and the EEG signals are consistent with the preset target values, and the control is terminated.
[0087] The control method in this embodiment collects and analyzes the behavioral gait data and EEG signal data of mice through multiple ultrasonic stimulation cycles and continuously adjusts the ultrasonic stimulation parameters in real time, and finally records and analyzes the data after each ultrasonic stimulation to optimize the system performance, thereby achieving effective control of the behavioral gait and EEG of free mice.
[0088] It is to be understood that the present invention is described by some embodiments, and it is known to those skilled in the art that various changes or equivalent substitutions may be made to these features and embodiments without departing from the spirit and scope of the present invention. In addition, under the teachings of the present invention, these features and embodiments may be modified to adapt to specific circumstances and materials without departing from the spirit and scope of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of this application are within the scope of protection of the present invention.
Claims
1. A dual closed-loop ultrasound stimulation control system based on gait and EEG, characterized by: The invention comprises an ultrasonic stimulation module for ultrasonically stimulating an experimental subject, a behavior and gait acquisition module for carrying the experimental subject, an electroencephalogram signal acquisition module connected to the experimental subject, a data analysis module for receiving data information transmitted by the behavior and gait acquisition module and the electroencephalogram signal acquisition module and performing processing and analysis, and a PID feedback control module for performing unified regulation; the outputs of the behavior and gait acquisition module and the electroencephalogram signal acquisition module are both connected to the input of the data analysis module, the output of the data analysis module is connected to the input of the PID feedback control module, the output of the PID feedback control module is connected to the input of the ultrasonic stimulation module, and the ultrasound output by the ultrasonic stimulation module regulates the behavior and gait and electroencephalogram signal of the experimental subject.
2. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 1, characterized in that: The ultrasonic stimulation module includes two function signal generators, a radio frequency power amplifier whose input is connected to the output of one of the function signal generators, an ultrasonic transducer whose input is connected to the output of the radio frequency power amplifier, and a collimator whose input is connected to the output of the ultrasonic transducer and whose output is aligned with the head of the experimental subject.
3. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 2, characterized in that: The behavior and gait acquisition module includes a free-movement treadmill for carrying experimental subjects, an electric lamp placed under the free-movement treadmill, a camera placed on one side of the free-movement treadmill and whose output is connected to the input of the data analysis module, a plane mirror placed obliquely under the free-movement treadmill, and an anti-interference copper mesh covering the outer surface of the free-movement treadmill; a running room adapted to the experimental subjects is arranged on the free-movement treadmill.
4. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 3, characterized in that: The EEG acquisition module includes electrodes in contact with the head of the experimental subject, a preamplifier whose input is connected to the output of the electrode, a signal transmission line whose input is connected to the output of the preamplifier, and a data acquisition system whose input is connected to the output of the signal transmission line and whose output is connected to the data analysis module. The data acquisition system converts analog signals into digital signals through an analog-to-digital converter ADC and transmits them to the data analysis module.
5. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 4, characterized in that: The data analysis module includes two submodules, namely a behavior gait analysis module that uses OpenCV to load and process videos and an EEG signal analysis module that uses MATLAB to draw graphics for the collected EEG data.
6. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 5, characterized in that: The EEG signal analysis includes the following steps: using the load function to load the data file according to the data saving path; creating filters for the loaded EEG data according to the sampling rate, low-pass and high-pass filter functions; dividing the filtered data into windows, and calculating the root mean square value of each window, evaluating the strength of the EEG signal and abnormal detection, and eliminating abnormal data; saving normal data and drawing graphs of normal data.
7. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 6, characterized in that: The behavior and gait analysis includes the following steps: cv::BackgroundSubtractorMOG2 is used to remove the background; cv::GaussianBlur is used to filter and denoise the image; v::equalizeHist is used to enhance the image and contrast; after cv::filter2D is used to sharpen the image, cv::morphologyEx and cv::findContours are used to identify the foot image of the experimental subject through the cross segmentation method; and cv::SURF is used to extract the behavior and gait feature data.
8. The dual closed-loop ultrasound stimulation control system based on gait and EEG according to claim 7, characterized in that: The PID feedback control module includes a PID controller for EEG signals and a PID controller for gait data, wherein the PID control of EEG signals includes the following steps: The actual EEG signal is compared with the set target EEG signal and the deviation is calculated. The specific calculation formula is as follows: e 脑电 (t) = target EEG - actual EEG (t) The output of the PID controller is calculated based on the deviation and the ultrasonic parameters are adjusted. The specific calculation formula is as follows: PID control of gait data includes the following steps: The actual gait data is compared with the set target gait data and the deviation is calculated. The specific calculation formula is as follows: e 步态 (t) = target gait - actual gait (t) The output of the PID controller is calculated based on the deviation and the ultrasonic parameters are adjusted. The specific calculation formula is as follows:
9. A dual closed-loop ultrasound stimulation control method based on gait and EEG, characterized in that: The control system according to any one of claims 1 to 8 performs a control operation, comprising the following steps: Step S1: Connect the electrodes in the EEG acquisition module to the head of the experimental subject, and place the experimental subject in the running room of the free-motion treadmill in the behavior gait acquisition module, and start the camera and the light at the same time; Step S2: using two function signal generators to set initial ultrasound stimulation parameters in the ultrasound stimulation module, and using an ultrasound transducer via a collimator to perform precise ultrasound stimulation on the cerebellum of the experimental subject; Step S3: The camera in the behavior and gait acquisition module records the behavior and gait data of the experimental subject and transmits it to the behavior and gait analysis module in the data analysis module. At the same time, the data acquisition system in the EEG acquisition module transmits the EEG signal data collected by the electrodes to the EEG signal analysis module in the data analysis module. Step S4: the behavior gait analysis module in the data analysis module analyzes and processes the behavior gait data while the EEG signal analysis module analyzes and processes the EEG signal data, and compares the behavior gait parameters and EEG signal data obtained by the analysis with the preset target values; Step S5: If the behavior gait parameters and the EEG signals are consistent with the preset target values, the control is terminated; if the behavior gait parameters and the EEG signals are inconsistent with the preset target values, the data analysis module transmits the deviation between the behavior gait parameters and the EEG signals and the preset target values to the PID feedback control module, and the PID feedback control module recalculates and adjusts the ultrasonic stimulation parameters according to the deviation, and transmits the ultrasonic stimulation parameters to the ultrasonic stimulation module to generate a new ultrasonic stimulation signal, and then repeats steps S2-S4 to perform multiple ultrasonic stimulation cycles on the experimental subject until the behavior gait parameters and the EEG signals are consistent with the preset target values, and the control is terminated.
10. The dual closed-loop ultrasound stimulation control method based on gait and EEG according to claim 9, characterized in that: In step S4, the actually acquired behavioral gait parameters and EEG signal data are converted into an array, multiple deviation category ranges are defined, the difference between the actual behavioral gait parameters and EEG signals and the target value is calculated, the categories are matched according to the results, and the deviation of each category is specified to be passed to the PID feedback control module as input.
Citation Information
Patent Citations
Closed-loop ultrasonic simulation method, system and device
CN115430070A
Wireless battery-free cranial nerve stimulator and preparation method thereof
CN115445087A
Real-time analysis method for spontaneous gaits of mice in long and narrow runway
CN115512439A
Free moving mouse behavior state dependent closed loop ultrasonic stimulation system and method
CN116171885A
Mouse electroencephalogram anomaly detection and ultrasonic stimulation device based on CNN (Convolutional Neural Network) technology
CN116649983A
