Closed-loop electrical stimulation regulation and control system and method based on eye movement characteristic feedback

Abstract

The invention belongs to the field of control systems, and particularly relates to a closed-loop electrical stimulation regulation and control system based on eye movement characteristic feedback and a closed-loop electrical stimulation regulation and control method adopting the system. The system comprises a data processing control center, a content presentation module, and an eye movement sensing module, an eye movement feature calculation module, a regulation and control instruction module and an electrical stimulation module which are connected in sequence, the communication ends of the content presentation module, the eye movement sensing module, the eye movement feature calculation module, the regulation and control instruction module and the electrical stimulation module are respectively connected with the communication end of the data processing control center. The invention provides an intelligent closed-loop electrical stimulation regulation and control system which can realize electrical stimulation of transcranial or specific acupuncture points of the body according to the eye movement behavior of the user, and can better realize cognitive function enhancement and specific disease treatment. Visual sensing, artificial intelligence calculation and feedback stimulation electrical stimulation are combined, so that low-delay and high-precision real-time closed-loop electrical stimulation adjustment becomes possible.

Description

Technical Field

[0001] The present invention relates to a closed-loop electrical stimulation regulation system and method, and particularly to a closed-loop electrical stimulation regulation system based on eye movement feature feedback and a closed-loop electrical stimulation regulation method using the system. Background Art

[0002] Transcranial electrical stimulation is a non-invasive neuroelectrical stimulation technique. It uses two electrodes, positive and negative, to apply a weak current to the scalp. Through a conductive medium in contact with the scalp surface, a stimulating current is then injected into a specific scalp area by the electrodes, and this current acts on the cortical neurons within the cerebral cortex. According to the different polarities of the input current, it is divided into anodic (positive) stimulation and cathodic (negative) stimulation. Usually, anodic stimulation enhances the excitability of the cortex, depolarizing the resting membrane potential of neurons; cathodic stimulation reduces the cortical excitability, hyperpolarizing the resting membrane potential. Thus, transcranial electrical stimulation changes the neuroelectrical activity state of the cognitive and emotional function areas of the cerebral cortex by promoting or inhibiting the neuron discharge rate, and its stimulation effect is related to various parameters such as the electrode position and size, stimulation polarity, injected current intensity and time, and the number of treatments. Transcranial electrical stimulation has been widely used in the treatment of various diseases, such as Parkinson's disease (PD), epilepsy, and depression, etc.

[0003] Acupuncture point electrical stimulation is a technique for preventing and treating diseases by applying a microcurrent close to the human bioelectricity through acupuncture points under the guidance of traditional Chinese medicine meridian theory. It utilizes the characteristics of the human body surface arc, and through the electrodes attached to the acupuncture points, the electrical signal is transmitted to the nerve endings, and then the central nervous system is stimulated to produce an effect similar to the internal regulation of the central nervous system.

[0004] However, most of the electrical stimulation regulation methods used in existing transcranial electrical stimulation and acupuncture point electrical stimulation are open-loop electrical stimulation, and the few closed-loop electrical stimulations are closed-loop regulated by synchronously measuring the electroencephalogram signal characteristics, with relatively low regulation accuracy and high latency. Summary of the Invention

[0005] The object of the present invention is to solve the technical problems of relatively low regulation accuracy and high latency of the existing closed-loop electrical stimulation regulation based on synchronously measuring the electroencephalogram signal characteristics, and to provide a closed-loop electrical stimulation regulation system and method based on eye movement feature feedback.

[0006] Eye movement tracking technology can track the eye movements of users in real time and further capture the visual attention patterns of users. Eye movement tracking technology is an effective method for studying cognitive behavior and its neurophysiological mechanisms, which can realize the quantification and process evaluation of brain cognitive functions. It has great application prospects in the characteristic eye movement representations in different nervous system diseases and different cognitive function impairments, as well as in cognitive assessment.

[0007] To achieve the above object, the technical solution adopted by the present invention is as follows:

[0008] A closed-loop electrical stimulation regulation system based on eye movement feature feedback, characterized in that:

[0009] It includes a data processing center, a content presentation module, an eye movement perception module, an eye movement feature calculation module, a regulation instruction module, and an electrical stimulation module;

[0010] The eye movement perception module, the eye movement feature calculation module, the regulation instruction module, and the electrical stimulation module are connected in sequence, and the communication ends of the content presentation module, the eye movement perception module, the eye movement feature calculation module, the regulation instruction module, and the electrical stimulation module are respectively connected to the communication end of the data processing center;

[0011] The content presentation module is used to display the pre-designed experimental paradigm content under the control of the data processing center;

[0012] The eye movement perception module is used to calculate and record the user's eye movement tracking data in real time using the data processing center;

[0013] The eye movement feature calculation module is used to calculate eye movement features based on the eye movement tracking data using the data processing center;

[0014] The regulation instruction module is used to determine the mode of electrical stimulation regulation using the data processing center and form a control instruction;

[0015] The electrical stimulation module is used to determine the current output time, stimulation position, current intensity, pulse width, and frequency of the output electrical stimulation according to the control instruction using the data processing center, and output the electrical stimulation to the user to form a closed-loop electrical stimulation regulation;

[0016] The closed-loop electrical stimulation regulation refers to determining the electrical stimulation regulation method by capturing the user's eye movement behavior, thereby improving the user's eye movement behavior, and further capturing the user's eye movement behavior to form a closed-loop regulation.

[0017] Furthermore, the eye movement perception module includes an eye movement image acquisition unit, an eye movement tracking calibration unit, and a real-time eye movement tracking unit that are electrically connected in sequence;

[0018] The communication ends of the eye movement image acquisition unit, the eye movement tracking calibration unit, and the real-time eye movement tracking unit are respectively electrically connected to the communication end of the data processing center; the output end of the real-time eye movement tracking unit is electrically connected to the input end of the eye movement feature calculation module;

[0019] The eye movement image acquisition unit is used to capture the user's eye movement images under the control of the data processing center;

[0020] The eye tracking calibration unit is used to perform eye tracking calibration of the user in conjunction with the data processing center based on the captured eye movement images, and calculate the user's sight point;

[0021] The real-time eye tracking unit is used to cooperate with the data processing center to calculate the user's line of sight direction or landing point in real time and obtain eye tracking data.

[0022] Furthermore, the eye movement image acquisition unit is a camera.

[0023] Furthermore, the experimental paradigm content is the experimental material content presented to the user in the content presentation module according to the set rules, and its content form is pictures, videos, audios and / or interactive games, etc.

[0024] Furthermore, the content presentation module is a display screen, a virtual display device and / or an audio device, etc.

[0025] Furthermore, the eye movement characteristics include pupil size, blinking frequency and time, gaze point position and time, eye saccade amplitude, gaze point position and time, and characteristics of gaze content.

[0026] At the same time, the present invention also provides a closed-loop electrical stimulation control method based on eye movement feature feedback, which adopts the aforementioned closed-loop electrical stimulation control system based on eye movement feature feedback, and its special feature is that it includes the following steps:

[0027] Step 1: Bring the user into the scene and environment set by the closed-loop electrical stimulation control system;

[0028] Step 2: Collect the user's eye movement images, and the user completes the eye tracking calibration according to the prompts of the eye tracking calibration program;

[0029] Step 3, displaying the experimental paradigm content on the content presentation module;

[0030] Step 4: While the user is watching the experimental paradigm content, the eye movement perception module obtains the current eye movement tracking data in real time and outputs it to the eye movement feature calculation module;

[0031] Step 5: The eye movement feature calculation module calculates the user's current eye movement features based on the eye movement data, and outputs the results to the control instruction module;

[0032] Step 6: Generate a control instruction of a set mode according to the current eye movement characteristics through the control instruction module, and output it to the electrical stimulation module;

[0033] Step 7: Control the electrical stimulation control mode according to the current control instructions through the electrical stimulation module, and apply corresponding electrical stimulation to the user; after completing one electrical stimulation, return to step 4 to form a closed-loop electrical stimulation control until the set electrical stimulation task is completed.

[0034] The beneficial effects of the present invention are as follows:

[0035] 1. The present invention provides an intelligent closed-loop electrical stimulation regulation system, which can realize electrical stimulation of specific cranial or body acupoints according to the user's eye movement behavior, and can better enhance cognitive function and treat specific diseases.

[0036] 2. By combining visual sensing, artificial intelligence calculation and feedback stimulation electrical stimulation, the present invention makes it possible to adjust real-time closed-loop electrical stimulation with low latency and high precision.

[0037] 3. By designing specific experimental stimuli and capturing the eye movement characteristics under specific experimental stimuli for closed-loop stimulation, the present invention can realize more refined and targeted electrical stimulation regulation for individual differences of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 is a schematic structural diagram of an embodiment of the present invention;

[0039] Figure 2 is a schematic diagram of an eye movement trajectory in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0040] To make the objectives, advantages and features of the present invention clearer, the following further describes in detail a closed-loop electrical stimulation regulation system based on eye movement feature feedback proposed by the present invention with reference to the accompanying drawings and specific embodiments. According to the following specific embodiments, the advantages and features of the present invention will be clearer.

[0041] Refer to Figure 1 , a closed-loop electrical stimulation regulation system based on eye movement feature feedback in this embodiment mainly includes a data processing center, a content presentation module, and an eye movement perception module, an eye movement feature calculation module, a regulation instruction module, and an electrical stimulation module that are connected in sequence. At the same time, the communication terminals of the content presentation module, the eye movement perception module, the eye movement feature calculation module, the regulation instruction module, and the electrical stimulation module are respectively connected to the communication terminal of the data processing center, and the data processing center provides software and hardware support for relevant modules in terms of calculation and control.

[0042] The aforementioned content presentation module can be a display screen, a virtual display device, and / or an audio device, etc. Its main function is to display the pre-designed experimental paradigm content under the control of the data processing center. Specifically, the experimental paradigm content is the experimental material content presented to the user on the content presentation module according to certain rules, and the content form of the experimental paradigm content is pictures, videos, audios, and / or interactive games, etc.

[0043] The eye movement perception module includes an eye movement image acquisition unit, an eye movement tracking calibration unit, and a real-time eye movement tracking unit, which are respectively electrically connected to the data processing center. Among them, the eye movement image acquisition unit is specifically a camera, and the viewing field direction of the camera faces the face, which can clearly capture the eye movement images of the user under the control of the data processing center while the user is viewing the calibration content or tracking content; the eye movement tracking calibration unit accurately calculates the sight landing point of the user based on the captured eye movement images to complete the eye movement tracking calibration of the user; the real-time eye movement tracking unit uses the data processing center to calculate the sight direction or landing point of the user in real time to obtain eye movement tracking data.

[0044] While the user is viewing the experimental paradigm content, the eye movement perception module uses the data processing center to calculate and record the eye movement tracking data of the user in real time; the eye movement feature calculation module calculates the eye movement features based on the eye movement tracking data using the data processing center; the eye movement features include pupil size, blink frequency and time, sight landing point position and time, saccade amplitude, position and time of the fixation point, and features of the fixation content, etc.

[0045] The regulation instruction module determines the mode of electrical stimulation regulation in combination with the data processing center based on the calculated eye movement features and forms a control instruction.

[0046] The electrical stimulation module is usually composed of electrodes, stimulators, amplifiers, etc., and can determine the current output time, stimulation position, current intensity, pulse width, and frequency of the output electrical stimulation in combination with the data processing center according to the control instruction, and output the electrical stimulation to the user, thus forming a closed-loop control.

[0047] The specific implementation steps of this system are as follows:

[0048] Step 1: Bring the user into the scene and environment specified in the closed-loop electrical stimulation regulation system. After making preparations, the system starts to run.

[0049] Step 2: Collect the user's eye movement images, and the user completes the eye movement tracking calibration according to the prompts of the set eye movement tracking calibration program.

[0050] Step 3: Display the experimental paradigm content on the content presentation module.

[0051] Step 4: While the user is viewing the tracking content, the eye movement image acquisition unit captures the user's eye movement images under the control of the data processing center; the real-time eye movement tracking unit calculates the sight direction or landing point of the user in real time in combination with the data processing center to obtain the eye movement tracking data and outputs it to the eye movement feature calculation module.

[0052] Step 5: The eye movement feature calculation module calculates the current eye movement features of the user based on the eye movement data and outputs them to the regulation instruction module.

[0053] For example: as Figure 2 shown, the user's fixation points include Fixation Point 1, Fixation Point 2, and Fixation Point 3 located at different positions in the target area. Fixation Point 1, Fixation Point 2, and Fixation Point 3 reflect the user's saccade behavior towards a certain object in the picture and can be used as a type of eye movement feature; the positions of Fixation Point 1, Fixation Point 2, and Fixation Point 3 all fall within the region of interest defined by the example picture and can be used as a type of eye movement feature; the saccade amplitude between each fixation point can be used as a type of eye movement feature; the position of each fixation point can be used as a type of eye movement feature; the duration of each fixation point can be used as a type of eye movement feature.

[0054] Step 6: Generate a regulation command in a set mode according to the current eye movement feature through the regulation command module and output it to the electrical stimulation module. Example: When a certain type of eye movement feature in Step 5 occurs, generate a short-term electrical stimulation regulation command.

[0055] Step 7: Control the regulation mode of the electrical stimulation according to the current regulation command through the electrical stimulation module and apply the corresponding electrical stimulation to the user. After completing one stimulation, return to Step 4 to form a closed-loop electrical stimulation regulation until the set electrical stimulation task is completed.

[0056] Example: According to the generated control command, at time t 1 give the user's prefrontal lobe a sinusoidal electrical stimulation with a frequency of 20 Hz and an amplitude of 2 mA.

Claims

1. A closed-loop electrical stimulation control system based on eye movement feature feedback, characterized in that: It includes a data processing center, a content presentation module, an eye movement perception module, an eye movement feature calculation module, a control instruction module and an electrical stimulation module; The eye movement perception module, the eye movement feature calculation module, the control instruction module and the electrical stimulation module are connected in sequence, and the communication terminals of the content presentation module, the eye movement perception module, the eye movement feature calculation module, the control instruction module and the electrical stimulation module are respectively connected to the communication terminal of the data processing center; The content presentation module displays the pre-designed experimental paradigm content under the control of the data processing center; The eye movement perception module uses a data processing center to calculate and record the user's eye movement tracking data in real time; The eye movement feature calculation module uses the data processing center to calculate the eye movement features based on the eye movement tracking data; The control instruction module uses the data processing center to determine the mode of electrical stimulation control and form a control instruction; The electrical stimulation module uses the data processing center to determine the current output time, stimulation position, current intensity, pulse width and frequency of the output electrical stimulation according to the control instruction, and outputs the electrical stimulation to the user, forming a closed-loop electrical stimulation control; The closed-loop electrical stimulation regulation refers to determining the electrical stimulation regulation method by capturing the user's eye movement behavior, thereby improving the user's eye movement behavior, and further capturing the user's eye movement behavior to form a closed-loop regulation.

2. A closed-loop electrical stimulation control system based on eye movement feature feedback according to claim 1, characterized in that: The eye movement perception module includes an eye movement image acquisition unit, an eye movement tracking calibration unit and a real-time eye movement tracking unit which are electrically connected in sequence; The communication ends of the eye movement image acquisition unit, the eye movement tracking calibration unit and the real-time eye movement tracking unit are electrically connected to the communication end of the data processing center respectively; the output end of the real-time eye movement tracking unit is electrically connected to the input end of the eye movement feature calculation module; The eye movement image acquisition unit is used to capture the user's eye movement image under the control of the data processing center; The eye tracking calibration unit is used to perform eye tracking calibration of the user in conjunction with the data processing center based on the captured eye movement images, and calculate the user's sight point; The real-time eye tracking unit is used to cooperate with the data processing center to calculate the user's line of sight direction or landing point in real time and obtain eye tracking data.

3. A closed-loop electrical stimulation control system based on eye movement feature feedback according to claim 2, characterized in that: The eye movement image acquisition unit is a camera.

4. A closed-loop electrical stimulation control system based on eye movement feature feedback according to any one of claims 1 to 3, characterized in that: The experimental paradigm content is the experimental material content presented to the user in the content presentation module according to the set rules, and its content form is pictures, videos, audio and / or interactive games.

5. A closed-loop electrical stimulation control system based on eye movement feature feedback according to claim 4, characterized in that: The content presentation module is a display screen, a virtual display device and / or an audio device.

6. A closed-loop electrical stimulation control system based on eye movement feature feedback according to claim 5, characterized in that: The eye movement characteristics include pupil size, blink frequency and time, gaze point position and time, eye saccade amplitude, gaze point position and time, and characteristics of gaze content.

7. A closed-loop electrical stimulation control method based on eye movement feature feedback, using a closed-loop electrical stimulation control system based on eye movement feature feedback as described in any one of claims 1 to 6, characterized in that: The following steps are involved: Step 1: Bring the user into the scene and environment set by the closed-loop electrical stimulation control system; Step 2: Collect the user's eye movement images, and the user completes the eye tracking calibration according to the prompts of the eye tracking calibration program; Step 3, displaying the experimental paradigm content on the content presentation module; Step 4: While the user is watching the experimental paradigm content, the eye movement perception module obtains the current eye movement tracking data in real time and outputs it to the eye movement feature calculation module; Step 5: The eye movement feature calculation module calculates the user's current eye movement features based on the eye movement data, and outputs the results to the control instruction module; Step 6: Generate a control instruction of a set mode according to the current eye movement characteristics through the control instruction module, and output it to the electrical stimulation module; Step 7: Controlling the control mode of the electrical stimulation according to the current control instruction through the electrical stimulation module, and applying corresponding electrical stimulation to the user; After the electrical stimulation is completed, return to step 4 to form a closed-loop electrical stimulation control until the set electrical stimulation task is completed.

Images