Brain-computer-based mechanical system and control method thereof

By setting up multiple EEG trigger modules and acquisition modules in the brain-computer device, the EEG signal is analyzed to determine the control intention, the misjudgment problem caused by external interference is solved, and the control accuracy and applicability of the brain-computer device are improved.

CN119045657APending Publication Date: 2024-11-29HANGZHOU INNOVATION RES INST OF BEIJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411033324.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

When existing brain-computer devices acquire EEG signals, external things attract attention lead to unexpected EEG signals, causing misjudgment of behavioral intentions. Moreover, the motion planning of mechanical equipment is mainly based on binary control, making it difficult to meet specific environments and The needs of the crowd.

Method used

Design a mechanical system based on a brain machine, including an action execution module, a first EEG trigger module, a second EEG trigger module and an EEG acquisition module, respectively, by setting the first EEG trigger module and the second EEG trigger module on the controlled target. The EEG trigger module stimulates the target object to generate specific EEG signals, collects and analyzes signals to determine the control intention, and sends control instructions to avoid false triggering.

Benefits of technology

It improves the accuracy of judging the control intention of the target object, avoids misjudgment caused by external interference, and meets the actual needs of specific environments and people.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119045657A_ABST
    Figure CN119045657A_ABST
Patent Text Reader

Abstract

The invention provides a brain-computer-based mechanical system and a control method thereof, and the system comprises an action execution module which is disposed on a controlled target; the first electroencephalogram triggering module is arranged on the controlled target, and the first electroencephalogram triggering module is used for stimulating the target object so that the brain of the target object can generate a first electroencephalogram signal; the second electroencephalogram triggering module is arranged on the controlled target, and the second electroencephalogram triggering module is used for stimulating the target object so that the brain of the target object can generate a second electroencephalogram signal; the electroencephalogram acquisition module is used for acquiring a first electroencephalogram signal and a second electroencephalogram signal; the electroencephalogram acquisition module, the first electroencephalogram trigger module, the second electroencephalogram trigger module and the action execution module are respectively in communication connection with the control module; according to the scheme provided by the embodiment of the invention, the accuracy of judging the control intention of the target object can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to but is not limited to the field of electroencephalogram recognition technology, and in particular to a brain-computer-based mechanical system and a control method thereof. Background Art

[0002] The research on EEG mechanical equipment involves key technologies such as architecture, human-computer interaction, motion planning, and motion control. Human-computer interaction and motion planning are undoubtedly the key contents of the above research. The choice of human-computer interaction method directly affects the effect and efficiency of communication between people and machines.

[0003] In the related technology, when obtaining human EEG signals through brain-computer devices for identification, it is often difficult for people to receive specific stimulation from the brain-computer for a long time. If external things attract people's attention and cause their brains to produce unexpected EEG signals, the brain-computer will misjudge people's behavioral intentions. Moreover, the motion planning of mechanical equipment is mostly based on traditional binary control methods to complete predetermined operations, which is difficult to meet the actual needs of specific environments and specific groups of people. Summary of the invention

[0004] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.

[0005] The embodiments of the present application provide a brain-computer-based mechanical system and a control method thereof, which can improve the accuracy of judging the control intention of a target object.

[0006] To achieve the above-mentioned purpose, the first aspect of the embodiment of the present application proposes a brain-computer-based mechanical system, characterized in that it includes: an action execution module, which is arranged on a controlled target; a first EEG trigger module, which is arranged on the controlled target, and the first EEG trigger module is used to stimulate the target object so that the brain of the target object generates a first EEG signal; a second EEG trigger module, which is arranged on the controlled target, and the second EEG trigger module is used to stimulate the target object so that the brain of the target object generates a second EEG signal; an EEG acquisition module, which is used to acquire the first EEG signal and the second EEG signal; a control module, wherein the EEG acquisition module, the first EEG trigger module, the second EEG trigger module and the action execution module are respectively connected to the control module in communication; wherein the control module is used to determine the control intention of the target object according to the first EEG signal; when the EEG trigger module acquires the second EEG signal and the control intention is determined, the control module determines a control instruction according to the control intention, and sends the control instruction to the action execution module, so that the action execution module controls the controlled target to perform an action according to the control instruction.

[0007] In some embodiments, the first EEG trigger module includes a first visual stroboscope, which strobes at a preset first flickering frequency to cause the brain of the target object to generate a first EEG signal equal to the first flickering frequency.

[0008] In some embodiments, the second EEG trigger module includes a second visual stroboscope, which lights up and turns off alternately at a preset second flashing frequency, and the off-duration of the second visual stroboscope is within a preset off-duration interval.

[0009] In some embodiments, after the EEG acquisition module detects the first EEG signal, the second EEG triggering module is controlled to stimulate the target object.

[0010] In some embodiments, the action execution module includes a torque motor and a drive chip, the torque motor is electrically connected to the drive chip, the drive chip is communicatively connected to the control module, and the drive chip is used to control the action state of the torque motor according to the control instruction.

[0011] In some embodiments, the action execution module includes a pressure sensor, which is communicatively connected to the control module. The pressure sensor is used to obtain the pressure state between the action execution module and the controlled target, and the action chip is used to adjust the action state of the torque motor according to the pressure state.

[0012] In some embodiments, the action execution module includes a potential sensor, which is communicatively connected to the control module, and is used to obtain the potential state of the controlled target. The action chip is used to adjust the action state of the torque motor according to the potential state.

[0013] To achieve the above-mentioned purpose, the second aspect of the present application proposes a control method for a brain-computer-based mechanical system, which is applied to the brain-computer-based mechanical system as described in the first aspect. The brain-computer-based mechanical system includes an action execution module, a first EEG trigger module, a second EEG trigger module, an EEG acquisition module and a control module. The control method includes: the first EEG trigger module stimulates the target object so that the brain of the target object generates a first EEG signal; when the EEG acquisition module detects the first EEG signal, the control module determines the control intention of the target object according to the first EEG signal, and controls the second EEG trigger module to stimulate the target object so that the brain of the target object generates a second EEG signal; when the EEG acquisition module detects the second EEG signal, it determines a control instruction according to the control intention, and sends the control instruction to the action execution module, so that the action execution module controls the controlled target to perform an action according to the control instruction.

[0014] To achieve the above-mentioned purpose, the third aspect of the present application proposes an electronic device, which includes a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, it implements the control method of the brain-computer-based mechanical system as described in the second aspect.

[0015] To achieve the above-mentioned purpose, the fourth aspect of the present application proposes a storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the control method of the brain-computer-based mechanical system as described in the second aspect.

[0016] According to the solution provided in the embodiment of the present application, by setting a first EEG trigger module on the controlled target, when the target object intends to control the controlled target, the target object will receive the stimulation caused by the first EEG trigger module, so that the brain of the target object generates a first EEG signal corresponding to the stimulation generated by the first EEG trigger module. Therefore, by analyzing the first EEG signal by the control module, the control intention of the target object can be determined; in addition, by setting a second EEG trigger module, the second EEG trigger module is also set on the controlled target. When the target object intends to control the controlled target, the target object will also receive the stimulation caused by the second EEG trigger module, and the brain of the target object will also generate a second EEG signal corresponding to the stimulation generated by the second EEG trigger module. The control module analyzes the second EEG signal and sends the control instruction corresponding to the control intention to the action execution module, which can avoid the situation where the target object does not receive the stimulation of the first brain trigger module and generates the first EEG signal due to coincidence, causing the action execution module to be falsely triggered, thereby improving the accuracy of the control module in judging the control intention of the target object through EEG signals.

[0017] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are used to provide further understanding of the technical solution of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application and do not constitute a limitation on the technical solution of the present application.

[0019] Figure 1 An optional system block diagram of a brain-computer-based mechanical system provided in an embodiment of the present application;

[0020] Figure 2 An optional structural diagram of a brain-computer-based mechanical system provided in an embodiment of the present application;

[0021] Figure 3 An optional system block diagram of an action execution module provided in an embodiment of the present application;

[0022] Figure 4 An optional flow chart of a control method for a mechanical system provided in an embodiment of the present application;

[0023] Figure 5 An optional flowchart of a control method for an action execution module provided in an embodiment of the present application;

[0024] Figure 6 A schematic diagram of an optional flow chart of a method for calculating a mechanoelectric coefficient provided in an embodiment of the present application;

[0025] Figure 7 A schematic diagram of an optional hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] This section will describe in detail the specific embodiments of the present application. The preferred embodiments of the present application are shown in the accompanying drawings. The purpose of the accompanying drawings is to supplement the description of the text part of the specification with graphics, so that people can intuitively and vividly understand each technical feature and the overall technical solution of the present application, but it cannot be understood as a limitation on the scope of protection of the present application.

[0027] In the description of the present application, it should be understood that descriptions involving orientation, such as up, down, front, back, left, right, etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0028] In the description of this application, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed", etc. are understood to exclude the number itself, and "above", "below", "within", etc. are understood to include the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0029] In the description of this application, unless otherwise clearly defined, terms such as setting, installation, and electrical connection should be understood in a broad sense, and technicians in the relevant technical field can reasonably determine the specific meanings of the above terms in this application based on the specific content of the technical solution.

[0030] To facilitate understanding of the technical solutions provided in the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:

[0031] Event Related Potential (ERP) is a measurement of the brain's psychological response to specific sensory, cognitive or motor events from the external environment. The P300 potential is a special electroencephalogram component and a type of event-related potential (ERP). P300 is a positive peak, usually appearing as an upward deflection in the electroencephalogram recording. The latency of the P300 potential is about 300 milliseconds, and it usually appears about 300 milliseconds after the stimulus occurs. The P300 potential is related to cognitive functions such as attention, working memory, decision-making and stimulus evaluation. It is an important indicator in cognitive neuroscience research and is widely used to study how the brain processes and responds to external stimuli.

[0032] Steady-State Visual Evoked Potentials (SSVEP) is a continuous potential response of the brain to continuous or repeated visual stimulation. When vision is stimulated by a specific frequency, such as light flickering or graphic changes, the visual cortex of the brain will produce potential changes related to the stimulation frequency. These changes have a periodic rhythm and can be used to identify the target of visual gaze or the subject's intention.

[0033] At present, when obtaining human EEG signals through brain-computer devices for identification, it is often difficult for people to receive specific stimulation from the brain-computer for a long time. If external things attract people's attention and cause their brains to produce unexpected EEG signals, the brain-computer will misjudge people's behavioral intentions. In addition, the motion planning of mechanical equipment is mostly based on traditional binary control methods to complete predetermined operations, which is difficult to meet the actual needs of specific environments and specific groups of people.

[0034] In response to the problem that behavioral intentions are prone to misjudgment, the present application provides a brain-computer-based mechanical system and a control method thereof, the mechanical system comprising: an action execution module, which is arranged on a controlled target; a first EEG trigger module, which is arranged on the controlled target, the first EEG trigger module is used to stimulate the target object so that the brain of the target object produces a first EEG signal; a second EEG trigger module, which is arranged on the controlled target, the second EEG trigger module is used to stimulate the target object so that the brain of the target object produces a second EEG signal; an EEG acquisition module is used to acquire the first EEG signal and the second EEG signal; a control module, the EEG acquisition module, the first EEG trigger module, the second EEG trigger module and the action execution module are respectively communicated with the control module; wherein the control module is used to determine the control intention of the target object according to the first EEG signal; when the EEG trigger module acquires the second EEG signal and the control intention is determined, the control module determines the control instruction according to the control intention, and sends the control instruction to the action execution module, so that the action execution module controls the controlled target to perform an action according to the control instruction. According to the solution provided in the embodiment of the present application, by setting a first EEG trigger module on the controlled target, when the target object intends to control the controlled target, the target object will receive the stimulation caused by the first EEG trigger module, so that the brain of the target object generates a first EEG signal corresponding to the stimulation generated by the first EEG trigger module. Therefore, by analyzing the first EEG signal by the control module, the control intention of the target object can be determined; in addition, by setting a second EEG trigger module, the second EEG trigger module is also set on the controlled target. When the target object intends to control the controlled target, the target object will also receive the stimulation caused by the second EEG trigger module, and the brain of the target object will also generate a second EEG signal corresponding to the stimulation generated by the second EEG trigger module. The control module analyzes the second EEG signal and sends the control instruction corresponding to the control intention to the action execution module, which can avoid the situation where the target object does not receive the stimulation of the first brain trigger module and generates the first EEG signal due to coincidence, causing the action execution module to be falsely triggered, thereby improving the accuracy of the control module in judging the control intention of the target object through EEG signals.

[0035] The brain-computer-based mechanical system and control method thereof provided in the embodiments of the present application are specifically illustrated through the following embodiments. First, the brain-computer-based mechanical system in the embodiments of the present application is described.

[0036] The embodiments of the present application are further described below in conjunction with the accompanying drawings.

[0037] Reference Figure 1 to Figure 2 , this application proposes a brain-machine based mechanical system, including:

[0038] An action execution module 100 is provided on a controlled object;

[0039] A first EEG triggering module 200 is provided on the controlled target, and is used to stimulate the target object so that the brain of the target object generates a first EEG signal;

[0040] A second EEG triggering module 300 is provided on the controlled target, and is used to stimulate the target object so that the brain of the target object generates a second EEG signal;

[0041] An EEG acquisition module 400 is used to acquire a first EEG signal and a second EEG signal;

[0042] The control module 500, the EEG acquisition module 400, the first EEG trigger module 200, the second EEG trigger module 300 and the action execution module 100 are respectively connected to the control module 500 in communication;

[0043] Among them, the control module 500 is used to determine the control intention of the target object based on the first EEG signal; when the EEG trigger module collects the second EEG signal and the control intention is determined, the control module 500 determines the control instruction according to the control intention, and sends the control instruction to the action execution module 100, so that the action execution module 100 controls the controlled target to perform action according to the control instruction.

[0044] It is understandable that the target object can be a human or an experimental animal, and there is no limitation here. When the target object is a human, the controlled target can be the human's hand, leg, wheelchair, computer or other mechanical and electronic equipment.

[0045] In a specific embodiment, the EEG acquisition module 400 includes an electrode cap and a signal amplifier. The target object wears an electrode cap on the brain, and a plurality of brain electrodes are arranged on the electrode cap. The brain electrodes are respectively pasted on the occipital lobe area (O1, O2, Oz) and the parietal lobe area (Pz) of the brain. The electrode cap is electrically connected to the signal amplifier, and the signal amplifier is connected to the control module 500. The signal amplifier is used to amplify the EEG signals collected by the electrodes, thereby facilitating the analysis and proofreading of the EEG signals.

[0046] It can be understood that by setting the first EEG trigger module 200 on the controlled target, when the target object intends to control the controlled target, the target object will receive the stimulation caused by the first EEG trigger module 200, so that the brain of the target object generates a first EEG signal corresponding to the stimulation generated by the first EEG trigger module 200. Therefore, by analyzing the first EEG signal through the control module 500, the control intention of the target object can be determined; in addition, by setting the second EEG trigger module 300, the second EEG trigger module 300 is also set on the controlled target. When the target object intends to control the controlled target, When the target object receives the stimulation from the second EEG trigger module 300, the target object's brain will also generate a second EEG signal corresponding to the stimulation generated by the second EEG trigger module 300. The control module 500 analyzes the second EEG signal and sends the control instruction corresponding to the control intention to the action execution module 100. This can avoid the situation where the target object does not receive the stimulation from the first brain trigger module and generates the first EEG signal due to coincidence, causing the action execution module 100 to be falsely triggered, thereby improving the accuracy of the control module 500 in judging the control intention of the target object through EEG signals.

[0047] In a specific embodiment, the control module 500 first controls the first EEG trigger module 200 to stimulate the target object. Here, the first EEG trigger module 200 can be one or more combinations of visual stimulation devices, auditory stimulation devices or tactile stimulation devices; then, the brain of the target object generates a first EEG signal. After the EEG acquisition module 400 acquires the first EEG signal, the control module 500 determines the control intention of the target object according to the first EEG signal, and at the same time controls the second EEG trigger module 300 to stimulate the target object. The second EEG trigger module 300 can be one or more combinations of visual stimulation devices, auditory stimulation devices or tactile stimulation devices; then, the brain of the target object generates a second EEG signal. When the EEG acquisition module 400 acquires the second EEG signal, the control module 500 determines the control instruction according to the control intention, and sends the control instruction to the action execution module 100, so that the action perception module acts on the controlled target.

[0048] In addition, refer to Figure 2 In some embodiments of the present application, the first EEG trigger module 200 includes a first visual stroboscope 201, which strobes at a preset first flickering frequency to cause the target object's brain to generate a first EEG signal equal to the first flickering frequency.

[0049] In a specific embodiment, the first EEG trigger module 200 includes a plurality of first visual stroboscopes 201, which are specifically LED lights. The first visual stroboscopes 201 are respectively arranged at different positions of the controlled target, and the first flickering frequencies of the first visual stroboscopes 201 are different. When the eyes of the target object look at one of the first visual stroboscopes 201, the brain of the target object correspondingly generates a steady-state visual evoked potential equal to the first flickering frequency of the first visual stroboscope 201. The control module 500 analyzes the first EEG signal. When the frequency of the first EEG signal satisfies:

[0050]

[0051] Determine the sight line of the target object and the position where the target object intends to perform an action, and the control module 500 generates a corresponding control instruction to control the corresponding part in the action execution module 100 to perform an action;

[0052] Among them, f i Indicates the first flashing frequency, P indicates f i The corresponding brain energy power, n represents the number of the first visual stroboscopes 201, and Th is the preset EEG energy threshold.

[0053] In a specific embodiment, the first EEG trigger module 200 includes six first visual stroboscopes 201, each of which strobes at a different first flashing frequency. The controlled target is the hand of the target object. The first visual stroboscopes 201 are respectively arranged on the back of the hand and five fingers. The action execution module 100 is a manipulator installed on the hand. When the manipulator receives a control instruction, it controls the corresponding limb to bend or straighten.

[0054] Exemplarily, assuming that the first flashing frequencies of the first visual stroboscope 201 are 10 Hz, 10.2 Hz, 10.4 Hz, 10.6 Hz, 10.8 Hz and 11 Hz respectively, assuming that the first flashing frequency of the first visual stroboscope 201 on the thumb is 10 Hz, and the first flashing frequency of the first visual stroboscope 201 on the back of the hand is 11 Hz, when the target object's eyes look at the first visual stroboscope 201 on the thumb, the target object's brain generates a first electroencephalogram signal with a frequency of 10 Hz, and the control module 500 analyzes the first electroencephalogram signal to control the mechanical part on the thumb to bend and straighten back and forth, when the target object's sight moves away, the first electroencephalogram signal disappears, and the control module 500 controls the mechanical part on the thumb to maintain the current posture; or, when the target object's eyes look at the first visual stroboscope 201 on the back of the hand, the target object's brain generates a first electroencephalogram signal with a frequency of 11 Hz, so that the control module 500 drives the entire manipulator to control the target object's hand to clench and release a fist.

[0055] In the related art, the amplitude of the steady-state visual evoked potential induced by visual stimulation with white light is the highest, the amplitude of the steady-state visual evoked potential induced by visual stimulation with purple light and yellow light as the visual stimulation module is second only to white light, and the amplitude of the steady-state visual evoked potential induced by red light, green light and blue light is the lowest. It can be understood that the photosensitive pigments in the cone cells play a decisive role in the photosensitivity process of the human eye to color, and the cone pigments are most sensitive to blue, green and red, and white light is composed of three colors, namely red, green and blue. Therefore, white light can excite these three different cone cells at the same time. The amplitude of the steady-state visual evoked potential generated by stimulation with white light is the largest. Yellow is composed of red and green, and purple light is composed of red and blue. These two colors can excite two different cone cells at the same time. Therefore, compared with other monochromatic lights, the amplitude of the steady-state visual evoked potential caused by yellow light and purple light is larger. It can be seen that using white light as a visual stimulation module for visual stimulation can obtain a larger amplitude steady-state visual stimulation potential signal than other colors, thereby improving the recognition accuracy of the control module 500. Therefore, the first visual stroboscope 201 in this application will use white light for stroboscopic.

[0056] In addition, refer to Figure 2 In some embodiments of the present application, the second EEG trigger module 300 includes a second visual stroboscope 301, which lights up and turns off alternately at a preset second flashing frequency, and the off duration of the second visual stroboscope 301 is within a preset off duration interval.

[0057] In a specific embodiment, the second EEG trigger module 300 includes multiple second visual stroboscopes 301, which are specifically LED lights. The second visual stroboscopes 301 are set at different positions of the controlled target. After the control module 500 recognizes the first EEG signal, the second visual stroboscopes 301 are controlled to light up and turn off alternately at a second flashing frequency. The second flashing frequency is within the off-time interval, and the off-time interval is [300ms, 1000ms]. At this time, if the target object's eyes are still looking at the corresponding part of the controlled target, the second visual stroboscope 301 will cause the target object's brain to generate a P300 potential. When the control module 500 detects the P300 potential, the control instruction is sent to the action execution module 100.

[0058] In a specific embodiment, the second visual stroboscope 301 is respectively arranged on the back of the hand and the five fingers, and the second visual stroboscope 301 is installed adjacent to the first visual stroboscope 201. For example, assuming that the first visual stroboscope 201 on the thumb is 10 Hz, when the control module 500 detects the first electroencephalogram signal with a frequency of 10 Hz, the second visual stroboscope 301 adjacent to the first visual stroboscope 201 is controlled to light up and go out alternately. When the target object's eyes see the second visual stroboscope 301 light up 300ms later, the target object's brain will generate a P300 potential. When the control module 500 detects the P300 potential, the control instruction is sent to the action instruction module, thereby controlling the thumb to bend and straighten.

[0059] It can be understood that by setting up the second visual stroboscope 301, when the control module 500 detects the first EEG signal, the corresponding second visual stroboscope 301 is controlled to light up, stimulating the target object's brain to produce the second EEG signal, which can avoid the control module 500 from misjudging the EEG signal collected by the EEG acquisition module 400. When the control module 500 detects the second EEG signal 300ms after controlling the second visual stroboscope 301 to light up, it can be determined that the first EEG signal and its corresponding control intention are valid, thereby improving the accuracy of the control module 500 in judging the EEG signal.

[0060] In addition, in some embodiments of the present application, after the EEG acquisition module 400 detects the first EEG signal, the second EEG triggering module 300 is controlled to stimulate the target object.

[0061] It is understandable that both the first EEG trigger module 200 and the second EEG trigger module 300 will stimulate the target object, thereby causing the target object's brain to generate the first EEG signal and the second EEG signal respectively. However, when the first EEG trigger module 200 and the second EEG trigger module 300 are the same type of stimulation, for example, when the first EEG trigger module 200 and the second EEG trigger module 300 are both visual stimulations, or both are auditory stimulations, the simultaneous generation of the first EEG signal and the second EEG signal will affect the control module 500's judgment of the target object's control intention; therefore, the control module 500 can improve the accuracy of the control module 500's judgment of the target object's control intention by controlling the second EEG module to stimulate the target object after detecting the first EEG signal.

[0062] In addition, refer to Figure 2 and Figure 3In some embodiments of the present application, the action execution module 100 includes a driver chip 110 and a driver chip 110, the driver chip 110 is electrically connected to the driver chip 110, the driver chip 110 is communicatively connected to the control module 500, and the driver chip 110 is used to control the action state of the driver chip 110 according to the control instruction.

[0063] In a specific embodiment, within a sampling frame of the EEG signal, when the control module 500 detects the first EEG signal and the second EEG signal within the current sampling frame, the driver chip 110 will control the driver chip 110 to act according to the control instruction; when the control module 500 does not detect the first EEG signal and the second EEG signal, the driver chip 110 controls the driver chip 110 to maintain the current posture.

[0064] In addition, in some embodiments of the present application, the action execution module 100 also includes a potential sensor 130, which is communicatively connected to the control module 500, and the potential sensor 130 is used to obtain the potential state of the controlled target, and the action chip is used to adjust the action state of the driving chip 110 according to the potential state.

[0065] Furthermore, in some embodiments of the present application, the action execution module 100 also includes a pressure sensor 140, which is communicatively connected to the control module 500. The pressure sensor 140 is used to obtain the pressure state between the action execution module 100 and the controlled target, and the action chip is used to adjust the action state of the driving chip 110 according to the pressure state.

[0066] In a specific embodiment, when the target object is a person, the controlled target is the hand of the target object. On one hand of the target object, the action execution module 100 includes a reference electrode 131 and at least one action electrode 132. The reference electrode 131 is pasted on the arm or the reference ground, and the action electrode 132 is pasted on the outside of the muscle responsible for movement of the hand. The reference electrode 131 is used to obtain the reference potential on the arm of the target object, and the action electrode 132 is used to obtain the action potential generated by the hand during the movement. The driving chip 110 filters the action potential through the continuously obtained reference potential, thereby obtaining the actual potential generated by the hand during the movement.

[0067] The pressure sensor 140 is specifically a thin film sensor. The pressure sensor 140 is disposed between the active end of the driving chip 110 and the hand muscle. The pressure sensor 140 is used to obtain the pressure state between the driving chip 110 and the hand during the hand movement.

[0068] Specifically, before the control starts, the target object controls the hand to be in the most tense state, and the potential sensor 130 collects the potential of the hand muscles through each action electrode 132 to obtain the active action potential of the hand muscles in the tense state, and determines the active average potential of the hand through each active actual potential:

[0069]

[0070] in, Represents the active average potential of the hand muscles in a tense state, E i ' represents the active action potential of the hand muscle in a tense state, and n is the number of action electrodes 132;

[0071] At the same time, the active reference potential on the arm is collected through the reference electrode 131, and the active average potential is filtered according to the active reference potential to eliminate the potential noise in the active action potential to obtain the active actual potential, which is specifically:

[0072]

[0073] Among them, ΔE′ represents the active actual potential of the hand muscles in a tense state, and E0′ represents the active reference potential of the hand muscles in a tense state;

[0074] Then, the active pressure between the active end of the driving chip 110 and the hand when the hand muscles are tense is obtained through the pressure sensor 140, and the force-electric coefficient between the active pressure and the active actual potential is determined:

[0075] k=F' / AE'

[0076] Then, in a control frame of the action execution module 100, the control action potentials on the muscles of each part of the hand are obtained to determine the control average potential of the hand:

[0077]

[0078] in, represents the controlled average potential, E i represents the control action potential;

[0079] Then, the control reference potential on the arm is obtained through the action electrode 132, and the control average potential is filtered according to the control reference potential to obtain the control actual potential in the current control frame:

[0080]

[0081] Then, the control pressure between the active end of the driving chip 110 and the hand in the current control frame is obtained through the pressure sensor 140, and the control error of the action execution module 100 in the current control frame is determined by controlling the actual potential, the force-electric coefficient and the control pressure:

[0082] AS t =Fk·ΔE

[0083] Then, the driving force increment of the driving chip 110 is determined according to the control error, and the action state of the action execution module 100 is adjusted according to the driving force increment. The calculation formula of the driving force increment is:

[0084] FD=P·ΔSt+I·(ΔS+ASt-1)+D·(ΔSt-AS-1)

[0085] Where FD represents the driving force increment in the current control frame, ΔS t-1 It represents the control error of the previous control frame, and P, I, and D are the preset control coefficients.

[0086] In addition, refer to Figure 4 The present application also proposes a control method for a brain-computer-based mechanical system, which is applied to the brain-computer-based mechanical system. The brain-computer-based mechanical system includes an action execution module, a first EEG trigger module, a second EEG trigger module, an EEG acquisition module and a control module. The control method includes but is not limited to the following steps:

[0087] Step S410, the first EEG triggering module stimulates the target object so that the brain of the target object generates a first EEG signal;

[0088] Step S420, when the EEG acquisition module detects the first EEG signal, the control module determines the control intention of the target object according to the first EEG signal, and controls the second EEG triggering module to stimulate the target object;

[0089] Step S430, when the EEG acquisition module detects the second EEG signal, a control instruction is determined according to the control intention, and the control instruction is sent to the action execution module.

[0090] It can be understood that since the control method of the brain-computer-based mechanical system in this embodiment is applied to the brain-computer-based mechanical system mentioned in the above-mentioned specific embodiments, the control method of the brain-computer-based mechanical system in this embodiment has the beneficial effects brought by the brain-computer-based mechanical system mentioned in the above-mentioned specific embodiments.

[0091] In addition, the action execution module includes a driver chip, a torque motor, a potentiometer sensor and a pressure sensor. Figure 5 , the above control method further includes:

[0092] Step S510, obtaining the force-electric coefficient, obtaining the actual control potential of the controlled target through the potential sensor in the current control frame, obtaining the control pressure between the active end of the torque motor and the controlled target through the pressure sensor, and determining the control error according to the actual control potential and the control pressure;

[0093] Step S520, obtaining a control coefficient, and determining a driving force increment of the torque motor according to the control coefficient and a control error.

[0094] Specifically, the calculation formula of the driving force increment is:

[0095]

[0096] in, Indicates the driving force increment of the current control frame, Indicates the control error in the current control frame, Indicates the control error of the previous control frame.

[0097] In addition, refer to Figure 6 As shown, Figure 5 Step S510 in the embodiment specifically includes:

[0098] Step S610, obtaining the active actual potential of the controlled target when actively performing an action through a potential sensor, and obtaining the active pressure of the controlled target when actively performing an action through a pressure sensor;

[0099] Step S620, determining the electromechanical coefficient according to the active actual potential and the active pressure;

[0100] Step S630, in the current control frame, the actual control potential of the controlled target is obtained through the potential sensor, the control pressure between the active end of the torque motor and the controlled target is obtained through the pressure sensor, and the control error is determined according to the actual control potential and the control pressure.

[0101] Specifically, the calculation formula of the electromechanical coefficient is:

[0102]

[0103] in, Indicates active pressure, represents the active actual potential, and k represents the electromechanical coefficient.

[0104] In addition, refer to Figure 7 , Figure 7 : is an optional hardware structure diagram of an electronic device provided in an embodiment of the present application, the electronic device includes:

[0105] The processor 701 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0106] The memory 702 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 702 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 702, and the processor 701 calls and executes the control method of the brain-computer-based mechanical system in the embodiment of the present application, for example, to execute the above-described Figure 4 Steps S410 to S430 of the method, Figure 5 Steps S510 to S520 of the method, Figure 6 Steps S610 to S620 of the method;

[0107] Input / output interface 703, used to implement information input and output;

[0108] Communication interface 704, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.);

[0109] A bus 705 that transmits information between the various components of the device (e.g., the processor 701, the memory 702, the input / output interface 703, and the communication interface 704);

[0110] The processor 701 , the memory 702 , the input / output interface 703 and the communication interface 704 are connected to each other in communication within the device via a bus 705 .

[0111] The embodiment of the present application also provides a storage medium, which is a computer-readable storage medium for computer-readable storage, and the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the above-mentioned brain-computer-based mechanical system control method, for example, to execute the above-described Figure 4 Steps S410 to S430 of the method, Figure 5 Steps S510 to S520 of the method, Figure 6 Method steps S610 to S620.

[0112] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0113] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0114] It can be understood by those skilled in the art that Figures 1 to 7 The technical solutions shown in the figure do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than those shown in the figure, or a combination of certain steps, or different steps.

[0115] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0117] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0118] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0119] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0120] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0121] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0122] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0123] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A brain-computer-based mechanical system, characterized in that: include: An action execution module is set on the controlled target; A first EEG trigger module is provided on the controlled target, and the first EEG trigger module is used to stimulate the target object so that the brain of the target object generates a first EEG signal; A second EEG triggering module is provided on the controlled target, and the second EEG triggering module is used to stimulate the target object so that the brain of the target object generates a second EEG signal; An EEG acquisition module, used for acquiring the first EEG signal and the second EEG signal; A control module, the EEG acquisition module, the first EEG trigger module, the second EEG trigger module and the action execution module are respectively connected to the control module in communication; Wherein, the control module is used to determine the control intention of the target object according to the first EEG signal; When the EEG trigger module collects the second EEG signal and the control intention is determined, the control module determines the control instruction according to the control intention, and sends the control instruction to the action execution module, so that the action execution module controls the controlled target to perform action according to the control instruction.

2. The mechanical system according to claim 1, characterized in that: The first EEG trigger module includes a first visual stroboscope, which strobes at a preset first flickering frequency to cause the brain of the target object to generate a first EEG signal equal to the first flickering frequency.

3. The mechanical system according to claim 1, characterized in that: The second EEG trigger module includes a second visual stroboscope, which lights up and turns off alternately at a preset second flashing frequency, and the off-duration duration of the second visual stroboscope is within a preset off-duration interval.

4. The mechanical system according to any one of claims 1 to 3, characterized in that: When the EEG acquisition module detects the first EEG signal, the second EEG trigger module is controlled to stimulate the target object to avoid EEG signal interference.

5. The mechanical system according to claim 1, characterized in that: The action execution module includes a torque motor and a drive chip, the torque motor is electrically connected to the drive chip, the drive chip is communicatively connected to the control module, and the drive chip is used to control the action state of the torque motor according to the control instruction.

6. The mechanical system according to claim 5, characterized in that The action execution module includes a pressure sensor, which is communicatively connected to the control module. The pressure sensor is used to obtain the pressure state between the action execution module and the controlled target. The action chip is used to adjust the action state of the torque motor according to the pressure state.

7. The mechanical system according to claim 5 or 6, characterized in that: The action execution module includes a potential sensor, which is communicatively connected to the control module. The potential sensor is used to obtain the potential state of the controlled target, and the action chip is used to adjust the action state of the torque motor according to the potential state.

8. A method for controlling a mechanical system based on brain-computer interaction, characterized in that: Applied to the brain-computer based mechanical system as claimed in any one of claims 1 to 7, the brain-computer based mechanical system comprises an action execution module, a first EEG trigger module, a second EEG trigger module, an EEG acquisition module and a control module, and the control method comprises: The first EEG triggering module stimulates the target object so that the brain of the target object generates a first EEG signal; When the EEG acquisition module detects a first EEG signal, the control module determines the control intention of the target object according to the first EEG signal, and controls the second EEG triggering module to stimulate the target object so that the brain of the target object generates a second EEG signal; When the EEG acquisition module detects the second EEG signal, it determines a control instruction according to the control intention, and sends the control instruction to the action execution module, so that the action execution module controls the controlled target to perform an action according to the control instruction.

9. An electronic device, characterized in that: The electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the control method of the brain-computer-based mechanical system as claimed in claim 8 when executing the computer program.

10. A storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the control method of the brain-computer-based mechanical system as claimed in claim 8 is implemented.