A multi-channel control method and system for picture selection using electroencephalogram signals
Through the multi-channel control method of selecting pictures by EEG signals, multi-channel control is achieved using the focus index, which solves the complex and unstable problems of multi-channel control in the prior art, and improves the interaction efficiency and autonomous interaction capabilities between users and devices.
Patent Information
- Application Number
- CN202410589373.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-13
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-05-13
AI Technical Summary
When existing brain-computer interface technology requires multi-channel control, the process is complex and the effect is unstable, making it difficult to achieve fast and efficient interaction and control.
Multi-channel control method for image selection using EEG signals, set the image parameters to be controlled, play the picture in a loop, collect user brain waves, generate multi-byte data, extract focus index, and select the action to be controlled based on the focus index The picture executes corresponding instructions to realize multi-channel control.
The operation process is simplified, and users can seamlessly interact with various electronic devices by adjusting their concentration, achieving easy control of smart homes and medical devices, and improving the possibility of users' independent interaction.
Smart Images

Figure CN118535013B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a multi-channel control method and system for selecting pictures by using electroencephalogram signals, belonging to the technical field of electroencephalogram signal control. Background Art
[0002] In the modern medical field, the need for real-time monitoring and effective control of medical equipment is particularly important, especially for patients in intensive care units, paralyzed patients, and individuals who require long-term care. The rapid development of brain-computer interface (BCI) technology has provided a new way to meet these needs. BCI systems convert the user's intentions into specific control commands by decoding electroencephalogram (EEG) signals. However, these systems still face many challenges in practical applications, such as the accuracy of signal acquisition, processing speed, and the intuitiveness of user interaction.
[0003] Current methods usually involve using a head-mounted multi-electrode device to collect signals, then perform signal extraction and waveform analysis, and use big data training to match the signals with specific actions to achieve precise control of medical devices. However, this method is complex and unstable when facing multi-channel control requirements, making it difficult to achieve fast and efficient interaction and control. Summary of the invention
[0004] A brief overview of the present invention is provided below in order to provide a basic understanding of certain aspects of the present invention. It should be understood that this overview is not an exhaustive overview of the present invention. It is not intended to identify key or important parts of the present invention, nor is it intended to limit the scope of the present invention. Its purpose is merely to present certain concepts in a simplified form as a prelude to a more detailed description discussed later.
[0005] In view of this, in order to solve the technical problem that when there is a multi-channel control demand in the prior art, the process is complicated and the effect is unstable, the present invention provides a multi-channel control method and system for selecting pictures using EEG signals. The present invention can be applied to the control of smart homes and medical equipment.
[0006] Solution 1: A multi-channel control method for image selection using EEG signals, comprising the following steps:
[0007] Step 1: Set the parameters of the action picture to be controlled;
[0008] Step 2: loop the action picture to be controlled, collect the user's brain waves, and generate multi-byte data;
[0009] Step 3: Extracting the concentration index based on multi-byte data;
[0010] Step 4: Select the action picture to be controlled based on the concentration index, and execute the corresponding instruction of the action picture to be controlled.
[0011] Preferably, the parameter settings of the pictures of the actions to be controlled include control mode settings and carousel parameter settings of the pictures of the actions to be controlled; the control mode settings include single-channel and multi-channel control modes; the carousel parameter settings of the pictures of the actions to be controlled include concentration threshold, the number of consecutive times the concentration threshold is reached, the carousel time of the pictures of the actions to be controlled, and the waiting time between the pictures of the actions to be controlled.
[0012] Preferably, the single-channel control mode is: the user selects a picture of the action to be controlled and displays it on the UI interface; the multi-channel control mode is: the user selects no less than one picture of the action to be controlled, sets it on the UI interface and displays it.
[0013] Preferably, the settings on the UI interface include setting the selected action picture to be controlled, the corresponding parameters of the action picture to be controlled, and the verification parameters;
[0014] Set the selected action pictures to be controlled to: set the action pictures to be controlled that need to be rotated when starting for the first time;
[0015] The parameters corresponding to the action picture to be controlled are: the name of the action picture to be controlled, the execution time, the execution instruction and the language played during execution;
[0016] The verification parameters are set as follows: before the user submits the data, ensure the integrity of each action data, that is, all parameters have been set and conform to the default parameter format. After passing the verification, the user obtains the system's storage permission for persistent storage of data.
[0017] Preferably, the user's brain waves include low-frequency alpha waves, low-frequency beta waves, high-frequency alpha waves, high-frequency beta waves and theta waves.
[0018] Preferably, the method for extracting the concentration index based on multi-byte data is: the multi-byte data is converted into a decimal format and calculated by the following formula:
[0019] A=x max -x min
[0020] Among them, A represents the amplitude value, x max Indicates the maximum value of the signal, x min Indicates the minimum value of the signal;
[0021]
[0022] Among them, X RMS represents the signal RMS, X i Indicates the signal amplitude;
[0023]
[0024] Where K represents the kurtosis factor of the signal waveform;
[0025]
[0026] Where S represents the slope factor of the signal waveform, represents the mean value of the signal, and σ represents the standard deviation of the signal;
[0027]
[0028] Among them, F represents the concentration index, A θ , A β1 , A β2 , A α1 , A α2 They represent theta wave amplitude, low-frequency beta wave amplitude, high-frequency beta wave amplitude, low-frequency alpha wave amplitude, and high-frequency alpha wave amplitude, respectively. β1 , S β2 , S α1 , S α2 They represent the low-frequency β wave slope factor, high-frequency β wave slope factor, low-frequency α wave slope factor, and high-frequency α wave slope factor, respectively. K β1 , K β2 , K α1 , K α2 They represent the low-frequency β wave kurtosis factor, the high-frequency β wave kurtosis factor, the low-frequency α wave kurtosis factor, and the high-frequency α wave kurtosis factor, respectively.
[0029] Preferably, the method of selecting the action picture to be controlled based on the concentration index and executing the corresponding instruction of the action picture to be controlled is: judging whether the concentration index meets the concentration threshold, if so, adding 1 to the number of times the concentration threshold is reached, if not, returning the number of times the concentration threshold is reached to zero, judging whether the number of times the concentration threshold is reached reaches the set number of times the concentration threshold is reached continuously, if so, executing the corresponding instruction of the action picture to be controlled, if not, returning to step three.
[0030] Solution 2: A multi-channel control system for selecting pictures using EEG signals, including a picture selection and parameter setting module, a picture carousel and parameter setting module, a control instruction issuing and communication module, and an EEG signal acquisition and communication module;
[0031] The picture carousel and parameter setting module is respectively connected to the picture selection and parameter setting module, the control instruction issuing and communication module and the EEG signal acquisition and communication module;
[0032] The picture selection and parameter setting module includes a picture selection module and a parameter setting module; the picture selection module is connected to the parameter setting module;
[0033] The picture carousel and parameter setting module includes a picture carousel module and a carousel parameter setting module; the picture carousel module and the carousel parameter setting module are connected;
[0034] The EEG signal acquisition and communication module includes a signal acquisition module and a device communication module; the signal acquisition module is connected to the device communication module;
[0035] The control instruction issuing and communication module includes a control instruction issuing module and a controller communication module; the control instruction issuing module is connected to the controller communication module;
[0036] The parameter setting module, the device communication module, and the control instruction issuing module are respectively connected to the picture carousel module parameter setting module.
[0037] Solution three, an electronic device, including a memory and a processor, the memory storing a computer program, and the processor implementing the steps of a multi-channel control method for selecting pictures using electroencephalogram signals as described in Solution one when executing the computer program.
[0038] Solution 4: A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the multi-channel control method for selecting images using electroencephalogram signals as described in Solution 1.
[0039] The beneficial effects of the present invention are as follows: The present invention realizes multi-channel control, and rotates a variety of different action pictures to be controlled. Users only need to adjust their concentration to seamlessly interact with various electronic devices, from smart home systems to complex medical equipment. It can be easily controlled. Not only does it simplify the operation process, but it also opens up new possibilities for individuals with limited mobility or special needs, allowing them to interact with the world around them more autonomously. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:
[0041] Figure 1 It is a flow chart of a multi-channel control method for picture selection using EEG signals;
[0042] Figure 2 A schematic diagram of a flow chart of selecting an action picture to be controlled based on the concentration index and executing instructions corresponding to the action picture to be controlled;
[0043] Figure 3This is a structural diagram of a multi-channel control system that uses EEG signals to select pictures. DETAILED DESCRIPTION
[0044] In order to make the technical solutions and advantages of the embodiments of the present invention more clearly understood, the exemplary embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than an exhaustive list of all the embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.
[0045] Example 1: Reference Figure 1-Figure 2 To illustrate this embodiment, a multi-channel control method for selecting pictures using EEG signals includes the following steps:
[0046] Step 1: Set the parameters of the action picture to be controlled. The method is:
[0047] Control mode settings include single-channel and multi-channel control modes; in single-channel control mode, the user selects a picture of the action to be controlled and displays it on the UI interface;
[0048] In multi-channel control mode, the user selects at least one picture of the action to be controlled, and displays it after setting it on the UI interface;
[0049] Setting on the UI interface: including setting the selected action picture to be controlled and the corresponding parameters of the action picture to be controlled;
[0050] Set the selected action pictures to be controlled: set the action pictures to be controlled that need to be rotated when starting for the first time; it is set for people who need to be mobile.
[0051] Parameters corresponding to the action picture to be controlled: name of the action picture to be controlled, execution time, execution instruction and language played during execution;
[0052] The verification parameters are set as follows: before the user submits the data, ensure the integrity of each action data, that is, all parameters have been set and conform to the default parameter format. After passing the verification, the user obtains the system's storage permission for persistent storage of data.
[0053] The name of the action picture to be controlled represents the name of the action associated with the action picture to be controlled;
[0054] Execution time refers to the time required for the controller to perform the action;
[0055] Execution instructions are those required to achieve control;
[0056] The language played during execution is the prompt voice played when the action is executed.
[0057] Parameter settings for the carousel of the action pictures to be controlled, including the concentration threshold, the number of consecutive times the concentration threshold is reached, the carousel time of the action pictures to be controlled, and the waiting time between the action pictures to be controlled;
[0058] The parameter settings of the action picture carousel to be controlled also include carousel effects;
[0059] Concentration threshold: The threshold range is 1-100 seconds; the concentration effect is best at 60 seconds, and can be changed according to individual users.
[0060] The number of times the concentration threshold is reached continuously: the number ranges from 3 to 8 times. Five times is the best number of times the concentration threshold is reached continuously. The number of times the concentration threshold is reached continuously means the number of times the concentration threshold must be reached before photos are selected. Targeted changes can be made based on individual users.
[0061] Carousel time of the action to be controlled pictures: the carousel time ranges from 10 seconds to 30 seconds, and 20 seconds is the best time for the carousel time of the action to be controlled pictures. The carousel time of the action to be controlled pictures refers to the display time of each action to be controlled picture under multi-channel control.
[0062] Waiting time between pictures of action to be controlled: the waiting time ranges from 2 to 10 seconds, and 5 seconds is the best. The waiting time between pictures of action to be controlled refers to the waiting time after each picture of action to be controlled is rotated.
[0063] Carousel effect: The switching mode of the action picture to be controlled is overlay, and the rendering mode is full screen.
[0064] The user first selects multiple GIF pictures of the action to be controlled, such as backing up; the execution time is 15 seconds, the execution command is "BACKLIFEING" and the voice played during execution is backing up.
[0065] Step 2: loop the action picture to be controlled, collect the user's brain waves, and generate multi-byte data;
[0066] The user's brain waves include low-frequency alpha waves, low-frequency beta waves, high-frequency alpha waves, high-frequency beta waves and theta waves.
[0067] Step 3: Extracting the concentration index based on multi-byte data;
[0068] Convert multi-byte data to decimal format using the following formula:
[0069] A x max -x min
[0070] Among them, A represents the amplitude value, x max Indicates the maximum value of the signal, x minIndicates the minimum value of the signal;
[0071]
[0072] Among them, X RMS represents the signal RMS, X i Indicates the signal amplitude;
[0073]
[0074] Where K represents the kurtosis factor of the signal waveform;
[0075]
[0076] Among them, S represents the slope factor of the signal waveform, M represents the mean value of the signal, and σ represents the standard deviation of the signal;
[0077]
[0078] Among them, F represents the concentration index, A θ , A β 1 , A β 2 , 5A α1 , A α2 They represent theta wave amplitude, low-frequency beta wave amplitude, high-frequency beta wave amplitude, low-frequency alpha wave amplitude, and high-frequency alpha wave amplitude, respectively. β1 , S β2 , S α1 , S α2 They represent the low-frequency β wave slope factor, high-frequency β wave slope factor, low-frequency α wave slope factor, and high-frequency α wave slope factor, respectively. K β1 , K β2 , K α1 , K α2 They represent the low-frequency β wave kurtosis factor, the high-frequency β wave kurtosis factor, the low-frequency α wave kurtosis factor, and the high-frequency α wave kurtosis factor, respectively.
[0079] Step 4: Select the action picture to be controlled based on the concentration index, and execute the corresponding instruction of the action picture to be controlled.
[0080] Determine whether the concentration index meets the concentration threshold. If so, the number of times the concentration threshold is reached is increased by 1; if not, the number of times the concentration threshold is reached is reset to zero. Determine whether the number of times the concentration threshold is reached reaches the set number of times the concentration threshold is reached continuously. If so, execute the corresponding instruction of the action picture to be controlled; if not, return to step three.
[0081] In order to increase the accuracy of confirmation, a confirmation step can be added after executing the judgment on whether the number of times the concentration threshold is reached reaches the set number of times the concentration threshold is reached continuously. The execution method of the confirmation step is consistent with the method of executing the corresponding instruction of the action picture to be controlled, that is, judging whether the concentration index meets the concentration threshold, if it meets, the number of times the concentration threshold is reached is increased by 1, if it does not meet, the number of times the concentration threshold is reached is reset to zero, judging whether the number of times the concentration threshold is reached reaches the set number of times the concentration threshold is reached continuously, if it is reached, judging whether to confirm the operation, and the method for confirming the operation is to judge whether the concentration index meets the concentration threshold, if it meets, the number of times the concentration threshold is reached is increased by 1, if it does not meet, the number of times the concentration threshold is reached is reset to zero, judging whether the number of times the concentration threshold is reached reaches the set number of times the concentration threshold is reached continuously, if it is reached, executing the corresponding instruction of the action picture to be controlled, if it does not meet, returning to step three.
[0082] Example 2: Reference Figure 3 This embodiment is described as a multi-channel control system for selecting pictures using EEG signals, including a picture selection and parameter setting module, a picture carousel and parameter setting module, a control instruction issuing and communication module, and an EEG signal acquisition and communication module;
[0083] The picture carousel and parameter setting module is respectively connected to the picture selection and parameter setting module, the control instruction issuing and communication module and the EEG signal acquisition and communication module;
[0084] The EEG signal acquisition and communication module is used to acquire and process EEG signals, and includes a signal acquisition module and a device communication module; the signal acquisition module and the device communication module are connected via Bluetooth to serial communication;
[0085] The user wears an EEG acquisition device and generates brain waves through visual stimulation, thereby acquiring EEG signals. The EEG signal is converted into 24 bytes of data at a frequency of 2 Hz per second to form a comprehensive EEG activity index. In order to optimize the connection flexibility and portability between devices and ensure long-term stable use, the communication module uses Bluetooth to serial port for data transmission; after connecting the device, the system automatically obtains communication permissions and sets the corresponding communication parameters: the baud rate is 9600, the data bit is 8, the stop bit is 1, and the check bit and serial port stream are set to None; at the end of the action picture carousel device to be controlled, the received EEG data will be converted into decimal form to extract the concentration index. Subsequently, by registering the broadcast transmitter, the concentration data is forwarded to the application, and the broadcast frequency is dynamically adjusted according to the frequency of signal acquisition, so as to achieve accurate and efficient data dissemination and processing.
[0086] The picture selection and parameter setting module is used to enable the user to select the action picture to be controlled according to the control mode, set parameters such as name, execution time, instruction and voice, and store them after verification to ensure the operation logic and system safety, including a picture selection module and a parameter setting module; the picture selection module is connected to the parameter setting module;
[0087] In the picture selection module, the operating system obtains permission to read the picture of the action to be controlled, including multiple formats of the picture of the action to be controlled, including png, jpg, gif, etc.
[0088] The parameter setting module fills in the corresponding parameters for each action picture to be controlled, including the name of the action picture to be controlled, the execution time, the execution instruction, and the language played during execution, such as backing up; the execution time is 15 seconds, the execution instruction is "BACKLIFEING", and the voice played during execution is backing up. All parameters need to be verified after filling in. If the verification is passed, the user obtains the system storage permission for persistent storage of data.
[0089] The picture carousel and parameter setting module is used to set the concentration threshold, control the carousel time and effect, and monitor and adjust in real time to ensure the accuracy and continuity of the carousel process, including a picture carousel module and a carousel parameter setting module; the picture carousel module and the carousel parameter setting module are connected via Bluetooth to serial communication;
[0090] The carousel parameter setting module is responsible for defining how to control the carousel process of the action pictures to be controlled, including setting the concentration threshold, the number of times the concentration threshold is reached continuously, the carousel time of the action pictures to be controlled, the waiting time between the action pictures to be controlled, and the carousel effect.
[0091] Set the concentration threshold to 60 (the EEG signal is considered valid only when this threshold is reached), the number of times the concentration threshold is reached continuously to 5, the carousel time of the action picture to be controlled to 20S, the waiting time between the action pictures to be controlled to 5S, and the switching mode of the action picture to be controlled to overlay and the rendering mode to full screen. The picture carousel module is the core of multi-channel control. After the carousel starts, the set action pictures and parameters to be controlled are obtained first, and used as the carousel sequence, and then the countdown is started for the carousel. The concentration index is monitored in real time by registering a broadcast receiver. When the concentration index reaches the set threshold, the count increases; if it is lower than the threshold, the count is reset. After reaching the required number of thresholds continuously, the action picture to be controlled is confirmed (the confirmation operation is the same as the selection operation. When the (set) threshold is reached five times in a row, the action picture to be controlled is confirmed), and then the relevant instructions are issued. The instruction issuance operation depends on the control instruction and communication module. When the instruction is issued, the prompt page will be displayed and the voice will be played, and the receiver will be paused at the same time. If the action picture to be controlled is not selected or confirmed, or after the instruction is executed, the system will enter the waiting interface and confirm the carousel parameter settings again. After the waiting interface ends, the system returns to the process of selecting the action picture to be controlled. This process will continue to loop until the program is exited.
[0092] The control instruction sending and communication module is used to broadcast the transmitter to associate the action picture to be controlled with the control instruction, and adopts UDP unicast and heartbeat detection to achieve stable and accurate real-time device communication, including a control instruction sending module and a controller communication module; the control instruction sending module is connected to the controller communication module;
[0093] In the control instruction sending module, after confirming the selected action picture to be controlled, the system will register the broadcast transmitter and obtain the control instruction corresponding to the action picture to be controlled for broadcasting. This process ensures that the action picture to be controlled selected in the carousel of action pictures to be controlled can be accurately associated with the corresponding control instruction. The controller communication module is responsible for real-time communication with the lower computer. For precise control, the module uses the UDP protocol in the TCP / IP protocol family for data transmission, and implements UDP unicast to ensure one-to-one communication. In this module, the system automatically obtains the local IP address (127.0.0.1) and requires the input of the IP address (192.168.1.110) and port number (8080) of the target device. In order to maintain the stability of communication, the module starts multi-threading to perform heartbeat detection, including setting the detection interval time (10S) and timeout time (30S). By establishing a UDP connection and equipping it with an automatic reconnection mechanism, the system can automatically reconnect after a timeout when it detects that the UDP connection is disconnected. In addition, the module registers a broadcast receiver to receive control instructions. When receiving the instructions, it immediately sends the instructions to the target device through the UDP connection for control.
[0094] The parameter setting module, the device communication module, and the control instruction issuing module are respectively connected to the picture carousel module parameter setting module.
[0095] This embodiment realizes efficient and stable transmission of EEG signals by integrating Bluetooth to serial communication and UDP protocol. By using Bluetooth to serial port, EEG signals can be continuously received and processed with low power consumption to meet the needs of long-term monitoring. The selection of UDP unicast transmission ensures the rapid and direct exchange of data, while the heartbeat detection and timeout reconnection mechanism ensure the continuity and reliability of communication, and effectively deal with the problem of connection interruption. Not only does it optimize the data transmission process, but it also significantly improves the versatility of the system, making it compatible with a variety of smart devices, such as mobile phones, tablets and electronic watches. This versatility combined with low power consumption and efficient transmission has become a choice for applications in multiple fields, especially in situations where accurate and long-term EEG monitoring and control are required, such as medical monitoring, scientific research analysis and daily health management. This embodiment greatly simplifies the process of interacting with the device, thereby providing users with unprecedented convenience and accessibility. Compared with traditional brain-computer interface technology, the present invention does not need to rely on complex hardware equipment or any external input such as voice commands or body movements. The present invention uses the inherent ability of an individual, concentration, as the main source of control signals.
[0096] Embodiment 3: The computer device of the present invention may be a device including a processor and a memory, such as a single chip microcomputer including a central processing unit, etc. Moreover, the processor is used to implement the steps of the above-mentioned multi-channel control method for selecting pictures using EEG signals when executing the computer program stored in the memory.
[0097] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0098] The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0099] Embodiment 4: Computer readable storage medium embodiment.
[0100] The computer-readable storage medium of the present invention can be any form of storage medium that can be read by the processor of a computer device, including but not limited to non-volatile memory, volatile memory, ferroelectric memory, etc. The computer-readable storage medium stores a computer program. When the processor of the computer device reads and executes the computer program stored in the memory, the steps of the above-mentioned multi-channel control method for selecting pictures using EEG signals can be implemented.
[0101] The computer program includes computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media do not include electric carrier signals and telecommunication signals.
[0102] Although the present invention has been described according to a limited number of embodiments, it will be apparent to those skilled in the art, with the benefit of the above description, that other embodiments may be envisioned within the scope of the invention thus described. In addition, it should be noted that the language used in this specification is selected primarily for readability and teaching purposes, rather than for explaining or defining the subject matter of the present invention. Therefore, many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the appended claims. The disclosure of the present invention is illustrative, not restrictive, with respect to the scope of the present invention, which is defined by the appended claims.
Claims
1. A multi-channel control method for picture selection using EEG signals, characterized in that: The following steps are involved: Step 1: Set the parameters of the action picture to be controlled; Step 2: loop the action picture to be controlled, collect the user's brain waves, and generate multi-byte data; Step 3: Extracting the concentration index based on multi-byte data; Step 4: Select the action picture to be controlled based on the concentration index, and execute the corresponding instruction of the action picture to be controlled; The parameter settings of the pictures of the actions to be controlled include the control mode settings and the carousel parameter settings of the pictures of the actions to be controlled; the control mode settings include single-channel and multi-channel control modes; the carousel parameter settings of the pictures of the actions to be controlled include the concentration threshold, the number of times the concentration threshold is reached continuously, the carousel time of the pictures of the actions to be controlled and the waiting time between the pictures of the actions to be controlled; Single-channel control mode: the user selects an action picture to be controlled and displays it on the UI interface; multi-channel control mode: the user selects at least one action picture to be controlled and displays it after setting it on the UI interface; Settings on the UI interface: including setting the selected action picture to be controlled, the corresponding parameters of the action picture to be controlled, and the verification parameters; Set the selected action pictures to be controlled to: set the action pictures to be controlled that need to be rotated when starting for the first time; The parameters corresponding to the action picture to be controlled are: the name of the action picture to be controlled, the execution time, the execution instruction and the language played during execution; The verification parameters are set as follows: before the user submits the data, ensure the integrity of each action data, that is, all parameters have been set and conform to the default parameter format. After passing the verification, the user obtains the system's storage permission for persistent storage of data.
2. The multi-channel control method for selecting pictures using EEG signals according to claim 1, characterized in that: The user's brain waves include low-frequency alpha waves, low-frequency beta waves, high-frequency alpha waves, high-frequency beta waves and theta waves.
3. The multi-channel control method for selecting pictures using EEG signals according to claim 1, characterized in that: The method for extracting the concentration index based on multi-byte data is: convert the multi-byte data into decimal format and calculate it using the following formula: A=x max -x min Among them, A represents the amplitude value, x max Indicates the maximum value of the signal, x min Indicates the minimum value of the signal; Among them, X RMS represents the signal RMS, X i Indicates the signal amplitude; Where K represents the kurtosis factor of the signal waveform; Where S represents the slope factor of the signal waveform, represents the mean value of the signal, and σ represents the standard deviation of the signal; Among them, F represents the concentration index, A θ , A β1 , A β2 , A α1 , A α2 They represent theta wave amplitude, low-frequency beta wave amplitude, high-frequency beta wave amplitude, low-frequency alpha wave amplitude, and high-frequency alpha wave amplitude, respectively. β1 , S β2 , S α1 , S α2 They represent the low-frequency β wave slope factor, high-frequency β wave slope factor, low-frequency α wave slope factor, and high-frequency α wave slope factor, respectively. K β1 , K β2 , K α1 , K α2 They represent the low-frequency β wave kurtosis factor, the high-frequency β wave kurtosis factor, the low-frequency α wave kurtosis factor, and the high-frequency α wave kurtosis factor, respectively.
4. The multi-channel control method for selecting pictures using EEG signals according to claim 1, characterized in that: The method of selecting the action picture to be controlled based on the concentration index and executing the corresponding instruction of the action picture to be controlled is: judging whether the concentration index meets the concentration threshold, if so, the number of times the concentration threshold is reached is increased by 1, if not, the number of times the concentration threshold is reached is reset to zero, judging whether the number of times the concentration threshold is reached reaches the set number of times the concentration threshold is reached continuously, if so, executing the corresponding instruction of the action picture to be controlled, if not, returning to step three.
5. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of a multi-channel control method for selecting pictures using electroencephalogram signals as described in any one of claims 1 to 4 when executing the computer program.
6. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the multi-channel control method for selecting pictures using electroencephalogram signals as described in any one of claims 1 to 4 is implemented.
