Electroencephalogram signal processing method and device and storage medium

By dividing the EEG software into three parts: paradigm setting, paradigm material display and acquisition and processing, it is independently deployed and interactively solved the problems of complex design and high maintenance costs in the existing technology, and achieved multi-modular development and efficient brain Electric signal processing.

CN119055255APending Publication Date: 2024-12-03DANYANG HUICHUANG MEDICAL EQUIP CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411184325.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

When faced with multimodal application scenarios and multi-terminal operation requirements, existing EEG software has complex designs and is difficult to achieve independent development and maintenance, resulting in high development and maintenance costs, and it is unable to effectively respond to the multimodal paradigm display needs.

Method used

The EEG signal processing software is divided into paradigm setting software, paradigm material display software and EEG acquisition and processing software, which are independently deployed and work together through interactive logic. Users input indicator paradigm information. The paradigm material display software is displayed collaboratively during the acquisition process. The matching materials, the EEG acquisition device collects data, acquires and analyzes the labeled data.

Benefits of technology

It realizes multi-modular EEG-related software development and maintenance, reduces the cost of a single software, can quickly respond to new software needs, improves development and maintenance efficiency, and supports multi-modal paradigm display and data analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119055255A_ABST
    Figure CN119055255A_ABST
Patent Text Reader

Abstract

The invention provides an electroencephalogram signal processing method and device and a storage medium. The method comprises the steps that electroencephalogram collecting and processing software is provided separately from normal form setting software and normal form material display software; in response to starting of the electroencephalogram acquisition processing software, starting normal form setting software to receive user input which indicates used normal form information; the normal form setting software sends normal form information to normal form material display software; in response to an electroencephalogram acquisition operation on the electroencephalogram acquisition processing software, sending a starting instruction to the normal form material display software to indicate the normal form material display software to cooperatively display a normal form material matched with normal form information in an electroencephalogram signal acquisition process, and sending an acquisition instruction to the electroencephalogram acquisition equipment to display the normal form material matched with the normal form information in the normal form material display software; the electroencephalogram collection device is indicated to collect electroencephalogram signal data; and acquiring the acquired electroencephalogram signal data and mark data acquired when the normal form material display software displays the normal form material, and performing display or analysis based on the mark data and the electroencephalogram signal data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of electroencephalogram (EEG), and in particular to an EEG signal processing method, device and storage medium. Background Art

[0002] Electroencephalogram (EEG) is an electrophysiological monitoring method for non-invasively recording brain electrical activity. During EEG testing, electrodes are placed along the scalp, and then multiple electrodes placed on the scalp are used to record the brain's spontaneous electrical activity over a period of time. With the rapid development of EEG technology, more and more software usage requirements have emerged in the EEG acquisition process, such as EEG data collection and display requirements, paradigm information setting requirements, EEG data analysis requirements, and EEG paradigm corresponding playback requirements.

[0003] In the related technology, in order to facilitate user operations, the software usage requirements in the EEG acquisition process are usually implemented by a single EEG software. However, as the software usage requirements continue to increase, the development cost and maintenance cost of the EEG software are also getting higher and higher. In addition, the problems existing in the single EEG software will cause multiple functional aspects of the design to fail to operate, increasing the difficulty of software updates.

[0004] In addition, with the development of multimodal brain functional imaging, EEG will be used together with other modalities, including but not limited to near-infrared brain functional imaging (fNIRS), transcranial magnetic resonance imaging (TMS), etc., and new application scenarios will be introduced, such as various multimedia paradigm display solutions. In addition, with the expansion of EEG application scenarios, there may be multiple operating users, and multiple operable terminals may be introduced. Even the operating terminals acting on the same functional aspects of the software may change with user needs and application scenarios. Different functional aspects may need to be implemented at different terminal devices at a considerable distance. A single EEG software cannot cope with such usage methods and application scenarios. Summary of the invention

[0005] This application is proposed to solve the above technical problems in the prior art. This application aims to provide an EEG signal processing method, device and storage medium, so as to realize independent, convenient and efficient software development, deployment and maintenance of several functional aspects required for EEG signal acquisition under the required paradigm.

[0006] According to the first scheme of the present application, there is provided an EEG signal processing method, the EEG signal processing method comprising: providing EEG acquisition processing software separately from paradigm setting software and paradigm material display software; in response to the startup of the EEG acquisition processing software, starting the paradigm setting software to receive user input, the user input indicating the paradigm information used; the paradigm setting software sending paradigm information to the paradigm material display software; in response to the EEG acquisition operation on the EEG acquisition processing software, sending a startup instruction to the paradigm material display software to instruct the paradigm material display software to collaboratively display paradigm materials matching the paradigm information during the EEG signal acquisition process, and sending an acquisition instruction to the EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data; acquiring the acquired EEG signal data and the tag data acquired by the paradigm material display software when displaying the paradigm material, so as to display or analyze based on the tag data and the EEG signal data.

[0007] According to a second scheme of the present application, a processing device for EEG signal processing is provided, the processing device comprising a memory and a processor, the memory being configured to: locally deploy or load separate paradigm setting software and EEG acquisition processing software; the processor being configured to: in response to the startup of the EEG acquisition processing software, start the paradigm setting software to receive user input, the user input indicating the paradigm information used; the paradigm setting software sending paradigm information to paradigm material display software deployed on another device; in response to an EEG acquisition operation on the EEG acquisition processing software, sending a startup instruction to the paradigm material display software to instruct the paradigm material display software to collaboratively display paradigm materials matching the paradigm information during the EEG signal acquisition process, and sending an acquisition instruction to an EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data; acquiring the acquired EEG signal data and the tag data acquired by the paradigm material display software when displaying the paradigm material, so as to display or analyze based on the tag data and the EEG signal data.

[0008] According to the third scheme of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the EEG signal processing method as described in each embodiment of the present application. The method includes: providing EEG acquisition processing software separately from the paradigm setting software and the paradigm material display software; in response to the startup of the EEG acquisition processing software, starting the paradigm setting software to receive user input, wherein the user input indicates the paradigm information used; the paradigm setting software sends the paradigm information to the paradigm material display software; in response to the EEG acquisition operation of the EEG acquisition processing software, sending a startup instruction to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and sending an acquisition instruction to the EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data; acquiring the acquired EEG signal data and the tag data acquired by the paradigm material display software when displaying the paradigm material, so as to display or analyze based on the tag data and the EEG signal data.

[0009] Compared with the prior art, the beneficial effects of the embodiments of the present application are:

[0010] The EEG signal processing method, device and storage medium provided in the embodiments of the present application reasonably decouple the EEG software according to the software usage requirements in the EEG acquisition process to obtain multiple EEG-related software including EEG acquisition processing software, paradigm setting software and paradigm material display software, and design reasonable interaction logic for the paradigm usage scenarios in EEG acquisition, and can provide EEG acquisition processing software separately from the paradigm setting software and the paradigm material display software. In response to the startup of the EEG acquisition processing software, the paradigm setting software is started to receive user input, and the user input indicates the paradigm information used, and the paradigm setting software is used to generate the EEG acquisition processing software. The paradigm setting software sends paradigm information to the paradigm material display software; in response to the EEG acquisition operation of the EEG acquisition processing software, a startup instruction is sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and an acquisition instruction is sent to the EEG acquisition device to instruct the EEG acquisition device to collect EEG signal data; thereby, the collected EEG signal data and the tag data collected by the paradigm material display software when displaying the paradigm material can be obtained, so as to display or analyze based on the tag data and the EEG signal data. In this way, after the EEG software is reasonably decoupled according to the paradigm usage scenario, multiple modular EEG-related software can be obtained, so that each modular EEG-related software can be developed, deployed and maintained separately, reducing the cost of a single EEG-related software; on the other hand, for new software usage requirements, the corresponding EEG-related software can be quickly developed through modular design, without the need to continue to develop on the original software code, and can more efficiently and conveniently realize new software usage requirements.

[0011] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above description and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In the drawings, which are not necessarily drawn to scale, the same reference numerals may describe similar parts in different views. Similar reference numerals with letter suffixes or different letter suffixes may represent different examples of similar components. The accompanying drawings generally illustrate various embodiments by way of example and not by way of limitation, and together with the description and claims, are used to illustrate the disclosed embodiments. Such embodiments are illustrative and exemplary and are not intended to be exhaustive or exclusive embodiments of the present method, apparatus, system, or non-transitory computer-readable medium having instructions for implementing the method.

[0013] FIG1(A) shows a schematic diagram of a display interface of a first device according to an embodiment of the present application.

[0014] FIG1(B) shows a schematic diagram of a display interface of a second device according to an embodiment of the present application.

[0015] Figure 2 A flowchart of the method for processing EEG signals according to an embodiment of the present application is shown.

[0016] FIG3(A) shows a schematic diagram of data interaction among an EEG acquisition and processing software, a paradigm material display software, a paradigm setting software, and an EEG acquisition device provided in accordance with the present application.

[0017] FIG3(B) shows a schematic diagram of data interaction among another EEG acquisition and processing software, paradigm material display software, paradigm setting software, and EEG acquisition equipment provided in accordance with the present application.

[0018] FIG3(C) shows a schematic diagram of data interaction between the EEG acquisition and processing software and the EEG signal analysis software provided in the present application.

[0019] Figure 4 A flowchart of an electroencephalogram signal processing method provided in the present application is shown. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the technical solution of the present application, the present application is described in detail below in conjunction with the accompanying drawings and specific implementation examples. The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and specific implementation examples, but are not intended to limit the present application.

[0021] The words "first", "second" and similar words used in this application do not indicate any order, quantity or importance, but are only used to distinguish. The words "include" or "comprises" and similar words used in this application mean that the elements before the word include the elements listed after the word, and do not exclude the possibility of covering other elements. In this application, the arrows shown in the figures of each step are only examples of the execution order, not limitations. The technical solution of this application is not limited to the execution order described in the embodiments. The various steps in the execution order can be combined, decomposed, or the order can be changed, as long as the logical relationship of the execution content is not affected.

[0022] All terms (including technical terms or scientific terms) used in this application have the same meaning as those understood by ordinary technicians in the field to which this application belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined here. Techniques and equipment known to ordinary technicians in the relevant field may not be discussed in detail, but where appropriate, the techniques and equipment should be considered as part of the specification.

[0023] In the present application, the arrows shown in the figures of each step are merely examples of the execution order, not limitations. The technical solution of the present application is not limited to the execution order described in the embodiments. The various steps in the execution order can be combined for execution, can be decomposed for execution, and can be reordered, as long as the logical relationship of the execution content is not affected.

[0024] First, the execution subject of the EEG signal processing method provided in the embodiment of the present disclosure is introduced. In the EEG signal processing method, EEG acquisition processing software can be provided separately from the paradigm setting software and the paradigm material display software, that is, the paradigm setting software, the paradigm material display software and the EEG acquisition processing software are all independent software, so each software can be deployed separately on a computer device with a certain computing power, and can also be deployed on a computer device at the same time as other software. The computer device includes, for example: a terminal device or a server or other processing device. The terminal device can be a terminal device with a display function, for example, a smart phone, a laptop computer, a tablet computer, a desktop computer, a smart wearable device, etc. In some possible implementations, the EEG signal processing method can be implemented by a processor calling computer-readable instructions stored in a memory.

[0025] In some possible embodiments, the EEG acquisition and processing software and the paradigm setting software can be deployed on a first device, and the paradigm material display software can be deployed on a second device.

[0026] Exemplarily, the first device may be a laptop computer, and the second device may be a smart phone; accordingly, the software type of the EEG acquisition and processing software and the paradigm setting software may be .exe, and the software type of the paradigm material display software may be .app.

[0027] In some possible embodiments, a schematic diagram of the display interface of the first device may be as shown in FIG1(A). In FIG1(A), the EEG acquisition and processing software corresponds to a first display interface, and the paradigm setting software corresponds to a second display interface. The second display interface is located at a preset position in the first display interface (as shown in the lower right corner of FIG1(A)), that is, the preset position is the lower right corner; the first display interface may include at least one triggerable item (such as a button) corresponding to an EEG acquisition operation, and the EEG acquisition operation includes start, pause, end, etc.

[0028] In actual use, the preset position can be set according to the user's usage habits, and the display position, size and other display-related parameters of the second display interface can also be adjusted according to user operations, which is not limited in this embodiment of the present disclosure.

[0029] In this way, by setting the display interface corresponding to the paradigm setting software at a preset position in the display interface corresponding to the EEG acquisition and processing software, the two software can be made to look like one software, and the user will not be aware of the decoupling process of the EEG related software in the operation interface, so that the decoupling of the EEG related software will not have a negative impact on the user's normal interactive experience.

[0030] In some possible embodiments, the schematic diagram of the display interface of the second device may be as shown in FIG. 1(B). In FIG. 1(B), the paradigm material display software corresponds to a third display interface, and the third display interface includes a paradigm material display interface for displaying paradigm materials, and at least one triggerable mark button (as shown in the figure "mark A" and "mark B"). When viewing the paradigm material, the user can generate mark data for performing EEG analysis on the user by triggering the mark button, so as to perform corresponding analysis based on the mark data and the collected EEG signal data. In addition, the third display interface may also include progress indication information when displaying the paradigm material to prompt the EEG acquisition object of the current EEG acquisition progress, and the progress indication information may also be displayed in the first display interface to prompt the user of the current EEG acquisition progress.

[0031] In some possible embodiments, the EEG acquisition and processing software can be deployed separately on a third device, and the paradigm setting software and the paradigm material display software can be deployed together on a fourth device.

[0032] Figure 2 A flowchart of the EEG signal processing method according to an embodiment of the present application is shown, wherein the EEG signal processing method can provide EEG acquisition processing software separately from the paradigm setting software and the paradigm material display software. The EEG signal processing method includes S201 to S204, wherein:

[0033] S201: In response to the start of the EEG acquisition and processing software, the paradigm setting software is started to receive user input, where the user input indicates the paradigm information used.

[0034] S202: The paradigm setting software sends paradigm information to the paradigm material display software.

[0035] S203: In response to the EEG acquisition operation of the EEG acquisition processing software, a startup instruction is sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and an acquisition instruction is sent to the EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data.

[0036] S204: Acquire the collected EEG signal data and the marking data collected by the paradigm material display software when displaying the paradigm material, so as to display or analyze based on the marking data and the EEG signal data.

[0037] The following is a detailed description of the above steps.

[0038] With respect to S201, the EEG acquisition and processing software may be started after the user triggers the software icon corresponding to the EEG acquisition and processing software. During the startup of the EEG acquisition and processing software, the paradigm setting software may be started synchronously with the EEG acquisition and processing software.

[0039] In some possible implementations, the paradigm setting software and the EEG acquisition and processing software are started synchronously. According to different deployment situations of the EEG acquisition and processing software and the paradigm setting software, the following situations can be classified:

[0040] Case 1: The paradigm setting software and the EEG acquisition and processing software are deployed in the same device.

[0041] In this case, since the paradigm setting software and the EEG acquisition and processing software are deployed in the same device, they can be started synchronously through local interaction methods such as inter-process communication.

[0042] Case 2: The paradigm setting software and the EEG acquisition and processing software are deployed in different devices.

[0043] In this case, since the paradigm setting software and the EEG acquisition and processing software are deployed in different devices, they can be started synchronously through remote interaction methods such as TCP / IP communication.

[0044] In some possible implementations, the paradigm information may include paradigm parameters such as paradigm name, paradigm language, paradigm mode, etc.; wherein the paradigm name may be, for example, a language fluency task method, the paradigm language may be, for example, Chinese, and the paradigm mode may be, for example, a picture; in addition, the paradigm information may also be a paradigm identifier, and the paradigm identifier corresponds to at least one pre-configured paradigm parameter, and by selecting a specific paradigm identifier, the paradigm parameters corresponding to the paradigm identifier may be used.

[0045] With respect to S202, in some possible implementations, before the paradigm setting software sends the paradigm information to the paradigm material display software, a remote start instruction may be sent to the second device to instruct the second device to start the paradigm material display software.

[0046] Here, when the EEG acquisition and processing software and the paradigm setting software are deployed on a first device, and the paradigm material display software is deployed on a second device, the first device can send a remote start instruction to the second device to start the paradigm material display software; in addition, the paradigm material display software can also be manually started by the user.

[0047] Furthermore, in order to ensure that the paradigm material display software can receive the paradigm information, before sending the paradigm information to the paradigm material display software, the startup status of the paradigm material display software and / or the communication connection status with the paradigm setting software can be detected, and if the detection passes, the paradigm setting software sends the paradigm information to the paradigm material display software.

[0048] Among them, when the detection content includes the startup status of the Paradigm material display software, the detection passes including detecting that the Paradigm material display software has been started; when the detection content includes the communication connection status between the Paradigm material display software and the Paradigm setting software, the detection passes including detecting that the communication connection between the Paradigm material display software and the Paradigm setting software is normal.

[0049] Regarding S203, here, when the user performs the EEG acquisition operation on the EEG acquisition processing software, relevant instructions for starting playback (acquisition) can be sent to the paradigm material display software and the EEG acquisition device at the same time to instruct the EEG acquisition device and the paradigm material display software to run synchronously, so that the paradigm material display software can collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process.

[0050] In some possible implementations, before sending a start instruction to the paradigm material display software, the communication connection status between the EEG acquisition and processing software and the paradigm material display software may be detected.

[0051] Here, the EEG acquisition and processing software and the paradigm material display software can be connected to each other through a preset communication protocol, and the preset communication protocol can be, for example, a TCP / IP communication protocol.

[0052] Specifically, when detecting the communication connection status between the EEG acquisition and processing software and the paradigm material display software, the communication connection status between the EEG acquisition and processing software and the paradigm material display software can be detected through TCP status detection tools, establishing a heartbeat mechanism, calling a communication status detection interface, etc., and subsequent operations can be performed when the communication connection status between the EEG acquisition and processing software and the paradigm material display software is successful or stable.

[0053] In this way, by detecting the communication connection status between the EEG acquisition and processing software and the paradigm material display software before sending the startup instruction to the paradigm material display software, it can be ensured that the paradigm material display software can normally receive the corresponding startup instruction, thereby ensuring the synchronous execution of the paradigm material display process and the EEG signal acquisition process, and ensuring the accuracy of the results of the analysis of the collected EEG signal data.

[0054] Regarding S204, here, when the EEG acquisition and processing software obtains the collected EEG signal data, and when the paradigm material display software obtains the marking data collected when displaying the paradigm material, it can receive the EEG signal data sent by the EEG acquisition device, and receive the marking data sent by the paradigm material display software.

[0055] The EEG signal data may be sent in real time by the EEG acquisition device after acquisition, and the marking data may be sent in real time by the paradigm material display software after acquisition when displaying paradigm materials.

[0056] In some possible implementations, when acquiring the collected EEG signal data and the marking data collected by the paradigm material display software when displaying the paradigm material, any of the following methods may be used:

[0057] Method 1: receiving the EEG signal data sent by the EEG acquisition device and the marking data sent by the paradigm material display software.

[0058] Here, the EEG acquisition and processing software can respectively receive the EEG signal data sent by the EEG acquisition device and the marking data sent by the paradigm material display software.

[0059] Exemplarily, the data interaction diagram corresponding to the above-mentioned method 1 can be shown in Figure 3 (A), which shows a data interaction diagram between an EEG acquisition processing software, a paradigm material display software, a paradigm setting software, and an EEG acquisition device provided by the present application. Among them, the EEG acquisition processing software can synchronously start the paradigm setting software when it is started. The paradigm setting software can send the paradigm information used by the user input knowledge to the paradigm material display software. The EEG acquisition processing software can respond to the user's start acquisition operation and simultaneously send startup-related instructions to the EEG acquisition device and the paradigm material display software to synchronously perform EEG signal acquisition and paradigm material display. After the EEG acquisition device collects the EEG signal data, it can transmit the EEG signal data to the EEG acquisition processing software in real time through a wired or wireless transmission method. After the paradigm material display software collects the marked data, it can transmit the marked data to the EEG acquisition processing software through a preset data transmission protocol, and the data transmission protocol can be a TCP / IP protocol, a USB protocol, etc.

[0060] Method 2: receiving the marked EEG data sent by the EEG acquisition device.

[0061] Here, the marked EEG data includes the EEG signal data and the marking data sent by the paradigm material display software to the EEG acquisition device.

[0062] Exemplarily, the data interaction diagram corresponding to the above-mentioned method 2 can be shown in Figure 3(B), which shows a data interaction diagram between another EEG acquisition and processing software, paradigm material display software, paradigm setting software, and EEG acquisition equipment provided by the present application.

[0063] Among them, the EEG acquisition processing software can synchronously start the paradigm setting software when it is started. The paradigm setting software can send the paradigm information used by the user input knowledge to the paradigm material display software. The EEG acquisition processing software can respond to the user's startup acquisition operation, and simultaneously send startup-related instructions to the EEG acquisition device and the paradigm material display software to synchronously perform EEG signal acquisition and paradigm material display. The paradigm material display software can transmit the collected marked data to the EEG acquisition device through a serial port or other connection method. The EEG acquisition device can send data to the EEG acquisition processing software in real time, or temporarily store the data locally in the acquisition device or in a storage device connected to the acquisition device. After receiving the marked data, the EEG acquisition device can fuse the marked data with the collected EEG signal data, so that the marked EEG data obtained after the fusion can be sent to the EEG acquisition processing software.

[0064] In this way, in the scenario where the EEG acquisition and processing software and the paradigm material display software are deployed on different devices and the distance between the devices is relatively far, when wireless communication is required between the EEG acquisition and processing software and the paradigm material display software, since the paradigm material display software and the EEG acquisition device are both located near the EEG acquisition object, it is convenient for the EEG acquisition device and the devices deployed by the paradigm material display software to communicate by wire. In this usage scenario, the EEG acquisition device and the paradigm material display software are marked (i.e., the process of generating and transmitting marked data) through wired transmission methods such as serial ports. Compared with marking by wireless communication between the EEG acquisition and processing software and the paradigm material display software, the delay is lower and the data transmission is more stable. In the subsequent processing process, there is no need to use time alignment operations, and data transmission and corresponding processing can be performed stably and efficiently in this scenario.

[0065] In some possible implementations, the EEG acquisition and processing software may also interact with other software to further process the EEG signal data.

[0066] Exemplarily, the data interaction diagram between the EEG acquisition and processing software and the EEG signal analysis software can be shown in Figure 3(C). In Figure 3(C), the EEG acquisition and processing software can send the EEG signal data and the marking data to the EEG signal analysis software to analyze the EEG signal and the marking data based on the EEG signal analysis software. It should be noted that the position of the EEG signal data and the marking data in Figure 3(C) does not limit the order in which the data is sent. The EEG signal data and the marking data can be sent simultaneously or in a certain order, and the embodiments of the present disclosure do not limit this.

[0067] Among them, the EEG signal analysis software can be a software developed independently for performing EEG signal data analysis. Different EEG equipment manufacturers can use different EEG signal analysis software. The EEG acquisition and processing software can send the EEG signal data to at least one EEG signal analysis software and obtain the analysis results obtained by the at least one EEG signal analysis software.

[0068] In some possible implementations, the paradigm setting software can also directly send the selected paradigm material to the paradigm material display software according to user operations, so as to display personalized paradigm material to the EEG acquisition subject.

[0069] In some possible implementations, when the user input indicates not to use paradigm information, a collection instruction can be sent to the EEG collection device to instruct the EEG collection device to collect EEG signals, thereby obtaining the collected EEG signal data and displaying or analyzing the data based on the EEG signal data.

[0070] Specifically, the user can set not to use the EEG paradigm in the EEG acquisition and processing software. In this case, the software can respond to the user's EEG signal acquisition operation and send an acquisition instruction to the EEG acquisition device to instruct the EEG acquisition device to collect EEG signals, and display or analyze the EEG signal data collected by the EEG device.

[0071] The following will introduce the EEG signal processing method provided by the embodiment of the present disclosure in conjunction with the accompanying drawings. Figure 4 As shown, the EEG signal processing method provided by the embodiment of the present disclosure may include the following steps:

[0072] Step 1: Start the EEG acquisition and processing software.

[0073] Step 2: Start the Paradigm Setup software.

[0074] Here, the paradigm setting software may be started in response to the starting of the EEG acquisition and processing software.

[0075] Step 3: Determine whether to use the paradigm.

[0076] Here, whether to use the paradigm can be determined based on the user's real-time selection / pre-setting. If yes, steps 411 to 416 are executed; otherwise, steps 421 to 424 are executed.

[0077] First, the branch using paradigm information is introduced, which includes the following steps:

[0078] Step 411, start the Paradigm material display software.

[0079] Here, the paradigm material display software may be started in response to a user's start operation, or may be automatically started by remote start or the like.

[0080] Furthermore, after starting the Paradigm Material Display Software, the startup status of the Paradigm Material Display Software may be detected, and after detecting that the Paradigm Material Display Software has been successfully started, step 412 is executed; and if it is detected that the Paradigm Material Display Software has not been successfully started, the process returns to the step of executing the startup of the Paradigm Material Display Software, and when the startup operation is re-executed, the startup mode of the previous startup may be changed. For example, if the previous startup was manually started by the user, the current startup may be an automatic startup mode such as a remote startup, thereby increasing the probability of successful startup of the Paradigm Material Display Software.

[0081] Step 412: Connect to the Paradigm material display software.

[0082] Here, after confirming that the paradigm material display software is successfully started, a communication connection between the EEG acquisition and processing software and the paradigm material display software, as well as a communication connection between the paradigm setting software and the paradigm material display software can be established.

[0083] Furthermore, after the communication connection is established, a test may be performed to detect whether the communication connection between each software and the paradigm material display software is normal.

[0084] Among them, the detection of the communication connection status can be carried out in time after the communication is established, or it can be carried out before each EEG acquisition operation / paradigm setting operation, so as to ensure that the paradigm information and startup instructions can be accurately sent to the paradigm material display software, thereby ensuring the normal progress of the EEG acquisition process.

[0085] Specifically, when it is detected that the connection state is normal, step 413 may be executed; and when it is detected that the connection state is abnormal, reconnection may be performed and redetection may be performed.

[0086] Step 413: Select paradigm information.

[0087] Here, the paradigm setting software can send the paradigm information used as indicated by the user input to the paradigm material display software; correspondingly, the paradigm material display software can also proceed to the display interface to display the corresponding paradigm material in the display interface according to the user's subsequent operations.

[0088] It should be noted that Figure 4 The connecting line with arrows indicates the execution order of the steps, and the connecting line without arrows can indicate the related operations of the paradigm material display software. Taking the connecting line between "Select paradigm information" and "Enter display interface" as an example, it means that when the paradigm setting software receives the paradigm information sent by the user, the paradigm material display software can display the display interface.

[0089] Step 414: Start collecting.

[0090] Here, in response to the EEG acquisition operation of the EEG acquisition processing software, a startup instruction can be sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and an acquisition instruction can be sent to the EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data.

[0091] Step 415: Collecting.

[0092] Here, the marking data collected by the paradigm material display software when displaying the paradigm material can be sent to the EEG acquisition processing software and / or the EEG acquisition device in real time.

[0093] Step 416: End the collection.

[0094] Here, when the acquisition end conditions are met, the EEG signal acquisition can be ended and the presentation of the paradigm material can be stopped, while the relevant records / results can be saved.

[0095] Among them, the conditions for ending the acquisition include receiving an end acquisition instruction sent by the EEG acquisition processing software, the acquisition time reaching a preset time, etc.

[0096] Next, we introduce the branch that does not use paradigm information. This branch includes the following steps:

[0097] Step 421, start collecting.

[0098] Step 422: Collecting.

[0099] Step 423, end the collection.

[0100] Step 424: Data preservation.

[0101] The specific description of the above steps can be referred to the relevant content and will not be repeated here.

[0102] The EEG signal processing method provided in the embodiment of the present application reasonably decouples the EEG software according to the software usage requirements in the EEG acquisition process, and obtains multiple EEG-related software including EEG acquisition processing software, paradigm setting software, and paradigm material display software, and designs reasonable interaction logic for the paradigm usage scenarios in EEG acquisition. The EEG acquisition processing software can be provided separately from the paradigm setting software and the paradigm material display software. In response to the startup of the EEG acquisition processing software, the paradigm setting software is started to receive user input, and the user input indicates the paradigm information used, and the paradigm setting software The software sends paradigm information to the paradigm material display software; in response to the EEG acquisition operation of the EEG acquisition processing software, a startup instruction is sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and an acquisition instruction is sent to the EEG acquisition device to instruct the EEG acquisition device to collect EEG signal data; thereby, the collected EEG signal data and the tag data collected by the paradigm material display software when displaying the paradigm material can be obtained, so as to display or analyze based on the tag data and the EEG signal data. In this way, after the EEG software is reasonably decoupled according to the paradigm usage scenario, multiple modular EEG-related software can be obtained, so that each modular EEG-related software can be developed, deployed and maintained separately, reducing the cost of a single EEG-related software; on the other hand, for new software usage requirements, the corresponding EEG-related software can be quickly developed through modular design, without the need to continue to develop on the original software code, and the new software usage requirements can be realized more efficiently and conveniently.

[0103] In some embodiments of the present application, a device for processing an electroencephalogram signal is provided, the device comprising a memory and a processor, the memory being configured to locally deploy or load separate paradigm setting software and electroencephalogram acquisition processing software; the processor being configured to execute the electroencephalogram signal processing method according to each embodiment of the present application. The method may include the following steps performed by the processor: in response to the startup of the electroencephalogram acquisition processing software, the paradigm setting software is started to receive user input, the user input indicating the paradigm information used; the paradigm setting software sends the paradigm information to the paradigm material display software; in response to the electroencephalogram acquisition operation of the electroencephalogram acquisition processing software, a startup instruction is sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the electroencephalogram signal acquisition process, and a collection instruction is sent to the electroencephalogram acquisition device to instruct the electroencephalogram acquisition device to collect electroencephalogram signal data; the collected electroencephalogram signal data and the marker data collected by the paradigm material display software when displaying the paradigm material are obtained, so as to display or analyze based on the marker data and the electroencephalogram signal data. The details or examples of the methods and steps described in each embodiment of the present application can be combined here independently or in combination and will not be repeated here.

[0104] The processor may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), etc. More specifically, the processor may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor may also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.

[0105] This application describes various operations or functions that may be implemented as software codes or instructions or defined as software codes or instructions. Such content may be source code or differential code ("incremental" or "patch" code) that can be directly executed ("object" or "executable" form). Software codes or instructions may be stored in a computer-readable storage medium, and when executed, may cause a machine to perform the described functions or operations, and include any mechanism for storing information in a form accessible to a machine (e.g., a computing device, an electronic system, etc.), such as recordable or non-recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).

[0106] The exemplary methods described in this application may be implemented at least in part by a machine or computer. In some embodiments, a computer-readable storage medium stores computer program instructions, which, when executed by a processor, cause the processor to perform the EEG signal processing method described in each embodiment of this application. The method includes: providing EEG acquisition processing software separately from paradigm setting software and paradigm material display software; in response to the startup of the EEG acquisition processing software, starting the paradigm setting software to receive user input, the user input indicating the paradigm information used; the paradigm setting software sends paradigm information to the paradigm material display software; in response to the EEG acquisition operation of the EEG acquisition processing software, sending a startup instruction to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and sending an acquisition instruction to the EEG acquisition device to instruct the EEG acquisition device to collect EEG signal data; obtaining the collected EEG signal data and the tag data collected by the paradigm material display software when displaying the paradigm material, so as to display or analyze based on the tag data and the EEG signal data. The details or examples in the methods and steps recorded in each embodiment of the present application can be combined here independently or in combination, and will not be repeated here.

[0107] The implementation of such a method may include software code, such as microcode, assembly language code, high-level language code, etc. Various software programming techniques may be used to create various programs or program modules. For example, a program portion or program module may be designed with or by means of Java, Python, C, C++, assembly language, or any known programming language. One or more of such software portions or modules may be integrated into a computer system and / or a computer-readable medium. Such software code may include computer-readable instructions for executing various methods. The software code may form a part of a computer program product or a computer program module. In addition, in an example, the software code may be tangibly stored on one or more volatile, non-temporary or non-volatile tangible computer-readable media, such as during execution or at other times. Examples of these tangible computer-readable media may include, but are not limited to, hard disks, removable disks, removable optical disks (such as optical disks and digital video disks), cassettes, memory cards or memory sticks, random access memories (RAMs), read-only memories (ROMs), etc.

[0108] In addition, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., various embodiments intersecting schemes), adaptations or changes. The elements in the claims will be interpreted broadly based on the language adopted in the claims, and are not limited to the examples described in this specification or during the implementation of the application, and the examples will be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered as examples only, and the true scope and spirit are indicated by the following claims and the full scope of their equivalents.

[0109] The above description is intended to be illustrative rather than restrictive. For example, the above examples (or one or more of them) can be used in combination with each other. For example, those of ordinary skill in the art can use other embodiments when reading the above description. In addition, in the above-mentioned specific embodiments, various features can be grouped together to simplify the application. This should not be interpreted as an intention that a disclosed feature that does not require protection is necessary for any claim. On the contrary, the subject matter of the present application may be less than all the features of a specific disclosed embodiment. Thus, the claims are incorporated into the specific embodiments as examples or embodiments, wherein each claim is independently used as a separate embodiment, and it is considered that these embodiments can be combined with each other in various combinations or arrangements. The scope of the present application should be determined with reference to the full scope of the equivalent forms of the attached claims and these claims.

[0110] The above embodiments are only exemplary embodiments of the present application and are not intended to limit the present application. The protection scope of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and protection scope of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the protection scope of the present application.

Claims

1. A method for processing electroencephalogram signals, characterized in that: The electroencephalogram signal processing method comprises: Providing EEG acquisition and processing software separately from the paradigm setting software and the paradigm material display software; In response to the startup of the EEG acquisition and processing software, the paradigm setting software is started to receive user input, wherein the user input indicates the paradigm information used; The paradigm setting software sends paradigm information to the paradigm material display software; In response to the EEG acquisition operation of the EEG acquisition processing software, a start instruction is sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and an acquisition instruction is sent to the EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data; The collected EEG signal data and the marking data collected by the paradigm material display software when displaying the paradigm material are obtained, so as to display or analyze based on the marking data and the EEG signal data.

2. The method for processing electroencephalogram signals according to claim 1, characterized in that: The EEG acquisition and processing software and the paradigm setting software are deployed on a first device, and the paradigm material display software is deployed on a second device.

3. The method for processing electroencephalogram signals according to claim 2, characterized in that: The EEG acquisition and processing software corresponds to a first display interface, and the paradigm setting software corresponds to a second display interface, and the second display interface is located at a preset position in the first display interface.

4. The method for processing electroencephalogram signals according to claim 1, characterized in that: Acquiring the collected EEG signal data and the marking data collected by the paradigm material display software when displaying the paradigm material, specifically includes: Receiving the EEG signal data sent by the EEG acquisition device and the marking data sent by the paradigm material display software; or, Receive the marked EEG data sent by the EEG acquisition device, wherein the marked EEG data includes the EEG signal data and the marking data sent by the paradigm material display software to the EEG acquisition device.

5. The method for processing electroencephalogram signals according to claim 1, characterized in that: The EEG acquisition and processing software and the paradigm material display software are connected to each other through a preset communication protocol; The method further comprises, before sending a start instruction to the paradigm material display software: The communication connection status between the EEG acquisition and processing software and the paradigm material display software is detected.

6. The method for processing electroencephalogram signals according to claim 1, characterized in that: The method further comprises: The EEG signal data and the marking data are sent to EEG signal analysis software, so as to analyze the EEG signal data and the marking data based on the EEG signal analysis software.

7. The method according to claim 2, characterized in that The method further includes, before the paradigm setting software sends the paradigm information to the paradigm material display software: A remote start instruction is sent to the second device to instruct the second device to start the paradigm material display software.

8. The method according to claim 1, characterized in that The method further comprises: When the user input indicates that the paradigm information is not to be used, sending a collection instruction to the EEG collection device to instruct the EEG collection device to collect EEG signal data; The collected EEG signal data is obtained, and displayed or analyzed based on the EEG signal data.

9. An electroencephalogram signal processing device, characterized in that: The device comprises: A memory configured to: locally deploy or load separate paradigm setting software and EEG acquisition and processing software; and A processor, wherein the processor is configured as: In response to the startup of the EEG acquisition and processing software, the paradigm setting software is started to receive user input, wherein the user input indicates the paradigm information used; The paradigm setting software sends the paradigm information to the paradigm material display software deployed on another device; In response to the EEG acquisition operation of the EEG acquisition processing software, a start instruction is sent to the paradigm material display software to instruct the paradigm material display software to collaboratively display the paradigm material matching the paradigm information during the EEG signal acquisition process, and an acquisition instruction is sent to the EEG acquisition device to instruct the EEG acquisition device to acquire EEG signal data; The collected EEG signal data and the marking data collected by the paradigm material display software when displaying the paradigm material are obtained, so as to display or analyze based on the marking data and the EEG signal data.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the electroencephalogram signal processing method according to any one of claims 1 to 8 are implemented.

Citation Information

Patent Citations

  • Tri-modal serial brain-computer interface method based on multi-information fusion

    CN103699226A

  • System and achieving method for P300-based normal-form virtual-reality brain-computer interface

    CN107479696A

  • BCI multi-task method and system based on interactive interface

    CN116483341A

  • Chinese input auxiliary system based on brain-controlled spelling

    CN118426601A

  • User-experience exhibition device using brain waves, exhibition mehod thereof, and computer program therefor

    KR1020180033776A