Electroencephalogram experiment data processing method and device and electroencephalogram equipment

Abstract

The embodiment of the invention provides an electroencephalogram experiment data processing method and device and electroencephalogram equipment, and relates to the technical field of electroencephalogram equipment. According to the specific implementation scheme, in the process of continuously displaying multiple experimental stimulation contents, electroencephalogram experimental data of an experimented object are collected; acquiring experimental stimulation content to obtain acquired content; determining a content switching time point in the collected content, and generating content identification data based on the content switching time point, the content switching time point representing a time point between two adjacent experimental stimulation contents corresponding to the collected content; and fusing the content identification data with the electroencephalogram experiment data to obtain fused electroencephalogram experiment data. In the scheme, the electroencephalogram equipment can automatically generate the content identification data, and the dependency on the equipment is reduced. Compared with wireless connection, the accuracy of the content identification data can be improved. Besides, stimulation in a specified environment such as a natural environment can be directly collected for experiment without display equipment, so that the application range of the scheme is expanded.

Description

Technical Field

[0001] The present application relates to the technical field of electroencephalogram (EEG) equipment. Specifically, the present application relates to an EEG experimental data processing method, device, and EEG equipment. Background Art

[0002] EEG experiments are an experimental method that studies human cognition, emotions, or pathological states by recording the brain's electrical activity. EEG experiments are typically performed by presenting stimuli to subjects, collecting EEG data, and then performing correlation analysis on the data.

[0003] Content identification data needs to be embedded in EEG experimental data. The content identification data can reflect the display time of different experimental stimulation contents, so that the experimental stimulation contents can be associated with the EEG experimental data generated under the influence of the experimental stimulation contents to achieve correlation analysis.

[0004] In related technologies, content identification data is mostly sent to the EEG device by the display device of the experimental stimulus content via wired or wireless means. This requires relying on wired or wireless connections between devices, and requires relying on special data transmission protocols and synchronization mechanisms, and is highly dependent on both hardware and software. Summary of the Invention

[0005] This application provides a method, device, and EEG equipment for processing EEG experimental data, aiming to solve at least one of the above technical deficiencies. The technical solutions adopted in this application are as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for processing EEG experimental data, the method comprising:

[0007] During the continuous display of multiple experimental stimuli, the EEG experimental data of the experimental subjects are collected;

[0008] Collecting experimental stimulus content to obtain collected content;

[0009] Determining a content switching time point in the collected content, and generating content identification data based on the content switching time point, wherein the content switching time point represents a time point between two adjacent experimental stimulus contents corresponding to the collected content;

[0010] The content identification data is fused with the EEG experimental data to obtain fused EEG experimental data.

[0011] As an optional method, determining the content switching time point in the collected content includes:

[0012] The time point of the content segment whose content characteristics in the collected content meet the preset conditions is determined as the content switching time point.

[0013] As an optional method, the experimental stimulus content is a video or an image, the content feature is the light intensity of the content, and the preset condition is that the light intensity of the content segment is greater than a preset light intensity.

[0014] As an optional method, spacer content is added between adjacent experimental stimulus contents, and a preset condition is that the content features of the content segments match the content features of the spacer content.

[0015] As an optional method, generating content identification data based on the content switching time point includes:

[0016] Content identification data is generated based on the time data corresponding to the content switching time point and the content identification of the experimental stimulus content corresponding to the content cutting position.

[0017] As an optional method, the content identification data is fused with the EEG experimental data to obtain fused EEG experimental data, including:

[0018] Aligning the time data corresponding to the content identification data with the time data corresponding to the sampling point of the EEG experimental data closest in time to obtain aligned content identification data;

[0019] The aligned content identification data is fused with the EEG experimental data to obtain fused EEG experimental data.

[0020] As an optional method, after obtaining the fused EEG experimental data, the above method further includes:

[0021] Cache the fused EEG experimental data;

[0022] According to the preset sending cycle, the fused EEG experimental data in the cache is sent to the server.

[0023] As an option, multiple experimental stimuli can be presented consecutively, including any of the following:

[0024] Continuously display multiple experimental stimulus contents through a display device;

[0025] The experimental stimulus content is automatically displayed in the specified environment.

[0026] In a second aspect, an embodiment of the present application provides an EEG experimental data processing device, the device comprising:

[0027] The EEG experiment data acquisition module is used to collect EEG experiment data of the experimental subjects during the process of continuously displaying multiple experimental stimulation contents;

[0028] A content collection module is used to collect experimental stimulus content and obtain collected content;

[0029] A content identification generation module is used to determine a content switching time point in the collected content and generate content identification data based on the content switching time point, wherein the content switching time point represents the position between two adjacent experimental stimulus contents corresponding to the collected content;

[0030] The data fusion module is used to fuse the content identification data with the EEG experimental data to obtain fused EEG experimental data.

[0031] In a third aspect, an embodiment of the present application provides an electroencephalogram (EEG) device, comprising:

[0032] The EEG experiment data acquisition component is used to collect EEG experiment data of the experimental subjects during the continuous display of multiple experimental stimulus contents;

[0033] A content collection component is used to collect experimental stimulus content and obtain collected content;

[0034] The controller is electrically connected to the EEG experiment data acquisition component and the content acquisition component respectively, and is used to determine the content switching time point in the acquired content, generate content identification data based on the content switching time point, and fuse the content identification data with the EEG experiment data to obtain fused EEG experiment data, wherein the content switching time point represents the position between two adjacent experimental stimulation contents corresponding to the acquired content.

[0035] As an optional approach, the content collection component is an event camera.

[0036] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the steps of the above-mentioned EEG experimental data processing method when executed by a processor.

[0037] The beneficial effects of the technical solution provided by the embodiments of the present application are:

[0038] The solution provided by the embodiment of the present application is to collect EEG experimental data of the experimental subject during the process of continuously displaying multiple experimental stimulation contents; collect the experimental stimulation contents to obtain the collected contents; determine the content switching time point in the collected contents, and generate content identification data based on the content switching time point, wherein the content switching time point represents the time point between two adjacent experimental stimulation contents corresponding to the collected contents; and fuse the content identification data with the EEG experimental data to obtain the fused EEG experimental data. Based on this solution, the EEG device can automatically generate content identification data and embed the content identification data into the EEG experimental data, which facilitates the subsequent analysis of the EEG experimental data, greatly reduces the dependence on hardware and software, and has better applicability. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments of the present application.

[0040] Figure 1 A diagram of the system architecture applicable to the embodiments of the present application;

[0041] Figure 2 A flowchart of the method for processing EEG experimental data provided in an embodiment of the present application;

[0042] Figure 3 A schematic diagram of the structure of the EEG experimental data processing device provided in an embodiment of the present application;

[0043] Figure 4 A schematic diagram of the structure of the electroencephalogram device provided in an embodiment of the present application; DETAILED DESCRIPTION

[0044] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0045] The terms used in the embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit the present application. The singular forms "a", "an", "the" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise.

[0046] It should be understood that the term "and / or" as used herein is merely a description of the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates that the associated objects are in an "or" relationship.

[0047] The word "if," as used herein, may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to the determination" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)," depending on the context.

[0048] In order to facilitate the understanding of this application, the system architecture on which this application is based is first described. Figure 1 An exemplary system architecture to which the embodiments of the present application can be applied is shown. Figure 1 As shown in , the system architecture may include: an EEG device, and a server.

[0049] The EEG device executes the method provided in this application and sends the generated EEG experimental data to the server, so that the server analyzes the EEG experiment based on the EEG experimental data sent by the EEG device.

[0050] The above-mentioned EEG devices may include but are not limited to: EEG headbands, EEG headbands, EEG headphones, etc.

[0051] The servers can be configured as independent servers, on the same server or server cluster, or on separate or shared cloud servers. A cloud server, also known as a cloud computing server or cloud host, is a host product within the cloud computing service ecosystem. It addresses the management difficulties and scalability limitations of traditional physical hosts and virtual private servers (VPS). The model training device and medical image prediction device can also be deployed on a computer terminal with significant computing power.

[0052] It can include but is not limited to various types of image, video, and audio players.

[0053] It should be understood that Figure 1 The number of EEG devices, servers, and devices in the embodiment is merely illustrative. Depending on the implementation requirements, any number of user terminals, model training devices, medical image prediction devices, and medical image prediction models may be provided.

[0054] Figure 2 A schematic diagram of a process flow of an EEG experimental data processing method provided by an embodiment of the present application is shown. The method can be performed by Figure 1 The EEG device in the system shown is executed. Figure 2 As shown, the method may mainly include:

[0055] Step S210: collecting EEG experimental data of the experimental subject during the process of continuously displaying multiple experimental stimulation contents;

[0056] Step S220: collecting experimental stimulus content to obtain collected content;

[0057] Step S230: determining a content switching time point in the collected content, and generating content identification data based on the content switching time point, wherein the content switching time point represents a position between two adjacent experimental stimulus contents corresponding to the collected content;

[0058] Step S240: Fusing the content identification data with the EEG experimental data to obtain fused EEG experimental data.

[0059] The stimulation content may include but is not limited to visual, auditory and other types of stimulation content, such as static images, videos, audio and the like.

[0060] The continuously displaying of multiple experimental stimulation contents may include continuously displaying multiple experimental stimulation contents through a display device; or automatically displaying the experimental stimulation contents in a designated environment.

[0061] As an example, a specific display device may be used to display stimulating content for the subject to perceive. The display device may play the stimulating content in a predetermined order.

[0062] It is understandable that the display device can be deployed with a special experimental program for EEG experiments, which is integrated with a playback function and can continuously display experimental stimulation content.

[0063] As another example, the experimental stimulus content in this application can also be displayed automatically in a specified environment without the need for fixed display equipment. In a specified environment, signals such as light and sound will change over time according to certain rules, and these changing signals can be used as experimental stimulus content. For example, the experimental subject will experience different light before and after passing through a tunnel.

[0064] While the subject is perceiving the stimulus, the EEG device can collect the subject's EEG data. This EEG data is generated by the subject after the stimulus and can be used for experimental analysis. For example, the EEG device can collect EEG signals through relevant sensors.

[0065] During the experiment, multiple experimental stimulus contents are generally displayed continuously. During this process, the EEG device can collect the experimental stimulus contents to obtain collected content.

[0066] As an example, the experimental stimulation content can be collected using a device corresponding to the content type of the experimental stimulation content. For example, for experimental stimulation content of static image or video type, an image collection device can be used for content collection; for experimental stimulation content of audio type, a recording device can be used for content collection.

[0067] The EEG device can determine the content switching time point between adjacent experimental stimulation contents based on the collected content. The content switching time point is the time point between adjacent experimental stimulation contents. Content identification data can be generated based on the content switching time point.

[0068] The content identification data can reflect the display time of different experimental stimulation contents, so that the experimental stimulation contents are associated with the EEG experimental data generated under the effect of the experimental stimulation contents to achieve correlation analysis.

[0069] For example, experimental stimulation content A is displayed from 1 to 30 seconds, and stimulation content B is displayed from 31 to 60 seconds. The content switching time points are 1 second, 30 second, 31 second and 60 second. Then, corresponding content identification data can be generated. The content identification data can include content identification corresponding to the above-mentioned content switching events, thereby reflecting that the display time of experimental stimulation content A is 0-30 seconds, and the display time of experimental stimulation content B is 30-60 seconds.

[0070] In an embodiment of the present application, the EEG device can obtain collected content by collecting experimental stimulation content, and automatically generate content identification data by analyzing the content switching time points in the collected content, so that the content identification data can be fused with the EEG experimental data to obtain fused EEG experimental data.

[0071] After fusion, content identification data is embedded in the EEG experimental data, so that the experimental stimulation content can be associated with the EEG experimental data generated under the influence of the experimental stimulation content, thereby realizing correlation analysis of the EEG experimental data.

[0072] The method provided in the embodiment of the present application collects EEG experimental data of the experimental subject during the process of continuously displaying multiple experimental stimulation contents; collects the experimental stimulation contents to obtain collected contents; determines the content switching time point in the collected contents, and generates content identification data based on the content switching time point, wherein the content switching time point represents the time point between two adjacent experimental stimulation contents corresponding to the collected contents; and fuses the content identification data with the EEG experimental data to obtain fused EEG experimental data. Based on this solution, the EEG device can automatically generate content identification data and embed the content identification data into the EEG experimental data, which facilitates the subsequent analysis of the EEG experimental data, greatly reduces the dependence on hardware and software, and has better applicability.

[0073] This solution no longer relies on a wired or wireless connection to a display device, reducing device dependency and improving its applicability. Furthermore, compared to wireless connections to display devices, this solution significantly improves accuracy. Furthermore, this solution can also directly collect stimuli from a specified environment (e.g., a natural environment) for EEG experiments, eliminating the need for display devices. This expands the scope of EEG experiments and enhances their practicality.

[0074] As an example, the EEG device can send the fused EEG experimental data to the server, and the server performs subsequent data analysis based on the fused EEG experimental data.

[0075] As an example, the wireless connection between the EEG device and the server may include, but is not limited to, a Bluetooth connection and a Wireless Fidelity (WiFi) connection.

[0076] In an optional manner of the embodiment of the present application, determining a content switching time point in the collected content includes:

[0077] The time point of the content segment whose content characteristics in the collected content meet the preset conditions is determined as the content switching time point.

[0078] In the embodiment of the present application, when different experimental stimulus contents are switched, the content segments corresponding to the switching points in the collected content will have specific content features. Therefore, the content switching time points can be analyzed based on the content features of each content segment in the collected content.

[0079] In the embodiment of the present application, the content features of each content segment in the collected content can be detected to determine the content segment whose content change meets the preset conditions, and the corresponding time point is used as the content switching time point.

[0080] In an optional manner of the embodiment of the present application, the experimental stimulus content is a video or an image, the content feature is the light intensity of the content, and the preset condition is that the light intensity of the content segment is greater than the preset light intensity.

[0081] In the embodiment of the present application, when the experimental stimulus content is a video or image, when the experimental stimulus content switches, the light intensity of the entire image in the captured content increases to greater than the preset light intensity. Therefore, the time point at which the light intensity of the content segment in the captured content exceeds the preset light intensity can be used as the content switching time point.

[0082] In this example, the experimental content can be captured using an event camera, which triggers data output based on pixel-level brightness changes. Each pixel operates independently, and when it detects a light intensity change exceeding a preset threshold, it immediately generates an "event" containing a timestamp, pixel location, and the direction (polarity) of the brightness change. This preset threshold can be set to a preset light intensity value, allowing the output of the event camera to directly determine the content switching time point.

[0083] As an example, the length of the content segment can be set according to actual needs, for example, set to one or more video images in the captured content.

[0084] In an optional manner of the embodiment of the present application, interval content is added between adjacent experimental stimulation contents, and a preset condition is that the content features of the content segments match the content features of the interval content.

[0085] In an embodiment of the present application, in order to improve the accuracy of the determined content switching time point, interval content can be added in advance between adjacent experimental stimulation content. When displaying the experimental stimulation content, the interval content will be displayed directly after the previous experimental stimulation content is played. After the interval content is displayed, the next experimental stimulation content will be displayed.

[0086] When spacer content is added between adjacent experimental stimulus contents, the content features of each content segment can be detected and compared with the content features of the spacer content. The content segments whose content features match the content features of the spacer content can be judged as spacer content segments.

[0087] As an example, the duration of the content segment may be set to be the same as the duration of the interval content.

[0088] In the embodiment of the present application, the content segment may correspond to sampled content at a time point or sampled content for a time period. The content switching time point can be specified from the time data corresponding to the content segment.

[0089] For example, if the experimental stimulus content is an image or video, the content segment may be a video frame or a segment of video content. When the content segment is a video frame, the time point corresponding to the video frame can be used as the content switching time point. When the content segment is a segment of video content, the content switching time point can be specified within the time period corresponding to the content segment, for example, the time point corresponding to the starting point or the midpoint of the content segment can be used as the content switching time point.

[0090] After determining the content switching time point, the content switching time point can be used as a dividing point between two adjacent experimental stimulation contents, thereby generating content identification data.

[0091] For example, experimental stimulus content A is displayed from 0 to 30 seconds, with the 30th second being the content switching time point, and stimulus content B is displayed from 30 to 60 seconds. The 30th second can be used as the dividing point between experimental stimulus content A and experimental stimulus content B in the content identification data. The content identification data can reflect that the display time of experimental stimulus content A is 0 to 30 seconds, and the display time of experimental stimulus content B is 30 to 60 seconds.

[0092] In an optional manner of the embodiment of the present application, the content identification data is fused with the EEG experimental data to obtain fused EEG experimental data, including:

[0093] Aligning the time data corresponding to the content identification data with the time data corresponding to the sampling point of the EEG experimental data closest in time to obtain aligned content identification data;

[0094] The aligned content identification data is fused with the EEG experimental data to obtain fused EEG experimental data.

[0095] In the embodiment of the present application, before the content identification data and the EEG experiment data are fused, the content identification data and the EEG experiment data need to be aligned.

[0096] Specifically, EEG experimental data is generally obtained by sampling at a fixed frequency. The EEG experimental data will correspond to multiple sampling points. It is necessary to align the time point in the content identification data to the time point of the nearest neighbor sampling point to obtain the aligned content identification data. Then, the aligned content identification data can be fused with the EEG experimental data to obtain the fused EEG experimental data.

[0097] As an example, the content identification data can reflect that the display time of experimental stimulation content A is 0-30 seconds, and the display time of experimental stimulation content B is 30-60 seconds. The time points corresponding to the EEG experimental data sampling points are 1 second, 31 seconds, and 61 seconds, respectively. After aligning the content identification data with the time points of the sampling points, the aligned content identification data can reflect that the display time of experimental stimulation content A is 1-31 seconds, and the display time of experimental stimulation content B is 31-61 seconds.

[0098] In an optional manner of the embodiment of the present application, the EEG experiment data includes sub-data of a preset number of channels, and the aligned content identification data is fused with the EEG experiment data to obtain fused EEG experiment data, including:

[0099] The aligned content identification data is used as sub-data of a channel of the EEG experiment data and added to the EEG experiment data to obtain fused EEG experiment data.

[0100] Among them, EEG experimental data generally contains sub-data of multiple channels. The aligned content identification data can also be used as sub-data of a channel in the EEG experimental data. The aligned content identification data can be added to the EEG experimental data by adding channels to obtain fused EEG experimental data.

[0101] As an example, the EEG experimental data includes 8 channels of sub-data, which are collected by different sensors respectively. The sub-data of 1 channel in the EEG experimental data is aligned with the content identification data, so that the final fused EEG experimental data includes 9 channels of sub-data.

[0102] In an optional manner of the embodiment of the present application, after obtaining the fused EEG experimental data, the method further includes:

[0103] Cache the fused EEG experimental data;

[0104] According to the preset sending cycle, the fused EEG experimental data in the cache is sent to the server.

[0105] In the embodiment of the present application, the fused EEG experimental data can be cached and sent to the server according to a preset sending cycle.

[0106] It is understandable that after the fused EEG experimental data in the cache is sent, it can be deleted from the cache to ensure reasonable utilization of the cache space.

[0107] Based on Figure 2 The same principle as shown in the method, Figure 3 FIG. 1 shows a schematic diagram of a structure of an EEG experiment data transmission device provided in an embodiment of the present application. Figure 3 As shown, the EEG experiment data processing device 30 may include:

[0108] The EEG experiment data acquisition module 310 is used to collect EEG experiment data of the experimental subject during the process of continuously displaying multiple experimental stimulation contents;

[0109] The content collection module 320 is used to collect experimental stimulus content and obtain collected content;

[0110] A content identification generating module 330 is configured to determine a content switching time point in the collected content and generate content identification data based on the content switching time point, wherein the content switching time point represents a position between two adjacent experimental stimulus contents corresponding to the collected content;

[0111] The data fusion module 340 is used to fuse the content identification data with the EEG experimental data to obtain fused EEG experimental data.

[0112] The device provided in the embodiment of the present application collects EEG experimental data of the experimental subject during the process of continuously displaying multiple experimental stimulation contents; collects the experimental stimulation contents to obtain the collected contents; determines the content switching time point in the collected contents, and generates content identification data based on the content switching time point, wherein the content switching time point represents the time point between two adjacent experimental stimulation contents corresponding to the collected contents; and fuses the content identification data with the EEG experimental data to obtain fused EEG experimental data. Based on this solution, the EEG device can automatically generate content identification data and embed the content identification data into the EEG experimental data, which facilitates the subsequent analysis of the EEG experimental data, greatly reduces the dependence on hardware and software, and has better applicability.

[0113] As an optional manner, when determining the content switching time point in the collected content, the content identification generation module 330 is specifically configured to:

[0114] The time point of the content segment whose content characteristics in the collected content meet the preset conditions is determined as the content switching time point.

[0115] As an optional method, the experimental stimulus content is a video or an image, the content feature is the light intensity of the content, and the preset condition is that the light intensity of the content segment is greater than a preset light intensity.

[0116] As an optional method, spacer content is added between adjacent experimental stimulus contents, and a preset condition is that the content features of the content segments match the content features of the spacer content.

[0117] As an optional manner, when generating content identification data based on the content switching time point, the content identification generation module 330 is specifically configured to:

[0118] Content identification data is generated based on the time data corresponding to the content switching time point and the content identification of the experimental stimulus content corresponding to the content cutting position.

[0119] As an optional approach, the data fusion module 340 is specifically configured to:

[0120] Aligning the time data corresponding to the content identification data with the time data corresponding to the sampling point of the EEG experimental data closest in time to obtain aligned content identification data;

[0121] The aligned content identification data is fused with the EEG experimental data to obtain fused EEG experimental data.

[0122] As an optional manner, the EEG experiment data includes sub-data of a preset number of channels. When the data fusion module 340 fuses the aligned content identification data with the EEG experiment data to obtain the fused EEG experiment data, it is specifically used to:

[0123] The aligned content identification data is used as sub-data of a channel of the EEG experiment data and added to the EEG experiment data to obtain fused EEG experiment data.

[0124] As an optional method, the above device further includes:

[0125] A cache module (not shown in the figure) is used to cache the fused EEG experimental data after obtaining it;

[0126] According to the preset sending cycle, the fused EEG experimental data in the cache is sent to the server.

[0127] As an optional embodiment, the above device further includes a display module (not shown in the figure), which is used for any of the following when continuously displaying multiple experimental stimulus contents:

[0128] Continuously display multiple experimental stimulus contents through a display device;

[0129] The experimental stimulus content is automatically displayed in the specified environment.

[0130] The present application also provides an electroencephalogram (EEG) device, including:

[0131] The EEG experiment data acquisition component is used to collect EEG experiment data of the experimental subjects during the continuous display of multiple experimental stimulus contents;

[0132] A content collection component is used to collect experimental stimulus content and obtain collected content;

[0133] The controller is electrically connected to the EEG experiment data acquisition component and the content acquisition component respectively, and is used to determine the content switching time point in the acquired content, generate content identification data based on the content switching time point, and fuse the content identification data with the EEG experiment data to obtain fused EEG experiment data, wherein the content switching time point represents the position between two adjacent experimental stimulation contents corresponding to the acquired content.

[0134] The EEG experiment data acquisition component may specifically be a related sensor for collecting EEG data.

[0135] The content collection component is used to collect experimental stimulus content to obtain collected content. The content collection component can be specifically an image or audio collector.

[0136] As an example, the content acquisition component may be an event camera.

[0137] The controller can be electrically connected to the EEG experiment data acquisition component and the content acquisition component respectively, and is used to determine the content switching time point and generate content identification data based on the content switching time point, thereby realizing the fusion of the content identification data and the EEG experiment data.

[0138] like Figure 4 FIG. 1 shows a schematic diagram of the structure of an electroencephalogram device provided in an embodiment of the present application. Figure 4 As shown in , the experimental program runs on, which is used to continuously display multiple experimental stimulus contents.

[0139] The event camera is used to collect experimental stimulus content and obtain collected content.

[0140] The calculation module is used to determine a content switching time point based on the collected content, and generate content identification data based on the content switching time point.

[0141] Marker, i.e. content identification data, is used to identify the stimulus content displayed.

[0142] A synchronization module is used to fuse the content identification data with the EEG experimental data to obtain fused EEG experimental data;

[0143] The storage module is used to cache the fused EEG experimental data.

[0144] Brain-computer data with markers, i.e., fused EEG experimental data. EEG devices can connect to the server via Bluetooth or Wi-Fi, and send the fused EEG experimental data to the server for relevant analysis.

[0145] Each embodiment in this specification is described in a progressive manner. The same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For the relevant parts, refer to the partial description of the method embodiment. The device embodiment described above is merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0146] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0147] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any one of the method embodiments described above.

[0148] Compared with the prior art, the computer-readable storage medium provided in the embodiment of the present application collects EEG experimental data of the experimental subject during the process of continuously displaying multiple experimental stimulation contents; collects experimental stimulation contents to obtain collected contents; determines the content switching time point in the collected contents, and generates content identification data based on the content switching time point, wherein the content switching time point represents the time point between two adjacent experimental stimulation contents corresponding to the collected contents; and fuses the content identification data with the EEG experimental data to obtain fused EEG experimental data. Based on this solution, the EEG device can automatically generate content identification data and embed the content identification data into the EEG experimental data, which facilitates the subsequent analysis of the EEG experimental data, greatly reduces the dependence on hardware and software, and has better applicability.

[0149] It should be understood that although the steps in the flowcharts of the accompanying drawings are shown in sequence as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the flowcharts of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0150] The above descriptions are only partial embodiments of the present invention. It should be pointed out that ordinary technicians in this technical field can make several improvements and modifications without departing from the principles of the present invention. These improvements and modifications should also be regarded as within the scope of protection of the present invention.

Claims

1. A method for processing EEG experimental data, applied to EEG equipment, characterized in that: The method comprises: During the continuous display of multiple experimental stimuli, the EEG experimental data of the experimental subjects are collected; collecting the experimental stimulus content to obtain collected content; Determining a content switching time point in the collected content, and generating content identification data based on the content switching time point, wherein the content switching time point represents a time point between two adjacent experimental stimulation contents corresponding to the collected content; The content identification data is fused with the EEG experimental data to obtain fused EEG experimental data.

2. The method according to claim 1, characterized in that The determining of a content switching time point in the collected content includes: The time point of the content segment whose content feature in the collected content meets the preset conditions is determined as the content switching time point.

3. The method according to claim 2, characterized in that The experimental stimulus content is a video or an image, the content feature is the light intensity of the content, and the preset condition is that the light intensity of the content segment is greater than a preset light intensity.

4. The method according to claim 2, characterized in that Interval content is added between adjacent experimental stimulation contents, and the preset condition is that the content features of the content segments match the content features of the interval content.

5. The method according to claim 1, wherein Generating content identification data based on the content switching time point includes: Content identification data is generated based on the time data corresponding to the content switching time point and the content identification of the experimental stimulation content corresponding to the content cutting position.

6. The method according to claim 5, characterized in that The step of fusing the content identification data with the EEG experimental data to obtain fused EEG experimental data includes: Aligning the time data corresponding to the content identification data with the time data corresponding to the sampling point of the EEG experimental data closest in time to obtain aligned content identification data; The aligned content identification data is fused with the EEG experimental data to obtain fused EEG experimental data.

7. The method according to claim 6, characterized in that The EEG experiment data includes sub-data of a preset number of channels, and fusing the aligned content identification data with the EEG experiment data to obtain fused EEG experiment data includes: The aligned content identification data is used as sub-data of a channel of the EEG experiment data and added to the EEG experiment data to obtain fused EEG experiment data.

8. The method according to any one of claims 1 to 7, characterized in that After obtaining the fused EEG experimental data, the method further includes: caching the fused EEG experimental data; According to a preset sending cycle, the fused EEG experimental data in the cache is sent to the server.

9. The method according to any one of claims 1 to 7, characterized in that The continuous display of multiple experimental stimulus contents includes any of the following: Continuously display multiple experimental stimulus contents through a display device; The experimental stimulus content is automatically displayed in the specified environment.

10. An EEG experimental data processing device, characterized in that: include: The EEG experiment data acquisition module is used to collect EEG experiment data of the experimental subjects during the process of continuously displaying multiple experimental stimulation contents; A content collection module, configured to collect the experimental stimulus content and obtain collected content; a content identification generating module, configured to determine a content switching time point in the collected content and generate content identification data based on the content switching time point, wherein the content switching time point represents a position between two adjacent experimental stimulus contents corresponding to the collected content; The data fusion module is used to fuse the content identification data with the EEG experimental data to obtain fused EEG experimental data.

11. An electroencephalogram device, characterized in that: include: The EEG experiment data acquisition component is used to collect EEG experiment data of the experimental subjects during the continuous display of multiple experimental stimulus contents; A content collection component, configured to collect the experimental stimulus content to obtain collected content; A controller is electrically connected to the EEG experiment data acquisition component and the content acquisition component, respectively, and is used to determine a content switching time point in the acquired content, generate content identification data based on the content switching time point, and fuse the content identification data with the EEG experiment data to obtain fused EEG experiment data, wherein the content switching time point represents the position between two adjacent experimental stimulation contents corresponding to the acquired content.

12. The electroencephalogram device according to claim 11, characterized in that The content collection component is an event camera.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images