NeuroX multi-source heterogeneous experimental psychology data synchronous access device and method

Abstract

The invention discloses a NeuroX multi-source heterogeneous experimental psychology data synchronous access device and method, and relates to the field of physiological signal detection, and the device comprises a physiological signal collection device which is used for collecting a physiological signal of a testee; the data synchronization access equipment is connected with the physiological signal acquisition equipment and is used for carrying out synchronization processing on the physiological signals and storing the synchronized physiological signals; the data synchronization access device comprises a protocol conversion layer, a data processing layer and a ConsDB time sequence database. The protocol conversion layer is connected with the physiological signal acquisition equipment and is used for automatically converting the physiological signals according to a protocol library of the physiological signal acquisition equipment; the data processing layer is connected with the protocol conversion layer and is used for performing clock synchronization and format conversion on the converted physiological signals and outputting final data; and the ConsDB time sequence database is connected with the data processing layer and is used for persisting final data. According to the invention, the data processing efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of physiological signal detection, and in particular to a NeuroX multi-source heterogeneous experimental psychology data synchronization access device and method. Background Art

[0002] At present, psychology is gradually becoming more and more popular in the computer field, and the feasibility of using computer technology to study psychology has been confirmed. The study of psychology in the computer field is mainly based on the detection of various physiological signals. In the field of physiological signal acquisition and processing, with the development of technology, more and more devices are able to collect physiological data such as EEG signals, eye movement signals, skin electrical signals and heart rate signals. These devices are widely used in medicine, psychology, neuroscience and other fields. Usually, the physiological signal acquisition system relies on specialized hardware devices to transmit signals to data processing equipment through a variety of communication protocols (such as USB, Bluetooth, etc.), and then perform data analysis through dedicated software.

[0003] However, the current physiological signal acquisition manufacturers in the market mainly focus on single products. For example, the equipment for collecting physiological signals such as EEG, skin electricity and heart rate are equipped with corresponding supporting software. However, different equipment and software have their own communication protocols and data formats. Due to the inconsistency of protocols and data formats of various physiological signal acquisition devices, when using various physiological signal acquisition devices in the same device, compatibility is poor and data cannot be synchronized. It is also necessary to set up additional protocol converters or software modules, which increases the complexity of the device and reduces data processing efficiency. Summary of the invention

[0004] The purpose of this application is to provide a NeuroX multi-source heterogeneous experimental psychology data synchronization access device and method, which can improve the efficiency of data processing.

[0005] To achieve the above objectives, this application provides the following solutions:

[0006] In a first aspect, the present application provides a NeuroX multi-source heterogeneous experimental psychology data synchronization access device, the device comprising:

[0007] Physiological signal acquisition equipment, used to collect physiological signals of the subject; the physiological signals include: electroencephalogram signals, eye movement signals, skin electricity signals, heart rate signals and blood oxygen signals;

[0008] A data synchronization access device, connected to the physiological signal acquisition device, for synchronously processing the physiological signals and storing the synchronized physiological signals;

[0009] The data synchronization access device includes: a protocol conversion layer, a data processing layer and a ConsDB time series database; the protocol conversion layer is connected to the physiological signal acquisition device, and automatically converts the physiological signal according to the protocol library of the physiological signal acquisition device; the data processing layer is connected to the protocol conversion layer, and is used to perform clock synchronization and format conversion on the converted physiological signal, and output the final data; the ConsDB time series database is connected to the data processing layer, and is used to store the final data to achieve persistence of the final data.

[0010] Optionally, the physiological signal acquisition device specifically includes:

[0011] An EEG acquisition unit, used to collect EEG signals of the subject;

[0012] An eye movement acquisition unit, used to collect eye movement signals of the subject;

[0013] A skin electrical acquisition unit, used to collect skin electrical signals of the subject;

[0014] A heart rate collection unit, used to collect the heart rate signal of the subject;

[0015] The blood oxygen collection unit is used to collect the blood oxygen signal of the subject.

[0016] Optionally, the physiological signal acquisition device further includes:

[0017] A key unit, used to collect key information of the subject and perform paradigm interaction with the subject;

[0018] The display unit is used to copy the operator's screen content to the cabin screen for the subjects to view.

[0019] Optionally, the NeuroX multi-source heterogeneous experimental psychology data synchronous access device further includes:

[0020] A high-level application device is connected to the data synchronization access device and is used for performing a post-analysis on the synchronized physiological signal.

[0021] In a second aspect, the present application provides a NeuroX multi-source heterogeneous experimental psychology data synchronization access method, which is used to implement the above-mentioned NeuroX multi-source heterogeneous experimental psychology data synchronization access device, and the NeuroX multi-source heterogeneous experimental psychology data synchronization access method includes:

[0022] Acquiring physiological signals of the subject; the physiological signals include: electroencephalogram signals, eye movement signals, skin electrical signals, heart rate signals and blood oxygen signals;

[0023] Automatically converting the physiological signal;

[0024] Perform clock synchronization and format conversion on the converted physiological signals to obtain final data;

[0025] The final data is stored and persisted.

[0026] Optionally, the NeuroX multi-source heterogeneous experimental psychology data synchronous access method further includes:

[0027] The final data is then analyzed by connecting to a high-level application device via TCP / IP protocol.

[0028] Optionally, obtaining the subject's physiological signal specifically includes:

[0029] The EEG signal of the subject is collected by the EEG collection unit to obtain the EEG signal;

[0030] The eye movement signal of the subject is collected by an eye movement collection unit to obtain the eye movement signal;

[0031] The skin electrical signal of the subject is collected by the skin electrical collection unit to obtain the skin electrical signal;

[0032] The heart rate signal of the subject is collected by a heart rate collection unit to obtain a heart rate signal;

[0033] The blood oxygen signal of the subject is collected by the blood oxygen collection unit to obtain the blood oxygen signal.

[0034] Optionally, the physiological signal is automatically converted, specifically comprising:

[0035] The physiological signal is automatically converted through the protocol conversion layer to obtain a converted physiological signal.

[0036] Optionally, clock synchronization and format conversion are performed on the converted physiological signal to obtain final data, specifically including:

[0037] The converted physiological signals are clock synchronized and format converted through the data processing layer to obtain the final data.

[0038] Optionally, storing the final data and persisting the final data specifically includes:

[0039] The final data is stored and persisted through the ConsDB time series database.

[0040] According to the specific embodiments provided in this application, this application has the following technical effects:

[0041] The present application provides a NeuroX multi-source heterogeneous experimental psychology data synchronization access device and method, which is horizontally compatible with the protocols of different devices through a protocol conversion layer, automatically completes data conversion, and outputs data that conforms to the format of the data synchronization access device; further, the data that conforms to the format of the data synchronization access device is processed by clock synchronization and format conversion through a data processing layer to ensure the synchronization of multi-source data, and persists the final data to the ConsDB time series database to ensure that the data accurately records the time, thereby greatly simplifying the communication problems between different devices, reducing manual adjustment time, and improving the efficiency of the device in data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0043] Figure 1 This is a functional module diagram of a NeuroX multi-source heterogeneous experimental psychology data synchronization access device in one embodiment of the present application;

[0044] Figure 2 A flowchart of a NeuroX multi-source heterogeneous experimental psychology data synchronization access method provided in one embodiment of the present application.

[0045] Figure numerals: 1-physiological signal acquisition device; 11-EEG acquisition unit; 12-eye movement acquisition unit; 13-skin electricity acquisition unit; 14-heart rate acquisition unit; 15-blood oxygen acquisition unit; 16-button unit; 17-display unit; 2-data synchronization access device; 3-high-level application equipment; 21-protocol conversion layer; 22-data processing layer; 23-ConsDB time series database. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] In recent years, technological development in the field of physiological signal detection has focused on the following aspects:

[0048] 1. Diversification of physiological signal acquisition equipment: The technology of various physiological signal equipment is relatively mature, and equipment such as EEG equipment, eye trackers, and skin electrical sensors can provide accurate physiological signal acquisition. However, different devices have their own communication protocols and data formats.

[0049] 2. Multi-channel, multi-modal data acquisition: Current technology supports multi-channel data acquisition and can collect multiple physiological signals at the same time. These signals can reflect the different physiological states of the subjects. However, how to effectively synchronize multi-modal data remains a technical challenge.

[0050] 3. Timeliness requirements for data processing and storage: With the increase in the amount of multimodal physiological signal data, processing and storing large amounts of high-frequency data has become an important issue. Existing solutions usually rely on high-performance computing equipment to perform real-time data processing and analysis, especially with higher requirements for the accuracy of time series data.

[0051] Based on the above three aspects, although the existing technologies and equipment are relatively mature, they still face a series of technical challenges in practical applications:

[0052] 1. Inconsistent protocols and poor compatibility between devices: The protocols and data formats of various physiological signal acquisition devices are not unified, resulting in the need for additional protocol converters or software modules when using different devices in the same system. This increases system complexity, reduces efficiency, and makes data synchronization between different devices very difficult.

[0053] 2. Difficulty in synchronizing multimodal data: In the collection of multiple physiological signals, clock synchronization is extremely critical. However, many existing systems cannot achieve high-precision clock synchronization when processing multi-source data, resulting in inconsistent time points of multimodal data, affecting subsequent analysis and interpretation.

[0054] 3. Low data storage and retrieval efficiency: As the amount of physiological signal data continues to increase, how to efficiently store and retrieve this data is a huge challenge. Traditional database systems are inefficient in storing time series data and cannot meet the real-time storage requirements of high-frequency physiological signal data.

[0055] 4. Insufficient system scalability: Most existing solutions are designed for specific devices and lack good scalability. When the system needs to connect to new physiological signal devices, it usually needs to be redesigned and adjusted, which increases R&D and maintenance costs.

[0056] Based on the above technical challenges, this application aims to solve the problem of low data processing efficiency due to poor device compatibility, difficult data synchronization, low storage efficiency and insufficient system scalability.

[0057] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0058] In an exemplary embodiment, Figure 1 As shown, a NeuroX multi-source heterogeneous experimental psychology data synchronization access device is provided, and the device includes:

[0059] The physiological signal acquisition device 1 is used to acquire physiological signals of the subject; the physiological signals include: electroencephalogram signals, eye movement signals, skin electricity signals, heart rate signals and blood oxygen signals.

[0060] The data synchronization access device 2 is connected to the physiological signal acquisition device, and is used for synchronously processing the physiological signals and storing the synchronized physiological signals.

[0061] The data synchronization access device includes: a protocol conversion layer 21, a data processing layer 22 and a ConsDB time series database 23; the protocol conversion layer 21 is connected to the physiological signal acquisition device, and can be horizontally compatible with the protocols of various physiological acquisition devices, and automatically convert the physiological signals according to the protocol library of the physiological signal acquisition device; the data processing layer 22 is connected to the protocol conversion layer 21, and is used to perform clock synchronization and format conversion on the converted physiological signals, and output the final data; the ConsDB time series database 23 is connected to the data processing layer 22, and is used to store the final data to achieve persistence of the final data.

[0062] Specifically, the physiological signal acquisition device 1 includes: an electroencephalogram acquisition unit 11 for acquiring electroencephalogram signals of the subject; an eye movement acquisition unit 12 for acquiring eye movement signals of the subject; a skin electricity acquisition unit 13 for acquiring skin electricity signals of the subject; a heart rate acquisition unit 14 for acquiring heart rate signals of the subject; and a blood oxygen acquisition unit 15 for acquiring blood oxygen signals of the subject. The physiological signal acquisition device can be connected to the data synchronization access device 2 by other communication methods such as Universal Serial Bus (USB), Bluetooth, High Definition Multimedia Interface (HDMI), etc.

[0063] In addition, other physiological signals (blood pressure, pulse wave, electromyogram, electrogastrogram, etc.) of the subject can also be collected through different collection units, and the data can be transmitted to the data synchronization access device 2 through a horizontal expansion program.

[0064] Specifically, the physiological signal acquisition device also includes: a button unit 16, which is used to collect the subject's button information and perform paradigm interaction with the subject, and the device obtains the corresponding label value; a display unit 17, which is used to copy the operator's screen content to the cabin screen for the subject to view; at the same time, after the device is initialized and calibrated, the eye movement acquisition unit will capture the position of the subject's pupil and convert it into a coordinate point on the screen being viewed.

[0065] Specifically, the NeuroX multi-source heterogeneous experimental psychology data synchronization access device also includes: a high-level application device 3, which is connected to the data synchronization access device and is a high-level application abstraction layer for various post-processing, and is used for post-analysis of synchronized physiological signals.

[0066] In an exemplary embodiment, based on the NeuroX multi-source heterogeneous experimental psychology data synchronization access device, a NeuroX multi-source heterogeneous experimental psychology data synchronization access method is provided, such as Figure 2 As shown, the method includes:

[0067] Step S1: Acquire the subject's physiological signals; the physiological signals include: EEG signals, eye movement signals, skin electrical signals, heart rate signals and blood oxygen signals.

[0068] Step S2: Automatically convert the physiological signal.

[0069] Step S3: Perform clock synchronization and format conversion on the converted physiological signal to obtain final data.

[0070] Step S4: storing the final data and making the final data persistent.

[0071] In a specific embodiment, the NeuroX multi-source heterogeneous experimental psychology data synchronous access method further includes:

[0072] Step S5: Connect with high-level application equipment via TCP / IP protocol and perform post-analysis on the final data.

[0073] In a specific embodiment, in step S1, obtaining the physiological signal of the subject includes: collecting the EEG signal of the subject through the EEG acquisition unit to obtain the EEG signal; collecting the eye movement signal of the subject through the eye movement acquisition unit to obtain the eye movement signal; collecting the skin electricity signal of the subject through the skin electricity acquisition unit to obtain the skin electricity signal; collecting the heart rate signal of the subject through the heart rate acquisition unit to obtain the heart rate signal; collecting the blood oxygen signal of the subject through the blood oxygen acquisition unit to obtain the blood oxygen signal. In addition, other physiological signals of the subject can also be collected through different acquisition units, and the data can be transmitted to the protocol conversion layer through the horizontal expansion program.

[0074] In a specific embodiment, in step S2, the physiological signal is automatically converted, which specifically includes: automatically converting the physiological signal through a protocol conversion layer to obtain a converted physiological signal.

[0075] In a specific embodiment, in step S3, clock synchronization and format conversion are performed on the converted physiological signal to obtain final data, which specifically includes: clock synchronization and format conversion are performed on the converted physiological signal through a data processing layer to obtain final data.

[0076] In a specific embodiment, in step S4, the final data is stored and persisted, which specifically includes: storing the final data through the ConsDB time series database and persisting the final data.

[0077] The NeuroX multi-source heterogeneous experimental psychology data synchronization access device and method provided in this application has the following beneficial effects:

[0078] 1. Efficient data acquisition and processing: Various physiological signal acquisition devices (EEG, eye movement, skin electricity, etc.) are horizontally compatible with the protocols of different devices through the protocol conversion layer, achieving compatibility with the protocols and data formats of different physiological signal devices, and further automating the data conversion, so that the collected data of different acquisition units can be unified, reducing manual intervention in data stream processing, solving the problem of inconsistent protocols and data formats between devices, greatly simplifying the communication problems between different devices, as well as the process of data acquisition and processing, reducing manual adjustment time, and improving data processing efficiency.

[0079] 2. High-precision clock synchronization: Through the data synchronization access device, the clock synchronization and format conversion of the collected multi-modal physiological signals are carried out to ensure the synchronization of multi-source data and improve the overall data processing efficiency of the device. Through precise clock management, the synchronous processing of multi-source data is realized, the time consistency of different physiological signal data is ensured, and the accuracy of multi-source data analysis is improved.

[0080] 3. Efficient CnosDB time series database: CnosDB time series database is used to store and manage high-frequency time series data. By persisting various physiological signals, it can accurately record and store the time point of each collected signal, thereby optimizing the data structure and retrieval mechanism, ensuring high accuracy of data during the analysis process, and reducing errors caused by data delays or inconsistencies. CnosDB time series database can also efficiently store and quickly retrieve time series data, solving the problem of low data storage and retrieval efficiency and ensuring the real-time performance of the system.

[0081] 4. The device has strong scalability and flexibility: various physiological signal acquisition devices are seamlessly integrated with the data synchronization access device through different connection methods (USB, Bluetooth, HDMI, etc.), and functions can be added by expanding new devices. This feature ensures that the system can adapt to more types of physiological signal devices, achieve flexible expansion, adapt to different experimental needs, improve the scalability and flexibility of the device, and solve the problem of insufficient scalability of traditional devices that can only handle a single or a few devices.

[0082] 5. High-level application equipment has strong real-time and operability: High-level application equipment is connected to the data synchronization access device through TCP / IP, and can obtain the processed physiological signal data in real time for analysis. Since the data has been formatted and stored in time series in CnosDB, the data preparation work for subsequent analysis is greatly reduced. High-level application equipment can quickly retrieve and analyze data, reduce data preprocessing time, and improve the real-time performance of the experiment.

[0083] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0084] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A NeuroX multi-source heterogeneous experimental psychology data synchronization access device, characterized in that: The NeuroX multi-source heterogeneous experimental psychology data synchronization access device includes: Physiological signal acquisition equipment, used to collect physiological signals of the subject; the physiological signals include: electroencephalogram signals, eye movement signals, skin electricity signals, heart rate signals and blood oxygen signals; A data synchronization access device, connected to the physiological signal acquisition device, for synchronously processing the physiological signals and storing the synchronized physiological signals; The data synchronization access device includes: a protocol conversion layer, a data processing layer and a ConsDB time series database; the protocol conversion layer is connected to the physiological signal acquisition device, and automatically converts the physiological signal according to the protocol library of the physiological signal acquisition device; the data processing layer is connected to the protocol conversion layer, and is used to perform clock synchronization and format conversion on the converted physiological signal, and output the final data; the ConsDB time series database is connected to the data processing layer, and is used to store the final data to achieve persistence of the final data.

2. The NeuroX multi-source heterogeneous experimental psychology data synchronization access device according to claim 1 is characterized in that: The physiological signal acquisition device specifically comprises: An EEG acquisition unit, used to collect EEG signals of the subject; An eye movement acquisition unit, used to collect eye movement signals of the subject; A skin electrical acquisition unit, used to collect skin electrical signals of the subject; A heart rate collection unit, used to collect the heart rate signal of the subject; The blood oxygen collection unit is used to collect the blood oxygen signal of the subject.

3. The NeuroX multi-source heterogeneous experimental psychology data synchronization access device according to claim 1 is characterized in that: The physiological signal acquisition device further includes: A key unit, used to collect key information of the subject and perform paradigm interaction with the subject; The display unit is used to copy the operator's screen content to the cabin screen for the subjects to view.

4. The NeuroX multi-source heterogeneous experimental psychology data synchronization access device according to claim 1 is characterized in that: The NeuroX multi-source heterogeneous experimental psychology data synchronization access device also includes: A high-level application device is connected to the data synchronization access device and is used for performing a post-analysis on the synchronized physiological signal.

5. A method for synchronous access of NeuroX multi-source heterogeneous experimental psychology data, characterized in that: The NeuroX multi-source heterogeneous experimental psychology data synchronization access device as described in any one of claims 1 to 4, the NeuroX multi-source heterogeneous experimental psychology data synchronization access method comprises: Acquiring physiological signals of the subject; the physiological signals include: electroencephalogram signals, eye movement signals, skin electrical signals, heart rate signals and blood oxygen signals; Automatically converting the physiological signal; Perform clock synchronization and format conversion on the converted physiological signals to obtain final data; The final data is stored and persisted.

6. The NeuroX multi-source heterogeneous experimental psychology data synchronous access method according to claim 5 is characterized in that: The NeuroX multi-source heterogeneous experimental psychology data synchronous access method also includes: The final data is then analyzed by connecting to a high-level application device via TCP / IP protocol.

7. The NeuroX multi-source heterogeneous experimental psychology data synchronous access method according to claim 5 is characterized in that: Obtain the subject's physiological signals, including: The EEG signal of the subject is collected by the EEG collection unit to obtain the EEG signal; The eye movement signal of the subject is collected by an eye movement collection unit to obtain the eye movement signal; The skin electrical signal of the subject is collected by the skin electrical collection unit to obtain the skin electrical signal; The heart rate signal of the subject is collected by a heart rate collection unit to obtain a heart rate signal; The blood oxygen signal of the subject is collected by the blood oxygen collection unit to obtain the blood oxygen signal.

8. The NeuroX multi-source heterogeneous experimental psychology data synchronous access method according to claim 5 is characterized in that: Automatically converting the physiological signal specifically includes: The physiological signal is automatically converted through the protocol conversion layer to obtain a converted physiological signal.

9. The NeuroX multi-source heterogeneous experimental psychology data synchronous access method according to claim 5, characterized in that: The converted physiological signals are clock synchronized and format converted to obtain the final data, including: The converted physiological signals are clock synchronized and format converted through the data processing layer to obtain the final data.

10. The NeuroX multi-source heterogeneous experimental psychology data synchronous access method according to claim 5, characterized in that: The final data is stored and persisted, specifically including: The final data is stored and persisted through the ConsDB time series database.

Images