Wearable multichannel physiological parameter acquisition system

Abstract

The invention relates to the technical field of man-machine interaction, and discloses a wearable multi-channel physiological parameter acquisition system which comprises wearable physiological parameter acquisition equipment and preprocessing software. The technical problems that most of existing physiological state collecting devices are used in a laboratory environment, the use preparation time is long, wearing is inconvenient, and the working requirement in the actual high-speed cabin environment cannot be met are solved, collecting of physiological data of a driver in the high-speed flight or ground driving environment is achieved, and the working efficiency is improved. And data input is provided for evaluating the fatigue state and the cognitive state of the driver in real time.

Description

Technical Field

[0001] The present invention relates to the technical field of human-computer interaction, and in particular to a wearable multi-channel physiological parameter acquisition system. Background Art

[0002] In high-speed flight or ground driving environments, drivers are often under high-load working conditions. Once they are under high-load fatigue for a long time, driving safety will be affected. It is necessary to be able to collect the driver's physiological parameters and process the collected data to obtain physiological characteristic data that can be used for status assessment. This supports further status analysis and ensures driving safety.

[0003] Most of the existing physiological status acquisition equipment is used in laboratory environments, which takes a long time to prepare and is inconvenient to wear, and cannot meet the working requirements in the actual high-speed cockpit environment. In addition, the existing physiological acquisition and data processing methods are mostly based on a single data source, and the calculation and processing results are easily affected by data errors and individual differences. Summary of the invention

[0004] The purpose of the present invention is to provide a system with multi-channel physiological parameter collection and data processing functions for high-speed aircraft or ground driving environments, so as to solve the problem of low physiological state recognition accuracy caused by lack of physiological parameter collection means and single source of physiological data in such environments.

[0005] The technical solution of the present invention is achieved in this way:

[0006] A wearable multi-channel physiological parameter acquisition system, comprising:

[0007] Wearable physiological parameter collection equipment, which consists of a multi-channel physiological collection wristwatch, an EEG collection and processing module, a blood oxygen collection earmuff, and an eye movement collection module, and is used to collect various physiological parameters of the driver and convert them into digital signals;

[0008] The pre-processing software deployed on the cockpit system host computer obtains the digital signals of the driver's various physiological parameters, processes them and outputs the physiological characteristic data.

[0009] As a further solution of the present invention: the EEG acquisition and processing module is integrated on the inner lining of the helmet to collect EEG signals;

[0010] The eye movement acquisition module is installed on the helmet mask and is used to collect eye movement data;

[0011] The blood oxygen collection earmuffs are installed on both sides of the helmet to collect ear blood oxygen data;

[0012] The multi-channel physiological acquisition wristwatch is worn on the driver's wrist and is used to collect multiple physiological parameters.

[0013] As a further solution of the present invention: the system collects multiple physiological parameters through sensors integrated on the watch, and collects head-related physiological parameters through blood oxygen collection earmuffs, EEG collection modules and eye movement collection modules integrated in the helmet. The collected signals include PPG signals, electrodermal signals, body temperature signals, acceleration signals, EEG data and eye movement data.

[0014] As a further solution of the present invention: the multi-channel physiological collection wristwatch includes a PPG sensor, a skin charge sensor, a body temperature sensor and an acceleration sensor, which collects the wearer's heart rate, blood oxygen, skin charge, body temperature and acceleration physiological parameters in real time, and monitors and records the wearer's physiological parameters in real time.

[0015] As a further solution of the present invention: the blood oxygen collection earmuffs integrate a PPG collection module on the noise reduction headphones in the driver's helmet, use photoplethysmography to collect the reflected light intensity of light sources of different wavelengths, and extract physiological characteristic data such as blood oxygen concentration and heart rate through algorithm calculation.

[0016] As a further solution of the present invention: the EEG acquisition and processing module is integrated into the driver's helmet as a detachable module, and brain electrodes are used to record the brain activity state to form EEG data, which is then preprocessed to improve the signal-to-noise ratio of the signal and remove artifacts, interference, and noise.

[0017] As a further solution of the present invention: the eye movement data acquisition module collects eye diagram data through an eye movement sensor, and obtains the driver's gaze point position information and pupil-related information after algorithm calculation.

[0018] As a further solution of the present invention: the preprocessing software performs preprocessing on the received raw physiological data of each channel, specifically comprising the following steps:

[0019] Establish communication with the acquisition device. If the device is in normal state, the received raw physiological data will be timestamped and stored in the buffer area;

[0020] Read data of a certain time window from the buffer, including pulse wave, skin electricity, acceleration, EEG signal, and viewpoint coordinates, and package them into a raw physiological data structure with a timestamp;

[0021] The original physiological data structure is read, and the characteristic values ​​of the original physiological data in the time window are extracted, including heart rate, average skin electrical level, mean EEG energy, and average eye movement speed, to generate a characteristic data structure.

[0022] Beneficial effects of the present invention:

[0023] 1. The present invention relates to a multi-channel physiological state acquisition and processing method, which realizes the acquisition of driver physiological data in high-speed flight or ground driving environment, and provides data input for real-time evaluation of the driver's fatigue state and cognitive state.

[0024] 2. The wearable data acquisition device of the present invention is portable: considering the usage scenarios in the cockpit during high-speed flight or driving, the wearable data acquisition device integrates multiple physiological channel acquisition sensors into existing equipment or equipment that has no impact on the driver. This not only saves a lot of preparation time when performing tasks, but also ensures that it will not affect the normal operation of the driver. At the same time, the data acquisition device itself also needs to be able to work normally in the cockpit environment.

[0025] 3. The present invention adopts multi-channel physiological acquisition processing to reduce the impact of single channel errors: the data of multiple physiological acquisition sensors are combined for unified processing, and physiological parameters of different types and locations are comprehensively processed through signal filtering and preprocessing, so as to extract multi-channel physiological characteristic data and reduce the evaluation error caused by single channel data.

[0026] The present invention will be further described below in conjunction with the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a block diagram of the system composition principle of the present invention;

[0028] Figure 2 It is a schematic diagram of the device form of the present invention;

[0029] Figure 3 This is a functional block diagram of the system of the present invention;

[0030] Figure 4 Schematic diagram of the workflow of the preprocessing software of the present invention.

[0031] The reference numerals in the figure are: EEG acquisition and processing module 101, eye movement acquisition module 102, blood oxygen acquisition earmuffs 103, and multi-channel physiological acquisition wristwatch 104. DETAILED DESCRIPTION

[0032] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0033] The present invention realizes a wearable multi-channel physiological parameter acquisition and processing system, which adopts a wearable physiological parameter acquisition device and a multi-channel data processing algorithm. In the following embodiments, Example 1 is the composition of the system, and Example 2 is the method of using the system in a specific application scenario.

[0034] Embodiment 1:

[0035] See attached Figure 1-4The present invention provides a wearable multi-channel physiological parameter acquisition system, which includes: a wearable physiological parameter acquisition device and preprocessing software.

[0036] Wearable physiological parameter acquisition device, which is used to collect various physiological parameters of the driver and convert them into digital signals.

[0037] The preprocessing software obtains the digital signals of various physiological parameters of the driver, and outputs the physiological characteristic data after processing.

[0038] like Figure 1 As shown in the figure, the wearable multi-channel physiological parameter acquisition device consists of a multi-channel physiological acquisition wristwatch, an EEG acquisition and processing module, a blood oxygen acquisition earmuff, and an eye movement acquisition module. Figure 2 As shown, the EEG acquisition and processing module 101 is integrated on the helmet lining for collecting EEG signals, the eye movement acquisition module 102 is installed on the helmet mask for collecting eye movement data, the blood oxygen acquisition earmuffs 103 are installed on both sides of the helmet for collecting ear blood oxygen data, and the multi-channel physiological acquisition watch 104 is worn on the driver's wrist for collecting multiple physiological parameters.

[0039] like Figure 3 As shown, the system collects multiple physiological parameters through sensors integrated in the watch, and collects head-related physiological parameters through blood oxygen collection earmuffs, EEG collection modules and eye movement collection modules integrated in the helmet. The collected signals include PPG signals, electrodermal signals, body temperature signals, acceleration signals, EEG data and eye movement data.

[0040] The following focuses on the various module components of the system:

[0041] 1. Multi-channel physiological data collection watch

[0042] The multi-channel physiological data collection watch is worn on the driver's wrist, and collects the wearer's heart rate, blood oxygen, skin electricity, body temperature, acceleration and other physiological parameters in real time, and monitors and records the wearer's physiological parameters in real time. As a simple wearable device, the watch will not affect the driver's normal task operation in the cockpit environment.

[0043] The multi-channel physiological data collection watch includes a PPG sensor, a skin charge sensor, a body temperature sensor, and an acceleration sensor.

[0044] The PPG sensor consists of an LED light emitter and a PD light sensor. Using photoplethysmography, the green light, red light and infrared light emitted by the LED are reflected by the blood vessels and received by the PD. The heart rate and blood oxygen values ​​are calculated based on the reflected light intensity of different wavelengths.

[0045] The galvanic skin sensor uses a high-precision, low-power analog front end that can excite and measure the current, voltage or impedance response of the sensor. It calculates the skin electrical impedance by measuring the current and voltage values ​​of the two contact electrodes in contact with the skin surface.

[0046] The body temperature sensor uses an infrared thermometer for non-contact temperature measurement and uses an IR-sensitive thermopile detector chip to measure the temperature of the wearing position.

[0047] The acceleration sensor uses a sensor chip that can provide three-axis digital acceleration and a three-axis digital gyroscope, which can measure and output the real-time acceleration of the wearing position.

[0048] 2. Blood oxygen collection earmuffs

[0049] The blood oxygen collection earmuffs can collect blood oxygen signals from the driver's ear. The collection device integrates a PPG collection module on the noise reduction earphones in the driver's helmet, uses photoplethysmography to collect the reflected light intensity of light sources of different wavelengths, and extracts physiological characteristic data such as blood oxygen concentration and heart rate through algorithm calculation.

[0050] 3. EEG acquisition and processing module

[0051] The EEG acquisition and processing module uses brain electrodes to record brain activity. When the brain is active, the electric waves formed by a large number of neurons synchronously are called brain waves, which are the overall reflection of the electrophysiological activities of brain nerve cells in the cerebral cortex or scalp surface. The purpose of EEG data preprocessing is to improve the signal-to-noise ratio of the signal, remove artifacts, interference, and noise as much as possible, and retain pure EEG signals. The EEG acquisition and processing module is integrated into the driver's helmet as a detachable module to minimize the impact on the driver's task.

[0052] 4. Eye movement acquisition module

[0053] The eye movement data acquisition module realizes the function of collecting and preprocessing the driver's eye movement data. The eye movement sensor collects eye data, and the driver's gaze point position information and pupil-related information are obtained after algorithm calculation. The eye movement acquisition module is a component of the protective helmet. The acquisition camera is installed on the helmet mask. The driver's eye diagram is captured by an infrared camera without blocking the driver's line of sight, and the gaze direction and coordinates are obtained using the pupil-corneal reflection method.

[0054] 5. Preprocessing software

[0055] The physiological data processing software performs preprocessing on the received raw physiological data of each channel. After receiving the raw physiological data of different channels sent by each acquisition device, the physiological characteristic data is firstly uniformly timestamped, and then the feature extraction algorithm is used to calculate the raw physiological data to obtain the physiological characteristic data of each channel. The processed multi-channel physiological characteristic data is sent in the specified format, and the multi-channel physiological data can be analyzed by labeling.

[0056] The preprocessing software includes: communication control module, time synchronization module and data feature extraction module. It performs physiological data preprocessing, mainly including: PPG feature extraction, acceleration feature extraction, EEG feature extraction, electrodermal feature extraction, eye movement feature extraction, time event marking, body temperature feature extraction and comprehensive analysis.

[0057] like Figure 4 As shown, the preprocessing software runs according to the following process:

[0058] 1) The device communication control module of the physiological data acquisition and processing software establishes communication with the acquisition device. If the device status is normal, the received raw physiological data is timestamped and stored in the buffer area (list);

[0059] 2) The time synchronization module reads data of a certain time window (within the same second) from the buffer area (list), including pulse wave, skin electricity, acceleration, EEG signal, viewpoint coordinates, etc., and packages them into a raw physiological data structure with a timestamp;

[0060] 3) The data feature extraction module reads the original physiological data structure, extracts the characteristic values ​​of the original physiological data in the time window, including heart rate, average skin electrical level, mean EEG energy, average eye movement speed, etc., and generates a characteristic data structure.

[0061] Example 2

[0062] The present invention provides a method for using a wearable multi-channel physiological parameter acquisition system, which specifically includes the following contents:

[0063] In the cockpit environment, press Figure 2 The driver is shown wearing a protective helmet with an EEG acquisition module, blood oxygen acquisition earmuffs, and an eye movement acquisition module, and a physiological acquisition watch on his wrist. The preprocessing software is deployed on the host computer of the cockpit system. The physiological acquisition watch transmits the collected data to the host computer via Bluetooth communication, and other acquisition devices transmit the collected data to the host computer via serial communication. The preprocessing software extracts physiological feature data from each channel data and sends it to the outside for subsequent driver status analysis.

[0064] So far, the purpose of the present invention has been achieved.

[0065] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A wearable multi-channel physiological parameter acquisition system, characterized in that: include: Wearable physiological parameter collection equipment, which consists of a multi-channel physiological collection wristwatch, an EEG collection and processing module, a blood oxygen collection earmuff, and an eye movement collection module, and is used to collect various physiological parameters of the driver and convert them into digital signals; The pre-processing software deployed on the cockpit system host computer obtains the digital signals of the driver's various physiological parameters, processes them and outputs the physiological characteristic data.

2. A wearable multi-channel physiological parameter acquisition system according to claim 1, characterized in that: The EEG acquisition and processing module is integrated on the helmet lining and is used to collect EEG signals; The eye movement acquisition module is installed on the helmet mask and is used to collect eye movement data; The blood oxygen collection earmuffs are installed on both sides of the helmet to collect ear blood oxygen data; The multi-channel physiological acquisition wristwatch is worn on the driver's wrist and is used to collect multiple physiological parameters.

3. A wearable multi-channel physiological parameter acquisition system according to claim 2, characterized in that: The system collects multiple physiological parameters through sensors integrated on the watch, and collects head-related physiological parameters through blood oxygen collection earmuffs, EEG collection modules and eye movement collection modules integrated in the helmet. The collected signals include PPG signals, skin electrodermal signals, body temperature signals, acceleration signals, EEG data and eye movement data.

4. A wearable multi-channel physiological parameter acquisition system according to claim 3, characterized in that: The multi-channel physiological data collection wristwatch includes a PPG sensor, a skin charge sensor, a body temperature sensor and an acceleration sensor, which collects the wearer's heart rate, blood oxygen, skin charge, body temperature and acceleration physiological parameters in real time, and monitors and records the wearer's physiological parameters in real time.

5. A wearable multi-channel physiological parameter acquisition system according to claim 3, characterized in that: The blood oxygen collection earmuffs integrate a PPG collection module on the noise reduction earphones in the driver's helmet, use photoplethysmography to collect the reflected light intensity of light sources of different wavelengths, and extract physiological characteristic data such as blood oxygen concentration and heart rate through algorithm calculation.

6. A wearable multi-channel physiological parameter acquisition system according to claim 3, characterized in that: The EEG acquisition and processing module is integrated into the driver's helmet as a detachable module, uses brain electrodes to record brain activity status, forms EEG data, and then performs preprocessing to improve the signal-to-noise ratio of the signal and remove artifacts, interference, and noise.

7. A wearable multi-channel physiological parameter acquisition system according to claim 3, characterized in that: The eye movement data acquisition module collects eye diagram data through an eye movement sensor, and obtains the driver's gaze point position information and pupil related information after algorithm calculation.

8. A wearable multi-channel physiological parameter acquisition system according to any one of claims 1 to 7, characterized in that: The preprocessing software performs preprocessing on the received raw physiological data of each channel, specifically including the following steps: Establish communication with the acquisition device. If the device is in normal state, the received raw physiological data will be timestamped and stored in the buffer area; Read data of a certain time window from the buffer, including pulse wave, skin electricity, acceleration, EEG signal, and viewpoint coordinates, and package them into a raw physiological data structure with a timestamp; The original physiological data structure is read, and the characteristic values ​​of the original physiological data in the time window are extracted, including heart rate, average skin electrical level, mean EEG energy, and average eye movement speed, to generate a characteristic data structure.

Images