Pilot brain consciousness state detection method, electronic device and detection system

Abstract

The invention provides a pilot brain consciousness state detection method, an electronic device and a detection system, which are applied to the technical field of biomedicine, and the method comprises the following steps: collecting a dual-channel photoelectric volume pulse wave signal of a forehead part of a to-be-detected pilot; determining a forehead blood oxygen value and a blood perfusion degree of the pilot to be detected based on the dual-channel photoelectric volume pulse wave signal; inputting the forehead blood oxygen value and the blood flow perfusion degree of the pilot to be detected into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood flow perfusion degree based on a pre-trained weight coefficient, outputting the brain consciousness state score of the pilot to be detected; and determining the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold. In this way, the brain consciousness state of the pilot can be comprehensively detected, and the accuracy of detecting the brain consciousness state of the pilot can be improved.

Description

Technical Field

[0001] The present application relates to the field of biomedical technology, and in particular to a method, an electronic device and a detection system for a pilot's brain consciousness state. Background Art

[0002] The changes in gravitational acceleration to which pilots are subjected during flight can cause dramatic changes in blood distribution throughout the body, placing tremendous pressure on the pilot's cardiovascular system. Sometimes, insufficient cerebral perfusion may lead to loss of brain consciousness, which may result in the risk of flight accidents. Therefore, it is necessary to detect the pilot's brain consciousness state during flight.

[0003] In the related technology, many methods for detecting blood oxygen in brain tissue have emerged. Although these methods can detect the blood oxygen in human brain tissue relatively accurately, and then detect the pilot's brain consciousness state, the blood oxygen detection system is susceptible to noise interference. At the same time, only through the detection of blood oxygen value, it is impossible to fully detect the pilot's brain consciousness state, and there is a problem of inaccurate brain consciousness state detection. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a method, an electronic device and a detection system for detecting the brain consciousness state of a pilot, to obtain a dual-channel photoplethysmogram signal of the forehead of the pilot to be detected, to determine the forehead blood oxygen value and blood perfusion of the pilot to be detected, to detect the brain consciousness state of the pilot to be detected in combination with the forehead blood oxygen value and blood perfusion of the pilot to be detected, to detect the brain consciousness state of the pilot in all aspects, and to help improve the accuracy of the detection of the pilot's brain consciousness state.

[0005] In a first aspect, an embodiment of the present application provides a method for detecting a pilot's brain consciousness state, which is applied to an electronic device in a system for detecting a pilot's brain consciousness state; the detection method comprises:

[0006] Collect dual-channel photoelectric volume pulse wave signals from the forehead of the pilot to be tested;

[0007] Determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal;

[0008] Inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficient, and outputs the brain consciousness state score of the pilot to be tested;

[0009] The brain consciousness state of the pilot to be detected is determined based on the brain consciousness state score and a preset state score threshold.

[0010] In a possible implementation, determining the forehead blood oxygen value and blood perfusion of the pilot to be detected based on the dual-channel photoplethysmography signal includes:

[0011] Processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal;

[0012] Based on the extracted peak and valley feature points of at least one photoplethysmogram signal, a pulsating component and a non-pulsating component of the photoplethysmogram signal are obtained;

[0013] Based on the pulsating component and the non-pulsating component, the forehead blood oxygen value and the blood perfusion degree of the pilot to be detected are determined.

[0014] In a possible implementation, the forehead blood oxygen value is determined by the following formula:

[0015]

[0016] Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue, and a, b and c are pre-calibrated constants.

[0017] In a possible implementation, the blood perfusion degree is determined by the following formula:

[0018]

[0019] Among them, P is the relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be detected in a resting state.

[0020] In a possible implementation manner, the weight coefficient is determined by the following steps:

[0021] Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state;

[0022] For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label;

[0023] If there is an inconsistency between the target brain consciousness state and the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

[0024] In a possible implementation manner, determining the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold includes:

[0025] If the brain consciousness state score is greater than or equal to the preset state score threshold, determining that the pilot to be detected has lost brain consciousness;

[0026] If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be detected is normal.

[0027] In a possible implementation, the detection method further includes:

[0028] The dual-channel photoplethysmogram signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score and the brain consciousness state of the pilot to be detected are stored according to a preset storage frequency.

[0029] In a possible implementation, the detection method further includes:

[0030] The brain consciousness state of the pilot to be detected is sent to a target client, and when the brain consciousness of the pilot to be detected is lost, a warning message is generated.

[0031] In a second aspect, an embodiment of the present application further provides an electronic device, the electronic device comprising:

[0032] An acquisition module is used to acquire dual-channel photoelectric volumetric pulse wave signals from the forehead of the pilot to be tested;

[0033] An information determination module, used to determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal;

[0034] a score calculation module, for inputting the forehead blood oxygen value and the blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the weight coefficient obtained by pre-training, and outputs the brain consciousness state score of the pilot to be tested;

[0035] The state determination module is used to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

[0036] In a third aspect, an embodiment of the present application further provides a system for detecting the brain consciousness state of a pilot, the detection system comprising the electronic device as described in the second aspect and a flexible stickable probe device; the flexible stickable probe device is worn on the forehead of the pilot to be detected;

[0037] The flexible attachable probe device is used to obtain the dual-channel photoplethysmogram signal and send the dual-channel photoplethysmogram signal to the electronic device;

[0038] The electronic device is used to determine the brain consciousness state of the pilot to be detected based on the dual-channel photoplethysmogram signal sent by the flexible stickable probe device.

[0039] In a fourth aspect, an embodiment of the present application further provides an electronic device, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the steps of the method for detecting the pilot's brain consciousness state as described in any one of the first aspects.

[0040] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for detecting the pilot's brain consciousness state as described in any one of the first aspects are executed.

[0041] The detection method, electronic device and detection system of the pilot's brain consciousness state provided in the embodiment of the present application collect dual-channel photoplethysmogram signals of the pilot's forehead to be detected; determine the forehead blood oxygen value and blood perfusion of the pilot to be detected based on the dual-channel photoplethysmogram signals; input the forehead blood oxygen value and blood perfusion of the pilot to be detected into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and blood perfusion based on the weight coefficient obtained in the pre-training, and outputs the brain consciousness state score of the pilot to be detected; determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and the preset state score threshold. In this way, the dual-channel photoplethysmogram signals of the pilot's forehead to be detected are obtained, the forehead blood oxygen value and blood perfusion of the pilot to be detected are determined, and the brain consciousness state of the pilot to be detected is detected in combination with the forehead blood oxygen value and blood perfusion of the pilot to be detected, and the brain consciousness state of the pilot is detected in all aspects, which helps to improve the accuracy of the detection of the pilot's brain consciousness state.

[0042] Furthermore, the pilot brain consciousness state detection system provided in the embodiment of the present application is portable and wearable, has low power consumption, does not affect the pilot's daily training and flight activities, and can be monitored for a long time, thereby improving the convenience and accuracy of detecting the pilot to be detected.

[0043] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 A flowchart of a method for detecting a pilot's brain consciousness state provided in an embodiment of the present application;

[0046] Figure 2 A schematic diagram of the structure of a pilot's brain consciousness state detection system provided in an embodiment of the present application;

[0047] Figure 3 A schematic diagram of wearing a pilot's brain consciousness state detection system provided in an embodiment of the present application;

[0048] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0050] Icons: 200-detection system; 210-electronic device; 211-power management module; 212-sensor module group; 213-microprocessor; 214-storage module; 215-wireless communication module; 216-acquisition module; 217-information determination module; 218-score calculation module; 219-state determination module; 220-flexible stickable probe device; 221-flexible material substrate; 222-photoelectric volumetric pulse wave sensor; 223-data transmission line; 310-bandage; 320-head bandage; 500-electronic device; 510-processor; 520-memory; 530-bus. DETAILED DESCRIPTION

[0051] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0052] First, the application scenarios to which the present application is applicable are introduced. The present application can be applied in the field of biomedical technology.

[0053] The changes in gravitational acceleration to which pilots are subjected during flight can cause dramatic changes in blood distribution throughout the body, placing tremendous pressure on the pilot's cardiovascular system. Sometimes, insufficient cerebral perfusion may lead to loss of brain consciousness, which may result in the risk of flight accidents. Therefore, it is necessary to detect the pilot's brain consciousness state during flight.

[0054] In the related technology, the pilot's brain consciousness state is generally detected by blood oxygen saturation. The traditional finger-clip oximeter can only detect the blood oxygen saturation of the human finger, and the blood oxygen in this part may not reflect the brain consciousness state. In addition, the finger-clip oximeter may hinder the pilot's driving behavior during the flight and increase the risk of pilot misoperation.

[0055] Based on this, many methods for detecting brain tissue blood oxygen have emerged. Although these methods can detect the blood oxygen of human brain tissue relatively accurately, and then detect the pilot's brain consciousness state, the blood oxygen detection system is susceptible to noise interference. At the same time, only through the detection of blood oxygen value, it is impossible to fully detect the pilot's brain consciousness state, and there is a problem of inaccurate brain consciousness state detection.

[0056] Based on this, an embodiment of the present application provides a method for detecting the pilot's brain consciousness state, so as to comprehensively detect the pilot's brain consciousness state and improve the accuracy of the pilot's brain consciousness state detection.

[0057] See also Figure 1 , Figure 1 This is a flow chart of a method for detecting the pilot's brain consciousness state provided in an embodiment of the present application. Figure 1 As shown in , the method for detecting the pilot's brain consciousness state provided by the embodiment of the present application includes:

[0058] S101, collecting dual-channel photoplethysmographic signals from the forehead of the pilot to be tested.

[0059] S102: Determine the forehead blood oxygen value and blood perfusion degree of the pilot to be tested based on the dual-channel photoplethysmogram signal.

[0060] S103, inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficient, and outputs the brain consciousness state score of the pilot to be tested.

[0061] S104. Determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

[0062] The application embodiment provides a method for detecting the brain consciousness state of a pilot, which obtains a dual-channel photoplethysmogram signal from the forehead of the pilot to be detected, determines the forehead blood oxygen value and blood perfusion of the pilot to be detected, and detects the brain consciousness state of the pilot to be detected in combination with the forehead blood oxygen value and blood perfusion of the pilot to be detected, thereby comprehensively detecting the brain consciousness state of the pilot, which helps to improve the accuracy of the detection of the pilot's brain consciousness state.

[0063] The following is a description of the exemplary steps of the present application embodiment:

[0064] S101, collecting dual-channel photoplethysmographic signals from the forehead of the pilot to be tested.

[0065] In the embodiment of the present application, the changes in gravitational acceleration to which the pilot is subjected during flight may cause drastic changes in blood distribution throughout the body, thereby placing tremendous pressure on the pilot's cardiovascular system. Sometimes, insufficient cerebral perfusion may lead to loss of brain consciousness, which may result in the risk of flight accidents. Therefore, it is necessary to detect the pilot's brain consciousness state during flight.

[0066] In the related technology, the pilot's brain consciousness state is generally detected by blood oxygen saturation. The traditional finger-clip oximeter can only detect the blood oxygen saturation of the human finger, and the blood oxygen in this part may not reflect the brain consciousness state. In addition, the finger-clip oximeter may hinder the pilot's driving behavior during the flight and increase the risk of pilot misoperation.

[0067] In a possible embodiment, the present application provides a system for detecting the brain consciousness state of a pilot; the detection system includes an electronic device and a flexible sticky probe device; the flexible sticky probe device is worn on the forehead of the pilot to be detected; the flexible sticky probe device is used to obtain the dual-channel photoplethysmogram signal and send the dual-channel photoplethysmogram signal to the electronic device; the electronic device is used to determine the brain consciousness state of the pilot to be detected based on the dual-channel photoplethysmogram signal sent by the flexible sticky probe device.

[0068] The flexible stickable probe device can be in close contact with the forehead skin surface of the pilot to be tested to obtain dual-wavelength photoelectric volumetric pulse wave signals; the electronic device is the core carrier of the detection system's calculation, storage, data transmission and other functions. The electronic device and the flexible stickable probe device are electrically connected by a data transmission line.

[0069] In one possible implementation, see Figure 2 , Figure 2 The structural diagram of the detection system of the pilot's brain consciousness state provided in the embodiment of the present application, the detection system 200 includes an electronic device 210 and a flexible stickable probe device 220; the flexible stickable probe device 220 is composed of a flexible material substrate 221, a photoelectric volumetric pulse wave sensor 222, and a data transmission line 223. Among them, the flexible material substrate 221 is attached to the skin of the forehead of the pilot to be detected, and the photoelectric volumetric pulse wave sensor 222 is placed in the center of the flexible material substrate. The photoelectric volumetric pulse wave sensor 222 has two red light / infrared light diode light source transmitters and a photoelectric receiving device built in. The electronic device 210 includes a power management module 211, a sensor module group 212, a microprocessor 213, a storage module 214 and a wireless communication module 215.

[0070] For example, see Figure 3 , Figure 3 This is a schematic diagram of wearing a pilot's brain consciousness state detection system provided in an embodiment of the present application; Figure 3 As shown in the figure, the electronic device 210 of the testing system can be attached to the waist and abdomen of the pilot to be tested by means of a strap 310, and the flexible stickable probe device 220 can be fixed to the forehead of the pilot to be tested by means of a stretchable head bandage 320.

[0071] Specifically, in the first aspect, the power management module 211 uses a rechargeable lithium battery to provide a reliable power source for other modules of the system.

[0072] Exemplarily, the power management module 211 may use a rechargeable lithium battery with a capacity of 300 mAh, and provide a reliable power supply for other modules of the detection system through a 3V / 2.1V linear voltage regulator circuit.

[0073] In the second aspect, the sensor module group 212 includes a dual-channel photoelectric volumetric pulse wave signal acquisition sensor. The optical probe of the photoelectric volumetric pulse wave sensor is exposed, and the dual-channel pulse wave signal of the forehead of the pilot to be tested is collected by using the reflection principle.

[0074] Exemplarily, the sensor module group 212 can use an ultra-low power integrated analog front end AFE4900 to collect photoplethysmographic signals. The optical probe of the sensor module group is exposed and includes an LED light source transmitter and a photoelectric receiving sensor. When the light emitted by the light source irradiates human tissue, the absorption of light by muscles, skin, etc. is a relatively stable value. Due to the relaxation and contraction of the heart, the filling degree of subcutaneous capillaries in the human body changes, and the change in blood flow causes the absorption of light in the blood to show periodic changes. The photoelectric sensor can convert this light intensity into an electrical signal output, and the photoplethysmographic signal can be obtained after further processing by the program.

[0075] Thirdly, the microprocessor 213 is equipped with a brain consciousness state calculation program based on forehead blood oxygen and blood perfusion, completing the detection process of the brain consciousness state of the pilot to be detected in the entire system.

[0076] Exemplarily, the microprocessor 213 may adopt a CC2640R2F chip.

[0077] Fourthly, the storage module 214 can save the collected original signals and various calculated parameters in real time.

[0078] Exemplarily, the storage module 214 can store the collected dual-channel photoplethysmogram signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score and the brain consciousness state of the pilot to be tested, so as to provide data reference for analyzing the brain consciousness state of different pilots to be tested or for taking subsequent treatment measures.

[0079] Fifthly, the wireless communication module 215 can send the results in real time to a target client such as a smart phone or a computer that has display and warning functions.

[0080] For example, the wireless communication module can send the measurement results to a target client such as a smartphone or computer with display and warning functions through a set low-power Bluetooth, 4G or other wireless communication technology. The communication information transmission process can be completed through the 2.4GHz radio frequency part inside the CC2640R2F.

[0081] In the embodiment of the present application, the detection system of the pilot's brain consciousness state is portable and wearable, has low power consumption, does not affect the pilot's daily training and flight activities, and can be monitored for a long time, thereby improving the convenience and accuracy of detecting the pilot to be detected.

[0082] Furthermore, a specific detection method after obtaining the dual-channel photoplethysmography signal in the electronic device 210 is described.

[0083] S102: Determine the forehead blood oxygen value and blood perfusion degree of the pilot to be tested based on the dual-channel photoplethysmogram signal.

[0084] In the embodiment of the present application, after obtaining the dual-channel photoplethysmogram signal, the dual-channel photoplethysmogram signal needs to be processed to determine the pulsating component and the non-pulsating component of the dual-channel photoplethysmogram signal, and obtain the forehead blood oxygen value and blood perfusion of the pilot to be tested, and then the brain consciousness state of the pilot to be tested is detected by combining the forehead blood oxygen value and blood perfusion of the pilot to be tested.

[0085] Specifically, the step of "determining the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal" includes:

[0086] a1: Processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal.

[0087] a2: Based on the extracted peak and valley feature points of at least one photoplethysmography signal, a pulsating component and a non-pulsating component of the photoplethysmography signal are obtained.

[0088] a3: Based on the pulsating component and the non-pulsating component, determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected.

[0089] In an embodiment of the present application, the dual-channel photoplethysmography signal may be processed by wavelet decomposition. Furthermore, a quadratic spline wavelet basis is selected to decompose the original signal into signal components with different resolutions at different scales, and signal components that can highlight signal feature points are obtained. Exemplarily, three layers of wavelet components may be selected, and based on the local maximum principle, at least one peak and valley feature point of the photoplethysmography signal may be determined from the processed dual-channel photoplethysmography signal.

[0090] Furthermore, the pulsating component and the non-pulsating component of the photoplethysmography signal are calculated and determined by determining the peak and valley characteristic points of at least one photoplethysmography signal.

[0091] In a possible implementation, the pulsating component and the non-pulsating component of the photoplethysmography signal may be determined by the following formula:

[0092] I AC =A peak -A valley ;

[0093]

[0094] Among them, I AC is the pulsating component of the photoplethysmographic signal; I DC A is the non-pulsating component of the photoplethysmographic signal; paek is the peak value of the photoplethysmographic signal; A valley is the valley value of the photoplethysmogram signal.

[0095] Furthermore, after the pulsating component and the non-pulsating component of the photoplethysmogram signal are determined, the forehead blood oxygen value and the blood perfusion degree of the pilot to be tested can be calculated by using the determined pulsating component and the non-pulsating component of the photoplethysmogram signal.

[0096] In a possible implementation, the forehead blood oxygen value may be calculated by detecting changes in the intensity of light reflected by forehead tissue at two different wavelengths of red light and infrared light. Specifically, the forehead blood oxygen value may be determined by the following formula:

[0097]

[0098] Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue, and a, b and c are pre-calibrated constants.

[0099] In a possible implementation, the blood perfusion degree may be calculated by detecting the ratio of the AC pulsation component in the super-weightlessness state to that in the resting state. Specifically, the blood perfusion degree is determined by the following formula:

[0100]

[0101] Among them, P is the relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be detected in a resting state.

[0102] In a possible implementation, a smaller value of the relative blood perfusion degree indicates a lower blood perfusion degree; conversely, a smaller value indicates a higher blood perfusion degree.

[0103] Furthermore, after the forehead blood oxygen value and blood perfusion of the pilot to be tested are determined based on the dual-channel photoplethysmography signal, the brain consciousness state score of the pilot to be tested can be determined by weighted calculation of the forehead blood oxygen value and blood perfusion.

[0104] S103, inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficient, and outputs the brain consciousness state score of the pilot to be tested.

[0105] In a possible implementation manner, the brain consciousness state score of the pilot to be detected may be determined by the following formula.

[0106] Score=W SpO2 *SpO2+W p *P;

[0107] Among them, Score is the brain consciousness score of the pilot to be tested; SpO2 is the forehead blood oxygen value of the pilot to be tested; P is the relative blood perfusion of the pilot to be tested; W SpO2 W is the blood oxygen weighting coefficient; P is the blood perfusion weighting coefficient.

[0108] In a possible implementation, the blood oxygen weighting coefficient and the blood perfusion weighting coefficient can be obtained through training according to the sample data composed of the historical measurement quantity of the pilot to be tested during the actual measurement process. The neural network model is trained by obtaining multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees and corresponding sample brain consciousness state labels to obtain a brain consciousness state score prediction model, and then the weight coefficient in the brain consciousness state score prediction model is determined to ensure that the brain consciousness state score prediction model can perform weighted calculations on the forehead blood oxygen value and blood perfusion degree according to the trained weight coefficients to obtain the pilot's brain consciousness state score.

[0109] Specifically, the weight coefficient is determined by the following steps:

[0110] b1: Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees and corresponding sample brain consciousness state labels, input them into the pre-built neural network model, and output the target brain consciousness state.

[0111] b2: For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label.

[0112] b3: If there is an inconsistency between the target brain consciousness state and the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

[0113] In one possible implementation, in addition to determining whether the training of the neural network model is completed by comparing the target brain consciousness state with the sample brain consciousness state label, the training of the neural network model can also be completed by iterating the neural network model multiple times and determining that the number of iterations is greater than a preset iteration threshold, or the convergence function value of the neural network model is less than a preset function value.

[0114] In a possible implementation, the trained neural network model is directly applied, and the forehead blood oxygen value and blood perfusion degree of the pilot to be tested are input into the trained brain consciousness state score prediction model. The brain consciousness state score prediction model outputs the brain consciousness state score of the pilot to be tested, and then the brain consciousness state of the pilot to be tested is determined, thereby reducing the calculation steps for the brain consciousness state score and improving the efficiency of detecting the brain consciousness state of the pilot to be tested.

[0115] Furthermore, after obtaining the brain consciousness state score by weighted calculation of the forehead blood oxygen value and the blood perfusion degree, the brain consciousness state score can be compared with a preset state score threshold to determine the brain consciousness state of the pilot to be tested.

[0116] S104. Determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

[0117] Specifically, the step of “determining the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold” includes:

[0118] c1: If the brain consciousness state score is greater than or equal to the preset state score threshold, it is determined that the pilot to be detected has lost brain consciousness.

[0119] c2: If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be tested is normal.

[0120] Specifically, the specific judgment process can be expressed by the following formula:

[0121]

[0122] Among them, Status is the brain consciousness state of the pilot to be tested; Score is the brain consciousness state score of the pilot to be tested; S threshold is the preset status score threshold.

[0123] In a possible implementation, the preset state score threshold can be determined based on a mapping relationship between the brain consciousness state score and the brain consciousness state of the pilot to be detected in a historical process, and the preset state score threshold can be updated based on an update of the mapping relationship between the detected brain consciousness state score and the brain consciousness state of the pilot.

[0124] Furthermore, in order to analyze the brain consciousness states of different pilots to be tested, or to provide data reference when taking subsequent treatment measures, or to update the weight coefficient of the brain state consciousness score in real time according to the data of the pilots to be tested to improve the accuracy of the brain state consciousness score calculation, the obtained parameter information can be stored.

[0125] Specifically, the detection method further includes:

[0126] d1: storing the dual-channel photoplethysmography signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score and the brain consciousness state of the pilot to be tested at a preset storage frequency.

[0127] In a possible implementation, the storage frequency of the dual-channel photoplethysmogram signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be detected can be stored in real time, that is, the dual-channel photoplethysmogram signal is collected, or the forehead blood oxygen value and blood perfusion are calculated and stored immediately; it can also be stored uniformly within a period of time according to a preset time frequency.

[0128] Among them, when storing, it can be stored according to the data set, that is, the calculated forehead blood oxygen value and blood perfusion degree, the corresponding brain consciousness state score and the brain consciousness state (normal or lost) of the pilot to be tested are stored in the same data set, so as to perform data analysis according to the corresponding data set later.

[0129] In a possible implementation, the stored information in an earlier historical time period may be deleted according to a preset update frequency to save storage space of the detection system.

[0130] Furthermore, the electronic device can be connected to the target client through the communication module, and the current detection data and corresponding warning information can be sent to the target client, thereby issuing a warning on the status of the pilot to be detected, so as to facilitate the subsequent adoption of corresponding remedial measures.

[0131] Specifically, the detection method further includes:

[0132] e1: Sending the brain consciousness state of the pilot to be detected to the target client, and generating early warning information when the pilot to be detected loses brain consciousness.

[0133] In a possible implementation, after determining that the pilot to be tested has lost consciousness, a warning message is directly generated and sent to the target client. The warning message can be displayed on the screen of the target client in the form of a pop-up window, promptly notifying the current crisis situation of the pilot to be tested of the consciousness zombie, so as to facilitate the relevant personnel to take corresponding remedial measures.

[0134] In another possible implementation, if the current pilot's brain consciousness state is normal, the pilot's brain consciousness state or data such as forehead blood oxygen value and blood perfusion degree can be transmitted to the target client at a preset transmission frequency, so that relevant personnel can collect the status information of the pilot to be tested and monitor the pilot to be tested.

[0135] Exemplarily, the target client may be a device such as a smart phone or a computer that has display and warning functions.

[0136] The method for detecting the brain consciousness state of a pilot provided in the embodiment of the present application collects a dual-channel photoplethysmogram signal of the forehead of the pilot to be detected; based on the dual-channel photoplethysmogram signal, determines the forehead blood oxygen value and blood perfusion of the pilot to be detected; inputs the forehead blood oxygen value and blood perfusion of the pilot to be detected into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and blood perfusion based on the weight coefficient obtained in the pre-training, and outputs the brain consciousness state score of the pilot to be detected; based on the brain consciousness state score and the preset state score threshold, determines the brain consciousness state of the pilot to be detected. In this way, the dual-channel photoplethysmogram signal of the forehead of the pilot to be detected is obtained, the forehead blood oxygen value and blood perfusion of the pilot to be detected are determined, and the brain consciousness state of the pilot to be detected is detected in combination with the forehead blood oxygen value and blood perfusion of the pilot to be detected, and the brain consciousness state of the pilot is detected in all aspects, which helps to improve the accuracy of the detection of the pilot's brain consciousness state.

[0137] Based on the same inventive concept, an electronic device for use in a method for detecting a pilot's brain consciousness state is also provided in an embodiment of the present application. Since the principle of solving the problem by the device in the embodiment of the present application is similar to the method for detecting a pilot's brain consciousness state in the embodiment of the present application, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0138] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown in , the electronic device 210 includes:

[0139] The acquisition module 216 is used to acquire a dual-channel photoplethysmogram signal from the forehead of the pilot to be tested;

[0140] An information determination module 217, configured to determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal;

[0141] The score calculation module 218 is used to input the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficient, and outputs the brain consciousness state score of the pilot to be tested;

[0142] The state determination module 219 is used to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

[0143] In a possible implementation manner, when the information determination module 217 is used to determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal, the information determination module 217 is used to:

[0144] Processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal;

[0145] Based on the extracted peak and valley feature points of at least one photoplethysmogram signal, a pulsating component and a non-pulsating component of the photoplethysmogram signal are obtained;

[0146] Based on the pulsating component and the non-pulsating component, the forehead blood oxygen value and the blood perfusion degree of the pilot to be detected are determined.

[0147] In a possible implementation, the information determination module 217 is used to determine the forehead blood oxygen value by using the following formula:

[0148]

[0149] Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue, and a, b and c are pre-calibrated constants.

[0150] In a possible implementation, the information determination module 217 is used to determine the blood perfusion degree by using the following formula:

[0151]

[0152] Among them, P is the relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be detected in a resting state.

[0153] In a possible implementation manner, the electronic device 210 further includes a coefficient determination module (not shown in the figure); the coefficient determination module is used to determine the weight coefficient through the following steps:

[0154] Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state;

[0155] For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label;

[0156] If there is an inconsistency between the target brain consciousness state and the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, and obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

[0157] In a possible implementation manner, when the state determination module 219 is used to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold, the state determination module 219 is used to:

[0158] If the brain consciousness state score is greater than or equal to the preset state score threshold, determining that the pilot to be detected has lost brain consciousness;

[0159] If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be detected is normal.

[0160] In a possible implementation, the electronic device 210 further includes a storage module, and the storage module is used to:

[0161] The dual-channel photoplethysmogram signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score and the brain consciousness state of the pilot to be detected are stored according to a preset storage frequency.

[0162] In a possible implementation, the electronic device 210 further includes a wireless communication module, and the wireless communication module is used to:

[0163] The brain consciousness state of the pilot to be detected is sent to a target client, and when the brain consciousness of the pilot to be detected is lost, a warning message is generated.

[0164] The electronic device provided in the embodiment of the present application collects a dual-channel photoplethysmogram signal of the forehead of the pilot to be detected; based on the dual-channel photoplethysmogram signal, determines the forehead blood oxygen value and blood perfusion of the pilot to be detected; inputs the forehead blood oxygen value and blood perfusion of the pilot to be detected into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and blood perfusion based on the weight coefficient obtained in the pre-training, and outputs the brain consciousness state score of the pilot to be detected; based on the brain consciousness state score and the preset state score threshold, determines the brain consciousness state of the pilot to be detected. In this way, the dual-channel photoplethysmogram signal of the forehead of the pilot to be detected is obtained, the forehead blood oxygen value and blood perfusion of the pilot to be detected are determined, and the brain consciousness state of the pilot to be detected is detected in combination with the forehead blood oxygen value and blood perfusion of the pilot to be detected, and the brain consciousness state of the pilot is detected in all aspects, which helps to improve the accuracy of the detection of the pilot's brain consciousness state.

[0165] See also Figure 5 , Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown in , the electronic device 500 includes a processor 510 , a memory 520 and a bus 530 .

[0166] The memory 520 stores machine-readable instructions executable by the processor 510. When the electronic device 500 is running, the processor 510 communicates with the memory 520 via the bus 530. When the machine-readable instructions are executed by the processor 510, the above-mentioned Figure 1 The steps of the method for detecting the pilot's brain consciousness state in the method embodiment shown in the embodiment and the specific implementation method thereof can be referred to the method embodiment, which will not be described in detail here.

[0167] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 The steps of the method for detecting the pilot's brain consciousness state in the method embodiment shown in the embodiment and the specific implementation method thereof can be referred to the method embodiment, which will not be described in detail here.

[0168] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0169] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0170] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0171] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0172] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0173] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for detecting the pilot's brain consciousness state, characterized in that: An electronic device used in a system for detecting a pilot's brain consciousness state; the detection method comprises: Collect dual-channel photoelectric volume pulse wave signals from the forehead of the pilot to be tested; Determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal; Inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficient, and outputs the brain consciousness state score of the pilot to be tested; The brain consciousness state of the pilot to be detected is determined based on the brain consciousness state score and a preset state score threshold.

2. The detection method according to claim 1, characterized in that: The step of determining the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmogram signal includes: Processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal; Based on the extracted peak and valley feature points of at least one photoplethysmogram signal, a pulsating component and a non-pulsating component of the photoplethysmogram signal are obtained; Based on the pulsating component and the non-pulsating component, the forehead blood oxygen value and the blood perfusion degree of the pilot to be detected are determined.

3. The detection method according to claim 2, characterized in that: The forehead blood oxygen value is determined by the following formula: Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; It is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; a, b and c are pre-calibrated constants.

4. The detection method according to claim 2, characterized in that: The blood perfusion degree is determined by the following formula: Among them, P is the relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be detected in a resting state.

5. The detection method according to claim 1, characterized in that: The weight coefficient is determined by the following steps: Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state; For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label; If there is an inconsistency between the target brain consciousness state and the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and the sample blood perfusion degree is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

6. The detection method according to claim 1, characterized in that: The determining the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold includes: If the brain consciousness state score is greater than or equal to the preset state score threshold, determining that the pilot to be detected has lost brain consciousness; If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be detected is normal.

7. The detection method according to claim 1, characterized in that: The detection method further comprises: The dual-channel photoplethysmogram signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score and the brain consciousness state of the pilot to be detected are stored according to a preset storage frequency.

8. The detection method according to claim 1, characterized in that: The detection method further comprises: The brain consciousness state of the pilot to be detected is sent to a target client, and when the brain consciousness of the pilot to be detected is lost, a warning message is generated.

9. An electronic device, characterized in that: The electronic device comprises: An acquisition module is used to acquire dual-channel photoelectric volumetric pulse wave signals from the forehead of the pilot to be tested; An information determination module, used to determine the forehead blood oxygen value and blood perfusion degree of the pilot to be detected based on the dual-channel photoplethysmography signal; a score calculation module, used for inputting the forehead blood oxygen value and the blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the weight coefficient obtained by pre-training, and outputs the brain consciousness state score of the pilot to be tested; The state determination module is used to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

10. A system for detecting the pilot's brain consciousness state, characterized in that: The detection system comprises the electronic device as claimed in claim 9 and a flexible stickable probe device; the flexible stickable probe device is worn on the forehead of the pilot to be detected; The flexible attachable probe device is used to obtain the dual-channel photoplethysmogram signal and send the dual-channel photoplethysmogram signal to the electronic device; The electronic device is used to determine the brain consciousness state of the pilot to be detected based on the dual-channel photoplethysmogram signal sent by the flexible stickable probe device.

Images