A method, electronic device and detection system for detecting the pilot's brain consciousness state

Abstract

The present application provides a method, electronic device, and detection system for detecting a pilot's brain consciousness state, which are applied to the field of biomedical technology. The method collects a dual-channel photoplethysmography signal from the pilot's forehead; determines the pilot's forehead blood oxygen level and blood perfusion based on the dual-channel photoplethysmography signal; inputs the pilot's forehead blood oxygen level and blood perfusion into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state prediction model performs a weighted calculation on the forehead blood oxygen level and blood perfusion based on the pre-trained weight coefficients and outputs the pilot's brain consciousness state score; and determines the pilot's brain consciousness state based on the brain consciousness state score and a preset state score threshold. In this way, the pilot's brain consciousness state can be comprehensively detected, which helps to improve the accuracy of the pilot's brain consciousness state detection.

Description

Technical Field

[0001] The present application relates to the field of biomedical technology, and in particular to a method, electronic device, and detection system for detecting a pilot's brain consciousness state. Background Art

[0002] The changes in gravitational acceleration to which pilots are subjected during flight can cause dramatic changes in blood distribution throughout the body, placing enormous pressure on the pilot's cardiovascular system. Sometimes, insufficient cerebral perfusion can lead to loss of consciousness, potentially leading to the risk of flight accidents. Therefore, it is necessary to monitor the pilot's state of consciousness during flight.

[0003] Numerous methods for measuring brain tissue blood oxygen have emerged. While these methods can accurately measure brain tissue blood oxygen levels and, in turn, the pilot's state of consciousness, they are susceptible to noise interference. Furthermore, measuring blood oxygen levels alone cannot fully assess a pilot's state of consciousness, leading to inaccurate brain consciousness measurements. Summary of the Invention

[0004] In view of this, the purpose of the present application is to provide a method, electronic device, and detection system for detecting the pilot's brain consciousness state, which obtains a dual-channel photoplethysmography signal from the pilot's forehead to be detected, determines the pilot's forehead blood oxygen value and blood perfusion, and detects the pilot's brain consciousness state in combination with the pilot's forehead blood oxygen value and blood perfusion, thereby comprehensively detecting the pilot's brain consciousness state and helping to improve the accuracy of the pilot's brain consciousness state detection.

[0005] In a first aspect, embodiments of the present application provide a method for detecting a pilot's brain consciousness state, which is applied to an electronic device in a system for detecting a pilot's brain consciousness state. The detection method includes:

[0006] Collect dual-channel photoplethysmography signals from the pilot's forehead;

[0007] determining the forehead blood oxygen value and blood perfusion degree of the pilot to be tested based on the dual-channel photoplethysmography signal;

[0008] Inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficients, and outputs the brain consciousness state score of the pilot to be tested;

[0009] The brain consciousness state of the pilot to be detected is determined based on the brain consciousness state score and a preset state score threshold.

[0010] In a possible implementation, determining the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal includes:

[0011] processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal;

[0012] obtaining a pulsating component and a non-pulsating component of the photoplethysmography signal based on the extracted peak and valley feature points of the at least one photoplethysmography signal;

[0013] Based on the pulsating component and the non-pulsating component, the forehead blood oxygen value and the blood perfusion degree of the pilot to be detected are determined.

[0014] In one possible implementation, the forehead blood oxygen value is determined by the following formula:

[0015]

[0016] Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue, and a, b and c are pre-calibrated constants.

[0017] In one possible implementation, the blood perfusion degree is determined by the following formula:

[0018]

[0019] Wherein, P is relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be tested in a resting state.

[0020] In a possible implementation, the weight coefficient is determined by the following steps:

[0021] Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state;

[0022] For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and sample blood perfusion degree is consistent with the sample brain consciousness state label;

[0023] If the target brain consciousness state is inconsistent with the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and sample blood perfusion is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

[0024] In one possible implementation, determining the brain consciousness state of the pilot to be tested based on the brain consciousness state score and a preset state score threshold includes:

[0025] If the brain consciousness state score is greater than or equal to the preset state score threshold, determining that the pilot to be tested has lost brain consciousness;

[0026] If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be tested is normal.

[0027] In a possible embodiment, the detection method further includes:

[0028] The dual-channel photoplethysmography signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be tested are stored according to a preset storage frequency.

[0029] In a possible embodiment, the detection method further includes:

[0030] The brain consciousness state of the pilot to be detected is sent to a target client, and when the brain consciousness of the pilot to be detected is lost, an early warning message is generated.

[0031] In a second aspect, an embodiment of the present application further provides an electronic device, comprising:

[0032] An acquisition module, used to collect dual-channel photoplethysmography signals from the forehead of the pilot to be tested;

[0033] an information determination module, configured to determine the forehead blood oxygen value and blood perfusion degree of the pilot to be tested based on the dual-channel photoplethysmography signal;

[0034] a score calculation module, configured to input the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs a weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficients, and output a brain consciousness state score of the pilot to be tested;

[0035] The state determination module is used to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

[0036] In a third aspect, an embodiment of the present application further provides a system for detecting a pilot's brain consciousness state, the detection system comprising the electronic device described in the second aspect and a flexible, attachable probe device; the flexible, attachable probe device is worn on the forehead of the pilot to be detected;

[0037] The flexible, attachable probe device is used to obtain the dual-channel photoplethysmography signal and send the dual-channel photoplethysmography signal to the electronic device;

[0038] The electronic device is used to determine the brain consciousness state of the pilot to be tested based on the dual-channel photoplethysmography signal sent by the flexible adhesive probe device.

[0039] In a fourth aspect, an embodiment of the present application further provides an electronic device comprising: a processor, a storage medium, and a bus, wherein the storage medium stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the storage medium communicate via the bus, and the processor executes the machine-readable instructions to perform the steps of the method for detecting the pilot's brain consciousness state as described in any one of the first aspects.

[0040] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method for detecting the pilot's brain consciousness state as described in any one of the first aspects are executed.

[0041] The present invention provides a method, electronic device, and detection system for detecting the pilot's brain consciousness state. The method collects dual-channel photoplethysmography (PPE) signals from the pilot's forehead; determines the pilot's forehead blood oxygen level and blood perfusion based on the PPE signals; inputs the pilot's forehead blood oxygen level and blood perfusion into a pre-trained brain consciousness state score prediction model, which then performs a weighted calculation on the forehead PPE and blood perfusion based on pre-trained weight coefficients and outputs a brain consciousness state score for the pilot; and determines the pilot's brain consciousness state based on the brain consciousness state score and a preset state score threshold. In this way, the dual-channel PPE signals are acquired from the pilot's forehead to determine the pilot's forehead PPE and blood perfusion. The pilot's brain consciousness state is then detected based on the PPE and blood perfusion signals, providing a comprehensive assessment of the pilot's brain consciousness state and improving the accuracy of brain consciousness state detection.

[0042] Furthermore, the pilot brain consciousness state detection system provided in the embodiment of the present application is portable and wearable, has low power consumption, does not affect the pilot's daily training and flight activities, and can be used for long-term monitoring, thereby improving the convenience and accuracy of detecting the pilot to be detected.

[0043] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 A flowchart of a method for detecting a pilot's brain consciousness state provided in an embodiment of the present application;

[0046] Figure 2 This is a schematic diagram of the structure of the pilot brain consciousness state detection system provided in an embodiment of the present application;

[0047] Figure 3 A schematic diagram of a pilot's brain consciousness state detection system provided in an embodiment of the present application;

[0048] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0050] Icons: 200-detection system; 210-electronic device; 211-power management module; 212-sensor module group; 213-microprocessor; 214-storage module; 215-wireless communication module; 216-acquisition module; 217-information determination module; 218-score calculation module; 219-state determination module; 220-flexible attachable probe device; 221-flexible material substrate; 222-photoplethysmography sensor; 223-data transmission line; 310-strap; 320-head bandage; 500-electronic device; 510-processor; 520-memory; 530-bus. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application for which protection is claimed, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work falls within the scope of protection of the present application.

[0052] First, the application scenarios to which this application is applicable are introduced. This application can be applied in the field of biomedical technology.

[0053] The changes in gravitational acceleration to which pilots are subjected during flight can cause dramatic changes in blood distribution throughout the body, placing enormous pressure on the pilot's cardiovascular system. Sometimes, insufficient cerebral perfusion can lead to loss of consciousness, potentially leading to the risk of flight accidents. Therefore, it is necessary to monitor the pilot's state of consciousness during flight.

[0054] Prior art typically uses blood oxygen saturation to monitor a pilot's state of consciousness. Traditional finger-clip oximeters can only measure blood oxygen saturation in the fingertips, which may not reflect the pilot's state of consciousness. Furthermore, finger-clip oximeters can interfere with pilots' flight behavior and increase the risk of operational errors.

[0055] Based on this, many methods for measuring brain tissue blood oxygen have emerged. Although these methods can relatively accurately measure blood oxygen in human brain tissue and, in turn, detect the pilot's state of consciousness, the blood oxygen detection system is susceptible to noise interference. Furthermore, measuring blood oxygen levels alone cannot fully assess the pilot's state of consciousness, leading to inaccurate brain consciousness detection.

[0056] Based on this, an embodiment of the present application provides a method for detecting a pilot's brain consciousness state, so as to comprehensively detect the pilot's brain consciousness state and improve the accuracy of the detection of the pilot's brain consciousness state.

[0057] See also Figure 1 , Figure 1 This is a flow chart of a method for detecting a pilot's brain consciousness state provided in an embodiment of the present application. Figure 1 As shown in , the method for detecting the pilot's brain consciousness state provided by the embodiment of the present application includes:

[0058] S101. Collect a dual-channel photoplethysmography signal from the forehead of the pilot to be tested.

[0059] S102: Determine the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal.

[0060] S103: Input the forehead blood oxygen value and blood perfusion rate of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs a weighted calculation on the forehead blood oxygen value and the blood perfusion rate based on the pre-trained weight coefficients, and outputs the brain consciousness state score of the pilot to be tested.

[0061] S104: Determine the brain consciousness state of the pilot to be tested based on the brain consciousness state score and a preset state score threshold.

[0062] The application embodiment provides a method for detecting a pilot's brain consciousness state, which obtains a dual-channel photoplethysmography signal from the pilot's forehead to determine the pilot's forehead blood oxygen value and blood perfusion. The pilot's brain consciousness state is then detected based on the pilot's forehead blood oxygen value and blood perfusion. This method comprehensively detects the pilot's brain consciousness state, helping to improve the accuracy of the pilot's brain consciousness state detection.

[0063] The following describes the exemplary steps of the embodiment of the present application:

[0064] S101. Collect a dual-channel photoplethysmography signal from the forehead of the pilot to be tested.

[0065] In the embodiment of the present application, the changes in gravitational acceleration to which the pilot is subjected during flight may cause drastic changes in blood distribution throughout the body, thereby placing tremendous pressure on the pilot's cardiovascular system. Sometimes, insufficient cerebral perfusion may lead to loss of brain consciousness, which may result in the risk of flight accidents. Therefore, it is necessary to detect the pilot's brain consciousness state during flight.

[0066] Prior art typically uses blood oxygen saturation to monitor a pilot's state of consciousness. Traditional finger-clip oximeters can only measure blood oxygen saturation in the fingertips, which may not reflect the pilot's state of consciousness. Furthermore, finger-clip oximeters can interfere with pilots' flight behavior and increase the risk of operational errors.

[0067] In one possible embodiment, the present application provides a system for detecting the brain consciousness state of a pilot; the detection system includes an electronic device and a flexible, attachable probe device; the flexible, attachable probe device is worn on the forehead of the pilot to be detected; the flexible, attachable probe device is used to obtain the dual-channel photoplethysmography signal and send the dual-channel photoplethysmography signal to the electronic device; the electronic device is used to determine the brain consciousness state of the pilot to be detected based on the dual-channel photoplethysmography signal sent by the flexible, attachable probe device.

[0068] The flexible, attachable probe device is designed to maintain close contact with the pilot's forehead skin to acquire dual-wavelength photoplethysmography signals. The electronic device is the core component of the system's computing, storage, and data transmission functions. The electronic device and the flexible, attachable probe device are electrically connected via a data transmission cable.

[0069] In one possible implementation, see Figure 2 , Figure 2 This is a schematic diagram of the structure of a pilot's brain consciousness state detection system provided in an embodiment of the present application. Detection system 200 includes an electronic device 210 and a flexible, attachable probe device 220. The flexible, attachable probe device 220 is composed of a flexible material substrate 221, a photoplethysmography sensor 222, and a data transmission line 223. The flexible material substrate 221 is attached to the skin of the pilot's forehead to be tested, and the photoplethysmography sensor 222 is placed in the center of the flexible material substrate. The photoplethysmography sensor 222 has two built-in red / infrared light diode light emitters and a photoelectric receiver. The electronic device 210 includes a power management module 211, a sensor module group 212, a microprocessor 213, a storage module 214, and a wireless communication module 215.

[0070] For example, see Figure 3 , Figure 3 This is a schematic diagram of the pilot's brain consciousness state detection system provided in the embodiment of the present application; Figure 3 As shown in FIG, the electronic device 210 of the detection system can be attached to the waist and abdomen of the pilot to be detected by a strap 310, and the flexible adhesive probe device 220 can be fixed to the forehead of the pilot to be detected by a stretchable head bandage 320.

[0071] Specifically, in a first aspect, the power management module 211 uses a rechargeable lithium battery to provide a reliable power source for other modules of the system.

[0072] For example, the power management module 211 may use a rechargeable lithium battery with a capacity of 300 mAh, and provide a reliable power supply for other modules of the detection system through a 3V / 2.1V linear voltage regulator circuit.

[0073] Secondly, the sensor module group 212 includes a dual-channel photoplethysmography signal acquisition sensor. The optical probe of the photoplethysmography sensor is exposed, and it uses the reflection principle to collect dual-channel pulse wave signals from the forehead of the pilot to be tested.

[0074] Exemplarily, the sensor module group 212 can use an ultra-low power integrated analog front-end AFE4900 to collect photoplethysmography signals. The optical probe of the sensor module group is exposed and includes an LED light source transmitter and a photoelectric receiving sensor. When the light emitted by the light source irradiates human tissue, the absorption of light by muscles, skin, etc. is a relatively stable value. However, due to the relaxation and contraction of the heart, the filling degree of the subcutaneous capillaries of the human body changes, and the change in blood flow causes the absorption of light in the blood to show periodic changes. The photoelectric sensor can convert this light intensity into an electrical signal output, and the photoplethysmography signal can be obtained after further processing by the program.

[0075] Thirdly, the microprocessor 213 is equipped with a brain consciousness state calculation program based on forehead blood oxygen and blood perfusion, completing the detection process of the brain consciousness state of the pilot to be tested in the entire system.

[0076] For example, the microprocessor 213 may be a CC2640R2F chip.

[0077] Fourthly, the storage module 214 can save the collected original signals and various calculated parameters in real time.

[0078] Exemplarily, the storage module 214 can store the collected dual-channel photoplethysmography signals, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be tested, so as to provide data reference for analyzing the brain consciousness state of different pilots to be tested or for subsequent treatment measures.

[0079] Fifthly, the wireless communication module 215 can send the results in real time to target clients such as smart phones and computers that have display and warning functions.

[0080] For example, the wireless communication module can transmit the measurement results to a target client such as a smartphone or computer with display and warning functions via a wireless communication technology such as low-power Bluetooth or 4G. The communication information transmission process can be completed via the 2.4GHz radio frequency part within the CC2640R2F.

[0081] In the embodiment of the present application, the pilot's brain consciousness state detection system is portable and wearable, has low power consumption, does not affect the pilot's daily training and flight activities, and can be monitored for a long time, thereby improving the convenience and accuracy of the detection of the pilot to be tested.

[0082] Furthermore, a specific detection method after obtaining the dual-channel photoplethysmography signal in the electronic device 210 is described.

[0083] S102: Determine the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal.

[0084] In an embodiment of the present application, after obtaining the dual-channel photoplethysmography signal, the dual-channel photoplethysmography signal needs to be processed to determine the pulsating component and the non-pulsating component of the dual-channel photoplethysmography signal, and obtain the forehead blood oxygen value and blood perfusion of the pilot to be tested, and then the brain consciousness state of the pilot to be tested is detected by combining the forehead blood oxygen value and blood perfusion of the pilot to be tested.

[0085] Specifically, the step of "determining the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal" includes:

[0086] a1: Processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal.

[0087] a2: Based on the extracted peak and valley feature points of at least one photoplethysmography signal, obtain the pulsating component and the non-pulsating component of the photoplethysmography signal.

[0088] a3: Determine the forehead blood oxygen value and blood perfusion degree of the pilot to be tested based on the pulsating component and the non-pulsating component.

[0089] In an embodiment of the present application, the dual-channel photoplethysmography signal can be processed by wavelet decomposition. Furthermore, a quadratic spline wavelet basis is selected to decompose the original signal into signal components with different resolutions at different scales, and signal components that can highlight signal feature points are obtained. Exemplarily, three layers of wavelet components can be selected, and based on the local maximum principle, at least one peak and valley feature point of the photoplethysmography signal can be determined from the processed dual-channel photoplethysmography signal.

[0090] Furthermore, the pulsating component and the non-pulsating component of the photoplethysmography signal are calculated and determined by determining the peak and valley characteristic points of at least one photoplethysmography signal.

[0091] In a possible implementation, the pulsatile component and the non-pulsatile component of the photoplethysmography signal may be determined by the following formula:

[0092] I AC =A peak -A valley ;

[0093]

[0094] Among them, I AC is the pulsating component of the photoplethysmography signal; I DC is the non-pulsating component of the photoplethysmography signal; A paek is the peak value of the photoplethysmography signal; A valley is the valley value of the photoplethysmography signal.

[0095] Furthermore, after the pulsating component and the non-pulsating component of the photoplethysmography signal are determined, the forehead blood oxygen value and the blood perfusion degree of the pilot to be tested can be calculated based on the determined pulsating component and the non-pulsating component of the photoplethysmography signal.

[0096] In a possible implementation, the forehead blood oxygen value may be calculated by detecting changes in the intensity of light reflected from forehead tissue at two different wavelengths, red light and infrared light. Specifically, the forehead blood oxygen value may be determined using the following formula:

[0097]

[0098] Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue, and a, b and c are pre-calibrated constants.

[0099] In a possible implementation, the blood perfusion degree may be calculated by detecting the ratio of the AC pulsation component in the super-weightless state to that in the resting state. Specifically, the blood perfusion degree is determined by the following formula:

[0100]

[0101] Wherein, P is relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be tested in a resting state.

[0102] In a possible implementation, a smaller value of the relative blood perfusion degree indicates a lower blood perfusion degree; conversely, a smaller value indicates a higher blood perfusion degree.

[0103] Furthermore, after the forehead blood oxygen value and blood perfusion of the pilot to be tested are determined based on the dual-channel photoplethysmography signal, the brain consciousness state score of the pilot to be tested can be determined by performing weighted calculation on the forehead blood oxygen value and blood perfusion.

[0104] S103: Input the forehead blood oxygen value and blood perfusion rate of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs a weighted calculation on the forehead blood oxygen value and the blood perfusion rate based on the pre-trained weight coefficients, and outputs the brain consciousness state score of the pilot to be tested.

[0105] In a possible implementation, the brain consciousness state score of the pilot to be tested may be determined by the following formula.

[0106] Score=W SpO2 *SpO2+W p *P;

[0107] Among them, Score is the brain consciousness score of the pilot to be tested; SpO2 is the forehead blood oxygen value of the pilot to be tested; P is the relative blood perfusion of the pilot to be tested; W SpO2 is the blood oxygen weighting coefficient; W P is the blood perfusion weighting coefficient.

[0108] In one possible implementation, the blood oxygenation and blood perfusion weighting coefficients can be obtained through training based on sample data from historical measurements of the pilot being tested during actual measurements. A neural network model is trained using multiple sample forehead oxygenation values, multiple sample blood perfusion levels, and corresponding sample brain consciousness state labels to generate a brain consciousness state score prediction model. The weighting coefficients within the brain consciousness state score prediction model are then determined, ensuring that the brain consciousness state score prediction model can perform weighted calculations on forehead oxygenation and blood perfusion levels using the trained weighting coefficients to determine the pilot's brain consciousness state score.

[0109] Specifically, the weight coefficient is determined by the following steps:

[0110] b1: Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state.

[0111] b2: For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and sample blood perfusion degree is consistent with the sample brain consciousness state label.

[0112] b3: If the target brain consciousness state is inconsistent with the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and sample blood perfusion is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

[0113] In one possible implementation, in addition to determining whether the training of the neural network model is completed by comparing the target brain consciousness state with the sample brain consciousness state label, the training of the neural network model can also be completed by iterating the neural network model multiple times. When it is determined that the number of iterations is greater than a preset iteration threshold, or the convergence function value of the neural network model is less than a preset function value, the training of the neural network model is determined to be completed.

[0114] In one possible implementation, the trained neural network model is directly applied, and the forehead blood oxygen value and blood perfusion rate of the pilot to be tested are input into the trained brain consciousness state score prediction model. The brain consciousness state score prediction model outputs the brain consciousness state score of the pilot to be tested, and then the brain consciousness state of the pilot to be tested is determined, thereby reducing the calculation steps for the brain consciousness state score and improving the efficiency of brain consciousness state detection of the pilot to be tested.

[0115] Furthermore, after obtaining the brain consciousness state score by weighted calculation of the forehead blood oxygen value and the blood perfusion degree, the brain consciousness state of the pilot to be tested can be determined by comparing the brain consciousness state score with a preset state score threshold.

[0116] S104: Determine the brain consciousness state of the pilot to be tested based on the brain consciousness state score and a preset state score threshold.

[0117] Specifically, the step of "determining the brain consciousness state of the pilot to be tested based on the brain consciousness state score and a preset state score threshold" includes:

[0118] c1: If the brain consciousness state score is greater than or equal to the preset state score threshold, it is determined that the pilot to be tested has lost brain consciousness.

[0119] c2: If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be tested is normal.

[0120] Specifically, the specific judgment process can be expressed by the following formula:

[0121]

[0122] Among them, Status is the brain consciousness state of the pilot to be tested; Score is the brain consciousness state score of the pilot to be tested; S threshold is the preset status score threshold.

[0123] In a possible implementation, the preset state score threshold can be determined based on a mapping relationship between the brain consciousness state score and the brain consciousness state of the pilot to be detected in a historical process. The preset state score threshold can be updated based on an update of the mapping relationship between the detected brain consciousness state score and the brain consciousness state of the pilot.

[0124] Furthermore, in order to analyze the brain consciousness status of different pilots to be tested, or to provide data reference when taking subsequent treatment measures, or to update the weight coefficient of the brain state consciousness score in real time based on the data of the pilots to be tested to improve the accuracy of the brain state consciousness score calculation, the obtained parameter information can be stored.

[0125] Specifically, the detection method further includes:

[0126] d1: storing the dual-channel photoplethysmography signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be tested at a preset storage frequency.

[0127] In one possible implementation, the storage frequency of the dual-channel photoplethysmography signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be tested can be real-time storage, that is, the dual-channel photoplethysmography signal is collected, or the forehead blood oxygen value and blood perfusion are calculated, etc., are stored immediately; it can also be stored uniformly over a period of time according to a preset time frequency.

[0128] Among them, when storing, it can be stored according to the data set, that is, the calculated forehead blood oxygen value and blood perfusion degree, the corresponding brain consciousness state score and the brain consciousness state of the pilot to be tested (normal or lost) are stored in the same data set, so as to perform data analysis according to the corresponding data set later.

[0129] In a possible implementation, stored information in an earlier historical time period may be deleted according to a preset update frequency to save storage space of the detection system.

[0130] Furthermore, the electronic device can be connected to the target client through the communication module, and send the current detection data and corresponding warning information to the target client, thereby issuing a warning on the status of the pilot to be detected, so as to facilitate the subsequent adoption of corresponding remedial measures.

[0131] Specifically, the detection method further includes:

[0132] e1: Sending the brain consciousness state of the pilot to be detected to the target client, and generating early warning information when the pilot to be detected loses brain consciousness.

[0133] In one possible implementation, after determining that the pilot to be tested has lost consciousness, a warning message is directly generated and sent to the target client. The warning message can be displayed on the target client's screen in the form of a pop-up window, promptly notifying the current crisis situation of the pilot to be tested losing consciousness, so as to facilitate relevant personnel to take corresponding remedial measures.

[0134] In another possible implementation, if the current pilot's brain consciousness state is normal, the pilot's brain consciousness state or data such as forehead blood oxygen value and blood perfusion degree can be transmitted to the target client at a preset transmission frequency, so that relevant personnel can collect the status information of the pilot to be tested and monitor the pilot to be tested.

[0135] For example, the target client may be a device with display and warning functions, such as a smart phone or a computer.

[0136] The present invention provides a method for detecting the pilot's state of mind. The method involves acquiring a dual-channel photoplethysmography signal from the pilot's forehead; determining the pilot's forehead blood oxygen level and blood perfusion based on the dual-channel photoplethysmography signal; inputting the pilot's forehead blood oxygen level and blood perfusion into a pre-trained brain consciousness score prediction model, so that the model performs a weighted calculation on the forehead blood oxygen level and blood perfusion based on the pre-trained weight coefficients and outputs a brain consciousness score for the pilot; and determining the pilot's state of mind based on the brain consciousness score and a preset state score threshold. In this manner, the dual-channel photoplethysmography signal is acquired from the pilot's forehead to determine the pilot's forehead blood oxygen level and blood perfusion. The pilot's state of mind is then detected based on the pilot's forehead blood oxygen level and blood perfusion, providing a comprehensive assessment of the pilot's state of mind and improving the accuracy of the pilot's state of mind detection.

[0137] Based on the same inventive concept, an electronic device for use in a method for detecting a pilot's brain consciousness state is also provided in an embodiment of the present application. Since the principle of solving the problem by the device in the embodiment of the present application is similar to that of the method for detecting a pilot's brain consciousness state in the above-mentioned embodiment of the present application, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0138] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown in FIG, the electronic device 210 includes:

[0139] An acquisition module 216 is used to acquire a dual-channel photoplethysmography signal from the forehead of the pilot to be tested;

[0140] an information determination module 217 for determining the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal;

[0141] a score calculation module 218 for inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs a weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficients, and outputs the brain consciousness state score of the pilot to be tested;

[0142] The state determination module 219 is configured to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

[0143] In one possible implementation, when the information determination module 217 is configured to determine the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal, the information determination module 217 is configured to:

[0144] processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal;

[0145] obtaining a pulsating component and a non-pulsating component of the photoplethysmography signal based on the extracted peak and valley feature points of the at least one photoplethysmography signal;

[0146] Based on the pulsating component and the non-pulsating component, the forehead blood oxygen value and the blood perfusion degree of the pilot to be detected are determined.

[0147] In a possible implementation, the information determination module 217 is configured to determine the forehead blood oxygen value using the following formula:

[0148]

[0149] Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue, and a, b and c are pre-calibrated constants.

[0150] In a possible implementation, the information determination module 217 is configured to determine the blood perfusion degree using the following formula:

[0151]

[0152] Wherein, P is relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be tested in a resting state.

[0153] In a possible implementation, the electronic device 210 further includes a coefficient determination module (not shown in the figure); the coefficient determination module is configured to determine the weight coefficient by the following steps:

[0154] Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state;

[0155] For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and sample blood perfusion degree is consistent with the sample brain consciousness state label;

[0156] If the target brain consciousness state is inconsistent with the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and the sample blood perfusion is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

[0157] In one possible implementation, when the state determination module 219 is configured to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold, the state determination module 219 is configured to:

[0158] If the brain consciousness state score is greater than or equal to the preset state score threshold, determining that the pilot to be tested has lost brain consciousness;

[0159] If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be tested is normal.

[0160] In a possible implementation, the electronic device 210 further includes a storage module, and the storage module is configured to:

[0161] The dual-channel photoplethysmography signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be tested are stored according to a preset storage frequency.

[0162] In a possible implementation, the electronic device 210 further includes a wireless communication module, and the wireless communication module is configured to:

[0163] The brain consciousness state of the pilot to be detected is sent to a target client, and when the brain consciousness of the pilot to be detected is lost, an early warning message is generated.

[0164] The electronic device provided in an embodiment of the present application collects dual-channel photoplethysmography signals from the forehead of a pilot to be tested; determines the pilot's forehead blood oxygen level and blood perfusion based on the dual-channel photoplethysmography signals; inputs the pilot's forehead blood oxygen level and blood perfusion into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state prediction model performs a weighted calculation on the forehead blood oxygen level and blood perfusion based on the pre-trained weight coefficients and outputs the pilot's brain consciousness state score; and determines the pilot's brain consciousness state based on the brain consciousness state score and a preset state score threshold. In this way, the dual-channel photoplethysmography signals are obtained from the pilot's forehead to determine the pilot's forehead blood oxygen level and blood perfusion. The pilot's brain consciousness state is then detected based on the pilot's forehead blood oxygen level and blood perfusion, thereby comprehensively detecting the pilot's brain consciousness state and improving the accuracy of the pilot's brain consciousness state detection.

[0165] See also Figure 5 , Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown in FIG, the electronic device 500 includes a processor 510, a memory 520 and a bus 530.

[0166] The memory 520 stores machine-readable instructions executable by the processor 510. When the electronic device 500 is running, the processor 510 communicates with the memory 520 via the bus 530. When the machine-readable instructions are executed by the processor 510, the above-mentioned Figure 1 The steps of the method for detecting the pilot's brain consciousness state in the method embodiment shown are specifically implemented in accordance with the method embodiment and will not be described in detail here.

[0167] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 The steps of the method for detecting the pilot's brain consciousness state in the method embodiment shown are specifically implemented in accordance with the method embodiment and will not be described in detail here.

[0168] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0169] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. There may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some communication interface, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.

[0170] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0171] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0172] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0173] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The scope of protection of the present application is not limited thereto. Although the present application has been described in detail with reference to the above-mentioned embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-mentioned embodiments within the technical scope disclosed in the present application, or perform equivalent replacements for some of the technical features thereof. These modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A method for detecting a pilot's brain consciousness state, characterized in that: An electronic device used in a system for detecting a pilot's brain consciousness state; the detection method includes: Collect dual-channel photoplethysmography signals from the pilot's forehead; Determining the forehead blood oxygen value and blood perfusion of the pilot to be tested based on the dual-channel photoplethysmography signal; wherein the blood perfusion is determined based on the ratio of the AC pulsation component of the pilot to be tested under super-weightlessness to the AC pulsation component of the pilot to be tested in a resting state; Inputting the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficients, and outputs the brain consciousness state score of the pilot to be tested; The brain consciousness state of the pilot to be detected is determined based on the brain consciousness state score and a preset state score threshold.

2. The detection method according to claim 1, wherein Determining the forehead blood oxygen value and blood perfusion of the pilot to be detected based on the dual-channel photoplethysmography signal includes: processing the dual-channel photoplethysmography signal, and determining at least one peak and valley characteristic point of the photoplethysmography signal from the processed dual-channel photoplethysmography signal; obtaining a pulsating component and a non-pulsating component of the photoplethysmography signal based on the extracted peak and valley feature points of the at least one photoplethysmography signal; Based on the pulsating component and the non-pulsating component, the forehead blood oxygen value and the blood perfusion degree of the pilot to be detected are determined.

3. The detection method according to claim 2, characterized in that The forehead blood oxygen value is determined by the following formula: ； Among them, SpO2 is the forehead blood oxygen value; It is the pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the non-pulsating light intensity of red light with a wavelength of 660nm reflected by forehead tissue; It is the pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; is the non-pulsating light intensity of infrared light with a wavelength of 905nm reflected by forehead tissue; a, b and c are pre-calibrated constants.

4. The detection method according to claim 2, characterized in that The blood perfusion degree is determined by the following formula: ； Wherein, P is relative blood perfusion; is the AC pulsation component of the pilot to be tested under super-weightlessness conditions; is the AC pulsation component of the pilot to be tested in a resting state.

5. The detection method according to claim 1, wherein The weight coefficient is determined by the following steps: Obtain multiple sample forehead blood oxygen values, multiple sample blood perfusion degrees, and corresponding sample brain consciousness state labels, input them into a pre-built neural network model, and output the target brain consciousness state; For each sample forehead blood oxygen value and sample blood perfusion degree, determine whether the target brain consciousness state corresponding to the sample forehead blood oxygen value and sample blood perfusion degree is consistent with the sample brain consciousness state label; If the target brain consciousness state is inconsistent with the sample brain consciousness state label, adjust the parameters in the neural network model until the target brain consciousness state corresponding to each sample forehead blood oxygen value and sample blood perfusion is consistent with the sample brain consciousness state label, determine that the neural network model training is completed, obtain the brain consciousness state score prediction model, and determine the parameters in the trained brain consciousness state score prediction model as the weight coefficient.

6. The detection method according to claim 1, characterized in that The determining of the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold includes: If the brain consciousness state score is greater than or equal to the preset state score threshold, determining that the pilot to be tested has lost brain consciousness; If the brain consciousness state score is less than the preset state score threshold, it is determined that the brain consciousness of the pilot to be tested is normal.

7. The detection method according to claim 1, characterized in that The detection method further comprises: The dual-channel photoplethysmography signal, the calculated forehead blood oxygen value and blood perfusion, the brain consciousness state score, and the brain consciousness state of the pilot to be tested are stored according to a preset storage frequency.

8. The detection method according to claim 1, wherein The detection method further comprises: The brain consciousness state of the pilot to be detected is sent to a target client, and when the brain consciousness of the pilot to be detected is lost, an early warning message is generated.

9. An electronic device, characterized in that: The electronic device comprises: An acquisition module, used to collect dual-channel photoplethysmography signals from the forehead of the pilot to be tested; an information determination module, configured to determine, based on the dual-channel photoplethysmography signal, a forehead blood oxygen value and a blood perfusion level of the pilot to be tested; wherein the blood perfusion level is determined based on a ratio between an AC pulsation component of the pilot to be tested under hypergravity and an AC pulsation component of the pilot to be tested in a resting state; a score calculation module, configured to input the forehead blood oxygen value and blood perfusion of the pilot to be tested into a pre-trained brain consciousness state score prediction model, so that the brain consciousness state score prediction model performs a weighted calculation on the forehead blood oxygen value and the blood perfusion based on the pre-trained weight coefficients, and outputs the brain consciousness state score of the pilot to be tested; The state determination module is used to determine the brain consciousness state of the pilot to be detected based on the brain consciousness state score and a preset state score threshold.

10. A system for detecting the state of a pilot's brain consciousness, characterized in that: The detection system comprises the electronic device according to claim 9 and a flexible, attachable probe device; the flexible, attachable probe device is worn on the forehead of the pilot to be detected; The flexible, attachable probe device is used to obtain the dual-channel photoplethysmography signal and send the dual-channel photoplethysmography signal to the electronic device; The electronic device is used to determine the brain consciousness state of the pilot to be tested based on the dual-channel photoplethysmography signal sent by the flexible adhesive probe device.

Images