A bio-information acquisition system and method for tracking pilot awareness

Abstract

This invention discloses a bio-information acquisition system and method for tracking pilot consciousness, relating to the field of human state recognition technology in human-machine-environment interaction. The system includes detecting the pressure applied by the pilot to the aircraft control stick and pedals; tracking the pilot's pupillary responses and posture information; receiving physiological information from wearable devices; deriving feature points related to pilot loss of consciousness; processing and storing integrated data of aircraft and pilot-related states, sounds, and flight data records; receiving and saving aircraft and pilot posture information data; and generating warning signals when discrepancies occur. This invention improves the accuracy and real-time performance of pilot consciousness state recognition in high-dynamic environments by integrating non-contact physiological monitoring with intelligent behavior analysis, reduces the false judgment rate of single-modal monitoring, and minimizes interference from contact sensors on flight operations, thereby enhancing flight safety and optimizing the overall reliability of the human-machine-environment system.

Description

Technical Field

[0001] This invention relates to the field of human state recognition technology in human-machine-environment interaction, and in particular to a bio-information acquisition system and method for tracking pilot consciousness. Background Technology

[0002] Real-time monitoring and acquisition of pilot consciousness is a type of human state recognition technology in human-machine-environment systems. Biometric data acquisition devices for pilot consciousness use various technologies to collect physiological signals and behavioral data related to human consciousness states, assessing and monitoring an individual's level of consciousness to improve flight safety, enhance pilot health, and optimize flight operation efficiency. Brain electrical activity, heart rate and heart rate variability, respiratory signals, electromyographic signals, pupillary response, head posture, operational behavior, eye movements, and visual tracking are among the most closely watched and valuable indicators for human consciousness recognition. These indicators can effectively monitor and assess the consciousness state of pilots or other personnel, promptly detect the risk of loss of consciousness, and thus take appropriate measures to ensure safety.

[0003] During combat missions, pilots are often exposed to stress due to various factors such as battlefield conditions, mission characteristics, and aircraft characteristics (maneuverability, vibration, etc.). They may also lose consciousness due to high maneuverability, high G-forces, physical characteristics (such as fainting, hypoxia, flight fatigue, spatial disorientation, sudden illness, and excessive fright caused by physical and psychological stress), or attacks. Pilot loss of consciousness can lead to aircraft instability, forced landings, or crashes. Therefore, a bio-information acquisition device is needed to track pilot consciousness in real time. Summary of the Invention

[0004] In view of the problems existing in the bio-information collection systems and methods used to track pilot consciousness, the present invention is proposed.

[0005] Therefore, the problem to be solved by the present invention is the defects of existing pilot consciousness monitoring technology, such as high misjudgment rate of single-modal monitoring, interference operation of contact sensor, and insufficient real-time performance and reliability in high-noise and high-maneuver environments.

[0006] To solve the above-mentioned technical problems, the present invention provides the following technical solution: In a first aspect, embodiments of the present invention provide a bio-information acquisition system for tracking pilot consciousness, comprising a control system pressure signal sensing device for detecting pressure applied by the pilot to the aircraft control stick and pedals; The pilot consciousness tracking learning device is used to track the pilot's pupillary response and posture information, receive physiological information from wearable devices, and derive feature points related to the pilot's loss of consciousness. An integrated data processing and storage device for processing and storing integrated data related to the aircraft and pilot's status, sound, and flight data records; The integrated data processing and storage device includes an attitude information processing and storage module, which is used to receive and store attitude information data of the aircraft and the pilot, and generate a warning signal when a difference occurs.

[0007] As a preferred embodiment of the bio-information acquisition system for tracking pilot consciousness according to the present invention, the control system pressure signal sensing device includes a pressure sensing module, a data transceiver module, and a power supply module. The pilot consciousness tracking and learning device includes a pupil response and attitude information perception module, a Bluetooth transmission and reception module, a signal information processing and learning module, a data transceiver module, and a power supply module. The integrated data processing and storage device also includes a biological information processing and storage module, a voice and flight record storage device, a data transceiver module, and a power supply module.

[0008] As a preferred embodiment of the bio-information acquisition system for tracking pilot consciousness according to the present invention, wherein: the pressure sensing module is used to acquire pressure data applied by the pilot to the control stick, the lever, and the pedals; The data transceiver module is used to transmit the pressure value data obtained by the pressure detection module to the pilot consciousness tracking and learning device and the integrated data processing and storage device. The power module is used to provide power to the pressure sensing module and the data transceiver module.

[0009] As a preferred embodiment of the bio-information acquisition system for tracking pilot consciousness described in this invention, the pupil response and posture information sensing module is used to collect facial changes including pupil size, and posture information of the pilot's head, shoulders and arms. The posture information is provided to the signal information processing and learning module, and infrared wavelengths with low human-harm effects are irradiated onto the pupil to guide changes in pupil size. The Bluetooth transmitting and receiving module is used to receive physiological information data sent from the pilot's wearable device and transmit the physiological information data to the signal information processing and learning module; The data transceiver module is used to transmit the information collected and analyzed by the signal information processing and learning module to the integrated data processing and storage device. The power module provides power to the pupil response and posture information sensing module, the Bluetooth transmitting and receiving module, the signal information processing and learning module, and the data transceiver module.

[0010] As a preferred embodiment of the bio-information acquisition system for tracking pilot consciousness described in this invention, the signal information processing and learning module is used to monitor the signals and information transmitted between the wearable device and the pupil response and posture information perception module. The signal information processing and learning module learns and saves the pilot's physiological and posture information based on the collected data, identifies and confirms loss of consciousness from the physiological and posture information, and analyzes and compares the data through the system's built-in logic to identify potential danger signals. When a risk of loss of consciousness is detected, the system will automatically trigger a warning signal to remind the pilot or other flight personnel to take safety measures; When no risk of loss of consciousness is detected, the system remains in monitoring mode and records normal flight data and pilot status information without triggering any warning signals.

[0011] As a preferred embodiment of the bio-information acquisition system for tracking pilot consciousness described in this invention, the signal information processing and learning module is further configured to use a face and posture recognition camera sensor to track the corresponding movement lines of the pilot's head, shoulders, and hands during pre-flight mission equipment checks. The signal information processing and learning module then learns normal operational movement lines. Furthermore, the module uses a control system pressure signal sensing device to track the operational direction and pressure applied to the control stick and pedals during pre-flight mission equipment checks, and learns the range of operational direction and pressure applied under normal consciousness levels. If signal information that does not conform to the learned range is input, the signal information processing and learning module processes the input deemed abnormal.

[0012] As a preferred embodiment of the biological information acquisition system for tracking pilot consciousness according to the present invention, wherein: the biological information processing and storage module is used to receive and store the pilot's physiological information data; The voice and flight record storage device is used to store the pilot's communication voice data and flight record data; The data transceiver module is used to transmit the information received by the signal information processing and learning module and the pressure signal sensing device of the control system to the posture information processing and storage module, the biological information processing and storage module, and the voice and flight record storage device. The power module provides power to the posture information processing and storage module, the biological information processing and storage module, the voice and flight record storage device, and the data transceiver module.

[0013] Secondly, embodiments of the present invention provide a bio-information collection method for tracking pilot consciousness, which includes: detecting the pressure applied by the pilot to the aircraft control stick and pedals; Track the pilot's pupillary response and posture information, receive physiological information from wearable devices, and derive feature points related to the pilot's loss of consciousness; Integrated data for processing and storing aircraft and pilot-related status, sound, and flight data records; It receives and stores attitude information data of the aircraft and pilot, and generates warning signals when discrepancies occur.

[0014] Thirdly, embodiments of the present invention provide a wearable device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement any of the steps of the above-described bio-information acquisition system for tracking pilot consciousness; The wearable device includes a physiological signal sensing module, a Bluetooth transmitting and receiving module, and a power module. The wearable device is used to collect physiological information of the pilot.

[0015] Fourthly, embodiments of the present invention provide a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, it implements any of the steps of the above-described bio-information acquisition system for tracking pilot consciousness.

[0016] The beneficial effects of this invention are as follows: By integrating non-contact physiological monitoring and intelligent behavior analysis, this invention significantly improves the accuracy and real-time performance of pilot consciousness state recognition in high-dynamic environments. This solution effectively reduces the misjudgment rate of single-modal monitoring, reduces the interference of contact sensors on flight operations, thereby enhancing flight safety assurance capabilities and optimizing the overall reliability and practicality of the human-machine-environment system. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein: Figure 1 This is a structural diagram of a bio-information acquisition device for a bio-information acquisition system and method for tracking pilot consciousness.

[0018] Figure 2 This is a conceptual diagram of a bio-information acquisition device for a bio-information acquisition system and method for tracking pilot consciousness.

[0019] Figure 3 This is a schematic diagram of the pilot's pupillary response in a bio-information acquisition system and method for tracking pilot consciousness.

[0020] Figure 4 This is a schematic diagram of a pilot's joystick operation posture in a bio-information acquisition system and method for tracking pilot consciousness.

[0021] Figure 5 This is a schematic diagram of the pilot's head posture and position in a bio-information acquisition system and method for tracking pilot consciousness.

[0022] Figure 6 This is a schematic diagram of physiological information monitoring for a biological information acquisition system and method used to track pilot consciousness. Detailed Implementation

[0023] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the protection scope of the present invention.

[0024] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0025] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that is mutually exclusive with other embodiments.

[0026] This invention is described in detail with reference to the schematic diagrams. When detailing the embodiments of this invention, for ease of explanation, the cross-sectional views illustrating the device structure may be partially enlarged, not adhering to the usual scale. Furthermore, the schematic diagrams are merely examples and should not be construed as limiting the scope of protection of this invention. In actual fabrication, the three-dimensional spatial dimensions of length, width, and depth should be included.

[0027] Furthermore, in the description of this invention, it should be noted that the terms "upper," "lower," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. These terms are used solely for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. In addition, the terms "first," "second," or "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0028] Unless otherwise explicitly specified and limited, the terms "installation," "connection," and "joining" in this invention should be interpreted broadly. For example, they can refer to fixed connections, detachable connections, or integral connections; similarly, they can refer to mechanical connections, electrical connections, or direct connections, or indirect connections through an intermediate medium, or internal connections between two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0029] Example 1 Reference Figure 1 and Figure 6 This is the first embodiment of the present invention, which provides a bio-information acquisition system for tracking pilot consciousness, comprising: S1: Control system pressure signal sensing device, used to detect the pressure applied by the pilot to the aircraft control stick and pedals.

[0030] The pressure signal sensing device of the control system includes a pressure sensing module, a data transceiver module, and a power supply module.

[0031] The pilot consciousness tracking and learning device includes a pupil response and attitude information perception module, a Bluetooth transmission and reception module, a signal information processing and learning module, a data transceiver module, and a power supply module.

[0032] The integrated data processing and storage device also includes a biological information processing and storage module, a voice and flight record storage device, a data transceiver module, and a power supply module.

[0033] S1.1: The pressure sensing module is used to acquire pressure data applied by the pilot to the control stick, levers, and pedals.

[0034] The data transceiver module is used to transmit the pressure value data obtained by the pressure detection module to the pilot consciousness tracking and learning device and the integrated data processing and storage device.

[0035] The power module is used to provide power to the pressure sensing module and the data transceiver module.

[0036] Furthermore, the pressure sensing module specifically includes a cyclic pressure detection sensor, a joystick pressure detection sensor, and a pedal pressure detection sensor. The cyclic pressure detection sensor is located at the lower center of the front of the driver's seat; the joystick pressure detection sensor is located at the lower left side of the driver's seat; and the pedal pressure detection sensor is located at the lower front of the driver's seat.

[0037] S2: Pilot consciousness tracking learning device, used to track the pilot's pupillary response and posture information, receive physiological information from wearable devices, and derive feature points related to the pilot's loss of consciousness.

[0038] The pupil response and posture information perception module is used to collect facial changes including pupil size, and posture information of the pilot's head, shoulders and arms. The posture information is provided to the signal information processing and learning module, and infrared wavelengths with low human harm are irradiated into the pupil to guide changes in pupil size.

[0039] The Bluetooth transmitter / receiver module is used to receive physiological information data sent from the pilot's wearable device and transmit the physiological information data to the signal information processing and learning module.

[0040] The data transceiver module is used to transmit the information collected and analyzed by the signal information processing and learning module to the integrated data processing and storage device.

[0041] The power module provides power to the pupil response and attitude information sensing module, the Bluetooth transmitting and receiving module, the signal information processing and learning module, and the data transceiver module.

[0042] S2.1: The signal information processing and learning module is used to monitor the signals and information transmitted between the wearable device and the pupil response and posture information perception module. The signal information processing and learning module learns and saves the pilot's physiological and posture information based on the collected data, and identifies and confirms loss of consciousness from the physiological and posture information. The signal information processing and learning module analyzes and compares the data through the system's built-in logic to identify potential danger signals.

[0043] When a risk of loss of consciousness is detected, the system will automatically trigger a warning signal to remind the pilot or other flight crew to take safety measures.

[0044] When no risk of loss of consciousness is detected, the system remains in monitoring mode and records normal flight data and pilot status information without triggering any warning signals.

[0045] S2.2: The signal information processing and learning module is also used to learn normal operating movements by using face and posture recognition camera sensors to track the corresponding movement lines of the pilot's head, shoulders, and hands during pre-flight mission equipment checks. The signal information processing and learning module also tracks the operating direction and pressure applied to the control stick and pedals during pre-flight mission equipment checks through the control system pressure signal sensing device, and learns the operating direction and pressure range applied under normal consciousness level. If the input signal information does not conform to the learning range, the signal information processing and learning module will process the input that is judged as abnormal.

[0046] Furthermore, the pupil response and posture information perception module includes a face and posture recognition camera sensor and an infrared light for pupil reflection. The face and posture recognition camera sensor can collect facial changes including pupils and posture information including the pilot's head, shoulders, and arms in real time. This data is represented by virtual vertical lines connecting the protruding parts of the face (including the pilot's nose and chin) to the center of the body, and virtual horizontal lines crossing the shoulders. This data is then provided to the signal information processing and learning module. The infrared light for pupil reflection is the pilot's pupil reflection recognition device, which irradiates the pupil with infrared wavelengths that are less harmful to the human body, guiding changes in pupil size.

[0047] The signal information processing and learning module confirms the state of the eyeball without pupillary response more than twice during pre-flight equipment checks and learns the pupil diameter d before the response. During pre-flight equipment checks or during flight mission execution, after multiple infrared light irradiations to confirm pupillary response, the module learns the pupil diameter d' after the response by arithmetic averaging. During periodic infrared light irradiation in flight, if the camera sensor confirms that the pupil diameter d' is d ± 5% of the pupil diameter before the response, infrared light is irradiated more than 3 times at intervals of 1 ± 0.5 seconds to observe the pupillary response and learns the pupil diameter d″ after arithmetic averaging of the collected pupil diameters. Additionally, this module uses a wearable device to transmit infrared light at 5 ± 5% intervals. The system receives blood pressure, heart rate, electrocardiogram, body temperature, and oxygen saturation information at 2-minute intervals and calculates the arithmetic mean of each item to learn the mean under stable consciousness conditions. It also learns the pupil diameter *d* under stable consciousness conditions through the pupil response and posture information sensing module. If the input signal information is outside the learned range, it can be identified as abnormal and processed. Simultaneously, the module associates features related to loss of consciousness based on physiological and posture information. Loss of consciousness is identified when the pupil diameter *d″* is *d ± 5%* or when the pupil disappears from the upper and lower eyelids. Loss of consciousness is also identified when the heart rate measured by the wearable device is 0. If the pilot's posture is at an abnormal angle, it will be tracked, and if the pressure detected by the control system pressure signal sensing device is 0, it is identified as loss of consciousness. Similarly, if the pilot's posture is at an abnormal angle, it will be tracked, and if the control system pressure signal sensing device applies fixed pressure in a direction consistent with the abnormal operating range, it is identified as loss of consciousness. Additional criteria associated with loss of consciousness can be added externally via the data transceiver module; the signal information processing and learning module includes functions for monitoring information and warning signals transmitted from each module, learning and storing the pilot's physiological and postural information based on the collected data, and identifying relevant feature points for recognizing physiological information and posture to confirm whether consciousness has been lost. For this purpose, the signal information processing and learning module may include processors and memory, etc.; the learning methods for the signal information processing and learning module may include machine learning and deep learning, etc.

[0048] Based on the input body and posture information, the signal information processing and learning module makes the following judgments regarding the identification of feature points related to loss of consciousness: Loss of consciousness can be determined when the pupil diameter is d≈d″ or when the pupil deviates from the upper or lower eyelid range; loss of consciousness can be determined when the heart rate acquired by the physiological information wearable device 20 is 0; loss of consciousness can be determined when the pilot's posture is tracked and is at an abnormal angle, and all pressure values ​​measured by the control system pressure signal sensing device 30 become 0 or the pressure values ​​are in an abnormal operating range and when pressure is applied; loss of consciousness can be determined based on the respiratory sound characteristics corresponding to various aircraft actions (such as rolls) or a personalized model for the pilot.

[0049] In addition to the above explanation, the signal information processing and learning module can determine whether a pilot has lost consciousness by collecting physiological and posture information and by using externally imported conditions that can be used to determine loss of consciousness.

[0050] S3: Integrated data processing and storage device, used to process and store integrated data related to the status, sound and flight data of the aircraft and pilot.

[0051] The biological information processing and storage module is used to receive and store the pilot's physiological information data.

[0052] The voice and flight recorder is used to store the pilot's communication voice data and flight record data.

[0053] The data transceiver module is used to transmit information received by the signal information processing and learning module and the pressure signal sensing device of the control system to the posture information processing and storage module, the biological information processing and storage module, and the voice and flight record storage device.

[0054] The power module provides power to the attitude information processing and storage module, the biological information processing and storage module, the voice and flight record storage device, and the data transceiver module.

[0055] Furthermore, the physiological signal sensing module may include blood pressure sensors, heart rate sensors, electrocardiogram sensors, body temperature sensors, and oxygen saturation sensors, which can be configured in a modular manner.

[0056] S4: The integrated data processing and storage device includes an attitude information processing and storage module, which is used to receive and store attitude information data of the aircraft and the pilot, and generate warning signals when discrepancies occur.

[0057] Furthermore, this embodiment also provides a method for collecting biometric information to track pilot consciousness, including: It detects the pressure exerted by the pilot on the aircraft's control stick and pedals.

[0058] The system tracks the pilot's pupillary response and posture information, receives physiological information from wearable devices, and derives feature points related to the pilot's loss of consciousness.

[0059] It processes and stores integrated data related to the status, sound, and flight data of aircraft and pilots.

[0060] It receives and stores attitude information data of the aircraft and pilot, and generates warning signals when discrepancies occur.

[0061] This embodiment also provides a wearable device suitable for a biometric information acquisition system for tracking pilot consciousness, including a memory and a processor; the memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions to realize the biometric information acquisition system for tracking pilot consciousness as proposed in the above embodiment.

[0062] The wearable device includes a physiological signal sensing module, a Bluetooth transmitting and receiving module, and a power module. The wearable device is used to collect physiological information of the pilot.

[0063] The computer device can be a terminal, comprising a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, NFC (Near Field Communication), or other technologies. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad on the computer device's casing, or an external keyboard, touchpad, or mouse.

[0064] In summary, this invention discloses a bio-information acquisition system and method for tracking pilot consciousness, belonging to the field of human state recognition technology in human-machine-environment interaction. The system includes a control system pressure signal sensing device, a pilot consciousness tracking and learning device, and a comprehensive data processing and storage device. The pressure sensing device detects the pressure applied by the pilot to the control stick and pedals; the consciousness tracking and learning device tracks the pilot's pupillary responses and the operational movements of the head, shoulders, and hands using a camera sensor, and combines this with physiological signals received from wearable devices (such as heart rate and blood pressure), using a signal processing and learning module to establish an operational benchmark and physiological characteristic model under normal consciousness levels; the comprehensive data processing device integrates and stores flight data and physiological state information. When the real-time monitored operational pressure, attitude movement, or physiological indicators deviate from the learned normal range, the system automatically determines it as an abnormal consciousness and triggers a warning. This invention, through multimodal data fusion and non-contact monitoring, effectively solves the problems of high misjudgment rate in single-modal monitoring and interference from contact sensors, significantly improving the accuracy and real-time performance of identifying pilot loss of consciousness risk in highly dynamic flight environments.

[0065] Example 2 Reference Figures 1-6 This is the second embodiment of the present invention, which provides a bio-information acquisition system for tracking pilot consciousness. In order to verify the beneficial effects of the present invention, a simulation experiment is conducted for scientific demonstration.

[0066] In an actual flight mission of a certain type of fighter jet, when the pilot's consciousness gradually becomes blurred due to sudden high-altitude hypoxia, the system of this invention immediately goes into operation: the control system pressure signal sensing device installed on the control stick and pedals detects in real time that the operating pressure gradually decreases to zero; at the same time, the pilot consciousness tracking and learning device captures the loss of pupil light reflection and abnormal head posture of the pilot through an infrared camera, combined with wearable device data received via Bluetooth (abnormal heart rate, sudden drop in blood oxygen saturation), and quickly determines that the pilot is on the verge of losing consciousness; the integrated data processing and storage device receives the above multi-source information, and through built-in logic comparison and analysis, confirms that the pilot's state deviates significantly from the normal operating model, and then automatically triggers an emergency warning signal to remind the pilot in the back seat to take over the aircraft, and simultaneously saves the current flight data, voice recording and physiological information to the storage device, providing key evidence for subsequent accident analysis.

[0067] Furthermore, this invention can be applied not only to military rotorcraft, such as helicopters, but also to other military aircraft and civilian aircraft. It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A bio-information acquisition system for tracking pilot consciousness, characterized in that: include, The control system pressure signal sensing device is used to detect the pressure applied by the pilot to the aircraft control stick and pedals; The pilot consciousness tracking learning device is used to track the pilot's pupillary response and posture information, receive physiological information from wearable devices, and derive feature points related to the pilot's loss of consciousness. An integrated data processing and storage device for processing and storing integrated data related to the aircraft and pilot's status, sound, and flight data records; The integrated data processing and storage device includes an attitude information processing and storage module, which is used to receive and store attitude information data of the aircraft and the pilot, and generate a warning signal when a difference occurs.

2. The bio-information acquisition system for tracking pilot consciousness as described in claim 1, characterized in that: The pressure signal sensing device of the control system includes a pressure sensing module, a data transceiver module, and a power supply module. The pilot consciousness tracking and learning device includes a pupil response and attitude information perception module, a Bluetooth transmission and reception module, a signal information processing and learning module, a data transceiver module, and a power supply module. The integrated data processing and storage device also includes a biological information processing and storage module, a voice and flight record storage device, a data transceiver module, and a power supply module.

3. The bio-information acquisition system for tracking pilot consciousness as described in claim 2, characterized in that: The pressure sensing module is used to acquire pressure data applied by the pilot to the control stick, lever, and pedals; The data transceiver module is used to transmit the pressure value data obtained by the pressure detection module to the pilot consciousness tracking and learning device and the integrated data processing and storage device. The power module is used to provide power to the pressure sensing module and the data transceiver module.

4. The bio-information acquisition system for tracking pilot consciousness as described in claim 3, characterized in that: The pupil response and posture information sensing module is used to collect facial changes including pupil size, and posture information of the pilot's head, shoulders and arms. The posture information is provided to the signal information processing and learning module, and infrared wavelengths with low human harmfulness are irradiated into the pupil to guide changes in pupil size. The Bluetooth transmitting and receiving module is used to receive physiological information data sent from the pilot's wearable device and transmit the physiological information data to the signal information processing and learning module; The data transceiver module is used to transmit the information collected and analyzed by the signal information processing and learning module to the integrated data processing and storage device. The power module provides power to the pupil response and posture information sensing module, the Bluetooth transmitting and receiving module, the signal information processing and learning module, and the data transceiver module.

5. The bio-information acquisition system for tracking pilot consciousness as described in claim 4, characterized in that: The signal information processing and learning module is used to monitor the signals and information transmitted between the wearable device and the pupil response and posture information sensing module. The signal information processing and learning module learns and saves the pilot's physiological and posture information based on the collected data, and identifies and confirms loss of consciousness from the physiological and posture information. The signal information processing and learning module analyzes and compares the data through the system's built-in logic to identify potential danger signals. When a risk of loss of consciousness is detected, the system will automatically trigger a warning signal to remind the pilot or other flight personnel to take safety measures; When no risk of loss of consciousness is detected, the system remains in monitoring mode and records normal flight data and pilot status information without triggering any warning signals.

6. The bio-information acquisition system for tracking pilot consciousness as described in claim 5, characterized in that: The signal information processing and learning module is also used to learn normal operating movements by using face and posture recognition camera sensors to track the corresponding movement lines of the pilot's head, shoulders, and hands during pre-flight mission equipment checks. The signal information processing and learning module also tracks the operating direction and pressure applied to the control stick and pedals during pre-flight mission equipment checks through the control system pressure signal sensing device, and learns the operating direction and pressure range applied under normal consciousness level. If the input signal information does not conform to the learning range, the signal information processing and learning module will process the input that is judged as abnormal.

7. The bio-information acquisition system for tracking pilot consciousness as described in claim 6, characterized in that: The biological information processing and storage module is used to receive and store the pilot's physiological information data; The voice and flight record storage device is used to store the pilot's communication voice data and flight record data; The data transceiver module is used to transmit the information received by the signal information processing and learning module and the pressure signal sensing device of the control system to the posture information processing and storage module, the biological information processing and storage module, and the voice and flight record storage device. The power module provides power to the posture information processing and storage module, the biological information processing and storage module, the voice and flight record storage device, and the data transceiver module.

8. A method for collecting biometric information for tracking pilot consciousness, based on the biometric information collection system for tracking pilot consciousness as described in any one of claims 1 to 7, characterized in that: include, Detects the pressure exerted by the pilot on the aircraft control stick and pedals; Track the pilot's pupillary response and posture information, receive physiological information from wearable devices, and derive feature points related to the pilot's loss of consciousness; Integrated data for processing and storing aircraft and pilot-related status, sound, and flight data records; It receives and stores attitude information data of the aircraft and pilot, and generates warning signals when discrepancies occur.

9. A wearable device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, it implements the steps of the bio-information acquisition system for tracking pilot consciousness as described in any one of claims 1 to 7; The wearable device includes a physiological signal sensing module, a Bluetooth transmitting and receiving module, and a power module. The wearable device is used to collect physiological information of the pilot.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, it implements the steps of the bio-information acquisition system for tracking pilot consciousness as described in any one of claims 1 to 7.

Images