Driving unit abnormal condition active reporting system
By combining cameras, microphone arrays, and active reporting buttons, the system enables multi-faceted active reporting of abnormal situations by the flight crew, solving the problem of reporting difficulties when the flight crew is partially incapacitated and improving flight safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-21
- Publication Date
- 2026-04-14
AI Technical Summary
In flight modes with reduced crew numbers, existing technologies lack timely identification and effective reporting methods for abnormal crew conditions, especially when the crew experiences partial incapacitation, making it impossible to effectively operate the aircraft to report the situation.
Employing a camera, microphone array, and active reporting button, the system enables proactive reporting of abnormal conditions by recognizing the crew's actions, voice, and button signals.
When the flight crew has some capacity for action, they can proactively report abnormal situations through various means, thereby improving flight safety.
Smart Images
Figure CN224117526U_ABST
Abstract
Description
Technical Field
[0001] This utility model belongs to the field of cockpit integration and industrial design technology, and relates to an active reporting system for abnormal conditions of the flight crew. Background Technology
[0002] With the development of flight technology, a flight mode with fewer crew members is gradually becoming a trend. However, in this mode, abnormal situations such as crew incapacitation can pose a threat to flight safety. Currently, there is no technology to identify abnormal crew conditions in this mode. Furthermore, in traditional flight modes, there is a lack of timely and effective methods for identifying or reporting abnormal situations, especially partial crew incapacitation.
[0003] Currently, there are two main methods for handling abnormal situations involving flight crews: real-time monitoring and proactive reporting. Real-time monitoring is primarily used for predicting abnormal situations before they occur and for timely identification after they occur, especially when the flight crew has lost consciousness or the ability to proactively report. Proactive reporting, on the other hand, involves the flight crew reporting while they still have the capability, particularly for more subtle abnormal situations, which can significantly improve operational safety.
[0004] In existing technologies, there are separate crew-initiated button reporting systems, but no separate crew-initiated voice reporting or button reporting systems, nor is there a systematic crew-initiated reporting technology that integrates voice reporting, button reporting, and action reporting, allowing for the selection of any one of these methods. If the crew detects an abnormal situation, especially if they experience partial disability, such as severe pain, or loss of voice or visual function, making it impossible to effectively operate the aircraft, they cannot report the situation in a timely and effective manner. Utility Model Content
[0005] To address the aforementioned technical problems, this utility model provides a pilot crew abnormality reporting system that enables pilots to report their own status by actively speaking, pressing buttons, or performing actions while they still possess some behavioral capabilities (actions or language).
[0006] To achieve the above-mentioned technical objectives, this utility model provides the following technical solution:
[0007] A flight crew abnormality reporting system includes: a camera installed in the cockpit, an active reporting button and a microphone array, and a processing unit.
[0008] The camera is used to collect the action signals of the flight crew in real time and send the action signals to the processing unit.
[0009] The microphone array is used to collect the voice signals of the flight crew in real time and send the voice signals to the processing unit;
[0010] The active reporting button is used to collect the active reporting button signal from the flight crew and send the active reporting button signal to the processing unit.
[0011] The processing unit is used to receive action signals, voice signals, and active reporting button signals from the flight crew; and the processing unit is used to identify trigger actions in action signals, trigger statements in voice signals, and button trigger signals in active reporting button signals, so as to make accurate judgments on abnormal conditions of the flight crew.
[0012] Furthermore, the camera, the microphone array, and the active reporting button are all connected to the processing unit; the camera, the active reporting button, and the microphone array are all integrated into the cockpit.
[0013] Furthermore, the triggering action is a pre-set specific action, the triggering statement is a pre-set specific terminology, and the number of key presses and the key press frequency of the key trigger signal meet the set number of key presses and the set frequency.
[0014] Furthermore, when the processing unit recognizes any one or more of the trigger action, the trigger statement, or the key trigger signal, it issues a disability warning and outputs a warning.
[0015] Furthermore, the microphone array includes at least two microphones; the number of cameras is 2-8.
[0016] Furthermore, the number of active reporting buttons is at least two, and the active reporting buttons are installed on the lower surface of the light shield to prevent accidental activation.
[0017] Furthermore, the camera is a visible light camera or a visible light & infrared camera.
[0018] Furthermore, the camera is installed at a distance of 0.6 to 1.2 meters from the crew members.
[0019] The resolution of the camera is no less than 720p.
[0020] Furthermore, the motion signals collected by the camera are upper body motion video data.
[0021] The beneficial effects of this utility model are:
[0022] The active reporting system for abnormal conditions of the driving crew provided by this utility model can actively report abnormal conditions of the driving crew while the driving crew still has different behavioral capabilities such as action or speech. It can actively report its own status through methods including but not limited to voice, action, and button. The hardware equipment selected includes microphone array, visible light / infrared camera, and buttons to improve the safety of abnormal conditions of the driving crew. Attached Figure Description
[0023] Figure 1 This is a schematic diagram showing the locations of the camera, active reporting button, and microphone in the cockpit in an embodiment of this utility model;
[0024] Figure 2 This is a schematic diagram showing the connection between the camera, active reporting button, microphone, and processing unit in an embodiment of this utility model. Detailed Implementation
[0025] The technical solution of this utility model will be further described below with reference to specific embodiments and accompanying drawings.
[0026] Example 1: A flight crew abnormality reporting system, the system comprising: a processing unit and a camera, an active reporting button and a microphone array installed in the cockpit;
[0027] The camera is used to collect the action signals of the flight crew in real time and send the action signals to the processing unit.
[0028] The microphone array is used to collect the voice signals of the flight crew in real time and send the voice signals to the processing unit;
[0029] The active reporting button is used to collect the active reporting button signal from the flight crew and send the active reporting button signal to the processing unit.
[0030] The processing unit is used to receive action signals, voice signals, and active reporting button signals from the flight crew; and the processing unit is used to identify trigger actions in action signals, trigger statements in voice signals, and button trigger signals in active reporting button signals, so as to make accurate judgments on abnormal conditions of the flight crew.
[0031] In this embodiment, as Figure 2 As shown, the camera, the microphone array, and the active reporting button are all connected to the processing unit; the camera, the active reporting button, and the microphone array are all integrated into the cockpit.
[0032] In this embodiment, the triggering action is a pre-set specific action, the triggering statement is a pre-set specific terminology, and the number of key presses and the key press frequency of the key trigger signal meet the set number of key presses and the set frequency.
[0033] When the processing unit recognizes any one or more of the trigger action, the trigger statement, or the key trigger signal, it issues a disability warning and outputs a warning.
[0034] Specifically, the processing unit includes an action recognition module, a voice recognition module, and a key signal recognition module;
[0035] The action recognition module is used to identify the driver's actions in the action signal and compare them with pre-set specific actions. When the similarity is greater than a threshold, the corresponding action is determined to be a trigger action. The action recognition module adopts existing conventional human action recognition technology.
[0036] The speech recognition module is used to recognize the speech text in the speech signal and compare the recognized speech text with a pre-set specific term. When the comparison result is consistent, the corresponding speech signal is determined to be a trigger statement. The speech recognition module adopts existing conventional speech recognition technology.
[0037] The key signal recognition module is used to identify the number of key presses and the key frequency in actively reported key signals. When the number of key presses and the key frequency meet the set number and set frequency, the corresponding key signal is determined to be a key trigger signal. Specifically, in one embodiment, the set number of key presses is two short presses, and the set frequency is a short press interval of less than a specified time (e.g., 500ms). When the above set number of key presses and set frequency are met, the corresponding key signal is determined to be a key trigger signal. In other embodiments, the number of key presses and the key frequency of the key trigger signal can be set as needed.
[0038] In this invention, the processing unit is a conventional processor.
[0039] like Figure 1 As shown, the microphone array in this embodiment includes at least two microphones; preferably, each driver crew member is equipped with at least one microphone, and the microphone placement is set according to actual needs. Preferably, it can be placed on the lower side of the display screen directly in front of the driver crew, or in other locations that facilitate the collection of the driver's voice signals.
[0040] The number of cameras is 2-8. When there are 2 cameras, one camera is set on each of the front sunshades of the two sides of the unit. If more cameras (more than 2) are used, 1-3 cameras should be symmetrically arranged on the central window frame support, the side window frame support, and both sides of the instrument panel to cover different head turning angles.
[0041] There must be at least one active reporting button, which is installed on the lower surface of the sun visor and positioned within arm's reach of the driver. Installing the active reporting button on the lower surface of the cockpit sun visor prevents accidental activation when a protective cover is not used.
[0042] In this embodiment, the camera is a visible light camera or a visible light & infrared camera. Specifically, a visible light & infrared camera refers to a camera that emits visible light and also has infrared functionality.
[0043] The camera is installed at a distance of 0.6 to 1.2 meters from the crew members.
[0044] The resolution of the camera is no less than 720p.
[0045] The camera used in this invention is designed to meet the requirements for face detection, upper limb detection, and departure detection of the flight crew in an aircraft cockpit environment, and can adapt to different cockpit lighting environments such as normal lighting, side lighting, strong light, and low light. Specifically, the visible light and infrared cameras can be used in all lighting environments, including normal lighting, side lighting, strong light, and low light; the visible light camera can be used in normal lighting, side lighting, and strong light environments, but cannot be used in low light environments.
[0046] In this embodiment, the motion signal collected by the camera is upper body motion video data.
[0047] The method for proactively reporting abnormal conditions of the driving crew using the system described in Example 1 is as follows:
[0048] (1) Activate the camera, microphone array and active reporting button to perform active reporting monitoring;
[0049] (2) The camera collects the action signals of the driving crew in real time and sends the action signals to the processing unit;
[0050] The microphone array collects the voice signals of the flight crew in real time and sends the voice signals to the processing unit;
[0051] The active reporting button collects the active reporting button signal from the flight crew and sends the active reporting button signal to the processing unit;
[0052] (3) The processing unit receives action signals, voice signals, and active reporting button signals from the flight crew.
[0053] The processing unit identifies trigger actions in action signals, trigger statements in voice signals, and key trigger signals in active reporting key signals; when the processing unit identifies any one of the trigger actions, trigger statements, or key trigger signals, it issues a disability warning and outputs a warning.
[0054] The system provided in this embodiment can realize abnormal status reporting of the driving crew based on buttons, voice, and vision, as well as abnormal status reporting of the driving crew based on a combination of voice, vision, and buttons. It is not limited to one reporting method and can ensure that the driving crew can still actively report abnormal conditions of the driving crew while still having different behavioral abilities such as movement or language, which greatly improves the safety of operation.
[0055] Finally, it should be noted that the above description is only a preferred embodiment of the present utility model and is not intended to limit the present utility model. For those skilled in the art, they can still modify or improve the technical solutions described above, and these modifications and improvements are all within the protection scope of the present utility model.
Claims
1. A system for proactively reporting abnormal conditions of a flight crew, characterized in that, The system includes: a camera, an active reporting button, a microphone array, and a processing unit installed in the cockpit; The camera is used to collect the action signals of the flight crew in real time and send the action signals to the processing unit. The microphone array is used to collect the voice signals of the flight crew in real time and send the voice signals to the processing unit; The active reporting button is used to collect the active reporting button signal from the flight crew and send the active reporting button signal to the processing unit. The processing unit is used to receive action signals, voice signals, and active reporting button signals from the flight crew; and the processing unit is used to identify trigger actions in action signals, trigger statements in voice signals, and button trigger signals in active reporting button signals, so as to make accurate judgments on abnormal conditions of the flight crew.
2. The active reporting system for abnormal conditions of a flight crew according to claim 1, characterized in that, The camera, the microphone array, and the active reporting button are all connected to the processing unit; the camera, the active reporting button, and the microphone array are all integrated into the cockpit.
3. The active reporting system for abnormal conditions of the driving crew according to claim 1, characterized in that, The triggering action is a pre-set specific action, the triggering statement is a pre-set specific terminology, and the number of key presses and the key press frequency of the key trigger signal meet the set number of key presses and the set frequency.
4. The active reporting system for abnormal conditions of the operating crew according to claim 3, characterized in that, When the processing unit recognizes any one or more of the trigger action, the trigger statement, or the key trigger signal, it issues a disability warning and outputs a warning.
5. The active reporting system for abnormal conditions of the driving crew according to claim 1, characterized in that, The microphone array includes at least two microphones; the number of cameras is 2-8.
6. The active reporting system for abnormal conditions of the driving crew according to claim 1, characterized in that, The number of active reporting buttons is at least two, and the active reporting buttons are installed on the lower surface of the light shield to prevent accidental activation.
7. The active reporting system for abnormal conditions of the operating crew according to claim 1, characterized in that, The camera is a visible light camera or a visible light & infrared camera.
8. The active reporting system for abnormal conditions of a flight crew according to claim 1, characterized in that, The camera is installed at a distance of 0.6 to 1.2 meters from the crew members. The resolution of the camera is no less than 720p.
9. The active reporting system for abnormal conditions of a flight crew according to claim 1, characterized in that, The motion signals collected by the camera are upper body motion video data.