An aircraft information reminding method, system and device

Abstract

The embodiment of the present specification provides an airplane information reminding method, comprising: when a preset airplane prompt information is triggered, determining a processing condition of the airplane prompt information according to a priority of the airplane prompt information; when the processing condition of the airplane prompt information is reached, judging whether a target object has noticed the airplane prompt information according to key physiological data of the target object; and if it is judged that the target object has not noticed the airplane prompt information, triggering a reminding condition to remind the airplane prompt information.

Description

Technical Field

[0001] This application relates to the field of flight control technology, and in particular to an aircraft information alerting method, system and device. Background Technology

[0002] Human information processing involves acquiring visual stimuli, cognitively processing these stimuli to transform them into meaningful information, and then making decisions. When people's attention is focused on a task or event, they may capture unintended visual stimuli without processing them, even if the stimuli are very obvious. This phenomenon of "not seeing" is known as inattentive blindness. Furthermore, fatigue can easily lead to decreased attention, resulting in the neglect of visual or auditory stimuli. All of these situations can occur when flight crews are operating an aircraft, causing them to ignore important warnings or alerts, resulting in a loss of situational awareness and threatening flight safety.

[0003] Current technologies related to attention monitoring and alerts mainly focus on the automotive driving field, including: TW109126421 "Vehicle Driving Attention Alert Integration System and Vehicle Driving Attention Alert Method", which uses wearable units to monitor whether the driver's attention is focused and provides reminders through the seat belt; CN108986410A "A Vehicle Fatigue Driving Warning and Mitigation System", which uses wearable devices to acquire physiological signals reflecting driver fatigue and alleviates cockpit fatigue through the seat (including posture adjustment, massage and / or seat vibration).

[0004] As for the civil aviation cockpit field, the main focus is on solutions for monitoring and alerting crew fatigue, including: CN202011179364.2 "Methods and systems for monitoring the fatigue status of aircraft crew members," which mentions wearable devices that collect physiological indicators such as "heart rate" or "electrocardiogram"; and CN202210106243.8 "Methods, systems, electronic devices and readable storage media for crew fatigue early warning," which mainly mentions crew fatigue monitoring and uses alarm messages for early warning, without employing tactile methods.

[0005] The above solutions have the following problems:

[0006] 1) All of them use wearable devices to monitor whether the relevant personnel are focused or fatigued. This monitoring method is not suitable for civil aviation operations or the flight environment.

[0007] 2) It only measures whether the relevant personnel are focused or fatigued, but cannot monitor whether they notice the reminder / alarm information after it appears, that is, it cannot monitor the relevant personnel's ability to pay attention to specific information. Summary of the Invention

[0008] This specification provides an aircraft information reminder method, system, and apparatus to solve the technical problem of how to more effectively remind users of aircraft information.

[0009] To address the aforementioned technical problems, the embodiments in this specification provide the following technical solutions:

[0010] This specification provides an embodiment of an aircraft information alert method, the method comprising:

[0011] When a preset aircraft alert message is triggered, the processing conditions for the aircraft alert message are determined according to its priority.

[0012] When the processing conditions for the aircraft alert information are met, it is determined whether the target object has noticed the aircraft alert information based on the target object's key physiological data.

[0013] If it is determined that the target object has not noticed the aircraft prompt message, a reminder condition is triggered to remind the target object of the aircraft prompt message.

[0014] Optionally, determining whether the target object has noticed the aircraft cue information includes:

[0015] If the facial thermal imaging data of the target object meets the preset change within a preset time, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information.

[0016] And / or,

[0017] If the facial thermal imaging data of the target object does not meet the preset change within a preset time, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

[0018] Optionally, after the reminder condition is triggered, the method further includes:

[0019] Determining whether the target object has noticed the aircraft cue message includes:

[0020] If the facial thermal imaging data of the target object meets the preset change, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information;

[0021] And / or,

[0022] If the facial thermal imaging data of the target object does not meet the preset change, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

[0023] Optionally, determining the processing conditions for the aircraft alert information based on its priority includes:

[0024] Determine if there is any pending information with a higher priority than the aircraft alert information;

[0025] If so, the processing conditions for the aircraft prompt information include: processing the aircraft prompt information after the pending information has been processed.

[0026] Optionally, the method further includes:

[0027] Obtain key aircraft information, and determine whether the information to be processed has been completed based on the key aircraft information.

[0028] Optionally, the method further includes:

[0029] Obtain key aircraft information and determine whether to trigger a preset aircraft prompt message based on the key aircraft information.

[0030] Optionally, determining whether to trigger a preset aircraft prompt message based on the aforementioned key aircraft information includes:

[0031] The key aircraft information is compared with a preset aircraft prompt model, and the preset aircraft prompt information is determined based on the comparison result.

[0032] Optionally, the method further includes:

[0033] If the alert stop condition is triggered, then the alert for the aircraft will stop.

[0034] This specification provides an aircraft information alert system, the system comprising:

[0035] The storage module is used to store preset aircraft prompt information;

[0036] The sensor module is used to collect key physiological data of the target object;

[0037] The data processing module is used to determine whether to trigger a preset aircraft prompt message based on key aircraft information. When the preset aircraft prompt message is triggered, the module determines the processing conditions for the aircraft prompt message based on its priority. When the processing conditions for the aircraft prompt message are met, the module determines whether the target object has noticed the aircraft prompt message based on key physiological data of the target object. If it is determined that the target object has not noticed the aircraft prompt message, the module triggers a reminder condition to remind the target object of the aircraft prompt message.

[0038] The information reminder module is used to remind users of the aircraft's prompts.

[0039] This specification provides an aircraft information alert device, the device comprising:

[0040] The triggering module is used to determine the processing conditions of the aircraft prompt information according to the priority of the aircraft prompt information when a preset aircraft prompt information is triggered.

[0041] The judgment module is used to determine whether the target object has noticed the aircraft prompt information based on the target object's key physiological data when the processing conditions of the aircraft prompt information are met.

[0042] The reminder module is used to trigger a reminder condition to remind the target object of the aircraft prompt information if it is determined that the target object has not noticed the aircraft prompt information.

[0043] The above-described at least one technical solution adopted in the embodiments of this specification can achieve the following beneficial effects:

[0044] After an aircraft alert is issued, by monitoring the key physiological data of the target, it can be determined whether the target has noticed the aircraft alert. If it is determined that the target has not noticed the aircraft alert, an alert condition is triggered to remind the target of the aircraft alert, thereby improving the effectiveness and efficiency of aircraft alerts and facilitating the timely and efficient processing of aircraft information. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of this specification or the prior art, the drawings used in the description of the embodiments of this specification or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a flowchart illustrating the aircraft information alert method in the first embodiment of this specification.

[0047] Figure 2 This is a flowchart of an aircraft information notification method in the first embodiment of this specification.

[0048] Figure 3 This is another aircraft information alert flowchart in the first embodiment of this specification.

[0049] Figure 4 This is a schematic diagram of the installation of the sensor device and vibration alert device in the first embodiment of this specification.

[0050] Figure 5 This is a schematic diagram of the aircraft information alert system in the second embodiment of this specification.

[0051] Figure 6 This is a structural schematic diagram of the aircraft information reminder device in the third embodiment of this specification. Detailed Implementation

[0052] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this specification, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this application.

[0053] like Figures 1 to 3 As shown, the first embodiment of this specification (hereinafter referred to as "Embodiment 1") provides an aircraft information alert method, including:

[0054] S101: When a preset aircraft prompt message is triggered, the processing conditions for the aircraft prompt message are determined according to the priority of the aircraft prompt message;

[0055] In Example 1, one or more types of aircraft information can be preset as aircraft alert information. Aircraft alert information includes, but is not limited to, warning and alert-level alarm information, as well as other alert-level information requiring crew intervention, such as engine fire alarms and cabin depressurization. Furthermore, various types of aircraft information, including but not limited to aircraft alert information, can have corresponding priorities (or processing priorities).

[0056] When a preset aircraft alert is triggered, i.e., when the situation represented by the triggered aircraft alert occurs, the processing conditions for the triggered aircraft alert can be determined according to the priority of the triggered aircraft alert.

[0057] Specifically, it can obtain key aircraft information and determine whether to trigger preset aircraft alerts based on this information. This key aircraft information includes, but is not limited to: information about various aircraft systems, the aircraft's flight phase, and its status.

[0058] Specifically, an aircraft prompt model can be preset. This model can include a list of various information items that need to be prompted, the corresponding triggering logic, and the information display area. Determining whether to trigger a preset aircraft prompt based on key aircraft information can include comparing the key aircraft information with the preset aircraft prompt model and determining whether to trigger the preset aircraft prompt based on the comparison result (i.e., whether the situation represented by the aircraft prompt appears).

[0059] The following aircraft alert message to be triggered will be referred to as "Message A". Message A may be one or more messages.

[0060] In Example 1, determining the processing conditions for information A based on its priority may include: determining whether there is any pending information with a higher priority than information A; if there is pending information with a higher priority than information A (all pending information with a higher priority than information A are hereinafter referred to as "information B", and information B can be one or more messages), then the processing conditions for information A may include: processing information A only after information B has been processed. That is, information B should be processed first, and information A should be processed only after information B has been processed. Of course, if there is no pending information with a higher priority than information A, then the processing conditions for information A may include: treating information A as a pending message.

[0061] In Example 1, it is possible to monitor and determine whether information B has been processed. For example, if information B is fault-related, then after the corresponding handling procedure for information B is completed, the corresponding fault is isolated, information B disappears, indicating that information B has been processed. Specifically, key aircraft information can be obtained, and the processing status of information B can be determined based on this key aircraft information. Key aircraft information includes, but is not limited to: information about various aircraft systems, aircraft flight phases, and aircraft status.

[0062] If it is determined that information B has been processed, then the processing conditions for information A have been met, and information A needs to be processed.

[0063] S103: When the processing conditions for the aircraft prompt information are met, determine whether the target object has noticed the aircraft prompt information based on the key physiological data of the target object;

[0064] When the processing conditions for information A are met, key physiological data of the target object (typically crew members, such as pilots) can be monitored. Based on this data, it can be determined whether the target object has noticed information A. This key physiological data can include attention-related data, such as eye data and facial thermal imaging data. Specifically, eye data can include eye movement data to determine the area of ​​gaze; facial thermal imaging data can include nasal temperature data.

[0065] In Embodiment 1, determining whether the target object has noticed the aircraft prompt information may include: determining whether the target object has noticed information A within a preset time. The preset time can be calculated from the time the processing conditions for the aircraft prompt information are met. Specifically, if information B exists when information A is triggered, the preset time can be calculated from the time information B is processed; if information B does not exist when information A is triggered, the preset time can be calculated from the time information A is triggered.

[0066] In Example 1, determining whether the target object has noticed information A within a preset time period may include:

[0067] If the facial thermal imaging data of the target object meets the preset change within the preset time, and the target object's gaze area and the area where information A is presented overlap, then it is determined that the target object has noticed information A.

[0068] And / or,

[0069] If the facial thermal imaging data of the target object does not meet the preset change within the preset time, or if the target object's gaze area and the area where information A is presented do not overlap, then it is determined that the target object has not noticed information A.

[0070] S105: If it is determined that the target object has not noticed the aircraft prompt information, then a reminder condition is triggered to remind the target object of the aircraft prompt information.

[0071] If it is determined that the target object has not noticed information A, a reminder condition can be triggered to remind the user of information A. Reminder methods include, but are not limited to: a specific alarm tone, a buzzer sound, or tactile vibration of the seat. Preferably, tactile reminder can be provided using seat vibration.

[0072] After the alert condition is triggered, it can be determined whether the target object has noticed information A. Determining whether the target object has noticed information A can include:

[0073] If the facial thermal imaging data of the target object meets the preset change, and the target object's gaze area and the area where information A is presented overlap, then it is determined that the target object has noticed information A;

[0074] And / or,

[0075] If the facial thermal imaging data of the target object does not meet the preset change, or if the target object's gaze area and the area where information A is presented do not overlap, then it is determined that the target object has not noticed information A.

[0076] In Example 1, if it is determined that the target object has noticed information A, information A can be continuously reminded. If it is determined that the target object has noticed information A, the reminder of information A can be stopped.

[0077] Additionally, if the reminder stop condition is triggered, reminders for information A can be stopped. The reminder stop condition can include receiving a reminder stop signal, which can be generated through an operation on the target object.

[0078] The implementation method of Example 1 will be further explained below:

[0079] In Embodiment 1, an aircraft information alert system can be installed on the aircraft, and this system will implement the above-described content of Embodiment 1. The aircraft information alert system may include:

[0080] The storage module is used to store various types of information, including preset aircraft alerts. It can also be used to store physiological threshold data that triggers alerts (including physiological threshold data of the target object).

[0081] The storage module may specifically include: a monitoring model library for storing aircraft cueing models and / or various logical judgment conditions involved in Embodiment 1 (which can be used by the data processing module); and a physiological data storage module for storing data collected by the sensor module.

[0082] The sensor module is used to collect (and can collect continuously, equivalent to monitoring) key physiological data of the target object, that is, to monitor the key physiological data of the target object.

[0083] The sensor module may specifically include: an eye data acquisition module, used to collect and extract eye data of the target object, such as pupil diameter, fixation, and saccades; this can be a camera-based eye tracker. A facial thermal imaging integration module, used to collect facial thermal imaging data of the target object, such as facial temperature distribution information; this can be an infrared camera. The sensor module (i.e., the sensor device) can be placed in a suitable location within the aircraft cockpit, without direct contact with the target object, such as... Figure 4 As shown.

[0084] The data processing module is used to determine whether to trigger a preset aircraft prompt message based on key aircraft information. When the preset aircraft prompt message is triggered, the module determines the processing conditions for the aircraft prompt message based on its priority. When the processing conditions for the aircraft prompt message are met, the module determines whether the target object has noticed the aircraft prompt message based on key physiological data of the target object. If it is determined that the target object has not noticed the aircraft prompt message, the module triggers a reminder condition to remind the target object of the aircraft prompt message.

[0085] The information reminder module is used to remind users of the aircraft prompts. For example, it can be a seat vibration device used to make the aircraft cockpit seat vibrate.

[0086] The above system may also include:

[0087] The information collection module is used to collect various types of aircraft information, including key aircraft information.

[0088] The display or prompt module is used to acquire various information, including key aircraft information and triggered information, and to display the acquired information.

[0089] The reminder suppression module is used to stop the information reminder function, that is, to stop reminding the aircraft of reminder information.

[0090] The network module provides at least one data transmission method for the aforementioned modules, enabling various data transmissions between them. For example, the network module could be an avionics core network. The avionics core network adopts an integrated modular avionics concept and is a general-purpose processing platform sharing hardware and software resources, providing the aircraft with resources for data computation, data transmission, and data conversion. Alternatively, the network module can build its own network to provide a data transmission network for the aforementioned modules, allowing them to transmit data through the data transmission network, or enabling direct connection between the modules for data transmission.

[0091] The following explains the specific working process of the aircraft information alert system:

[0092] S1: When the aircraft is powered on, the aircraft information alert system activates its self-test function, meaning the data processing module monitors whether each module or function of the aircraft information alert system is working properly. Specifically, this can be done by analyzing the signals output by each module to determine its functionality.

[0093] S3: After completing the self-test, the data processing module obtains various types of information stored in the storage module, as well as various aircraft information collected by the information acquisition module, including key aircraft information. It compares the aircraft information with the various types of information stored in the storage module to determine whether the information stored in the storage module is triggered (i.e., whether the situation represented by the information stored in the storage module occurs).

[0094] If the information stored in the trigger storage module is determined, then the key physiological data of the target object collected by the sensor module at the time of the trigger (the sensor module can continuously collect key physiological data of the target object from the trigger information, and the data collected by the sensor module can be stored in the storage module for the data processing module to retrieve), including eye data and facial thermal imaging data, is obtained. Additionally, it is determined whether the triggered information belongs to a preset aircraft warning message.

[0095] Additionally, the triggered information can be displayed via a display or prompt module.

[0096] S5: If it is determined that some or all of the triggered information belongs to the preset aircraft prompt information (hereinafter referred to as "Information A"), then determine whether there is any pending information with a higher priority than Information A.

[0097] Scenario 1: If there is pending information with a higher priority than information A (all pending information with a higher priority than information A are referred to as "information B"), then continuously check whether information B has been processed. Specifically, this can be done by combining network module resources and various aircraft information, such as alarm conditions, aircraft or system status, control device location, and critical aircraft information, to continuously check whether information B has been processed.

[0098] If it is determined that information B has been processed, then it is determined whether the target object has noticed information A, including: within a preset time from the time information B is processed, acquiring key physiological data of the target object collected by the sensor module, determining the changes in the target object's facial thermal imaging data and the target object's gaze area, and determining whether the target object has noticed information A based on the key physiological data.

[0099] In scenario one, if the facial thermal imaging data (e.g., nasal temperature data) of the target object meets the preset change within the preset time period, and the target object's gaze area and the information A presentation area (the presentation area can be the display area provided by the display or prompt module, and there can be multiple display areas, with different information displayed by different display areas; specifically, the corresponding display area can be determined based on information A, the same below) overlap, then it is determined that the target object has noticed information A; and / or, if the facial thermal imaging data (e.g., nasal temperature data) of the target object does not meet the preset change within the preset time period, or the target object's gaze area and the information A presentation area (the presentation area can be the display area provided by the display or prompt module) do not overlap, then it is determined that the target object has not noticed information A.

[0100] Scenario 2: If there is no information to be processed with a higher priority than information A, then determine whether the target object has noticed information A, including: within a preset time from the triggering of information A, acquiring the key physiological data of the target object collected by the sensor module (including the key physiological data of the target object acquired when information A is triggered), determining the changes in the target object's facial thermal imaging data and the target object's gaze area, and determining whether the target object has noticed information A based on the key physiological data.

[0101] In scenario two, if within the preset time period, including the key physiological data of the target object acquired when triggering information A, the facial thermal imaging data (e.g., nasal temperature data) of the target object meets the preset change, and the target object's gaze area overlaps with the information A presentation area (the presentation area may be the display area provided by the display or prompting module), then it is determined that the target object has noticed information A; and / or, if within the preset time period, including the key physiological data of the target object acquired when triggering information A, the facial thermal imaging data (e.g., nasal temperature data) of the target object does not meet the preset change, or the target object's gaze area does not overlap with the information A presentation area (the presentation area may be the display area provided by the display or prompting module), then it is determined that the target object has not noticed information A.

[0102] Judging whether a target has noticed information A based on key physiological data can be represented as follows:

[0103] a) Determine whether the nasal temperature change of the target object meets the preset conditions; if it does, set the nasal temperature judgment signal to 1, i.e., TNose==1; if it does not meet the conditions, keep the nasal temperature signal at 0, i.e., TNose==0;

[0104] b) Determine whether the target object's gaze area and the information A presentation area overlap; if they overlap, set the eye judgment signal to 1, i.e., Eye==1; if they do not overlap, keep the eye judgment signal at 0, i.e., Eye==0.

[0105] c) If Eye&&TNose==1, then determine that the target object has noticed information A;

[0106] d) If Eye&&TNose! = 1, then it is determined that the target object did not notice information A.

[0107] S7: If it is determined that the target object has not noticed information A, the data processing module triggers the reminder condition, causing the information reminder module to remind the user of information A.

[0108] In addition, when triggering the reminder condition, it is necessary to determine whether the target object has noticed information A, including: acquiring key physiological data of the target object collected by the sensor module, determining the changes in the target object's facial thermal imaging data and the target object's gaze area, and determining whether the target object has noticed information A based on the key physiological data.

[0109] As above, if the facial thermal imaging data of the target object meets the preset change, and the target object's gaze area and the information A presentation area overlap, then it is determined that the target object has noticed information A; and / or, if the facial thermal imaging data of the target object does not meet the preset change, or the target object's gaze area and the information A presentation area do not overlap, then it is determined that the target object has not noticed information A.

[0110] If it is determined that the target object has not noticed information A, the information reminder module can continue to remind users of information A.

[0111] S9: If the reminder stop condition is triggered, such as the reminder suppression module being operated, the data processing module will cause the information reminder module to stop reminding information A and continue with S3.

[0112] If it is determined that the target object has noticed information A, the information reminder module can stop reminding the target object of information A, and the sensor module can stop collecting the target object's key physiological data and continue with S3.

[0113] Example 1 can achieve the following beneficial effects:

[0114] After an aircraft warning message appears, by monitoring the key physiological data of the target object, it can be determined whether the target object has noticed (in Example 1, noticing means seeing and cognitively processing) the aircraft warning message. If it is determined that the target object has not noticed the aircraft warning message, a reminder condition is triggered to remind the target object of the aircraft warning message. This avoids the target object from not noticing the aircraft warning message (especially visual information such as flight mode change, barometric reference setting reminder, or CAS information not presented in the main field of vision) due to various reasons such as insufficient attention resources or fatigue. This improves the reminder effect and efficiency of aircraft information and facilitates the timely and efficient processing of aircraft information.

[0115] By using facial thermal imaging data and physiological data such as the gaze area to determine whether a target has noticed the aircraft information, this method matches the rapid changes in physiological data when the human body experiences changes in attention and cognition. This allows for a faster, more timely, accurate, and effective determination of whether a target has noticed the aircraft information or has cognitively processed it, thereby improving the effectiveness and efficiency of aircraft information alerts.

[0116] Key physiological data of target objects can be collected using non-wearable or non-contact devices. For example, sensor modules can be placed in the cockpit environment of an aircraft without causing discomfort or interference to the target object, making it particularly suitable for special fields and environments such as aircraft piloting.

[0117] It can use tactile means, such as seat vibration, to remind the user of aircraft prompts. This does not occupy the cognitive resources of the target and can play a reasonable and effective reminder role, making it especially suitable for special fields and environments such as aircraft piloting.

[0118] The ability to stop alerts by reminding passengers of the conditions for stopping can further reduce interference with the aircraft piloting process, making it particularly suitable for special fields and environments like aircraft piloting.

[0119] like Figure 5 As shown, the second embodiment of this specification provides an aircraft information alert system corresponding to the method described in Embodiment 1 (i.e., the aircraft information alert system described in Embodiment 1), comprising:

[0120] The storage module is used to store preset aircraft prompt information;

[0121] The sensor module is used to collect key physiological data of the target object;

[0122] The data processing module is used to determine whether to trigger a preset aircraft prompt message based on key aircraft information. When the preset aircraft prompt message is triggered, the module determines the processing conditions for the aircraft prompt message based on its priority. When the processing conditions for the aircraft prompt message are met, the module determines whether the target object has noticed the aircraft prompt message based on key physiological data of the target object. If it is determined that the target object has not noticed the aircraft prompt message, the module triggers a reminder condition to remind the target object of the aircraft prompt message.

[0123] The information reminder module is used to remind users of the aircraft's prompts.

[0124] Optionally, the sensor module may include an eye data acquisition module and a facial thermal imaging acquisition module; and / or, the storage module may include a monitoring model library and a physiological data storage module.

[0125] The system may also include an information acquisition module and / or a display or prompting module and / or a reminder suppression module and / or a network module.

[0126] The specific details of the system described in Embodiment 2, including its working method, have been explained in Embodiment 1 and will not be repeated here.

[0127] like Figure 6As shown, the third embodiment of this specification provides an aircraft information alert device corresponding to the method described in Embodiment 1. The device includes:

[0128] Trigger module 202 is used to determine the processing conditions of the aircraft prompt information according to the priority of the aircraft prompt information when a preset aircraft prompt information is triggered.

[0129] The judgment module 204 is used to determine whether the target object has noticed the aircraft prompt information based on the key physiological data of the target object when the processing conditions of the aircraft prompt information are met.

[0130] The reminder module 206 is used to trigger a reminder condition to remind the target object of the aircraft prompt information if it is determined that the target object has not noticed the aircraft prompt information.

[0131] Optionally, determining whether the target object has noticed the aircraft cue information includes:

[0132] If the facial thermal imaging data of the target object meets the preset change within a preset time, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information.

[0133] And / or,

[0134] If the facial thermal imaging data of the target object does not meet the preset change within a preset time, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

[0135] Optionally, the judgment module 204 is further configured to, after triggering the reminder condition, determine whether the target object has noticed the aircraft prompt information, including:

[0136] If the facial thermal imaging data of the target object meets the preset change, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information;

[0137] And / or,

[0138] If the facial thermal imaging data of the target object does not meet the preset change, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

[0139] Optionally, determining the processing conditions for the aircraft alert information based on its priority includes:

[0140] Determine if there is any pending information with a higher priority than the aircraft alert information;

[0141] If so, the processing conditions for the aircraft prompt information include: processing the aircraft prompt information after the pending information has been processed.

[0142] Optionally, the triggering module 202 is further configured to acquire key aircraft information and determine whether the information to be processed has been processed based on the key aircraft information.

[0143] Optionally, the triggering module 202 is further configured to acquire key aircraft information and determine whether to trigger preset aircraft prompt information based on the key aircraft information.

[0144] Optionally, determining whether to trigger a preset aircraft prompt message based on the aforementioned key aircraft information includes:

[0145] The key aircraft information is compared with a preset aircraft prompt model, and the preset aircraft prompt information is determined based on the comparison result.

[0146] Optionally, the reminder module 206 is further configured to stop reminding the aircraft of the reminder information if the reminder stop condition is triggered.

[0147] The above embodiments can be used in combination, and modules with the same name in different embodiments or within the same embodiment can be the same or different modules.

[0148] The foregoing has described specific embodiments of this specification; other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims may be performed in a different order than those shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily have to follow the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0149] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments of apparatus, devices, and non-volatile computer-readable storage media are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0150] The apparatus, device, non-volatile computer-readable storage medium and method provided in the embodiments of this specification are corresponding. Therefore, the apparatus, device and non-volatile computer storage medium also have similar beneficial technical effects as the corresponding method. Since the beneficial technical effects of the method have been described in detail above, the beneficial technical effects of the corresponding apparatus, device and non-volatile computer storage medium will not be repeated here.

[0151] In the 1990s, improvements to a technology could be clearly distinguished as either hardware improvements (e.g., improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the methodology). However, with technological advancements, many methodological improvements today can be considered direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved methodology into the hardware circuit. Therefore, it cannot be said that a methodological improvement cannot be implemented using hardware physical modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is such an integrated circuit whose logic function is determined by the user programming the device. Designers can program and "integrate" a digital system onto a PLD themselves, without needing chip manufacturers to design and manufacture dedicated integrated circuit chips. Furthermore, nowadays, instead of manually manufacturing integrated circuit chips, this programming is mostly implemented using "logic compiler" software. Similar to the software compiler used in program development, the original code before compilation must be written in a specific programming language, called a Hardware Description Language (HDL). There are many HDLs, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, and RHDL (Ruby Hardware Description Language). Currently, the most commonly used are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should understand that by simply performing some logic programming on the method flow using one of these hardware description languages ​​and programming it into an integrated circuit, the hardware circuit implementing the logical method flow can be easily obtained.

[0152] The controller can be implemented in any suitable manner. For example, it can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicon Labs C8051F320. A memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also recognize that, in addition to implementing the controller in purely computer-readable program code form, the same functionality can be achieved by logically programming the method steps to make the controller take the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers. Therefore, such a controller can be considered a hardware component, and the means included therein for implementing various functions can also be considered as structures within the hardware component. Alternatively, the means for implementing various functions can be considered as both software modules implementing the method and structures within the hardware component.

[0153] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0154] For ease of description, the above devices are described in terms of function, divided into various units. Of course, in implementing this specification, the functions of each unit can be implemented in one or more software and / or hardware components.

[0155] Those skilled in the art will understand that the embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the embodiments of this specification can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0156] This specification is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this specification. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0157] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0158] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0159] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0160] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0161] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0162] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0163] This specification can be described in the general context of computer-executable instructions that are executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. This specification can also be practiced in distributed computing environments, where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0164] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0165] The above description is merely an embodiment of this specification and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of this application should be included within the scope of the claims of this application.

Claims

1. A method for providing aircraft information alerts, characterized in that, The method includes: When a preset aircraft alert message is triggered, the processing conditions for the aircraft alert message are determined according to its priority. When the processing conditions for the aircraft alert information are met, it is determined whether the target object has noticed the aircraft alert information based on the target object's key physiological data. If it is determined that the target object has not noticed the aircraft prompt message, then a reminder condition is triggered to remind the target object of the aircraft prompt message. Determining whether the target object has noticed the aircraft notification information includes: If the facial thermal imaging data of the target object meets the preset change within a preset time, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information. And / or, If the facial thermal imaging data of the target object does not meet the preset change within a preset time, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

2. The method as described in claim 1, characterized in that, After the reminder condition is triggered, the method further includes: Determining whether the target object has noticed the aircraft cue message includes: If the facial thermal imaging data of the target object meets the preset change, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information. And / or, If the facial thermal imaging data of the target object does not meet the preset change, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

3. The method as described in claim 1, characterized in that, Determining the processing conditions for the aircraft alert information based on its priority includes: Determine if there is any pending information with a higher priority than the aircraft alert information; If so, the processing conditions for the aircraft prompt information include: processing the aircraft prompt information after the pending information has been processed.

4. The method as described in claim 3, characterized in that, The method further includes: Obtain key aircraft information, and determine whether the information to be processed has been completed based on the key aircraft information.

5. The method as described in claim 1, characterized in that, The method further includes: Obtain key aircraft information and determine whether to trigger a preset aircraft prompt message based on the key aircraft information.

6. The method as described in claim 5, characterized in that, Determining whether to trigger a preset aircraft notification based on the aforementioned key aircraft information includes: The key aircraft information is compared with a preset aircraft prompt model, and the preset aircraft prompt information is determined based on the comparison result.

7. The method as described in claim 1, characterized in that, The method further includes: If the alert stop condition is triggered, then the alert for the aircraft will stop.

8. An aircraft information alert system, characterized in that, The system includes: The storage module is used to store preset aircraft prompt information; The sensor module is used to collect key physiological data of the target object; The data processing module is used to determine whether to trigger a preset aircraft prompt message based on key aircraft information. When the preset aircraft prompt message is triggered, the module determines the processing conditions for the aircraft prompt message based on its priority. When the processing conditions for the aircraft prompt message are met, the module determines whether the target object has noticed the aircraft prompt message based on key physiological data of the target object. If it is determined that the target object has not noticed the aircraft prompt message, the module triggers a reminder condition to remind the target object of the aircraft prompt message. The information reminder module is used to remind users of the aircraft's prompts. Determining whether the target object has noticed the aircraft notification information includes: If the facial thermal imaging data of the target object meets the preset change within a preset time, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information. And / or, If the facial thermal imaging data of the target object does not meet the preset change within a preset time, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

9. An aircraft information alert device, characterized in that, The device includes: The triggering module is used to determine the processing conditions of the aircraft prompt information according to the priority of the aircraft prompt information when a preset aircraft prompt information is triggered. The judgment module is used to determine whether the target object has noticed the aircraft prompt information based on the target object's key physiological data when the processing conditions of the aircraft prompt information are met. The reminder module is used to trigger a reminder condition if it is determined that the target object has not noticed the aircraft reminder information, so as to remind the target object of the aircraft reminder information. Determining whether the target object has noticed the aircraft notification information includes: If the facial thermal imaging data of the target object meets the preset change within a preset time, and the target object's line of sight area overlaps with the area where the aircraft prompt information is displayed, then it is determined that the target object has noticed the aircraft prompt information. And / or, If the facial thermal imaging data of the target object does not meet the preset change within a preset time, or if the target object's line of sight area and the area where the aircraft prompt information is presented do not overlap, then it is determined that the target object has not noticed the aircraft prompt information.

Images