Monitoring video display method and display system for aircraft

Abstract

The invention discloses a monitoring video display method and a monitoring video display system for an aircraft. The monitoring video display method for the aircraft can comprise the following steps: acquiring one or more parameters of the aircraft, wherein the one or more parameters comprise aircraft state parameters; determining a current operating scene of the aircraft according to a flight phase model based on one or more of the acquired one or more parameters; and allocating a display area for at least one of the surveillance videos according to a display management logic based on the running scene. According to the monitoring video display method and display system for the aircraft, the display area is automatically allocated to the monitoring video according to one or more parameters of the aircraft, the observation and analysis efficiency of a pilot on the monitoring video is improved, the scene awareness of a unit is enhanced, the workload of the unit is reduced, and the flight safety is improved.

Description

Technical Field

[0001] This invention relates to the field of civil aircraft avionics systems, and more particularly to a method and system for displaying surveillance video for aircraft. Background Technology

[0002] Airworthiness authorities, addressing the safety requirements of civil transport aircraft, have explicitly mandated the installation of video surveillance systems to monitor cockpit doors, enhancing safety and controllability during operation. This surveillance video utilizes cameras installed inside and outside the aircraft to monitor various parts (e.g., wings, landing gear, cockpit doors, passenger cabin, and cargo hold) in real-time. This measure primarily aims to address potential safety threats and ensure effective monitoring of the cockpit's security and safety. Furthermore, during aircraft operations, there have been frequent incidents of aircraft having to return to their origin due to false alarms of smoke in the cargo hold. These incidents not only impose additional costs and burdens on airlines but also disrupt flight schedules. To address this issue, domestic and international airlines have begun deploying cameras inside aircraft cargo holds to achieve real-time monitoring of the cargo hold's status. In this way, if abnormal conditions such as smoke are detected in the cargo hold, the crew can obtain relevant information promptly, make accurate judgments and decisions, and avoid unnecessary return-to-origin incidents.

[0003] With the increasing demand for aircraft safety and operational status monitoring, manufacturers of civil transport aircraft have equipped their cockpits with various video surveillance systems. These systems provide pilots with real-time video information from different parts of the aircraft, both inside and outside, helping them to fully understand the aircraft's operational status and surrounding environment. However, the display interface in front of the pilot in the cockpit has limited space. Due to the large number of video sources, including cockpit door monitoring video, cargo hold monitoring video, and other possible external camera videos, it is impossible to display all the monitoring videos simultaneously on the interface.

[0004] Therefore, there is an urgent need for a method to automatically provide pilots with the necessary monitoring video sources for different operational scenarios on civil transport aircraft. Summary of the Invention

[0005] The following provides a brief overview of one or more aspects to offer a basic understanding of such aspects. This overview is not an exhaustive summary of all conceived aspects, nor is it intended to identify the key or decisive elements of all aspects, nor to define the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as an introduction to the more detailed description that follows.

[0006] To address one or more of the aforementioned technical problems, this disclosure proposes a method and system for displaying surveillance video on aircraft. Based on aircraft parameters and a flight phase model, the method and system automatically allocate display areas for at least one surveillance video based on the flight phase model and display management logic. This improves the efficiency of pilots' observation and analysis of surveillance video, enhances the crew's situational awareness, reduces crew workload, and improves flight safety, demonstrating broad application prospects.

[0007] One aspect of this disclosure discloses a method for displaying surveillance video of an aircraft. The method may include: acquiring one or more parameters of the aircraft, wherein the one or more parameters include aircraft status parameters; determining the current operating scenario of the aircraft based on one or more of the acquired parameters according to a flight phase model; and allocating a display area for at least one surveillance video in the surveillance video according to display management logic based on the operating scenario.

[0008] In one embodiment, the surveillance video display method may optionally further include: capturing a display request signal from at least one surveillance video.

[0009] In one embodiment, optionally, one or more parameters may further include: a display request signal captured from at least one monitoring video in the monitoring video, the urgency of the display request signal, an alarm signal triggered during the maneuvering of the aircraft, and the response time and / or priority order of the flight maneuvers.

[0010] In one embodiment, the aircraft status parameters may optionally include: flight phase information, air-to-ground status, ground speed, and monitoring / operating pilot settings.

[0011] In one embodiment, the surveillance video may optionally include: cockpit door surveillance video, belly surveillance video, wing surveillance video, landing gear surveillance video, passenger cabin area surveillance video, cargo hold area surveillance video and / or cargo hold door surveillance video.

[0012] In one embodiment, the display area may optionally include a first field of view and a second field of view, wherein the first field of view includes a field of view range of 30-40° to the left and right in the horizontal direction with the pilot's designed eye position as a reference point, and 35-45° above and 15-25° below in the vertical direction with the pilot's designed eye position as a reference line, and the second field of view includes a field of view range below and to the side of the pilot in the cockpit that does not interfere with the crew's current mission.

[0013] In one embodiment, the display area may optionally include a first field of view, a second field of view, and a third field of view, wherein the third field of view includes a field of view range of 10-30° horizontally with reference to the pilot's designed eye position, and 10-20° vertically with reference to 15° downward from the pilot's designed eye position, and excluding the third field of view range; the first field of view includes a field of view range of 30-40° horizontally with reference to the pilot's designed eye position, and 35-45° vertically with reference to 15° downward from the pilot's designed eye position, and excluding the third field of view range; and the second field of view includes a field of view range below and to the side of the pilot in the cockpit that does not interfere with the crew's current mission.

[0014] In one embodiment, the surveillance video display method may optionally further include: when two or more surveillance videos are assigned to the same field of view, determining the display method of the two or more surveillance videos based on their priority order within the field of view. In this embodiment, the priority order may dynamically change depending on the operating scenario. In one instance, the display method may include: selective display, side-by-side display, or primary / secondary display.

[0015] In one embodiment, the priority order may optionally include: alarm display > flight control display > routine operation display.

[0016] In one embodiment, the priority order may optionally include: flight control display > alarm display > routine operation display.

[0017] In one embodiment, the surveillance video display method may optionally further include: allocating display time for at least one surveillance video in the surveillance video; and displaying at least one surveillance video in a display area allocated to at least one surveillance video in the surveillance video.

[0018] In one embodiment, optionally, the display management logic may include: determining whether at least one monitoring video and other windows to be displayed are related to flight control; if it is determined that at least one of the at least one monitoring video and other windows to be displayed are related to flight control, then displaying at least one of them in a first or third field of view of the pilot; if it is determined that at least one of the at least one monitoring video and other windows to be displayed are not related to flight control, then determining whether at least one of the at least one monitoring video and other windows to be displayed are related to an alarm; if at least one of the at least one monitoring video and other windows to be displayed are related to an alarm, then displaying at least one of them in a first field of view of the pilot; and if at least one of the at least one monitoring video and other windows to be displayed are not related to an alarm, then displaying at least one of them in a second field of view.

[0019] Another aspect of this disclosure discloses a display system for monitoring video of an aircraft. The monitoring video display system may include: multiple camera modules, a parameter acquisition module, a display module, and a display management module, wherein the display management module is connected to the multiple camera modules, the parameter acquisition module, and the display module respectively. In one embodiment, the multiple camera modules may be arranged at multiple locations on the aircraft and configured to acquire real-time images. In one embodiment, the parameter acquisition module may be configured to acquire one or more parameters of the aircraft, wherein the one or more parameters include aircraft status parameters. In one embodiment, the display module may be configured to display images and other information required for flight. In one embodiment, the display management module may be configured to: determine the current operating scenario of the aircraft based on one or more of the acquired parameters, according to a flight phase model, and, based on the operating scenario, allocate display areas on the display module to at least one monitoring video in the monitoring video according to display management logic.

[0020] Another aspect of this disclosure provides a non-transient computer-readable storage medium having instructions stored thereon, which can be executed by a processor to perform the methods described above.

[0021] The monitoring video display method and system for aircraft disclosed herein can automatically adjust the display of monitoring video based on the actual status of the aircraft, eliminating the need for manual operation by the pilot and improving the timeliness and accuracy of the display. Furthermore, the monitoring video display method and system can allocate appropriate display areas for monitoring video according to different scenarios, allowing pilots to easily observe the required monitoring video in various operational situations, thus improving the rationality and effectiveness of the display. In addition, the monitoring video display method and system can prioritize the content displayed within the same display area under different operational scenarios, ensuring that important information is displayed first. This helps pilots quickly obtain key information, ensuring flight safety and efficiency at all stages.

[0022] This disclosure is provided to introduce concepts in a simplified form, which will be further described in the detailed description below. This disclosure is not intended to identify key or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter. Other aspects, features, and / or advantages of the embodiments will be set forth in part in the description which follows, and will be apparent in part from the description, or may be learned by practice of this disclosure. Attached Figure Description

[0023] To gain a more detailed understanding of the features described above in this disclosure, reference can be made to a more specific description of the above-briefly summarized aspects, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings illustrate only certain typical aspects of this disclosure and should not be considered as limiting its scope, as other equivalent aspects are permissible in this description. In the drawings:

[0024] Figure 1 A schematic diagram of the distribution of cameras for an aircraft according to an embodiment of the present disclosure is shown.

[0025] Figure 2 A flowchart of a method for displaying surveillance video for an aircraft according to an embodiment of the present disclosure is shown.

[0026] Figure 3 A schematic diagram of the division of the display area according to an embodiment of the present disclosure is shown.

[0027] Figure 4 A structural diagram of a monitoring video display system for an aircraft according to an embodiment of the present disclosure is shown.

[0028] Figure 5 A flowchart of display management logic for an aircraft according to an embodiment of the present disclosure is shown.

[0029] Figure 6 A block diagram of an apparatus including a surveillance video display system for an aircraft is shown according to one embodiment of the present disclosure. Detailed Implementation

[0030] The specific embodiments described below with reference to the accompanying drawings are intended as descriptions of various configurations and are not intended to represent only the configurations in which the concepts described herein can be practiced. These specific embodiments include detailed descriptions to provide a thorough understanding of the various concepts. However, it will be apparent to those skilled in the art that these concepts can be practiced without these detailed descriptions.

[0031] Based on this teaching, those skilled in the art will appreciate that the scope of this disclosure is intended to cover any aspect of this disclosure, whether implemented independently of or in combination with any other aspect of this disclosure. For example, any number of the aspects described can be used to implement an apparatus or method of practice. Furthermore, the scope of this disclosure is intended to cover such apparatus or methods practiced using other structures, functionalities, or structures and functionalities that complement or differ from the various aspects of this disclosure described.

[0032] While specific aspects are described herein, numerous variations and substitutions of these aspects fall within the scope of this disclosure. Although some benefits and advantages of preferred aspects have been mentioned, the scope of this disclosure is not intended to be limited to a particular benefit, use, or objective. The detailed description and accompanying drawings are merely illustrative and not limiting of this disclosure, the scope of which is defined by the appended claims and their equivalents.

[0033] With the increasing demand for aircraft safety and operational status monitoring, manufacturers of civil transport aircraft have equipped their cockpits with various video surveillance systems. These systems provide pilots with real-time video information from different parts of the aircraft, both inside and outside, helping them gain a comprehensive understanding of the aircraft's operational status and surrounding environment. However, the display interface in front of the pilot in the cockpit has limited space. Due to the large number of video sources, including cockpit door surveillance video, cargo hold surveillance video, and other possible external camera videos, it is impossible to display all the surveillance videos simultaneously on the interface. For example, some aircraft models are equipped with two fixed electronic flight bags (EFBs) in the cockpit. The fixed EFB can be used to calculate takeoff performance and charts for the Flight Management System (FMS) and display cockpit door surveillance video. However, this aircraft model only allows the crew to manually view the surveillance video of the passenger cabin area outside the cockpit door. The fixed EFB has limited information exchange with the aircraft control domain, resulting in a low level of automation. How to automatically provide pilots with the required monitoring video sources based on different operational scenarios within a limited display interface has become an urgent problem to be solved in the field of civil transport aircraft. Existing monitoring video display methods often fail to meet this need, suffering from low automation and unreasonable allocation of display areas, which makes it inconvenient for pilots to obtain critical monitoring video information, affecting flight safety and operational efficiency.

[0034] To address one or more of the aforementioned technical problems, this disclosure proposes a method and system for displaying surveillance video on aircraft. Based on aircraft parameters and a flight phase model, the method and system automatically allocate display areas for at least one surveillance video based on the flight phase model and display management logic. This improves the efficiency of pilots' observation and analysis of surveillance video, enhances the crew's situational awareness, reduces crew workload, and improves flight safety, demonstrating broad application prospects.

[0035] For ease of description, the following description uses an airplane as an example of an aircraft. Those skilled in the art will appreciate that the monitoring video display method and system for aircraft according to this disclosure are applicable to various types of aircraft without departing from the scope of this disclosure. In the following description of this disclosure, "aircraft" and "airplane" can be used interchangeably.

[0036] The present disclosure will be further described below with reference to specific embodiments and accompanying drawings, but this should not be construed as limiting the scope of protection of the present disclosure.

[0037] Figure 1 A schematic diagram 100 showing the distribution of a camera 105 for an aircraft according to an embodiment of the present disclosure is shown. As an example, such as... Figure 1 As shown, the camera 105 can be distributed at various locations on the aircraft. In some cases, the camera 105 may be located on the wings, landing gear, cockpit door, passenger cabin area, and cargo hold area, etc. In other cases, the camera 105 may be located on the belly of the aircraft, etc. Those skilled in the art will appreciate that the camera 105 can be distributed at any location on the aircraft (including...). Figure 1 (The location is not shown in the text) without departing from the scope of this disclosure.

[0038] Figure 2 A flowchart of a monitoring video display method 200 for an aircraft according to an embodiment of the present disclosure is shown. In some cases, the monitoring video display method 200 for an aircraft may be provided by a display management module (hereinafter referred to as...). Figure 4 (To be elaborated further) to be executed. In this embodiment, as... Figure 2 As shown, the monitoring video display method 200 may include the following steps.

[0039] In step 202, the display management module can acquire one or more parameters of the aircraft, including aircraft status parameters. In one optional embodiment, the aircraft status parameters may include, but are not limited to, flight phase information, air-to-ground status, ground speed, monitoring pilot / operating pilot settings, etc. In one optional embodiment, the one or more parameters may further include: a display request signal captured from at least one monitoring video, the urgency level of the display request signal, alarm signals triggered during aircraft maneuvering, and response time and / or priority order of flight maneuvers. For example, the display request signal captured from at least one monitoring video may be a cockpit door access request signal captured from a camera located at the cockpit door. For example, the urgency level of the display request signal may include emergency and routine. For example, the cockpit door access request signal may be a routine display request signal or an emergency display request signal. For example, alarm signals triggered during aircraft maneuvering may include, but are not limited to, landing gear not deployed alarms, cargo hold smoke alarms, cargo hold door unlocked configuration alarms, and / or landing gear door not closed alarms, etc. For example, the response time of flight maneuvers may be the response time required for the pilot to perform flight operations and receive feedback.

[0040] In step 204, the display management module can determine the aircraft's current operating scenario based on one or more of the acquired parameters, according to a flight phase model. In one embodiment, flight phases may include, but are not limited to, taxiing out, takeoff, cruise, descent, approach, landing, and slide-in. As an example, flight phases can be determined by parameters such as landing gear wheel load, engine start-up, throttle lever angle, radio altitude, flap / slat configuration, thrust reverser status, and ground spoiler position.

[0041] In section 204, the display management module can allocate display areas for at least one monitoring video based on the operational scenario and display management logic. For example, if a landing gear not deployed alarm is triggered, the belly monitoring video is automatically displayed in a designated area, such as within the pilot's primary field of view; if a cargo hold smoke alarm is triggered, the cargo hold monitoring video is automatically displayed in a designated display area, such as within the pilot's primary field of view; if a cargo hold door not locked configuration alarm is triggered, the cargo hold door monitoring video is automatically displayed in a designated display area, such as within the pilot's optimal field of view; if a landing gear door not closed alarm is triggered, the belly monitoring video is automatically displayed in a designated display area, such as within the primary field of view. As an example, when allocating display areas for at least one monitoring video, the timing of the display of at least one monitoring video within the display area should be pre-emptive, taking into account the response time of flight controls to ensure flight safety. In other words, the timing of the display of at least one monitoring video within the display area should prioritize flight safety and take into account the response time of flight controls. For example, at least one surveillance video should be displayed in the display area before the response time required for flight maneuvers performed to ensure flight safety. In one example, emergency access to the cockpit door typically begins a countdown after the user (e.g., cabin crew) enters the correct access code, and the cockpit door automatically unlocks before the countdown ends, even if the crew does not respond in time.

[0042] In an optional embodiment, the surveillance video display method may further include: a display management module capturing a display request signal from at least one surveillance video. In an alternative embodiment, the display request signal may be captured by camera 105 and sent to the display management module.

[0043] In an optional embodiment, the monitoring video display method may further include: a display management module allocating display time for at least one monitoring video in the monitoring video; and displaying at least one monitoring video within the display area allocated to the at least one monitoring video in the monitoring video. For example, when the display management module allocates display time for the at least one monitoring video in the monitoring video, the response time of flight operations should be taken into account to ensure flight safety.

[0044] In one alternative embodiment, the surveillance video may include, but is not limited to: cockpit door surveillance video, belly surveillance video, wing surveillance video, landing gear surveillance video, passenger cabin area surveillance video, cargo hold area surveillance video and / or cargo hold door surveillance video, etc., and this application does not limit it in this regard.

[0045] Those skilled in the art will appreciate that the priority order can differ depending on the aircraft's operational scenarios. That is, the priority order described herein is dynamic and not fixed, depending on the operational scenario. In one alternative embodiment, the priority order may include: alarm display > flight control display > routine operation display. In an alternative embodiment, the priority order may include: flight control display > alarm display > routine operation display. In one embodiment, the priority order may vary for each field of view.

[0046] In one example, when the aircraft is in the air, if the landing gear doors are not closed or there is smoke in the cargo hold, the monitoring video related to the alarm is displayed first, such as the belly of the aircraft or the cargo hold. Subsequently, content that may be related to flight control is displayed, such as video of the status of the wing multi-function spoilers.

[0047] As an example, during descent, if a cargo hold smoke alarm occurs, the priority order for displaying information in the second field of view can be: cargo hold monitoring video > cockpit door monitoring video > passenger cabin monitoring video, with the crew given priority in assessing the actual situation in the cargo hold. Once the aircraft has completed its emergency descent and is fully alighted on the runway, the priority order for displaying information in the second field of view can be: passenger cabin monitoring video > cockpit door monitoring video > cargo hold monitoring video, with the crew given priority in guiding and understanding the passenger cabin evacuation status, and secondarily in assessing whether the cockpit door area is safe to open.

[0048] Under normal circumstances, taxiing video is typically displayed in the first field of view (Field of View), while cabin area or cockpit door monitoring video is typically displayed in the second field of view (Field of View). As an example, during the landing phase, if the aircraft decelerates to below 60 knots upon touchdown, taxiing video and cabin / cockpit door monitoring video can be simultaneously assigned to the second field of view (e.g., the system diagram page of the second field of view) via a composite view overlaid on the Primary Flight Display (PFD) or manual selection by the crew (e.g., the system diagram page of the second field of view). In this case, even with cabin calls, the priority order of the displayed videos can be: taxiing video > cockpit door monitoring video > cabin area monitoring video, prioritizing assistance to the crew in completing runway disengagement. After entering the main taxiway, if cabin calls continue, the video priority order can be adjusted to: cabin area (corresponding to crew positions) monitoring video > cockpit door monitoring video > taxiing video.

[0049] Those skilled in the art will appreciate that the above priorities are provided merely as examples and are not intended to limit the scope of this application. Furthermore, those skilled in the art will appreciate that the priority for any one field of view within the field of view can be dynamically changed.

[0050] In an optional embodiment, the display area may include a first field of view and a second field of view, wherein the first field of view includes a field of view range of 30-40° to the left and right in the horizontal direction with the pilot's designed eye position as the reference point, and 35-45° above and 15-25° below in the vertical direction with the pilot's designed eye position as the reference line, and the second field of view includes a field of view range below and to the side of the pilot in the cockpit that does not interfere with the crew's current mission.

[0051] In an optional embodiment, the monitoring video display method may further include: when two or more monitoring videos are assigned to the same field of view, determining the display method of the two or more monitoring videos based on their priority order within the field of view. In this embodiment, the priority order may dynamically change depending on the operational scenario. In one instance, the display method may include: selective display, side-by-side display, or primary and secondary display. For example, during landing and deceleration, taxiing videos are displayed first to assist the crew in controlling the aircraft's taxiing.

[0052] Figure 3 A schematic diagram illustrating the division of a display area according to an embodiment of the present disclosure is shown. In this embodiment, the display area may include: a first field of view, a second field of view (not shown), and a third field of view. In some cases, the third field of view includes: a field of view range extending 10-30° horizontally and 10-20° vertically with the pilot's designed eye position as a reference point, and 10-20° upward and downward with the pilot's designed eye position as a reference line downward. The first field of view includes: a field of view range excluding the third field of view extending 30-40° horizontally and 35-45° vertically with the pilot's designed eye position as a reference point, and 15-25° downward with the pilot's designed eye position as a reference line downward. The second field of view includes: a field of view range below and to the side of the pilot in the cockpit that does not interfere with the crew's current mission.

[0053] In a preferred embodiment, the first field of view can be the main field of view, which is a field of view range with the pilot's designed eye position (DEP) as the reference point, extending 35° horizontally to the left and right, 15° downward from the DEP vertically, and 40° upward and 20° downward; the second field of view can be outside the main field of view, that is, below and to the side of the pilot in the cockpit, such as a side display or a fixed electronic flight bag; the third field of view can be within the optimal field of view, that is, a subset of the main field of view, extending 15° horizontally to the left and right, 15° upward and 15° downward from the DEP vertically.

[0054] As an example, monitoring video related to alarms can be automatically displayed in the first field of view. For instance, calibrated airspeed (CAS) can be concentrated as much as possible in the first field of view. As another example, monitoring video related to routine operations can be automatically displayed in the second field of view, provided it does not interfere with the crew's current mission. As yet another example, monitoring video related to flight maneuvers can be automatically displayed in the third field of view to reduce the pilot's line-of-sight movement. Those skilled in the art will appreciate that the above division of display areas is merely illustrative, and the display area can be divided into more or fewer fields of view (e.g., two fields of view, namely the first and second fields of view) or in different ways without departing from the scope of this disclosure.

[0055] As a preferred example, the display area can be divided into the optimal field of view for the pilot in control (PF), the primary field of view for the monitoring pilot (PM), and areas outside the primary field of view. For example, as... Figure 3 As shown, the third field of view (e.g., the PF optimal field of view) can be a field of view range of 10-20° horizontally, preferably 14-16°, for example 15°, with DEP as the reference point; and 10-20° vertically, preferably 14-16°, for example 15°, with DEP 15° downwards as the reference line; and 10-20° vertically, preferably 14-16°, for example 15°, with DEP 15° downwards as the reference line. For example, the first field of view (e.g., the PM main field of view) can be a field of view range of 30-40° horizontally, preferably 34-36°, for example 35°, with DEP as the reference point; and 35-45° vertically, preferably 39-41°, for example 40°, with DEP 15° downwards as the reference line; and 15-25° vertically, preferably 19-21°, for example 20°, with DEP 15° downwards as the reference line. For example, the area outside the main field of view can be the area below and to the side of the pilot in the cockpit.

[0056] Those skilled in the art will appreciate that the above field of view division is provided merely as an example and is not intended to limit this application.

[0057] Figure 4 A structural diagram of a monitoring video display system 400 for an aircraft according to an embodiment of the present disclosure is shown. Figure 4 As shown, the surveillance video display system 400 may include multiple camera modules 405 (e.g., Figure 1The diagram shows a camera 105, a parameter acquisition module 410, a display module 415, and a display management module 420. The display management module 420 can be connected to multiple camera modules 405, parameter acquisition modules 410, and display modules 415. In one embodiment, multiple camera modules 405 can be arranged at multiple locations on the aircraft and configured to acquire real-time images. For example, camera modules 405 can be used to capture real-time video inside and outside the aircraft, including but not limited to video from locations such as the cockpit door, wings, landing gear, cargo hold, and passenger cabin. In one embodiment, the parameter acquisition module 410 can be configured to acquire one or more parameters of the aircraft, including aircraft status parameters such as, but not limited to, flight phase, ground speed, air-to-ground status, etc. In one embodiment, the display module 415 can be configured to display images and other information required for flight, including but not limited to the main display, side displays, and fixed electronic flight bag, etc. In one embodiment, the display management module 420 may be configured to: determine the current operating scenario of the aircraft based on one or more of the acquired parameters according to a flight phase model; and, based on the operating scenario, allocate a display area on a display module to at least one monitoring video in the monitoring video according to display management logic. For example, the display management module 420 may manage and allocate display areas for the monitoring video according to flight parameters and display management logic.

[0058] Figure 5 A flowchart of display management logic 500 for an aircraft according to an embodiment of the present disclosure is shown. In this embodiment, the display management logic may include: determining whether at least one monitoring video and other windows to be displayed are related to flight control; if it is determined that at least one of the at least one monitoring video and other windows to be displayed are related to flight control, then displaying at least one of them within the optimal field of view of the control PF; if it is determined that at least one of the at least one monitoring video and other windows to be displayed are not related to flight control, then determining whether at least one of the at least one monitoring video and other windows to be displayed are related to an alarm; if at least one of the at least one monitoring video and other windows to be displayed are related to an alarm, then displaying at least one of them within the main field of view of the monitoring PM; and if at least one of the at least one monitoring video and other windows to be displayed are not related to an alarm, then displaying at least one of them outside the main field of view.

[0059] This patent provides a highly automated monitoring video display method and system. The system can display corresponding monitoring videos in different areas of the cockpit according to display management logic, based on normal operation scenarios (such as ground taxiing and cockpit door access) and abnormal operation scenarios (such as landing gear not being deployed). The following detailed embodiments further illustrate this.

[0060] Example 1 – Flight Control Scenario

[0061] When the aircraft is on the ground and the ground speed is less than or equal to a threshold, the display management module 420 can determine whether to display the aircraft taxiing video within the PF optimal field of view so that the pilot can better perform ground taxiing.

[0062] When the aircraft ground speed exceeds a threshold, the display management module 420 can determine to remove the aircraft taxiing video display within the PF optimal field of view in order to avoid interfering with the pilot's normal flight.

[0063] Example 2 – Normal Operation Scenarios Other Than Flight Control

[0064] When a regular cockpit door access request is triggered, the display management module 420 can determine whether to display the cockpit door monitoring video on the side display or fixed electronic flight bag outside the main field of view, so that the pilot can view the situation outside the cockpit door without affecting normal flight operations.

[0065] Example 3 – Alarm-related scenarios

[0066] If a landing gear failure alarm is triggered, the display management module 420 can determine to display the belly monitoring video in the pilot-monitoring (PM) main field of view so that the pilot can check the landing gear status in a timely manner.

[0067] If a cargo hold smoke alarm is triggered, the display management module 420 can determine whether to display the cargo hold area monitoring video in the PM main field of view so that the pilot can be informed of the smoke situation in the cargo hold in a timely manner.

[0068] If an emergency request is made from the cabin, the display management module 420 can determine which display area to show the relevant surveillance video so that the pilots can be informed of the emergency situation in the cabin in a timely manner.

[0069] If a cargo door unlocked configuration alarm is triggered, the display management module 420 can determine to display the cargo door monitoring video in the optimal field of view of the pilot-flying (PF) so that the pilot can check the cargo door status in a timely manner.

[0070] If a landing gear door not closed alarm is triggered, the display management module 420 can determine to display the belly monitoring video on the system diagram page in the main field of view so that the pilot can check the landing gear door status in a timely manner.

[0071] As an example, the PF's optimal field of view can be assigned to display monitoring video related to flight operations, such as, but not limited to, taxi assist. As an example, the PM's primary field of view can be assigned to display alarm-related scenarios, such as, but not limited to, landing gear not deployed, cargo hold smoke, cargo hold door unlocked, and cargo hold door not closed. As an example, scenarios outside the primary field of view can be assigned to display normal operation scenarios, such as, but not limited to, regular cockpit door access requests. The following assignment relationships are merely illustrative and not intended to be limiting.

[0072] The monitoring video display method and system for aircraft disclosed herein can automatically adjust the display of monitoring video based on the actual status of the aircraft, eliminating the need for manual operation by the pilot and improving the timeliness and accuracy of the display. Furthermore, the monitoring video display method and system can allocate appropriate display areas for monitoring video according to different scenarios, allowing pilots to easily observe the required monitoring video in various operational situations, thus improving the rationality and effectiveness of the display. In addition, the monitoring video display method and system can prioritize the content displayed within the same display area under different operational scenarios, ensuring that important information is displayed first. This helps pilots quickly obtain key information, ensuring flight safety and efficiency at all stages.

[0073] Figure 6 A block diagram of an apparatus 600 including a surveillance video display system for an aircraft is shown according to one embodiment of the present disclosure. The apparatus illustrates a general hardware environment in which the present disclosure can be applied according to exemplary embodiments thereof.

[0074] Now refer to Figure 6 Device 600 is described as an exemplary embodiment of a hardware device that can be applied to various aspects of this disclosure. Device 600 can be any machine configured to perform processing and / or computation, and can be, but is not limited to, a workstation, server, desktop computer, laptop computer, tablet computer, or any combination thereof. The aforementioned system can be implemented wholly or at least partially by device 600 or similar devices or systems.

[0075] Device 600 may include elements that may be connected to or communicate with bus 602 via one or more interfaces. For example, device 600 may include bus 602, one or more input devices 605, one or more output devices 610, one or more processors 615, and one or more memories 620, etc.

[0076] Processor 615 can be any type of processor and may include, but is not limited to, general-purpose processors and / or special-purpose processors (e.g., special-purpose chips), intelligent hardware devices (e.g., general-purpose processors, DSPs, CPUs, microcontrollers, ASICs, FPGAs, programmable logic devices, discrete gate or transistor logic components, discrete hardware components, or any combination thereof). In some cases, processor 615 may be configured to use a memory controller to operate a memory array. In other cases, a memory controller (not shown) may be integrated into processor 615. Processor 615 may be configured to execute computer-readable instructions stored in memory to perform the various functions described herein.

[0077] Memory 620 can be any storage device capable of storing data. Memory 620 may include, but is not limited to, disk drives, optical storage devices, solid-state storage, floppy disks, hard disks, magnetic tape or any other magnetic media, optical discs or any other optical media, ROM (read-only memory), RAM (random access memory), cache memory and / or any other memory chip or cartridge, and / or any other medium from which a computer can read data, instructions and / or code. Memory 620 may store computer-executable software 625 including computer-readable instructions that, when executed, cause a processor to perform the various functions described herein. Memory 620 may have various data / instructions / code for implementing the various functions described herein.

[0078] Software 625 may be stored in memory 620 and includes, but is not limited to, an operating system, one or more applications, drivers, and / or other data and code. Instructions for performing the various functions described herein may be included in one or more applications, and the units of the aforementioned device 600 may be implemented by processor 615 reading and executing the instructions of one or more applications. In some cases, software 625 may not be directly executable by the processor, but may (e.g., when compiled and executed) enable the computer to perform the functions described herein.

[0079] Input device 605 can be any type of device that can input information to the computing device.

[0080] The output device 610 can be any type of output device capable of outputting information. In one case, the output device 610 can be any type of image output device capable of displaying information.

[0081] Those skilled in the art will clearly understand from the above embodiments that this disclosure can be implemented by software with the necessary hardware or by hardware, firmware, etc. Based on this understanding, embodiments of this disclosure can be implemented in part in software form. The computer software can be stored on a readable storage medium, such as a floppy disk, hard disk, optical disk, or computer flash memory. The computer software includes a series of instructions to cause a computer (e.g., a personal computer, service station, or network terminal) to perform methods or portions thereof according to various embodiments of this disclosure.

[0082] The word “exemplary” is used herein to mean “serving as an example, embodiment, or illustration.” Any aspect described herein as “exemplary” is not necessarily to be construed as superior to or better than the others.

[0083] The preceding description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will readily be understood by those skilled in the art, and the universal principles defined herein may be applied to other aspects. Therefore, the claims are not intended to be limited to the aspects shown herein, but should be granted the full scope consistent with the language of the claims, wherein references to the singular form of an element, unless specifically stated otherwise, are not intended to mean “one and only one,” but rather “one or more.” Unless specifically stated otherwise, the term “some” refers to one or more. All structural and functional equivalents of the elements of the various aspects described throughout this disclosure, whether now or hereafter known to a person skilled in the art, are expressly incorporated herein by reference and are intended to be covered by the claims.

Claims

1. A method for displaying surveillance video of an aircraft, comprising: Acquire one or more parameters of the aircraft, wherein the one or more parameters include aircraft state parameters; Based on one or more of the acquired parameters, the current operating scenario of the aircraft is determined according to the flight phase model; as well as Based on the aforementioned operating scenario, a display area is allocated to at least one of the monitored videos according to the display management logic.

2. The method as described in claim 1, characterized in that, Further includes: A display request signal is captured from at least one of the surveillance videos.

3. The method as described in claim 1, characterized in that: The one or more parameters further include: a display request signal captured from at least one monitoring video in the monitoring video, the urgency of the display request signal, an alarm signal triggered during the maneuvering of the aircraft, and the response time and / or priority order of the flight maneuvers. The aircraft status parameters include: flight phase information, air-to-ground status, ground speed, monitoring pilot / operating pilot settings; and / or The surveillance videos include: cockpit door surveillance video, belly surveillance video, wing surveillance video, landing gear surveillance video, passenger cabin area surveillance video, cargo hold area surveillance video and / or cargo hold door surveillance video.

4. The method as described in claim 1, characterized in that, The display area includes: A first field of view and a second field of view, wherein the first field of view includes: a horizontal field of view extending 30-40° to the left and right of the pilot's designed eye position, and a vertical field of view extending 35-45° upward and 15-25° downward, with the pilot's designed eye position downward as a reference line; and the second field of view includes: a field of view below and to the side of the pilot in the cockpit that does not interfere with the crew's current mission; or The first field of view, the second field of view, and the third field of view are defined as follows: the third field of view includes a range of 10-30° horizontally with reference to the pilot's designed eye position, and 10-20° vertically with reference to 15° downward from the pilot's designed eye position. The first field of view includes the range of 30-40° horizontally with reference to the pilot's designed eye position, and 35-45° vertically with reference to 15° downward from the pilot's designed eye position, excluding the third field of view. The second field of view includes the field of view below and to the side of the pilot in the cockpit that does not interfere with the crew's current mission.

5. The method as described in claim 4, characterized in that, Further includes: When two or more surveillance videos are assigned to the same field of view, the display method of the two or more surveillance videos is determined based on their priority order within the field of view. The priority order changes dynamically depending on the operating scenario, and the display method includes: selective display, side-by-side display, or primary and secondary display.

6. The method as described in claim 5, characterized in that, The priority sorting includes: Alarm displays > Flight control displays > Routine operation displays; or Flight control display > Alarm display > Routine operation display.

7. The method as described in claim 5, characterized in that, Further includes: Assign display time to at least one of the surveillance videos; as well as The at least one surveillance video is displayed in the display area allocated to the at least one surveillance video in the surveillance video.

8. The method as described in claim 1, characterized in that, The display management logic includes: Determine whether the at least one monitoring video and other windows to be displayed are related to flight operations; If it is determined that at least one of the at least one monitoring video and at least one of the other windows to be displayed is related to flight control, then the at least one is displayed in the pilot's first or third field of view. If it is determined that at least one of the at least one monitoring video and at least one of the other windows to be displayed is not related to flight control, then it is determined whether the at least one monitoring video and at least one of the other windows to be displayed are related to an alarm. If at least one of the at least one surveillance video and at least one of the other windows to be displayed is related to an alarm, then the at least one is displayed within the first field of view of the monitoring pilot; and If at least one of the at least one surveillance video and at least one of the other windows to be displayed is not related to the alarm, then the at least one is displayed in the second field of view.

9. A display system for monitoring video of an aircraft, comprising: Multiple camera modules are arranged at multiple locations on the aircraft and configured to acquire real-time images; A parameter acquisition module is configured to acquire one or more parameters of the aircraft, wherein the one or more parameters include aircraft status parameters. A display module configured to display images and other information required for flight; as well as The display management module is connected to the plurality of camera modules, the parameter acquisition module, and the display module, and is configured to: Based on one or more of the acquired parameters, the current operating scenario of the aircraft is determined according to the flight phase model, and Based on the aforementioned operating scenario, a display area on the display module is allocated to at least one of the monitored videos according to the display management logic.

10. A non-transient computer-readable storage medium having instructions stored thereon, the instructions being executable by a processor to perform the method as claimed in any one of claims 1-8.

Images