Method and system for indicating and guiding fire extinguishing aircraft based on head-up display

The head-up display system for firefighting aircraft integrates real-time data to enhance visibility and obstacle avoidance, addressing maneuverability and visibility issues, thereby improving safety and efficiency in firefighting operations.

CN119075230APending Publication Date: 2024-12-06COMMERCIAL AIRCRAFT CORP OF CHINA LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411398782.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-08
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Firefighting aircraft face challenges in maintaining maneuverability and stability due to heavy weight and reduced visibility during firefighting operations, especially in complex terrain, leading to potential accidents and low delivery efficiency.

Method used

A method and system using a head-up display to project symbol information for firefighting guidance, enhanced vision, and obstacle avoidance, integrating real-time aircraft and external data to provide intuitive flight path adjustments and delivery instructions.

Benefits of technology

Enhances pilot situational awareness and reduces visual fatigue by maintaining a head-up posture, improving safety and efficiency in firefighting operations by integrating real-time data projection onto a head-up display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119075230A_ABST
    Figure CN119075230A_ABST
Patent Text Reader

Abstract

The invention provides a head-up display-based method for indicating and guiding a fire-extinguishing aircraft. The method comprises the following steps of: generating symbol information of fire-extinguishing indication and guiding; generating surrounding terrain conditions and enhanced views and indication symbols of obstacles; and projecting the symbol information of the fire extinguishing indication guidance, the surrounding terrain condition, the enhanced vision of the obstacle and the indication symbol to a head-up display combination instrument in front of a pilot. In addition, the invention further provides a system for indicating and guiding the fire-fighting aircraft based on head-up display. According to the invention, the sight of a pilot does not need to be frequently switched between a lower display scene and an external scene, the visual fatigue of the pilot is relieved, the response time of the pilot is reduced, and the pilot can conveniently and visually know the surrounding terrain obstacle condition in a view shielding state caused by smoke.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of fire-fighting aircraft mission system design, and in particular to a method and system for indicating and guiding a fire-fighting aircraft based on a head-up display. Background Art

[0002] Wild forest fires often occur in remote mountains and hills with complex terrain. Fixed-wing firefighting aircraft have the advantages of fast flight speed, large amount of fire-fighting medium, and convenient large-area monitoring. They are an efficient means of controlling such fires. However, if the firefighting aircraft flies at a high altitude during delivery, the fire-fighting medium will be atomized and deviate from the predetermined delivery position. Therefore, in order to achieve effective coverage of fire-fighting or flame-retardant media, the aircraft must be controlled to fly at a lower altitude. When carrying a large amount of fire-fighting medium, the fire-fighting aircraft will have reduced maneuverability due to its heavy weight. When flying at a lower altitude, the pilot needs to operate very carefully. However, the smoke and deflagration caused by the burning are likely to obscure the pilot's vision. At the same time, the rapid change of weight and gravity center caused by the discharge of a large amount of fire-fighting medium and the unstable airflow will also seriously affect the stability of the aircraft. Therefore, when carrying out firefighting operations in mountains and forests with undulating terrain, if the vision is obscured and only relying on the aircraft's warnings, accidents may occur due to the pilot's untimely response.

[0003] Of the firefighting aircraft accidents that have occurred in recent years, 50% occurred during the firefighting phase, of which 42% were caused by airspace conflicts, terrain factors, and inexperienced pilots. Most of the existing firefighting aircraft rely on the pilots’ own experience to deliver firefighting, resulting in low delivery efficiency. Currently, the newly developed firefighting aircraft can plan the flight route in advance after detecting the fire point, and calculate the delivery guidance signal in real time based on the fire point information and flight parameters, and automatically give delivery instructions, which effectively reduces the pilot’s operating burden. However, the existing firefighting aircraft indication and display designs are based on the bottom display on the one hand, and only focus on the delivery action itself on the other hand, ignoring the need for flight route guidance and obstacle avoidance guidance during the firefighting flight. Summary of the invention

[0004] This Summary is provided to introduce some concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0005] The present invention aims to provide a method and system for indicating and guiding a fire-fighting aircraft based on a head-up display.

[0006] According to one aspect of the present invention, a method for indicating and guiding firefighting aircraft based on a head-up display is provided, the method may include: generating symbol information for firefighting indication and guidance; generating an enhanced vision and indication symbols of surrounding terrain conditions and obstacles; and projecting the symbol information for firefighting indication and guidance, the enhanced vision and indication symbols of surrounding terrain conditions and obstacles onto a head-up display combination instrument directly in front of the pilot.

[0007] According to one embodiment of the present invention, the symbol information of the fire extinguishing instruction guidance may be generated by the following operations: calculating the precise location and release timing of the fire extinguishing release point based at least in part on a preset flight path, external information and the real-time status of the aircraft.

[0008] According to an embodiment of the present invention, the external information may include one or more of the following information acquired by the aircraft sensor detection module: external terrain, fire source, and obstacle.

[0009] According to one embodiment of the present invention, the real-time status of the aircraft may include one or more of the following information obtained from various systems of the aircraft: aircraft position, altitude, heading, attitude, airspeed, water tank status, and cabin door status.

[0010] According to one embodiment of the present invention, the preset flight path may be generated based on the flight plan of the aircraft, and the preset flight path may identify the flight altitude of each key point on the flight route, and the location and altitude of the fire extinguishing delivery point.

[0011] According to one embodiment of the present invention, the preset flight path can be adjusted in real time according to the real-time status of the aircraft and external information.

[0012] According to an embodiment of the present invention, the release action can be controlled based on the symbol information of the fire extinguishing instruction guidance, the enhanced vision of the surrounding terrain conditions and obstacles, and the instruction symbols.

[0013] According to another aspect of the present invention, a system for indicating and guiding firefighting aircraft based on a head-up display is provided, and the system may include: a main control module, which is configured to: generate symbol information for firefighting indication and guidance; generate enhanced vision and indication symbols of surrounding terrain conditions and obstacles; and a head-up display control unit, which is configured to: project the symbol information for firefighting indication and guidance, the enhanced vision and indication symbols of surrounding terrain conditions and obstacles onto a head-up display combination instrument directly in front of the pilot.

[0014] According to one embodiment of the present invention, the main control module can be further configured to: calculate the precise location and release timing of the fire extinguishing release point based at least in part on a preset flight path, external information and the real-time status of the aircraft to generate the symbol information of the fire extinguishing indication guidance.

[0015] According to one embodiment of the present invention, the system for indicating and guiding fire-fighting aircraft based on a head-up display may further include: an interface module, which is configured to: receive a preset flight path, receive external information, receive the real-time status of the aircraft, and output the external information and the real-time status of the aircraft to the head-up display control unit; a sensor detection module, which is configured to: obtain one or more of the following information: external terrain, fire source, obstacle; and an operating tablet, which is configured to: receive the pilot's operating instructions.

[0016] Compared with the solutions in the prior art, the method and system for indicating and guiding firefighting aircraft based on head-up display provided by the present invention can enable the pilot to maintain a head-up posture to read the instructions for the delivery operation and observe the external situation under the enhanced vision. The pilot does not need to frequently switch between the lower display and the external scene, which relieves the pilot's visual fatigue and reduces the pilot's reaction time. In addition, it is convenient for the pilot to intuitively understand the surrounding terrain obstacles when the vision is blocked by smoke. The head-up display component is used in the present invention to centrally display the delivery point identification function, delivery countdown function, and enhanced vision display function to solve:

[0017] 1. Safety hazards caused by reduced visibility caused by deflagration flames and smoke, and pilots’ inability to grasp the terrain environment or airspace conflicts in a timely and intuitive manner;

[0018] 2. Faced with risks such as reduced maneuverability due to the heavy weight of the aircraft, complex airflow in the fire scene, and insufficient aircraft power due to low oxygen content in the air, pilots must always pay attention to changes in the external environment. They also need to pay attention to the start and completion of precise delivery operations and timely adjust the flight altitude. They also need to pay attention to whether the delivered fire-extinguishing medium covers the preset position in order to adjust the flight attitude, which creates a great psychological burden on the pilots.

[0019] These and other features and advantages will become apparent by reading the following detailed description and by reference to the associated drawings.It is to be understood that the foregoing general description and the following detailed description are illustrative only and are not restrictive of the aspects of what is claimed. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to understand the manner in which the above features of the present invention are used in detail, the above briefly summarized contents can be described in more detail with reference to various embodiments, some of which are shown in the accompanying drawings. However, it should be noted that the accompanying drawings only show some typical aspects of the present invention and should not be considered to limit its scope, because the description may allow for other equally effective aspects.

[0021] Figure 1The flowchart illustrates a method for indicating and guiding a firefighting aircraft based on a head-up display according to one aspect of the present invention.

[0022] Figure 2 is a schematic diagram illustrating a preset flight path according to an embodiment of the present invention.

[0023] Figure 3 is a schematic diagram illustrating an obstacle avoidance guidance interface under enhanced vision according to an embodiment of the present invention.

[0024] Figure 4 The present invention is a schematic diagram illustrating a system for indicating and guiding a firefighting aircraft based on a head-up display according to one aspect of the present invention. DETAILED DESCRIPTION

[0025] The present invention will be described in detail below in conjunction with the accompanying drawings, and the features of the present invention will be further revealed in the following specific description.

[0026] Figure 1 A flow chart illustrating a method 100 for firefighting aircraft indication guidance based on a heads-up display according to one aspect of the present invention.

[0027] like Figure 1 As shown in , in step 102, symbol information for fire-fighting instruction guidance can be generated. When a fire-fighting aircraft is performing a fire-fighting mission, it can preset a flight path based on the calculation of the main control module in combination with the flight plan of the flight control system. The calculation of the main control module includes determining parameters such as flight speed, delivery altitude, total amount and viscosity of delivered liquid, which will affect the distribution of the fire-fighting agent and the fire-fighting effect. The preset flight path can also mark the flight altitude of each key point, the current position of the aircraft, and the position and altitude of the delivery point. Figure 2 As shown in , in one embodiment of the present invention, an aircraft can take off from an airport at an altitude of 0, fly counterclockwise (the aircraft is represented by a rotating blade symbol as shown in the figure), cruise to an altitude of 5,000 meters, then descend to 2,000 meters, and finally drop at an altitude of 1,000 meters (the drop position is represented by a triangle as shown in the figure), and then rise to 3,000 meters after drop, and then rise to 5,000 meters, until returning to the airport. The preset flight path must take into account both the effect of dropping the fire extinguishing agent and flight safety.

[0028] During the flight of the aircraft, the aircraft can adjust the flight path in real time according to the real-time status of the aircraft and external information. In an embodiment of the present invention, the real-time status of the aircraft may include signals such as the position, altitude, heading, attitude, airspeed, water tank status, and door status of the aircraft obtained from various systems of the aircraft, but is not limited to these signals. For example, the real-time status information such as the fuel quantity, the remaining amount of fire extinguishing agent, and the mechanical condition of the aircraft will also affect the adjustment of the aircraft path. External information is the image and distance position information of external terrain, fire source, obstacles, etc. obtained by the sensor detection module of the aircraft (for example, visible light, infrared imaging, laser radar, etc.). External information can also further include real-time meteorological data, such as wind speed, wind direction, temperature and humidity. These factors can also affect the distribution and effect of the fire extinguishing agent. For example, when the aircraft flies at low altitude or in a complex terrain area, the flight route can be adjusted to ensure flight safety and fire extinguishing efficiency based on the information of terrain and obstacles obtained by the sensor detection module of the aircraft, combined with the internal engine performance, fuel efficiency, water tank status, and meteorological conditions of the aircraft.

[0029] In an embodiment of the present invention, the precise position and delivery time of the fire extinguishing delivery point can be calculated based on the preset flight path, external information and the real-time status of the aircraft, thereby generating the symbol information of the fire extinguishing instruction guidance. The precise position of the fire extinguishing delivery point may include one or both of the specific position of the fire extinguishing delivery point relative to the current position of the aircraft (for example, the angle from the current orientation of the aircraft (usually the nose pointing) to the target delivery point, which can be an angle in the horizontal plane, usually expressed in degrees) and the distance of the fire extinguishing delivery point relative to the current position of the aircraft. The delivery time can be represented by a delivery time countdown, for example, the countdown is displayed as 30 seconds, indicating that the aircraft will reach the predetermined delivery position after 30 seconds, and the pilot can control the delivery action by clicking the delivery button on the operation tablet to realize the automatic delivery of the water tank system. It can be seen that the symbol information of the fire extinguishing instruction guidance may include one or more of the specific position of the fire extinguishing delivery point relative to the current position of the aircraft, the distance of the fire extinguishing delivery point relative to the current position of the aircraft, the path from the aircraft to the fire extinguishing delivery point and the delivery time.

[0030] In step 104, an enhanced view and indicator symbols of the surrounding terrain conditions and obstacles can be generated. In an embodiment of the present invention, the image and distance position information of the external terrain, fire source, obstacles, etc. can be obtained by the sensing detection module of the aircraft (for example, visible light, infrared imaging, laser radar, etc.), and the enhanced view and indicator symbols of the surrounding terrain conditions and obstacles can be generated based on the information obtained by the sensing detection module. The enhanced view of the surrounding terrain conditions and obstacles can include displaying the terrain contours around the aircraft, including mountains, hills, valleys, etc.; and displaying man-made obstacles (for example, guide aircraft, other aircraft, towers, etc.) and natural obstacles (for example, peaks, rocks, etc.). Color coding can also be used to distinguish the terrain according to different heights or terrain types, such as green for lower terrain and brown for higher terrain. These display contents can enhance the pilot's perception of the surrounding environment and improve flight safety, especially in complex terrain or severe weather conditions. In an embodiment of the present invention, the indicator symbols for displaying the surrounding terrain conditions and obstacles can be described as follows. For example, when the distance to the highest obstacle in the area detected by visible light, infrared detection or terrain perception is reachable within 30 seconds under the current flight attitude, the obstacle area at the highest point in the area is represented by a solid triangle, and its relative position is marked with "+\-"; when the distance to the highest obstacle in the area detected by visible light, infrared detection or terrain perception is reachable within 30-50 seconds under the current flight attitude, the obstacle area at the highest point in the area is represented by a hollow triangle, and its relative position is marked with "+\-". Among them, - represents that the obstacle is below the aircraft altitude, + represents that the obstacle is above the aircraft altitude, and the number after +\- represents the specific altitude value.

[0031] In step 106, the symbol information of the fire extinguishing instruction guidance, the enhanced vision and indicator symbols of the surrounding terrain conditions and obstacles can be projected onto the head-up display combination instrument directly in front of the pilot. In an embodiment of the present invention, by projecting the symbol information of the fire extinguishing instruction guidance, the enhanced vision and indicator symbols of the surrounding terrain conditions and obstacles onto a transparent head-up display combination instrument directly in front of the pilot and focusing at infinity, the pilot can maintain a head-up posture to read the guidance of the delivery operation and observe the external situation under the enhanced vision. The pilot does not need to frequently switch between the lower display and the external scene, which relieves the pilot's visual fatigue and reduces the pilot's reaction time. In addition, it is convenient for the pilot to intuitively understand the surrounding terrain obstacles when the field of vision is obscured by smoke, thereby improving mission efficiency. The projection content includes:

[0032] 1. Symbol information to guide the delivery operation;

[0033] 2. Indication of terrain and obstacles;

[0034] 3. Provide enhanced vision of terrain and obstacles.

[0035] In an embodiment of the present invention, the release action can be controlled based on the symbol information of the fire extinguishing instruction guidance, the enhanced vision and the indicator symbols of the surrounding terrain conditions and obstacles. When the pilot intuitively understands the surrounding terrain obstacle conditions based on the enhanced vision and the indicator symbols of the surrounding terrain conditions and obstacles, and the current position of the aircraft coincides with the position of the fire extinguishing release point in the symbol information of the fire extinguishing instruction guidance on the head-up display combination instrument or the countdown of the release timing is displayed as 0, the pilot can control the release of the fire extinguishing agent by operating the tablet and clicking on the release.

[0036] Figure 3 FIG. 3 is a schematic diagram illustrating an obstacle avoidance guidance interface 300 in an enhanced vision environment according to an embodiment of the present invention. Figure 3 As shown in the figure, the upper right corner is the preset flight path, which is described in detail as above. In an embodiment of the present invention, the preset flight path can display the adjustment of the real-time flight path. Figure 3 The double hollow circles in the middle indicate the current position of the firefighting aircraft, the solid origin in the dotted box indicates the position of the firefighting drop point, and the dotted line between the two indicates the flight path. The solid triangle and -611 indicate that the obstacle distance at the highest point in the area can be reached within 30 seconds under the current flight attitude, and the obstacle height is 611 meters lower than the current flight altitude of the aircraft. The hollow triangle and -836 indicate that the obstacle distance at the highest point in the area can be reached within 30s-50s under the current flight attitude, and the obstacle height is 836 meters lower than the current flight altitude of the aircraft. Figure 3 The HUD also provides enhanced views of terrain and obstacles. Based on these enhanced views, pilots can get high-definition visual references of terrain and obstacles through the HUD in low-visibility environments such as smoke, haze and darkness, which will greatly improve the pilot's situational awareness of the aircraft's surroundings, thereby further improving flight safety.

[0037] Figure 4 A schematic diagram of a system 400 for indicating and guiding a firefighting aircraft based on a head-up display according to one aspect of the present invention is illustrated. It should be noted that Figure 4 This is for illustration purposes only and is not intended to be limiting. System 400 may include Figure 4 More or fewer components may be used than shown.

[0038] like Figure 4 As shown in FIG. 4 , a system 400 for indicating and guiding a firefighting aircraft based on a head-up display may include a main control module 402 and a head-up display control unit 404 .

[0039] The main control module 402 can be configured to: generate symbol information for fire extinguishing indication guidance; generate enhanced visual and indication symbols for surrounding terrain conditions and obstacles. The main control module 402 can be further configured to calculate the precise location and timing of the fire extinguishing delivery point based at least in part on the preset flight path, external information and the real-time status of the aircraft to generate the symbol information for fire extinguishing indication guidance. Specifically, the main control module 402 can realize the task scheduling and control functions, and can adjust the flight path planning scheme through the precise location of the fire source and the precise terrain and obstacle information obtained in real time, calculate the precise location and timing of the delivery point in combination with the aircraft's position, altitude, heading, attitude, airspeed and other information, and control the delivery actuation and automatic delivery of the water tank system.

[0040] The head-up display control unit 404 can be configured to project the symbol information of the fire extinguishing instruction guide, the enhanced vision and instruction symbols of the surrounding terrain conditions and obstacles onto the head-up display combination instrument directly in front of the pilot. The head-up display control unit 404 can be used for Head Up Display (HUD) image calculation and generation.

[0041] The system 400 for indicating and guiding firefighting aircraft based on head-up display may further include an interface module 406 , an operation panel 408 , and a sensor detection module 410 .

[0042] The interface module 406 may be configured to: receive a preset flight path; receive external information; receive the real-time status of the aircraft; and output the external information and the real-time status of the aircraft to the head-up display control unit 404. Specifically, the interface module 406 may obtain signals such as the aircraft position, altitude, heading, attitude, airspeed, water tank status, and door status from various aircraft systems, and obtain information such as external terrain, fire source, and obstacles from the sensor detection module 410, and output the final image to the head-up display control unit 404.

[0043] The operation tablet 408 may be configured to receive operation instructions from the pilot and provide operation interaction for the crew.

[0044] The sensor detection module 410 may be configured to obtain one or more of the following information: external terrain, fire source, and obstacles.

[0045] What has been described above includes examples of various aspects of the claimed subject matter. Of course, it is not possible to describe every conceivable combination of components or methods for the purpose of describing the claimed subject matter, but one of ordinary skill in the art will recognize that many further combinations and permutations of the claimed subject matter are possible. Thus, the disclosed subject matter is intended to encompass all such alterations, modifications, and variations that fall within the spirit and scope of the appended claims.

Claims

1. A method for indicating and guiding a firefighting aircraft based on a head-up display, the method comprising: Generate symbol information for fire extinguishing instructions and guidance; Generates enhanced visuals and indicator symbols of surrounding terrain and obstacles; as well as The symbol information of the fire extinguishing instruction guidance, the enhanced vision and instruction symbols of the surrounding terrain conditions and obstacles are projected onto the head-up display combination instrument directly in front of the pilot.

2. The method according to claim 1, characterized in that The symbol information of the fire extinguishing instruction guide is generated by the following operations: The precise location and timing of the fire extinguishing delivery point are calculated based at least in part on the preset flight path, external information, and the real-time status of the aircraft.

3. The method according to claim 2, characterized in that The external information includes one or more of the following information obtained by the aircraft sensor detection module: external terrain, fire source, and obstacle.

4. The method according to claim 2, characterized in that The real-time status of the aircraft includes one or more of the following information obtained from various systems of the aircraft: aircraft position, altitude, heading, attitude, airspeed, water tank status, and cabin door status.

5. The method according to claim 2, characterized in that The preset flight path is generated based on the flight plan of the aircraft, and the preset flight path identifies the flight altitude of each key point on the flight route, and the location and altitude of the fire extinguishing delivery point.

6. The method according to claim 5, characterized in that The preset flight path is adjusted in real time according to the real-time status of the aircraft and external information.

7. The method of claim 1, further comprising: The release action is controlled based on the symbol information of the fire extinguishing instruction guidance, the enhanced vision and instruction symbols of the surrounding terrain conditions and obstacles.

8. A system for indicating and guiding a firefighting aircraft based on a head-up display, the system comprising: The main control module is configured to: Generate symbol information for fire extinguishing instructions and guidance; Produces enhanced visuals and indicators of surrounding terrain and obstacles; and A head-up display control unit is configured to: The symbol information of the fire extinguishing instruction guidance, the enhanced vision and instruction symbols of the surrounding terrain conditions and obstacles are projected onto the head-up display combination instrument directly in front of the pilot.

9. The system according to claim 8, characterized in that The main control module is further configured to: The precise location and release timing of the fire extinguishing release point are calculated at least partially based on a preset flight path, external information and the real-time status of the aircraft to generate the symbol information of the fire extinguishing indication guidance.

10. The system according to claim 8, characterized in that The system further comprises: An interface module configured to: Receive a preset flight path; Receive external information; Receive real-time status of aircraft; and Outputting the external information and the real-time status of the aircraft to the head-up display control unit; and A sensor detection module configured to obtain one or more of the following information: external terrain, fire source, obstacles; and The operating tablet is configured to receive operating instructions from the pilot.