Key symbol monitoring method for enhancing flight visual system

Abstract

The invention belongs to the technical field of display graph monitoring, and particularly relates to a key symbol monitoring method for an enhanced flight visual system, which comprises the following steps of: drawing key symbol characteristics which change along with flight parameters in a red and / or blue channel in a specific area of a head-up display picture, and when a head-up display symbol is superposed with an enhanced visual image, displaying the key symbol characteristics in the red and / or blue channel. And keeping the red and / or blue channel information of the key symbol feature, then monitoring the display correctness of the key symbol through the information and the frame number, and giving an alarm when the display is abnormal. According to the method, the display correctness of the key symbols is monitored, meanwhile, the completeness of the enhanced visual images displayed in an overlapped mode is not damaged, meanwhile, a pilot cannot see the characteristics of the key symbols when observing the images of the head-up display, and interference to the pilot is avoided.

Description

Technical Field

[0001] The invention belongs to the technical field of display graphics monitoring, and in particular relates to a key symbol monitoring method for an enhanced flight vision system. Background Art

[0002] At present, the enhanced flight vision system is being used on more and more aircraft. It combines the advantages of the enhanced vision system (EVS) and the head-up display (HUD), and displays the flight symbols (including airspeed, altitude, attitude, heading, etc.) superimposed on the real-time electronic image of the environment in front of the aircraft obtained by the enhanced vision system on the head-up display at an equal angle, significantly enhancing the pilot's perception of the aircraft status and surrounding environment.

[0003] At present, the key symbol monitoring on the head-up display only considers the monitoring when the flight symbols are displayed. When the image output by the enhanced vision system is superimposed, the background image will interfere with the key symbol monitoring, causing the monitoring to fail and reducing the system availability. Therefore, it is necessary to study the key symbol monitoring method in the enhanced flight vision system after the flight symbols and images are superimposed and displayed. Summary of the invention

[0004] In view of this, the present invention proposes a key symbol monitoring method for an enhanced flight vision system, so as to realize the monitoring of key symbols displayed therein when flight symbols and enhanced vision images are superimposed and displayed on a head-up display, while ensuring the integrity of the enhanced vision image in the picture, meeting the requirements for safety monitoring of the enhanced flight vision system, and improving the reliability of the display of key flight information.

[0005] The technical solution of the present invention is:

[0006] A method for monitoring key symbols of an enhanced flight vision system comprises the following steps:

[0007] Step 1, receiving the flight parameters output by the sensor on the aircraft, marking the flight parameters with frame numbers and storing M frames of data, and drawing flight symbols on the HUD screen according to the flight parameters, wherein the flight symbols include multiple key symbols;

[0008] Step 2, in a specific area S of the HUD screen, draw each key symbol feature and frame number that changes with the flight parameters;

[0009] Step 3, superimposing the flight symbol and the enhanced vision image on the HUD screen to generate an enhanced flight vision screen;

[0010] Step 4, transmitting the generated enhanced flight vision picture to the head-up display for display, collecting the picture, and extracting the frame number and each key symbol feature of the picture;

[0011] Step 5, extract flight parameter data from each key symbol feature, and compare them with the stored flight parameter data one by one according to the frame number; when the data comparison result of a key symbol is within the tolerance range and continues for the preset frame, the head-up display displays the corresponding key symbol; when the data comparison result of a key symbol exceeds the tolerance range and continues for the preset frame, the head-up display displays the warning information of the corresponding key symbol.

[0012] Furthermore, the value of M is determined by the maximum delay time and software cycle on the link from receiving sensor data to displaying the head-up display.

[0013] Furthermore, the color of the flight symbol drawn in the HUD screen only uses the green channel component of the pixel.

[0014] Furthermore, the step 2 specifically includes the following steps:

[0015] S201 divides the display area in the HUD image that is not reached by all the flight symbols in the fixed position and motion display into a specific area S, where S consists of n parts (S = ΣS i , i=1…n);

[0016] S202: draw each key symbol feature without exceeding the specific area S, the key symbol feature changes with the flight parameters, and the color of each feature uses the red and / or blue channel components of the pixel where it is located;

[0017] S203 draws a frame number at a prominent position in the specific area S, and the color of the frame number uses the red and / or blue channel components of the pixel where the frame number is located.

[0018] Furthermore, the enhanced vision image is generated by the enhanced vision system detecting the exterior scene in front of the aircraft, and the enhanced vision image is a single-channel grayscale image.

[0019] 6. The method for monitoring key symbols of an enhanced flight vision system according to claim 4, wherein step 3 specifically comprises the following steps:

[0020] S301 converts the single-channel enhanced visual grayscale image into a green image occupying only the green channel;

[0021] S302 performs equiangular pixel-by-pixel superposition according to the fields of view of the head-up display image and the enhanced vision image, and installation and calibration parameters of the head-up display and the enhanced vision system;

[0022] S303: when superimposing the flight symbol and the enhanced vision image in the head-up display screen, the green channel component of the pixel where the flight symbol is located covers the green channel component of the corresponding pixel in the enhanced vision image, and the red and blue channel components remain unchanged;

[0023] When the specific area S and the enhanced vision image are superimposed in the HUD screen, the green channel component of the pixel in the enhanced vision image covers the green channel component of the pixel corresponding to the key symbol feature, and the red and blue channel components of the pixel where the key symbol feature is located cover the red and blue channel components of the corresponding pixel in the enhanced vision image;

[0024] When the enhanced vision image is superimposed on blank pixels without flight symbols and key symbol features, the green channel component of the pixel in the enhanced vision image covers the green channel component of the pixel, and the red and blue channel components remain unchanged.

[0025] Furthermore, when extracting the frame sequence number and each key symbol characteristic parameter, the parameter extraction is completed according to the S coordinate of the specific area and the red and / or blue channel components of the pixels in the area.

[0026] Furthermore, when the generated enhanced flight vision picture is displayed on a head-up display, only the green channel component value of each pixel in the picture is taken for display.

[0027] Beneficial effects of the present invention:

[0028] 1) In the absence of effective key symbol monitoring of the head-up display with enhanced visual images, a breakthrough has been made in the key symbol monitoring method of the enhanced flight vision system, meeting the requirements for safety monitoring of the enhanced flight vision system and improving the reliability of key flight information display;

[0029] 2) The method of the present invention does not destroy the integrity of the flight symbols and enhanced visual images while adding key symbol monitoring features to the enhanced flight visual image. At the same time, the pilot will not see these key symbol features when observing the head-up display screen, thereby avoiding interference to the pilot;

[0030] 3) The method of the present invention is compatible with the current airborne enhanced flight vision system and will not increase the cost of the aircraft.

[0031] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 This is a schematic diagram of flight symbols and key symbol features before the enhanced visual image is superimposed in an embodiment of the present application;

[0034] Figure 2 A schematic diagram of overlaying and generating an enhanced flight vision system head-up display screen according to an embodiment of the present application. DETAILED DESCRIPTION

[0035] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0036] The following describes the embodiments of the present disclosure through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all of the embodiments. The present disclosure can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present disclosure.

[0037] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein can be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on the present disclosure, it should be understood by those skilled in the art that an aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement the device and / or practice the method. In addition, other structures and / or functionalities other than one or more of the aspects described herein can be used to implement this device and / or practice this method.

[0038] It should also be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present disclosure. The illustrations only show components related to the present disclosure rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0039] Additionally, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects described may be practiced without these specific details.

[0040] In one embodiment of the present invention, a method for monitoring key symbols of an enhanced flight vision system is provided, comprising the following steps:

[0041] Step 1, receiving the flight parameters output by the sensors on the aircraft, including airspeed, pressure altitude, pitch, roll, Mach number, flight track vector, flight guidance, radio altitude, level guidance, flight mode notification, vertical speed, pressure reference, navigation source, ground speed, true heading, magnetic heading and other parameters. Considering the maximum delay time ΔT and software cycle C on the HUD display link, each frame of sensor parameters is marked with a frame number (the sequence number is 1 to M cycles) and M frames of data are stored, and the flight symbol is drawn on the HUD screen, such as Figure 1 As shown, it includes key symbols such as airspeed, pressure altitude, pitch, roll, flight path vector, flight director, radio altitude, leveling guidance, etc.

[0042] Where, M = ΔT / C;

[0043] Step 2: Draw each key symbol feature (such as Figure 1 As shown, the symbol features are drawn using only the red channel) and the frame number (1 to M);

[0044] Step 3, superimposing the flight symbol and the enhanced vision image on the HUD screen to generate an enhanced flight vision screen;

[0045] Step 4, transmitting the generated enhanced flight vision picture to the head-up display for display, collecting the picture, and extracting the frame number and each key symbol feature;

[0046] Step 5, extracting flight parameter data from each key symbol feature, and comparing them one by one with the flight parameter data output by the stored sensor according to the frame sequence number;

[0047] Step 6: When the comparison result of a key symbol data is within the tolerance range and lasts for several frames, the head-up display displays the corresponding key symbol;

[0048] When the data comparison result exceeds the tolerance range and persists for several frames, the head-up display displays a warning message corresponding to the key symbol.

[0049] Specifically, in this embodiment, the color of each pixel U in the HUD screen is composed of three components: red r, green g, and blue b, with a value range of 0 to 255, expressed as U (Ur, Ug, Ub).

[0050] In this embodiment, the flight symbol (such as Figure 2 As shown in S5 in the figure, the color of each symbol only uses the green channel component of the pixel where it is located, that is, the color is A(0, Ag, 0).

[0051] In this embodiment, the key symbol features and frame numbers (such as Figure 2 ), comprising the following steps:

[0052] S101 divides the display area in the HUD image that all the flight symbols in the fixed position and motion display will not reach into a specific area S, such as Figure 1 As shown, S consists of 4 parts, S = ΣS i (i=1…4);

[0053] S102 draws each key symbol feature without exceeding a specific area S, the key symbol feature changes with the avionics parameter, and the color of each feature uses only the red channel component of the pixel where it is located;

[0054] Specifically, the color of each feature is E(Er, 0, 0);

[0055] S103 draws a frame number at a prominent position in the specific area S. The color of the frame number uses only the red channel component of the pixel where the frame number is located, and the color is E (Er, 0, 0).

[0056] In this embodiment, the enhanced vision image is generated by the enhanced vision system detecting the exterior scene in front of the aircraft, and the image is a single-channel grayscale image, such as Figure 2 As shown in S6.

[0057] In this embodiment, the flight symbol and the enhanced visual image are superimposed on the HUD screen, such as Figure 2 As shown in S7, the following steps are included:

[0058] S201 converts the single-channel enhanced visual grayscale image into a green image occupying only the green channel;

[0059] Specifically, the grayscale image pixel H(g), where g ranges from 0 to 255, has a color of H(0, Hg, 0) after conversion to a green image;

[0060] S202 performs equiangular pixel-by-pixel superposition according to the fields of view of the head-up display image and the enhanced vision image, and installation and calibration parameters of the head-up display and the enhanced vision system;

[0061] S203, when superimposing the flight symbol area and the enhanced visual image in the head-up display screen, the green channel component of the pixel where the flight symbol is located covers the green channel component of the corresponding pixel in the enhanced visual image, and the red and blue channel components remain unchanged;

[0062] Specifically, the color of the pixel in the picture is U=A(0, Ag, 0);

[0063] S204: when the specific area S and the enhanced visual image are superimposed in the HUD image, the green channel component of the pixel in the enhanced visual image covers the green channel component of the pixel corresponding to the key symbol feature, and the red and blue channel components of the pixel where the key symbol feature is located cover the red and blue channel components of the corresponding pixel in the enhanced visual image;

[0064] Specifically, the color of the pixel in the picture is U=E+H=U(Er, Hg, 0);

[0065] S205 When the blank pixels without flight symbols and key symbol features are superimposed on the enhanced visual image, the green channel component of the pixel in the enhanced visual image covers the green channel component of the pixel, and the red and blue channel components remain unchanged;

[0066] Specifically, the pixel color in the picture is U=H(0, Hg, 0).

[0067] In this embodiment, the frame number and each key symbol feature parameter are extracted, and the parameter extraction is completed according to the S coordinate of a specific area and the red channel component of the pixels in the area.

[0068] Specifically, according to the coordinates of the four corner points of the S1-S4 area divided during the screen design, the area to be monitored is intercepted from the screen, the red channel component of each pixel U, namely Er, is taken out, binarized according to the threshold, and then matched with the pre-stored key symbol feature template to determine whether the feature pattern is displayed correctly, and the frame number and the dynamically changing key symbol parameters are extracted according to the coding definition;

[0069] Specifically, when comparing the key symbol parameters extracted from the picture with the pre-stored M-frame onboard sensor parameters, find a frame with the same sequence number in the corresponding M-frame sensor parameters according to the extracted picture frame sequence number, and then restore the original sensor value of each key symbol parameter, and compare it with the pre-stored onboard sensor value to determine whether it is within the tolerance range.

[0070] Specifically, when comparing the data results, the number of frames in the "continuous several frames" condition is determined by the time requirement T for displaying error warnings of key symbols in the enhanced flight vision system safety requirements. s The minimum value of the maximum display link delay time ΔT, that is, the number of frames = min(T s ,ΔT)

[0071] In this embodiment, the generated enhanced flight visual picture (such as Figure 2When the green channel component value of each pixel in the picture is displayed on the head-up display (as shown in S7 in the figure), the pilot can observe the complete flight symbols and enhanced visual image without seeing the key symbol features in the specific area S. While the key symbol monitoring features are added to the enhanced flight vision picture, interference to the pilot is avoided.

[0072] The above is only a specific implementation of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present disclosure should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for monitoring key symbols of an enhanced flight vision system, characterized in that: The following steps are involved: Step 1, receiving the flight parameters output by the sensor on the aircraft, marking the flight parameters with frame numbers and storing M frames of data, and drawing flight symbols on the HUD screen according to the flight parameters, wherein the flight symbols include multiple key symbols; Step 2, in a specific area S of the HUD screen, draw each key symbol feature and frame number that changes with the flight parameters; Step 3, superimposing the flight symbol and the enhanced vision image on the HUD screen to generate an enhanced flight vision screen; Step 4, transmitting the generated enhanced flight vision picture to the head-up display for display, collecting the picture, and extracting the frame number and each key symbol feature of the picture; Step 5, extract flight parameter data from each key symbol feature, and compare them with the stored flight parameter data one by one according to the frame number; when the data comparison result of a key symbol is within the tolerance range and continues for the preset frame, the head-up display displays the corresponding key symbol; when the data comparison result of a key symbol exceeds the tolerance range and continues for the preset frame, the head-up display displays the warning information of the corresponding key symbol.

2. The key symbol monitoring method of the enhanced flight vision system according to claim 1, characterized in that: The value of M is determined by the maximum delay time and software cycle on the link from receiving sensor data to displaying the head-up display.

3. The key symbol monitoring method of the enhanced flight vision system according to claim 2, characterized in that: The color of the flight symbol drawn in the HUD uses only the green channel component of the pixel.

4. The key symbol monitoring method of the enhanced flight vision system according to claim 3, characterized in that: The step 2 specifically includes the following steps: S201 divides the display area in the HUD image that all the flight symbols in the fixed position and motion display will not reach into a specific area S, where S consists of n parts (S = ΣS i , i=1…n); S202: draw each key symbol feature without exceeding the specific area S, the key symbol feature changes with the flight parameters, and the color of each feature uses the red and / or blue channel components of the pixel where it is located; S203 draws a frame number at a prominent position in the specific area S, and the color of the frame number uses the red and / or blue channel components of the pixel where the frame number is located.

5. The key symbol monitoring method of the enhanced flight vision system according to claim 4, characterized in that: The enhanced vision image is generated by the enhanced vision system detecting the exterior scene in front of the aircraft, and the enhanced vision image is a single-channel grayscale image.

6. The key symbol monitoring method of the enhanced flight vision system according to claim 5, characterized in that: Step 3 specifically includes the following steps: S301 converts the single-channel enhanced visual grayscale image into a green image occupying only the green channel; S302 performs equiangular pixel-by-pixel superposition according to the fields of view of the head-up display image and the enhanced vision image, and installation and calibration parameters of the head-up display and the enhanced vision system; S303: when superimposing the flight symbol and the enhanced vision image in the head-up display screen, the green channel component of the pixel where the flight symbol is located covers the green channel component of the corresponding pixel in the enhanced vision image, and the red and blue channel components remain unchanged; When the specific area S and the enhanced vision image are superimposed in the HUD screen, the green channel component of the pixel in the enhanced vision image covers the green channel component of the pixel corresponding to the key symbol feature, and the red and blue channel components of the pixel where the key symbol feature is located cover the red and blue channel components of the corresponding pixel in the enhanced vision image; When the enhanced vision image is superimposed on blank pixels without flight symbols and key symbol features, the green channel component of the pixel in the enhanced vision image covers the green channel component of the pixel, and the red and blue channel components remain unchanged.

7. The key symbol monitoring method of the enhanced flight vision system according to claim 6, characterized in that: When extracting the frame number and each key symbol characteristic parameter, the parameter extraction is completed according to the S coordinate of the specific area and the red and / or blue channel components of the pixels in the area.

8. The key symbol monitoring method of the enhanced flight vision system according to claim 7, characterized in that: When the generated enhanced flight vision picture is displayed on the head-up display, only the green channel component value of each pixel in the picture is displayed.

Images