Airborne enhanced flight visual system delay measurement method and system

Abstract

The invention relates to the technical field of flight vision systems, in particular to an airborne enhanced flight vision system delay measurement method and system, and the method comprises the steps: placing a light source and a light source shielding device in a view field range of an airborne enhanced flight vision system; lightening the light source and closing the light source shielding device; starting an airborne enhanced flight vision system, displaying an enhanced flight vision image on a head-up display, and confirming that the light source can be seen; when the brightness of the light source is maximum and the image is clearest, simultaneously shooting the light source displayed in the picture of the head-up display and the real scene at the eye position of the head-up display by using a camera device; starting a light source shielding device to completely shield a light source; and the video recorded by the camera device is analyzed, and the time difference between the enhanced flight visual image displayed on the head-up display and the outdoor scene is calculated to serve as a delay measurement result of the airborne enhanced flight visual system. According to the method, the delay of the airborne enhanced flight visual system can be rapidly and visually measured.

Description

Technical Field

[0001] The embodiments of this application relate to the field of flight vision system technology, and in particular to a method and system for delay measurement of an airborne enhanced flight vision system. Background Technology

[0002] Currently, augmented flight vision systems are being used on an increasing number of aircraft. These systems combine the advantages of augmented vision systems (EVS) and head-up displays (HUDs), displaying flight symbols (including but not limited to airspeed, altitude, attitude, and heading) along with real-time electronic images of the environment in front of the aircraft obtained by the augmented vision system on the head-up display at an equal angle. This significantly enhances the pilot's perception of the aircraft's status and surrounding environment, and improves the aircraft's safe flight capability in low-visibility conditions.

[0003] According to the DO-315B standard, the latency from the detection image by the augmented reality system to its output on the head-up display should be less than 100 milliseconds. Currently, airborne augmented reality systems mainly rely on latency analysis to estimate system latency, and latency measurement is limited to the software and device levels. There is a lack of a complete latency measurement method for the entire display chain of augmented reality systems, resulting in a lack of actual data to support the system's latency and improve its confidence level. Furthermore, latency testing for other similar airborne vision systems primarily relies on changes in characters on the displayed screen as a criterion, a method that cannot be used in latency measurement for augmented reality systems.

[0004] Therefore, how to achieve delay measurement of airborne enhanced flight vision systems more quickly and effectively in real-world usage environments is an urgent problem to be solved. Summary of the Invention

[0005] To address the aforementioned technical issues, embodiments of this application propose a method and system for measuring the delay of an airborne enhanced flight vision system. By using the transition of a light source from bright to dark as a marker point, the delay of the airborne enhanced flight vision system can be measured quickly and intuitively, providing a reference for optimizing the system's display delay.

[0006] To achieve the above objectives, embodiments of this application propose a delay measurement method for an airborne enhanced flight vision system. The method includes: placing a light source and a light source shielding device within the field of view of the airborne enhanced flight vision system; turning on the light source and turning off the light source shielding device; activating the airborne enhanced flight vision system, displaying an enhanced flight vision image on a head-up display (HUD), and confirming that the light source can be seen in the HUD image; when the light source has maximum brightness and is most clearly imaged in the enhanced vision image, simultaneously capturing images of the light source displayed in the HUD image and in the real scene using a camera at the eye level of the HUD; activating the light source shielding device to completely block the light source, causing it to disappear from the HUD image and the external scene at the eye level of the HUD; analyzing the video recorded by the camera, calculating the time difference between the enhanced flight vision image displayed on the HUD and the external scene, and using the time difference as the delay measurement result of the airborne enhanced flight vision system.

[0007] To achieve the above objectives, embodiments of this application also propose an airborne enhanced flight vision system delay measurement system, implemented based on the airborne enhanced flight vision system delay measurement method described above. The system includes a light source device, a light source shielding device, a control device, a camera device, and a delay analysis device. The light source device emits light that can be detected by the enhanced flight vision system. The light source shielding device shields the thermal radiation characteristics of the light source, causing it to disappear from the image captured by the enhanced flight vision system. The control device controls the intensity of the thermal radiation characteristics of the light source device and the activation / deactivation of the light source shielding device. The camera device acquires and records images of the enhanced flight vision image displayed on the head-up display and images of the external view from the aircraft cockpit. The delay analysis device reads and analyzes the video recorded by the camera device, identifies light source state transition markers in the images, calculates the time difference between the enhanced flight vision image displayed on the head-up display and the external view, and uses this time difference as the delay measurement result of the airborne enhanced flight vision system.

[0008] To achieve the above objectives, embodiments of this application also propose an electronic device, including a processor and a memory, wherein the memory stores instructions executable by the processor, and the processor is configured to execute the instructions such that the electronic device can implement the airborne enhanced flight vision system delay measurement method as described above.

[0009] To achieve the above objectives, embodiments of this application also propose a computer-readable storage medium storing a computer program that, when executed by a processor, enables the implementation of a delay measurement method for an airborne enhanced flight vision system as described above.

[0010] Optionally, the wavelength of the light emitted by the light source is matched with the wavelength of light that the airborne augmented flight vision system can detect, ensuring that the light source can be detected by the airborne augmented flight vision system.

[0011] Optionally, the function of the light source shielding device is to shield the thermal radiation characteristics of the light source. After the light source shielding device is activated, the light source will disappear from the enhanced flight vision image obtained by the airborne enhanced flight vision system. After the light source shielding device is deactivated, the light source will appear in the enhanced flight vision image.

[0012] Optionally, a high-speed camera device is selected, which captures frames per second at least an order of magnitude higher than the required accuracy of the delay measurement.

[0013] Optionally, when analyzing the video recorded by the camera device, the moment when the light source changes from being lit to being unlit in the video can be used as a marker point.

[0014] Optionally, analyzing the video recorded by the camera device and calculating the time difference between the enhanced flight vision image displayed on the head-up display and the external scene, and using the time difference as the delay measurement result of the airborne enhanced flight vision system, includes: recording the time when the light source disappears in the enhanced flight vision image displayed on the head-up display in the video recorded by the camera device as... The time when the light source disappears in the video footage recorded by the camera device is recorded as . ;calculate and The absolute value of the time difference between ,Will As a delay measurement result of an airborne enhanced flight vision system .

[0015] Optionally, the final delay measurement result of the airborne enhanced flight vision system is obtained based on multiple measurements; denoted as the first... The delay measurement results of the airborne enhanced flight vision system obtained from this measurement are as follows: Total measurements Next, take The average of the delay measurement results from each measurement is taken as the final delay measurement result. The final delay measurement result This can be expressed by the formula: .

[0016] This application proposes a method and system for measuring the delay of an airborne augmented flight vision system. It utilizes the transition of a light source from illumination to oblivion, which can be captured by the airborne augmented flight vision system, as marker information. A camera device records and analyzes the change process, enabling rapid, intuitive, and scientific measurement of the airborne augmented flight vision system's delay. The system can be built using conventional light sources, light source shielding devices, and camera equipment. It is compatible with all airborne augmented flight vision systems developed domestically and internationally. The measurement process does not affect the original state of the airborne augmented flight vision system or the aircraft. The delay can be measured in a laboratory environment or on an aircraft already equipped with the system. The entire delay measurement process is convenient, fast, and safe, providing a reliable reference for optimizing the display delay of airborne augmented flight vision systems. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies of this application will be briefly introduced below. Obviously, the following drawings are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. The drawings described herein are only used to explain this application and are not intended to limit this application.

[0018] Figure 1 This is a flowchart of a delay measurement method for an airborne enhanced flight vision system provided in one embodiment of this application; Figure 2 This is a schematic diagram of the structure of an airborne enhanced flight vision system delay measurement system provided in another embodiment of this application; Figure 3 This is a schematic diagram of the structure of an electronic device provided in another embodiment of this application. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the various embodiments of this application will be described in detail below with reference to the accompanying drawings. Those skilled in the art will understand that many technical details have been presented in the embodiments of this application to facilitate better understanding. However, the technical solutions claimed in this application can be implemented even without these technical details and various variations and modifications based on the following embodiments. The division of the following embodiments is for ease of description and should not constitute any limitation on the specific implementation of this application. The following embodiments can be combined with and referenced by each other without contradiction.

[0020] One embodiment of this application proposes a delay measurement method for an airborne enhanced flight vision system. The implementation details of the delay measurement method for an airborne enhanced flight vision system proposed in this embodiment are described in detail below. The following implementation details are provided for ease of understanding and are not necessary for implementing this solution.

[0021] The specific process of the delay measurement method for an airborne enhanced flight vision system proposed in this embodiment can be described as follows: Figure 1 As shown, it includes: Step 11: Place the light source and the light source shielding device within the field of view of the airborne enhanced flight vision system.

[0022] In practice, when it is necessary to perform delay measurement on the airborne augmented flight vision system, the deployment of various measurement auxiliary devices is completed first. The light source device and the light source shielding device are deployed in the field of view, but the camera device needs to be aimed at the head-up display within the field of view of the airborne augmented flight vision system in order to capture (record) the display screen of the head-up display in real time.

[0023] It should be noted that when performing delay measurements on an airborne augmented flight vision system already installed on an aircraft, there may be strong winds in the external environment, so the light source device and the light source shielding device need to be securely fixed to the ground.

[0024] Step 12: Turn on the light source and turn off the light source shielding device.

[0025] Step 13: Activate the onboard augmented flight vision system, display the augmented flight vision image on the head-up display, and confirm that you can see the light source in the head-up display screen.

[0026] In practice, after the light source device and the light source shielding device are installed, the light source can be turned on and the light source shielding device can be turned off. Then, the airborne augmented flight vision system is activated, and the augmented flight vision image (i.e., the image obtained by the airborne augmented flight vision system) is displayed on the head-up display. It is confirmed that the light source can be seen in the head-up display screen. If the light source cannot be seen in the head-up display screen, it indicates that there is a problem with the installation of the light source device, and it needs to be redone.

[0027] It is important to note that the wavelength of the light emitted by the light source must match the wavelength of the light that the airborne augmented flight vision system can detect, ensuring that the light source can be detected by the airborne augmented flight vision system; otherwise, delay measurement will not be possible.

[0028] Step 14: When the light source is at its brightest and the image is clearest in the enhanced visual image, use a camera device to simultaneously capture images of the light source displayed on the head-up display and in the real scene from the eye position of the head-up display.

[0029] In practice, when the light source is at its brightest and most clearly imaged in the enhanced visual image, a camera can be used to simultaneously capture the light source displayed on the head-up display and in the real scene from the eye position of the head-up display. In other words, during the period when the light source is on and the light source shielding device is off, the video recorded by the camera must contain "two light sources": one is the light source displayed on the head-up display, and the other is the light source in the real scene.

[0030] It is important to note that a high-speed camera must be used, with a frame rate at least one order of magnitude higher than the required latency measurement accuracy. For example, if the required latency measurement is in the millisecond range (one-thousandth of a second), then the high-speed camera needs to capture frames at the ten-thousandth of a second.

[0031] Step 15: Activate the light source shielding device to completely block the light source, making it disappear from the view on the head-up display and from the view of the outside scene at the head-up display's eye position.

[0032] In practice, once the camera is set to capture images, the light source shielding device can be activated to completely block the light source, causing it to disappear from the view on the head-up display and from the viewpoint of the head-up display.

[0033] The function of the light source shielding device is to shield the thermal radiation characteristics of the light source. After the light source shielding device is activated, the light source will disappear from the enhanced flight vision image obtained by the airborne enhanced flight vision system. After the light source shielding device is deactivated, the light source will reappear in the enhanced flight vision image.

[0034] It is important to note that currently, all airborne augmented vision systems developed domestically and internationally include infrared detection capabilities. When using infrared light sources as a reference for delay measurement, the on / off process of these sources is relatively long (typically on the order of milliseconds). Therefore, using the transition from off to on or on to off as a marker point makes it difficult to find the accurate on / off time, leading to errors that affect the measurement results. This embodiment, however, does not require extinguishing the light source. Simply activating the light source shielding device quickly removes the light source from the augmented flight vision image obtained by the airborne augmented flight vision system. Therefore, using the transition from on to off as a marker point allows for a rapid, intuitive, and scientific measurement of the airborne augmented flight vision system's delay, providing a reference for optimizing the display delay of the system.

[0035] Step 16: Analyze the video recorded by the camera device, calculate the time difference between the enhanced flight vision image displayed on the head-up display and the external scene, and use the time difference as the delay measurement result of the airborne enhanced flight vision system.

[0036] In practice, after the camera device records the entire process, the video recorded by the camera device can be read and analyzed, the time difference between the enhanced flight vision image displayed on the head-up display and the external scene can be calculated, and the time difference can be used as the delay measurement result of the airborne enhanced flight vision system.

[0037] In one example, when analyzing video recorded by a camera, the instant when a light source transitions from being lit to being unlit is used as a marker point. The time when the light source disappears in the enhanced flight view image displayed on the head-up display in the video recorded by the camera is denoted as... The time when the light source disappears in the video footage recorded by the camera device is recorded as . .calculate and The absolute value of the time difference between ,Will As a delay measurement result of an airborne enhanced flight vision system .

[0038] In one example, to further improve the accuracy of delay measurements, the final delay measurement result of the airborne enhanced flight vision system will be obtained based on multiple measurements. The delay measurement results of the airborne enhanced flight vision system obtained from this measurement are as follows: Total measurements Next, take The average of the delay measurement results from each measurement is taken as the final delay measurement result. The final delay measurement results This can be expressed by the formula: .

[0039] This embodiment proposes a method and system for measuring the delay of an airborne augmented flight vision system. It utilizes the transition of a light source from illumination to oblivion, which can be captured by the system, as marker information. A camera records and analyzes this process, enabling rapid, intuitive, and scientific measurement of the system's delay. The system can be built using conventional light sources, light source shielding devices, and camera equipment. It is compatible with all airborne augmented flight vision systems developed domestically and internationally. The measurement process does not affect the original state of the system or the aircraft. Delay measurements can be performed in laboratory environments or on aircraft already equipped with the system. The entire delay measurement process is convenient, fast, and safe, providing a reliable reference for optimizing the display delay of airborne augmented flight vision systems.

[0040] The steps described above are merely for clarity in describing the technical solution. In actual implementation, they can be combined into one step, or certain steps can be broken down into multiple steps, as long as they involve the same logical relationship, they are all within the scope of protection of this application. Any insignificant modifications or designs added to the algorithm or process, as long as they do not change the core of the algorithm or process, are also within the scope of protection of this application.

[0041] Another embodiment of this application proposes an airborne enhanced flight vision system delay measurement system, which is implemented based on an airborne enhanced flight vision system delay measurement method as described in the above method embodiment. The details of the airborne enhanced flight vision system delay measurement system proposed in this embodiment are described in detail below. The following content is only for the convenience of understanding and is not necessary for implementing this example. Figure 2 This is a schematic diagram of the structure of an airborne enhanced flight vision system delay measurement system proposed in this embodiment, including: a light source device 21, a light source shielding device 22, a control device 23, a camera device 24, and a delay analysis device 25.

[0042] The light source device 21 is used to emit light that can be detected by the enhanced flight vision system.

[0043] The light source shielding device 22 is used to shield the thermal radiation characteristics of the light source, so that the light source disappears from the image of the enhanced flight vision system.

[0044] Control device 23 is used to control the intensity of the thermal radiation characteristics of the light source device and the start and stop of the light source shielding device.

[0045] The camera device 24 is used to capture and record images of the enhanced flight view displayed on the head-up display and images of the view outside the aircraft cockpit.

[0046] The delay analysis device 25 is used to read and analyze the video recorded by the camera device, identify the light source state transition markers in the image, calculate the time difference between the enhanced flight vision image displayed on the head-up display and the external scene, and use the time difference as the delay measurement result of the airborne enhanced flight vision system.

[0047] It is worth noting that all modules involved in this embodiment are logical modules. In practical applications, a logical module can be a physical module, a part of a physical module, or an organic combination of multiple physical modules. Furthermore, to highlight the innovative aspects of this application, this embodiment does not introduce modules that are not closely related to solving the technical problems proposed in this application. However, this does not mean that other modules are absent from this embodiment.

[0048] It is not difficult to see that this embodiment is a system embodiment corresponding to the above method embodiments, and this embodiment can be implemented in conjunction with the above method embodiments. The relevant technical details and technical effects mentioned in the above method embodiments are still valid in this embodiment, and will not be repeated here to reduce repetition. Accordingly, the relevant technical details mentioned in this embodiment can also be applied to the above method embodiments.

[0049] Another embodiment of this application provides an electronic device, such as Figure 3 As shown, it includes a processor 31 and a memory 32. The memory 32 stores instructions that the processor 31 can execute. When the processor 31 is configured to execute the instructions, the electronic device can realize an airborne enhanced flight vision system delay measurement method as described in the above method embodiment.

[0050] The memory and processor are connected via a bus, which includes any number of interconnecting buses and bridges, connecting various circuits of one or more processors and the memory. The bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and will not be described further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices over a transmission medium. Data processed by the processor is transmitted over the wireless medium via an antenna, which further receives data and transmits it to the processor.

[0051] The processor manages the bus and general processing, and also provides various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory is used to store data used by the processor during operation.

[0052] Another embodiment of this application proposes a computer-readable storage medium storing a computer program that, when executed by a processor, enables a delay measurement method for an airborne enhanced flight vision system as described in the above method embodiments.

[0053] That is, those skilled in the art will understand that all or part of the steps in the above method embodiments can be implemented by a program instructing related hardware. The program is stored in a storage medium and includes several instructions to cause a device (such as a microcontroller, chip, etc.) or processor to execute all or part of the steps of the method described in the method embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory, random access memory, magnetic disks, or optical disks.

[0054] It will be understood by those skilled in the art that the above embodiments are specific implementations of this application, and various changes in form and detail can be made in practical applications without departing from the spirit and scope of this application. For those skilled in the art, several improvements and modifications can be made without departing from the principles of this application, and these improvements and modifications are also considered to be within the scope of protection of this application.

Claims

1. A method for measuring delay in an airborne enhanced flight vision system, characterized in that, include: Place the light source and light source shielding device within the field of view of the airborne enhanced flight vision system; Turn on the light source and turn off the light source shielding device; Activate the onboard augmented flight vision system, display the augmented flight vision image on the head-up display, and confirm that you can see the light source in the head-up display screen; When the light source is at its brightest and forms the clearest image in the enhanced visual image, use a camera device to simultaneously capture the light source displayed on the head-up display and in the real scene from the eye position of the head-up display. Activate the light source shielding device to completely block the light source, making it disappear from the image on the head-up display and from the viewpoint of the head-up display. The video recorded by the camera device is analyzed, and the time difference between the enhanced flight vision image displayed on the head-up display and the external scene is calculated. The time difference is used as the delay measurement result of the airborne enhanced flight vision system.

2. The delay measurement method for an airborne enhanced flight vision system according to claim 1, characterized in that, The wavelength of the light emitted by the light source matches the wavelength of the light that the airborne augmented flight vision system can detect, ensuring that the light source can be detected by the airborne augmented flight vision system.

3. The delay measurement method for an airborne enhanced flight vision system according to claim 1, characterized in that, The function of the light source shielding device is to shield the thermal radiation characteristics of the light source. After the light source shielding device is activated, the light source will disappear from the enhanced flight vision image obtained by the airborne enhanced flight vision system. After the light source shielding device is deactivated, the light source will appear in the enhanced flight vision image.

4. The delay measurement method for an airborne enhanced flight vision system according to claim 1, characterized in that, The camera device used is a high-speed camera, which captures at least one order of magnitude higher frames per second than the required accuracy of the delay measurement.

5. The delay measurement method for an airborne enhanced flight vision system according to claim 1, characterized in that, When analyzing video recorded by a camera, the moment when the light source changes from being lit to being unlit is taken as a marker point.

6. A delay measurement method for an airborne enhanced flight vision system according to any one of claims 1 to 5, characterized in that, Analyzing the video recorded by the camera device, calculating the time difference between the enhanced flight vision image displayed on the head-up display and the external scene, and using this time difference as the delay measurement result of the airborne enhanced flight vision system, including: The time when the light source disappears in the enhanced flight view image displayed on the head-up display in the video recorded by the camera device is denoted as . The time when the light source disappears in the video footage recorded by the camera device is recorded as . ; calculate and The absolute value of the time difference between ,Will As a delay measurement result of an airborne enhanced flight vision system .

7. The delay measurement method for an airborne enhanced flight vision system according to claim 6, characterized in that, The final delay measurement results of the airborne enhanced flight vision system are obtained based on multiple measurements; Record No. The delay measurement results of the airborne enhanced flight vision system obtained from this measurement are as follows: Total measurements Next, take The average of the delay measurement results from each measurement is taken as the final delay measurement result. ; Final delay measurement results This can be expressed by the formula: 。 8. A delay measurement system for an airborne enhanced flight vision system, implemented based on the delay measurement method for an airborne enhanced flight vision system as described in any one of claims 1 to 7, characterized in that, The system includes a light source device, a light source shielding device, a control device, a camera device, and a delay analysis device; A light source device used to emit light that can be detected by an enhanced flight vision system; A light source shielding device is used to shield the thermal radiation characteristics of the light source, making the light source disappear from the image captured by the enhanced flight vision system. A control device used to control the intensity of the thermal radiation characteristics of the light source device and the activation and deactivation of the light source shielding device; The camera device is used to capture and record images of the enhanced flight view displayed on the head-up display and images of the view outside the aircraft cockpit. The delay analysis device is used to read and analyze the video recorded by the camera device, identify the light source state transition markers in the image, calculate the time difference between the enhanced flight vision image displayed on the head-up display and the external scene, and use the time difference as the delay measurement result of the airborne enhanced flight vision system.

9. An electronic device, characterized in that, include: A processor and a memory, wherein the memory stores instructions executable by the processor, and the processor is configured to, when executing the instructions, enable the electronic device to implement a delay measurement method for an airborne enhanced flight vision system as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it can implement a delay measurement method for an airborne enhanced flight vision system as described in any one of claims 1 to 7.

Images