FPGA-based method, apparatus, computer equipment, and media for detecting screen freeze in airborne display systems.

By using FPGA to detect pixel value flipping and changes in pixels within the blanking region, the accuracy problem of image freeze detection in airborne display systems is solved, achieving efficient image freeze detection without additional hardware.

CN123072293APending Publication Date: 2026-11-10SUZHOU CHANGFENG AVIATION ELECTRONICS
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611443684.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-09-17
Publication Date
2026-11-10

AI Technical Summary

Technical Problem

Existing technologies cannot effectively identify frozen screen states in airborne display systems, and adding hardware circuitry may also fail to identify static states of the same frame.

Method used

The video signal is received by FPGA, the blanking region timing is analyzed, a preset number of detection pixels are selected for pixel value flipping, and the pixel value change is judged within a preset time period to realize the image freeze detection.

Benefits of technology

It achieves highly accurate image freeze recognition without the need for additional hardware, avoiding misjudging a frozen state of the same frame as a system crash, thus improving the accuracy of recognition and the security of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FT_1
    Figure FT_1
  • Figure FT_2
    Figure FT_2
  • Figure FT_3
    Figure FT_3
Patent Text Reader

Abstract

This invention provides a method, apparatus, computer device, and medium for detecting screen freeze in an airborne display system based on FPGA. The method includes the following steps: receiving a video signal decoded from a front end and analyzing the timing position of the blanking zone; selecting a preset number of pixels within the blanking zone as detection pixels and flipping the pixel values ​​of the detection pixels; determining the changes in pixel values ​​of all detection pixels in the current frame compared to the corresponding pixel values ​​in the previous frame; if the changes are unchanged, determining the changes in pixel values ​​of all detection pixels within a preset time period before the current time point; if the changes in pixel values ​​of all detection pixels within the preset time period before the current time point are all unchanged, determining that the display screen has frozen. This method can solve the technical problems of existing technologies that require additional hardware circuitry or cannot identify the static state of the same frame.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of screen freeze detection technology, and in particular to a screen freeze detection method, apparatus, computer equipment and medium for an airborne display system based on FPGA. Background Technology

[0002] In airborne mission display systems, the airborne mission controller typically sends navigation, situational awareness, and map images to the airborne display for viewing, providing operators with intuitive mission information. In actual missions, factors such as electromagnetic interference from the airborne environment, bus timing fluctuations, or video transmission link failures can cause the video output from the mission controller to freeze, crash, or fail to refresh. Failure to promptly identify image freezing faults will directly impact mission execution and operational safety.

[0003] To effectively detect frozen screen states, existing technologies typically fall into two categories. The first involves adding a dedicated communication link for heartbeat detection. This is achieved by transmitting heartbeat signals through a serial port, network, or hardware signal line outside the video interface, thus monitoring the display status. While this method does not affect the active screen, it increases hardware costs.

[0004] The second method involves adding an independent watchdog to monitor the graphics generation unit. If the watchdog is not fed within a timeout period, the rendering is considered to be frozen. However, this method can only detect GPU crashes and cannot identify static states in the same frame. Summary of the Invention

[0005] In view of this, embodiments of the present invention provide a method, apparatus, computer equipment and medium for detecting screen freeze in an airborne display system based on FPGA, in order to solve the technical problems in the prior art that require the addition of hardware circuits or cannot identify the static state of the same frame.

[0006] The technical solution provided in this application includes: The first aspect of this invention provides a method for detecting screen freeze in an airborne display system based on FPGA, comprising the following steps: Receive the video signal decoded by the front end and analyze the timing position of the blanking region; A preset number of pixels are selected as detection pixels within the blanking region, wherein the preset number is 2-5. The pixel values ​​of the detected pixels are flipped. Determine the changes in pixel values ​​of all detected pixels in the current frame compared to the corresponding pixel values ​​in the previous frame, wherein the changes are either changes or no changes. If the change is no change, then determine the change in the pixel value of all detected pixels within a preset time period before the current time point, where the preset time period is 3 to 7 seconds; If the pixel values ​​of all detected pixels remain unchanged within the preset time period before the current time point, the display screen is determined to be frozen.

[0007] A second aspect of the present invention provides an FPGA-based airborne display system screen freeze detection device, comprising: The signal interface module is used to receive the video signal decoded by the front end. The video parsing module is used to parse the timing position of the blanking region in the video signal; A detection point configuration module is used to determine the detection pixel points in the blanking area; A pixel flipping module is used to flip the pixel value of the detected pixel. A change judgment module is used to determine the change of pixel values ​​of all detected pixels in the current frame compared with the pixel values ​​of corresponding detected pixels in the previous frame, wherein the change is either a change or no change. An anomaly detection module is used to determine the changes in pixel values ​​of all detected pixels within a preset time period prior to the current time point if the change condition is unchanged. The preset time period is 3 to 7 seconds. If the changes in pixel values ​​of all detected pixels within the preset time period prior to the current time point are all unchanged, it is determined that the display screen has frozen.

[0008] A third aspect of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the FPGA-based airborne display system screen freeze detection method described in the first aspect.

[0009] A fourth aspect of the present invention provides a computer-readable storage medium storing a computer program that performs the FPGA-based airborne display system screen freeze detection method described in the first aspect.

[0010] Compared with the prior art, the beneficial effects that at least one technical solution adopted in the embodiments of this specification can achieve include at least: This solution identifies screen freeze by flipping the pixel values ​​of the detected pixels in the blanking area and observing the changes in these pixel values. It not only eliminates the need for additional hardware but also enables the identification of static states within the same frame, preventing static states from being identified as a system crash and improving the accuracy of the identification. Attached Figure Description

[0011] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a flowchart of a screen freeze detection method for an airborne display system based on FPGA provided in an embodiment of the present invention; Figure 2 This is a schematic block diagram of a computer device provided in an embodiment of the present invention; Figure 3 This is a timing diagram for the field synchronization of DVI video signals. Detailed Implementation

[0013] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0014] The following specific examples illustrate the implementation of this application. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. This application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be noted that, in the absence of conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0015] The first aspect of this invention provides a method for detecting screen freeze in an airborne display system based on FPGA, such as... Figure 1 As shown, the method includes steps S1 to S6.

[0016] Step S1: Receive the video signal decoded by the front end and parse out the timing position of the blanking region.

[0017] Specifically, the video signal decoded by the ARINC818 front-end of the FPGA can be used to analyze the timing positions of the line synchronization signal, field synchronization signal, valid data area, and line and field blanking areas. Based on FPGA hardware implementation, it offers strong real-time performance, low latency, and strong anti-interference capabilities, making it suitable for airborne environments with high reliability requirements.

[0018] Step S2: Select a preset number of pixels as detection pixels within the blanking area, where the preset number is 2-5.

[0019] The detection pixel can be specified only in the line blanking area, only in the field blanking area, or both. As the processing point for pixel value inversion, the detection pixel is located within the blanking area. During the inversion process, no pixel modification is performed on the valid display area, and it does not affect the display of the airborne mission screen.

[0020] Preferably, the preset quantity is 3.

[0021] Step S3: Flip the pixel value of the detected pixel.

[0022] Pixel value flipping involves flipping the pixel value of the detected pixel in each frame of the video signal between high and low levels or between 0 and 1.

[0023] Step S4: Determine the changes in pixel values ​​of all detected pixels in the current frame compared to the corresponding pixel values ​​in the previous frame. The changes are either changes or no changes.

[0024] Specifically, if the pixel value of at least one detected pixel in the current frame is different from the pixel value of the corresponding detected pixel in the previous frame, the change is determined to be a change; if the pixel values ​​of all detected pixels in the current frame are the same as the pixel values ​​of the corresponding detected pixels in the previous frame, the change is determined to be no change.

[0025] Step S5: If the change is that there is no change, then determine the change of pixel values ​​of all detected pixels within a preset time period before the current time point, where the preset time period is 3 to 7 seconds.

[0026] Preferably, the preset duration is 5 seconds.

[0027] Step S6: If the pixel values ​​of all detected pixels within the preset time period before the current time point have not changed, then it is determined that the display screen has frozen.

[0028] If the pixel value of at least one detected pixel does not change within the preset time period before the current time point, the display screen is not considered to be frozen.

[0029] This solution uses standard DVI video timing and interface without adding extra communication interfaces and hardware links. It judges the pixel value flipping of a specified point in the blanking area to avoid pixel modification in the effective display area, ensuring the integrity and interference-free airborne mission screen, and achieving accurate identification of screen freeze.

[0030] To facilitate understanding of this solution, a specific example is provided below.

[0031] The onboard display resolution is 1600. The system transmits data at 1200Hz at 60Hz using the RGB888 format. An FPGA is used as the core processing unit. The ARINC818 receives the electrical signals, converts them into DVI video signals, and sends them to the FPGA for processing. Internally, the FPGA uses logic code to implement video timing analysis, blanking region identification, inter-frame comparison, and anomaly detection.

[0032] Pixel position settings: The FPGA performs timing analysis on the input DVI video signal, dividing it into the valid region and horizontal and vertical blanking regions. To avoid affecting the valid display screen, the detected pixels are placed within a stable timing segment, after the vertical sync signal and before the valid display area. For example... Figure 3 As shown, t8 is the front shoulder of the vertical sync signal, t9 is the sync header of the vertical sync signal, t10 is the back shoulder of the vertical sync signal, and t6 is the blanking area of ​​the vertical sync signal. Specifically, the t10 portion in the figure is selected, with row 1205 as the detection row.

[0033] Three consecutive column positions within this row are selected as detection pixels, namely: Detect pixel P1 (row 1205, column 1620) Detect pixel P2 (row 1205, column 1621) Detect pixel P3 (row 1205, column 1622) All three points are located within the blanking region and do not participate in image display. Modifying or flipping their pixel values ​​will not affect the displayed image.

[0034] Pixel value flipping processing: This example uses a binary two-state periodic flip, employing two states: State 0: Pixel value is low. State 1: Pixel value is high. When the FPGA detects that the current timing is in row 1205 of the field blanking interval, it performs a pixel value flip once on the three detection points P1, P2 and P3. If the current detected pixel value is 0, then flip it to 1; If the current detected pixel value is 1, then flip it to 0; Each frame flips only once in the field blanking region, causing the detected pixels to exhibit alternating changes frame by frame, which is used to identify normal video frame refresh.

[0035] Inter-frame change judgment and freeze judgment: The FPGA uses three registers to store the pixel values ​​of P1, P2, and P3, and a second counter to continuously count down for 5 seconds. P1, P2, and P3 are used for rising and falling edge detection, and the second counter is reset to zero. Figure 3As shown.

[0036] If the pixel values ​​of the three detection pixels simultaneously change between 0 and 1, the current video signal is determined to be normal and the screen is not frozen.

[0037] If the countdown timer reaches 5 seconds, the output screen of the airborne mission system will be frozen.

[0038] Error warning output: When the screen is determined to be frozen, the FPGA outputs an abnormal alarm signal. The FPGA can generate a fixed character screen to prompt the operator that the screen is frozen. The operator can restart the onboard task machine to resume work immediately.

[0039] This embodiment completes pixel flipping and status monitoring only in the DVI field blanking area, without modifying the effective display area throughout the process. This ensures the integrity of the displayed image and achieves highly reliable, low-latency crash detection, meeting the high security and stability requirements of airborne mission systems and improving the security and reliability of airborne display systems.

[0040] A second aspect of the present invention provides an FPGA-based airborne display system screen freeze detection device, comprising: The signal interface module is used to receive the video signal decoded by the front end. The video parsing module is used to parse the timing position of the blanking region in the video signal; A detection point configuration module is used to determine the detection pixel points in the blanking area; A pixel flipping module is used to flip the pixel value of the detected pixel. A change judgment module is used to determine the change of pixel values ​​of all detected pixels in the current frame compared with the pixel values ​​of corresponding detected pixels in the previous frame, wherein the change is either a change or no change. An anomaly detection module is used to determine the changes in pixel values ​​of all detected pixels within a preset time period prior to the current time point if the change condition is unchanged. The preset time period is 3 to 7 seconds. If the changes in pixel values ​​of all detected pixels within the preset time period prior to the current time point are all unchanged, it is determined that the display screen has frozen.

[0041] In this embodiment, a computer device is provided, such as... Figure 2As shown, it includes a memory 201, a processor 202, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the FPGA-based airborne display system screen freeze detection method described in the first aspect.

[0042] Specifically, the computer device can be a computer terminal, a server, or a similar computing device.

[0043] In this embodiment, a computer-readable storage medium is provided, which stores a computer program that executes the FPGA-based airborne display system screen freeze detection method described in the first aspect.

[0044] Specifically, computer-readable storage media, including both permanent and non-permanent, removable and non-removable media, can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer-readable storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable storage media does not include transient media, such as modulated data signals and carrier waves.

[0045] Obviously, those skilled in the art should understand that the modules or steps of the above-described embodiments of the present invention can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the embodiments of the present invention are not limited to any particular hardware and software combination.

[0046] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, various modifications and variations can be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for detecting screen freeze in an airborne display system based on FPGA, characterized in that, Includes the following steps: Receive the video signal decoded by the front end and analyze the timing position of the blanking region; A preset number of pixels are selected as detection pixels within the blanking region, wherein the preset number is 2-5. The pixel values ​​of the detected pixels are flipped. Determine the changes in pixel values ​​of all detected pixels in the current frame compared to the corresponding pixel values ​​in the previous frame, wherein the changes are either changes or no changes. If the change is no change, then determine the change in the pixel value of all detected pixels within a preset time period before the current time point, where the preset time period is 3 to 7 seconds; If the pixel values ​​of all detected pixels remain unchanged within the preset time period before the current time point, the display screen is determined to be frozen.

2. The FPGA-based airborne display system screen freeze detection method as described in claim 1, characterized in that, The preset duration is 5 seconds.

3. The FPGA-based airborne display system screen freeze detection method as described in claim 1, characterized in that, The preset quantity is 3.

4. The FPGA-based airborne display system screen freeze detection method as described in claim 1, characterized in that, Determining the changes in pixel values ​​of all detected pixels in the current frame compared to the corresponding pixel values ​​in the previous frame includes: If the pixel value of at least one detected pixel in the current frame is different from the pixel value of the corresponding detected pixel in the previous frame, then the change is determined to be a change. If the pixel values ​​of all detected pixels in the current frame are the same as the pixel values ​​of the corresponding detected pixels in the previous frame, then the change is determined to be no change.

5. The FPGA-based airborne display system screen freeze detection method as described in claim 1, characterized in that, The blanking region is a row blanking region and / or a field blanking region.

6. An FPGA-based airborne display system screen freeze detection device, characterized in that, include: The signal interface module is used to receive the video signal decoded by the front end. The video parsing module is used to parse the timing position of the blanking region in the video signal; A detection point configuration module is used to determine the detection pixel points in the blanking area; A pixel flipping module is used to flip the pixel value of the detected pixel. A change judgment module is used to determine the change of pixel values ​​of all detected pixels in the current frame compared with the pixel values ​​of corresponding detected pixels in the previous frame, wherein the change is either a change or no change. An anomaly detection module is used to determine the changes in pixel values ​​of all detected pixels within a preset time period prior to the current time point if the change condition is unchanged. The preset time period is 3 to 7 seconds. If the changes in pixel values ​​of all detected pixels within the preset time period prior to the current time point are all unchanged, it is determined that the display screen has frozen.

7. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the FPGA-based airborne display system screen freeze detection method as described in any one of claims 1 to 4.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that executes the screen freeze detection method for an airborne display system based on FPGA as described in any one of claims 1 to 4.