An ultra-wide screen redundant graphics display processing apparatus

Abstract

The application discloses a kind of super-wide screen redundant graphic display processing equipment, including n multiple window graphic display processing components, k multiple display video monitoring and switching selection components, a multi-channel fault-tolerant super-wide screen display component, the same internal function of each multiple window graphic display processing component, each multiple window graphic display processing component has k video processing channels outside, the i th video processing channel of each multiple window graphic display processing component is connected to the i th multiple display video monitoring and switching selection component;Multi-channel fault-tolerant super-wide screen display component has k video display channels outside, the i th video display channel of channel fault-tolerant super-wide screen display component is connected to the i th multiple display video monitoring and switching selection component;The function that each multiple display video monitoring and switching selection component has is the same, according to the video switching control information of multiple window graphic display processing component 1 for video display channel to connect corresponding video processing channel.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of avionics equipment for graphic display processing, in particular, to a redundant graphic display processing device which can be used in an airborne panoramic display system and can meet the stringent airborne reliability and safety index requirements. BACKGROUND

[0002] The cockpit display system in the field of avionics usually provides each operator with multiple independent traditional display screens for information display and interactive operation. In order to facilitate the layout of multiple display screens in the cockpit, the traditional display screens have common aspect ratios such as 1:1, 4:3, 5:4, 16:9, 16:10, etc. The display area of each display screen in this scheme is not too large and is independent of each other, the complexity of graphic display processing is not too high, the high safety strategy is simple and clear, and the redundant backup is simple to implement, so this scheme has been widely used in airborne display systems in the field of avionics. However, this scheme also has obvious limitations and shortcomings, the display frame and mounting area occupy too much area of the visual focal point area, cannot provide complete display in a large area in the visual focal point area, is difficult to support multi-channel interactive panoramic display requirements, and the human-computer interaction efficiency cannot meet the development needs of modern cockpit informatization and intelligentization.

[0003] Under this background, new large-size display screens with aspect ratios of 10:4 and 8:3, which can easily provide complete display in a large area in the visual focal point area, have become the preferred scheme for advanced cockpits. The aspect ratio of this new large-size display screen is usually more than 2:1, which we call super-wide screen. In a cockpit system, a new super-wide screen can replace multiple traditional display screens to provide complete display in a large area in the visual focal point area, effectively support multi-channel interactive panoramic display, provide efficient human-computer interaction, and is very suitable for the development needs of modern cockpit informatization and intelligentization.

[0004] The use of super-wide screens brings higher human-computer interaction efficiency, but also brings new challenges. The primary problem is the reliability and safety challenge brought by replacing multiple traditional display screens with a single display screen. This makes the super-wide screen redundant graphic display processing technology that can effectively deal with this problem become the key to the successful cockpit application promotion of super-wide screen display. SUMMARY

[0005] The purpose of the present application is to provide a super-wide screen redundant graphic display processing device, to solve the reliability and safety challenges of airborne super-wide screen applications, to accelerate the popularization of new-generation multi-channel interactive, panoramic display cockpit systems in the field of avionics, and to improve the human-machine interaction efficiency and task performance of aircraft. The present application includes at least two multi-window graphic display processing components, at least two multi-channel display video monitoring and switching selection components, and a multi-channel fault-tolerant super-wide screen display component. The present application not only supports large-area panoramic graphic display processing of visual focus area, but also supports redundancy backup, integrity monitoring, and fault reconstruction of super-wide screen display channel level and display window level. When a general fault occurs, the redundancy backup function of the present application can ensure that the panoramic graphic display function continues to operate normally; when a serious fault occurs, as long as any one super-wide screen channel can display interaction normally, the complete cockpit multi-channel interaction function can be provided, so that a single display screen can also achieve reliability and safety indicators not lower than traditional multiple display screens.

[0006] The present application can achieve extremely stringent integrity indicators and availability indicators while providing higher human-machine interaction efficiency, and is very suitable for multi-channel interactive panoramic cockpit display systems.

[0007] The purpose of the present application is achieved by the following technical solutions.

[0008] A super-wide screen redundant graphic display processing device includes n multi-window graphic display processing components 1, k multi-channel display video monitoring and switching selection components 2, and a multi-channel fault-tolerant super-wide screen display component 3. The internal functions of each multi-window graphic display processing component 1 are the same, each multi-window graphic display processing component 1 has k video processing channels externally, and the i-th video processing channel of each multi-window graphic display processing component 1 is connected to the i-th multi-channel display video monitoring and switching selection component 2. The multi-channel fault-tolerant super-wide screen display component 3 has k video display channels externally, and the i-th video display channel of the multi-channel fault-tolerant super-wide screen display component 3 is connected to the i-th multi-channel display video monitoring and switching selection component 2. Each multi-channel display video monitoring and switching selection component 2 has the same function.

[0009] In the normal working mode of the multi-window graphic display processing component 1:

[0010] Each multi-window graphic display processing component 1 receives the first status information output by each multi-display video monitoring and switching selection component 2 and the second status information output by the multi-channel fault-tolerant ultra-wide screen display component 3, and the to-be-displayed data input from outside, draws the to-be-displayed data into an ultra-wide screen panoramic graphic with a width of w x k and a height of h, divides the ultra-wide screen panoramic graphic into k area graphics with a width of w and a height of h from left to right, and outputs the k area graphics from left to right through the k video processing channels outside in sequence, and sends the video switching control information to the multi-display video monitoring and switching selection component 2 by the multi-window graphic display processing component 1 with the control right.

[0011] The multi-display video monitoring and switching selection component 2 monitors the state of the video processing channels connected to each multi-window graphic display processing component 1 and itself, and sends the first status information obtained by the monitoring to the multi-window graphic display processing component 1, and when receiving the video switching control information of the multi-window graphic display processing component 1, sends the area graphic on the video processing channel of the multi-window graphic display processing component 1 with the control right to the video display channel connected to the multi-channel fault-tolerant ultra-wide screen display component 3.

[0012] The multi-channel fault-tolerant ultra-wide screen display component 3 combines the area graphics on the k video display channels from left to right to generate an ultra-wide screen panoramic graphic with a width of w x k and a height of h for display.

[0013] Preferably, if the first status information and the second status information reflect that there is a fault in each multi-display video monitoring and switching selection component 2 and the video display channel of the multi-channel fault-tolerant ultra-wide screen display component 3, the multi-window graphic display processing component 1 adjusts the human-computer interaction window on the corresponding area graphic to the area graphic that is not affected.

[0014] Preferably, when the status information reported by a certain multi-display video monitoring and switching selection component 2 to the multi-window graphic display processing component 1 indicates that there is an input fault, if there is an internal fault of a certain multi-window graphic display processing component 1 or a fault of the video processing channel of a certain multi-window graphic display processing component 1, the redundant backup mode is entered.

[0015] At this time, each multi-window graphic display processing component 1 in a normal working state and with a normal video processing channel will perform fault processing, and if there are multiple multi-window graphic display processing components 1 with fault processing conditions, the multi-window graphic display processing component 1 with the highest priority obtains the control right in priority.

[0016] Preferably, when n multi-window graphic display processing components 1 are unable to complete the super-wide screen panoramic graphic processing via the multi-path display video monitoring and switching selection component 2 to display on the multi-channel fault-tolerant super-wide screen display component 3, the system will lose the super-wide screen panoramic graphic display function and need to enter the fault reconstruction mode:

[0017] The multi-window graphic display processing component 1 directly transmits the externally input display data to the remaining normal transmission video processing channels of the k video processing channels.

[0018] Preferably, the multi-window graphic display processing component 1 comprises a data interface component 11, a display control and multi-window management component 12, m window graphic display processing components 13, m window graphic integrity monitoring components 14, and a graphic synthesis component 15. The number of m is determined by the human-machine interface window in the super-wide screen panoramic graphic. The window graphic display processing component 13 corresponds to draw a human-machine interface window. The m window graphic integrity monitoring components 14 and the window graphic display processing components 13 are one-to-one corresponding, and the integrity of the window graphic display processing component 13 is monitored.

[0019] The display control and multi-window management component 12 is used to:

[0020] 1) Control the data interface component 11 to receive the first state information output by each multi-path display video monitoring and switching selection component 2, the second state information output by the multi-channel fault-tolerant super-wide screen display component 3, the externally input display data, and send fault information to the external system;

[0021] 2) Identify the display data and input it into the corresponding window graphic display processing component 13, and control the window graphic display processing component 13 to draw a human-machine interface window corresponding to the display data;

[0022] 3) Control the window graphic integrity monitoring component 14 to monitor the integrity of the human-machine interface window, and obtain the monitoring state and result;

[0023] 4) Control the graphic synthesis component 15 to perform multi-window layout according to the human-machine interface window drawn by the window graphic display processing component 13, the monitoring state and result of the window graphic integrity monitoring component 14, and the fault information of the multi-path display video monitoring and switching selection component 2 and the multi-channel fault-tolerant super-wide screen display component 3 reflected in the first state information and the second state information, form a super-wide screen panoramic graphic with a width of w x k and a height of h, divide the super-wide screen panoramic graphic into corresponding area graphics, add a video synchronization signal, and output to the video processing channel to send to each multi-path display video monitoring and switching selection component 2.

[0024] Preferably, the display control and multi-window management component 12 is also used for:

[0025] 5) When the monitoring result reported by the window graphics integrity monitoring component 14 is abnormal, the control of each window graphics display processing component 13 and the graphics composition component 15 is reconfigured, the graphics processing function of the window graphics display processing component 13 with abnormality is adjusted to be processed by other window graphics display processing components 13, the normal operation of the panoramic display function is ensured, and the window graphics display processing component with abnormality is isolated and restarted, and after the completion of the restart is detected to be normal, the original graphics processing function is restored; if the recovery cannot be continued, the multi-window graphics display processing component 1 is faulty, and according to the redundancy mode, the multi-window graphics display processing component 1 with the highest priority will obtain the control right to replace the multi-window graphics display processing component 1;

[0026] 6) When the first state information reported by the multi-channel display video monitoring and switching selection component 2 indicates that there is an input fault, the display control and multi-window management component 12 in each multi-window graphics display processing component 1 with fault processing conditions selects the multi-window graphics display processing component 1 with the highest priority to obtain the control right preferentially;

[0027] 7) When the n multi-window graphics display processing components 1 cannot complete the panoramic graphics processing to be displayed on the multi-channel fault-tolerant ultra-wide screen display component 3 through the multi-channel display video monitoring and switching selection component 2, the display control and multi-window management component 12 in each multi-window graphics display processing component 1 selects the multi-window graphics display processing component 1 with the highest priority to obtain the control right preferentially, and the display control and multi-window management component 12 directly inputs the external input display data into the graphics composition component 15 and then transmits the data through the part of the video processing channels that can still normally transmit.

[0028] Preferably, the window graphics integrity monitoring method of the window graphics integrity monitoring component 14 is as follows:

[0029] The window graphics display processing component 13 needs to send periodic heartbeat signals, self-detection state information, human-computer interaction windows, and key parameter values for window graphics processing to the window graphics integrity monitoring component 14; the window graphics integrity monitoring component 14 monitors the timeout and freezing of the window graphics display processing component 13 through the heartbeat signals; the self-detection state information collection can more comprehensively understand the state of the window graphics display processing component 13 in abnormality; the received human-computer interaction windows are monitored, including the address of the window graphics data and whether the last change occurs; the characteristics of the key parameter values for graphics processing are monitored according to the requirements of the display control and multi-window management component 12, and the integrity of the output graphics of the window graphics display processing component 13 is detected.

[0030] Preferably, the multi-channel display video monitoring and switching selection component 2 comprises a display video monitoring component 21, a monitoring interface component 22, and a display video switching selection component 23.

[0031] The display video monitoring component 21 monitors the status of each input regional graphic, and sends the monitoring status and monitoring result to the monitoring interface component 22, and directly sends the regional graphic with normal monitoring result to the display video switching selection component 23.

[0032] The monitoring interface component 22 receives the video switching control information from the multi-window graphic display processing component 1, and sends the monitoring result of the display video monitoring component 21 and the status information of the video switching selection of the display video switching selection component 23 to each multi-window graphic display processing component 1.

[0033] The display video switching selection component 23 selects the corresponding regional graphic from the input multi-channel regional graphics according to the video switching control information received by the monitoring interface component 22, and sends the video switching selection result to the monitoring interface component 22, and sends the abnormal status information to the monitoring interface component 22 if the switching selection is abnormal.

[0034] Preferably, the video monitoring method of the display video monitoring component 21 is as follows:

[0035] The video monitoring of the display video monitoring component 21 has three levels: 1) video signal link monitoring, detecting whether the signal connection of each input video processing channel is normal, and detecting the open circuit and the broken circuit; 2) video signal synchronization signal monitoring, decoding the video synchronization signal from the input regional graphic, detecting the cycle length and the pulse width, and comparing the detection result with the corresponding channel video standard signal standard defined by the system, and determining that the input regional graphic is abnormal if there is a disagreement; 3) detecting the auxiliary test information embedded in the regional graphic.

[0036] Preferably, the k video display channels of the multi-channel fault-tolerant ultra-wide screen display component 3 are independent of each other, each video display channel has a separate power supply and electronic components, there is physical isolation between the video display channels, and each video display channel corresponds to a display area on the ultra-wide screen and is independent of each other. BRIEF DESCRIPTION OF DRAWINGS

[0037] Figure 1 Structure diagram of the ultra-wide screen redundant graphic display processing device.

[0038] Figure 2 Technical principle diagram of the multi-window graphic display processing component 1.

[0039] Figure 3 Technical principle diagram of the multi-channel display video monitoring and switching selection component 2.

[0040] Figure 4 Schematic diagram of multi-channel redundant ultra-wide screen display. DETAILED DESCRIPTION

[0041] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

[0042] In the field of avionics, the ultra-wide screen redundant graphics display processing device shown in this embodiment supports high-performance complex graphics display processing on board, has redundant graphics display processing capabilities with outstanding safety and reliability, supports the implementation of ultra-wide screen panoramic display on board, improves human-computer interaction efficiency and aircraft performance, such as Figure 1 As shown, it comprises n multi-window graphic display processing components 1 (assuming that the serial numbers of the multi-window graphic display processing components are 1 to n according to the priority, n ≥ 2), k multi-channel display video monitoring and switching selection components 2 (assuming that the serial numbers of the multi-channel display video monitoring and switching selection components are 1 to k from left to right, k ≥ 2), and a multi-channel fault-tolerant ultra-wide screen display component 3. The internal functions of the multi-window graphic display processing components 1 are the same, and the external parts of the multi-window graphic display processing components 1 have k video processing channels (assuming that the serial numbers of the video processing channels are 1 to k from left to right, k ≥ 2). The i-th video processing channel of the display processing component 1 is connected to the i-th multi-channel display video monitoring and switching selection component 2. There are k video display channels outside the multi-channel fault-tolerant ultra-wide screen display component 3 (assuming that the video display channels are numbered from 1 to k from left to right, k≥2). The i-th video display channel of the channel fault-tolerant ultra-wide screen display component 3 is connected to the i-th multi-channel display video monitoring and switching selection component 2. The functions of each multi-channel display video monitoring and switching selection component 2 are the same. According to the video switching control information of the multi-window graphic display processing component 1, the video display channel is connected to the corresponding video processing channel.

[0043] In the normal working mode of the multi-window graphics display processing unit 1:

[0044] Each multi-window graphic display processing component 1 receives the first status information output by each multi-channel display video monitoring and switching selection component 2 and the second status information output by the multi-channel fault-tolerant ultra-wide screen display component 3, as well as the external input data to be displayed, and draws the data to be displayed into an ultra-wide screen panoramic graphic with a width of w×k and a height of h, and divides the ultra-wide screen panoramic graphic into k w×h regional graphics from left to right. These k regional graphics are output from left to right in sequence through the k-th external video processing channels, and the multi-window graphic display processing component 1 with control right (the highest priority, i.e., serial number 1) sends video switching control information to the multi-channel display video monitoring and switching selection component 2.

[0045] The multi-path display video monitoring and switching selection component 2 monitors the video processing channel of each multi-window graphical display processing component 1 connected thereto and its own state, and sends the first state information monitored to the multi-window graphical display processing component 1. When receiving the video switching control information of the multi-window graphical display processing component 1, the multi-path display video monitoring and switching selection component 2 sends the region graphics on the video processing channel of the multi-window graphical display processing component 1 with the control right to the video display channel of the multi-path fault-tolerant ultra-wide screen display component 3 connected thereto.

[0046] The multi-path fault-tolerant ultra-wide screen display component 3 combines the region graphics on the first path to the kth path, i.e. k video display channels, from left to right according to the arrangement on the multi-path ultra-wide screen display schematic diagram, generates an ultra-wide screen panoramic graphic with a width of w x k and a height of h, and displays the ultra-wide screen panoramic graphic. Figure 4 The multi-path fault-tolerant ultra-wide screen display component 3 combines the region graphics on the first path to the kth path, i.e. k video display channels, from left to right according to the arrangement on the multi-path ultra-wide screen display schematic diagram, generates an ultra-wide screen panoramic graphic with a width of w x k and a height of h, and displays the ultra-wide screen panoramic graphic.

[0047] The first state information includes periodic heartbeat information for maintaining the communication state with the multi-window graphical display processing component 1, working mode related state information of the multi-path display video monitoring and switching selection component 2, fault information of the multi-path display video monitoring and switching selection component 2 itself, input function fault information of the multi-path display video monitoring and switching selection component 2, and monitoring results of the video processing channel of the multi-path display video monitoring and switching selection component 2. If the multi-window graphical display processing component 1 cannot receive the periodic heartbeat information for maintaining the communication state from the multi-path display video monitoring and switching selection component 2 in time, it is considered that the multi-path display video monitoring and switching selection component 2 is faulty, and the fault processing is reported to the external system.

[0048] The second state information mainly includes periodic heartbeat information for maintaining the communication state with the multi-window graphical display processing component 1, working mode related state information of the multi-path fault-tolerant ultra-wide screen display component 3, fault information of the multi-path fault-tolerant ultra-wide screen display component 3 itself, and input function fault information of the multi-path fault-tolerant ultra-wide screen display component 3. If the multi-window graphical display processing component 1 cannot receive the periodic heartbeat information for maintaining the communication state from the multi-path fault-tolerant ultra-wide screen display component 3 in time, it is considered that the multi-path fault-tolerant ultra-wide screen display component 3 is faulty, and the fault processing is reported to the external system.

[0049] If the first state information and the second state information reflect that the video display channels of the multi-path display video monitoring and switching selection component 2 and the multi-path fault-tolerant ultra-wide screen display component 3 are faulty, the multi-window graphical display processing component 1 adjusts the human-computer interaction window on the corresponding region graphic to the region graphic not affected.

[0050] When the state information reported by the multi-path display video monitoring and switching selection component 2 to the multi-window graphics display processing component 1 indicates that there is an input fault, if the internal fault of a certain multi-window graphics display processing component 1 or the fault of a video processing channel of a certain multi-window graphics display processing component 1 occurs, the redundant backup mode is entered:

[0051] At this time, each multi-window graphics display processing component 1 in the normal working state and with a normal video processing channel will perform fault processing. If there are multiple multi-window graphics display processing components 1 with fault processing conditions, the multi-window graphics display processing component 1 with a smaller serial number has priority to obtain control. For example, the multi-window graphics display processing component 1 with a serial number of 1 has the highest priority and has the control by default. When the internal fault of the multi-window graphics display processing component 1 with a serial number of 1 or the fault of the video processing channel occurs, the multi-window graphics display processing component 1 with a serial number of 2 with a secondary priority has the control. The area graphics of the k video processing channels output by the multi-window graphics display processing component 1 with a serial number of 2 are sent to the multi-channel fault-tolerant ultra-wide screen display component 3 to complete the ultra-wide screen panoramic graphics display. If the multi-window graphics display processing component 1 with a serial number of 2 also fails to support the ultra-wide screen panoramic graphics display on the multi-channel fault-tolerant ultra-wide screen display component 3, the multi-window graphics display processing component 1 with a serial number of 3 has the control to guarantee the ultra-wide screen panoramic graphics display. In this way, as long as one of the n multi-window graphics display processing components 1 can send all k video processing channels to the multi-channel fault-tolerant ultra-wide screen display component 3 through the multi-path display video monitoring and switching selection component 2 for display, the ultra-wide screen panoramic graphics display function can be guaranteed.

[0052] If the outputs of the multi-window graphics display processing components 1 involved in the current state with faults are not sent to the multi-channel fault-tolerant ultra-wide screen display component 3 for display, the display function will be in a normal state and not affected by the fault. The multi-window graphics display processing component 1 with a fault will report the fault state to the external system. If the outputs of the multi-window graphics display processing components 1 involved in the current state with faults exist to be sent to the multi-channel fault-tolerant ultra-wide screen display component 3 for display (i.e., have the control), the display function may be affected by the fault. The multi-window graphics display processing component 1 with a fault will report the fault processing result and the fault state to the external system after giving up the control and checking and confirming that the display function returns to normal.

[0053] When the n multi-window graphics display processing components 1 cannot complete the ultra-wide screen panoramic graphics processing to be sent to the multi-channel fault-tolerant ultra-wide screen display component 3 through the multi-path display video monitoring and switching selection component 2 for display, the system will lose the ultra-wide screen panoramic graphics display function and needs to enter the fault reconstruction mode:

[0054] The multi-window graphic display processing component 1 transmits externally input data to be displayed directly using the portion of the k video processing channels that are still functioning. For example, if a single video processing channel is used to display all required data, the multi-channel display video monitoring and switching selection component 2 prioritizes control over the multi-window graphic display processing component 1, which then transmits the most critical flight safety information, including electronic flight instruments and engine parameter displays, including aircraft attitude, flight parameters, and engine parameters, via the video processing channels. The pilot can then manipulate other required information as needed. If the multi-window graphic display processing component 1, numbered 1, experiences a serious malfunction that prevents it from completing the reconstruction process, the multi-window graphic display processing component 1 detects this anomaly and reports it to all other multi-window graphic display processing components 1. The multi-window graphic display processing component 1, numbered 2, then assumes control and takes over the reconstruction process. This continues in this order, until the multi-window graphic display processing component 1, numbered n, finally assumes control.

[0055] To implement the above modes, the implementation of each component is illustrated below with examples.

[0056] like Figure 2 As shown, the multi-window graphics display processing component 1 provides integrity monitoring and redundancy reconstruction functions at the display window level and includes a data interface component 11, a display control and multi-window management component 12, m window graphics display processing components 13 (numbered 1 to m), m window graphics integrity monitoring components 14 (numbered 1 to m), and a graphics synthesis component 15. The number m is determined by the human-machine interface windows in the ultra-widescreen panoramic graphics, which varies depending on the project. The maximum number of human-machine interface windows is the number of m. The window graphics display processing component 13 draws a corresponding human-machine interface window, such as an electronic flight instrument or navigation system. The m window graphics integrity monitoring components 14 correspond one-to-one with the window graphics display processing component 13, monitoring the integrity of the window graphics display processing component 13.

[0057] The data interface component 11 is controlled by the display control and multi-window management component 12, and performs data input and output through the bus or peripheral interface, including external input and output of the ultra-wide screen redundant graphic display processing system, multi-channel display video monitoring and switching selection component 2 and status information input of the multi-channel fault-tolerant ultra-wide screen display component 3.

[0058] The display control and multi-window management component 12 has multiple functions, namely:

[0059] 1) Control data interface component 11 receives first state information output by each multi-channel display video monitoring and switching selection component 2, second state information output by multi-channel fault-tolerant ultra-wide screen display component 3, to-be-displayed data input from external systems, and sends fault information to external systems, etc.

[0060] 2) After to-be-displayed data is identified, it is input to each corresponding window graphical display processing component 13, and each window graphical display processing component 13 draws a human-computer interface window corresponding to the to-be-displayed data.

[0061] 3) Control each window graphical integrity monitoring component 14 to monitor the integrity of the human-computer interface window, and obtain monitoring states and results.

[0062] 4) Control graphical synthesis component 15 to perform multi-window layout according to the human-computer interface window drawn by each window graphical display processing component 13, the monitoring states and results of each window graphical integrity monitoring component 14, and the fault information of the video display channels of multi-channel display video monitoring and switching selection component 2 and multi-channel fault-tolerant ultra-wide screen display component 3 reflected in first state information and second state information, form an ultra-wide screen panorama with a width of w x k and a height of h, divide the ultra-wide screen panorama into corresponding area graphics, add a video synchronization signal, and output to a video processing channel to each multi-channel display video monitoring and switching selection component 2.

[0063] If the window graphical integrity monitoring component 14 monitors that the corresponding window graphical display processing component is abnormal, the graphical synthesis component 15 will additionally add warning information such as a red cross to the human-computer interaction window drawn by the window graphical display processing component when performing multi-window layout.

[0064] If a multi-channel display video monitoring and switching selection component 2 fails, the area graphics passing through the multi-channel display video monitoring and switching selection component 2 will not be displayed on the multi-channel fault-tolerant ultra-wide screen display component 3, and the window content intersecting with the video area will not be normally displayed. The graphical synthesis component 15 enters a backup state of reconstruction, adjusts the human-computer interaction window on the area graphic to other unaffected area graphics according to the received first state information of the multi-channel display video monitoring and switching selection component 2, and ensures that critical information can be normally displayed.

[0065] If the multi-channel fault-tolerant super-wide screen display component 3 fails or reports input failure, the video display channel related to the failure will not be normally displayed on the multi-channel fault-tolerant super-wide screen display component 3. The process is the same as that when a certain multi-channel display video monitoring and switching selection component 2 fails. The graphic synthesis component 15 enters the reconstruction backup state, and according to the second state information of the multi-channel fault-tolerant super-wide screen display component 3, adjusts the man-machine interaction window on the area graphic to other unaffected area graphics, to ensure that the key information can be normally displayed.

[0066] 5) When the monitoring result reported by the window graphic integrity monitoring component 14 is abnormal, the window graphic display processing component 13 and the graphic synthesis component 15 are controlled to reconstruct, the graphic processing function of the window graphic display processing component 13 with the abnormality is adjusted to be processed by other window graphic display processing components 13, to ensure the normal operation of the panoramic display function, and at the same time, the window graphic display processing component with the abnormality is isolated to avoid the influence on other components when restarting, and then restarted. After the restart is completed and the detection is normal, the original graphic processing function is restored. If the recovery cannot be continued, the multi-window graphic display processing component 1 has a failure. According to the redundancy mode, the multi-window graphic display processing component 1 with a larger serial number will obtain the control right to replace the multi-window graphic display processing component 1, to ensure the normal display of the key information.

[0067] 6) When the first state information reported by a certain multi-channel display video monitoring and switching selection component 2 prompts an input failure, the display control and multi-window management component 12 in each multi-window graphic display processing component 1 with a failure processing condition selects the multi-window graphic display processing component 1 with the highest priority to obtain the control right preferentially.

[0068] 7) When n multi-window graphic display processing components 1 cannot complete the panoramic graphic processing to be sent to the multi-channel fault-tolerant super-wide screen display component 3 for display via the multi-channel display video monitoring and switching selection component 2, the display control and multi-window management component 12 in each multi-window graphic display processing component 1 selects the multi-window graphic display processing component 1 with the highest priority to obtain the control right preferentially, and the display control and multi-window management component 12 directly inputs the external input display data into the graphic synthesis component 15 and then transmits the data by using the part of the video processing channels that can still normally transmit in the k video processing channels.

[0069] The implementation method of the window graphic integrity monitoring component 14 is as follows:

[0070] The window graphics display processing component 13 needs to send periodic heartbeat signals, self-detection state information, human-computer interaction windows, and key parameter values used for window graphics processing to the window graphics integrity monitoring component 14. The window graphics integrity monitoring component 14 detects the periodic heartbeat signals, self-detection state information, human-computer interaction windows, and key parameter values used for window graphics processing received from the window graphics display processing component 13. Through the heartbeat signals, it can monitor the processing timeout, freezing, and other failures of the window graphics display processing component 13. For example, the heartbeat signals are usually within 20 ms, and when a certain threshold value such as 3 cycles of 60 ms is exceeded and the heartbeat signals are not received, it is considered that the window graphics display processing component 13 has timed out and is not responding, and has lost control. The collection of self-detection state information can comprehensively understand the state of the window graphics display processing component 13 in an abnormal situation. The received human-computer interaction windows are monitored, including monitoring whether the address of the human-computer interaction window has changed from the last time, monitoring the characteristics of the key symbols of the graphic data according to the requirements of the display control and multi-window management component 12, and detecting the integrity of the output graphics of the window graphics display processing component 13. For example, in the figure, a yellow triangle with a blue background and a side length of 30 pixels in a certain direction should be present, which can be monitored and detected by matching the expected colors of the feature pixels. If the colors of the feature pixels are consistent with the expected colors, it is normal, and if they are not consistent, it is an integrity anomaly. The monitoring of the key parameter values used for window graphics processing only needs to compare the key parameter values used for window graphics processing from the window graphics display processing component 13 and the display control and multi-window management component 12. If they are consistent, it is normal, and if they are not consistent, it is an integrity anomaly. If the window graphics integrity monitoring component 14 detects an anomaly in the window graphics display processing component 13, it not only reports the anomaly to the display control and multi-window management component 12, but also reports the anomaly information to the graphic synthesis component 15. When the graphic synthesis component 15 performs graphic synthesis, it adds red cross lines on the window reporting the anomaly to mark that the data in the window is not reliable, thereby avoiding misleading the pilot with unreliable information. After receiving the anomaly information of the window graphics display processing component 13, the display control and multi-window management component 12 will perform a fault isolation and recovery process to restart and recover the window graphics display processing component 13 that has an anomaly.

[0071] Referring to Figure 3 As shown in the figure, the multi-channel display video monitoring and switching selection component 2 includes a display video monitoring component 21, a monitoring interface component 22, and a display video switching selection component 23.

[0072] The display video monitoring unit 21 monitors the state of each input area graphic, and sends the monitoring state and monitoring result to the monitoring interface unit 22, and sends the area graphic with normal monitoring result directly to the display video switching selection unit 23.

[0073] The monitoring interface unit 22 receives the video switching control information from the multi-window graphic display processing unit 1, and sends the monitoring result of the display video monitoring unit 21 and the state information of the video switching selection of the display video switching selection unit 23 to each multi-window graphic display processing unit 1.

[0074] The display video switching selection unit 23 selects the corresponding area graphic from the input area graphics according to the video switching control information received by the monitoring interface unit 22, and sends the video switching selection result to the monitoring interface unit 22, and sends the abnormal state information to the monitoring interface unit 22 if the switching selection is abnormal.

[0075] The video monitoring method of the display video monitoring unit 21 is described as follows:

[0076] The video monitoring of the display video monitoring unit 21 mainly has three levels. The first level is the monitoring of the video signal link, whether the signal connection of each input video processing channel is normal, and the detection of the electrical open circuit, open circuit and other faults; the second level is the monitoring of the video signal synchronization signal, the decoding of the line synchronization, field synchronization and blanking signal and other video synchronization signals from the input area graphic, the detection of the cycle length and pulse width length, the comparison of the detection result with the corresponding channel video standard signal standard defined by the system, and the determination of the input area graphic as abnormal if there is any inconsistency; the third level is the detection of the auxiliary test information embedded in the area graphic, such as the specific feature data put into the low four bits of each color in the first row by the graphic synthesis unit 15, such as the continuous 8 pixels of RGB channel low four bits increasing from 0 to 7, and the continuous detection of the low four bits of the 8 pixels of each frame graphic video, and the input video as abnormal if the value of the area of several video frames is inconsistent with the expectation. After the display video monitoring unit 21 monitors the abnormality, the abnormal information is sent to the monitoring interface unit 22, which is reported to the unit 1 for processing by the monitoring interface unit 22.

[0077] Referring to Figure 4As shown, the k video display channels of the multi-channel fault-tolerant ultra-wide screen display component 3 are independent of each other, each video display channel has a separate power supply and electronic components, there is physical isolation between the video display channels, each video display channel corresponds to a display area on the ultra-wide screen and is independent of each other, and failure of any one video display channel will not affect the display of other channels. The multi-channel fault-tolerant ultra-wide screen display component 3 receives the region graphics output by the k multi-channel display video monitoring and switching selection component 2 in order to send to the multiple independent fault-tolerant channels of the ultra-wide screen, and displays on the ultra-wide screen to realize panoramic display. The multi-channel fault-tolerant ultra-wide screen display component 3 continuously monitors each video display channel during operation, and sends the state information of each video display channel to each multi-window graphics display processing component 1, so as to perform redundancy or reconstruction processing when there is an exception, and ensure that critical information can be normally displayed.

[0078] The hardware implementation of the present application is illustrated below taking 5760x1080 ultra-wide screen panoramic display as an example:

[0079] The multi-channel fault-tolerant ultra-wide screen display component 3 is implemented by a three-channel redundant liquid crystal display module, with a resolution of 5760x1080, and the resolution of each of the three channels is 1920x1080. The power supply, backlight, and control circuit of each channel are independent components, and are divided into left, middle, and right parts. There is a visually invisible line separating the liquid crystal in the middle and adjacent areas on the left and right, which avoids affecting the adjacent area of the liquid crystal panel when the liquid crystal panel fails physically. In this way, failure of any one channel will not affect the display of other channels. The three-channel redundant liquid crystal display module continuously reports the self-detection condition to component 1 through the bus, and when a display channel fails, component 1 will enter a reconstruction mode to provide complete display control function using the remaining normal display channel.

[0080] The multi-window graphics display processing component 1 is selected to have three, each of which can process one 5760x1080 panoramic graphics, and three 1920x1080 video channels are sent to the three multi-channel video monitoring and switching selection components 2. Each of the three multi-channel video monitoring and switching selection components 2 outputs one 1920x1080 video to the multi-channel fault-tolerant ultra-wide screen display component 3, which is a three-channel redundant liquid crystal display module, corresponding to the left, middle, and right three 1920x1080 display areas.

[0081] The data interface component 11 in the multi-window graphic display processing component 1 is realized by using an airborne bus interface computer board and matching software, supports multiple 1553B, ARINC429, AFDX, FC, RS422 and other airborne buses, and is interconnected with other airborne avionics equipment, three multi-channel video monitoring and switching selection components 2 and one multi-channel fault-tolerant ultra-wide screen display component 3. The display control and multi-window management component 12, the window graphic display processing component 13, the window graphic integrity monitoring component 14 and the graphic synthesis component 15 in the multi-window graphic display processing component 1 are realized by using an airborne high-performance graphic processing board and display control processing software, window graphic display processing software, window graphic integrity monitoring software and graphic synthesis software. The airborne bus interface computer board and the airborne high-performance graphic processing board are interconnected through a chassis bus such as a PCIE bus. The display control and multi-window management component 12 is realized by running the display control processing software on the airborne high-performance graphic processing board. The window graphic display processing component 13 is realized by running the window graphic display processing software on the airborne high-performance graphic processing board. The window graphic integrity monitoring component 14 is realized by running the window graphic integrity monitoring software on the airborne high-performance graphic processing board. The graphic synthesis component 15 is realized by running the graphic synthesis software on the airborne high-performance graphic processing board.

[0082] The multi-channel display video monitoring and switching selection component 2 is realized by using three ASIC chips with multi-channel video input monitoring and switching selection functions. The display video monitoring component 21 is realized by using the video input interface monitoring and detection functions of the special ASIC chip. The monitoring interface component 22 is realized by using the monitoring and interface software running on the microcontroller of the special ASIC chip. The display video switching selection component 23 is realized by using the video switching matrix of the special ASIC chip. The monitoring and interface software running on the microcontroller of the special ASIC chip reports the monitoring and detection results to the multi-window graphic display processing component 1, and controls the video switching matrix of the special ASIC chip to select the video to be sent to the multi-channel fault-tolerant ultra-wide screen display component 3 according to the commands of the multi-window graphic display processing component 1.

[0083] The application provides an ultra-wide screen redundant graphic display processing device, which is characterized by excellent graphic display processing capacity, safety and reliability, can support panoramic graphic display processing of a large visual focus area, and can support integrity monitoring, redundancy backup and fault reconstruction at the level of an ultra-wide screen display channel and the level of a display window. When the application is applied to panoramic graphic display processing, the integrity index and the availability index of the ultra-wide screen display system can be effectively ensured. The application is suitable for an airborne ultra-wide screen panoramic display system, and application of the application can reduce the cost of the panoramic cabin display system, accelerate popularization and application, and significantly improve the human-machine interaction efficiency and the efficiency of an airplane in the field of avionics, and has strong popularization and remarkable economic benefits. The application can also be applied to other ultra-wide screen panoramic display systems with high safety and reliability requirements.

Claims

1. A super-wide screen redundant graphic display processing device, comprising n multi-window graphic display processing units (1), k multi-path display video monitoring and switching selection units (2), and a multi-channel fault-tolerant super-wide screen display unit (3), characterized in that The internal functions of each multi-window graphic display processing component (1) are the same, and each multi-window graphic display processing component (1) has k video processing channels outside, and the i-th video processing channel of each multi-window graphic display processing component (1) is connected to the i-th multi-path display video monitoring and switching selection component (2); the multi-channel fault-tolerant ultra-wide screen display component (3) has k video display channels outside, and the i-th video display channel of the multi-channel fault-tolerant ultra-wide screen display component (3) is connected to the i-th multi-path display video monitoring and switching selection component (2); the functions of each multi-path display video monitoring and switching selection component (2) are the same; In the normal working mode of the multi-window graphic display processing component (1): Each multi-window graphic display processing component (1) receives the first state information output by each multi-path display video monitoring and switching selection component (2) and the second state information output by the multi-channel fault-tolerant ultra-wide screen display component (3), as well as the externally input display data, draws the display data into an ultra-wide screen panoramic pattern with a width of w x k and a height of h, divides the ultra-wide screen panoramic pattern into k area patterns with a width of w and a height of h from left to right, sequentially outputs the k area patterns through the first to k-th video processing channels outside, and sends video switching control information to the multi-path display video monitoring and switching selection component (2) by the multi-window graphic display processing component (1) with control authority; The multi-path display video monitoring and switching selection component (2) monitors the video processing channels connected to each multi-window graphic display processing component (1) and its own state, and sends the first state information obtained by monitoring to the multi-window graphic display processing component (1); when receiving the video switching control information of the multi-window graphic display processing component (1), the area pattern on the video processing channel of the multi-window graphic display processing component (1) with control authority is sent to the video display channel connected to the multi-channel fault-tolerant ultra-wide screen display component (3); The multi-channel fault-tolerant ultra-wide screen display component (3) combines the area patterns on the first to k-th video display channels from left to right to generate an ultra-wide screen panoramic pattern with a width of w x k and a height of h for display; The multi-window graphic display processing component (1) includes a data interface component (11), a display control and multi-window management component (12), m window graphic display processing components (13), m window graphic integrity monitoring components (14), and a graphic synthesis component (15); the number m is determined by the human-machine interface window in the ultra-wide screen panoramic pattern, the window graphic display processing component (13) corresponds to a human-machine interface window, and the m window graphic integrity monitoring components (14) and the window graphic display processing components (13) are one-to-one corresponding, and the integrity of the window graphic display processing component (13) is monitored; The display control and multi-window management component (12) is used for: 1) Control data interface component (11) receives first state information output by each multi-channel display video monitoring and switching selection component (2), second state information output by multi-channel fault-tolerant ultra-wide screen display component (3), to-be-displayed data input from external system, and sends fault information to external system; 2) After to-be-displayed data is identified, the data is input to each corresponding window graphical display processing component (13), and each window graphical display processing component (13) is controlled to draw a corresponding to-be-displayed data into a human-machine interface window; 3) Each window graphical integrity monitoring component (14) is controlled to monitor the integrity of the human-machine interface window, and the monitoring state and result are obtained; 4) The graphical synthesis component (15) is controlled to perform multi-window layout according to the human-machine interface window drawn by each window graphical display processing component (13), the monitoring state and result of each window graphical integrity monitoring component (14), and the fault information of the video display channel of the multi-channel display video monitoring and switching selection component (2) and the multi-channel fault-tolerant ultra-wide screen display component (3) reflected in the first state information and the second state information, to form an ultra-wide screen panorama with a width of w×k and a height of h, divide the ultra-wide screen panorama into corresponding area graphics, add a video synchronization signal, and output to a video processing channel to each multi-channel display video monitoring and switching selection component (2); 5) When the monitoring result reported by the window graphical integrity monitoring component (14) is abnormal, each window graphical display processing component (13) and the graphical synthesis component (15) are controlled to be reconfigured, the graphical processing function of the window graphical display processing component (13) with the abnormality is adjusted to the processing of other window graphical display processing components (13), the normal operation of the panorama display function is ensured, the window graphical display processing component with the abnormality is isolated and restarted, and the original graphical processing function is restored after the normality of the restarted component is detected; if the original graphical processing function cannot be restored, the multi-window graphical display processing component (1) has a fault, and according to the redundancy mode, the multi-window graphical display processing component (1) with the highest priority obtains control right to replace the multi-window graphical display processing component (1); 6) When the first state information reported by a certain multi-channel display video monitoring and switching selection component (2) indicates that there is an input fault, the display control and multi-window management component (12) in each multi-window graphical display processing component (1) with a fault processing condition selects the multi-window graphical display processing component (1) with the highest priority to obtain control right preferentially. 7) When n multi-window graphics display processing components (1) cannot complete panoramic graphics processing via multi-path display video monitoring and switching selection components (2) to multi-channel fault-tolerant ultra-wide screen display components (3) for display, the display control and multi-window management components (12) in each multi-window graphics display processing component (1) select the multi-window graphics display processing component (1) with the highest priority to obtain control priority, and the display control and multi-window management components (12) directly input externally input display data to the graphics synthesis components (15) and then transmit the data through the remaining video processing channels in the k video processing channels.

2. The super-wide screen redundant graphics display processing apparatus according to claim 1, wherein If the first state information and the second state information reflect that there is a fault in the video display channel of each multi-path display video monitoring and switching selection component (2) and the multi-channel fault-tolerant ultra-wide screen display component (3), the multi-window graphics display processing component (1) adjusts the man-machine interactive window on the corresponding area graphics to the area graphics that is not affected.

3. The super-wide screen redundant graphics display processing apparatus according to claim 1, wherein When the state information reported by a multi-path display video monitoring and switching selection component (2) to the multi-window graphics display processing component (1) indicates that there is an input fault, if there is an internal fault of a multi-window graphics display processing component (1) or a fault in the video processing channel of a multi-window graphics display processing component (1), the redundant backup mode is entered: At this time, each multi-window graphics display processing component (1) in a normal working state and with a normal video processing channel will perform fault processing, and if there are multiple multi-window graphics display processing components (1) with fault processing conditions, the multi-window graphics display processing component (1) with the highest priority obtains control priority.

4. The super-wide screen redundant graphics display processing apparatus according to claim 1, wherein When n multi-window graphics display processing components (1) cannot complete ultra-wide screen panoramic graphics processing via multi-path display video monitoring and switching selection components (2) to multi-channel fault-tolerant ultra-wide screen display components (3) for display, the system will lose the ultra-wide screen panoramic graphics display function and needs to enter the fault reconstruction mode: The multi-window graphics display processing component (1) directly transmits externally input display data through the remaining video processing channels in the k video processing channels.

5. The super-wide screen redundant graphics display processing apparatus according to claim 1, wherein The window graphics integrity monitoring method of the window graphics integrity monitoring component (14) is as follows: The window graphics display processing component (13) needs to send periodic heartbeat signals, self-detection state information, man-machine interactive windows, and key parameter values used for window graphics processing to the window graphics integrity monitoring component (14); The window graphics integrity monitoring component (14) monitors the window graphics display processing component (13) through the heartbeat signals and detects whether the processing is timed out or stuck; The self-detection state information collection can more comprehensively understand the state of the window graphics display processing component (13) in an abnormal state; the received man-machine interactive windows are monitored, including monitoring whether the address of the window graphics data and the last change have occurred; and the characteristics of the key parameter values used for graphics processing are monitored according to the requirements of the display control and multi-window management components (12), and the integrity of the output graphics of the window graphics display processing component (13) is detected.

6. The superwide redundant graphics display processing apparatus of claim 1, wherein The multi-path display video monitoring and switching selection unit (2) comprises a display video monitoring unit (21), a monitoring interface unit (22) and a display video switching selection unit (23); The display video monitoring unit (21) monitors the state of each input area graph, sends the monitoring state and monitoring result to the monitoring interface unit (22), and directly sends the area graph with normal monitoring result to the display video switching selection unit (23); The monitoring interface unit (22) receives the video switching control information from the multi-window graph display processing unit (1), and sends the monitoring result of the display video monitoring unit (21) and the state information of the video switching selection of the display video switching selection unit (23) to each multi-window graph display processing unit (1); The display video switching selection unit (23) selects the corresponding area graph from the input multi-path area graph according to the video switching control information received by the monitoring interface unit (22), sends the video switching selection result to the monitoring interface unit (22), and sends the abnormal state information to the monitoring interface unit (22) if the switching selection is abnormal.

7. A superwide screen redundant graphics display processing apparatus according to claim 6, wherein The video monitoring method of the display video monitoring unit (21) is as follows: The video monitoring of the display video monitoring unit (21) has three levels, one is the monitoring of the video signal link, whether the signal connection of each input video processing channel is normal, and the open circuit and the open circuit on the electricity are detected; two is the video signal synchronization signal monitoring, the video synchronization signal is decoded from the input area graph, the cycle length and the pulse width length are detected, the detection result is compared with the corresponding channel video standard signal standard defined by the system, if there is no coincidence, the input area graph is determined to be abnormal; three is to detect the auxiliary test information embedded in the area graph.

8. The apparatus of claim 1 wherein The k video display channels of the multi-channel fault-tolerant ultra-wide screen display unit (3) are independent of each other, each video display channel has a separate power supply and electronic components, and each video display channel has physical isolation between each other, and each video display channel corresponds to a display area on the ultra-wide screen and is independent of each other.

Images