Software computing GPU multi-path drawing method realized based on PSOC

Abstract

The PSOC-based software computing GPU multi-path drawing method is suitable for image display of a multi-path airborne display system, any path of character image is processed by the character image generation module at the PS end and the video generation module at the PL end and is output and displayed on a display of the airborne display system, and the integration level of the system is greatly improved.

Description

Technical Field

[0001] The invention belongs to the technical field of character video image processing and display in a display device, and in particular relates to a software computing GPU multi-channel drawing method based on PSOC. Background Art

[0002] The onboard display system is the window for pilots to obtain flight attitude parameters and control flight control. As important human-machine interface devices, helmet displays, head-up displays, and head-down displays convert flight parameter information into display information to provide intuitive flight guidance for pilots.

[0003] Airborne display systems have the characteristics of customized video formats, multiple video interface forms, and high integration requirements. The video resolution, video timing, and video output interface supported by the hardware GPU platform cannot usually be used directly to drive airborne display devices, but need to be processed through FPGA, which adds additional hardware overhead. The PSOC chip integrates the PS side of the multi-core ARM and the PL side of the programmable logic. Processing video display through the PSOC chip has significant advantages, making the display system hardware highly integrated and occupying a large space. Summary of the invention

[0004] In view of this, the present invention provides a method for software calculation GPU multi-channel drawing based on PSOC implementation. The PS end generates multi-channel character screens through software calculation simulation GPU, and the PL end converts the multi-channel character screens into video stream output, which greatly improves the system integration and has high practical value.

[0005] A method for software computing GPU multi-channel drawing based on PSOC is provided, which is suitable for image display of multi-channel airborne display system. The character image of any channel is processed by the character screen generation module on the PS side and the video generation module on the PL side, and output for display on the display of the airborne display system.

[0006] The technical beneficial effects of the present invention are:

[0007] Taking advantage of the high integration and high flexibility of the PSOC chip, the multi-core ARM on the PS side is used to complete the generation of multi-channel character screens, the logic resources on the PL side are used to complete the generation and encoding output of multi-channel character screen videos, and the hardware architecture solution of a single PSOC chip is used to complete the drawing output of multi-channel character videos. It can also drive display devices with different interfaces, reducing the size of the video processing circuit and improving the integration of the onboard display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0009] Figure 1 It is a schematic diagram of the structure of the software computing GPU multi-channel drawing implemented based on PSOC of the present invention;

[0010] Figure 2 This is a specific embodiment of the software computing GPU multi-channel rendering implemented based on PSOC of the present invention. DETAILED DESCRIPTION

[0011] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0012] The following describes the embodiments of the present disclosure through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all of the embodiments. The present disclosure can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present disclosure.

[0013] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein can be embodied in a wide variety of forms, and any specific structure and / or function described herein is merely illustrative. Based on the present disclosure, it should be understood by those skilled in the art that an aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects described herein can be used to implement the device and / or practice the method. In addition, other structures and / or functionalities other than one or more of the aspects described herein can be used to implement this device and / or practice this method.

[0014] like Figure 1 to Figure 2The software-calculated GPU multi-channel drawing method based on PSOC implementation shown is suitable for image display of multi-channel airborne display systems. Any character image (for example, HUD character screen, bottom display character screen) is processed by the character screen generation module on the PS side and the video generation module on the PL side, and output for display on the airborne display system, that is, a general circuit board drives two displays, thereby improving integration.

[0015] As a specific implementation method provided in this case, the character screen generation module includes a software computing GPU character drawing unit, a video frame buffer unit and a video frame scheduling unit, wherein:

[0016] The software computing GPU character drawing unit is used to complete the symbol drawing of the character image through the software computing GPU for any channel of character image data, and the pixel format of the character screen is Mono 8 or RGB565; generally, the software computing simulation GPU program can choose to run single-core single-thread or dual-core dual-thread;

[0017] The video frame buffer unit is used to store the character image data generated by the software calculation GPU character drawing unit, and is virtualized into three frame buffer areas, for example, a section of uncache space applied in the memory;

[0018] The video frame scheduling unit is used to write the character screen data drawn by the software computing GPU character drawing unit into the video frame buffer unit, wherein the three frame buffer areas adopt a three-frame buffer round-robin scheduling algorithm for cyclic covering sequential storage. For example, each storage area of ​​the three frame buffer areas in the video frame buffer unit is numbered 1, 2, and 3, and the character screen is repeatedly written into the frame buffer area corresponding to the video buffer unit in a cyclic manner in the order of 1-2-3-1.

[0019] As a specific implementation method provided in this case, the video generation module includes a video frame storage reading unit, a pixel format conversion unit, a video timing generation unit, an RGB video stream output unit and a video encoding unit, wherein:

[0020] The video frame storage reading unit is used to read the data in the three frame buffer areas by means of direct memory access (e.g., using a DMA direct access method), and convert the read character screen data into video stream data;

[0021] The pixel format conversion unit is used for format conversion of video stream data and converts it into RGB888 pixel format;

[0022] The video timing generation unit is used to generate pixel clock and timing information required for the video for the format-converted data;

[0023] The RGB video stream output unit is used to generate parallel video in RGB888 format from the pixel clock and timing information and the video stream data of the video frame storage reading unit;

[0024] The video encoding unit is used to convert parallel video into serial video and output it.

[0025] Furthermore, the serial data includes video in LVDS, DVI or ARI NC818 format, and the maximum number of channels supported by multi-channel drawing is the number of ARM cores of the selected PSOC.

[0026] Example

[0027] like Figure 2 As shown, it is used to drive a green head-up display with a DVI interface and a color head-down display with an LVDS interface. The PSOC chip in this embodiment uses FMQL45T900. The two character screens are composed of a character screen generation module on the PS side and a video generation module on the PL side. The character screen generation module is composed of a software computing GPU character drawing unit, a video frame buffer unit, and a video frame scheduling unit; the video generation module is composed of a video frame storage reading unit, a pixel format conversion unit, a video timing generation unit, an RGB video stream output unit, and a video encoding unit. Specifically,

[0028] 1) The software computing GPU character drawing unit completes the character screen drawing by completing the symbol drawing and other processing steps through the soft GPU. In this embodiment, the software computing GPU character drawing unit that drives the head-up display selects dual-thread operation, and the pixel format of the character screen is Mono 8; in this embodiment, the software computing GPU character drawing unit that drives the downward-looking display selects single-thread operation, and the pixel format of the character screen is RGB565; the video frame buffer unit is a section of uncache space applied for in the memory, and it is virtualized into three frame buffer areas.

[0029] 2) The video frame scheduling unit writes the character screen data drawn by the software-calculated GPU character drawing unit into the video frame buffer unit. The writing process adopts a three-frame buffer round-robin scheduling algorithm. The three-frame buffer round-robin scheduling algorithm numbers the three frame buffer areas in the video frame buffer unit as 1, 2, and 3, and writes the character screen into the frame buffer area corresponding to the video buffer unit in the order of 1-2-3-1;

[0030] 3) The video frame storage reading unit reads the data in the frame buffer area through direct memory access (DMA) and converts it into video stream data. The pixel format conversion unit receives the video stream data from the video frame storage reading unit and splices and converts the video stream data into RGB888 pixel format;

[0031] 4) The video timing generation unit generates the pixel clock required for the video and generates the timing information of the video. The RGB video stream output unit receives the video stream data of the pixel format conversion unit and the video timing of the video timing generation unit to generate parallel video in RGB888 format;

[0032] 5) The video encoding unit encodes and outputs the parallel video in RGB888 format. In this embodiment, the video encoding unit driving the head-up display encodes it into a video output in DVI format; in this embodiment, the video encoding unit driving the downward-looking display encodes it into a video output in LVDS format.

[0033] The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present disclosure should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for software computing GPU multi-channel rendering based on PSOC, suitable for image display of multi-channel airborne display system, characterized in that: Any character image is processed by the character screen generation module on the PS side and the video generation module on the PL side, and output for display on the display of the onboard display system.

2. The method according to claim 1, characterized in that The character screen generation module includes a software computing GPU character drawing unit, a video frame buffer unit and a video frame scheduling unit, wherein: The software computing GPU character drawing unit is used to complete the symbol drawing of the character image through the software computing GPU for any channel of character image data, and the pixel format of the character screen is Mono 8 or RGB565; The video frame buffer unit is used to store the character image data generated by the software calculation GPU character drawing unit, and is virtualized into three frame buffer areas; The video frame scheduling unit is used to write the character screen data drawn by the software calculation GPU character drawing unit into the video frame buffer unit, wherein the three frame buffer areas adopt a three-frame buffer round-robin scheduling algorithm for cyclic covering sequential storage.

3. The method according to claim 2, characterized in that The video generation module includes a video frame storage reading unit, a pixel format conversion unit, a video timing generation unit, an RGB video stream output unit and a video encoding unit, wherein: The video frame storage reading unit is used to read the data in the three frame buffer areas by direct memory access, and convert the read character screen data into video stream data; The pixel format conversion unit is used for format conversion of the video stream data to RGB888 pixel format; The video timing generation unit is used to generate pixel clock and timing information required for the video for the format-converted data; The RGB video stream output unit is used to generate parallel video in RGB888 format from the pixel clock and timing information and the video stream data of the video frame storage reading unit; The video encoding unit is used for converting the parallel video into a serial video and outputting the serial video.

4. The method according to claim 3, characterized in that The serial data includes video in LVDS, DVI or ARINC818 format.

5. The method according to claim 4, characterized in that The maximum number of channels supported by multi-channel drawing is the number of ARM cores of the selected PSOC.

6. The method according to claim 5, characterized in that The software calculation simulation GPU program can choose to run on single core single thread or dual core dual thread.

Images