A near real-time display method for graphics compression transmission in airborne display systems

Abstract

This invention discloses a near real-time display method for compressed graphics transmission in an airborne display system, comprising: 1. Dividing a drawing area into multiple sub-drawing areas; 2. Decomposing the current drawing instruction according to the sub-drawing areas, so that the decomposed sub-drawing instructions will only draw within their corresponding sub-drawing areas; 3. Estimating the drawing time required in each sub-drawing area, and determining whether to perform the drawing at the sending end or the receiving display end based on the time complexity of the sub-drawing instruction; 4. Drawing in the sub-drawing area using the corresponding decomposed sub-drawing instructions; 5. Receiving display end receiving the compressed sub-drawing area image data, decompressing it, and restoring the corresponding sub-drawing area image; after receiving all sub-drawing area data and restoring the image, displaying the final image. This invention achieves near real-time compressed graphics transmission and display under low-cost conditions.

Description

Technical Field

[0001] This invention relates to, but is not limited to, the field of graphics display technology in aviation, specifically a near real-time display method for graphics compression and transmission in airborne display systems. Background Technology

[0002] With the development of AR technology, AR technology is becoming increasingly integrated with the aviation industry. Head-up displays (HUDs) and aviation helmet display systems are products of this integration. They can display flight-related information in real time on the helmet's glasses and match it with the real scene to a certain extent, which facilitates the pilot's situational awareness.

[0003] However, since helmet-mounted display systems are wearable devices, they need to be as thin and light as possible. High-performance processors are difficult to use in helmet-mounted display systems due to their high power consumption and heat generation issues. In addition, from a cost perspective, head-mounted display systems require low-power, low-performance processors. However, low-performance processors are insufficient to meet the requirements of graphics rendering. Summary of the Invention

[0004] The purpose of this invention is to solve the above-mentioned technical problems. This invention provides a near real-time display method for graphics compression and transmission in airborne display systems, which solves the problems of high power consumption and heat generation of high-performance processors and low performance of low-performance processors when applying existing processors to helmet display systems.

[0005] The technical solution of the present invention: The embodiments of the present invention provide a near real-time display method for graphics compression transmission in an airborne display system, comprising:

[0006] Step 1: Divide the drawing area into multiple sub-drawing areas;

[0007] Step 2: Decompose the current drawing instruction according to the sub-drawing region so that the decomposed sub-drawing instructions will only draw in the corresponding sub-drawing region, and there will be no situation where a sub-drawing instruction draws in multiple sub-drawing regions.

[0008] Step 3: Estimate the time required for drawing in each sub-drawing area, and decide whether to draw it at the sending end of the display system or to transmit the sub-drawing instructions directly to the receiving display end based on the time complexity of the sub-drawing instructions.

[0009] Step 4: Draw in the sub-drawing area according to the preset order using the corresponding sub-drawing commands after decomposition;

[0010] Step 5: The receiving and displaying end receives the compressed sub-drawing area image data, decompresses it, and restores the corresponding sub-drawing area image; for the sub-drawing instructions directly received from Step 3, it directly draws them; after all sub-drawing area data has been received and the images have been restored, the final image is displayed.

[0011] Optionally, in the near real-time display method for graphics compression transmission for airborne display systems as described above, after estimating the drawing time required for each sub-drawing area in step three, the method further includes:

[0012] If the drawing time of some sub-drawing regions exceeds the sub-region drawing time threshold, these sub-drawing regions are further divided. After division, the process jumps to step two, where the sub-drawing instructions in the sub-drawing regions obtained from the second division are further decomposed. This continues until the drawing time of all sub-drawing regions obtained from the division is less than the sub-region drawing time threshold. Then, the process jumps to step three to determine whether the drawing is performed by the sending end or the receiving end of the display system.

[0013] Optionally, in the near real-time display method for graphics compression transmission in an airborne display system as described above, step three involves estimating the time required for drawing within each sub-drawing area and determining whether the drawing is performed by the sending end or the receiving display end. Specifically, this includes:

[0014] The sub-drawing instructions are categorized into general instructions and special instructions. General instructions are those that are drawn at the sending end, while special instructions are those that are sent to the receiving display end and drawn by the receiving display end.

[0015] The special instruction is a command that determines whether to hand over the drawing to the receiving display end based on the CPU's planar drawing computing power. If the CPU's computing power meets the drawing requirements, the instruction is sent to the receiving display end for drawing; otherwise, the drawing is performed by the sending end.

[0016] Optionally, in the near real-time display method for graphics compression transmission in an airborne display system as described above, step three involves estimating the time required for drawing within each sub-drawing area and determining whether the drawing is performed by the sending end or the receiving display end. Specifically, this includes:

[0017] The decision on whether to draw the final drawing is made by the sending end or the receiving display end, based on the communication time for sending the final drawing and the drawing time of the sub-drawing command.

[0018] If the sum of the time taken for the sending end to send the sub-drawing command and the time taken for the receiving end to draw is greater than the time required for the sending end to draw and compress the data, then the sending end will be chosen to draw and compress the data.

[0019] If the sum of the time taken for the sending end to send the sub-drawing instruction and the time taken to draw the sub-drawing instruction is less than or equal to the time required for the sending end to draw and compress the transmission, then the receiving display end will be used for drawing.

[0020] Optionally, in the graphics compression transmission quasi-real-time display method for airborne display systems described above,

[0021] In step four, while the sending end draws the general instructions, it also transmits the special instructions. The special instructions are transmitted to the receiving display end, which then draws the special instructions.

[0022] Optionally, in the near real-time display method for graphics compression transmission in an airborne display system as described above, step four, which involves drawing in the sub-drawing area using the corresponding sub-drawing instructions after decomposition according to a preset order, includes:

[0023] While drawing the image of the current sub-drawing area, the image of the previously drawn sub-drawing area is compressed and transmitted. The drawing and compression transmission of the sub-drawing area adopts a pipeline operation. The pipeline operation means that while drawing the current sub-drawing area, the data of the previously drawn sub-drawing area is compressed and transmitted to the receiving display end.

[0024] Optionally, in the near real-time display method for graphics compression transmission in an airborne display system as described above, the compression method for the drawing data of the sub-drawing area in step four includes:

[0025] a. Scan the memory region of the image in the current sub-drawing area. Assume that each pixel of the image is stored in RGB sequential order. Initially, record the pixel counter P. count =0, start scanning the sub-drawing area from the first pixel, and scan each pixel P count Add 1,

[0026] b. During the memory region scan in step a, when a pixel with not all RGB values ​​being 0 is found, record the value of P at that time. count Let the value be P. count_A Record the RGB value of the pixel, and let the RGB value of the pixel be P. RGB_A And continue scanning. If the pixel value of N consecutive pixels is P... RGB_A And the value of the (N+1)th pixel is not P. RGB_A At this time, data (P) is generated. count_A ,P RGB_A This set of data (N) is the data set in the compressed data set, and this set of data is recorded.

[0027] c. Repeat step b until all pixels have been scanned. The stored data is the compressed data for the sub-drawing area. Insert the position and size data of the sub-drawing area at the beginning of the compressed data.

[0028] Optionally, in the near real-time display method for graphics compression transmission for airborne display systems described above, the method for decompressing the compressed sub-drawing area image data received by the receiving display end in step five is as follows:

[0029] Read the sub-drawing area information, and then read (P) sequentially. count ,P RGB For data of type N, find the Pth plotting element in the corresponding sub-plot area. count The Pth pixel count The value of N consecutive pixels starting from pixel 1 is set to P. RGB Continue execution until the compressed data for the sub-drawing area has been read.

[0030] Optionally, in the near real-time display method for graphics compression transmission in an airborne display system as described above, step five, which involves directly drawing the sub-drawing instructions received directly from step three, includes:

[0031] After receiving a special instruction, the receiving display end can draw the special instruction in the corresponding sub-drawing area. The drawing of the special instruction on the receiving display end and the drawing of the sub-drawing area corresponding to the special instruction on the sending end are performed in parallel.

[0032] Optionally, in the graphics compression transmission quasi-real-time display method for airborne display systems described above,

[0033] The latency estimation method for the near real-time display method of graphics compression and transmission for airborne display systems is as follows: the latency is estimated by using the sum of the compression and transmission times of the last sub-drawing area.

[0034] The beneficial effects of the present invention are as follows: The embodiments of the present invention provide a near real-time display method for graphics compression transmission in an airborne display system. By segmenting the drawn image, the drawing instructions are decomposed according to the segmented sub-drawing regions. The decomposed sub-drawing instructions will only draw within the corresponding sub-drawing region and will not draw across two or more sub-drawing regions. After the sub-drawing instructions are decomposed, the drawing time of each sub-drawing region is evaluated. For sub-drawing regions with excessive drawing time, iterative operations of segmentation and evaluation are performed again to ensure that the drawing time of each sub-drawing region meets the system latency requirements.

[0035] Using the technical solution provided in this embodiment of the invention, during the drawing process of the sub-drawing area, on the one hand, special instructions are sent to the receiving display end, and the receiving display end directly draws, thereby reducing the latency; on the other hand, during the drawing and compression of the current sub-drawing area at the sending end, the sending of data from the previous sub-drawing area is executed in parallel, and this pipeline operation further reduces the sending latency; furthermore, a special compression design is adopted for the compression and decompression of the sub-drawing area data, which further reduces the system latency. Attached Figure Description

[0036] The accompanying drawings are provided to further understand the technical solutions of the present invention and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of the present invention and do not constitute a limitation on the technical solutions of the present invention.

[0037] Figure 1 A flowchart of a near real-time display method for graphics compression transmission in an airborne display system, provided as an embodiment of the present invention;

[0038] Figure 2 This is a schematic diagram of a sub-drawing area in the near real-time display method for graphics compression transmission in an airborne display system provided in an embodiment of the present invention;

[0039] Figure 3 This is a schematic diagram of the graphics and sub-drawing region division required in the near real-time display method for graphics compression transmission in an airborne display system provided in an embodiment of the present invention. Detailed Implementation

[0040] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, unless otherwise specified, the embodiments and features described in this application can be arbitrarily combined with each other.

[0041] As explained in the background section, when applying existing processors to helmet display systems, high-performance processors suffer from high power consumption and heat generation issues, while low-performance processors have low performance and cannot meet the requirements for graphics rendering.

[0042] Therefore, using an LRU (On-the-Line Replaceable Unit) or similar airborne module in an airborne display system to generate images through graphics processing, and then transmitting the images to a helmet or HUD for display, is a convenient option. Using ultra-high bandwidth communication methods, such as fiber optics, can meet the requirement for real-time image transmission; however, the introduction of fiber optic equipment also increases costs. To address this issue, this invention provides a near-real-time graphics compression transmission method for airborne display systems. Using inexpensive Ethernet equipment, the image generation, transmission, and display methods are optimized, achieving near-real-time graphics compression transmission and display under low-cost conditions. This near-real-time graphics compression transmission method can be applied to, but is not limited to, HUD or aviation helmet systems, achieving near-real-time display of relevant information graphics even with limited computing performance and communication bandwidth.

[0043] The present invention provides the following specific embodiments, which can be combined with each other. For the same or similar concepts or processes, they may not be described again in some embodiments.

[0044] Figure 1 This is a flowchart illustrating a near real-time display method for graphics compression and transmission in an airborne display system, provided as an embodiment of the present invention. Figure 1 As shown, the near real-time display method for graphics compression transmission provided in this embodiment of the invention includes the following steps:

[0045] Step 1: Divide the drawing area into multiple sub-drawing areas;

[0046] In step one of this embodiment of the invention, the drawing sub-region refers to: artificially dividing the drawing area into several sub-drawing areas of the same size. The division of the drawing area into sub-regions can be determined based on both the system's drawing performance and the data transmission speed. Let the drawing be divided into N equal-sized sub-drawing areas, and let the average time required for drawing within each sub-drawing area be approximately T. D The average time used for graphic compression and transmission in the sub-drawing area is T. CT Therefore, the size of the drawing area should be chosen to satisfy T. D Approximately equal to T CT .

[0047] In this embodiment of the invention, it is assumed that the current drawing area size is 640x320 pixels. In this step, the drawing area is divided into four sub-drawing areas, such as... Figure 2 The diagram shown is a schematic representation of a sub-drawing area in a near real-time display method for graphics compression and transmission in an airborne display system provided by an embodiment of the present invention. Figure 2 Each sub-drawing area shown in the diagram is 320x160 pixels in size.

[0048] Step 2: Decompose the current drawing command according to the sub-drawing area so that the decomposed sub-drawing commands will only draw in the corresponding sub-drawing area, and there will be no situation where a certain sub-drawing command is drawn in multiple sub-drawing areas.

[0049] In this embodiment of the invention, the decomposition of drawing instructions within the sub-drawing area in step two means that if a drawing instruction may span multiple sub-drawing areas, the drawing instruction spanning multiple sub-drawing areas is decomposed into multiple sub-drawing instructions. Each sub-drawing instruction will only draw within its corresponding sub-drawing area, ensuring that a certain sub-drawing instruction will not be drawn in multiple sub-drawing areas.

[0050] Figure 3 This is a schematic diagram illustrating the graphics and sub-drawing region divisions required for the near real-time display method for graphics compression transmission in an airborne display system provided in an embodiment of the present invention. In this embodiment, it is assumed that the drawn graphics are as follows: Figure 3 As shown, the initial drawing instructions include three commands: drawing a large circle, drawing a small circle, and drawing a character. These three commands are then decomposed into sub-drawing areas. Sub-drawing area 1 contains commands to draw a small circle and a quarter-circle; sub-drawing area 2 contains commands to draw a quarter-circle; sub-drawing area 3 contains commands to draw a quarter-circle and a character; and sub-drawing area 2 contains commands to draw a quarter-circle.

[0051] Step 3: Estimate the time required for drawing in each sub-drawing area, and determine whether to draw it at the sending end of the display system (e.g., LRU) or to transmit the sub-drawing instruction to the receiving display end (e.g., the glasses end of a HUD or helmet system) based on the time complexity of the sub-drawing instruction.

[0052] In practice, if the drawing time of some sub-drawing areas is greater than the sub-area drawing time threshold, these sub-drawing areas need to be divided again. After division, the process jumps to step two to further decompose the sub-drawing instructions in the sub-drawing areas obtained from the second division. This continues until the drawing time of all sub-drawing areas is less than the sub-area drawing time threshold. Then, the process jumps to step three to determine whether the drawing is performed by the transmitting end (LRU) of the display system or the receiving display end (HUD or the glasses end of the helmet system).

[0053] In step three of this embodiment of the invention, estimating the time required for drawing in each sub-drawing area refers to estimating and accumulating the execution time of the sub-drawing instructions in each sub-drawing area, thereby estimating the time required to draw each sub-area. The time estimation method in this embodiment of the invention adopts an iterative approach to subdivide the sub-areas with excessively long processing times multiple times in order to ultimately meet the requirement of maximum delay.

[0054] For example, in this embodiment of the invention, it is assumed that the execution time of each sub-drawing instruction is 1ms. Then, the drawing time in sub-drawing area 1 is 2ms, the drawing time in sub-drawing area 2 is 1ms, the drawing time in sub-drawing area 3 is 2ms, and the drawing time in sub-drawing area 4 is 1ms.

[0055] It should be noted that the sub-region drawing time threshold in step three of this embodiment refers to a pre-given time value, denoted as T. Th Let T be the maximum expected display delay of the system. MaxDelay Then T Th The value of should satisfy the following conditions:

[0056] T Th +T CT <T MaxDelay ;

[0057] In this embodiment of the invention, it is assumed that T MaxDelay The average time used for transmission is T, which is 2ms. CT If it is 0.5ms, then T Th The value can be 1.5ms. However, the drawing time for sub-drawing regions 1 and 3 is greater than 1.5ms, so sub-drawing regions 1 and 3 need to be processed.

[0058] Based on the above example, the further segmentation of the sub-drawing region in step three of this invention refers to the process where the drawing time exceeds the sub-region drawing time threshold T. Th The sub-drawing area is divided into three, four, or N equal parts. The value of N equal parts can be determined according to actual needs or actual experimental results.

[0059] In practice, sub-drawing region 1 is further divided into equal segments, resulting in an image as shown below. Figure 3 As shown, the divided sub-regions are denoted as sub-drawing region 1-1 and sub-drawing region 1-2. Obviously, the sub-drawing instruction on sub-drawing region 1-1 is to draw a small circle, while the drawing instruction on sub-drawing region 1-2 is to draw a quarter-circle. The drawing time of these two sub-drawing regions 1-1 and 1-2 both meet the requirements.

[0060] In one implementation of the present invention, step three involves estimating the time required for drawing within each sub-drawing area and determining whether the drawing is performed by the sending end or the receiving display end. This can be achieved using the following two methods:

[0061] Method 1: Instructions are categorized based on time complexity, into general instructions and special instructions. The special instructions can be assigned to the receiving display (HUD or helmet system) for drawing based on the CPU's planar graphics processing capabilities. If the CPU's processing power is strong, the instructions can be sent to the receiving display for drawing; otherwise, the sending end will handle the drawing.

[0062] Method Two: The decision of whether to perform the drawing on the sending end or the receiving display end is based on the communication time for sending the final drawn graphic and the drawing time of the instruction. Specifically, if the sum of the time taken by the sending end to send the sub-drawing instruction and the time taken by the receiving display end to draw is greater than the time required for the sending end to draw and compress the transmission, then the sending end is chosen to draw and compress the transmission; otherwise, the latter is not used. These sub-drawing instructions typically include drawing instructions for characters or specific symbols. These symbols can be pre-stored on the receiving display end. The sending end only needs to send information such as the sub-region's location, size, and the symbol's type, position, color, and whether it is the top layer. The receiving display end can then draw the corresponding graphic based on this information.

[0063] For the two instructions in sub-drawing area 3, the character drawing instruction can be sent in advance as a special instruction. Therefore, sub-drawing area 3 only retains one general instruction for drawing a quarter circle; in addition, its drawing time also meets the requirements.

[0064] Step 4: Draw in the sub-drawing area according to the preset order using the corresponding sub-drawing commands after decomposition.

[0065] The specific drawing method in step four is as follows: while drawing the current sub-drawing area image, the image of the previously drawn sub-drawing area is compressed and transmitted. The drawing and compression transmission of the sub-drawing area adopts a pipeline operation, that is, while drawing the current sub-drawing area, the data of the previously drawn sub-drawing area is compressed and transmitted to the receiving display end (such as the glasses end of the HUD or helmet system).

[0066] like Figure 3The diagram shows the segmentation of the sub-drawing regions. The drawing and sending order is sub-drawing region 1-1, sub-drawing region 1-2, sub-drawing region 2, sub-drawing region 3, and sub-drawing region 4. First, sub-drawing region 1-1 is drawn, and the data is compressed after drawing. Then, sub-drawing region 1-2 is drawn, and its data is sent simultaneously. Sub-drawing region 2 is drawn, and its data is sent simultaneously. Sub-drawing region 3 is drawn, and its data and special character drawing instructions are sent simultaneously. Sub-drawing region 4 is drawn, and its data is sent simultaneously. Finally, the data for sub-drawing region 4 is sent.

[0067] In step four of this embodiment, the transmission of the sub-drawing region image refers to network transmission, which can be carried out using, but is not limited to, UDP / TCPIP based on Ethernet. In this embodiment, the Ethernet UDP protocol is used to send data.

[0068] In one implementation of this invention, the data compression in step four employs the following method:

[0069] a. Scan the memory area of ​​the image in the current sub-drawing region, assuming that each pixel of the image is stored in RGB order (if other color spaces or orders are used, appropriate modifications should be made). Initially, record the pixel counter P. count =0, start scanning the sub-drawing area from the first pixel, and scan each pixel P count Add 1,

[0070] b. During the memory region scan in step a, when a pixel with not all RGB values ​​being 0 is found, record the value of P at that time. count Let the value be P. count_A Record the RGB value of the pixel, and let the RGB value of the pixel be P. RGB_A And continue scanning. If the pixel values ​​of the next N consecutive pixels are all P... RGB_A And the value of the (N+1)th pixel is not P. RGB_A At this time, data (P) is generated. count_A ,P RGB_A This set of data (N) is the data set in the compressed data set, and this set of data is recorded.

[0071] c. Repeat step b until all pixels have been scanned. The stored data is the compressed data for the sub-drawing area. Insert the position and size data of the sub-drawing area at the beginning of the compressed data.

[0072] Step 5: The receiving and displaying end receives the compressed sub-drawing area image data, decompresses it, and restores the corresponding sub-drawing area image; at the same time, it directly draws the sub-drawing instructions received directly from Step 3. After all sub-area data has been received and the image has been restored, the final image is displayed.

[0073] In step five of this embodiment of the invention, on the one hand, receiving and displaying the compressed sub-drawing area image data and decompressing it means: reading the sub-drawing area information, and then sequentially reading (P) count ,P RGB For data of type N, find the Pth plotting element in the corresponding sub-plot area. count The Pth pixel count The value of N consecutive pixels starting from pixel 1 is set to P. RGB Continue execution until the compressed data for that sub-drawing area has been completely read.

[0074] After receiving the data from the sub-drawing area at the receiving and displaying end, the data is decompressed using the method described above, and then drawn in the corresponding sub-drawing area at the receiving and displaying end.

[0075] On the other hand, the drawing of the special instruction received by the receiving and displaying end in step five means that the receiving and displaying end can draw the special instruction in the corresponding sub-drawing area after receiving the special instruction. The drawing of the special instruction on the receiving and displaying end and the drawing of the sub-drawing area corresponding to the special instruction by the sending end are performed in parallel.

[0076] In practice, if the receiving display terminal receives a special drawing instruction, the special instruction will be drawn in the corresponding sub-drawing area.

[0077] Once the receiving and displaying end has received all the data from all the sub-regions and drawn all the graphics for all the sub-regions, it can display the image on the receiving and displaying end.

[0078] The near real-time display method for graphics compression transmission in an airborne display system provided by this invention segmentes the drawn image and decomposes the drawing instructions according to the segmented sub-drawing regions. The decomposed sub-drawing instructions will only draw within their corresponding sub-drawing regions and will not draw across two or more sub-drawing regions. After the sub-drawing instructions are decomposed, the drawing time of each sub-drawing region is evaluated. For sub-drawing regions with excessive drawing time, iterative operations of segmentation and evaluation are performed again to ultimately ensure that the drawing time of each sub-drawing region meets the system latency requirements.

[0079] Using the technical solution provided in this embodiment of the invention, during the drawing process of the sub-drawing area, on the one hand, special instructions are sent to the receiving display end, and the receiving display end directly draws, thereby reducing the latency; on the other hand, during the drawing and compression of the current sub-drawing area at the sending end, the sending of data from the previous sub-drawing area is executed in parallel, and this pipeline operation further reduces the sending latency; furthermore, a special compression design is adopted for the compression and decompression of the sub-drawing area data, which further reduces the system latency.

[0080] While the embodiments disclosed in this invention are as described above, they are merely illustrative of the embodiments to facilitate understanding of the invention and are not intended to limit the invention. Any person skilled in the art to which this invention pertains may make any modifications and variations in the form and details of the implementation without departing from the spirit and scope disclosed herein; however, the scope of patent protection for this invention shall still be determined by the scope defined in the appended claims.

Claims

1. A method for near real-time display of graphics compression transmission in an airborne display system, comprising: Step 1: Divide the drawing area into multiple sub-drawing areas; Step 2: Decompose the current drawing instruction according to the sub-drawing region so that the decomposed sub-drawing instructions will only draw in the corresponding sub-drawing region, and there will be no situation where a sub-drawing instruction draws in multiple sub-drawing regions. Step 3: Estimate the time required for drawing in each sub-drawing area, and decide whether to draw it at the sending end of the display system or to transmit the sub-drawing instructions directly to the receiving display end based on the time complexity of the sub-drawing instructions. Step 4: Draw in the sub-drawing area according to the preset order using the corresponding sub-drawing commands after decomposition; Step 5: The receiving and displaying end receives the compressed sub-drawing area image data, decompresses it, and restores the corresponding sub-drawing area image; for the sub-drawing instructions directly received from Step 3, it directly draws them; after all sub-drawing area data has been received and the images have been restored, the final image is displayed.

2. The near real-time display method for graphics compression transmission in an airborne display system according to claim 1, characterized in that, After estimating the time required for drawing in each sub-drawing area in step three, the following steps are also included: If the drawing time of some sub-drawing regions exceeds the sub-region drawing time threshold, these sub-drawing regions are further divided. After division, the process jumps to step two, where the sub-drawing instructions in the sub-drawing regions obtained from the second division are further decomposed. This continues until the drawing time of all sub-drawing regions obtained from the division is less than the sub-region drawing time threshold. Then, the process jumps to step three to determine whether the drawing is performed by the sending end or the receiving end of the display system.

3. The near real-time display method for graphics compression transmission in an airborne display system according to claim 1, characterized in that, Step three involves estimating the time required for drawing within each sub-drawing area to determine whether the drawing should be performed by the sending end or the receiving display end. Specifically, this includes: The sub-drawing instructions are categorized into general instructions and special instructions. General instructions are those that are drawn at the sending end, while special instructions are those that are sent to the receiving display end and drawn by the receiving display end. The special instruction is a command that determines whether to hand over the drawing to the receiving display end based on the CPU's planar drawing computing power. If the CPU's computing power meets the drawing requirements, the instruction is sent to the receiving display end for drawing; otherwise, the drawing is performed by the sending end.

4. The near real-time display method for graphics compression transmission in an airborne display system according to claim 1, characterized in that, Step three involves estimating the time required for drawing within each sub-drawing area to determine whether the drawing should be performed by the sending end or the receiving display end. Specifically, this includes: The decision on whether to draw the final drawing is made by the sending end or the receiving display end, based on the communication time for sending the final drawing and the drawing time of the sub-drawing command. If the sum of the time taken for the sending end to send the sub-drawing command and the time taken for the receiving end to draw is greater than the time required for the sending end to draw and compress the data, then the sending end will be chosen to draw and compress the data. If the sum of the time taken for the sending end to send the sub-drawing instruction and the time taken to draw the sub-drawing instruction is less than or equal to the time required for the sending end to draw and compress the transmission, then the receiving display end will be used for drawing.

5. The near real-time display method for graphics compression transmission in an airborne display system according to claim 3, characterized in that, In step four, while the sending end draws the general instructions, it also transmits the special instructions. The special instructions are transmitted to the receiving display end, which then draws the special instructions.

6. The near real-time display method for graphics compression transmission in an airborne display system according to claim 1, characterized in that, Step four involves drawing in the sub-drawing area according to a preset order using the corresponding sub-drawing instructions after decomposition, including: While drawing the image of the current sub-drawing area, the image of the previously drawn sub-drawing area is compressed and transmitted. The drawing and compression transmission of the sub-drawing area adopts a pipeline operation. The pipeline operation means that while drawing the current sub-drawing area, the data of the previously drawn sub-drawing area is compressed and transmitted to the receiving display end.

7. The near real-time display method for graphics compression transmission in an airborne display system according to claim 6, characterized in that, The compression methods for the drawing data of the sub-drawing area in step four include: a. Scan the memory region of the image in the current sub-drawing area, assuming that each pixel of the image is stored in RGB sequential order, and initially record a pixel counter P. count =0, start scanning the sub-drawing area from the first pixel, and scan each pixel P. count Add 1, b. During the memory region scan in step a, when a pixel with not all RGB values ​​being 0 is found, record the value of P at that time. count Let the value be P. count_A Record the RGB value of the pixel, and let the RGB value of the pixel be P. RGB_A And continue scanning. If the pixel value of N consecutive pixels is P... RGB_A And the value of the (N+1)th pixel is not P. RGB_A At this time, data (P) is generated. count_A ,P RGB_A This set of data (N) is the data set in the compressed data set, and this set of data is recorded. c. Repeat step b until all pixels have been scanned. The stored data is the compressed data for the sub-drawing area. Insert the position and size data of the sub-drawing area at the beginning of the compressed data.

8. The near real-time display method for graphics compression transmission in an airborne display system according to claim 7, characterized in that, In step five, the receiving display terminal receives the compressed sub-drawing area image data, and decompresses it in the following way: Read the sub-drawing area information, and then read (P) sequentially. count ,P RGB For data of type N, find the Pth plotting element in the corresponding sub-plot area. count The Pth pixel count The value of N consecutive pixels starting from pixel 1 is set to P. RGB Continue execution until the compressed data for the sub-drawing area has been read.

9. The near real-time display method for graphics compression transmission in an airborne display system according to any one of claims 1 to 8, characterized in that, The estimation method for the near real-time display method of graphics compression and transmission for airborne display systems is as follows: the estimation is made by using the sum of the compression and transmission time of the last sub-drawing area.

Images