A method and system for adaptive panning of RGB-based flat-panel displays

Abstract

The application provides an RGB-based self-adaptive translation flat display picture method and system. By writing the horizontal and pitching deviation into a memory, combining the layout characteristics of the flat display picture, and adjusting the position of the starting point of the distortion correction based on the FPGA, the self-adaptive compensation of the flat display part machining and assembly error is realized without increasing the operation amount and the delay, and the translation process correctness monitoring is performed. The application can be applied to the compensation of the machining and assembly error of the large field of view digital flat display, increases the margin of the flat display part machining and assembly, and further reduces the cost.

Description

Technical Field

[0001] This invention belongs to the field of large field-of-view digital head-up display (HUD) image processing, specifically relating to a method and system for adaptive panning HUD images based on RGB. Background Technology

[0002] A large field-of-view digital head-up display (HUD) comprises electronic and optical components. The electronic components generate the HUD's symbol image, while the optical components collimate and display the symbol image directly in front of the user. To ensure display accuracy, especially for aiming-type HUDs, the center of the symbol image generated by the electronic components should coincide with the center of the optical components. Traditionally, this was achieved by strictly controlling the machining and assembly precision of the HUD components. However, with the increasing application areas and delivery volumes of HUDs, traditional methods are no longer sufficient. Summary of the Invention

[0003] To overcome the shortcomings of existing technologies, this invention provides a method and system for adaptive panning of a head-up display (HUD) screen based on RGB. By writing the horizontal and tilt deviations into memory and combining them with the layout characteristics of the HUD screen, the starting point of distortion correction is adjusted based on FPGA. This achieves adaptive compensation for machining and assembly errors of HUD components without increasing computational load or latency, thereby increasing the margin for machining and assembly of HUD components and further reducing costs.

[0004] A method for adaptive panning and displaying an image based on RGB, characterized by the following steps:

[0005] Step 1: Input and store the translation parameters. Each set of translation parameters includes the azimuth offset △x, the pitch offset △y, and a check value. The highest bits of △x and △y represent the direction of translation, and the check value is the lower 8 bits of the sum of △x and △y.

[0006] Step 2: Starting with the first group, read the translation parameters and check if the verification values ​​are correct. If correct, determine the translation direction based on the highest digit of Δx and Δy, and perform translation correction on the image. Specifically:

[0007] a) If the highest digit of both Δx and Δy is equal to 1, it indicates that both are in the positive direction. The translation calculation is performed according to the following formula:

[0008] (1)

[0009] in, This indicates the corresponding row number in the image after translation. The number of columns is The grayscale value of the pixel. Indicates the interpolation weight in the X direction, 0 ≤ ≤1, Indicates the interpolation weight in the Y direction, 0 ≤ ≤1, ( x , y ) represents a pixel ( x c , y c The corresponding coordinates in the input image before translation; |△x| represents the value of △x after removing the highest bit, and |△y| represents the value of △y after removing the highest bit; the positive direction refers to the same as the video scanning direction, and the negative direction refers to the opposite of the video scanning direction;

[0010] b) If the highest digit of both Δx and Δy is equal to 0, it indicates that both are negative. The translation calculation is performed according to the following formula:

[0011] (2)

[0012] c) If the highest digit of △x is equal to 1 and the highest digit of △y is equal to 0, it means that △x is in the positive direction and △y is in the negative direction. Perform the translation calculation according to the following formula:

[0013] (3)

[0014] d) If the highest digit of △x is equal to 0 and the highest digit of △y is equal to 1, it means that △x is in the negative direction and △y is in the positive direction. Perform the translation calculation according to the following formula:

[0015] (4)

[0016] If the verification values ​​of both sets of translation parameters are incorrect, an error in the translation parameters will be reported, and the image will not be translated.

[0017] Step 3: Assign a value of 255 to the blue channel of the center point of the input image, and a value of 0 to all other pixels. Perform translation calculations using the method in Step 2. and The value is set to 1. Then, the coordinates of the pixel with a blue channel value of 255 after translation calculation are checked. If the difference between its coordinates and the stored center point coordinates is equal to the offset (△x, △y), the translation result is considered to be correct. Otherwise, this step is performed on the next input frame. If the translation result obtained by this step is incorrect for 6 consecutive input frames, the translation parameter error is reported.

[0018] This invention also provides an RGB-based adaptive panning head-up display system, characterized by comprising: an RS422 signal isolation acquisition circuit, a microcontroller minimum system, a memory, a first FPGA minimum system, a second FPGA minimum system, an image source display unit, and a testing and adjustment device; wherein, the testing and adjustment device is used to input panning parameters and ARINC818 video during assembly and testing. After the panning parameters are input through the RS422 signal isolation acquisition circuit, the microcontroller stores them in the memory. The microcontroller reads the panning parameters from the memory and sends them to the second FPGA minimum system. The first FPGA minimum system converts the input ARINC818 video into DVI format and sends it to the second FPGA minimum system. The second FPGA minimum system performs image panning correction according to the panning parameters and converts the panning-corrected image into RGB format for output to the image source for display.

[0019] The beneficial effects of this invention are: by directly embedding the translation algorithm into the distortion correction process, latency is reduced while hardware resources are saved; and by performing translation correctness verification during translation, the correctness of the translation can be guaranteed. This invention can achieve adaptive translation correction of the head-up display screen without increasing computational load or latency, which can increase the margin for error in the processing and assembly of head-up display components and further reduce costs. Attached Figure Description

[0020] Figure 1 This is a schematic diagram of an RGB-based adaptive panning display system according to the present invention.

[0021] Figure 2 This is a schematic diagram of an RS422 signal isolation and acquisition circuit. Detailed Implementation

[0022] The present invention will be further described below with reference to the accompanying drawings and embodiments. The present invention includes, but is not limited to, the following embodiments.

[0023] This invention provides a method and system for adaptive panning and displaying a screen based on RGB, wherein the system is configured as follows: Figure 1 As shown, it includes: an RS422 signal isolation and acquisition circuit, a single-chip microcomputer minimum system, a memory, a first FPGA minimum system, a second FPGA minimum system, an image source display unit, and a testing and adjustment device.

[0024] The testing and commissioning equipment is used to input translation parameters and ARINC818 video during assembly and testing. After the translation parameters are input through the RS422 signal isolation acquisition circuit, the microcontroller stores them in the memory. The microcontroller reads the translation parameters from the memory and sends them to the second FPGA minimum system. The first FPGA minimum system converts the input ARINC818 video into DVI format and sends it to the second FPGA minimum system. The second FPGA minimum system performs image translation correction according to the translation parameters and converts the translated image into RGB format for output to the image source for display.

[0025] The specific implementation method of the RS422 signal isolation acquisition circuit is as follows: Figure 2 As shown, the circuit includes TVS diodes (V1-V6), resistors (R1-R4), capacitors (C1-C4), and common-mode inductors (L1-L2), effectively preventing damage to the circuit from abnormal electrical stresses such as lightning strikes. Communication with the testing equipment uses the RS422 protocol (TX in the diagram represents transmitting, and RX represents receiving, including positive and negative transmit, positive and negative receive, respectively). In specific implementation, the TVS diodes can be Littelfuse SMCJ5.0CA, the resistors can be 10Ω, and the capacitors can be 100pF.

[0026] The specific process of the RGB-based adaptive panning display method is as follows:

[0027] Step 1: Input and store the translation parameters. Each set of translation parameters includes the azimuth offset △x, the pitch offset △y, and a check value. The highest bits of △x and △y represent the direction of translation, and the check value is the lower 8 bits of the sum of △x and △y.

[0028] Step 2: The microcontroller reads the translation parameters from the memory, starting with the first group, and checks if the verification value is correct. The verification method is the same as the storage method used to verify the first group of parameters. If the read parameter verification value matches the calculated verification value, the first group of parameters is used for translation. If the read parameter verification value does not match the calculated verification value, but the read parameter verification value matches the calculated verification value, the second group of parameters is used for translation. If both sets of verification values ​​do not match, an error in the translation parameters is reported through the RS422 signal isolation acquisition circuit, and no image translation is performed.

[0029] The translation correction process involves determining the translation direction based on the highest-order bits of Δx and Δy, and then performing translation correction. This invention embeds the translation algorithm into the distortion correction process. After receiving the translation parameters, the second FPGA minimum system determines the translation direction based on the highest-order bits of Δx and Δy, and then performs translation correction calculations. Specifically:

[0030] a) If the highest digit of both Δx and Δy is equal to 1, it indicates that both are positive. The translation calculation can be performed using the following formula:

[0031] (5)

[0032] in, This indicates the corresponding row number in the image after translation. The number of columns is The grayscale value of the pixel, Indicates the interpolation weight in the X direction, 0 ≤ ≤1, Indicates the interpolation weight in the Y direction, 0 ≤ ≤1, ( x , y ) represents a pixel ( x c , y c The corresponding coordinates in the input image before translation are determined by the specific product's optical system; |△x| represents the value of △x after removing the highest bit, and |△y| represents the value of △y after removing the highest bit; the positive direction refers to the same as the video scanning direction, and the negative direction refers to the opposite of the video scanning direction;

[0033] b) If the highest digit of both Δx and Δy is equal to 0, it indicates that both are negative. The translation calculation is performed according to the following formula:

[0034] (6)

[0035] c) If the highest digit of △x is equal to 1 and the highest digit of △y is equal to 0, it means that △x is in the positive direction and △y is in the negative direction. Perform the translation calculation according to the following formula:

[0036] (7)

[0037] d) If the highest digit of △x is equal to 0 and the highest digit of △y is equal to 1, it means that △x is in the negative direction and △y is in the positive direction. Perform the translation calculation according to the following formula:

[0038] (8)

[0039] Step 3: To ensure the correctness of the translation process, this invention implements a method for monitoring the correctness of the translation process. Currently, the ARINC818 format is commonly used for transmitting video signals between onboard devices. After receiving the ARINC818 video, the head-up display (HUD) needs to convert it to a different video format. The first FPGA minimum system converts it to DVI format and then inputs it to the second FPGA minimum system. Meanwhile, commonly used onboard HUDs are monochrome HUDs, displaying only the green (G) channel of the DVI video.

[0040] The translation monitoring method of this invention involves the first FPGA minimum system assigning a value of 255 to the blue channel of the center point of the input screen and a grayscale value of 0 to other points during video format conversion. Translation calculation is then performed using the method described in step 2. and The value is set to 1. Then, the coordinates of the pixel with a blue channel value of 255 after translation calculation are detected and set to ( x B , y B ),if( x B , y B ) and the coordinates of the stored center point ( x c , y c )satisfy x B - x c =△x、 y B - y c If the result is equal to △y, the translation result is considered correct; otherwise, this step is performed on the next input frame. If the translation result calculated using this method is incorrect for 6 consecutive input frames, an error in the translation parameter is reported.

Claims

1. A method for adaptive panning and displaying an image based on RGB, characterized in that... The steps are as follows: Step 1: Input and store the translation parameters. Each set of translation parameters includes the azimuth offset △x, the pitch offset △y, and a check value. The highest bit of △x and △y represents the direction of translation, and the check value is the lower 8 bits of the sum of △x and △y. Step 2: Starting with the first group, read the translation parameters and check if the verification values ​​are correct. If correct, determine the translation direction based on the highest digit of Δx and Δy, and perform translation correction on the image. Specifically: a) If the highest digit of both Δx and Δy is equal to 1, it indicates that both are in the positive direction. The translation calculation is performed according to the following formula: （1） in, This indicates the corresponding row number in the image after translation. The number of columns is The grayscale value of the pixel. Indicates the interpolation weight in the X direction, 0 ≤ ≤1, Indicates the interpolation weight in the Y direction, 0 ≤ ≤1, ( x , y ) represents a pixel ( x c , y c The corresponding coordinates in the input image before translation; |△x| represents the value of △x after removing the highest bit, and |△y| represents the value of △y after removing the highest bit; the positive direction refers to the same as the video scanning direction, and the negative direction refers to the opposite of the video scanning direction; b) If the highest digit of both Δx and Δy is equal to 0, it indicates that both are negative. The translation calculation is performed according to the following formula: （2） c) If the highest digit of △x is equal to 1 and the highest digit of △y is equal to 0, it means that △x is in the positive direction and △y is in the negative direction. Perform the translation calculation according to the following formula: （3） d) If the highest digit of △x is equal to 0 and the highest digit of △y is equal to 1, it means that △x is in the negative direction and △y is in the positive direction. Perform the translation calculation according to the following formula: （4） If the verification values ​​of both sets of translation parameters are incorrect, an error in the translation parameters will be reported, and the image will not be translated. Step 3: Assign a value of 255 to the blue channel of the center point of the input image, and a value of 0 to all other pixels. Perform translation calculations using the method in Step 2. and The value is set to 1. Then, the coordinates of the pixel with a blue channel value of 255 after translation calculation are checked. If the difference between its coordinates and the stored center point coordinates is equal to the offset (△x, △y), the translation result is considered to be correct. Otherwise, this step is performed on the next input frame. If the translation result obtained by this step is incorrect for 6 consecutive input frames, the translation parameter error is reported.

2. A system employing the RGB-based adaptive panning and tilting display method as described in claim 1, characterized in that... include: The system comprises an RS422 signal isolation acquisition circuit, a microcontroller minimum system, a memory, a first FPGA minimum system, a second FPGA minimum system, an image source display unit, and a testing and adjustment device. The testing and adjustment device is used to input translation parameters and ARINC818 video during assembly and testing. After the translation parameters are input through the RS422 signal isolation acquisition circuit, the microcontroller stores them in the memory. The microcontroller then reads the translation parameters from the memory and sends them to the second FPGA minimum system. The first FPGA minimum system converts the input ARINC818 video into DVI format and sends it to the second FPGA minimum system. The second FPGA minimum system performs image translation correction based on the translation parameters and converts the corrected image into RGB format for output to the image source for display.

Images