Virtual pixel rendering method, data transmission system, control system and electronic device

Abstract

A virtual pixel rendering method, a data transmission system, a control system and an electronic device relate to the field of display technology and solve the problem of display color cast. The method is implemented based on an RGB triangle arrangement structure, in which the sub-pixels in the same column are of the same primary color, and the sub-pixels in the same row are arranged in a circular pattern of three primary colors. Each sub-pixel forms a triangle structure with two adjacent pixels of different primary colors in the previous row, and forms a triangle structure with two adjacent pixels of different primary colors in the next row; each triangle structure is used as a display unit so that each sub-pixel is reused by six display units; the display data of each sub-pixel is the average of the original data of the corresponding pixel point of the sub-pixel in the image source and the corresponding pixel point in the image source in the left and right columns; or it is the weighted average of the original data of the corresponding pixel point of the sub-pixel in the image source and the corresponding pixel point in the image source in the left and right columns. The present invention can be applied to solve the color cast problem in a virtual display device.

Description

Technical Field

[0001] The present invention relates to the field of LED display technology, and in particular to a virtual pixel rendering method, a data transmission system, a control system and an electronic device. Background Art

[0002] Pixel multiplexing technology is an important technology for improving the perceived resolution of LED displays. It makes each sub-pixel light point shared by several virtual pixels around it, similar to the method of smoothing and filtering the original video image data and then downsampling it. It can display images that exceed the physical resolution of the display on the LED display, thereby reducing the pixel spacing, increasing the perceived resolution, and enhancing the display effect.

[0003] The reduction in pixel pitch means higher requirements for display technology and more complex technical problems to be solved. The currently popular triple or quadruple pixel multiplexing technology can break through some lower limits of the pixel pitch design limit, so that the pixel pitch specification of mass-produced LED products can reach P0.4-P0.5. However, the display technology with a pixel pitch below P0.4 is still difficult to achieve with the current multiplexing method, and faces great technical difficulties and challenges.

[0004] In the process of implementing pixel reuse, due to the pixel arrangement and reuse algorithm (no weighted average), the color distortion problem of sharp edges will occur, such as Figure 1 As shown in the figure, since sharp edges contain rich high-frequency information, and the unweighted average reuse algorithm is a very serious smoothing filter, it will filter out the rich high-frequency information contained in the edge part. The information loss leads to edge distortion, which in turn causes color cast. The most serious is the single-pixel white straight line. Based on the different arrangement methods, it will cause different degrees of color cast. Specifically, in the original algorithm, the problem of colored lines occurs because the original reuse algorithm causes the luminance of the edge sub-pixel column to be insufficient. For example, Figure 2 The figure shows a schematic diagram of the existing triple virtual multiplexing method. According to this arrangement and triple virtual multiplexing method, when a white vertical line is to be displayed on the screen, further as shown in FIG. Figure 3 The three white vertical lines shown in the figure are due to the common use of white and black, which means that in each pixel that should originally display white, only the brightness of the sub-pixels in the middle column is full, while the sub-pixels in the left and right columns are only half the brightness because white and black are averaged. Therefore, the color mixing of the three sub-pixels with inconsistent brightness will inevitably fail to produce white, which will lead to color cast problems. Summary of the invention

[0005] In order to solve the problem of display color cast in the existing multiplexing algorithm, the present invention proposes a six-fold virtual rendering algorithm in an RGB triangle arrangement mode.

[0006] The technical solution of the present invention is as follows:

[0007] A virtual pixel rendering method, wherein the virtual pixel rendering method is implemented based on an RGB triangle arrangement structure;

[0008] The RGB triangle arrangement structure is as follows:

[0009] The sub-pixels in the same column are of the same primary color, and the sub-pixels in the same row are arranged in a cyclic pattern of three primary colors. Each sub-pixel forms a triangle structure with two adjacent pixels of different primary colors in the previous row, and a triangle structure with two adjacent pixels of different primary colors in the next row.

[0010] The virtual pixel rendering method is specifically as follows:

[0011] Each of the triangular structures is used as a display unit, so that each sub-pixel is multiplexed by six of the display units;

[0012] Determine the mapping relationship between each sub-pixel and the pixel point of the image source, the display data of each sub-pixel is the average of the original data of the pixel point corresponding to the sub-pixel in the image source and the corresponding pixel points in the image source in one column on its left and right sides; or the display data of each sub-pixel is the weighted average of the original data of the pixel point corresponding to the sub-pixel in the image source and the corresponding pixel points in the image source in one column on its left and two columns on its right.

[0013] Preferably, in the RGB triangle arrangement structure, two adjacent sub-pixels in the same row are spaced 2L apart, two adjacent sub-pixels in the same column are spaced 2L apart, and the row spacing between adjacent rows and the column spacing between adjacent columns are both L.

[0014] Preferably, the weighted average is calculated according to the following formula:

[0015]

[0016] Wherein, C is selected from R, G, B; C' xy represents the display data of the sub-pixel at the xth row and the yth column; C xy Represents the original data of the sub-pixel in the pixel at the xth row and the yth column.

[0017] The present invention also provides a data transmission system, which applies the above-mentioned virtual pixel rendering method. The data transmission system includes a host computer, an HDMI decoding chip, an HDMI encoding chip, a data processing module and a sending card. The host computer is used to send the HDMI video signal to be displayed to the HDMI decoding chip; the HDMI decoding chip is used to decode the HDMI video signal and send the decoded data to the data processing module; the data processing module includes a virtual pixel rendering unit, which is used to perform rendering calculations on each frame of data; the virtual pixel rendering unit internally includes a FIFO memory and a data register, which is used to dynamically store and read out the data after each frame of data arrives to form a data matrix, and then calculate the data in the data register according to the virtual pixel rendering method to obtain sub-pixel display data, and send the sub-pixel display data to the HDMI encoding chip to re-encode it into an HDMI video signal and output it to the sending card.

[0018] Preferably, the decoded data includes a line synchronization signal, a field synchronization signal, an enable signal and RGB grayscale data.

[0019] Preferably, the data processing module is a FPGA processor.

[0020] The present invention also provides a control system, including a receiving card, a driver IC and the above-mentioned data transmission system, wherein the receiving card is used to receive the effective video signal after being boxed by the sending card in the data transmission system, and transmit it to the driver IC after electro-optical conversion and brightness and chromaticity correction to drive the display screen for display.

[0021] The present invention also provides an electronic device, wherein the electronic device comprises the control system.

[0022] Compared with the prior art, the present invention solves the problem of color cast in the existing multiplexing algorithm, and has the following specific beneficial effects:

[0023] 1. The present invention makes use of the gaps in the existing triple virtual algorithm that have no multiplexing, expands the horizontal spacing between sub-pixels to twice that of the triple virtual algorithm, and based on this arrangement structure, multiplexes it 6 times, so that the product can achieve a dot pitch of P0.375 in this case;

[0024] 2. Based on this arrangement, the present invention proposes a new rendering method to supplement the brightness of sub-pixel columns with insufficient brightness, suppress color deviation, and avoid the problem of color cast of single-pixel white lines or black lines in the existing multiplexing method; in conjunction with the data transmission system, it can not only solve the problem of display color cast, but also save the transmission bandwidth between the sending card and the receiving card, the sending card load and the data processing capacity of the receiving card, thereby greatly reducing the cost, reducing the risk of short circuit and making the device easy to maintain. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 A schematic diagram of the color distortion effect of the sharp edge described in the background technology;

[0026] Figure 2 It is a schematic diagram of the triple virtual multiplexing method described in the background technology;

[0027] Figure 3 The sub-pixel brightness display diagram of the three white vertical lines mentioned in the background technology;

[0028] Figure 4 This is a schematic diagram of the RGB triangle arrangement structure described in Example 1;

[0029] Figure 5 Schematic diagram of the virtual pixel rendering method in Example 9;

[0030] Figure 6 Schematic diagram of the virtual pixel rendering method in Example 10. DETAILED DESCRIPTION

[0031] In order to make the technical solution of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the specification of the present invention. It should be noted that the following embodiments are only used to better understand the technical solution of the present invention and should not be understood as a limitation to the present invention.

[0032] Example 1.

[0033] This embodiment provides a virtual pixel rendering method, which is implemented based on an RGB triangle arrangement structure;

[0034] The RGB triangle arrangement structure is as follows Figure 4 As shown, the details are as follows:

[0035] The sub-pixels in the same column are of the same primary color, and the sub-pixels in the same row are arranged in a cyclic pattern of three primary colors. Each sub-pixel forms a triangle structure with two adjacent pixels of different primary colors in the previous row, and a triangle structure with two adjacent pixels of different primary colors in the next row.

[0036] The virtual pixel rendering method is specifically as follows:

[0037] Each of the triangular structures is used as a display unit, so that each sub-pixel is multiplexed by six of the display units;

[0038] Determine the mapping relationship between each sub-pixel and the pixel point of the image source, the display data of each sub-pixel is the average of the original data of the pixel point corresponding to the sub-pixel in the image source and the corresponding pixel points in the image source in one column on its left and right sides; or the display data of each sub-pixel is the weighted average of the original data of the pixel point corresponding to the sub-pixel in the image source and the corresponding pixel points in the image source in one column on its left and two columns on its right.

[0039] Example 2.

[0040] On the basis of Example 1, in the virtual pixel rendering method provided in this embodiment, the weighted average value is calculated specifically according to the following formula:

[0041]

[0042] Wherein, C is selected from R, G, B; C' xy represents the display data of the sub-pixel at the xth row and the yth column; C xy Represents the original data of the sub-pixel in the pixel at the xth row and the yth column.

[0043] Example 3.

[0044] On the basis of Example 1, the virtual pixel rendering method provided in this embodiment has the RGB triangle arrangement structure in which two adjacent sub-pixels in the same row are spaced 2L apart, two adjacent sub-pixels in the same column are spaced 2L apart, and the row spacing between adjacent rows and the column spacing between adjacent columns are both L.

[0045] This embodiment makes use of the gaps that are not reused in the existing triple virtual algorithm, that is, the horizontal spacing between sub-pixels is expanded to twice that of triple virtual, thus obtaining the arrangement we mentioned, and reuses it 6 times, so that the product can achieve a dot pitch of P0.375 in this case. Furthermore, with the support of the new rendering method, the problem of single-pixel white or black line color cast is also avoided.

[0046] Example 4.

[0047] The present embodiment provides a data transmission system, which applies a virtual pixel rendering method in any of the above embodiments. The data transmission system includes a host computer, an HDMI decoding chip, an HDMI encoding chip, a data processing module and a sending card. The host computer is used to send the HDMI video signal to be displayed to the HDMI decoding chip; the HDMI decoding chip is used to decode the HDMI video signal and send the decoded data to the data processing module; the data processing module includes a virtual pixel rendering unit, which is used to perform rendering calculations on each frame of data; the virtual pixel rendering unit internally includes a FIFO memory and a data register, which is used to dynamically store and read out the data after each frame of data arrives to form a data matrix, and then calculate the data in the data register according to the virtual pixel rendering method to obtain sub-pixel display data, and send the sub-pixel display data to the HDMI encoding chip to re-encode it into an HDMI video signal and output it to the sending card.

[0048] The data transmission system of the pixel multiplication display screen provided in this embodiment applies the pixel multiplexing method described in Example 1, which not only solves the color line problem caused by the traditional algorithm, but also realizes virtual processing of data on the transmission path between the host computer and the sending card, saves the transmission bandwidth between the sending card and the receiving card, the sending card load and the data processing capacity of the receiving card, reduces the system's requirements for the sending card and the receiving card, and thus greatly reduces the cost; it also reduces the number of wirings between the sending card and the receiving card in the corresponding display screen control device, so that the wiring inside the device box is regular, reduces the risk of short circuit and is easy to maintain.

[0049] Example 5.

[0050] On the basis of Example 4, in the data transmission system provided by this embodiment, the decoded data includes a line synchronization signal, a field synchronization signal, an enable signal and RGB grayscale data.

[0051] Example 6.

[0052] On the basis of Example 4, in the data transmission system provided in this embodiment, the data processing module is an FPGA processor.

[0053] Example 7.

[0054] This embodiment provides a control system, including a receiving card, a driver IC and the data transmission system as described in the above embodiment, wherein the receiving card is used to receive the effective video signal after being boxed by the sending card in the data transmission system, and transmit it to the driver IC after electro-optical conversion and brightness and chromaticity correction to drive the display screen for display.

[0055] Example 8.

[0056] This embodiment provides an electronic device, wherein the electronic device includes the display screen control system described in Embodiment 7.

[0057] Example 9.

[0058] In order to make the technical solution of the present invention clearer, this embodiment further illustrates the following on the basis of the solutions of Embodiments 1 to 8:

[0059] like Figure 5 The RGB triangle arrangement structure is shown in FIG. 1 . It can be seen that the sub-pixels in the same column are of the same primary color, and the sub-pixels in the same row are arranged in a cycle of three primary colors. Each sub-pixel forms a triangle structure with two adjacent pixels of different primary colors in the previous row, and forms a triangle structure with two adjacent pixels of different primary colors in the next row.

[0060] Each of the triangular structures is used as a display unit, so that each sub-pixel is multiplexed by six of the display units;

[0061] Assume that the third column of the original data needs to be displayed in white ( Figure 5 In the figure, the columns numbered 13, 23, 33, and 43 are displayed against a black background. The third column is displayed as white, which means that in the original data, only the third column has all sub-pixel data of 255, and all other pixel data are 0. Then the data in this column that needs to be displayed is the three RBG sub-pixel columns framed by solid and dotted rectangular frames in the figure above, where B is the middle column and RG is the edge column. Under normal circumstances, the brightness of RG is not enough, so color cast will occur.

[0062] In this embodiment, each sub-pixel column is represented by three columns of original data. For example, the blue sub-pixel column in the solid rectangular frame in the middle corresponds to the third column of original data, so its value is displayed by averaging the data of the column on its left and right sides. In other words, the display data of the blue sub-pixel in the third row and fourth column is:

[0063]

[0064] For the two columns on the edge, similar processing is done:

[0065]

[0066]

[0067] For the single-pixel line obtained in this way, the brightness of the third column of sub-pixels R is 1 / 3, the brightness of the fourth column of sub-pixels B is 1 / 3, and the brightness of the fifth column of sub-pixels G is also 1 / 3. Three columns of sub-pixels with the same brightness ratio are used to jointly display a column of white lines in the original data, and the mixed white display can be successfully achieved without color cast.

[0068] Furthermore, when the data transmission system is implemented in hardware, in order to obtain the correct rendering value and provide it to the driver IC through the correct channel for driving the display, since each time a set of RGB data is given to the driver IC, the original data of the center column and the data of the two columns on the left and the two columns on the right are required for calculation, it is necessary to temporarily store the values ​​of the pixel data of 3 rows and 5 columns in the data register. For example, in the example expressed by the above formula, the data rows that need to be temporarily stored are rows 2 / 3 / 4, and the data columns that need to be temporarily stored are columns 1 / 2 / 3 / 4 / 5. It should be noted that since there is no left column in the first column, the blue sub-pixels in this column can be directly averaged using the 123rd column of the original data, the second column of sub-pixels also use the 123rd column of the original data for averaging, and the third column of sub-pixels uses the 234th column of the original data for averaging.

[0069] Example 10.

[0070] In order to make the technical solution of the present invention clearer, this embodiment further illustrates the following on the basis of the solutions of Embodiments 1 to 8:

[0071] like Figure 6 The RGB triangle arrangement structure is shown, the sub-pixels in the same column are of the same primary color, the sub-pixels in the same row are arranged in a cycle of three primary colors, each sub-pixel and two adjacent pixels of different primary colors in the previous row form a triangle structure, and two adjacent pixels of different primary colors in the next row form a triangle structure; each of the triangle structures is used as a display unit, so that each sub-pixel is multiplexed by six of the display units;

[0072] Suppose you want to display the fourth column of the original data ( Figure 6In the figure above, the columns are numbered 14, 24, 34, and 44), and the fourth column is displayed as white against a black background. That is, in the original data, only the fourth column has all sub-pixel data of 255, and all other pixel data are 0. Then the data in this column that needs to be displayed is the four sub-pixel columns BGRB framed by the dotted rectangle in the figure above, where GR is the middle column and the two B columns are edge columns. Under normal circumstances, the brightness of B is not enough, which causes color cast. Therefore, our rendering algorithm at this time is to represent each sub-pixel column with four columns of original data. For example, the middle green sub-pixel column corresponds to the fourth column of original data, so its value is displayed by taking the weighted average of the data of it and the column on its left and the two columns on its right. In other words, the display data of the green sub-pixel in the fourth row and fifth column is:

[0073]

[0074] For the edge columns, similar processing is done:

[0075]

[0076]

[0077] The data calculation method for the remaining sub-pixel columns is similar. For the single-pixel line obtained in this way, the brightness of the 5th / 6th sub-pixel G / R column is 1 / 2, and the brightness of the 4th / 7th sub-pixel B column is 1 / 4. The two middle 1 / 2 brightness GR sub-pixel columns and the two edge 1 / 4 brightness B sub-pixel columns are used to jointly display a column of white lines in the original data. The brightness of the GRB sub-pixels is 1 / 2 of the full brightness, which can successfully display the mixed white without color cast.

[0078] Furthermore, when the data transmission system is implemented in hardware, in order to obtain the correct rendering value and provide it to the driver IC through the correct channel for driving the display, since each time a set of RGB data is given to the driver IC, the original data of the center column and the data of the two columns on the left and the two columns on the right are required for calculation, the values ​​of the pixel data of 3 rows and 6 columns need to be temporarily stored in the data register. For example, in the example expressed by the above formula, the data rows that need to be temporarily stored are the 2nd / 3rd / 4th rows, and the data columns that need to be temporarily stored are the 2nd / 3rd / 4th columns. It should be noted that since there is no left column in the first column, the blue sub-pixels in this column can directly use the 1st / 2nd / 3rd / 4th columns of the original data for averaging, and the second sub-pixel column also uses the 1st / 2nd / 3rd / 4th columns of the original data for averaging. The third sub-pixel column uses the 1st / 2nd / 3rd / 4th columns of the original data for averaging, and the fourth sub-pixel column uses the 2nd / 3rd / 4th columns of the original data for averaging.

[0079] The virtual pixel rendering method and data transmission system proposed in the present invention are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A virtual pixel rendering method, characterized in that: The virtual pixel rendering method is implemented based on the RGB triangle arrangement structure; The RGB triangle arrangement structure is as follows: The sub-pixels in the same sub-pixel column are of the same primary color, and the sub-pixels in the same sub-pixel row are arranged in a cyclic pattern of three primary colors. Each sub-pixel forms a triangle structure with its two adjacent sub-pixels of different primary colors in the previous sub-pixel row, and forms a triangle structure with its two adjacent sub-pixels of different primary colors in the next sub-pixel row; The virtual pixel rendering method is specifically as follows: Each of the triangular structures is used as a display unit, so that each sub-pixel is multiplexed by six of the display units; Determine the mapping relationship between each sub-pixel and the pixel point of the image source, the display data of each column of sub-pixels is the average of the original data of the pixel points of the corresponding column of the sub-pixels in the image source and the corresponding pixel points in the image source in the left and right columns; or the display data of each column of sub-pixels is the weighted average of the original data of the pixel points of the corresponding column of the sub-pixels in the image source and the corresponding pixel points in the image source in the left and right columns.

2. The virtual pixel rendering method according to claim 1, characterized in that: In the RGB triangle arrangement structure, two adjacent sub-pixels in the same sub-pixel row are spaced 2L apart, and two adjacent sub-pixels in the same sub-pixel column are spaced 2L apart. The row spacing between adjacent sub-pixel rows and the column spacing between adjacent sub-pixel columns are both L.

3. The virtual pixel rendering method according to claim 1, characterized in that: The weighted average value is calculated according to the following formula: Wherein, C is selected from R, G, B; C' xy represents the display data of the sub-pixel in the x-th sub-pixel row and the y-th sub-pixel column; C xy Represents the original data of the sub-pixel in the pixel at the xth pixel row and the yth pixel column.

4. A data transmission system, characterized in that: The virtual pixel rendering method described in any one of claims 1 to 3 is applied, and the data transmission system includes a host computer, an HDMI decoding chip, an HDMI encoding chip, a data processing module and a sending card, wherein the host computer is used to send the HDMI video signal to be displayed to the HDMI decoding chip; the HDMI decoding chip is used to decode the HDMI video signal and send the decoded data to the data processing module; the data processing module includes a virtual pixel rendering unit for performing rendering calculations on each frame of data; the virtual pixel rendering unit internally includes a FIFO memory and a data register for dynamically storing and reading data after each frame of data arrives to form a data matrix, and then calculating the data in the data register according to the virtual pixel rendering method to obtain sub-pixel display data, and sending the sub-pixel display data to the HDMI encoding chip for re-encoding into an HDMI video signal output to the sending card.

5. The data transmission system according to claim 4, characterized in that: The decoded data includes a line synchronization signal, a field synchronization signal, an enable signal and RGB grayscale data.

6. The data transmission system according to claim 4, characterized in that: The data processing module is an FPGA processor.

7. A control system, characterized in that: It comprises a receiving card, a driver IC and a data transmission system as described in any one of claims 4 to 6, wherein the receiving card is used to receive the effective video signal after being boxed by the sending card in the data transmission system, and transmit it to the driver IC after electro-optical conversion and brightness and chromaticity correction to drive the display screen for display.

8. An electronic device, characterized in that: The electronic device comprises the control system as claimed in claim 7.

Images