Sub-pixel rendering method, device and display device

Through the sub-pixel rendering method, the color offset problem of OLED display panels when realizing high-resolution display is solved. Through inverse gamma conversion and sub-pixel rendering processing, the target grayscale data is generated, the color offset phenomenon is reduced, and the display effect is improved.

CN115588409BActive Publication Date: 2025-07-01BEIJING ESWIN COMPUTING TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211240898.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-11
Publication Date
2025-07-01
Estimated Expiration
2042-10-11

AI Technical Summary

Technical Problem

When the OLED display panel realizes high-resolution display, due to the limitations of the evaporation process and the metal mask plate, a large distance needs to be maintained between the red, green and blue sub-pixels, which makes it difficult to avoid color shifting and reduces the display effect.

Method used

Through a sub-pixel rendering method, the input conversion module, the sub-pixel rendering module and the output conversion module are used to inversely convert the initial gray-scale data of the input image, and perform sub-pixel rendering processing to generate target gray-scale data to reduce color shift phenomenon.

Benefits of technology

By compensating the brightness of the sub-pixel structure, reducing the impact of color shift phenomenon on the display effect, and improving the display effect of the display device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115588409B_ABST
    Figure CN115588409B_ABST
Patent Text Reader

Abstract

The present application discloses a sub-pixel rendering method, apparatus and display device. The apparatus includes: an input conversion module that performs inverse gamma conversion on the initial grayscale data of the input image to obtain and output first luminance data; a sub-pixel rendering module that performs sub-pixel rendering processing on the display panel according to the first luminance data to obtain second luminance data, the second luminance data including the luminance data of the sub-pixel structure in the display panel, the number of the first type of color sub-pixel structures in the display panel being less than the number of the corresponding color sub-pixels in the input image, and the luminance of the first type of color sub-pixel structure being obtained according to the luminance sum of the corresponding multiple first type of color sub-pixels and a compensation coefficient; and an output conversion module that performs gamma conversion on the second luminance data to obtain target grayscale data and provides it to the display panel. In the present application, the luminance of the missing sub-pixel structures is obtained through the luminance sum of the corresponding multiple color corresponding sub-pixels and the compensation coefficient, which can reduce the influence of color deviation on the display effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of display technologies, and in particular, to a sub-pixel rendering method, apparatus, and display device. Background Art

[0002] With the continuous development of display technologies, display panels with high PPI (Pixels Per Inch) have become one of the essential configurations for various display devices. However, when manufacturing an OLED (Organic Light-Emitting Diode) display panel, due to limitations in the evaporation process and the Fine Metal Mask, a relatively large distance needs to be maintained between the red, green, and blue sub-pixels to avoid loss of yield, which makes it difficult for the OLED display panel to achieve high-resolution display.

[0003] To solve the above problems, a method of sharing adjacent sub-pixel structures is often used to reduce the number of sub-pixel structures in the display panel, thereby achieving the effect of simulating high resolution with low resolution. When actually displaying an image, a sub-pixel structure in the display panel "borrows" another color of its adjacent sub-pixel structure to achieve trichromatic display. When the picture is displayed, a color deviation phenomenon will occur due to the absence of some color sub-pixel structures, reducing the display effect of the display device. Summary of the Invention

[0004] To solve the above technical problems, the present application provides a sub-pixel rendering method, apparatus, and display device, which solve the color deviation problem to improve the display effect.

[0005] According to a first aspect of an embodiment of the present application, there is provided a sub-pixel rendering apparatus, including:

[0006] An input conversion module that performs inverse gamma conversion on the initial grayscale data of the input image to obtain and output first luminance data, where the first luminance data includes the luminance data of multiple sub-pixels in the input image;

[0007] A sub-pixel rendering module that performs sub-pixel rendering processing on the display panel according to the first luminance data to obtain second luminance data, where the second luminance data includes the luminance data of multiple sub-pixel structures in the display panel, and the number of the first type of color sub-pixel structures among the multiple sub-pixel structures is less than the number of corresponding color sub-pixels in the input image;

[0008] An output conversion module that performs gamma conversion on the second luminance data to obtain target grayscale data and provides it to the display panel,

[0009] Among them, the brightness of each of the first type of color sub-pixel structures is obtained based on the brightnesses of a plurality of first type of color sub-pixels corresponding thereto and a compensation coefficient.

[0010] Optionally, the sub-pixel rendering module includes:

[0011] An image detection unit that filters the image screen around each of the first type of color sub-pixel structures multiple times, and obtains a compensation coefficient corresponding to each of the first type of color sub-pixel structures based on a plurality of filtering results, and is used to provide the first brightness data and the compensation coefficient; and

[0012] A sub-pixel rendering unit, connected to the image detection unit, obtains a first brightness reference value and a second brightness reference value of each of the first type of color sub-pixel structures based on the brightnesses of a plurality of first type of color sub-pixels corresponding to each of the first type of color sub-pixel structures, and obtains the brightness of the first type of color sub-pixel structures based on the first brightness reference value, the second brightness reference value, and the compensation coefficient.

[0013] Optionally, the sub-pixel rendering unit also obtains the brightness of each of the second type of color sub-pixel structures in the plurality of sub-pixel structures, and the brightness of each of the second type of color sub-pixel structures is the same as the brightness of the second type of color sub-pixels corresponding to the second type of color sub-pixel structures in the input image, where the number of the second type of color sub-pixel structures is equal to the number of the second type of color sub-pixels in the input image.

[0014] Optionally, the first type of color includes red and blue, the second type of color includes green, the number of the red sub-pixel structures is less than the number of red sub-pixels in the input image, the number of the blue sub-pixel structures is less than the number of blue sub-pixels in the input image, and the number of the green sub-pixel structures is equal to the number of green sub-pixels in the input image.

[0015] Optionally, the sub-pixel rendering unit is further configured to determine four pixel units to which four green sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structures belong in the input image, and obtain the brightnesses of four first type of color sub-pixels in the four pixel units, calculate the average value of the brightnesses of the four first type of color sub-pixels to obtain the first brightness reference value, and obtain the second brightness reference value based on the sum of the squares of the brightnesses of the four first type of color sub-pixels and the sum of the brightnesses of the four first type of color sub-pixels.

[0016] Among them, the pixel unit includes a red sub-pixel, a blue sub-pixel, and a green sub-pixel. When the first type of color sub-pixel structure is a red sub-pixel structure, the first type of color sub-pixel is a red sub-pixel; when the first type of color sub-pixel structure is a blue sub-pixel structure, the first type of color sub-pixel is a blue sub-pixel.

[0017] Optionally, the screen detection unit is further configured to preset a plurality of look-up tables corresponding to a plurality of sets of filtering coefficients one by one, filter and normalize the brightness of the first type of color sub-pixels in the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image and the first type of color sub-pixels in the pixel units around the four pixel units under each set of filtering coefficients in a filter to obtain a plurality of filtering results, and obtain the compensation coefficient corresponding to the filtering result with the largest absolute value in the look-up table corresponding to the set of filtering coefficients corresponding to the filtering result with the largest absolute value.

[0018] Optionally, the four pixel units are located in adjacent two rows and adjacent two columns of the input image, and the pixel units around the four pixel units include 8 sets of four pixel units arranged around the four pixel units.

[0019] Optionally, the brightness D of the first type of color sub-pixel structure obtained by the sub-pixel rendering unit is D = M·(1 - s)+N·s, where s is the compensation coefficient, M is the first brightness reference value, and N is the second brightness reference value.

[0020] Optionally, the input conversion module includes:

[0021] An inverse gamma conversion unit that inversely gamma-converts the initial grayscale data of the input image into first brightness data and outputs the current row data converted from the first brightness data to the sub-pixel rendering module; and

[0022] A row buffer connected to the inverse gamma conversion unit to receive the first brightness data and output at least the previous row data of the current row to the sub-pixel rendering module.

[0023] According to a second aspect of the embodiments of the present application, a sub-pixel rendering method is provided, which is applicable to a display panel including a plurality of sub-pixel structures. Among them, it includes:

[0024] Inverse gamma-convert the initial grayscale data of the input image into first brightness data and output it, where the first brightness data includes the brightness data of a plurality of sub-pixels in the input image;

[0025] Performing sub-pixel rendering processing on the display panel according to the first luminance data to obtain second luminance data, where the second luminance data includes the luminance data of the multiple sub-pixel structures, and the number of the first type of color sub-pixel structures in the multiple sub-pixel structures is less than the number of corresponding color sub-pixels in the input image;

[0026] Gamma-converting the second luminance data to target grayscale data and providing it to the display panel,

[0027] wherein, the luminance of each of the first type of color sub-pixel structures is obtained according to the luminance of a plurality of first type of color sub-pixels corresponding thereto and a compensation coefficient.

[0028] Optionally, the step of obtaining the luminance of each of the first type of color sub-pixel structures according to the luminance of a plurality of first type of color sub-pixels corresponding thereto and a compensation coefficient includes:

[0029] Performing multiple filtering on the image frame around each of the first type of color sub-pixel structures, obtaining the compensation coefficient corresponding to each of the first type of color sub-pixel structures according to multiple filtering results, and providing the first luminance data and the compensation coefficient;

[0030] Obtaining a first luminance reference value and a second luminance reference value of each of the first type of color sub-pixel structures according to the luminance of a plurality of first type of color sub-pixels corresponding to each of the first type of color sub-pixel structures;

[0031] Obtaining the luminance of the first type of color sub-pixel structures according to the first luminance reference value, the second luminance reference value, and the compensation coefficient.

[0032] Optionally, further including:

[0033] Obtaining the luminance of each of the second type of color sub-pixel structures in the multiple sub-pixel structures, where the luminance of each of the second type of color sub-pixel structures is the same as the luminance of the second type of color sub-pixels corresponding to the second type of color sub-pixel structures in the input image, and wherein the number of the second type of color sub-pixel structures is equal to the number of the second type of color sub-pixels in the input image.

[0034] Optionally, the first type of color includes red and blue, the second type of color includes green, the number of the red sub-pixel structures is less than the number of red sub-pixels in the input image, the number of the blue sub-pixel structures is less than the number of blue sub-pixels in the input image, and the number of the green sub-pixel structures is equal to the number of green sub-pixels in the input image.

[0035] Optionally, the steps of obtaining the first brightness reference value and the second brightness reference value of each of the first type of color sub-pixel structures according to the brightnesses of the multiple first type of color sub-pixels corresponding to each of the first type of color sub-pixel structures include:

[0036] Determine the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image, and obtain the brightnesses of the four first type of color sub-pixels in the four pixel units;

[0037] Average the brightnesses of the four first type of color sub-pixels to obtain the first brightness reference value; and

[0038] Obtain the second brightness reference value according to the sum of the squares of the brightnesses of the four first type of color sub-pixels and the sum of the brightnesses of the four first type of color sub-pixels,

[0039] Wherein, the pixel unit includes a red sub-pixel, a blue sub-pixel, and a green sub-pixel, and when the first type of color sub-pixel structure is a red sub-pixel structure, the first type of color sub-pixel is a red sub-pixel, and when the first type of color sub-pixel structure is a blue sub-pixel structure, the first type of color sub-pixel is a blue sub-pixel.

[0040] Optionally, the steps of filtering the image frames around each of the first type of color sub-pixel structures multiple times and obtaining the compensation coefficient corresponding to each of the first type of color sub-pixel structures according to the multiple filtering results include:

[0041] Pre-set multiple look-up tables corresponding one-to-one with multiple groups of filtering coefficients;

[0042] Perform filtering processing and normalization calculation of the brightnesses of the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image and the first type of color sub-pixels in the pixel units around the four pixel units in the filters under each group of filtering coefficients to obtain multiple filtering results; and

[0043] Obtain the compensation coefficient corresponding to the filtering result with the largest absolute value in the look-up table corresponding to the group of filtering coefficients corresponding to the filtering result with the largest absolute value.

[0044] Optionally, the four pixel units are located in adjacent two rows and adjacent two columns of the input image, and the pixel units around the four pixel units include 8 groups of four pixel units arranged around the four pixel units.

[0045] Optionally, the brightness D of the first type of color sub-pixel structure is D = M·(1 - s)+N·s, where s is a compensation coefficient, M is a first brightness reference value, and N is a second brightness reference value.

[0046] According to a third aspect of the embodiments of the present application, a display device is provided, including:

[0047] A display panel;

[0048] The sub-pixel rendering device as described above, or a device for performing the sub-pixel rendering method as described above.

[0049] For the sub-pixel rendering method, device, and display device provided by the present application, the brightness of each sub-pixel structure in the display panel where the number of sub-pixel structures corresponding to a color is less than the number of sub-pixels in the input image is obtained according to the brightness of the sub-pixels corresponding to multiple colors and the compensation coefficient, thereby reducing the influence of the color deviation phenomenon on the display effect by compensating the brightness of the sub-pixel structure.

[0050] It should be noted that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. Description of the Drawings

[0051] Figure 1 A schematic diagram showing the sub-pixel rendering method provided by the embodiments of the present application;

[0052] Figure 2 A flowchart showing the sub-pixel rendering method provided by the embodiments of the present application;

[0053] Figure 3 A flowchart showing obtaining the brightness of the first type of color sub-pixel structure in the sub-pixel rendering method provided by the embodiments of the present application;

[0054] Figure 4 Showing Figure 3 A flowchart of step S220;

[0055] Figure 5 Showing Figure 4 A schematic diagram of the positions of four third color sub-pixel structures in step S221;

[0056] Figure 6 Showing Figure 3 A flowchart of step S210;

[0057] Figure 7a Showing Figure 6 A schematic diagram of step S212; Figure 7b Showing Figure 6 A schematic diagram of step S213;

[0058] Figure 8 A schematic structural diagram of a sub-pixel rendering device provided according to an embodiment of the present application is shown. Detailed implementation manners

[0059] To facilitate the understanding of the present application, the present application will be described more comprehensively below with reference to the relevant drawings. Preferred embodiments of the present application are shown in the drawings. However, the present application can be implemented in different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure content of the present application more thorough and comprehensive.

[0060] Figure 1 A schematic diagram of a sub-pixel rendering method provided according to an embodiment of the present application is shown. Figure 2 A schematic flowchart of a sub-pixel rendering method provided according to an embodiment of the present application is shown. Figure 3 A schematic flowchart of obtaining the brightness of a first type of color sub-pixel structure in the sub-pixel rendering method provided according to an embodiment of the present application is shown. Figure 4 Shown Figure 3 A schematic flowchart of step S220 therein is shown. Figure 5 Shown Figure 4 A schematic diagram of the positions of four third color sub-pixel structures in step S221 therein is shown. Figure 6 Shown Figure 3 A schematic flowchart of step S210 therein is shown. Figure 7a Shown Figure 6 A schematic diagram of step S212 therein is shown. Figure 7b Shown Figure 6 A schematic diagram of step S213 therein is shown. Figure 8 A schematic structural diagram of a sub-pixel rendering device provided according to an embodiment of the present application is shown.

[0061] See Figure 1, the arrangement of multiple sub-pixel structures in the display panel is, for example, a diamond arrangement or a quasi-diamond arrangement. The total number of sub-pixel structures in the display panel is, for example, two-thirds of the total number of sub-pixels in the input image to be displayed. Further, the display panel includes a first type of color sub-pixel structure and a second type of color sub-pixel structure. Among them, the number of the first type of color sub-pixel structures is missing compared to the number of sub-pixels of the same color in the input image with RGB three primary color components, and the number of the second type of color sub-pixel structures is not missing compared to the number of sub-pixels of the same color in the input image with RGB three primary color components. Further, the first type of color includes a first color and a second color, and the second type of color includes a third color. That is, the number of the first color sub-pixel structures is less than the number of the first color sub-pixels in the input image, the number of the second color sub-pixel structures is less than the number of the second color sub-pixels in the input image, and the number of the third color sub-pixel structures is equal to the number of the third color sub-pixels in the input image. Specifically, for example, the first color is red, the second color is blue, and the third color is green. Further, the number of red sub-pixel structures in the display panel is one-half of the number of red sub-pixels in the input image to be displayed, the number of blue sub-pixel structures in the display panel is one-half of the number of blue sub-pixels in the input image to be displayed, and the number of green sub-pixel structures in the display panel is the same as the number of green sub-pixels in the input image to be displayed.

[0062] Further, for the arrangement of multiple sub-pixel structures in the display panel in this embodiment, refer to Figure 1 the partial schematic on the right in. For example, all the third color sub-pixel structures are arranged in an array, and all the first color sub-pixel structures and the second color sub-pixel structures are alternately sorted and arranged in an array. That is, the first color sub-pixel structures and the second color sub-pixel structures are alternately arranged in the same sub-pixel structure row, and the first color sub-pixel structures and the second color sub-pixel structures are alternately arranged in the same sub-pixel structure column. And the sub-pixel structure rows containing the first color sub-pixel structures and the second color sub-pixel structures are alternately arranged with the sub-pixel structure rows containing the third color sub-pixel structures, and the sub-pixel structure columns containing the first color sub-pixel structures and the second color sub-pixel structures are alternately arranged with the sub-pixel structure columns containing the third color sub-pixel structures. That is, each pixel unit in the display panel in this embodiment includes two sub-pixel structures, for example, includes a first color sub-pixel structure and a third color sub-pixel structure, or includes a second color sub-pixel structure and a third color sub-pixel structure. When the picture is displayed, the missing third color in a pixel unit is solved by sharing the same color sub-pixel structure in the adjacent pixel unit.

[0063] For the partial schematic of the arrangement of multiple sub-pixels in the input image, please refer to Figure 1The left diagram on the left. That is, the initial grayscale data Data1 of the input image contains the grayscale data of multiple sub-pixels, and the multiple sub-pixels are arranged in an array. Among them, each row contains multiple pixel units, and each pixel unit contains a red sub-pixel R, a green sub-pixel G, and a blue sub-pixel B. As shown in the figure, 4 pixel units arranged in an array are shown in the initial grayscale data Data1, and 4 pixel units are correspondingly shown in the target grayscale data Data2. Since the arrangement method and quantity of the first type of color sub-pixel structure (red sub-pixel structure R and blue sub-pixel structure B) in the display panel are completely different from the arrangement method and quantity of the first type of color sub-pixels in the input image, sub-pixel rendering processing is required to convert the initial grayscale data Data1 to obtain the target grayscale data Data2.

[0064] See Figure 2 , the sub-pixel rendering method includes the following steps:

[0065] Step S100: Inverse gamma convert the initial grayscale data of the input image to obtain the first luminance data and output it. The first luminance data contains the luminance data of multiple sub-pixels in the input image. Further, first, the input initial grayscale data Data1 is converted to the normalized first luminance data by using the degamma conversion method. For example, the grayscale data of each sub-pixel in the initial grayscale data Data1 is converted to luminance data, and the specific conversion process is not described in detail here. Since the grayscale data in the input image does not represent the true luminance, if sub-pixel rendering processing is performed according to the grayscale data, color bleeding will occur, resulting in inaccurate target grayscale data Data2. Further, see Figure 8 , for example, the initial grayscale data Data1 of the input image is inversely gamma converted row by row through the inverse gamma conversion unit 411 in the input conversion module 410, and the current row data line-n in the converted first luminance data is directly output to the sub-pixel rendering module 420. And the at least previous row data line-(n-1) of the current row in the first luminance data received from the inverse gamma conversion unit 411 is output to the sub-pixel rendering module 420 through the row buffer 412 in the input conversion module 410.

[0066] Step S200: Perform sub-pixel rendering processing on the display panel according to the first luminance data to obtain the second luminance data. The second luminance data contains the luminance data of multiple sub-pixel structures. Among them, the second luminance data contains the luminance data of each sub-pixel structure in the display panel.

[0067] Step S300: gamma-convert the second brightness data into target grayscale data and provide it to the display panel. Further, the second brightness data is converted into target grayscale data Data2 by using regamma conversion. For example, the brightness data of each sub-pixel structure in the second brightness data is converted into grayscale data. The specific conversion process is not described in detail here. Then, the target grayscale data Data2 is output to the display panel to realize screen display. Figure 8 For example, the output conversion module 430 converts the second brightness data into target grayscale data Data2 using a regamma conversion method and provides the data to the display panel for image display.

[0068] Further, in step S200, since the arrangement mode and quantity of the first type of color sub-pixel structures (red sub-pixel structures R and blue sub-pixel structures B) in the display panel are completely different from the arrangement mode and quantity of the first type of color sub-pixels in the input image, the brightness of each first type of color sub-pixel structure in this embodiment is obtained according to the brightness and compensation coefficient of the corresponding plurality of first type of color sub-pixels. Further, since the arrangement mode and quantity of the second type of color sub-pixel structures (green sub-pixel structures G) in the display panel are the same as the arrangement mode and quantity of the second type of color sub-pixel (green sub-pixel G) in the input image, the brightness of each second type of color sub-pixel structure is the same as the brightness of the second type of color sub-pixel corresponding to the second type of color sub-pixel structure in the input image. Among them, the green sub-pixel array formed by all green sub-pixel structures in the display panel is the same as the array formed by all green sub-pixels in the input image (the number of rows and columns are the same). For example, the green sub-pixel structure G at the first row and first column in the green sub-pixel array in the display panel corresponds to the green sub-pixel G at the first row and first column in the green sub-pixel array in the input image, the green sub-pixel structure G at the second row and second column in the green sub-pixel array in the display panel corresponds to the green sub-pixel G at the second row and second column in the green sub-pixel array in the input image, and so on.

[0069] Further, see Figure 3 The brightness of each first-type color sub-pixel structure is obtained according to the brightness of the corresponding plurality of first-type color sub-pixels and the compensation coefficient, wherein the first-type color sub-pixel structure is a red sub-pixel structure or a blue sub-pixel structure, that is, the brightness of the red sub-pixel structure and the blue sub-pixel structure are obtained in a similar manner. The method for obtaining the brightness of each first-type color sub-pixel structure comprises the following steps:

[0070] Step S210: Filter the image frame around each first-type color sub-pixel structure multiple times, and obtain the compensation coefficient corresponding to each first-type color sub-pixel structure according to the multiple filtering results, and provide first brightness data and compensation coefficient.

[0071] Step S220: Obtain a first luminance reference value and a second luminance reference value for each first - type color sub - pixel structure according to the luminances of a plurality of first - type color sub - pixels corresponding to each first - type color sub - pixel structure.

[0072] Step S230: Obtain the luminance of the first - type color sub - pixel structure according to the first luminance reference value, the second luminance reference value, and a compensation coefficient. Further, the luminance D of the first - type color sub - pixel structure is D = M·(1 - s)+N·s, where s is the compensation coefficient, M is the first luminance reference value, and N is the second luminance reference value.

[0073] Further, the following takes obtaining the luminance of the red sub - pixel structure in the first - type color sub - pixel structure as an example for illustration. Refer to Figure 4 , Step S220 includes the following steps:

[0074] Step S221: Determine the four pixel units to which the four third - color sub - pixel structures with the smallest physical distance from the first - type color sub - pixel structure belong in the input image, and obtain the luminances of the four first - type color sub - pixels in the four pixel units. Further, the red sub - pixels in the input image corresponding to each red sub - pixel structure R in the display panel are: the luminances of the four red sub - pixels in the four pixel units to which the four green sub - pixel structures G with the smallest physical distance from the red sub - pixel structure R belong. Refer to Figure 5 , taking the red sub - pixel structure R at the sub - pixel structure P0 as an example, the four green sub - pixel structures with the smallest physical distance from it are P1, P2, P3, P4. The four pixel units to which P1, P2, P3, P4 belong in the input image have the same arrangement as P1, P2, P3, P4. The luminance of each red sub - pixel in the four units is related to the luminance of the red sub - pixel structure R at the sub - pixel structure P0. Further, when there is only one or two green sub - pixel structures with the smallest physical distance from the first - type color sub - pixel structure in the edge area of the display panel, the luminance of the first - type color sub - pixels corresponding to the insufficient part is defined as 0. Further, the blue sub - pixels in the input image corresponding to each blue sub - pixel structure B in the display panel are: the luminances of the four blue sub - pixels in the four pixel units to which the four green sub - pixel structures G with the smallest physical distance from the blue sub - pixel structure B belong.

[0075] Step S222: Calculate the average value of the luminances of the four first - type color sub - pixels to obtain the first luminance reference value. The first luminance reference value is the average value of the luminances of the above - mentioned four first - type color sub - pixels.

[0076] Step S223: Obtain a second luminance reference value based on the sum of the squares of the luminances of the four first-type color sub-pixels and the sum of the luminances of the four first-type color sub-pixels. Here, the second luminance reference value is the ratio between the sum of the squares of the luminances of the four first-type color sub-pixels and the sum of the luminances of the four first-type color sub-pixels. Since the first luminance reference value is generally lower than the target luminance of the red sub-pixel structure R, and the second luminance reference value is generally higher than the luminance of the red sub-pixel structure R. Therefore, to obtain a better display effect, in this embodiment, the luminance of the red sub-pixel structure R is jointly obtained based on the first luminance reference value, the second luminance reference value, and the compensation coefficient.

[0077] It should be noted that taking the calculation of the sub-pixel structure R corresponding to the white point screen in the input image as an example, for the convenience of description, grayscale data is used here, but in actual calculation, the corresponding luminance data is used here. When the compensation coefficient s is set to 0, the grayscale value of the corresponding sub-pixel structure R is the first luminance reference value M, which is 63. At this time, the grayscale values of the first-type color sub-pixel structures will be on the low side, and under this compensation coefficient, the display effects of the dot screen and the line screen will be overall greenish. If the compensation coefficient s is set to 1, the grayscale value of the corresponding sub-pixel structure R is the second luminance reference value N. At this time, the grayscale values of the first-type color sub-pixel structures will be on the high side, and under this compensation coefficient, the display effects of the dot screen and the line screen will be overall purplish. When the compensation coefficient s is set between 0 and 1, the grayscale values of the first-type color sub-pixel structures can be adjusted to the grayscale values between 63 and 255. Since the number ratios of the color sub-pixel structures at the dot screen and the line screen are different, the value of the compensation coefficient s also needs to be automatically adjusted according to the screen information of the input image.

[0078] Further, referring to Figure 6 , step S220 includes the following steps:

[0079] Step S211: Preset a plurality of look-up tables corresponding to multiple sets of filtering coefficients one by one.

[0080] Step S212: Perform filtering processing and normalization calculation on the luminances of the first-type color sub-pixels in the four pixel units to which the four third-color sub-pixel structures with the smallest physical distance from the first-type color sub-pixel structure belong in the input image and the first-type color sub-pixels in the pixel units around the four pixel units in each set of filtering coefficients in a filter to obtain a plurality of filtering results.

[0081] Step S213: Obtain the compensation coefficient corresponding to the filtering result with the largest absolute value in the look-up table corresponding to the set of filtering coefficients corresponding to the filtering result with the largest absolute value.

[0082] It should be noted that the brightness compensation coefficients corresponding to different types of pictures are different. In order to more accurately determine the compensation coefficients required for each first-type color sub-pixel structure, it is necessary to first analyze the picture type of the area where each first-type sub-pixel structure is located, and then obtain the corresponding compensation coefficients in the corresponding look-up table according to the normalization result of the detection result. See Figure 7a and Figure 7b , for example, three sets of filtering coefficients are respectively set in the filter to obtain three filters with different filtering effects. For example, filter filter1 focuses on the detection of dot pictures in the picture, filter filter2 focuses on the detection of 45° diagonal pictures in the picture, and filter filter3 focuses on the detection of 135° diagonal pictures in the picture. The input image pattern is respectively passed through the three filters to obtain the corresponding filtering results. Further, the brightness data of the same-color sub-pixels in the pixel units related to each first-type color sub-pixel structure in the input image are filtered and normalized in the filters under each set of filtering coefficients to obtain three filtering results. Among them, when the absolute value of the filtering result W_point output from filter filter1 is the largest, the picture type here is a dot picture, and correspondingly, the compensation coefficient corresponding to the filtering result W_point is obtained in the pre-stored look-up table corresponding to the filtering coefficients in filter filter1. When the absolute value of the filtering result W_dp output from filter filter2 is the largest, the picture type here is a 45° diagonal picture, and correspondingly, the compensation coefficient corresponding to the filtering result W_dp is obtained in the pre-stored look-up table corresponding to the filtering coefficients in filter filter2. When the absolute value of the filtering result W_dn output from filter filter3 is the largest, the picture type here is a 135° diagonal picture, and correspondingly, the compensation coefficient corresponding to the filtering result W_dn is obtained in the pre-stored look-up table corresponding to the filtering coefficients in filter filter3. Further, the brightness data of the same-color sub-pixels in the pixel units related to each first-type color sub-pixel structure in the input image, for example, include: the brightness of the first-type color sub-pixels in the four pixel units to which the four green sub-pixel structures with the smallest physical distance from the first-type color sub-pixel structure belong in the input image and the pixel units around the four pixel units. Specifically, the four pixel units are located in two adjacent rows and two adjacent columns of the input image, and the pixel units around the four pixel units include 8 groups of four pixel units arranged around the four pixel units. Each coefficient in each set of filtering coefficients is respectively calculated with the brightness of the same-color sub-pixels in each group of 4 pixel units at the corresponding position and normalized to obtain the corresponding filtering result.

[0083] See Figure 8, the sub-pixel rendering device 400 includes an input gamma conversion module 410, a sub-pixel rendering module 420, and an output gamma conversion module 430.

[0084] The input gamma conversion module 410 inverse gamma-converts the initial grayscale data Data1 of the input image into first luminance data, and the first luminance data includes the luminance data of multiple sub-pixels in the input image. Further, the input gamma conversion module 410 includes an inverse gamma conversion unit 411 and a line buffer 412. The inverse gamma conversion unit 411, for example, inverse gamma-converts the initial grayscale data Data1 of the input image line by line and directly outputs the current line data line-n in the converted first luminance data to the sub-pixel rendering module 420 and the line buffer 412. The line buffer 412 outputs at least the previous line data line-(n-1) of the current line in the first luminance data received from the inverse gamma conversion unit 411 to the sub-pixel rendering module 420. The line buffer 412 can, for example, provide the first i lines of data of the current line to the sub-pixel rendering module 420 according to actual requirements. i is an integer greater than 1 and less than n, and n is an integer greater than 1. The setting of the line buffer 412 can perform rate matching on the inverse gamma conversion unit 411 and the frame detection unit 421 in the sub-pixel rendering module 420, so that the sub-pixel rendering device 400 operates normally.

[0085] The sub-pixel rendering module 420 performs sub-pixel rendering processing on the display panel according to the first luminance data to obtain second luminance data, and the second luminance data includes the luminance data of multiple sub-pixel structures in the display panel. Further, the sub-pixel rendering module 420 includes a frame detection unit 421 and a sub-pixel rendering unit 422. The frame detection unit 421 is connected to the inverse gamma conversion unit 411 and the line buffer 412, filters the image frames around each first-type color sub-pixel structure multiple times, and obtains a compensation coefficient s corresponding to each first-type color sub-pixel structure according to multiple filtering results, and is used to provide the first luminance data and the compensation coefficient s. Further, for example, it is used to provide the current line data line-n and at least the previous line data line-(n-1) of the inverse gamma conversion in the first luminance data. The sub-pixel rendering unit 422 is connected to the frame detection unit 421, obtains a first luminance reference value and a second luminance reference value of each first-type color sub-pixel structure according to the luminance of multiple first-type color sub-pixels corresponding to each first-type color sub-pixel structure, and obtains the luminance of the first-type color sub-pixel structure according to the first luminance reference value, the second luminance reference value, and the compensation coefficient. Further, the sub-pixel rendering unit 422 also obtains the luminance of each second-type color sub-pixel structure in the multiple sub-pixel structures, and the luminance of each second-type color sub-pixel structure is the same as the luminance of the second-type color sub-pixels corresponding to the second-type color sub-pixel structure in the input image. Further, the sub-pixel rendering unit 422 is also used to determine the four pixel units to which the four green sub-pixel structures with the smallest physical distance from the first-type color sub-pixel structure belong in the input image, obtain the luminance of the four first-type color sub-pixels in the four pixel units, calculate the average value of the luminance of the four first-type color sub-pixels to obtain the first luminance reference value, and obtain the second luminance reference value according to the sum of the squares of the luminance of the four first-type color sub-pixels and the sum of the luminance of the four first-type color sub-pixels. Wherein, the pixel unit includes a red sub-pixel, a blue sub-pixel, and a green sub-pixel. When the first-type color sub-pixel structure is a red sub-pixel structure, the first-type color sub-pixel is a red sub-pixel, and when the first-type color sub-pixel structure is a blue sub-pixel structure, the first-type color sub-pixel is a blue sub-pixel. The luminance D of the first-type color sub-pixel structure obtained by the sub-pixel rendering unit 422 is D = M·(1 - s) + N·s, where s is the compensation coefficient, M is the first luminance reference value, and N is the second luminance reference value.Further, the screen detection unit 421 is further configured to preset a plurality of look-up tables corresponding to multiple sets of filtering coefficients one by one, filter and perform normalization calculation on the brightness of the first type of color sub-pixels in the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image and the pixel units around the four pixel units in each set of filtering coefficients of the filter to obtain a plurality of filtering results, and obtain a compensation coefficient corresponding to the filtering result with the largest absolute value in the look-up table corresponding to the set of filtering coefficients corresponding to the filtering result with the largest absolute value. Further, the four pixel units are located in adjacent two rows and adjacent two columns of the input image, and the pixel units around the four pixel units include 8 sets of four pixel units arranged around the four pixel units.

[0086] The output gamma conversion module 430 gamma-converts the second luminance data into target grayscale data Data2 and outputs it to the display panel. Further, for example, the regamma conversion method is used to convert the second luminance data into the target grayscale data Data2. For example, the luminance data of each sub-pixel structure in the second luminance data is converted into grayscale data, and the specific conversion process is not described in detail here.

[0087] The embodiment of the present application further provides a display device, including the sub-pixel rendering device described above, or a device for performing the above sub-pixel rendering method.

[0088] It should be noted that the numerical values in this article are only for illustrative purposes. In other embodiments of the present application, other numerical values can also be sampled to implement this solution, and specific settings should be made reasonably according to the current situation. The present application does not limit this.

[0089] Finally, it should be noted that: Obviously, the above embodiments are only examples for clearly explaining the present application, and are not limitations on the implementation manners. For those of ordinary skill in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to enumerate all the implementation manners here. And the obvious changes or modifications derived therefrom are still within the protection scope of the present application.

[0090] It should also be understood that the terms and expressions used in this article are only for description, and one or more embodiments of this specification should not be limited to these terms and expressions. Using these terms and expressions does not mean excluding any equivalent features of the illustration and description (or part of them), and it should be recognized that various modifications that may exist should also be included within the scope of the claims. Other modifications, changes and substitutions may also exist. Accordingly, the claims should be regarded as covering all these equivalents.

Claims

1. A sub-pixel rendering device, wherein, Comprising: An input conversion module that performs inverse gamma conversion on the initial grayscale data of the input image to obtain and output first luminance data, where the first luminance data includes the luminance data of multiple sub-pixels in the input image; A sub-pixel rendering module that performs sub-pixel rendering processing on the display panel according to the first luminance data to obtain second luminance data, where the second luminance data includes the luminance data of multiple sub-pixel structures in the display panel, and the number of the first type of color sub-pixel structures among the multiple sub-pixel structures is less than the number of corresponding color sub-pixels in the input image; An output conversion module that performs gamma conversion on the second luminance data to obtain target grayscale data and provides it to the display panel; The sub-pixel rendering module includes: An image detection unit that filters the image around each of the first type of color sub-pixel structures multiple times, and obtains a compensation coefficient corresponding to each of the first type of color sub-pixel structures according to multiple filtering results, and is used to provide the first luminance data and the compensation coefficient; and A sub-pixel rendering unit connected to the image detection unit, configured to determine four pixel units to which four green sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image, obtain the luminance of four first type of color sub-pixels in the four pixel units, calculate the average value of the luminance of the four first type of color sub-pixels to obtain the first luminance reference value, and obtain the second luminance reference value according to the sum of the squares of the luminance of the four first type of color sub-pixels and the sum of the luminance of the four first type of color sub-pixels. Wherein, the pixel unit includes a red sub-pixel, a blue sub-pixel, and a green sub-pixel. When the first type of color sub-pixel structure is a red sub-pixel structure, the first type of color sub-pixel is a red sub-pixel; when the first type of color sub-pixel structure is a blue sub-pixel structure, the first type of color sub-pixel is a blue sub-pixel, and the luminance of the first type of color sub-pixel structure is obtained according to the first luminance reference value, the second luminance reference value, and the compensation coefficient.

2. The device according to claim 1, wherein, The sub-pixel rendering unit also obtains the luminance of each second type of color sub-pixel structure among the multiple sub-pixel structures, and the luminance of each second type of color sub-pixel structure is the same as the luminance of the second type of color sub-pixel corresponding to the second type of color sub-pixel structure in the input image, where the number of the second type of color sub-pixel structures is equal to the number of second type of color sub-pixels in the input image.

3. The apparatus according to claim 2, wherein The first type of color includes red and blue, the second type of color includes green, the number of red sub-pixel structures is less than the number of red sub-pixels in the input image, the number of blue sub-pixel structures is less than the number of blue sub-pixels in the input image, and the number of green sub-pixel structures is equal to the number of green sub-pixels in the input image.

4. The device according to claim 3, wherein, The screen detection unit is further configured to preset a plurality of look-up tables corresponding to a plurality of sets of filter coefficients one by one, filter and normalize the brightness of the first type of color sub-pixel structures in the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image and the first type of color sub-pixel structures in the pixel units around the four pixel units in a filter under each set of filter coefficients to obtain a plurality of filtering results, and obtain the compensation coefficient corresponding to the filtering result with the largest absolute value in the look-up table corresponding to the set of filter coefficients corresponding to the filtering result with the largest absolute value.

5. The device according to claim 4, wherein, The four pixel units are located in adjacent two rows and adjacent two columns of the input image, and the pixel units around the four pixel units include 8 sets of four pixel units arranged around the four pixel units.

6. The device according to claim 3, wherein The brightness of the first type of color sub-pixel structure obtained by the sub-pixel rendering unit , where s is a compensation coefficient, M is a first brightness reference value, and N is a second brightness reference value.

7. The apparatus according to claim 1, wherein The input conversion module includes: An inverse gamma conversion unit that inversely gamma-converts the initial grayscale data of the input image into first luminance data and outputs the current row data converted in the first luminance data to the sub-pixel rendering module; and A line buffer connected to the inverse gamma conversion unit to receive the first luminance data and output at least the previous row data of the current row to the sub-pixel rendering module.

8. A sub-pixel rendering method, applicable to a display panel including a plurality of sub-pixel structures, wherein, including: Inverse gamma-converting the initial grayscale data of the input image into first luminance data and outputting the first luminance data including the luminance data of a plurality of sub-pixels in the input image; Performing sub-pixel rendering processing on the display panel according to the first luminance data to obtain second luminance data, the second luminance data including the luminance data of the plurality of sub-pixel structures, and the number of the first type of color sub-pixel structures in the plurality of sub-pixel structures is less than the number of corresponding color sub-pixels in the input image; Gamma-converting the second luminance data into target grayscale data and providing it to the display panel, wherein the luminance of each of the first type of color sub-pixel structures is obtained according to the luminance and compensation coefficient of a plurality of first type of color sub-pixels corresponding thereto, including: Filtering the image screen around each of the first type of color sub-pixel structures multiple times, obtaining the compensation coefficient corresponding to each of the first type of color sub-pixel structures according to multiple filtering results, and providing the first luminance data and the compensation coefficient; Determine the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image, and obtain the brightnesses of the four first type of color sub-pixels in the four pixel units; calculate the average value of the brightnesses of the four first type of color sub-pixels to obtain the first brightness reference value; and obtain the second brightness reference value according to the sum of the squares of the brightnesses of the four first type of color sub-pixels and the sum of the brightnesses of the four first type of color sub-pixels, where the pixel unit includes a red sub-pixel, a blue sub-pixel, and a green sub-pixel, the first type of color sub-pixel is a red sub-pixel when the first type of color sub-pixel structure is a red sub-pixel structure, and the first type of color sub-pixel is a blue sub-pixel when the first type of color sub-pixel structure is a blue sub-pixel structure; Obtain the brightness of the first type of color sub-pixel structure according to the first brightness reference value, the second brightness reference value, and the compensation coefficient.

9. The method according to claim 8, wherein, Further includes: Obtain the brightness of each second type of color sub-pixel structure in the plurality of sub-pixel structures, and the brightness of each second type of color sub-pixel structure is the same as the brightness of the second type of color sub-pixel corresponding to the second type of color sub-pixel structure in the input image, where the number of the second type of color sub-pixel structures is equal to the number of the second type of color sub-pixels in the input image.

10. The method according to claim 9, wherein, The first type of color includes red and blue, the second type of color includes green, the number of red sub-pixel structures is less than the number of red sub-pixels in the input image, the number of blue sub-pixel structures is less than the number of blue sub-pixels in the input image, and the number of green sub-pixel structures is equal to the number of green sub-pixels in the input image.

11. The method according to claim 10, wherein, The step of performing multiple filtering on the image frame around each first type of color sub-pixel structure and obtaining the compensation coefficient corresponding to each first type of color sub-pixel structure according to multiple filtering results includes: Pre-set multiple look-up tables corresponding one-to-one with multiple groups of filtering coefficients; Perform filtering processing and normalization calculation on the brightnesses of the first type of color sub-pixels in the four pixel units to which the four third color sub-pixel structures with the smallest physical distance from the first type of color sub-pixel structure belong in the input image and the pixel units around the four pixel units in each group of filtering coefficients to obtain multiple filtering results; and Obtain the compensation coefficient corresponding to the filtering result with the largest absolute value in the look-up table corresponding to the group of filtering coefficients corresponding to the filtering result with the largest absolute value.

12. The method according to claim 11, wherein, The four pixel units are located in adjacent two rows and adjacent two columns of the input image, and the pixel units around the four pixel units include 8 groups of four pixel units arranged around the four pixel units.

13. The method according to claim 10, wherein, Brightness of the first type of color sub-pixel structure , where s is a compensation coefficient, M is a first brightness reference value, and N is a second brightness reference value.

14. A display device, wherein, Includes: A display panel; The sub-pixel rendering device according to any one of claims 1-7, or a device for performing the sub-pixel rendering method according to any one of claims 8-13.

Citation Information

Patent Citations

  • Pixel structure, display device, pixel driving circuit and display control method

    CN110098240A

  • Sub-pixel rendering method, driving chip and display device

    CN110945582A