Sub-pixel rendering method, display driving apparatus, display apparatus, electronic device, and storage medium

Abstract

The application discloses a sub-pixel rendering method, a display driving device, a display device, an electronic equipment and a storage medium. The sub-pixel rendering method comprises adding an adjustable transient rendering effect between two preset rendering effects. The transient rendering effect is added to make the transition between different display areas in a display picture natural, enhance the edge features of a high-frequency image, improve the fidelity of the display picture, and improve the display effect.

Description

Technical Field

[0001] This invention relates to the field of display, and particularly to a subpixel rendering method, a display driving device, a display device, an electronic device, and a storage medium. Background Technology

[0002] Currently, the common subpixel design for displays is RGB (Red, Green, Blue) or WRGB (White, Red, Green, Blue), where three or four subpixels make up one subpixel for display, and its visual resolution is the same as its physical resolution. However, as customer demands for display quality increase, panel manufacturers need to continuously increase the visual resolution (PPI) of displays. Currently, the common method to improve the physical resolution of displays is to reduce the size of subpixels.

[0003] Digital images typically consist of a number of image pixels, each with a finite number of discrete color values. For example, these color values ​​are grayscale values ​​for the red, green, and blue components of the RGB color space. By driving multiple screen sub-pixels arranged in an array on the display based on the digital image, the digital image can be displayed on the monitor.

[0004] In traditional subpixel-driven displays, one subpixel represents the value of one color component in an image pixel. To increase display resolution, more image pixels need to be displayed, meaning the number of subpixels on the screen needs to be increased. However, due to manufacturing limitations, once the number of subpixels on the screen reaches a certain level, it becomes difficult to increase further, thus hindering further improvements in display resolution.

[0005] Therefore, existing technologies often require displaying high-resolution digital images on low-resolution displays while ensuring the spatial resolution and sharpness of the displayed digital images. To display high-resolution digital images on low-resolution displays, subpixel rendering (SPR) is used. SPR is a method that optimizes the physical properties of the screen and increases the apparent resolution of liquid crystal displays or organic light-emitting diodes through subpixel rendering.

[0006] The current industry practice for subpixel rendering is to set a fixed rendering effect for the display on a single panel. This rendering method can cause unnatural transitions in some display junction areas or display distortion of edge features in high-frequency images, resulting in uneven display and low fidelity of the entire screen. Summary of the Invention

[0007] The purpose of this invention is to provide a subpixel rendering method, a display driver, a display device, an electronic device, and a storage medium. By increasing the transient rendering effect, the transition between different display areas in the display screen becomes more natural, and the edge features of high-frequency images can be enhanced to improve the fidelity of the display screen.

[0008] To solve the above problems, the present invention is achieved through the following technical solution:

[0009] A subpixel rendering method includes: adding an adjustable transient rendering effect between two preset rendering effects.

[0010] Optionally, the transient rendering effect is the weighted sum of any two rendering effects.

[0011] Optionally, the two rendering effects include a first rendering effect and a second rendering effect. The first rendering effect is applied to a first preset spatial frequency image, and the second rendering effect is applied to a second preset spatial frequency image with a frequency higher than that of the first preset spatial frequency image. Specifically, a boundary detection circuit detects the target spatial frequency of the target boundary of any pattern, compares the target spatial frequency with the second preset spatial frequency, and if the target spatial frequency matches the second preset spatial frequency, the second rendering effect is executed; otherwise, the transient rendering effect obtained by the weighted sum of the first and second rendering effects is executed. Alternatively, the two rendering effects include a third rendering effect and a fourth rendering effect. The third rendering effect is located in the first display area of ​​the display panel, and the fourth rendering effect is located in the second display area of ​​the display panel. The transient rendering effect obtained by the weighted sum of the third and fourth rendering effects is applied to the boundary region near the intersection of the first and second display areas.

[0012] Optionally, the transient rendering effect matrix of the transient rendering effect is calculated using the following formula:

[0013] (1)

[0014]

[0015]

[0016] in, This represents the transient rendering effect matrix; and All are m x m matrices, where m ≥ 3 and m is an integer; where, This represents one of the rendering effect matrices; Let a represent another rendering effect matrix; a is a first strain factor representing the weight of one of the rendering effect matrices; b is a second strain factor representing the weight of the other rendering effect matrix.

[0017] Optionally, the values ​​of the first strain factor a and the second strain factor b are in the range of 0 to 1.

[0018] Optionally, The matrix representing the first or third rendering effect; The second or fourth rendering effect matrix represents the second or fourth rendering effect, wherein the first strain factor and the second strain factor are calculated using the following formula:

[0019] (2)

[0020] in, This represents the maximum error value of the brightness change matrix corresponding to the sub-pixel matrix; This represents the brightness matrix of the corresponding sub-pixel matrix detected by the boundary detection circuit; This represents the target brightness matrix of the corresponding sub-pixel matrix.

[0021] Optionally, the sub-pixel matrix is ​​obtained, and the value of the middle sub-pixel is compared with the value of the surrounding sub-pixels to obtain the maximum and minimum sub-pixel values. The maximum and minimum sub-pixel values ​​are added together and averaged to obtain the value of the middle sub-pixel. Based on a preset threshold, the values ​​of the middle sub-pixel are expanded upward and downward to form several edge levels.

[0022] The boundary detection circuit compares the value of each sub-pixel in the sub-pixel matrix with the edge level to obtain the brightness matrix. ;

[0023]

[0024] in, This represents the maximum error value for each brightness value in the brightness variation matrix; n represents the number of elements in the sub-pixel matrix.

[0025] Optionally, the boundary region is a planar rectangle, a planar annulus, a planar elliptical annulus, or a combination of these shapes, or the boundary region is a bent region.

[0026] Optionally, the first boundary area is near the boundary between the reserved screen area and the non-reserved screen area on the display panel, wherein the reserved screen area is the second display area, and the non-reserved screen area is the first display area; or,

[0027] The second type of boundary area is the bending area of ​​the foldable display panel, wherein the areas on both sides of the bending area are the first and second display areas, respectively; or,

[0028] The third type of boundary area is near the boundary between the under-display camera area and the non-under-display camera area, wherein the under-display camera area is the second display area, and the non-under-display camera area is the first display area; or

[0029] The fourth type of boundary area is near the boundary between the fingerprint recognition area and the non-fingerprint recognition area, wherein the fingerprint recognition area is the second display area and the non-fingerprint recognition area is the first display area.

[0030] Optionally, the first type of boundary region is rectangular, wherein, in the boundary region, the direction from the first display area to the second display area is located at the... The first strain factor a and the second strain factor b corresponding to the row are respectively:

[0031] (3)

[0032] in, The count value representing the sub-pixel row or column of the boundary region; The value of y1 ranges from 0 to y1, with the value gradually increasing; y1 represents the total number of sub-pixel rows or columns included in the boundary region.

[0033] Alternatively, in the boundary region, in the direction from the second display area toward the first display area, located at the... The first strain factor a and the second strain factor b corresponding to the row are respectively:

[0034] (4)

[0035] in, The count value representing the sub-pixel row or column of the boundary region; The value of y ranges from 0 to y2, with the value gradually increasing; y2 represents the total number of sub-pixel rows or columns included in the boundary region.

[0036] Optionally, the boundary area includes a first sub-transition area and / or a second sub-transition area, wherein the first sub-transition area is located above or to the left of the second display area, and the second sub-transition area is located below or to the right of the second display area;

[0037] For the first sub-transition region, the first and second strain factors are calculated using the formula (3);

[0038] For the second sub-transition region, the first and second strain factors are calculated using the formula (4).

[0039] Optionally, y1 is equal to y2.

[0040] Optionally, the boundary region is a bend region, and the boundary region includes a first bend transition region and a second bend transition region located on both sides of the center of the boundary region.

[0041] For the first or second bend transition zone, the first and second strain factors, respectively, are as follows: (The original text contains some formatting errors and inconsistencies. A more accurate translation would require the full context.)

[0042] (5)

[0043] In the formula, y3 represents the total number of rows or columns of sub-pixels covered by the first or second bend transition area; hcnt3 represents the count value of the current sub-pixel row or column where the first or second bend transition area is located.

[0044] For the first or second bend transition zone, the first and second strain factors, respectively, are as follows: (The original text contains some formatting errors and inconsistencies. A more accurate translation would require the full context.)

[0045] (6)

[0046] In the formula, y4 represents the total number of rows or columns of sub-pixels covered by the first or second bend transition area; hcnt4 represents the count value of the current sub-pixel row or column where the first or second bend transition area is located.

[0047] Optionally, y3 is equal to y4.

[0048] Optionally, with the center line of the bending region as the center, y3 and y4 change according to the bending angle.

[0049] Optionally, the third type of boundary region is a combination of a rectangular ring and a circular ring, and the first and second strain factors are respectively;

[0050] (7)

[0051] In the formula, β The value ranges from 1 to 0.8. β It is a parameter related to the radius of the circular ring and the width of the rectangular ring, which are combined with the boundary of the rectangular ring and the circular ring formed by the camera area.

[0052] Optionally, the fourth type of boundary region is annular, and the first and second strain factors are respectively;

[0053] (8)

[0054] In the formula, The value ranges from 0 to 1, and α is a parameter related to the radius of the planar circular boundary formed by the fingerprint recognition area.

[0055] Optionally, the formulas for the first and third rendering effects are as follows:

[0056] (9)

[0057] In the formula, R1 represents the first calculation result, and mm represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the j-th sub-pixel in the sub-pixel matrix; This represents the filter coefficient corresponding to the j-th sub-pixel in the first and third rendering filters;

[0058] The formulas for the second and fourth rendering effects are as follows:

[0059] (10)

[0060] In the formula, R2 represents the second calculation result, and mm represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the j-th sub-pixel in the sub-pixel matrix; This represents the filter coefficient corresponding to the j-th sub-pixel in the second and fourth rendering filters.

[0061] Optionally, the first and third rendering effects, the second and fourth rendering effects, or the transient rendering effects include one-dimensional rendering effects or two-dimensional rendering effects.

[0062] Optionally, the sub-pixel includes a red sub-pixel, a blue sub-pixel, or a green sub-pixel.

[0063] Optionally, the rendering formula for the sub-pixel is as follows:

[0064] (11)

[0065] In the formula, R represents the rendering result value of the corresponding color sub-pixel, and n represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the i-th sub-pixel in the sub-pixel matrix; This represents the transient rendering effect corresponding to the i-th sub-pixel in the transient rendering effect.

[0066] On the other hand, the present invention also provides a display driving device for driving a display panel, wherein the display driving device drives the display panel to display an image using the sub-pixel rendering method described above.

[0067] In another aspect, the present invention also provides a display device, comprising: a display panel including sub-pixel repeating units, wherein the sub-pixel repeating units are repeatedly arranged to form the display panel.

[0068] The subpixel repeating unit includes a plurality of subpixels. A display driving device, as described above, is coupled to the display panel to render a display image based on the subpixels.

[0069] In other aspects, the present invention also provides an electronic device including a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, it implements the method described above.

[0070] In other respects, the present invention also provides a readable storage medium storing a computer program, which, when executed by a processor, implements the method described above.

[0071] The present invention has the following technical effects:

[0072] This invention provides a sub-pixel rendering method that adds an adjustable transient rendering effect between two preset rendering effects. This enables a single panel to support more than two rendering effects, thereby making the displayed image more realistic, i.e., improving the display effect / resolution of digital images. Attached Figure Description

[0073] Figure 1a This is a schematic diagram of the sub-pixel rendering method provided in the first embodiment of the present invention;

[0074] Figure 1b This is a schematic diagram of one of the sub-pixel rendering methods provided in the second embodiment of the present invention;

[0075] Figure 1c This is a demonstration of the rendering effect of existing rendering algorithms.

[0076] Figure 2 This is a schematic diagram of a second sub-pixel rendering method provided in the second embodiment of the present invention;

[0077] Figure 3 This is a schematic diagram showing the distribution of the folding area of ​​a foldable screen provided in the second embodiment of the present invention;

[0078] Figure 4 This is a schematic diagram of a sub-pixel rendering method for a foldable screen provided in the second embodiment of the present invention;

[0079] Figure 5 This is a schematic diagram of a third sub-pixel rendering method provided in the second embodiment of the present invention;

[0080] Figure 6This is a schematic diagram of the fourth sub-pixel rendering method provided in the second embodiment of the present invention;

[0081] Figure 7 This is a schematic diagram illustrating one arrangement of subpixels in a display panel.

[0082] Figure 8 This is a schematic diagram illustrating a first or third rendering effect and / or a second or fourth rendering effect provided in an embodiment of the present invention. Detailed Implementation

[0083] The following detailed description, in conjunction with the accompanying drawings and specific embodiments, provides a further detailed explanation of the subpixel rendering method, display driving device, display device, electronic device, and storage medium proposed by the present invention. The advantages and features of the present invention will become clearer from the following description. It should be noted that the drawings are in a very simplified form and use non-precise proportions, used only to facilitate and clearly illustrate the embodiments of the present invention. Please refer to the drawings to make the objectives, features, and advantages of the present invention more apparent and understandable. It should be understood that the structures, proportions, sizes, etc., depicted in the accompanying drawings are only for illustrative purposes to aid those skilled in the art and are not intended to limit the implementation conditions of the present invention. Therefore, they have no substantial technical significance. Any modifications to the structure, changes in proportions, or adjustments to the size, without affecting the effects and objectives achieved by the present invention, should still fall within the scope of the technical content disclosed in the present invention.

[0084] This embodiment provides a subpixel rendering method, including: adding an adjustable transient rendering effect between two preset rendering effects. By adding the transient rendering effect, the transition between different display areas in the displayed image becomes more natural, enhancing the edge features of high-frequency images and improving the fidelity of the displayed image.

[0085] In this embodiment, the transient rendering effect is a weighted sum of the two rendering effects.

[0086] In a preferred embodiment, in the first aspect, as Figure 1a As shown, the two preset rendering effects can include, for example, any first rendering effect A1 (see reference). Figure 1a The display effect of the blank area in the middle) and the second rendering effect A2 (for reference) Figure 1a The display effect of the black line area), the first rendering effect A1 is used for the first preset spatial frequency image (refer to...). Figure 1a The blank area, or the interval area between two adjacent high-frequency image diagonal lines L1, or the interval area between two adjacent high-frequency image horizontal lines L2), the second rendering effect A2 is used for a second preset spatial frequency image with a higher spatial frequency than the first preset spatial frequency image (e.g., Figure 1a Multiple high-frequency image diagonal lines L1, or Figure 1a Multiple high-frequency image horizontal lines L2); wherein, the target boundary of arbitrary pattern (e.g.) is detected by boundary detection circuit. Figure 1a The area where the diagonal line L1 of the mid-to-high frequency image intersects, or Figure 1a The target spatial frequency of the region (the area where the mid-to-high frequency image horizontal line L2 intersects) is compared with the second preset spatial frequency. If the target spatial frequency is consistent with the second preset spatial frequency, the second rendering effect A2 is executed. If they are inconsistent, the transient rendering effect BF1, which is the weighted sum of the first and second rendering effects, is executed.

[0087] Secondly, such as Figure 1b As shown, the two preset rendering effects may include, for example, any third rendering effect A1' and fourth rendering effect A2'. The third rendering effect A1' is located in the first display area DA1 of the display panel, and the fourth rendering effect A2' is located in the second display area DA2 of the display panel. The transient rendering effect BF2, obtained by the weighted sum of the third and fourth rendering effects, is applied to the boundary region BA near the boundary between the first display area DA1 and the second display area DA2. The boundary region BA may include a portion of the pixel rows of the first display area DA1 and the pixel rows of the second display area DA2. The number of pixel rows including the first display area DA1 and the number of pixel rows including the second display area DA2 are preferably equal, but may also be unequal.

[0088] Thirdly, preferably, the transient rendering effects of the first and second aspects mentioned above can be superimposed. For example, based on the second aspect of implementing the transient rendering effect BF2 in the boundary region BA, it can also be applied to any display area (e.g., the attached area). Figure 1b The transient rendering effect BF1 mentioned in the first aspect is applied to any different preset spatial frequency images in the displayed images of the first display area DA1, the second display area DA2, the boundary area BA, etc.

[0089] It should be noted that the first and second rendering effects, the third and fourth rendering effects, and the corresponding filters mentioned in this article refer to the first, second, third, and fourth rendering effects. These terms are only used to distinguish any two preset rendering effects and are not intended to impose any other limitations.

[0090] In this embodiment, the aforementioned transient rendering effect is the weighted sum of any two rendering effects. For example, the transient rendering effect matrices of BF1 and BF2 are calculated using the following formula:

[0091] (1)

[0092]

[0093]

[0094] in, This represents the transient rendering effect matrix; and All are m x m matrices, where m ≥ 3 and m is an integer, preferably m = 3; where, This represents one of the rendering effect matrices; denoted as another rendering effect matrix; a is a first strain factor (or called the first (third) weight factor) representing the weight of one of the rendering effect matrices; b is a second strain factor (or called the second (fourth) weight factor) representing the weight of the other rendering effect matrix.

[0095] In one embodiment, the values ​​of the first strain factor a and the second strain factor b are in the range of 0 to 1.

[0096] Firstly, specifically, for patterns in the image display content that exhibit high and low frequency variations. Figure 1c When the displayed content exhibits high and low frequency variations, using a single filter to adjust the edges of the screen can result in black dots or black holes, as illustrated in the attached image. Figure 1c The high spatial frequency image shown is a diagonal line L1. Existing subpixel rendering methods use an edge detection circuit to detect the target spatial frequency of the pattern. The target spatial frequency is compared with a second preset spatial frequency. If the target spatial frequency matches the second preset spatial frequency, the pattern applies the second rendering filter effect A2; otherwise, it applies the first rendering filter effect A1. Therefore, for the edge regions of the high spatial frequency image, the brightness conditions are insufficient to reach a level higher than the preset brightness conditions, but the second rendering filter effect A2 is still applied, resulting in breakpoints (e.g., breakpoints in the diagonal line L1), causing image distortion. For example... Figure 1c The black dots D on several relatively obvious horizontal lines L2 ot This severely damages the realism of the image display.

[0097] To resolve the above issues, please continue to refer to [the relevant documentation / reference]. Figure 1aAs shown, the first rendering effect A1 is preset for a first preset spatial frequency image, and the second rendering effect A2 is preset for a second preset spatial frequency image with a spatial frequency higher than that of the first preset spatial frequency image. Specifically, the target spatial frequency of the target boundary of any pattern is detected by a boundary detection circuit, and the target spatial frequency is compared with the second preset spatial frequency. If the target spatial frequency matches the second preset spatial frequency, the second rendering effect A2 is executed; otherwise, the transient rendering effect BF1 is executed. (See attached diagram.) Figure 1c In comparison, it is evident that the appendix Figure 1a The displayed images are better and the content is more realistic.

[0098] In this embodiment, the formula (1) above... This represents the first rendering effect matrix of the first rendering effect A1; When representing the second rendering effect matrix of the second rendering effect A2, the first strain factor a and the second strain factor b are calculated using the following formula:

[0099] (2)

[0100] in, This represents the maximum error value of the brightness change matrix corresponding to the sub-pixel matrix; This represents the brightness matrix of the corresponding sub-pixel matrix detected by the boundary detection circuit; This represents the target luminance matrix corresponding to the sub-pixel matrix. The frequency of change in the luminance matrix value represents the target spatial frequency detected by the boundary detection circuit.

[0101] In this embodiment, a sub-pixel matrix is ​​obtained at the edge region of the high-frequency image. The value of the middle sub-pixel is compared with the value of the surrounding sub-pixels to obtain the maximum and minimum sub-pixel values. The maximum and minimum sub-pixel values ​​are added together and averaged to obtain the middle sub-pixel value. Based on a preset threshold, the middle sub-pixel value is expanded upward and downward to form several edge levels.

[0102] The boundary detection circuit compares the value of each sub-pixel in the sub-pixel matrix with the edge level to obtain the brightness matrix. ;

[0103]

[0104] in, This represents the maximum error value for each brightness value in the brightness variation matrix; n represents the number of elements in the sub-pixel matrix.

[0105] Specifically, for example, the edge levels include four levels from low to high: 0, 1, 2, and 3, and the sub-pixel matrix is ​​a 3x3 matrix. =27. The brightness matrix is ​​obtained by comparing each sub-pixel value in the sub-pixel matrix with the edge level. :

[0106]

[0107]

[0108]

[0109] Therefore, using the transient filtering rendering effect BF1 to render the edge areas of high-frequency images can effectively improve the problem of color distortion caused by black spots in these areas, thus improving the realism of the displayed image.

[0110] Optionally, the aforementioned 3x3 pixel matrix array is merely an example; larger pixel matrix arrays, such as a 5x5 pixel array, can also be used. Preferably, the pixel array is a matrix formed by an equal odd number of rows and columns, which ensures a balanced arrangement of the central sub-pixels and surrounding sub-pixels, further improving the rendering effect. Adaptably, the brightness matrix is ​​not limited to the aforementioned 3x3 matrix; the specific matrix size can also be adjusted accordingly.

[0111] Secondly, specifically, the current display page of the display panel can include multiple areas. For example, one area could be a small window area (Local HDR) used to display a portion of the screen image for playing video. When playing video, the small window area (Local HDR) is rendered using the third rendering filter effect A1', while other normal display areas are rendered using the fourth rendering filter effect A2'. However, the boundary area between two display areas may have poor visibility of the embossed edge.

[0112] In this embodiment or some other embodiments, the boundary region may be a planar rectangle, a planar annulus, a planar elliptical annulus, or any combination of the aforementioned shapes, or any other irregularly shaped region. In addition, the boundary region may also be a region formed by bending.

[0113] In view of this, taking the rectangular boundary area as an example, such as Figure 2As shown, in this embodiment, the first type of boundary area (the area indicated by labels BA1 and BA2) is near the boundary between the reserved screen area and the non-reserved screen area on the display panel, wherein the reserved screen area is the second display area DA2, and the non-reserved screen area is the first display area DA1.

[0114] In this embodiment, the formula (1) above is applied. This refers to the third rendering effect matrix of the third rendering effect A1´; This represents the fourth rendering effect matrix of the fourth rendering effect A2´.

[0115] If the direction in which adjacent display areas move from one to the other is defined as perpendicular to the row direction, then the rendering involved uses the row as a reference for changing transient rendering (e.g., Figure 2 The first and second display areas shown are vertically adjacent; if the direction of travel is defined to be perpendicular to the column direction, then the rendering involved uses the column as a reference for changing the transient rendering (e.g., the first and second display areas are horizontally adjacent), and the same applies below.

[0116] At this point, the first strain factor a and the second strain factor b are calculated using the following formula:

[0117] Please continue to refer to this. Figure 2 As shown, the first type of boundary regions BA1 and BA2 are rectangular. In the boundary region BA1, the direction from the first display area DA1 towards the second display area DA2 is located at the... The first strain factor a and the second strain factor b in the applicable formula (1) corresponding to the row are respectively:

[0118] (3)

[0119] in, The count value representing the sub-pixel row or column of the boundary region; The value of y1 ranges from 0 to y1, and the value gradually increases; y1 represents the total number of sub-pixel rows or columns included in the boundary region (if the boundary region is formed in the column direction, then y1 can represent the total number of sub-pixel columns).

[0120] Define the marker Line(X±Y), where X indicates the starting row / column position of the transient rendering on the screen, and Y indicates the boundary area that starts from row N / column and extends in a certain direction from row N to row N±Y / column within the entire display screen. Figure 2 ,4 involves X, which can be N / N´, etc., and Y can be y1, y2, y3, y4, etc.

[0121] like Figure 2 As shown, Line (N+0) indicates that the boundary region BA1 starts from row N in the entire display screen, and Line (N+y1) indicates that the boundary region BA1 ends at row N+y1 in the entire display screen, for a total of y1 rows involving BA1. Specifically, when When a = 0, then a = 1, b = 0. When y = 1, then a = 0, b = 1. Alternatively, please refer to further information. Figure 2 As shown, in the boundary region BA2, in the direction from the second display area DA2 toward the first display area DA1, located at the... The first strain factor a and the second strain factor b of the applicable formula (1) corresponding to the row are respectively:

[0122] (4)

[0123] in, The count value representing the sub-pixel row or column of the boundary region; The value of y ranges from 0 to y2, with the value gradually increasing; y2 represents the total number of sub-pixel rows included in the boundary region (if the boundary region is formed in the column direction, then y2 can represent the total number of sub-pixel columns).

[0124] when When a = 0, then a = 1, b = 0. When y1 = y2, then a = 0, b = 1. Preferably, y1 can be equal to y2. In other embodiments, y1 may not be equal to y2.

[0125] Optionally, the first display areas on both sides of the second display area DA2 can also have different third rendering effects, in which case the above formula (3) or (4) also applies.

[0126] Therefore, Local HDR is a small highlight window. In the area near the boundary between it and other display areas, a transient rendering filter effect is applied to each row (or column) individually. The transient rendering filter effect (transient rendering effect BF2) can reduce the visibility of the embossed edges of the highlight area, making the transition between different display areas more natural.

[0127] Appendix Figure 2The example illustrates a boundary in the row direction, but it is only an example; different display areas can also form boundaries in the column direction. For example, in this embodiment or some other embodiments, the boundary area includes a first sub-transition area and / or a second sub-transition area. The first sub-transition area can be located above or to the left of the second display area to form different boundary areas, and the second sub-transition area can be located below or to the right of the second display area to form different boundary areas. For the first sub-transition area, the first and second strain factors can be calculated according to the specific rendering direction using the formula (3) / (4). For the second sub-transition area, the first and second strain factors can be calculated according to the specific rendering direction using the formula (3) / (4).

[0128] In a preferred embodiment, the boundary region BA can be a bending region formed due to folding or other needs, such as... Figure 3 As shown, the bending area 30 of the existing foldable display panel is rendered using the third rendering filter (third rendering effect A1'), while the remaining area 31 is rendered using the fourth rendering filter (fourth rendering effect A2'). When a common foldable display panel is bent, the bending area 30 has a color distortion problem due to the change in viewing angle.

[0129] In view of this, such as Figure 4 As shown, the second type of boundary area BA is the bending area 30 of the foldable display panel, wherein the areas on both sides of the bending area 30 are the display areas 311.

[0130] In this embodiment, the boundary region BA is a bend region 30. In order to perform accurate sub-pixel rendering of the bend region 30, the boundary region BA is set to include a first bend transition region 301 and a second bend transition region 302 located on both sides with the boundary line 303 (virtual line) of the boundary region as the boundary.

[0131] For the first bending transition zone 301 or the second bending transition zone 302, the first and second strain factors a and b of formula (1) are respectively: (The original text contains some inconsistencies and unclear grammatical structures. A more accurate translation would require the full context.)

[0132] (5)

[0133] In the formula, y3 represents the total number of rows or columns of sub-pixels covered by the first or second bend transition area; hcnt3 represents the count value of the current sub-pixel row or column where the first or second bend transition area is located.

[0134] when When a = 0, then a = 0, b = 1. When y = 3, then a = 1, b = 0.

[0135] For the first bending transition zone 301 or the second bending transition zone 302, the first and second strain factors a and b in formula (1) are respectively: (The original text contains some inconsistencies and unclear grammatical structures. A more accurate translation would require the full context.)

[0136] (6)

[0137] In the formula, y4 represents the total number of rows or columns of sub-pixels covered by the first or second bend transition area; hcnt4 represents the count value of the current sub-pixel row or column where the first or second bend transition area is located.

[0138] when When a = 0, then a = 0, b = 1. When y = 4, then a = 1, b = 0.

[0139] Preferably, y3 is equal to y4.

[0140] In this embodiment, with the center line 303 of the bending area as the center, y3 and y4 are set to change according to the bending angle. Therefore, the rendering effect of the display screen during the folding process can be matched, and even during folding, the quality of the displayed image can be achieved as if it were not folded through this transient rendering effect.

[0141] Therefore, it can be seen that by using a transient rendering filter to render the bending area in this embodiment, the color distortion at the bending angle is reduced and the display quality of the foldable display panel is improved when it is bent.

[0142] like Figure 5 As shown, existing rendering methods typically use the fourth rendering effect A2' for the under-display camera area 41 of the display panel, and the third rendering effect A1' for the non-under-display camera area 40. For example... Figure 6 As shown, the fingerprint recognition area 51 is rendered using the fourth rendering effect A2', while the non-fingerprint recognition area 50 is rendered using the third rendering effect A1'. This results in poor visibility of the burn-in edge near the boundary between the under-display camera area 41 and the non-under-display camera area 40, or near the boundary between the fingerprint recognition area 51 and the non-fingerprint recognition area 50.

[0143] Therefore, please continue to refer to... Figure 5 As shown, when the third type of boundary region BA is near the boundary between the under-display camera region 41 and the non-under-display camera region 40, wherein the under-display camera region 41 is the second display area DA2, and the non-under-display camera region 40 is the first display area DA1, and the third type of boundary region BA is a combination of a rectangular ring and a circular ring (e.g., Figure 5 When the two sides are circular rings and the middle part is a rectangular ring, the first and second strain factors a and b of the formula (1) are respectively:

[0144] (7)

[0145] In the formula, β The value ranges from 1 to 0.8. β It is a parameter related to the radius of the circular ring and the width of the rectangular ring, which are combined with the circular ring formed by the camera area.

[0146] Please continue to refer to this. Figure 6 As shown, in this embodiment, the fourth type of boundary region BA is located near the boundary between the fingerprint recognition region 51 and the non-fingerprint recognition region 50, wherein the fingerprint recognition region 51 is the second display region DA2, and the non-fingerprint recognition region 50 is the first display region DA1. The fourth type of boundary region BA is annular, and the first and second strain factors a and b are respectively;

[0147] (8)

[0148] In the formula, The value ranges from 0 to 1. It is a parameter related to the radius of the planar circular boundary formed by the fingerprint recognition area.

[0149] Therefore, this embodiment can improve the visibility of the embossed edge by using transient rendering effect BF2 near the boundary between the under-display camera area 41 and the non-under-display camera area 40, or near the boundary between the fingerprint recognition area 51 and the non-fingerprint recognition area 50.

[0150] In an optional embodiment of the present invention, the formula for the first (or third) rendering effect is as follows:

[0151] (9)

[0152] In the formula, R1 represents the first (or third) rendering effect, and mm represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the j-th sub-pixel in the sub-pixel matrix; This represents the filter coefficient corresponding to the j-th sub-pixel in the first rendering filter;

[0153] The formula for the second (or fourth) rendering effect is as follows:

[0154] (10)

[0155] In the formula, R2 represents the second (or fourth) rendering effect, and mm represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the j-th sub-pixel in the sub-pixel matrix; This represents the filter coefficient corresponding to the j-th sub-pixel in the second rendering filter.

[0156] In this embodiment, the first (or third) rendering effect, the second (or fourth) rendering effect, or the transient rendering effect includes a one-dimensional rendering effect or a two-dimensional rendering effect.

[0157] For example, Figure 8 As shown, for example, the one-dimensional rendering effect is calculated for horizontal rendering, and the two-dimensional rendering effect...

[0158] The second (fourth) rendering filter includes horizontal rendering calculations and / or vertical rendering calculations; the filter coefficients of the horizontal rendering calculations and / or vertical rendering calculations are determined based on the ratio between the number of sub-pixels contained in a pixel unit and the total number of pixels in the pixel unit.

[0159] Please continue to refer to this. Figure 8 As shown, it displays four pixel units, pixel1 to pixel4. There are 2 red sub-pixels, so the filter coefficient for the red sub-pixels is 2 / 4 = 1 / 2. There are 2 blue sub-pixels, so the filter coefficient for the blue sub-pixels is 2 / 4 = 1 / 2. There are 4 green sub-pixels, so the filter coefficient for the green sub-pixels is 4 / 4 = 1.

[0160] To render a single subpixel, first determine the position of the subpixel to be rendered. Taking the position of the subpixel to be rendered as an example, obtain the positions of its eight surrounding subpixels, forming a 3x3 pixel relative position array. Then, assign corresponding filter coefficients to each subpixel position in this 3x3 pixel relative position array. This yields the rendering matrix for the one-dimensional rendering effect.

[0161]

[0162] The rendering effect matrix for 2D rendering:

[0163]

[0164] In this embodiment, the sub-pixel includes a red sub-pixel, a blue sub-pixel, or a green sub-pixel.

[0165] In this embodiment, the rendering formula for the sub-pixel is as follows:

[0166] (11)

[0167] In the formula, R represents the rendering result value of the corresponding color sub-pixel, and n represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the i-th sub-pixel in the sub-pixel matrix; This represents the transient rendering effect corresponding to the i-th sub-pixel in the transient rendering effect.

[0168] On the other hand, the present invention also provides a display driving device for driving a display panel, wherein the display driving device drives the display panel to display an image using the sub-pixel rendering method described above.

[0169] In another aspect, the present invention also provides a display device, comprising: a display panel including subpixel repeating units, the subpixel repeating units being repeatedly arranged to form the display panel, the subpixel repeating units including a plurality of subpixels; and a display driving device as described above, coupled to the display panel, for rendering a display image based on the subpixels.

[0170] For example, the pixel arrangement of the display panel can be RGBG (diamond) or GGRB, but the present invention is not limited thereto. Figure 7 As shown, the RGBG arrangement is, for example, the subpixel repeating unit shown in the dashed box in the figure. In the same row, the first subpixel repeating unit includes a red subpixel R1 and a green subpixel G1, and the second subpixel repeating unit includes a blue subpixel B2 and a green subpixel G2. In the next row, the first subpixel repeating unit includes a blue subpixel B3 and a green subpixel G3, and the second subpixel repeating unit includes a red subpixel R4 and a green subpixel G4.

[0171] In other aspects, the present invention also provides an electronic device including a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, it implements the method described above.

[0172] In other respects, the present invention also provides a readable storage medium storing a computer program, which, when executed by a processor, implements the method described above.

[0173] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0174] It should be noted that the apparatus and methods disclosed in the embodiments herein can also be implemented in other ways. The apparatus embodiments described above are merely illustrative; for example, the flowcharts and block diagrams in the accompanying drawings show the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments herein. In this regard, each block in a flowchart or block diagram may represent a module, program, or part of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system to perform the specified function or action, or can be implemented using a combination of dedicated hardware and computer instructions.

[0175] In addition, the functional modules in the various embodiments of this article can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0176] Although the present invention has been described in detail through the preferred embodiments above, it should be understood that the above description should not be considered as a limitation of the present invention. Various modifications and substitutions to the present invention will be apparent to those skilled in the art after reading the above description. Therefore, the scope of protection of the present invention should be defined by the appended claims.

Claims

1. A sub-pixel rendering method, characterized by, Add an adjustable transient rendering effect between the two preset rendering effects; The transient rendering effect is the weighted sum of any two rendering effects; The two rendering effects include a first rendering effect and a second rendering effect. The first rendering effect is applied to a first preset spatial frequency image, and the second rendering effect is applied to a second preset spatial frequency image with a spatial frequency higher than that of the first preset spatial frequency image. Specifically, the target spatial frequency of the target boundary of any pattern is detected by a boundary detection circuit, and the target spatial frequency is compared with the second preset spatial frequency. If the target spatial frequency matches the second preset spatial frequency, the second rendering effect is executed; otherwise, the transient rendering effect obtained by the weighted sum of the first and second rendering effects is executed; and / or, The two rendering effects include a third rendering effect and a fourth rendering effect. The third rendering effect is located in the first display area of ​​the display panel, and the fourth rendering effect is located in the second display area of ​​the display panel. The transient rendering effect, obtained by the weighted sum of the third rendering effect and the fourth rendering effect, is applied to the boundary area near the boundary between the first display area and the second display area. The transient rendering effect matrix is ​​calculated using the following formula: （1） in, This represents the transient rendering effect matrix; and All are m x m matrices, where m ≥ 3 and m is an integer; where, This represents one of the rendering effect matrices; denoted as another rendering effect matrix; a represents a first strain factor of the weights of one of the rendering effect matrices; b represents a second strain factor of the weights of the other rendering effect matrix; The values ​​of the first strain factor a and the second strain factor b range from 0 to 1; The matrix representing the first or third rendering effect; The second or fourth rendering effect matrix represents the second or fourth rendering effect, wherein the first strain factor and the second strain factor are calculated using the following formula: （2） in, This represents the maximum error value of the brightness change matrix corresponding to the sub-pixel matrix; This represents the brightness matrix of the corresponding sub-pixel matrix detected by the boundary detection circuit; This represents the target brightness matrix of the corresponding sub-pixel matrix; The sub-pixel matrix is ​​obtained, and the value of the middle sub-pixel is compared with the value of the surrounding sub-pixels to obtain the maximum and minimum sub-pixel values. The maximum and minimum sub-pixel values ​​are added together and averaged to obtain the value of the middle sub-pixel. Based on a preset threshold, the middle sub-pixel value is expanded upward and downward to form several edge levels. The boundary detection circuit compares each sub-pixel value in the sub-pixel matrix to an edge level to obtain the luminance matrix ; wherein, represents the maximum error value of each luminance value in the luminance variation matrix; n represents the number of elements in the sub-pixel matrix.

2. The sub-pixel rendering method of claim 1, wherein, The boundary region is a planar rectangle, a planar annulus, a planar elliptical annulus, or a combination of these shapes, or the boundary region is a bent region.

3. The sub-pixel rendering method as described in claim 2, characterized in that, The first definition refers to the area near the boundary between the reserved screen area and the non-reserved screen area on the display panel, wherein the reserved screen area is the second display area, and the non-reserved screen area is the first display area; or... The second type of boundary area is the bending area of ​​the foldable display panel, wherein the areas on both sides of the bending area are the first and second display areas, respectively; or, The third type of boundary area is near the boundary between the under-display camera area and the non-under-display camera area, wherein the under-display camera area is the second display area, and the non-under-display camera area is the first display area; or The fourth type of boundary area is near the boundary between the fingerprint recognition area and the non-fingerprint recognition area, wherein the fingerprint recognition area is the second display area and the non-fingerprint recognition area is the first display area.

4. The sub-pixel rendering method of claim 3, wherein, The first type of boundary region is rectangular, wherein, in the boundary region, the direction from the first display area to the second display area is located at the... The first strain factor a and the second strain factor b corresponding to the row are respectively: （3） in, The count value representing the sub-pixel row or column of the boundary region; The value of y1 ranges from 0 to y1, with the value gradually increasing; y1 represents the total number of sub-pixel rows or columns included in the boundary region. Or, in the interface region, from the second display area to the first display area, the first display area is located in the second display area The first strain factor a and the second strain factor b corresponding to the row are respectively: （4） wherein, represents a count value of a sub-pixel row or column of the boundary region; The value of y1 is from 0 to y2, and the value gradually increases in turn; y2 represents the total number of sub-pixel rows or columns included in the boundary region.

5. The sub-pixel rendering method of claim 4, wherein, The boundary area includes a first sub-transition area and / or a second sub-transition area, wherein the first sub-transition area is located above or to the left of the second display area, and the second sub-transition area is located below or to the right of the second display area; For the first sub-transition region, the first and second strain factors are calculated using the formula (3); For the second sub-transition region, the first and second strain factors are calculated using the formula (4).

6. The sub-pixel rendering method of claim 5, wherein, The value of y1 is equal to that of y2.

7. The sub-pixel rendering method as described in claim 1, characterized in that, The boundary region is a bend region, and the boundary region includes a first bend transition region and a second bend transition region located on both sides of the center of the boundary region. For the first or second bend transition zone, the first and second strain factors, respectively, are as follows: (The original text contains some formatting errors and inconsistencies. A more accurate translation would require the full context.) (5) In the formula, y3 represents the total number of rows or columns of sub-pixels covered by the first or second bend transition area; hcnt3 represents the count value of the current sub-pixel row or column where the first or second bend transition area is located. For the first or second bending transition zone, the first and second strain factors, respectively, are as follows: (The original text contains some formatting errors and inconsistencies. A more accurate translation would require the full context.) （6） In the formula, y4 represents the total number of rows or columns of sub-pixels covered by the first or second bend transition area; hcnt4 represents the count value of the current sub-pixel row or column where the first or second bend transition area is located.

8. The sub-pixel rendering method of claim 7, wherein, The value of y3 is equal to that of y4.

9. The sub-pixel rendering method of claim 7, wherein, Centered on the midline of the bending region, y3 and y4 change according to the bending angle.

10. The sub-pixel rendering method of claim 3, wherein, The third type of boundary region is a combination of rectangular and circular ring shapes, and the first and second strain factors are respectively; （7） In the formula, β The value ranges from 1 to 0.

8. β It is a parameter related to the radius of the circular ring and the width of the rectangular ring, which are combined with the boundary of the rectangular ring and the circular ring formed by the camera area.

11. The sub-pixel rendering method as described in claim 3, characterized in that, The fourth type of boundary region is annular, and the first and second strain factors are respectively; （8） In the formula, The value of a is a parameter related to the radius of the circular boundary of the plane formed by the fingerprint recognition area, and a is a value from 0 to 1.

12. The sub-pixel rendering method of claim 1, wherein, The formulas for the first and third rendering effects are as follows: （9） In the formula, R1 represents the first calculation result, and mm represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the j-th sub-pixel in the sub-pixel matrix; This represents the filter coefficient corresponding to the j-th sub-pixel in the first and third rendering filters; The formulas for the second and fourth rendering effects are as follows: （10） In the formula, R2 represents the second calculation result, and mm represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the j-th sub-pixel in the sub-pixel matrix; This represents the filter coefficient corresponding to the j-th sub-pixel in the second and fourth rendering filters.

13. The sub-pixel rendering method of claim 12, wherein, The first and third rendering effects, the second and fourth rendering effects, or transient rendering effects include one-dimensional rendering effects or two-dimensional rendering effects.

14. The sub-pixel rendering method of claim 1, wherein, The sub-pixels include red sub-pixels, blue sub-pixels, or green sub-pixels.

15. The sub-pixel rendering method of claim 14, wherein, The rendering formula for the sub-pixel is as follows: （11） In the formula, R represents the rendering result value of the corresponding color sub-pixel, and n represents the number of elements in the sub-pixel matrix. This represents the sub-pixel value of the i-th sub-pixel in the sub-pixel matrix; This represents the transient rendering effect corresponding to the i-th sub-pixel in the transient rendering effect.

16. A display driving apparatus for driving a display panel, the apparatus comprising: The display driving device uses the sub-pixel rendering method as described in any one of claims 1 to 15 to drive the display panel to display images.

17. A display device comprising: include: A display panel includes sub-pixel repeating units, which are repeatedly arranged to form the display panel. The sub-pixel repeating unit includes multiple sub-pixels; as well as The display driving device as described in claim 16 is coupled to the display panel for obtaining a display image based on the sub-pixel rendering.

18. An electronic device, comprising: It includes a processor and a memory, wherein the memory stores a computer program, which, when executed by the processor, implements the method of any one of claims 1 to 15.

19. A readable storage medium, characterized by, The readable storage medium stores a computer program, which, when executed by a processor, implements the method of any one of claims 1 to 15.

Images