Backlight adjusting method, device, system, storage medium and product of display device

Abstract

A backlight adjustment method, device, system, storage medium and product of a display device. The backlight adjustment method comprises: inputting multiple frames of images to the display device; obtaining multiple backlight matrices corresponding to the multiple frames of images, the backlight matrix comprising multiple backlight values; obtaining a connected domain composed of positive backlight values according to the backlight matrix; and determining an adjustment scheme of the backlight value of the boundary position of the connected domain according to the connected domain. Through the backlight adjustment method, different adjustment schemes of the backlight value of the boundary position can be selected for different connected domains, so that suitable backlight adjustment schemes can be selected for different objects in the display picture, and the backlight halo problem can be improved more effectively. In addition, other chips do not need to be added, and the backlight adjustment can be realized through the scaler board card of the display device, so that the cost and development period can be reduced.

Description

Technical Field

[0001] Embodiments of this disclosure relate to a backlight adjustment method for a display device, a backlight adjustment device for a display device, a computer system, a computer-readable storage medium, and a computer program product. Background Technology

[0002] Liquid crystal displays (LCDs) possess advantages such as ultra-long lifespan, low power consumption, low operating voltage, high color rendering index, fast response speed, environmental friendliness, small size, and low radiation, and are widely used in electronic devices such as laptops, mobile phones, and LCD TVs. An LCD is a passive light-emitting device, primarily consisting of a liquid crystal display panel and a backlight. The liquid crystal display panel itself does not emit light; instead, it relies on the backlight for illumination. To reduce power consumption and improve display contrast, LCDs with local dimming backlight functionality have gradually been developed. Summary of the Invention

[0003] When reducing the halo effect of backlight on objects in a display screen to solve the problem of excessive halo, the visual perception of the halo will differ for objects of different sizes if the same backlight processing is used. This disclosure provides a backlight adjustment method for a display device, which allows for the selection of appropriate backlight adjustment schemes for different objects in the display screen, thereby more effectively improving the backlight halo problem.

[0004] At least one embodiment of this disclosure provides a backlight adjustment method for a display device, comprising: inputting multiple frames of images to the display device; obtaining multiple backlight matrices corresponding to the multiple frames of images, the backlight matrices including multiple backlight values; obtaining a connected component composed of positive backlight values ​​according to the backlight matrices; and determining an adjustment scheme for the backlight values ​​at the boundary positions of the connected component according to the connected component.

[0005] For example, in a backlight adjustment method provided in an embodiment of this disclosure, determining the adjustment scheme for the backlight value at the boundary position of the connected component based on the connected component includes: obtaining a first parameter based on the connected component; setting a first parameter threshold; comparing the first parameter with the first parameter threshold; if the first parameter is less than or equal to the first parameter threshold, then adjusting the backlight value at the boundary position of the connected component using a first adjustment scheme; if the first parameter is greater than the first parameter threshold, then adjusting the backlight value at the boundary position of the connected component using either the first adjustment scheme or a second adjustment scheme, wherein the first adjustment scheme and the second adjustment scheme are different.

[0006] For example, in a backlight adjustment method provided in an embodiment of this disclosure, the first parameter includes: the ratio of the perimeter of the connected region to the perimeter of the backlight area; or the ratio of the area of ​​the connected region to the area of ​​the backlight area.

[0007] For example, in a backlight adjustment method provided in an embodiment of this disclosure, after determining that the first parameter is greater than the first parameter threshold, the adjustment scheme for determining the backlight value at the boundary position of the connected component based on the connected component further includes: obtaining a second parameter based on the connected component; setting a second parameter threshold; comparing the second parameter with the second parameter threshold; if the second parameter is less than or equal to the second parameter threshold, then using a second adjustment scheme to adjust the backlight value at the boundary position of the connected component; if the second parameter is greater than the second parameter threshold, then determining whether to use a first adjustment scheme based on a third parameter.

[0008] For example, in a backlight adjustment method provided in one embodiment of this disclosure, the second parameter includes the ratio between the maximum boundary distance and the minimum boundary distance of the connected domain.

[0009] For example, in a backlight adjustment method provided in an embodiment of this disclosure, after determining that the second parameter is greater than the second parameter threshold, the adjustment scheme for determining the backlight value at the boundary position of the connected component based on the connected component further includes: obtaining the third parameter based on the connected component; setting a third parameter threshold; comparing the third parameter with the third parameter threshold; if the third parameter is less than or equal to the third parameter threshold, then using a first adjustment scheme to adjust the backlight value at the boundary position of the connected component; if the third parameter is greater than the third parameter threshold, then using a second adjustment scheme to adjust the backlight value at the boundary position of the connected component.

[0010] For example, in a backlight adjustment method provided in one embodiment of this disclosure, the third parameter includes the ratio of the minimum boundary distance of the connected domain to the minimum boundary distance of the backlight region.

[0011] For example, in a backlight adjustment method provided in an embodiment of this disclosure, the first adjustment scheme includes: multiplying the backlight value at the boundary position of the connected domain by a weighting coefficient; the second adjustment scheme includes: filtering the backlight value at the boundary position of the connected domain.

[0012] For example, in a backlight adjustment method provided in an embodiment of this disclosure, before filtering the backlight value at the boundary position of the connected domain, the second adjustment scheme further includes: determining the number and position of the backlight values ​​of zero at adjacent positions of the boundary position of the connected domain; and selecting a filtering operator based on the determination result.

[0013] For example, in a backlight adjustment method provided in an embodiment of this disclosure, the backlight matrix includes row direction and column direction, and the number of adjacent positions of the boundary position of the connected domain is four. The four adjacent positions include: a first adjacent position and a second adjacent position that are opposite each other in the row direction with the boundary position as the center, and a third adjacent position and a fourth adjacent position that are opposite each other in the column direction. According to the judgment result, the selection of the filtering operator includes: if the backlight value of one of the first adjacent position and the second adjacent position is zero and the backlight value of one of the third adjacent position and the fourth adjacent position is zero, then an N*N type filtering operator or a "cross" type filtering operator is selected; if the backlight value of one of the first adjacent position and the second adjacent position is zero, then a 1*N type filtering operator is selected; and if the backlight value of one of the third adjacent position and the fourth adjacent position is zero, then an N*1 type filtering operator is selected, where N is an odd number greater than or equal to 3.

[0014] For example, in a backlight adjustment method provided in an embodiment of this disclosure, obtaining multiple backlight matrices corresponding to the multiple frames of images includes: obtaining the backlight matrices corresponding to any two adjacent frames of images. The backlight adjustment method further includes: obtaining a backlight difference matrix based on the backlight matrices of the two adjacent frames of images; determining the backlight change position based on the backlight difference matrix; and judging the backlight change trend at the backlight change position based on the backlight difference matrix.

[0015] For example, in a backlight adjustment method provided in an embodiment of this disclosure, the difference value in the backlight difference matrix includes zero, a positive number, or a negative number. Determining the backlight change position according to the backlight difference matrix includes: if the difference value in the backlight difference matrix is ​​a positive number or a negative number, then confirming the position where the difference value is located as the backlight change position.

[0016] For example, in a backlight adjustment method provided in an embodiment of this disclosure, determining the backlight change trend of the backlight change position according to the backlight difference matrix includes: determining the backlight change position with a positive difference value according to the backlight difference matrix; determining whether the difference value of the adjacent position of the positive backlight change position is zero; and determining the backlight change trend of the backlight change position according to the determination result.

[0017] For example, in a backlight adjustment method provided in an embodiment of this disclosure, the adjacent positions of the backlight change position include a first position, a second position, a third position, and a fourth position arranged clockwise around the backlight change position. The determination of the backlight change trend of the backlight change position based on the judgment result includes: if the difference value of only one of the first, second, third, and fourth positions is zero, then the backlight change trend of the backlight change position is towards the position with the zero difference value; if the difference value of any two adjacent positions among the first, second, third, and fourth positions is zero, then the backlight change trend of the backlight change position is towards the area between the two adjacent positions; and if the difference value of any three of the first, second, third, and fourth positions is zero, then the backlight change trend of the backlight change position is in the opposite direction to the position with the only non-zero difference value among the four positions.

[0018] For example, a backlight adjustment method provided in one embodiment of this disclosure further includes: adjusting the backlight value of adjacent positions of the backlight change position according to the backlight change trend, wherein the backlight difference value of adjacent positions of the backlight change position is 0.

[0019] For example, in a backlight adjustment method provided in an embodiment of this disclosure, adjusting the backlight value of adjacent positions of the backlight change position according to the backlight change trend includes: determining a backlight change position with a positive difference value; determining a fifth position adjacent to the positive backlight change position and a sixth position adjacent to the fifth position along the backlight change trend; and adjusting the backlight value of the fifth position.

[0020] For example, in a backlight adjustment method provided in one embodiment of this disclosure, the backlight value at the fifth position is calculated using a nonlinear interpolation method, and the calculation formula is as follows:

[0021] ;or

[0022] The backlight matrix includes row and column directions, where i and j represent the row and column indices of the backlight matrix, respectively. This represents the backlight value of the backlight matrix at time t. This represents the adaptive adjustment parameter, and its calculation formula is: .

[0023] For example, a backlight adjustment method provided in one embodiment of this disclosure further includes: adjusting the backlight value at the backlight change position to zero according to the backlight change trend.

[0024] For example, a backlight adjustment method provided in one embodiment of this disclosure further includes: obtaining the backlight matrix based on the display grayscale value of the image.

[0025] For example, in a backlight adjustment method provided in an embodiment of this disclosure, the backlight area includes multiple backlight partitions, each of which corresponds one-to-one with multiple backlight values ​​of the backlight matrix. The image includes multiple image partitions, each of which corresponds one-to-one with the multiple backlight partitions. Each image partition includes multiple pixels. Obtaining the backlight matrix based on the display grayscale values ​​of the image includes: obtaining the maximum display grayscale value and the average display grayscale value of each image partition based on the display grayscale values ​​of the multiple pixels of each image partition; and weighting the maximum display grayscale value and the average display grayscale value of each image partition to obtain the backlight value of the backlight partition corresponding to the image partition.

[0026] At least one embodiment of this disclosure provides a backlight adjustment device for a display device, comprising: an input module configured to input multiple frames of images to the display device; a first acquisition module configured to acquire multiple backlight matrices corresponding to the multiple frames of images, the backlight matrices including multiple backlight values; a second acquisition module configured to acquire, based on the backlight matrices, a connected component composed of positive backlight values; and a first determination module configured to determine, based on the connected component, an adjustment scheme for the backlight values ​​at the boundary positions of the connected component.

[0027] At least one embodiment of this disclosure provides a computer system including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any of the backlight adjustment methods described above.

[0028] At least one embodiment of this disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the backlight adjustment method described in any of the preceding claims.

[0029] At least one embodiment of this disclosure provides a computer program product, including a computer program, wherein the computer program, when executed by a processor, implements the steps of any of the methods described above. Attached Figure Description

[0030] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings of the embodiments will be briefly described below. Obviously, the drawings described below only relate to some embodiments of this disclosure and are not intended to limit this disclosure.

[0031] Figure 1 A flowchart illustrating a backlight adjustment method provided in one embodiment of this disclosure;

[0032] Figure 2This is a schematic diagram illustrating the correspondence between backlight partitions and image partitions according to an embodiment of the present disclosure;

[0033] Figure 3 A schematic diagram of a connected region provided in an embodiment of this disclosure;

[0034] Figure 4 A flowchart illustrating a backlight value adjustment scheme for determining the boundary position of a connected component based on a connected component, as provided in an embodiment of this disclosure;

[0035] Figure 5 A schematic diagram of a filtering operator provided in an embodiment of this disclosure;

[0036] Figure 6 A flowchart illustrating another backlight adjustment method provided in an embodiment of this disclosure;

[0037] Figure 7 A schematic diagram of a backlight difference matrix provided in an embodiment of this disclosure;

[0038] Figure 8 This is a schematic diagram of a backlight change position and its adjacent positions provided in an embodiment of this disclosure;

[0039] Figure 9 A schematic diagram of a nonlinear interpolation method provided in one embodiment of this disclosure;

[0040] Figure 10 A flowchart illustrating a backlight adjustment method provided in one embodiment of this disclosure;

[0041] Figure 11A A flowchart illustrating backlight adjustment is provided as an embodiment of this disclosure;

[0042] Figure 11B A flowchart of another backlight adjustment provided in an embodiment of this disclosure; and

[0043] Figure 12 This is a schematic diagram of a backlight adjustment device provided in one embodiment of the present disclosure. Detailed Implementation

[0044] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0045] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as “comprising” or “including” mean that an element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as “connected” or “linked” are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect.

[0046] Unless otherwise defined, the features such as "parallel," "perpendicular," and "identical" used in the embodiments of this disclosure include strictly defined cases of "parallel," "perpendicular," and "identical," as well as cases that include a certain margin of error, such as "approximately parallel," "approximately perpendicular," and "approximately identical." For example, the aforementioned "approximately" may indicate that the difference between the compared objects is within 10% or 5% of the average value of the compared objects. Unless otherwise specified in the following embodiments of this disclosure, the quantity of a component or element is implied to mean that the component or element may be one or more, or can be understood as at least one. "At least one" refers to one or more, and "more" refers to at least two.

[0047] When a planar backlight is used in an LCD panel, the backlight may brighten or dim across the entire panel during display, making precise light control impossible. To achieve independent control of backlight brightness, LCD panels can employ backlight area adjustment technology. This technology divides the image signal into several areas, analyzes and calculates the grayscale of each area, and then automatically controls the brightness of the backlight corresponding to each area, thus enabling independent control of the brightness of each area.

[0048] When reducing the halo effect of backlighting on objects in a display screen to address the problem of excessive halos, the visual perception of the halo differs for objects of different sizes if the same backlighting process is applied. For example, with the same backlight value, the halo appears smaller for large objects and larger for small objects. Therefore, using the same backlighting process for objects of different sizes does not effectively solve the halo problem.

[0049] Furthermore, backlight dimming technology is often implemented using chip-level hardware, commonly including Field Programmable Gate Array (FPGA) chips, which can simultaneously perform backlight adjustment and pixel compensation. However, hardware development is costly and time-consuming, making system integration impossible in a short period.

[0050] In response, this disclosure provides a backlight adjustment method for a display device, a backlight adjustment device for a display device, a computer system, a computer-readable storage medium, and a computer program product. The backlight adjustment method includes: inputting multiple frames of images to a display device; acquiring multiple backlight matrices corresponding to the multiple frames of images, each backlight matrix including multiple backlight values; acquiring a connected component composed of positive backlight values ​​based on the backlight matrices; and determining an adjustment scheme for the backlight values ​​at the boundary positions of the connected component based on the connected component.

[0051] In the backlight adjustment method provided in this embodiment, different connected domains can select different backlight value adjustment schemes at their boundary positions. Thus, for different objects in the display screen, a suitable backlight adjustment scheme can be selected, thereby more effectively improving the backlight halo problem.

[0052] In addition, improving the backlight halo problem by adjusting the backlight value does not require adding other chips; it can be achieved through the scaler board of the display device, thereby reducing costs and development cycle.

[0053] The backlight adjustment method, computer system, computer-readable storage medium, and computer program product provided in the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0054] One embodiment of this disclosure provides a backlight adjustment method. Figure 1 This is a flowchart illustrating a backlight adjustment method according to an embodiment of the present disclosure. Figure 1 As shown, the backlight adjustment method includes the following steps:

[0055] S100: Input multiple frames of images to the display device;

[0056] S200: Obtain multiple backlight matrices corresponding to multiple frames of images, where each backlight matrix includes multiple backlight values;

[0057] S300: Based on the backlight matrix, obtain the connected components consisting of positive backlight values;

[0058] S400: Based on the connected components, determine the backlight value adjustment scheme for the boundary positions of the connected components.

[0059] The multiple backlight values ​​of the backlight matrix can be calculated based on the display grayscale values ​​of the input image. Figure 2 This is a schematic diagram illustrating the correspondence between backlight partitions and image partitions according to an embodiment of this disclosure. Figure 2As shown, the backlight module of the display device includes multiple backlight sources 10 arranged in an array. To more clearly illustrate the correspondence between the backlight zones and image zones, only one backlight source 10 is schematically shown in the figure. The multiple backlight sources of the backlight module form the backlight area of ​​the display device, which includes multiple backlight zones, each corresponding to one of the multiple backlight sources. The image includes multiple image zones 20, each corresponding to one of the multiple backlight zones 20, and each image zone 20 includes multiple pixels. Based on the display grayscale values ​​of the multiple pixels of each image zone, the backlight value of the corresponding backlight zone can be obtained, thereby obtaining the corresponding backlight matrix based on the input image. This disclosure does not limit the method for calculating the backlight value.

[0060] For example, the color of each pixel in an image partition is composed of three color channels: red, green, and blue. To obtain the backlight value, the three color values ​​of red, green, and blue need to be converted into the display grayscale value of the pixel. Then, the backlight value of the corresponding backlight partition can be obtained based on the display grayscale values ​​of multiple pixels. For example, the conversion formula for display grayscale value can be: Gray = R * 0.299 + G * 0.587 + B * 0.114, where Gray is the display grayscale value, and R, G, and B represent the three color values ​​of red, green, and blue, respectively. Of course, the embodiments of this disclosure do not specifically limit the conversion formula for display grayscale value.

[0061] Figure 3 This is a schematic diagram of a connected region provided in one embodiment of this disclosure. For example... Figure 3 As shown, the backlight matrix can be used to obtain a connected component consisting of positive backlight values. The dashed box in the figure outlines a connected component; based on this component, the adjustment scheme for the backlight values ​​at its boundary positions is determined. For example... Figure 3 As shown, the boundary positions of this connected domain are the locations of backlight values ​​30, 15, 12, 30, 13, 9, and 18, respectively. By adjusting the backlight values ​​at these boundary positions, the backlight halo can be improved. Figure 3 This is used to illustrate connected components and their boundary locations, and does not impose any other limitations.

[0062] In the backlight adjustment method provided in this embodiment, different connected domains can use different backlight value adjustment schemes at their boundary positions. Thus, for different objects in the display screen, the backlight halo problem can be improved more effectively, and the problem of abnormal backlight value adjustment or disappearance of backlight value can be avoided.

[0063] In addition, improving the backlight halo problem by adjusting the backlight value does not require adding other chips; it can be achieved through the scaler board of the display device, thereby reducing costs and development cycle.

[0064] It should be noted that the boundary position of a connected component refers to a position where at least one of its adjacent positions has a backlight value of 0, or at least one of its adjacent positions has a backlight value less than or equal to a preset value, such as 3. All boundary positions of the connected component constitute its boundary. By adjusting the backlight values ​​at the boundary positions of the connected component, the backlight halo problem can be improved. For more information on connected components and their boundary positions, please refer to the following embodiments and illustrations.

[0065] In some examples, in step S400, determining the adjustment scheme for the backlight value at the boundary location of the connected domain includes:

[0066] S410: Obtain the first parameter based on the connected components;

[0067] S420: Set the first parameter threshold, compare the first parameter with the first parameter threshold:

[0068] S430: If the first parameter is less than or equal to the first parameter threshold, the backlight value of the boundary position of the connected domain is adjusted using the first adjustment scheme.

[0069] S440: If the first parameter is greater than the first parameter threshold, then the backlight value of the boundary position of the connected domain is adjusted by the first adjustment scheme or the second adjustment scheme, wherein the first adjustment scheme and the second adjustment scheme are different.

[0070] In some examples, the first parameter can be the ratio of the perimeter of the connected region to the perimeter of the backlight region. For example, the first parameter can also be the ratio of the area of ​​the connected region to the area of ​​the backlight region. Of course, the embodiments of this disclosure do not limit the first parameter.

[0071] In some examples, the first parameter threshold can be 1 / 10. For example, the first parameter threshold can be any value greater than or equal to 1 / 10. Of course, this disclosure does not limit the first parameter threshold.

[0072] The size relationship between the connected component and the backlight area can be determined by using the first parameter and its threshold value. For example, when the first parameter is less than or equal to the first parameter threshold value, the connected component occupies a relatively small proportion of the backlight area. Conversely, when the first parameter is greater than the first parameter threshold value, the connected component occupies a relatively large proportion of the backlight area. It should be noted that "large" and "small" here are relative values, not absolute values.

[0073] For example, objects in an image can be categorized into large and small objects. For instance, if the first parameter is less than or equal to a first parameter threshold, the object is determined to be small, and thus, the backlighting of the small object can be adjusted using the first adjustment scheme. Conversely, if the first parameter is greater than the first parameter threshold, the object is determined to be large. For large objects, further determination can be made to select either the first or second adjustment scheme. It should be noted that "large" and "small" objects here are relative to the backlighting area, not absolute large and small objects, and are related to the setting of the first parameter threshold. The introduction of the concepts of large and small objects is only illustrative to illustrate the selection of the first and second adjustment schemes and is not a limitation on the selection of the first and second adjustment schemes.

[0074] In some examples, after determining that the first parameter is greater than the first parameter threshold in step S440, the backlight adjustment method further includes:

[0075] S441: Obtain the second parameter based on the connected components;

[0076] S442: Set the second parameter threshold, compare the second parameter with the second parameter threshold:

[0077] S443: If the second parameter is less than or equal to the second parameter threshold, then the second adjustment scheme is used to adjust the backlight value of the boundary position of the connected domain;

[0078] S444: If the second parameter is greater than the second parameter threshold, then determine whether to adopt the first adjustment scheme based on the third parameter.

[0079] In some examples, the second parameter includes the ratio between the maximum boundary distance and the minimum boundary distance of the connected components. Of course, this disclosure does not limit the second parameter.

[0080] It should be noted that the maximum and minimum boundary distances of a connected component can be obtained as follows: Take an arbitrary first point on the boundary of the connected component, determine the tangent line at that point, and then draw a perpendicular line from that tangent line through the connected component, intersecting the boundary at a second point. The distance between the first and second points is called the boundary distance. By traversing all points on the boundary of the connected component, all boundary distances can be obtained. Among all the calculated boundary distances, the minimum value is called the minimum boundary distance, and the maximum value is called the maximum boundary distance.

[0081] In some examples, the second parameter threshold can be 3; for example, the second parameter threshold can be any positive integer greater than or equal to 3. Of course, this disclosure does not limit the second parameter threshold.

[0082] The second parameter and its threshold value can be used to determine the approximate shape of an object. For example, if the second parameter is less than or equal to the threshold value, the ratio of the maximum boundary distance to the minimum boundary distance of the connected component is less than 3. Therefore, the object's dimensions are relatively balanced in any direction, without any particular direction being excessively large or small. It should be noted that "large" and "small" here are relative values, not absolute values.

[0083] For example, the large objects mentioned above can be further divided into normal large objects and extremely large objects. For example, when the second parameter is less than or equal to the second parameter threshold, the object is determined to be a normal large object, and thus, the backlight of a normal large object can use the second adjustment scheme. For example, when the second parameter is greater than the second parameter threshold, for large objects, further determination can be made to select either the first or second adjustment scheme. It should be noted that the terms "normal large object" and "extreme large object" (e.g., extremely narrow strips or thin lines) here refer to the boundary distance relative to the connected region and are related to the setting of the second parameter threshold. The introduction of the concepts of normal large object and extreme large object is only illustrative to illustrate the selection of the first and second adjustment schemes and is not a limitation on the selection of the first and second adjustment schemes.

[0084] In some examples, after determining that the second parameter is greater than the second parameter threshold in step S444, the backlight adjustment method further includes:

[0085] S4441: Obtain the third parameter based on the connected components;

[0086] S4442: Set the third parameter threshold, compare the third parameter with the third parameter threshold:

[0087] S4443: If the third parameter is less than or equal to the third parameter threshold, then the first adjustment scheme is used to adjust the backlight value of the boundary position of the connected domain.

[0088] S4444: If the third parameter is greater than the third parameter threshold, then the second adjustment scheme is used to adjust the backlight value of the boundary position of the connected domain.

[0089] In some examples, the third parameter includes the ratio of the minimum boundary distance of the connected components to the minimum boundary distance of the backlight region. Of course, this disclosure does not limit the third parameter.

[0090] It should be noted that the minimum boundary distance of the backlight area is the minimum value among the boundary distances of the backlight area. For example, when the backlight area is rectangular, the minimum boundary distance of the backlight matrix is ​​the length of the shorter side of the rectangle.

[0091] In some examples, the third parameter threshold can be 1 / 10. For example, the third parameter threshold can be any value greater than or equal to 1 / 10. Of course, this disclosure does not limit the third parameter threshold.

[0092] The third parameter and its threshold can be used to further filter objects. For example, if the third parameter is less than or equal to the threshold, the ratio of the minimum boundary distance of the connected component to the minimum boundary distance of the backlit area is less than or equal to 1 / 10. Therefore, the object's size in a certain direction is relatively small compared to the minimum boundary distance of the backlit area; for example, the object could be an extremely narrow strip or a long, thin line. Conversely, if the third parameter is greater than the threshold, the ratio of the minimum boundary distance of the connected component to the minimum boundary distance of the backlit area is greater than 1 / 10. Therefore, the object's minimum size relative to the minimum boundary distance of the backlit area is greater than a set value; this can also be understood as the object not having a relatively small size relative to the minimum boundary distance of the backlit area. It should be noted that "greater" and "smaller" here are relative values, not absolute values.

[0093] For example, the large objects mentioned above can be further divided into normal large objects and extremely large objects. When the third parameter is less than or equal to the third parameter threshold, it is determined to be an extremely large object, and therefore, the backlight of an extremely large object can use the first adjustment scheme. For example, when the third parameter is greater than the third parameter threshold, it is determined to be a normal large object, and therefore, the backlight of a normal large object can use the second adjustment scheme. For example, an extremely large object here can be understood as a large object whose size in at least one direction is relatively small compared to the minimum boundary distance of the backlight area, while a normal large object is a large object other than an extremely large object.

[0094] By using the first parameter, the first parameter threshold, the second parameter, the second parameter threshold, the third parameter, and the third parameter threshold, the backlight value adjustment scheme at the boundary position of the connected domain can be determined, thus allowing different backlight value adjustment schemes to be selected according to different objects.

[0095] For example, extremely narrow strips or thin lines—the perimeter or area of ​​their connected regions may be larger than the first parameter threshold. However, their halo processing method cannot be the same as that for shapes like squares with the same perimeter or area of ​​connected regions. Therefore, by using multiple parameters and their corresponding thresholds, objects can be more accurately segmented, allowing for the selection of appropriate backlight adjustment schemes and better backlight optimization.

[0096] Figure 4This flowchart illustrates a backlight value adjustment scheme based on determining the boundary position of a connected component according to an embodiment of the present disclosure. This flowchart allows for the selection of appropriate backlight value adjustment schemes for different connected components, thereby more effectively improving backlight halo issues for different objects in the displayed image.

[0097] In some examples, the first adjustment scheme includes multiplying the backlight value at the boundary location of the connected component by a weighting coefficient. The second adjustment scheme includes filtering the backlight value at the boundary location of the connected component to adjust the backlight value at the boundary location of the connected component.

[0098] For objects using the first adjustment scheme, their backlight value is generally relatively small. Therefore, changes in the backlight value will cause significant changes in the visual perception. So, when adjusting the backlight value of this object, large changes in the backlight value should be avoided. Using a weighted coefficient method to change the backlight value of this object can avoid large changes in the backlight value. Thus, while improving and optimizing the halo of the object's backlight, it will not affect the visual perception and display effect of the object.

[0099] For example, the weighting coefficient can be any value less than 1. For example, the weighting coefficient can range from 0.6 to 1. For example, the weighting coefficient can be 0.9, 0.8, etc. Of course, the embodiments of this disclosure do not limit the weighting coefficient.

[0100] For objects using the second adjustment scheme, the corresponding backlit area is relatively large, and changes in the backlight value at its boundary positions are unlikely to cause significant visual changes. Adjusting using the aforementioned weighted coefficient method is unlikely to effectively improve the light source. Furthermore, the backlight value at the boundary positions may vary for different objects at different times. Reducing the backlight value at the boundary positions by the same proportion would cause the halo around the object's edges to fluctuate, affecting the visual experience. Using filtering not only significantly improves the halo effect at the object's edges but also adapts to backlight values ​​at boundary positions of different sizes, avoiding halo flickering issues.

[0101] In some examples, before filtering the backlight value at the boundary position of the connected component, the process includes: determining the number and position of zero backlight values ​​at adjacent positions of the boundary position of the connected component; and selecting a filtering operator based on the determination result.

[0102] By judging the backlight values ​​of adjacent positions at the boundary location, different filtering operators can be selected. Choosing a suitable filtering operator based on the judgment result can not only better optimize the halo, but also avoid using unsuitable filtering operators, which not only fail to improve the halo effect, but also cause abnormal backlight variation values.

[0103] In some examples, the backlight matrix includes row and column directions, and the number of adjacent positions at the boundary position is four. These four adjacent positions are: the first and second adjacent positions opposite each other in the row direction, centered on the boundary position; and the third and fourth adjacent positions opposite each other in the column direction. Based on the judgment result, the filter operator is selected as follows: if the backlight value of either the first or second adjacent position is zero, and the backlight value of either the third or fourth adjacent position is zero, then an N*N type filter operator or a "cross-shaped" filter operator is selected; if the backlight value of either the first or second adjacent position is zero, then a 1*N type filter operator is selected; and if the backlight value of either the third or fourth adjacent position is zero, then an N*1 type filter operator is selected. N is an odd number greater than or equal to 3.

[0104] By determining the number and location of zero backlight values ​​at adjacent positions of the boundary location, a suitable filtering operator can be selected, thereby enabling better halo optimization of the backlight value at that boundary location.

[0105] Figure 5 This is a schematic diagram of a filtering operator provided in an embodiment of this disclosure. Figure 5 As shown, take N=3, Figure 5 (a) is a 1*3 type filter operator. Figure 5 (b) is a 3*1 type filter operator. Figure 5 (c) is a "cross" type filter operator. Figure 5 (d) is a 3*3 type filter operator. Figure 5 Four filtering operators are shown only schematically and are not intended to limit the filtering operators in the embodiments of this disclosure.

[0106] In some examples, such as Figure 3 and Figure 5 As shown, at the boundary position of the connected component, the boundary position corresponding to the backlight value 15 has backlight values ​​of 30 and 12 at its first and second adjacent positions, respectively. Neither of these backlight values ​​is zero. One of the backlight values ​​at its third and fourth adjacent positions is 0. Therefore, an N*1 type filter operator is selected for filtering at this boundary position. Using an N*1 type filter operator allows for better halo optimization of this backlight value, making the adjusted backlight value closer to the direction where the backlight value of its adjacent position is 0. In this example, this corresponds to the column direction, avoiding the influence of backlight values ​​in other directions on the halo optimization of this boundary position.

[0107] It should be noted that, Figure 3 This diagram is used to illustrate how to select a suitable filtering operator at different boundary locations and is not intended to impose any other limitations.

[0108] For example, such as Figure 3 and Figure 5 As shown, the filtering process of the backlight value 15 at the boundary position using the 3*1 type mean filter operator is used as an example. The calculation formula for the filtering of the backlight value at this boundary position is: (0+15+45) / 3=20.

[0109] For example, such as Figure 3 and Figure 5 As shown, at the boundary position corresponding to the backlight value of 18, one of the backlight values ​​at its first and second adjacent positions is 0, while the backlight values ​​at its third and fourth adjacent positions are 30 and 9, respectively. Since the backlight values ​​at the third and fourth adjacent positions are not zero, a 1*N type filter operator is selected for filtering at this boundary position. Using a 1*N type filter operator allows for better halo optimization of this backlight value, making the adjusted backlight value closer to the direction where the backlight value at its adjacent position is 0. In this example, this corresponds to the row direction, avoiding the influence of backlight values ​​in other directions on the halo optimization at this boundary position.

[0110] For example, such as Figure 3 and Figure 5 As shown, the filtering process of the backlight value 18 at the boundary position using the 1*3 type mean filter operator is used as an example. The calculation formula for the filtering of the backlight value at this boundary position is: (0+18+45) / 3=21.

[0111] For example, such as Figure 3 and Figure 5 As shown, at the boundary position corresponding to backlight value 30, one of the backlight values ​​at its first and second adjacent positions is 0, and one of the backlight values ​​at its third and fourth adjacent positions is 0. Therefore, an N*N type filter operator or a "cross" type filter operator is selected for filtering at this boundary position. Using an N*N type filter operator or a "cross" type filter operator can comprehensively consider the backlight values ​​of the adjacent or surrounding positions at this boundary position, that is, it can simultaneously consider the backlight values ​​in both the row and column directions, thus enabling better halo optimization of this backlight value.

[0112] For example, such as Figure 3 and Figure 5 As shown, the "cross" shaped mean filter operator is used to filter the boundary position where the backlight value 30 is located as an example. The calculation formula for the filtering of the backlight value at this boundary position is: (0+30+18+0+15) / 5=12.

[0113] Similarly, the above method is used to filter all boundary positions of the connected domain in sequence, thereby optimizing the halo effect of the object's backlight.

[0114] Different backlight adjustment schemes can be used for different objects to avoid the problem of backlight values ​​disappearing. For example, for some special shapes, such as extremely narrow strips or thin lines, their short sides may only correspond to one or two backlight values. If a filtering operator is used to adjust the backlight value, such as a 1*3 or 3*1 filtering operator, the backlight value may decrease too much, failing to reach the set brightness, thus causing the backlight value to disappear. By using the above-mentioned multiple parameters and corresponding threshold values, these special shapes can be accurately filtered out, allowing the selection of the first adjustment scheme and avoiding abnormal backlight value adjustment problems such as the disappearance of backlight values.

[0115] In some examples, obtaining multiple backlight matrices corresponding to multiple frames of images includes obtaining the backlight matrices corresponding to any two adjacent frames. It should be noted that each frame of the multi-frame image corresponds to one backlight matrix. For example, the multi-frame image may include at least three frames. For example, the multi-frame image may include a previous frame, a current frame, and a next frame. For example, two adjacent frames may include a previous frame and a current frame, or a current frame and a next frame.

[0116] Figure 6 A flowchart illustrating another backlight adjustment method provided in an embodiment of this disclosure. Figure 6 As shown, the backlight adjustment method also includes:

[0117] S300': Obtain the backlight difference matrix based on the backlight matrix of any two adjacent frames;

[0118] S400': Determine the location of backlight changes based on the backlight difference matrix; and

[0119] S500': Based on the backlight difference matrix, determine the backlight change trend at the location of the backlight change.

[0120] In this embodiment, the backlight difference matrix can be used to determine the location of backlight changes and the trend of backlight changes at those locations, thereby enabling backlight optimization to address issues such as flickering and ghosting of moving objects in the displayed image. When an object moves, flickering and ghosting mainly occur at the edges of the object's backlight; the parts requiring optimization are those where the backlight changes. Therefore, the essence of backlight optimization is to optimize the areas where the backlight changes. The backlight difference matrix can easily and effectively determine the location of backlight changes, the backlight difference value, and the backlight change trend, thus enabling simple and effective backlight optimization to address issues such as flickering and ghosting of moving objects. For example, this backlight optimization method can be used to improve flickering and ghosting issues in high refresh rate displays (e.g., gaming monitors).

[0121] Furthermore, backlight optimization for issues like flickering and ghosting of moving objects using a backlight difference matrix can be achieved without adding additional chips, simply by using the display device's scaler board, thus reducing costs and development time. Existing methods such as the sliding window method and deep learning rely on large-scale computations and have high algorithm complexity, making them unsuitable for real-time backlight optimization using standalone scaler boards.

[0122] In some examples, the backlight difference matrix can also be used to predict the rate of backlight change. For instance, the number of positive values ​​in the backlight difference matrix can be used to determine the rate of backlight change; a large number of positive values ​​indicates a fast backlight change, while a small number indicates a slow rate of change.

[0123] In some examples, the difference between the backlight value of frame n and the backlight value of frame (n-1) represents the difference in backlight intensity.

[0124] Figure 7 This is a schematic diagram of a backlight difference matrix provided in one embodiment of the present disclosure. Figure 7 As shown, the difference values ​​in the backlight difference matrix include zero, positive, or negative numbers.

[0125] In some examples, determining the location of backlight changes based on the backlight difference matrix includes: if the difference value in the backlight difference matrix is ​​positive or negative, then the location of that difference value is identified as the location of the backlight change.

[0126] For example, if the difference value of the backlight change position is positive, it means that the backlight value of the backlight zone where the backlight change position is located has increased compared to the backlight value of the previous frame; if the difference value of the backlight change position is negative, it means that the backlight value of the backlight zone where the backlight change position is located has decreased compared to the backlight value of the previous frame; if the difference value of the backlight change position is zero, it means that the backlight value of the backlight zone where the backlight change position is located has not changed compared to the backlight value of the previous frame.

[0127] In some examples, in step S500', determining the backlight change trend at the backlight change location based on the backlight difference matrix includes:

[0128] S510': Determine the backlight change positions with positive difference values ​​based on the backlight difference matrix;

[0129] S520': Determine whether the difference value between adjacent positions of the positive backlight change position and the position of the positive number is zero; and

[0130] S530': Based on the judgment result, determine the backlight change trend at the backlight change position.

[0131] By determining whether the difference value of the backlight change position with a positive difference value and its adjacent positions is zero, the backlight change trend at that position can be determined simply and effectively. This allows for simple and effective backlight optimization to address issues such as flickering and ghosting of moving objects.

[0132] Figure 8 This is a schematic diagram illustrating the backlight variation position and its adjacent positions according to an embodiment of this disclosure. Figure 8 As shown, the adjacent positions of the backlight change position include the first position, the second position, the third position, and the fourth position, which are set clockwise around the backlight change position. Figure 8 These are four adjacent positions used only as an illustration of the backlight change location.

[0133] In some examples, in step S530', based on the judgment result, determining the backlight change trend at the backlight change location includes:

[0134] S531': If the difference value of only one of the first, second, third and fourth positions is zero, then the backlight change trend of that backlight change position is towards the position with the difference value of zero;

[0135] S532': If the difference between any two adjacent positions among the first, second, third, and fourth positions is zero, then the backlight change trend at that position is towards the area between the two adjacent positions; and

[0136] S533': If the difference value of any three of the four positions (first, second, third, and fourth) is zero, then the backlight change trend of that position is in the opposite direction to the position with the only non-zero difference value among the four positions.

[0137] It should be noted that any two adjacent positions among the first, second, third, and fourth positions refer to two adjacent positions in a clockwise direction. For example, the first and second positions are adjacent, the second and third positions are adjacent, the third and fourth positions are adjacent, and the fourth and first positions are adjacent.

[0138] In some examples, if the difference values ​​of the first, second, third, and fourth positions are all non-zero, the backlight change trend at the position of the backlight change can be determined by combining the current frame image and the next frame image.

[0139] In some examples, if the difference between two non-adjacent positions among the first, second, third, and fourth positions is not zero, and the difference between the other two non-adjacent positions is zero, for example, if the difference between the first and third positions is not zero, and the difference between the second and fourth positions is zero, then the positions with positive differences and positions with zero differences can be found along the direction of the line connecting the first and third positions. This allows us to determine the backlight change trend of the positions with positive differences.

[0140] like Figure 7 (a) shows the backlight difference matrix, where the difference value 30 is located at the position of the backlight change, for reference. Figure 8 The definition of adjacent positions is that the difference between the first and second positions is 0, while the difference between the third and fourth positions is not 0. The backlight change trend at this position is shown by the arrow in the figure, moving towards the area between the first and second positions. Figure 7 (b) In the backlight difference matrix shown, the position of difference value 30 is the position of backlight change, for reference. Figure 8 The definition of adjacent positions is as follows: the difference value of the first position is 0, while the difference values ​​of the second, third, and fourth positions are not 0. The backlight change trend at this position is shown by the arrow in the figure, pointing towards the first position. It should be noted that... Figure 7 This is only used to illustrate how to determine the trend of backlight change at different backlight positions, and does not impose any other limitations.

[0141] In some examples, the backlight adjustment method also includes:

[0142] S600': Adjust the backlight value of adjacent positions of the backlight change position according to the backlight change trend, wherein the backlight difference value of adjacent positions of the backlight change position is 0.

[0143] Adjusting the backlight value at adjacent positions based on the backlight change trend can achieve smooth backlight operation, thereby reducing flickering when objects are moving.

[0144] When moving objects move rapidly, their backlight changes become more noticeable, especially with small objects. This phenomenon is particularly pronounced when backlight changes are significant, resulting in a visually noticeable backlight flicker. The root cause is a large variation in backlight values ​​between adjacent frames, meaning a significant difference in backlight values. For example, backlight flicker can manifest as a sudden change in backlight value from 0 to a large value, or vice versa, within a specific backlight area; or a sudden change in backlight value from a small value to a large value, or vice versa. Adjusting the backlight values ​​of adjacent frames based on the trend of backlight changes can prevent large variations in backlight values, thus mitigating the flicker problem.

[0145] In some examples, in step S600', adjusting the backlight value at adjacent positions of the backlight change location based on the backlight change trend includes:

[0146] S610': Determine the location of backlight changes with a positive difference value;

[0147] S620': Along the backlight change trend, determine the fifth position adjacent to the backlight change position of the positive number and the sixth position adjacent to the fifth position; and

[0148] S630': Adjust the backlight value of position 5.

[0149] In some examples, the backlight value at the fifth position is calculated using a non-linear interpolation method, with the following formula:

[0150] ;or

[0151] The backlight matrix includes row and column directions, where i and j represent the row and column indices of the backlight matrix, respectively. This represents the backlight value of the backlight matrix at time t. This represents the adaptive adjustment parameter, and its calculation formula is: .

[0152] The effect of backlight variations at different backlight values ​​on the human eye varies. At higher backlight values, slight changes in backlight will not cause noticeable visual disturbances; however, at lower backlight values, even subtle changes are easily perceived by the human eye. 255 is the maximum backlight value. The backlight value at time t-1 The larger the value, the more adaptive the adjustment parameter. The larger it is, the better. The smaller the value, the more adaptive the adjustment parameter. The smaller the value, the better, by introducing adaptive adjustment parameters. It can use non-linear interpolation to adjust the backlight value at the fifth position, thereby allowing for different backlight adjustments for different backlight values, which can better adjust the backlight and improve the backlight flicker problem.

[0153] Figure 9 This disclosure provides a schematic diagram of a nonlinear interpolation method according to an embodiment. For example... Figure 9 As shown, positions A, B, C, D, E, F, G, and H each correspond to a backlight zone or backlight source. The backlight difference value at position A is positive, meaning that position A is a backlight change position. The backlight change trend judgment method at the backlight change position provided in the previous embodiment can be used to determine the backlight change trend at position A, which will not be elaborated here.

[0154] In some examples, such as Figure 9 As shown, assuming the backlight change trend at position A is towards position B, then position B corresponds to the fifth position mentioned above, and position E corresponds to the sixth position mentioned above. Based on the row direction index i and column direction index j of the fifth position, according to the calculation formula: The backlight value at position B is calculated, and the backlight value at position B is changed by nonlinear interpolation, which can improve the backlight flicker problem. Figure 9 This diagram is for illustrative purposes only and is not intended to limit backlight interpolation.

[0155] In some examples, such as Figure 9 As shown, assuming the backlight change trend at position A is towards position C, then position C corresponds to the fifth position mentioned above, and position G corresponds to the sixth position mentioned above. Based on the row direction index i and column direction index j of the fifth position, the calculation formula is as follows: The backlight value at position C is calculated, and the backlight value at position C is changed by nonlinear interpolation, thereby improving the backlight flicker problem.

[0156] According to the backlight change trend judgment method provided in the foregoing embodiments, a set of backlight change positions that need to be interpolated can be obtained. Then, the above method is used to interpolate all elements in the set in turn, thereby completing the backlight optimization and realizing the optimization of backlight flicker.

[0157] In some examples, the backlight adjustment method also includes: adjusting the backlight value at the location of the backlight change to zero based on the backlight change trend.

[0158] According to the backlight change trend, the backlight value at the backlight change position is adjusted to zero, so that the backlight can be turned off in advance according to the movement trend of the object, thereby reducing or eliminating the backlight delay problem and improving the ghosting problem.

[0159] In local dimming display systems, backlight ghosting is a common problem, where the illuminated area of ​​the backlight does not align with the image display area. This significantly affects the display quality, especially during fast-moving objects in the image, where the ghosting effect is particularly noticeable. Since the backlight value is calculated from the image and cannot be obtained beforehand, this problem cannot be solved technically. However, by adjusting the backlight value to zero at the location of the backlight change based on the backlight variation trend, the ghosting problem can be improved, achieving a match between the backlight and the image.

[0160] In some examples, adjusting the backlight value at the backlight change position to zero based on the backlight change trend also includes: if the difference value at the backlight change position is negative and the difference value between adjacent positions of the backlight change position is zero, then the backlight value at the backlight change position is adjusted to zero.

[0161] In some examples, such as Figure 7 As shown in (b), the difference value of the adjacent position of the difference value -15 is zero. Therefore, adjusting the backlight value of the position where the difference value -15 is located to zero can improve the backlight delay and ghosting problem at that position.

[0162] In some examples, the backlight adjustment method also includes obtaining a backlight matrix based on the displayed grayscale values ​​of the image.

[0163] In some examples, there are several different methods to obtain the backlight value of the corresponding backlight zone based on each image zone. For example, the maximum value method, the average value method, the cumulative distribution function (CDF) method, and the dynamic thresholding method can be used. For instance, the maximum value method uses the highest grayscale value among multiple pixels in each image zone to calculate the backlight value of the backlight zone. This can increase the display brightness of the backlight zone, but it is prone to sudden backlight changes, causing backlight flickering. The average value method uses the average grayscale value of multiple pixels in each image zone to calculate the backlight value of the backlight zone. Compared to the maximum value method, the average value method can save power, but it may result in insufficient display brightness and is prone to losing very small pixels.

[0164] In some examples, obtaining the backlight matrix based on the displayed grayscale values ​​of the image includes: obtaining the maximum and average displayed grayscale values ​​of the image partitions based on the displayed grayscale values ​​of multiple pixels in each image partition; and weighting the maximum and average displayed grayscale values ​​of each image partition to obtain the backlight value of the backlight partition corresponding to the image partition.

[0165] The backlight value of the corresponding backlight zone is calculated by weighting the maximum and average display grayscale values ​​of the image zones. This combines the advantages of the maximum value method and the average value method, and improves the backlight abruptness problem caused by the maximum value method and the insufficient display brightness problem caused by the average value method, thus making the calculated backlight value more optimized. It should be noted that the sum of the weighting coefficient of the maximum display grayscale value and the weighting coefficient of the average display grayscale value is 1. This embodiment of the disclosure does not limit the weighting coefficients of the maximum display grayscale value and the average display grayscale value. For example, the weighting coefficients of the maximum display grayscale value and the average display grayscale value can both be 0.5, or they can be any other arbitrary value.

[0166] In some examples, the weighting coefficients for the maximum and average display grayscale values ​​can be dynamically adjusted based on different image frames or display scenarios, thereby optimizing the calculated backlight values. For instance, when the image frame is bright, the weighting coefficient for the average display grayscale value can be greater than that for the maximum display grayscale value, thus reducing the weight of the maximum display grayscale value and mitigating backlight abrupt changes. Similarly, when image frames change frequently, the weighting coefficient for the average display grayscale value can be greater than that for the maximum display grayscale value, thus mitigating backlight abrupt changes caused by frame transitions.

[0167] Figure 10 This is a flowchart illustrating a backlight adjustment method according to an embodiment of the present disclosure. Figure 10 As shown, the process of this backlight adjustment method is as follows:

[0168] The backlight value is calculated based on the input image to obtain the backlight matrix; the backlight difference matrix is ​​then obtained from the backlight matrix. The backlight difference matrix can be used to detect difference values ​​and the location of backlight changes; predict backlight change trends and rates; and smooth the locations of backlight changes to reduce or improve backlight flicker. Therefore, this backlight adjustment method can achieve detection, prediction, and smoothing, thus optimizing the backlight.

[0169] Figure 11A This is a flowchart illustrating backlight adjustment according to an embodiment of the present disclosure. Figure 11A As shown, the backlight adjustment process includes:

[0170] Step 1: Input an image. For example, the image can be input into the backlight adjustment system through a multimedia interface, including but not limited to High Definition Multimedia Interface (HDMI), Video Graphics Array (VGA) interface, DisplayPort (DP) interface, or Digital Visual Interface (DVI), etc. This disclosure embodiment does not limit this.

[0171] Step 2: Backlight calculation. The backlight value of the image is calculated based on the pixel values ​​of the input image.

[0172] Step 3: Backlight optimization. Optimize the backlight value using any of the backlight adjustment methods mentioned above to improve the display effect.

[0173] Step 4: Backlight Output. The optimized backlight value is output to the backlight display module, which can then be used to drive the backlight source. For example, the backlight display module is part of the backlight module, and can be used to convert and map the backlight value to drive signals such as drive current, thereby illuminating the backlight source.

[0174] Figure 11B A flowchart illustrating another backlight adjustment method provided in an embodiment of this disclosure. For example... Figure 11B As shown, the above backlight adjustment process may further include:

[0175] Step 5: Backlight diffusion. The purpose of backlight diffusion is to simulate the optical diffusion process of the backlight source in order to obtain the backlight value corresponding to the actual pixel.

[0176] Step 6: Pixel Compensation. Before outputting the image, pixel compensation is performed. For example, backlight adjustment can cause pixels in areas with low backlight values ​​to remain unilluminated, resulting in a loss of image detail. To compensate for this loss, pixels in these low-backlight areas are compensated for, for example, by increasing their values.

[0177] Step 7: Output the compensation map, which is used for display.

[0178] Based on the same inventive concept, one embodiment of this disclosure also provides a backlight adjustment device for a display device. Figure 12 This is a schematic diagram of a backlight adjustment device provided in one embodiment of the present disclosure. Figure 12As shown, the backlight adjustment device includes: an input module 701, a first acquisition module 702, a second acquisition module 703, a first determination module 704, and an output module 705. The input module 701 is configured to input multiple frames of images to the display device; the first acquisition module 702 is configured to acquire multiple backlight matrices corresponding to the multiple frames of images, each backlight matrix including multiple backlight values; the second acquisition module 703 is configured to acquire connected components composed of positive backlight values ​​based on the backlight matrices; the first determination module 704 is configured to determine an adjustment scheme for the backlight values ​​at the boundary positions of the connected components based on the connected components; and the output module 705 is configured to output the adjusted backlight matrix to the backlight display module.

[0179] Since the principle of the backlight adjustment device in this embodiment of the present disclosure is similar to the backlight adjustment method described above in this embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method.

[0180] In some examples, the first determining module 704 is specifically used to: obtain a first parameter based on the connected component; set a threshold for the first parameter; compare the first parameter with the threshold for the first parameter: if the first parameter is less than or equal to the threshold for the first parameter, then adjust the backlight value of the boundary position of the connected component using a first adjustment scheme; if the first parameter is greater than the threshold for the first parameter, then adjust the backlight value of the boundary position of the connected component using either the first adjustment scheme or the second adjustment scheme, wherein the first adjustment scheme and the second adjustment scheme are different.

[0181] In some examples, the first determining module 704 is also specifically used to: obtain a second parameter based on the connected component; set a threshold for the second parameter; compare the second parameter with the threshold for the second parameter: if the second parameter is less than or equal to the threshold for the second parameter, then adopt the second adjustment scheme to adjust the backlight value of the boundary position of the connected component; if the second parameter is greater than the threshold for the second parameter, then determine whether to adopt the first adjustment scheme based on the third parameter.

[0182] In some examples, the first determining module 704 is also specifically used to: obtain a third parameter based on the connected component; set a threshold for the third parameter; compare the third parameter with the threshold for the third parameter: if the third parameter is less than or equal to the threshold for the third parameter, then use a first adjustment scheme to adjust the backlight value of the boundary position of the connected component; if the third parameter is greater than the threshold for the third parameter, then use a second adjustment scheme to adjust the backlight value of the boundary position of the connected component.

[0183] The first and second adjustment schemes described above are detailed in the embodiments above and will not be repeated here.

[0184] In some examples, the first acquisition module 702 is specifically used to: acquire the backlight matrix corresponding to any two adjacent frames of images.

[0185] In some examples, the backlight adjustment device further includes a third acquisition module, a second determination module, and a judgment module. The third acquisition module is configured to acquire a backlight difference matrix based on the backlight matrices of any two adjacent frames of images; the second determination module is configured to determine the backlight change position based on the backlight difference matrix; and the judgment module is configured to determine the backlight change trend at the backlight change position based on the backlight difference matrix.

[0186] In some examples, the second determining module is specifically used to: if the difference value in the backlight difference matrix is ​​positive or negative, then confirm that the location of the difference value is the location of the backlight change.

[0187] In some examples, the judgment module is specifically used to: determine the backlight change positions with positive difference values ​​based on the backlight difference matrix; determine whether the difference values ​​of adjacent positions to the positive backlight change positions are zero; and determine the backlight change trend at the backlight change positions based on the judgment results.

[0188] In some examples, the backlight adjustment device further includes a first adjustment module. The first adjustment module is configured to adjust the backlight value at adjacent positions of the backlight change location according to the backlight change trend.

[0189] In some examples, the first adjustment module is specifically used to: determine the backlight change position with a positive difference value; along the backlight change trend, determine the fifth position adjacent to the positive backlight change position and the sixth position adjacent to the fifth position; and adjust the backlight value of the fifth position.

[0190] In some examples, the backlight adjustment device further includes a second adjustment module. The second adjustment module is configured to adjust the backlight value at the position of the backlight change to zero according to the backlight change trend.

[0191] In some examples, the second adjustment module is specifically used to: if the difference value of the backlight change position is negative and the difference value of the adjacent positions of the backlight change position is zero, adjust the backlight value of the backlight change position to zero.

[0192] In some examples, the backlight adjustment device further includes a fourth acquisition module. The fourth acquisition module is configured to acquire the backlight matrix based on the displayed grayscale values ​​of the image.

[0193] In some examples, the fourth acquisition module is specifically used to: obtain the maximum and average display grayscale values ​​of the image partitions based on the display grayscale values ​​of multiple pixels in each image partition; and weight the maximum and average display grayscale values ​​of each image partition to obtain the backlight value of the backlight partition corresponding to the image partition.

[0194] This disclosure also provides a computer system in one embodiment. The computer system includes a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the steps of the backlight adjustment method of any of the embodiments described above.

[0195] An embodiment of this disclosure also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the backlight adjustment method of any of the above embodiments.

[0196] This disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the backlight adjustment method of any of the above embodiments.

[0197] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0198] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0199] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more blocks of a block diagram.

[0200] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0201] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0202] The following points need to be explained:

[0203] (1) The accompanying drawings of the embodiments of this disclosure only involve the structures involved in the embodiments of this disclosure. Other structures can be referred to the general design.

[0204] (2) Where there is no conflict, features of the same embodiment and different embodiments of this disclosure can be combined with each other.

[0205] The above are merely specific embodiments of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A backlight adjustment method for a display device, comprising: Input multiple frames of images to the display device; Obtain multiple backlight matrices corresponding to the multiple frames of images, wherein the backlight matrix includes multiple backlight values; Based on the backlight matrix, obtain the connected components formed by the positive backlight values; Based on the connected components, determine the backlight value adjustment scheme for the boundary positions of the connected components. The adjustment scheme for determining the backlight value at the boundary position of the connected component, based on the connected component, includes: Based on the connected components, obtain the first parameter; Set a first parameter threshold, and compare the first parameter with the first parameter threshold: If the first parameter is less than or equal to the first parameter threshold, then the backlight value at the boundary position of the connected domain is adjusted using the first adjustment scheme. If the first parameter is greater than the first parameter threshold, then the backlight value at the boundary position of the connected domain is adjusted using either the first adjustment scheme or the second adjustment scheme, wherein the first adjustment scheme and the second adjustment scheme are different. The first parameter includes: the ratio of the perimeter of the connected region to the perimeter of the backlight area; or the ratio of the area of ​​the connected region to the area of ​​the backlight area.

2. The backlight adjustment method according to claim 1, wherein, The backlight value of at least one of the adjacent positions of the boundary position of the connected domain is zero.

3. The backlight adjustment method according to claim 1, wherein, The backlight value of at least one of the adjacent positions of the boundary position of the connected domain is less than or equal to a preset value, wherein the preset value is greater than zero.

4. The backlight adjustment method according to claim 1, wherein, After determining that the first parameter is greater than the first parameter threshold, the adjustment scheme for determining the backlight value at the boundary position of the connected component further includes: Based on the connected components, obtain the second parameter; Set a second parameter threshold, and compare the second parameter with the second parameter threshold: If the second parameter is less than or equal to the threshold value of the second parameter, then the backlight value of the boundary position of the connected domain is adjusted using the second adjustment scheme. If the second parameter is greater than the threshold of the second parameter, then the first adjustment scheme is determined based on the third parameter.

5. The backlight adjustment method according to claim 4, wherein, The second parameter includes the ratio between the maximum boundary distance and the minimum boundary distance of the connected domain.

6. The backlight adjustment method according to claim 4, wherein, After determining that the second parameter is greater than the second parameter threshold, the adjustment scheme for determining the backlight value at the boundary position of the connected component further includes: The third parameter is obtained based on the connected components; Set a third parameter threshold, and compare the third parameter with the third parameter threshold: If the third parameter is less than or equal to the third parameter threshold, then the backlight value at the boundary position of the connected domain is adjusted using the first adjustment scheme. If the third parameter is greater than the third parameter threshold, then the backlight value of the boundary position of the connected domain is adjusted using the second adjustment scheme.

7. The backlight adjustment method according to claim 6, wherein, The third parameter includes the ratio of the minimum boundary distance of the connected domain to the minimum boundary distance of the backlight region.

8. The backlight adjustment method according to any one of claims 4-7, wherein, The first adjustment plan includes: The backlight value at the boundary position of the connected domain is multiplied by a weighting coefficient; The second adjustment plan includes: The backlight values ​​at the boundary positions of the connected domain are filtered.

9. The backlight adjustment method according to claim 8, wherein, Before filtering the backlight values ​​at the boundary positions of the connected components, the second adjustment scheme further includes: Determine the number and location of backlight values ​​of zero at adjacent positions of the boundary location of the connected component; and Based on the judgment result, select the filtering operator.

10. The backlight adjustment method according to claim 9, wherein, The backlight matrix includes row direction and column direction, and the number of adjacent positions of the boundary position of the connected domain is four. The four adjacent positions include: a first adjacent position and a second adjacent position that are opposite each other in the row direction with the boundary position as the center, and a third adjacent position and a fourth adjacent position that are opposite each other in the column direction. Based on the judgment results, the selected filtering operators include: If the backlight value of one of the first adjacent positions and the second adjacent positions is zero, and the backlight value of one of the third adjacent positions and the fourth adjacent positions is zero, then select N. N-type filter operator or "cross" type filter operator; If the backlight value of either the first adjacent position or the second adjacent position is zero, then select 1. N-type filter operator; and If the backlight value of either the third adjacent position or the fourth adjacent position is zero, then N is selected. Type 1 filter operator, Where N is an odd number greater than or equal to 3.

11. The backlight adjustment method according to any one of claims 1-7, further comprising: The backlight matrix is ​​obtained based on the displayed grayscale values ​​of the image.

12. The backlight adjustment method according to claim 11, wherein, The backlight area includes multiple backlight zones, each corresponding one-to-one with a backlight value in the backlight matrix. The image includes multiple image zones, each corresponding one-to-one with a backlight zone, and each image zone includes multiple pixels. Obtaining the backlight matrix based on the displayed grayscale values ​​of the image includes: Based on the displayed grayscale values ​​of the plurality of pixels in each of the image partitions, obtain the maximum displayed grayscale value and the average displayed grayscale value of the image partition; and The maximum display grayscale value and the average display grayscale value of each image partition are weighted to obtain the backlight value of the backlight partition corresponding to the image partition.

13. A method for adjusting the backlight of a display device, comprising: Input multiple frames of images to the display device; Obtain multiple backlight matrices corresponding to the multiple frames of images, wherein the backlight matrix includes multiple backlight values; Based on the backlight matrix, obtain the connected components formed by the positive backlight values; Based on the connected components, determine the backlight value adjustment scheme for the boundary positions of the connected components. The process of obtaining multiple backlight matrices corresponding to the multiple frames of images includes: Obtain the backlight matrix corresponding to any two adjacent image frames. The backlight adjustment method further includes: Based on the backlight matrix of any two adjacent frames, obtain the backlight difference matrix; Based on the backlight difference matrix, determine the location of the backlight change; and Based on the backlight difference matrix, determine the backlight change trend at the backlight change location.

14. The backlight adjustment method according to claim 13, wherein, The difference values ​​in the backlight difference matrix include zero, positive, or negative numbers. Determining the location of backlight changes based on the backlight difference matrix includes: If the difference value in the backlight difference matrix is ​​positive or negative, then the position of the difference value is confirmed as the backlight change position.

15. The backlight adjustment method according to claim 14, wherein, Based on the backlight difference matrix, determining the backlight change trend at the location of the backlight change includes: Based on the backlight difference matrix, determine the backlight change positions where the difference value is positive; Determine whether the difference between adjacent positions of the positive backlight change position and the position of the backlight change is zero; and Based on the judgment result, determine the backlight change trend at the backlight change position.

16. The backlight adjustment method according to claim 15, wherein, The adjacent positions of the backlight change position include a first position, a second position, a third position, and a fourth position arranged clockwise with the backlight change position as the center. Among them, judging the backlight change trend at the backlight change position according to the judgment result includes: If the difference value of only one of the first, second, third, and fourth positions is zero, then the backlight change trend of that backlight change position is toward the position where the difference value is zero. If the difference between any two adjacent positions among the first, second, third, and fourth positions is zero, then the backlight change trend at that position is towards the area between those two adjacent positions; and If the difference between any three of the first, second, third, and fourth positions is zero, then the backlight change trend at that position is in the opposite direction to the only position among the four positions where the difference is not zero.

17. The backlight adjustment method according to any one of claims 13-16, further comprising: Based on the backlight change trend, adjust the backlight value of adjacent positions of the backlight change position, wherein the backlight difference value of adjacent positions of the backlight change position is 0.

18. The backlight adjustment method according to claim 17, wherein, Adjusting the backlight value at adjacent positions based on the backlight change trend includes: Determine the locations of backlight changes where the difference value is positive; Along the backlight change trend, determine the fifth position adjacent to the positive backlight change position and the sixth position adjacent to the fifth position; and Adjust the backlight value at the fifth position.

19. The backlight adjustment method according to claim 18, wherein, The backlight value at the fifth position is calculated using a non-linear interpolation method, and the calculation formula is as follows: ;or The backlight matrix includes row and column directions, where i and j represent the row and column indices of the backlight matrix, respectively. This represents the backlight value of the backlight matrix at time t. This represents the adaptive adjustment parameter, and its calculation formula is: .

20. The backlight adjustment method according to claim 14, further comprising: Based on the backlight change trend, the backlight value at the position of the backlight change is adjusted to zero.

21. The backlight adjustment method according to claim 20, wherein, Adjusting the backlight value to zero at the location of the backlight change based on the backlight change trend includes: If the difference value of the backlight change position is negative, and the difference value of the adjacent positions of the backlight change position is zero, then the backlight value of the backlight change position is adjusted to zero.

22. The backlight adjustment method according to any one of claims 13-16, further comprising: The backlight matrix is ​​obtained based on the displayed grayscale values ​​of the image.

23. The backlight adjustment method according to claim 22, wherein, The backlight area includes multiple backlight zones, each corresponding one-to-one with a backlight value in the backlight matrix. The image includes multiple image zones, each corresponding one-to-one with a backlight zone, and each image zone includes multiple pixels. Obtaining the backlight matrix based on the displayed grayscale values ​​of the image includes: Based on the displayed grayscale values ​​of the plurality of pixels in each of the image partitions, obtain the maximum displayed grayscale value and the average displayed grayscale value of the image partition; and The maximum display grayscale value and the average display grayscale value of each image partition are weighted to obtain the backlight value of the backlight partition corresponding to the image partition.

24. A backlight adjustment device for a display device, comprising: The input module is configured to input multiple frames of images to the display device; The first acquisition module is configured to acquire multiple backlight matrices corresponding to the multiple frames of images, wherein the backlight matrix includes multiple backlight values; The second acquisition module is configured to acquire, based on the backlight matrix, a connected component consisting of positive backlight values; The first determining module is configured to determine an adjustment scheme for the backlight value of the boundary position of the connected component based on the connected component. as well as The output module is configured to output the adjusted backlight matrix to the backlight display module. The first determining module is further configured to: obtain a first parameter based on the connected component; set a threshold for the first parameter; compare the first parameter with the threshold: if the first parameter is less than or equal to the threshold, then adjust the backlight value at the boundary position of the connected component using a first adjustment scheme; if the first parameter is greater than the threshold, then adjust the backlight value at the boundary position of the connected component using either the first adjustment scheme or a second adjustment scheme, wherein the first adjustment scheme and the second adjustment scheme are different, and the first parameter includes: the ratio of the perimeter of the connected component to the perimeter of the backlight area; or the ratio of the area of ​​the connected component to the area of ​​the backlight area, or The first acquisition module is further configured to acquire the backlight matrix corresponding to any two adjacent frames of images. The backlight adjustment device further includes a third acquisition module, a second determination module, and a judgment module. The third acquisition module is configured to acquire a backlight difference matrix based on the backlight matrix of any two adjacent frames of images. The second determination module is configured to determine the backlight change position based on the backlight difference matrix. The judgment module is configured to determine the backlight change trend at the backlight change position based on the backlight difference matrix.

25. A computer system comprising a memory, a processor, and a computer program stored in the memory, wherein, The processor executes the computer program to implement the steps of the backlight adjustment method according to any one of claims 1-23.

26. A computer-readable storage medium having a computer program stored thereon, wherein, When executed by a processor, the computer program implements the steps of the backlight adjustment method according to any one of claims 1-23.

27. A computer program product comprising a computer program, wherein, When executed by a processor, the computer program performs the steps of the method described in any one of claims 1-23.

Images