Backlight adjusting method, device and system of display device, storage medium and product
Patent Information
- Application Number
- CN202380009063.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-10
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2043-05-10
AI Technical Summary
Existing LCD displays suffer from uneven backlight halo effects when displaying objects of different sizes, resulting in poor visual experience. Furthermore, hardware solutions are costly and have long development cycles.
By acquiring the backlight matrix corresponding to multiple frames of images, connected components are identified, and different backlight value adjustment schemes are selected based on the parameters and thresholds of the connected components, including weighted coefficient adjustment and filtering processing, to optimize the backlight values at boundary positions and reduce hardware dependence.
It effectively improves the backlight halo problem, reduces costs and development cycle, improves display effect, and avoids abnormal backlight values and flickering.
Smart Images

Figure CN119301669A_ABST
Abstract
Description
Backlight adjustment method, device, system, storage medium and product for display device Technical Field
[0001] Embodiments of the present disclosure relate to a backlight adjustment method for a display device, a backlight adjustment device for a display device, a computer system, a computer-readable storage medium, and a computer program product. Background Art
[0002] Liquid crystal displays (LCDs) offer advantages such as ultra-long lifespan, low power consumption, low operating voltage, high color rendering index, fast response time, environmental friendliness, compact size, and low radiation. They are widely used in electronic devices such as laptops, mobile phones, and LCD TVs. LCDs are passive light-emitting devices, primarily consisting of a liquid crystal display panel and a backlight. The LCD panel itself does not emit light, but relies on the backlight to provide it with light. To reduce power consumption and improve display contrast, LCDs with local backlight brightness adjustment capabilities have gradually developed.
[0003] Summary of the Invention
[0004] When reducing the halo corresponding to the backlight of objects in a display image to solve the problem of excessive halo, if the same backlight processing process is used for objects of different sizes, the resulting halo will be visually perceived differently. The disclosed embodiments provide a backlight adjustment method for a display device, which can select an appropriate backlight adjustment solution for different objects in the display image, thereby more effectively improving the backlight halo problem.
[0005] At least one embodiment of the present disclosure provides a backlight adjustment method for a display device, comprising: inputting multiple frames of images to the display device; obtaining multiple backlight matrices corresponding to the multiple frames of images, the backlight matrices including multiple backlight values; obtaining a connected domain consisting of positive backlight values based on the backlight matrices; and determining an adjustment scheme for the backlight value at a boundary position of the connected domain based on the connected domain.
[0006] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, determining an adjustment scheme for the backlight value at the boundary position of the connected domain based on the connected domain includes: obtaining a first parameter based on the connected domain; setting a first parameter threshold, and comparing the first parameter with the first parameter threshold: if the first parameter is less than or equal to the first parameter threshold, adopting the first adjustment scheme to adjust the backlight value at the boundary position of the connected domain; if the first parameter is greater than the first parameter threshold, adopting the first adjustment scheme or the second adjustment scheme to adjust the backlight value at the boundary position of the connected domain, and the first adjustment scheme and the second adjustment scheme are different.
[0007] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, the first parameter includes: the ratio of the perimeter of the connected domain to the perimeter of the backlight area; or the ratio of the area of the connected domain to the area of the backlight area.
[0008] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, after determining that the first parameter is greater than the first parameter threshold, determining, based on the connected domain, an adjustment scheme for the backlight value at the boundary position of the connected domain further includes: obtaining a second parameter based on the connected domain; setting a second parameter threshold, and comparing the second parameter with the second parameter threshold: if the second parameter is less than or equal to the second parameter threshold, adopting the second adjustment scheme to adjust the backlight value at the boundary position of the connected domain; if the second parameter is greater than the second parameter threshold, determining whether to adopt the first adjustment scheme based on a third parameter.
[0009] For example, in the backlight adjustment method provided by an embodiment of the present disclosure, the second parameter includes a ratio between a maximum boundary distance and a minimum boundary distance of the connected domain.
[0010] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, after determining that the second parameter is greater than the second parameter threshold, determining, based on the connected domain, an adjustment scheme for the backlight value at the boundary position of the connected domain also includes: obtaining, based on the connected domain, the third parameter; setting a third parameter threshold, and comparing the third parameter with the third parameter threshold: if the third parameter is less than or equal to the third parameter threshold, adopting the first adjustment scheme to adjust the backlight value at the boundary position of the connected domain; if the third parameter is greater than the third parameter threshold, adopting the second adjustment scheme to adjust the backlight value at the boundary position of the connected domain.
[0011] For example, in the backlight adjustment method provided by an embodiment of the present disclosure, the third parameter includes a ratio of the minimum boundary distance of the connected domain to the minimum boundary distance of the backlight area.
[0012] For example, in the backlight adjustment method provided in one embodiment of the present disclosure, the first adjustment scheme includes: multiplying the backlight value at the boundary position of the connected domain by a weighting coefficient; the second adjustment scheme includes: filtering the backlight value at the boundary position of the connected domain.
[0013] For example, in the backlight adjustment method provided in one embodiment of the present disclosure, before filtering the backlight value at the boundary position of the connected domain, the second adjustment scheme also includes: determining the number and position of zero backlight values at adjacent positions of the boundary position of the connected domain; and selecting a filtering operator based on the determination result.
[0014] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, the backlight matrix includes a row direction and a column direction, the number of adjacent positions of the boundary position of the connected domain is four, and the four adjacent positions include: a first adjacent position and a second adjacent position opposite to each other in the row direction with the boundary position as the center, and a third adjacent position and a fourth adjacent position opposite to each other in the column direction; according to the judgment result, selecting the filtering operator includes: if the backlight value of one of the first adjacent position and the second adjacent position is zero and the backlight value of one of the third adjacent position and the fourth adjacent position is zero, then selecting an N*N type filtering operator or a "cross" type filtering operator; if the backlight value of one of the first adjacent position and the second adjacent position is zero, then selecting a 1*N type filtering operator; and if the backlight value of one of the third adjacent position and the fourth adjacent position is zero, then selecting an N*1 type filtering operator, where N is an odd number greater than or equal to 3.
[0015] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, obtaining multiple backlight matrices corresponding to the multiple frames of images includes: obtaining the backlight matrices corresponding to any two adjacent frames of images, and the backlight adjustment method also includes: obtaining a backlight difference matrix based on the backlight matrices of the any two adjacent frames of images; determining a backlight change position based on the backlight difference matrix; and judging a backlight change trend of the backlight change position based on the backlight difference matrix.
[0016] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, the difference value in the backlight difference matrix includes zero, a positive number or a negative number. According to the backlight difference matrix, determining the backlight change position includes: if the difference value in the backlight difference matrix is a positive number or a negative number, then confirming that the position where the difference value is located is the backlight change position.
[0017] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, judging the backlight change trend of the backlight change position according to the backlight difference matrix includes: determining the backlight change position with a positive difference value according to the backlight difference matrix; judging whether the difference value of the position adjacent to the positive backlight change position is zero; and judging the backlight change trend of the backlight change position according to the judgment result.
[0018] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, the adjacent positions of the backlight change position include a first position, a second position, a third position and a fourth position arranged clockwise with the backlight change position as the center, and according to the judgment result, judging the backlight change trend of the backlight change position includes: if the difference value of only one position among the first position, the second position, the third position and the fourth position is zero, then the backlight change trend of the backlight change position is toward the position where the difference value is zero; if the difference value of any two adjacent positions among the first position, the second position, the third position and the fourth position is zero, then the backlight change trend of the backlight change position is toward between the two adjacent positions; and if the difference value of any three positions among the first position, the second position, the third position and the fourth position is zero, then the backlight change trend of the backlight change position is toward the opposite direction of the only position among the four positions whose difference value is not zero.
[0019] For example, the backlight adjustment method provided in an embodiment of the present disclosure further includes: adjusting the backlight value of the position adjacent to the backlight change position according to the backlight change trend, wherein the backlight difference value of the position adjacent to the backlight change position is 0.
[0020] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, adjusting the backlight value of a position adjacent to the backlight change position according to the backlight change trend includes: determining a backlight change position with a positive difference value; along the backlight change trend, determining a fifth position adjacent to the positive backlight change position and a sixth position adjacent to the fifth position; and adjusting the backlight value of the fifth position.
[0021] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, the backlight value at the fifth position is calculated using a nonlinear interpolation method, and the calculation formula is:
[0022] or
[0023] The backlight matrix includes a row direction and a column direction, i, j represent the row direction index and column direction index of the backlight matrix respectively, y t represents the backlight value of the backlight matrix at time t, α represents the adaptive adjustment parameter, and its calculation formula is:
[0024] For example, the backlight adjustment method provided in an embodiment of the present disclosure further includes: adjusting the backlight value of the backlight change position to zero according to the backlight change trend.
[0025] For example, the backlight adjustment method provided in an embodiment of the present disclosure further includes: acquiring the backlight matrix according to the display grayscale value of the image.
[0026] For example, in the backlight adjustment method provided in an embodiment of the present disclosure, the backlight area includes multiple backlight partitions, and the multiple backlight partitions correspond one-to-one to the multiple backlight values of the backlight matrix. The image includes multiple image partitions, and the multiple backlight partitions correspond one-to-one to the multiple image partitions. The image partition includes multiple pixel points. According to the display grayscale value of the image, obtaining the backlight matrix includes: obtaining the maximum display grayscale value and the average display grayscale value of the image partition according to the display grayscale value of the multiple pixel points of each of the image partitions; and weighting the maximum display grayscale value and the average grayscale value of each of the image partitions to obtain the backlight value of the backlight partition corresponding to the image partition.
[0027] At least one embodiment of the present disclosure provides a backlight adjustment device for a display device, comprising: an input module configured to input multiple frames of images to the display device; a first acquisition module configured to acquire multiple backlight matrices corresponding to the multiple frames of images, the backlight matrix including multiple backlight values; a second acquisition module configured to acquire a connected domain consisting of positive backlight values based on the backlight matrix; and a first determination module configured to determine an adjustment scheme for the backlight value at a boundary position of the connected domain based on the connected domain.
[0028] At least one embodiment of the present disclosure provides a computer system, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any one of the above-mentioned backlight adjustment methods.
[0029] At least one embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of any of the above-mentioned backlight adjustment methods.
[0030] At least one embodiment of the present disclosure provides a computer program product, including a computer program, wherein the computer program implements the steps of any of the above methods when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, rather than limiting the present disclosure.
[0032] FIG1 is a flow chart of a backlight adjustment method provided by an embodiment of the present disclosure;
[0033] FIG2 is a schematic diagram of a correspondence between backlight partitions and image partitions provided by an embodiment of the present disclosure;
[0034] FIG3 is a schematic diagram of a connected domain provided by an embodiment of the present disclosure;
[0035] FIG4 is a flowchart of a solution for adjusting a backlight value based on a connected domain to determine a boundary position of the connected domain according to an embodiment of the present disclosure;
[0036] FIG5 is a schematic diagram of a filtering operator provided by an embodiment of the present disclosure;
[0037] FIG6 is a flow chart of another backlight adjustment method provided by an embodiment of the present disclosure;
[0038] FIG7 is a schematic diagram of a backlight difference matrix provided by an embodiment of the present disclosure;
[0039] FIG8 is a schematic diagram of a backlight change position and its adjacent positions provided by an embodiment of the present disclosure;
[0040] FIG9 is a schematic diagram of a nonlinear interpolation method provided by an embodiment of the present disclosure;
[0041] FIG10 is a flow chart of a backlight adjustment method provided by an embodiment of the present disclosure;
[0042] FIG11A is a flowchart of backlight adjustment provided by an embodiment of the present disclosure;
[0043] FIG11B is a flowchart of another backlight adjustment provided by an embodiment of the present disclosure; and
[0044] FIG12 is a schematic diagram of a backlight adjustment device provided in accordance with an embodiment of the present disclosure. DETAILED DESCRIPTION
[0045] To make the purpose, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
[0046] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by persons of ordinary skill in the field to which this disclosure belongs. The words "first", "second" and similar terms used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Words such as "include" or "comprise" mean that the elements or objects preceding the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.
[0047] Unless otherwise defined, the features such as “parallel”, “perpendicular” and “identical” used in the embodiments of the present disclosure include situations such as “parallel”, “perpendicular” and “identical” in a strict sense, as well as situations such as “approximately parallel”, “approximately perpendicular” and “approximately identical” that contain a certain error. For example, the above-mentioned “approximately” may mean that the difference between the compared objects is 10% of the average value of the compared objects, or within 5%. When the number of a component or element is not specifically indicated below in the embodiments of the present disclosure, it means that the component or element may be one or more, or may be understood as at least one. “At least one” refers to one or more, and “plurality” refers to at least two.
[0048] When the backlight source of an LCD panel uses a flat light source, the backlight will brighten or dim as a whole during the display process, making it impossible to achieve precise light control. To achieve independent control of backlight brightness, LCD panels can use backlight zone adjustment technology. This divides the image signal into several zones, analyzes and calculates the grayscale of the image in each zone, and then automatically controls the brightness of the backlight source corresponding to the image in each zone, thereby achieving independent brightness control of each zone.
[0049] When reducing the halo associated with the backlighting of objects in the display image to address excessive haloing, the visual perception of haloing varies for objects of different sizes using the same backlighting process. For example, with the same backlighting value, the haloing appears smaller for large objects and larger for small objects. Therefore, using the same backlighting process for objects of different sizes does not effectively address haloing.
[0050] Furthermore, backlight dimming technology is often implemented using chip-level hardware, such as Field Programmable Gate Array (FPGA) chips, which can simultaneously implement backlight adjustment and pixel compensation. However, hardware development costs are high and development cycles are long, making system integration difficult to achieve in a short period of time.
[0051] To this end, embodiments of the present disclosure provide a backlight adjustment method for a display device, a backlight adjustment device for a display device, a computer system, a computer-readable storage medium, and a computer program product. The backlight adjustment method includes: inputting multiple frames of images to a display device; obtaining multiple backlight matrices corresponding to the multiple frames of images, the backlight matrices including multiple backlight values; obtaining a connected domain consisting of positive backlight values based on the backlight matrices; and determining, based on the connected domain, an adjustment scheme for the backlight values at the boundaries of the connected domain.
[0052] In the backlight adjustment method provided in the embodiment of the present disclosure, different connected domains can use different backlight value adjustment schemes at different boundary positions. Therefore, for different objects in the display screen, a suitable backlight adjustment scheme can be selected, thereby more effectively improving the backlight halo problem.
[0053] In addition, the backlight halo problem can be improved by using the backlight value without adding other chips. It can be achieved through the scaler board of the display device, thereby reducing costs and development cycles.
[0054] Below, the backlight adjustment method, computer system, computer-readable storage medium, and computer program product provided by the embodiments of the present disclosure are described in detail with reference to the accompanying drawings.
[0055] An embodiment of the present disclosure provides a backlight adjustment method. FIG1 is a flow chart of a backlight adjustment method provided by an embodiment of the present disclosure. As shown in FIG1 , the backlight adjustment method includes the following steps:
[0056] S100: Input multiple frames of images to a display device;
[0057] S200: Acquire multiple backlight matrices corresponding to multiple frames of images, where the backlight matrices include multiple backlight values;
[0058] S300: Obtaining a connected region consisting of positive backlight values according to the backlight matrix;
[0059] S400: Determine, according to the connected domain, a solution for adjusting the backlight value at the boundary position of the connected domain.
[0060] The multiple backlight values of the backlight matrix can be calculated based on the display grayscale value of the input image. Figure 2 is a schematic diagram of the correspondence between a backlight partition and an image partition provided by an embodiment of the present disclosure. As shown in Figure 2, the backlight module of the display device includes a plurality of backlight sources 10 arranged in an array. In order to more clearly illustrate the correspondence between the backlight partition and the image partition, only one backlight source 10 is schematically shown in the figure. The multiple backlight sources of the backlight module form the backlight area of the display device. The backlight area of the display device includes a plurality of backlight partitions, and the plurality of backlight partitions correspond one-to-one to the plurality of backlight sources. The image includes a plurality of image partitions 20, and the plurality of backlight partitions correspond one-to-one to the plurality of image partitions 20. Each image partition 20 includes a plurality of pixel points. According to the display grayscale values of the plurality of pixel points of each image partition, the backlight value of the backlight partition corresponding to the image partition can be obtained, so that the corresponding backlight matrix can be obtained according to the input image. The embodiment of the present disclosure does not limit the method for calculating the backlight value.
[0061] For example, the color of each pixel in the image partition is composed of the colors of three channels: red (Red), green (Green) and blue (Blue). In order to obtain the backlight value, it is necessary to first convert the three-color values of red, green and blue into the display grayscale value of the pixel point, and then the backlight value of the corresponding backlight partition can be obtained based on the display grayscale values of multiple pixels. For example, the conversion formula of the display grayscale value can be: Gray = R*0.299+G*0.587+B*0.114, Gray is the display grayscale value, and R, G and B represent the three-color values of red, green and blue, respectively. Of course, the embodiment of the present disclosure does not specifically limit the conversion formula of the display grayscale value.
[0062] FIG3 is a schematic diagram of a connected domain provided by an embodiment of the present disclosure. As shown in FIG3 , a connected domain consisting of positive backlight values can be obtained through the backlight matrix. The dotted box in the figure is a connected domain, and based on the connected domain, an adjustment scheme for the backlight value at the boundary position of the connected domain is determined. As shown in FIG3 , the boundary positions of the connected domain are respectively the positions of backlight values 30, 15, 12, 30, 13, 9, and 18. By adjusting the backlight values at these boundary positions, the backlight halo can be improved. FIG3 is used to schematically illustrate the connected domain and its boundary positions, and does not make other limitations.
[0063] In the backlight adjustment method provided in the embodiment of the present disclosure, different connected domains can use different backlight value adjustment schemes at different boundary positions. Thus, for different objects in the display screen, the backlight halo problem can be more effectively improved, avoiding the problem of abnormal backlight value adjustment or disappearance of backlight value.
[0064] In addition, the backlight halo problem can be improved by using the backlight value without adding other chips. It can be achieved through the scaler board of the display device, thereby reducing costs and development cycles.
[0065] It should be noted that the boundary position of a connected domain means that at least one of the adjacent positions has a backlight value of 0, or at least one of the adjacent positions has a backlight value less than or equal to a preset value, for example, the preset value may be 3. All boundary positions of the connected domain constitute the boundary of the connected domain. By adjusting the backlight value of the boundary position of the connected domain, the backlight halo problem can be improved. For information about the connected domain and the boundary position of the connected domain, please refer to the following embodiments and figures.
[0066] In some examples, in step S400, determining an adjustment scheme for the backlight value at the boundary position of the connected domain includes:
[0067] S410: Obtain a first parameter according to the connected domain;
[0068] S420: Setting a first parameter threshold, and comparing the first parameter with the first parameter threshold;
[0069] S430: If the first parameter is less than or equal to the first parameter threshold, use the first adjustment solution to adjust the backlight value at the boundary position of the connected domain;
[0070] S440: If the first parameter is greater than the first parameter threshold, the backlight value at the boundary position of the connected domain is adjusted using a first adjustment scheme or a second adjustment scheme, wherein the first adjustment scheme and the second adjustment scheme are different.
[0071] In some examples, the first parameter may be the ratio of the perimeter of the connected domain to the perimeter of the backlight region. For example, the first parameter may also be the ratio of the area of the connected domain to the area of the backlight region. Of course, the embodiments of the present disclosure do not limit the first parameter.
[0072] In some examples, the first parameter threshold may be 1 / 10. For example, the first parameter threshold may be any value greater than or equal to 1 / 10. Of course, the embodiments of the present disclosure do not limit the first parameter threshold.
[0073] The first parameter and the first parameter threshold can be used to determine the size relationship between the connected domain and the backlight area. For example, when the first parameter is less than or equal to the first parameter threshold, the connected domain accounts for a relatively small proportion within the backlight area. For example, when the first parameter is greater than the first parameter threshold, the connected domain accounts for a relatively large proportion within the backlight area. It should be noted that the "large" and "small" here are relative values, not absolute values.
[0074] For example, objects in an image can be divided into large objects and small objects. For example, when the first parameter is less than or equal to the first parameter threshold, the object is determined to be a small object, and thus, the backlight of the small object can use the first adjustment scheme. For example, when the first parameter is greater than the first parameter threshold, the object is determined to be a large object. For large objects, further judgment can be made to select the first adjustment scheme or the second adjustment scheme. It should be noted that the large objects and small objects here are relative to the backlight area, not absolute large objects and absolute small objects, and are related to the setting of the first parameter threshold. The introduction of the concepts of large objects and small objects is only used to schematically illustrate the selection of the first adjustment scheme and the second adjustment scheme, and is not a limitation on the selection of the first adjustment scheme and the second adjustment scheme.
[0075] In some examples, in step S440, after determining that the first parameter is greater than the first parameter threshold, the backlight adjustment method further includes:
[0076] S441: Obtain a second parameter according to the connected domain;
[0077] S442: Setting a second parameter threshold, and comparing the second parameter with the second parameter threshold;
[0078] S443: If the second parameter is less than or equal to the second parameter threshold, use the second adjustment solution to adjust the backlight value at the boundary position of the connected domain;
[0079] S444: If the second parameter is greater than the second parameter threshold, determine whether to adopt the first adjustment solution according to the third parameter.
[0080] In some examples, the second parameter includes a ratio between a maximum boundary distance and a minimum boundary distance of the connected domain. Of course, the embodiment of the present disclosure does not limit the second parameter.
[0081] It should be noted that the maximum and minimum boundary distances of a connected domain can be obtained using the following method: Take an arbitrary first point on the boundary of the connected domain, determine the tangent line to the first point, and then take a perpendicular line through the tangent line of the first point, passing through the connected domain and intersecting the boundary of the connected domain at a second point. The distance between the first and second points is called the boundary distance. By traversing all points on the boundary of the connected domain, all boundary distances can be obtained. Among all the boundary distances obtained, the smallest value is called the minimum boundary distance, and the largest value is called the maximum boundary distance.
[0082] In some examples, the second parameter threshold may be 3, for example, the second parameter threshold may be any positive integer greater than or equal to 3. Of course, the embodiment of the present disclosure does not limit the second parameter threshold.
[0083] The second parameter and its threshold can be used to determine the approximate shape of an object. For example, if the second parameter is less than or equal to the threshold, the ratio of the maximum boundary distance to the minimum boundary distance of the connected domain is within 3. As a result, the object's dimensions are relatively balanced in all directions, with no particular dimension being excessively large or small. It should be noted that the terms "large" and "small" are relative, not absolute.
[0084] For example, the large objects introduced above can also be divided into normal large objects and extremely large objects. For example, when the second parameter is less than or equal to the second parameter threshold, the object is determined to be a normal large object, so that the backlight of the normal large object can use the second adjustment scheme. For example, when the second parameter is greater than the second parameter threshold, for large objects, further judgment can be made to select the first adjustment scheme or the second adjustment scheme. It should be noted that the normal large objects and extremely large objects (such as extremely narrow strips or long thin lines) here are relative to the boundary distance of the connected domain, and are related to the setting of the second parameter threshold. The introduction of the concepts of normal large objects and extremely large objects is only used to schematically illustrate the selection of the first adjustment scheme and the second adjustment scheme, and is not a limitation on the selection of the first adjustment scheme and the second adjustment scheme.
[0085] In some examples, in step S444, after determining that the second parameter is greater than the second parameter threshold, the backlight adjustment method further includes:
[0086] S4441: Obtain a third parameter according to the connected domain;
[0087] S4442: Setting a third parameter threshold, and comparing the third parameter with the third parameter threshold;
[0088] S4443: If the third parameter is less than or equal to the third parameter threshold, use the first adjustment solution to adjust the backlight value at the boundary position of the connected domain;
[0089] S4444: If the third parameter is greater than the third parameter threshold, use the second adjustment solution to adjust the backlight value at the boundary position of the connected domain.
[0090] In some examples, the third parameter includes a ratio of a minimum boundary distance of the connected domain to a minimum boundary distance of the backlight area. Of course, the embodiment of the present disclosure does not limit the third parameter.
[0091] It should be noted that the minimum boundary distance of the backlight area is the minimum value among the boundary distances of the backlight area. For example, when the backlight area is rectangular, the minimum boundary distance of the backlight matrix is the length of the short side of the rectangle.
[0092] In some examples, the third parameter threshold may be 1 / 10. For example, the third parameter threshold may be any value greater than or equal to 1 / 10. Of course, the present disclosure does not limit the third parameter threshold.
[0093] Objects can be further screened by the third parameter and the third parameter threshold. For example, if the third parameter is less than or equal to the third parameter threshold, the ratio of the minimum boundary distance of the connected domain to the minimum boundary distance of the backlight area is less than or equal to 1 / 10, so that the size of the object in a certain direction is relatively small relative to the minimum boundary distance of the backlight area. For example, the object can be an extremely narrow strip or a long thin line. For example, if the third parameter is greater than the third parameter threshold, the ratio of the minimum boundary distance of the connected domain to the minimum boundary distance of the backlight area is greater than 1 / 10, so that the minimum size of the object relative to the minimum boundary distance of the backlight area is greater than the set value. It can also be understood that the object has no smaller size relative to the minimum boundary distance of the backlight area. It should be noted that big and small here are relative values, not absolute values.
[0094] For example, the large objects described above can be further divided into normal large objects and extremely large objects. When the third parameter is less than or equal to the third parameter threshold, the object is determined to be extremely large, and thus, the first backlight adjustment scheme can be used for the extremely large object. For example, when the third parameter is greater than the third parameter threshold, the object is determined to be normal large, and thus, the second backlight adjustment scheme can be used for the normal large object. For example, an extremely large object here can be understood as a large object whose size in at least one direction is relatively small relative to the minimum boundary distance of the backlight area. A normal large object is a large object other than an extremely large object.
[0095] The backlight value adjustment scheme at the boundary position of the connected domain can be determined by the first parameter, the first parameter threshold, the second parameter, the second parameter threshold, the third parameter and the third parameter threshold, so that different backlight value adjustment schemes can be selected according to different objects.
[0096] For example, the perimeter or area of the connected domain of a very narrow strip or line may be larger than the first parameter threshold, but the halo treatment for these special shapes cannot be the same as for shapes such as squares with the same connected domain perimeter or area. Therefore, by using multiple parameters and corresponding parameter thresholds, objects can be more accurately segmented, allowing for the selection of appropriate backlight adjustment solutions and better backlight optimization.
[0097] Figure 4 is a flow chart of a backlight adjustment scheme for determining the boundary positions of connected domains based on connected domains, according to an embodiment of the present disclosure. This flow chart allows for the selection of appropriate backlight adjustment schemes for different connected domains, thereby more effectively improving backlight haloing for different objects in the display image.
[0098] In some examples, the first adjustment scheme includes multiplying the backlight value at the boundary of the connected domain by a weighting coefficient. The second adjustment scheme includes filtering the backlight value at the boundary of the connected domain to adjust the backlight value at the boundary of the connected domain.
[0099] For objects using the first adjustment scheme, their backlight values are generally small, so changes in the backlight value will cause relatively large changes in the perception. Therefore, when adjusting the backlight value of the object, large changes in the backlight value cannot occur. Using the weighted coefficient method to change the backlight value of the object can avoid large changes in the backlight value, thereby improving and optimizing the halo of the object's backlight without affecting the perception change and display effect of the object.
[0100] For example, the weighting coefficient may be any value less than 1. For example, the weighting coefficient may range from 0.6 to 1. For example, the weighting coefficient may be 0.9, 0.8, etc. Of course, the embodiment of the present disclosure does not limit the weighting coefficient.
[0101] For objects using the second adjustment scheme, the corresponding backlight area is larger, and changes in the backlight value at its boundary position are not likely to cause significant changes in the visual experience. If the above-mentioned weighted coefficient method is used for adjustment, it is not easy to achieve the effect of improving the light source. In addition, the backlight values at the boundary positions of different objects at different times are not necessarily the same. If the backlight value at the boundary position is reduced by the same proportion, the halo at the edge of the object will fluctuate, affecting the visual experience. The use of filtering processing not only makes the halo at the edge of the object more obvious, but also can adapt to the backlight values of boundary positions of different sizes to avoid the problem of halo flickering.
[0102] In some examples, before filtering the backlight value at the boundary position of the connected domain, the method further includes: determining the number and positions of zero backlight values at positions adjacent to the boundary position of the connected domain; and selecting a filtering operator based on the determination result.
[0103] By determining the backlight values of adjacent locations at the boundary, different filter operators can be selected. Selecting the appropriate filter operator based on the judgment results can not only better optimize haloing, but also avoid using unsuitable filter operators, which not only fail to improve the halo effect but also cause abnormal backlight changes.
[0104] In some examples, the backlight matrix includes a row direction and a column direction, and the number of adjacent positions of a boundary position is four. The four adjacent positions include: a first adjacent position and a second adjacent position opposite to each other in the row direction, centered on the boundary position, and a third adjacent position and a fourth adjacent position opposite to each other in the column direction. Based on the judgment result, selecting a filter operator includes: if the backlight value of one of the first and second adjacent positions is zero and the backlight value of one of the third and fourth adjacent positions is zero, selecting an N*N filter operator or a "cross" filter operator; if the backlight value of one of the first and second adjacent positions is zero, selecting a 1*N filter operator; and if the backlight value of one of the third and fourth adjacent positions is zero, selecting an N*1 filter operator. N is an odd number greater than or equal to 3.
[0105] By determining the number and positions of zero backlight values at positions adjacent to a boundary position, a suitable filtering operator can be selected, thereby enabling better halo optimization of the backlight value at the boundary position.
[0106] Figure 5 is a schematic diagram of a filter operator provided in one embodiment of the present disclosure. As shown in Figure 5 , assuming N = 3, Figure 5(a) illustrates a 1*3 filter operator, Figure 5(b) illustrates a 3*1 filter operator, Figure 5(c) illustrates a "cross" filter operator, and Figure 5(d) illustrates a 3*3 filter operator. Figure 5 merely schematically illustrates four filter operators and does not limit the filter operators of the present disclosure.
[0107] In some examples, as shown in Figures 3 and 5, at the boundary position of the connected domain, the boundary position corresponding to the backlight value 15 has backlight values of 30 and 12 for its first and second adjacent positions, respectively. The backlight values of the first and second adjacent positions are both non-zero, and one of the backlight values of its third and fourth adjacent positions is 0. Therefore, an N*1 filter operator is selected for filtering at this boundary position. Selecting an N*1 filter operator can better optimize the halo of the backlight value, so that the adjusted backlight value is closer to the direction in which the backlight value of its adjacent position is 0, which corresponds to the column direction in this example, to prevent the backlight values in other directions of the boundary position from affecting its halo optimization.
[0108] It should be noted that FIG3 is used to schematically illustrate how to select a suitable filtering operator at different boundary positions, and this figure does not impose any other limitations.
[0109] For example, as shown in FIG3 and FIG5, the 3*1 mean filter operator is used to filter the boundary position where the backlight value 15 is located as an example. The filtering calculation formula for the backlight value at the boundary position is: (0+15+45) / 3=20.
[0110] For example, as shown in Figures 3 and 5, at the boundary position corresponding to the backlight value of 18, one of the backlight values of the first adjacent position and the second adjacent position is 0, and the backlight values of the third adjacent position and the fourth adjacent position are 30 and 9, respectively. The backlight values of the third adjacent position and the fourth adjacent position are both non-zero. Therefore, the 1*N filter operator is selected for filtering at this boundary position. The use of the 1*N filter operator can better optimize the halo of the backlight value, so that the adjusted backlight value is closer to the direction where the backlight value of its adjacent position is 0, which corresponds to the row direction in this example, to avoid the backlight values in other directions of the boundary position affecting its halo optimization.
[0111] For example, as shown in FIG3 and FIG5, the 1*3 mean filter operator is used to filter the boundary position where the backlight value 18 is located. The filtering calculation formula for the backlight value at the boundary position is: (0+18+45) / 3=21.
[0112] For example, as shown in Figures 3 and 5, at the boundary position corresponding to the backlight value 30, one of the backlight values of the first adjacent position and the second adjacent position is 0, and one of the backlight values of the third adjacent position and the fourth adjacent position is 0. Therefore, the boundary position is filtered using an N*N filter operator or a "cross" filter operator. Selecting an N*N filter operator or a "cross" filter operator can comprehensively consider the backlight values of the adjacent positions or surrounding positions of the boundary position, that is, it can simultaneously consider the backlight values in the row direction and the column direction, thereby better optimizing the halo of the backlight value.
[0113] For example, as shown in Figures 3 and 5, the "cross" type mean filter operator is used to filter the boundary position where the backlight value 30 is located as an example. The filtering calculation formula for the backlight value at the boundary position is: (0+30+18+0+15) / 5=12.
[0114] Similarly, the above method is used to sequentially filter all boundary positions of the connected domain, thereby achieving halo optimization of the object backlight.
[0115] Using different backlight adjustment schemes for different objects can also avoid the problem of backlight value disappearance. For example, for some special graphics, such as extremely narrow strips or thin lines, there may be only one or two backlight values corresponding to the short side direction. If the backlight value is adjusted using the filtering operator method, for example, using a 1*3 filter operator or a 3*1 filter operator, it may cause the backlight value to decrease too much and fail to reach the set brightness, resulting in the problem of backlight value disappearance. Through the above-mentioned multiple parameters and the corresponding parameter thresholds, these special graphics can be accurately screened out, so that the first adjustment scheme can be selected to avoid abnormal backlight value adjustment problems such as backlight value disappearance.
[0116] In some examples, acquiring multiple backlight matrices corresponding to multiple image frames includes acquiring backlight matrices corresponding to any two adjacent image frames. It should be noted that each image frame in the multiple image frames corresponds to a backlight matrix. For example, the multiple image frames include at least three image frames. For example, the multiple image frames include a previous image frame, a current image frame, and a next image frame. For example, two adjacent image frames include a previous image frame and a current image frame, or a current image frame and a next image frame.
[0117] FIG6 is a flow chart of another backlight adjustment method provided by an embodiment of the present disclosure. As shown in FIG6 , the backlight adjustment method further includes:
[0118] S300': obtaining a backlight difference matrix according to the backlight matrices of any two adjacent frames of images;
[0119] S400': determining a backlight change position according to the backlight difference matrix; and
[0120] S500': judging the backlight change trend of the backlight change position according to the backlight difference matrix.
[0121] In the embodiment of the present disclosure, the backlight change position and the backlight change trend of the backlight change position can be determined through the backlight difference matrix, so that the backlight optimization of the flickering and smearing of the moving object in the display image can be performed. When the object moves, the flickering and smearing of the moving object mainly appear at the backlight edge of the object, and the part that needs to be optimized is the part where the backlight changes. Therefore, the essence of backlight optimization is to optimize the place where the backlight changes. Through the backlight difference matrix, the backlight change position, the backlight difference value and the backlight change trend can be determined simply and effectively, so that the backlight optimization of the flickering and smearing of the moving object can be performed simply and effectively. For example, the backlight optimization method can be used to improve the flickering and smearing of the backlight of high refresh monitors (for example, e-sports monitors).
[0122] Furthermore, backlight optimization for flicker and smearing in moving objects using a backlight difference matrix can be achieved using the display device's scaler board without the need for additional chips, thus reducing costs and development cycles. Existing methods such as sliding window and deep learning rely on large-scale computations and high algorithmic complexity, making them unsuitable for real-time backlight optimization using standalone scalers.
[0123] In some examples, the backlight difference matrix can also be used to predict the backlight change speed. For example, the number of positive values in the backlight difference matrix can be used to predict the backlight change speed. If the number of positive values in the backlight difference matrix is large, it means the backlight change speed is fast, and vice versa, it means the backlight change speed is slow.
[0124] In some examples, the difference between the backlight value of the nth frame and the backlight value of the (n-1)th frame represents a difference value of the backlight.
[0125] Figure 7 is a schematic diagram of a backlight difference matrix provided by an embodiment of the present disclosure. As shown in Figure 7, the difference values in the backlight difference matrix include zero, a positive number, or a negative number.
[0126] In some examples, determining the backlight change position according to the backlight difference matrix includes: if a difference value in the backlight difference matrix is a positive number or a negative number, confirming the position where the difference value is located as the backlight change position.
[0127] For example, if the difference value of the backlight change position is a positive number, it means that the backlight value of the backlight partition where the backlight change position is located is larger than the backlight value of the previous frame; if the difference value of the backlight change position is a negative number, it means that the backlight value of the backlight partition where the backlight change position is located is smaller than the backlight value of the previous frame; if the difference value of the backlight change position is zero, it means that the backlight value of the backlight partition where the backlight change position is located is not changed compared with the backlight value of the previous frame.
[0128] In some examples, in step S500′, determining the backlight change trend of the backlight change position according to the backlight difference matrix includes:
[0129] S510′: determining backlight change positions with positive difference values according to the backlight difference matrix;
[0130] S520': Determine whether the difference value between the adjacent position of the positive backlight change position and the positive backlight change position is zero; and
[0131] S530': judging the backlight change trend of the backlight change position according to the judgment result.
[0132] By judging whether the difference value between the backlight change position with a positive difference value and its adjacent position is zero, the backlight change trend of the backlight change position can be determined simply and effectively, thereby simply and effectively optimizing the backlight for problems such as flickering and ghosting of moving objects.
[0133] Figure 8 is a schematic diagram of a backlight change position and its adjacent positions, provided in one embodiment of the present disclosure. As shown in Figure 8 , the adjacent positions of the backlight change position include a first position, a second position, a third position, and a fourth position, arranged clockwise from the backlight change position. Figure 8 is merely a schematic illustration of the four adjacent positions of the backlight change position.
[0134] In some examples, in step S530′, determining the backlight change trend of the backlight change position according to the determination result includes:
[0135] S531′: if the difference value of only one position among the first position, the second position, the third position and the fourth position is zero, then the backlight change trend of the backlight change position is toward the position where the difference value is zero;
[0136] S532′: if the difference between any two adjacent positions among the first position, the second position, the third position and the fourth position is zero, then the backlight change trend of the backlight change position is toward between the two adjacent positions; and
[0137] S533': If the difference values of any three positions among the first position, the second position, the third position and the fourth position are zero, the backlight change trend of the backlight change position is in the opposite direction of the only position among the four positions with a non-zero difference value.
[0138] It should be noted that any two adjacent positions among the first position, the second position, the third position and the fourth position refer to two adjacent positions in the clockwise direction. For example, the first position and the second position are adjacent positions, the second position and the third position are adjacent positions, the third position and the fourth position are adjacent positions, and the fourth position and the first position are adjacent positions.
[0139] In some examples, if the difference values of the first position, the second position, the third position, and the fourth position are all non-zero, the backlight change trend of the backlight change position can be determined in combination with the current frame image and the next frame image.
[0140] In some examples, if the difference value of two non-adjacent positions among the first position, the second position, the third position and the fourth position is not zero, the difference value of the other two non-adjacent positions is zero. For example, if the difference value between the first position and the third position is not zero, and the difference value between the second position and the fourth position is zero, then the position where the difference value is positive and the position where the difference value is zero can be searched along the direction of the line connecting the first position and the third position, so that the backlight change trend of the position where the difference value is positive can be determined.
[0141] As shown in FIG7 (a), in the backlight difference matrix, the position where the difference value 30 is located is the backlight change position. Referring to the definition of adjacent positions in FIG8, the difference value between the first position and the second position is 0, and the difference value between the third position and the fourth position is not 0. The backlight change trend of the backlight change position is shown as the arrow in the figure, which is toward between the first position and the second position. As shown in FIG7 (b), in the backlight difference matrix, the position where the difference value 30 is located is the backlight change position. Referring to the definition of adjacent positions in FIG8, the difference value of the first position is 0, and the difference values of the second position, the third position and the fourth position are not 0. The backlight change trend of the backlight change position is shown as the arrow in the figure, which is toward the first position. It should be noted that FIG7 is only used to schematically illustrate how to determine the backlight change trend of the backlight change position and does not make any other limitations.
[0142] In some examples, the backlight adjustment method further includes:
[0143] S600 ′: adjusting the backlight values of positions adjacent to the backlight change position according to the backlight change trend, wherein the backlight difference values of positions adjacent to the backlight change position are zero.
[0144] According to the backlight change trend, adjusting the backlight values of positions adjacent to the backlight change position can achieve smooth operation of the backlight, thereby improving the flicker when the object moves.
[0145] When a moving object moves quickly, its backlight changes will be more obvious, especially when a small object moves, this phenomenon is particularly serious. When the backlight changes significantly, it will be reflected in the visual perception as backlight flicker. The fundamental reason is that the backlight values of adjacent frames vary greatly, that is, the backlight difference value is large. For example, the actual manifestation of the backlight flicker problem can be that the backlight value of a certain backlight partition suddenly changes from 0 to a larger backlight value, or from a larger backlight value to 0; it can also be that the backlight value of a certain backlight area suddenly changes from a smaller backlight value to a larger backlight value, or from a larger backlight value to a smaller value. According to the backlight change trend, adjusting the backlight value of the adjacent position of the backlight change position can avoid a relatively large change in the backlight difference value, thereby improving the backlight flicker problem.
[0146] In some examples, in step S600′, adjusting the backlight value of a position adjacent to the backlight change position according to the backlight change trend includes:
[0147] S610': Determine the backlight change position where the difference value is positive;
[0148] S620′: determining a fifth position adjacent to the positive backlight change position and a sixth position adjacent to the fifth position along the backlight change trend; and
[0149] S630': Adjust the backlight values of five positions.
[0150] In some examples, the backlight value at the fifth position is calculated using a nonlinear interpolation method, using the following formula:
[0151] or
[0152] The backlight matrix includes row direction and column direction, i, j represent the row direction index and column direction index of the backlight matrix respectively, y t represents the backlight value of the backlight matrix at time t, α represents the adaptive adjustment parameter, and its calculation formula is:
[0153] The effects of backlight changes at different backlight values on the human eye are also different. When the backlight value is large, a slight change in the backlight will not cause obvious visual perception; when the backlight value is small, a slight change in the backlight will also be easily perceived by the human eye. 255 is the maximum backlight value, y t-1 is the backlight value at time t-1, y t-1 The larger the adaptive adjustment parameter α is, the larger y t-1 The smaller it is, the smaller the adaptive adjustment parameter α is. By introducing the adaptive adjustment parameter α, a nonlinear interpolation method can be used for the backlight value of the fifth position, so that different backlight adjustments can be made for backlight values of different sizes, thereby better adjusting the backlight and better improving the backlight flicker problem.
[0154] FIG9 is a schematic diagram of a nonlinear interpolation method provided by an embodiment of the present disclosure. As shown in FIG9 , positions A, B, C, D, E, F, G, and H each correspond to a backlight subarea or backlight source. The backlight difference value at position A is a positive number, indicating that position A is a backlight change position. The backlight change trend determination method for a backlight change position provided in the aforementioned embodiment can be used to determine the backlight change trend at position A, which will not be further described here.
[0155] In some examples, as shown in FIG9 , assuming that the backlight change trend at position A is toward position B, position B corresponds to the fifth position, position E corresponds to the sixth position, and according to the row direction index i and column direction index j of the fifth position, according to the calculation formula: The backlight value at position B is calculated and then changed by nonlinear interpolation, thereby improving the backlight flicker problem. FIG9 is only used to schematically illustrate backlight interpolation and does not limit the backlight flicker problem.
[0156] In some examples, as shown in FIG9 , assuming that the backlight change trend at position A is toward position C, position C corresponds to the fifth position, and position G corresponds to the sixth position. According to the row direction index i and column direction index j of the fifth position, the calculation formula is: The backlight value at position C is calculated and the backlight value at position C is changed by nonlinear interpolation, thereby improving the backlight flicker problem.
[0157] According to the backlight change trend judgment method of the backlight change position provided in the above embodiment, a set of backlight change positions that need to be interpolated can be obtained, and then all elements in the set are interpolated in turn using the above method, thereby completing the backlight optimization and realizing the optimization of backlight flicker.
[0158] In some examples, the backlight adjustment method further includes: adjusting the backlight value of the backlight change position to zero according to the backlight change trend.
[0159] The embodiment of the present disclosure adjusts the backlight value of the backlight change position to zero according to the backlight change trend, so that the backlight can be turned off in advance according to the object movement trend, reducing or eliminating the backlight delay problem and improving the ghosting problem.
[0160] In local dimming display systems, backlight smearing is prone to occur, meaning that the backlighting area does not align with the image display area. This can significantly affect the display quality, especially when objects are moving rapidly. Since the backlight value is calculated based on the image and cannot be obtained before the image is displayed, this phenomenon cannot be solved through technical means. Adjusting the backlight value to zero at the backlight changing position based on the backlight change trend can improve the smearing problem and ensure that the backlight matches the image.
[0161] In some examples, adjusting the backlight value of the backlight changing position to zero according to the backlight changing trend further includes: if the difference value of the backlight changing position is a negative number and the difference value of the adjacent position of the backlight changing position is zero, adjusting the backlight value of the backlight changing position to zero.
[0162] In some examples, as shown in FIG7( b ), the difference values of adjacent positions of the difference value -15 are zero, and thus, the backlight value of the position where the difference value -15 is located is adjusted to zero, thereby improving the backlight delay problem and the ghosting problem at this position.
[0163] In some examples, the backlight adjustment method further includes: obtaining a backlight matrix based on a display grayscale value of the image.
[0164] In some examples, there are many different methods for obtaining the backlight value of the corresponding backlight partition according to each image partition of the image. For example, the maximum method, the average method, the cumulative distribution function (CDF) method, and the dynamic threshold method can be used. For example, the maximum method uses the maximum display grayscale value of the display grayscale values of multiple pixels of each image partition to calculate the backlight value of the backlight partition. This can improve the display brightness of the backlight partition, but it is prone to backlight mutations, causing backlight flickering problems. For example, the average method uses the average display grayscale value of the display grayscale values of multiple pixels of each image partition to calculate the backlight value of the backlight partition. Compared with the maximum method, the average method can save power consumption, but it will make the display brightness insufficient and easily lose very small pixels.
[0165] In some examples, obtaining the backlight matrix based on the display grayscale value of the image includes: obtaining the maximum display grayscale value and the average display grayscale value of the image partition based on the display grayscale values of multiple pixel points of each image partition; weighting the maximum display grayscale value and the average grayscale value of each image partition to obtain the backlight value of the backlight partition corresponding to the image partition.
[0166] By weighting the maximum display grayscale value and the average display grayscale value of the image partition to calculate the backlight value of the corresponding backlight partition, the advantages of the maximum method and the average method can be combined, and the backlight mutation problem caused by the maximum method and the insufficient display brightness problem caused by the average method can be improved, so that the calculated backlight value can be more optimized. It should be noted that the sum of the weighting coefficient of the maximum display grayscale value and the weighting coefficient of the average display grayscale value is 1. The embodiment of the present disclosure does not limit the weighting coefficient of the maximum display grayscale value and the weighting coefficient of the average display grayscale value. For example, the weighting coefficients of the maximum display grayscale value and the average display grayscale value can both be 0.5, or can be any other value.
[0167] In some examples, the weighting coefficients of the maximum display grayscale value and the average display grayscale value can be dynamically adjusted according to different image screens or display scenes, so that the calculated backlight value can be more optimized. For example, when the image screen is relatively bright, the weighting coefficient of the average display grayscale value can be made greater than the weighting coefficient of the maximum display grayscale value, thereby reducing the weight of the maximum display grayscale value and improving the problem of backlight mutation. For example, when the image screen switches frequently, the weighting coefficient of the average display grayscale value can be made greater than the weighting coefficient of the maximum display grayscale value, thereby improving the problem of backlight mutation caused by screen switching.
[0168] FIG10 is a flow chart of a backlight adjustment method provided by an embodiment of the present disclosure. As shown in FIG10 , the flow of the backlight adjustment method is as follows:
[0169] The backlight value is calculated based on the input image to obtain a backlight matrix. This backlight matrix is then used to obtain a backlight difference matrix. The backlight difference matrix can be used to detect the difference value and backlight change location; predict the backlight change trend and speed; and smooth the backlight change location to reduce or improve backlight flicker. This backlight adjustment method achieves detection, prediction, and smoothing, ultimately achieving backlight optimization.
[0170] FIG11A is a flow chart of backlight adjustment provided by an embodiment of the present disclosure. As shown in FIG11A , the backlight adjustment process includes:
[0171] Step 1: Input an image. For example, the image can be input into the backlight adjustment system through a multimedia interface, including but not limited to a High Definition Multimedia Interface (HDMI), a Video Graphics Array (VGA) interface, a DisplayPort (DP), or a Digital Visual Interface (DVI), etc., which is not limited in the present embodiment.
[0172] Step 2: Backlight calculation: the backlight value of the image is calculated based on the pixel value of the input image;
[0173] Step 3: Backlight optimization: Use any of the above backlight adjustment methods to optimize the backlight value to improve the display effect;
[0174] Step 4: Backlight output: The optimized backlight value is output to the backlight display module, which can be used to drive the backlight source. For example, the backlight display module is part of the backlight module, so the backlight value can be converted and mapped to driving signals such as driving current through the backlight display module to realize the lighting of the backlight source.
[0175] FIG11B is a flowchart of another backlight adjustment process provided by an embodiment of the present disclosure. As shown in FIG11B , the backlight adjustment process may further include:
[0176] Step 5: Backlight diffusion. The purpose of backlight diffusion is to simulate the optical diffusion process of the backlight source, so as to obtain the backlight value corresponding to the actual pixel point;
[0177] Step 6: Pixel compensation. Before outputting the image, pixel compensation is performed on the output image. For example, backlight adjustment can cause image pixels in areas with low backlight values to be dimmed, resulting in a subjective loss of image detail. To compensate for the loss of image detail, the pixels in areas with low backlight values are compensated, for example, by increasing the pixel value.
[0178] Step 7: Output the compensation map, which is used for display.
[0179] Based on the same inventive concept, an embodiment of the present disclosure also provides a backlight adjustment device for a display device. Figure 12 is a schematic diagram of a backlight adjustment device provided by an embodiment of the present disclosure. As shown in Figure 12, the backlight adjustment device includes: an input module 701, a first acquisition module 702, a second acquisition module 703, a first determination module 704 and an output module 705. The input module 701 is configured to input multiple frames of images to the display device; the first acquisition module 702 is configured to obtain multiple backlight matrices corresponding to the multiple frames of images, and the backlight matrix includes multiple backlight values; the second acquisition module 703 is configured to obtain a connected domain composed of positive backlight values according to the backlight matrix; the first determination module 704 is configured to determine the adjustment scheme of the backlight value at the boundary position of the connected domain according to the connected domain, and the output module 705 is configured to output the adjusted backlight matrix to the backlight display module.
[0180] Since the principle of solving the problem by the backlight adjustment device in the embodiment of the present disclosure is similar to the above-mentioned backlight adjustment method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method.
[0181] In some examples, the first determination module 704 is specifically used to: obtain a first parameter based on the connected domain; set a first parameter threshold, and compare the first parameter and the first parameter threshold: if the first parameter is less than or equal to the first parameter threshold, then use the first adjustment scheme to adjust the backlight value of the boundary position of the connected domain; if the first parameter is greater than the first parameter threshold, then use the first adjustment scheme or the second adjustment scheme to adjust the backlight value of the boundary position of the connected domain, wherein the first adjustment scheme and the second adjustment scheme are different.
[0182] In some examples, the first determination module 704 is further specifically used to: obtain a second parameter based on the connected domain; set a second parameter threshold, and compare the second parameter and the second parameter threshold: if the second parameter is less than or equal to the second parameter threshold, then adopt the second adjustment scheme to adjust the backlight value at the boundary position of the connected domain; if the second parameter is greater than the second parameter threshold, then determine whether to adopt the first adjustment scheme based on the third parameter.
[0183] In some examples, the first determination module 704 is further specifically used to: obtain a third parameter based on the connected domain; set a third parameter threshold, and compare the third parameter and the third parameter threshold: if the third parameter is less than or equal to the third parameter threshold, then use the first adjustment scheme to adjust the backlight value at the boundary position of the connected domain; if the third parameter is greater than the third parameter threshold, then use the second adjustment scheme to adjust the backlight value at the boundary position of the connected domain.
[0184] The first adjustment scheme and the second adjustment scheme are described in detail in the above embodiment and will not be repeated here.
[0185] In some examples, the first acquisition module 702 is specifically used to: acquire the backlight matrix corresponding to any two adjacent frames of images.
[0186] In some examples, the backlight adjustment device further includes a third acquisition module, a second determination module, and a judgment module. The third acquisition module is configured to acquire a backlight difference matrix based on the backlight matrices of any two adjacent frames of image, the second determination module is configured to determine a backlight change position based on the backlight difference matrix, and the judgment module is configured to determine a backlight change trend at the backlight change position based on the backlight difference matrix.
[0187] In some examples, the second determining module is specifically configured to: if the difference value in the backlight difference matrix is a positive number or a negative number, confirm that the position where the difference value is located is the backlight change position.
[0188] In some examples, the judgment module is specifically used to: determine the backlight change position with a positive difference value based on the backlight difference matrix; determine whether the difference value of the adjacent position to the positive backlight change position is zero; and determine the backlight change trend of the backlight change position based on the judgment result.
[0189] In some examples, the backlight adjustment device further includes a first adjustment module configured to adjust the backlight values of positions adjacent to the backlight change position according to the backlight change trend.
[0190] In some examples, the first adjustment module is specifically used to: determine a backlight change position with a positive difference value; determine a fifth position adjacent to the positive backlight change position and a sixth position adjacent to the fifth position along the backlight change trend; and adjust the backlight value of the fifth position.
[0191] In some examples, the backlight adjustment device further includes a second adjustment module configured to adjust the backlight value of the backlight change position to zero according to the backlight change trend.
[0192] In some examples, the second adjustment module is specifically configured to: if the difference value of the backlight change position is a negative number and the difference value of adjacent positions of the backlight change position is zero, adjust the backlight value of the backlight change position to zero.
[0193] In some examples, the backlight adjustment device further includes a fourth acquisition module configured to acquire a backlight matrix according to a displayed grayscale value of the image.
[0194] In some examples, the fourth acquisition module is specifically used to: obtain the maximum display grayscale value and the average display grayscale value of the image partition based on the display grayscale values of multiple pixel points of each image partition; weight the maximum display grayscale value and the average grayscale value of each image partition to obtain the backlight value of the backlight partition corresponding to the image partition.
[0195] An embodiment of the present disclosure further provides a computer system comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the backlight adjustment method of any of the above embodiments.
[0196] An embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the backlight adjustment method of any of the above embodiments are implemented.
[0197] An embodiment of the present disclosure further provides a computer program product, including a computer program, which implements the steps of the backlight adjustment method of any of the above embodiments when executed by a processor.
[0198] It will be understood by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0199] The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0200] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0201] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0202] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.
[0203] There are a few points to note:
[0204] (1) The drawings of the embodiments of the present disclosure only relate to the structures related to the embodiments of the present disclosure, and other structures may refer to conventional designs.
[0205] (2) Unless there is any conflict, the features of the same embodiment and different embodiments of the present disclosure may be combined with each other.
[0206] The above are only specific embodiments of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.
Claims
1. A backlight adjustment method for a display device, comprising: Inputting multiple frames of images to the display device; Acquire a plurality of backlight matrices corresponding to the plurality of frames of images, the backlight matrix comprising a plurality of backlight values; According to the backlight matrix, obtaining a connected domain consisting of positive backlight values; According to the connected domain, an adjustment scheme for the backlight value at the boundary position of the connected domain is determined.
2. The backlight adjustment method according to claim 1, wherein: According to the connected domain, determining an adjustment scheme for a backlight value at a boundary position of the connected domain includes: Acquire a first parameter according to the connected domain; Setting a first parameter threshold, and comparing the first parameter with the first parameter threshold: If the first parameter is less than or equal to the first parameter threshold, a first adjustment scheme is adopted to adjust the backlight value at the boundary position of the connected domain; If the first parameter is greater than the first parameter threshold, the first adjustment scheme or the second adjustment scheme is adopted to adjust the backlight value at the boundary position of the connected domain, wherein the first adjustment scheme is different from the second adjustment scheme.
3. The backlight adjustment method according to claim 2, wherein: The first parameter includes: a ratio of a perimeter of the connected domain to a perimeter of the backlight region; or a ratio of an area of the connected domain to an area of the backlight region.
4. The backlight adjustment method according to claim 2, wherein: After determining that the first parameter is greater than the first parameter threshold, determining, according to the connected domain, an adjustment scheme for the backlight value at a boundary position of the connected domain further includes: According to the connected domain, obtaining a second parameter; Set a second parameter threshold, and compare the second parameter with the second parameter threshold: If the second parameter is less than or equal to the second parameter threshold, a second adjustment scheme is adopted to adjust the backlight value at the boundary position of the connected domain; If the second parameter is greater than the second parameter threshold, determining whether to adopt the first adjustment solution according to a third parameter.
5. The backlight adjustment method according to claim 4, wherein: The second parameter includes a ratio between a maximum boundary distance and a minimum boundary distance of the connected domain.
6. The backlight adjustment method according to claim 4, wherein: After determining that the second parameter is greater than the second parameter threshold, determining, according to the connected domain, an adjustment scheme for the backlight value at a boundary position of the connected domain further includes: Acquire the third parameter according to the connected domain; Setting a third parameter threshold, and comparing the third parameter with the third parameter threshold: If the third parameter is less than or equal to the third parameter threshold, the backlight value at the boundary position of the connected domain is adjusted using a first adjustment scheme; If the third parameter is greater than the third parameter threshold, a second adjustment scheme is adopted to adjust the backlight value at the boundary position of the connected domain.
7. The backlight adjustment method according to claim 6, wherein: The third parameter includes a ratio of the minimum boundary distance of the connected domain to the minimum boundary distance of the backlight area.
8. The backlight adjustment method according to any one of claims 4 to 7, wherein: The first adjustment plan includes: Multiplying the backlight value at the boundary position of the connected domain by a weighting coefficient; The second adjustment plan includes: The backlight value at the boundary position of the connected domain is filtered.
9. The backlight adjustment method according to claim 8, wherein: Before filtering the backlight value at the boundary position of the connected domain, the second adjustment scheme further includes: Determine the number and positions of zero backlight values at positions adjacent to the boundary position of the connected domain; and According to the judgment result, a filtering operator is selected.
10. The backlight adjustment method according to claim 9, wherein: The backlight matrix includes a row direction and a column direction, the number of adjacent positions of the boundary position of the connected domain is four, and the four adjacent positions include: a first adjacent position and a second adjacent position opposite to each other in the row direction with the boundary position as the center, and a third adjacent position and a fourth adjacent position opposite to each other in the column direction; According to the judgment result, the filter operators are selected including: If the backlight value of one of the first adjacent position and the second adjacent position is zero and the backlight value of one of the third adjacent position and the fourth adjacent position is zero, select an N*N type filter operator or a "cross" type filter operator; If the backlight value of one of the first neighboring position and the second neighboring position is zero, selecting a 1*N type filtering operator; and If the backlight value of one of the third neighboring position and the fourth neighboring position is zero, then select N*1 type filtering operator, Here, N is an odd number greater than or equal to 3.
11. The backlight adjustment method according to claim 1, in, Acquiring a plurality of backlight matrices corresponding to the plurality of frames of images, comprising: Get the backlight matrix corresponding to any two adjacent frames of images. Wherein, the backlight adjustment method further includes: Acquire a backlight difference matrix according to the backlight matrices of any two adjacent frames of images; Determining a backlight change position according to the backlight difference matrix; and The backlight change trend of the backlight change position is determined according to the backlight difference matrix.
12. The backlight adjustment method according to claim 11, wherein: The difference values in the backlight difference matrix include zero, positive numbers or negative numbers. Wherein, determining the backlight change position according to the backlight difference matrix includes: If the difference value in the backlight difference matrix is a positive number or a negative number, the position where the difference value is located is confirmed to be the backlight change position.
13. The backlight adjustment method according to claim 12, wherein: Determining the backlight change trend of the backlight change position according to the backlight difference matrix includes: Determine, according to the backlight difference matrix, a backlight change position where the difference value is positive; Determine whether the difference value of the position adjacent to the positive backlight change position is zero; and According to the determination result, the backlight change trend of the backlight change position is determined.
14. The backlight adjustment method according to claim 13, wherein: The adjacent positions of the backlight changing position include a first position, a second position, a third position and a fourth position which are arranged clockwise with the backlight changing position as the center. Wherein, judging the backlight change trend of the backlight change position according to the judgment result includes: If the difference value of only one position among the first position, the second position, the third position and the fourth position is zero, the backlight change trend of the backlight change position is toward the position where the difference value is zero; If the difference between any two adjacent positions among the first position, the second position, the third position and the fourth position is zero, the backlight change trend of the backlight change position is toward between the two adjacent positions; and If the difference values of any three positions among the first position, the second position, the third position and the fourth position are zero, the backlight change trend of the backlight change position is in the opposite direction of the only position among the four positions whose difference value is not zero.
15. The backlight adjustment method according to any one of claims 11 to 14, further comprising: According to the backlight change trend, the backlight value of the position adjacent to the backlight change position is adjusted, wherein the backlight difference value of the position adjacent to the backlight change position is 0.
16. The backlight adjustment method according to claim 15, wherein: According to the backlight change trend, adjusting the backlight value of a position adjacent to the backlight change position includes: Determine the backlight change position where the difference value is positive; Determine a fifth position adjacent to the positive backlight change position and a sixth position adjacent to the fifth position along the backlight change trend; and The backlight value of the fifth position is adjusted.
17. The backlight adjustment method according to claim 16, wherein: The backlight value of the fifth position is calculated by nonlinear interpolation, and the calculation formula is: or The backlight matrix includes a row direction and a column direction, i and j represent the row direction index and the column direction index of the backlight matrix respectively, and y t represents the backlight value of the backlight matrix at time t, α represents the adaptive adjustment parameter, and its calculation formula is:
18. The backlight adjustment method according to claim 12, further comprising: According to the backlight change trend, the backlight value of the backlight change position is adjusted to zero.
19. The backlight adjustment method according to claim 18, wherein: According to the backlight change trend, adjusting the backlight value of the backlight change position to zero includes: If the difference value of the backlight changing position is a negative number, and the difference value of the adjacent position of the backlight changing position is zero, the backlight value of the backlight changing position is adjusted to zero.
20. The backlight adjustment method according to any one of claims 1 to 19, further comprising: The backlight matrix is obtained according to the displayed grayscale value of the image.
21. The backlight adjustment method according to claim 20, wherein: The backlight area includes a plurality of backlight partitions, the plurality of backlight partitions correspond one-to-one to a plurality of backlight values of the backlight matrix, the image includes a plurality of image partitions, the plurality of backlight partitions correspond one-to-one to the plurality of image partitions, the image partitions include a plurality of pixel points, According to the displayed grayscale value of the image, acquiring the backlight matrix comprises: According to the displayed grayscale values of the plurality of pixels of each of the image partitions, the image partition is obtained. The maximum displayed grayscale value and the average displayed grayscale value of the area; and The maximum display grayscale value and the average grayscale value of each of the image partitions are weighted to obtain a backlight value of the backlight partition corresponding to the image partition.
22. A backlight adjustment device for a display device, comprising: An input module, configured to input multiple frames of images to the display device; A first acquisition module is configured to acquire a plurality of backlight matrices corresponding to the plurality of frames of images, wherein the backlight matrices include a plurality of backlight values; A second acquisition module is configured to acquire, according to the backlight matrix, a connected domain consisting of the backlight values being positive numbers; A first determining module is configured to determine, according to the connected domain, an adjustment scheme for the backlight value at the boundary position of the connected domain; as well as The output module is configured to output the adjusted backlight matrix to the backlight display module.
23. A computer system comprising a memory, a processor and a computer program stored in the memory, wherein: The processor executes the computer program to implement the steps of the backlight adjustment method according to any one of claims 1 to 21.
24. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the steps of the backlight adjustment method described in any one of claims 1 to 21 are implemented.
25. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the steps of the backlight adjustment method described in any one of claims 1 to 21 are implemented.
Citation Information
Patent Citations
Method and device for compensating backlight
CN101282425A
Liquid crystal display screen image displaying method, device and liquid crystal display television
CN102930831A
Backlight adjustment method and device of intelligent display device
CN107689214A
Liquid crystal display, backlight adjusting method thereof and computer readable medium
CN110910840A
Backlight adjusting method of display device, backlight adjusting device and display device
CN111599320A
Cited By
High-contrast Mini LED control method and system and medium
CN119811278A