A method, device, equipment and storage medium for determining light intensity value
Through polynomial fitting technology, the problem of waste of storage resources and difficult real-time playback in the backlight estimation method is solved, the estimation accuracy and contrast are improved, the backlight power consumption is reduced, and more efficient dynamic video playback is achieved.
Patent Information
- Application Number
- CN202111438098.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-30
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2041-11-30
AI Technical Summary
The existing backlight estimation method has problems such as wasting storage resources, difficulty in real-time playback, poor generalization and large estimation errors in dynamic local dimming technology. In particular, the optical intensity accumulation method requires a large amount of memory and the table lookup speed is slow. The BMA method The estimation error is large, and Gaussian fitting cannot fit the true light intensity distribution.
Polynomial fitting is used instead of the existing table lookup method. By obtaining the light intensity distribution data of the backlight block, binary high-degree polynomial fitting is performed to determine the fitting parameters, and the light intensity value of each pixel point is calculated, thereby reducing memory. Resources are wasted and estimation accuracy is improved.
It effectively reduces the waste of storage resources, realizes real-time playback of dynamic videos, reduces estimation errors, improves contrast and picture quality, and reduces backlight power consumption.
Smart Images

Figure CN116206573B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the field of liquid crystal display technology, and in particular to a method, device, equipment and storage medium for determining a light intensity value. Background Art
[0002] The traditional LCD (Liquid Crystal Display) is composed of a uniform backlight panel and a TFT-LCD. The backlight panel provides a backlight with uniform intensity, and the liquid crystal panel controls the degree of flipping of liquid crystal molecules according to the grayscale of the image to achieve pixel-by-pixel brightness control. However, this structure has a light leakage problem, which makes it impossible to obtain a pure black picture when the pixel value is zero. To solve this problem, local dynamic dimming technology is proposed. In this technology, the backlight panel is divided into multiple areas, and the brightness value of each area can be dynamically changed according to the image content; further, the original input data is compensated for the corresponding pixels according to the backlight distribution, thereby achieving the effect of improving the image quality contrast and reducing the backlight power consumption.
[0003] In the local dynamic dimming technology, in order to calculate the compensation value of each pixel, the light type diffusion function needs to be used to make a more accurate estimate of the light intensity distribution after local dimming. At present, the commonly used backlight estimation methods in the industry include: light intensity accumulation, BMA (blur mask approach) and Gaussian fitting.
[0004] The backlight estimation methods currently used in related dynamic local dimming technologies all have certain defects. For example, the light intensity accumulation method requires a large memory to store the light intensity distribution data on each light-emitting block, which greatly wastes hardware resources, and is limited by the table lookup speed, making it difficult to achieve real-time playback of dynamic videos; the BMA method is an approximate simulation of light intensity accumulation, with large estimation errors, and the algorithm assumes that all backlight blocks have the same luminous intensity, and has poor generalization. The Gaussian fitting method assumes that the light intensity distribution of the backlight block obeys the Gaussian distribution, and is also unable to fit the actual light intensity distribution, resulting in large estimation errors. Summary of the invention
[0005] The disclosed embodiments provide a method, device, equipment and storage medium for determining light intensity values, which not only solve the problem that the light intensity accumulation method requires a large memory to store the light intensity distribution data on each light-emitting block, which greatly wastes hardware resources, and is limited by the table lookup speed and is difficult to achieve real-time playback of dynamic videos, but also solve the problems of poor generalization and large estimation errors, and adopts a polynomial fitting method to replace the existing table lookup method to obtain the backlight distribution value, thereby greatly reducing the waste of memory resources.
[0006] In a first aspect, an embodiment of the present disclosure provides a method for determining a light intensity value, the method comprising:
[0007] Get the original input image;
[0008] Determining a driving value for each backlight block according to the original input image;
[0009] The light intensity value corresponding to each pixel is determined according to the driving value of each backlight block and the fitting parameter of each backlight block.
[0010] Furthermore, before determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, the method further includes:
[0011] Obtaining light intensity distribution data of each backlight block;
[0012] Determine the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block;
[0013] A binary high-order polynomial fitting is performed on the data to be fitted of each backlight block to obtain the fitting parameters of each backlight block.
[0014] Furthermore, the data to be fitted of each backlight block includes: the data to be fitted of the pixel points corresponding to each backlight block;
[0015] Accordingly, a binary high-order polynomial fitting is performed on the data to be fitted of each backlight block to obtain the fitting parameters of each backlight block, including:
[0016] Determine the target range according to the light intensity distribution data of the target backlight block;
[0017] The fitting parameters of the target backlight block are determined based on the following formula:
[0018] A * =(D T D) -1 D T Z * ;
[0019] Where D = [D1; D2; L; D N ], is the pixel data to be fitted within the target range, s takes values from 1 to N, N is the number of pixels within the target range, Z s =D s A i,j , X s =[1,x,x 2 ,L,x k ],Y s =[1,y,y 2 ,L,y k ],k 2is the degree of the binary high-order polynomial, flatten() is a matrix vectorization function, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, A * are the fitting parameters of the target backlight block.
[0020] Further, determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block includes:
[0021] Determine the light intensity value corresponding to the target pixel based on the following formula;
[0022]
[0023] Where BL(m,n) is the backlight driving value of the backlight block in the mth row and nth column, f m,n (x, y) is the backlight brightness contribution value of the backlight block in the mth row and nth column to the position of coordinate (x, y), A is the fitting parameter corresponding to the backlight block in the mth row and nth column, BL max is the maximum backlight drive value.
[0024] Furthermore, after determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, the method further includes:
[0025] Perform pixel compensation on the pixel value of each pixel point according to the light intensity value corresponding to each pixel point;
[0026] driving the backlight panel according to the driving value of each backlight block;
[0027] The pixel value of the compensated pixel point is sent to the screen driving board, so that the screen driving board displays according to the pixel value of the compensated pixel point.
[0028] Further, determining the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block includes:
[0029] Removing Gaussian noise from the light intensity distribution data of each backlight block;
[0030] The light intensity distribution data of each backlight block after removing Gaussian noise is mapped to the logarithmic space to obtain the data to be fitted for each backlight block.
[0031] Further, obtaining light intensity distribution data of each backlight block;
[0032] When the backlight driving value of the first backlight block is the maximum backlight driving value and the backlight driving values of the remaining backlight blocks are zero, the light intensity distribution data of the first backlight block is collected.
[0033] In a second aspect, an embodiment of the present disclosure further provides a light intensity value determining device, the light intensity value determining device comprising:
[0034] An acquisition module, used to acquire the original input image;
[0035] A driving value determination module, used to determine the driving value of each backlight block according to the original input image;
[0036] The light intensity value determination module is used to determine the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block.
[0037] In a third aspect, an embodiment of the present disclosure further provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a method for determining a light intensity value as described in any one of the embodiments of the present disclosure is implemented.
[0038] In a fourth aspect, the embodiments of the present disclosure further provide a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, a method for determining a light intensity value as described in any one of the embodiments of the present disclosure is implemented.
[0039] The disclosed embodiment obtains an original input image; determines the driving value of each backlight block according to the original input image; and determines the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block. This solves the problem that the light intensity accumulation method requires a large memory to store the light intensity distribution data on each light-emitting block, which greatly wastes hardware resources, and is limited by the table lookup speed and is difficult to achieve real-time playback of dynamic videos. It also solves the problems of poor generalization and large estimation errors, and adopts a polynomial fitting method instead of the existing table lookup method to obtain the backlight distribution value, which greatly reduces the waste of memory resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present disclosure and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0041] Figure 1 is a flow chart of a method for determining a light intensity value in the first embodiment of the present disclosure;
[0042] Figure 1a is a schematic diagram of the algorithm flow in the first embodiment of the present disclosure;
[0043] Figure 1bis the original data distribution diagram in the first embodiment of the present disclosure;
[0044] Figure 1c is a distribution diagram of fitting results in the first embodiment of the present disclosure;
[0045] Figure 1d is a deviation distribution diagram of the real data and the fitted data in the first embodiment of the present disclosure;
[0046] Figure 2 is a structural schematic diagram of a light intensity value determination device in Embodiment 2 of the present disclosure;
[0047] Figure 3 It is a structural diagram of a terminal device in Embodiment 3 of the present disclosure. DETAILED DESCRIPTION
[0048] The present disclosure is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present disclosure, rather than to limit the present disclosure. It should also be noted that, for ease of description, only parts related to the present disclosure are shown in the accompanying drawings, rather than all structures.
[0049] It should be mentioned before discussing the exemplary embodiments in more detail that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the various operations (or steps) as sequential processes, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the various operations can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to methods, functions, procedures, subroutines, subprograms, etc. In addition, the embodiments in the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0050] The term “including” and its variations used in the present disclosure are open inclusions, ie, “including but not limited to.” The term “based on” means “based at least in part on.” The term “one embodiment” means “at least one embodiment.”
[0051] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish the corresponding contents, and are not used to limit the order or interdependence.
[0052] Embodiment 1
[0053] Figure 1 This is a flow chart of a method for determining a light intensity value provided in the first embodiment of the present disclosure. This embodiment is applicable to the case of determining a light intensity value. The method can be executed by a light intensity value determining device in the embodiment of the present disclosure. The device can be implemented in software and / or hardware. Figure 1As shown, the light intensity value determination method specifically includes the following steps:
[0054] S110, obtaining an original input image.
[0055] Wherein, the original input image is the image to be displayed. If the original input image is directly displayed, light leakage problem will occur.
[0056] Specifically, the method of obtaining the original input image can be: obtaining the input image for the target LCD display, the LCD display is composed of a uniform backlight panel and a liquid crystal panel, the backlight panel provides a backlight with uniform intensity, and the liquid crystal panel controls the degree of flipping of liquid crystal molecules according to the grayscale of the image to achieve brightness control of each pixel.
[0057] S120: Determine a driving value of each backlight block according to the original input image.
[0058] Specifically, the method of determining the driving value of each backlight block according to the original input image may be: determining the driving value of each backlight block corresponding to the backlight panel of the target liquid crystal display according to the original input image.
[0059] S130, determining a light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block.
[0060] The light intensity value corresponding to each pixel is the light intensity value corresponding to each pixel on the original input image.
[0061] The fitting parameters of each backlight block can be determined by: obtaining the light intensity distribution data of each backlight block; determining the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block; performing binary high-order polynomial fitting on the data to be fitted for each backlight block to obtain the fitting parameters of each backlight block. The fitting parameters of each backlight block can also be determined by: determining the target range according to the light intensity distribution data of the target backlight block; determining the fitting parameters of the target backlight block based on the following formula: A * =(D T D) -1 D T Z * ; Where D=[D1; D2; L; D N ], is the pixel data to be fitted within the target range, s takes values from 1 to N, N is the number of pixels within the target range, Z s =D s A i,j , X s =[1,x,x 2 ,L,x k ],Y s=[1,y,y 2 ,L,y k ],k 2 is the degree of the binary high-order polynomial, flatten() is a matrix vectorization function, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, A * are the fitting parameters of the target backlight block.
[0062] Specifically, the method of determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block can be: determining the backlight brightness contribution value of each backlight block to the position on the liquid crystal panel according to the fitting parameters of each backlight block, and determining the light intensity value corresponding to each pixel point according to the backlight brightness contribution value of each backlight block to the position on the liquid crystal panel, the backlight driving value of each backlight block and the maximum backlight driving value. For example, the light intensity value corresponding to the target pixel point can be determined based on the following formula;
[0063]
[0064] Where BL(m,n) is the backlight driving value of the backlight block in the mth row and nth column, f m,n (x, y) is the backlight brightness contribution value of the backlight block in the mth row and nth column to the position of coordinate (x, y), A is the fitting parameter corresponding to the backlight block in the mth row and nth column, BL max is the maximum backlight drive value.
[0065] If the original input image is displayed directly, light leakage will occur. The embodiment of the present invention determines the light intensity value corresponding to each pixel in the original input image according to the driving value of each backlight block and the fitting parameters of each backlight block, thereby solving the light leakage problem.
[0066] It should be noted that after determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block, pixel compensation can be performed on the pixel value of each pixel point according to the light intensity value corresponding to each pixel point in the original input image, and the backlight panel is driven according to the driving value of each backlight block, and the pixel value of the compensated pixel point is sent to the screen driving board, so that the screen driving board displays according to the pixel value of the compensated pixel point.
[0067] The embodiment of the present invention compensates the pixel value of each pixel in the original input image, and the screen driving board displays according to the pixel value of the compensated pixel, which can solve the problem of light leakage and reduce backlight power consumption while improving image quality contrast.
[0068] In one embodiment, before determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, the method further includes:
[0069] Obtaining light intensity distribution data of each backlight block;
[0070] Determine the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block;
[0071] A binary high-order polynomial fitting is performed on the data to be fitted of each backlight block to obtain the fitting parameters of each backlight block.
[0072] The method for acquiring the light intensity distribution data of each backlight block may be: collecting the light intensity distribution data of each backlight block in sequence according to the arrangement order of the backlight blocks; if the light intensity distribution data of a certain backlight block is to be collected, the backlight drive value of the certain backlight block is first adjusted to the maximum backlight drive value, and then the backlight drive values of the other backlight blocks except the certain backlight block are adjusted to zero, and then the light intensity distribution data of the certain backlight block is collected. For example, if the backlight panel includes: M+1 backlight blocks, if the light intensity distribution data of the first backlight block is to be collected, the backlight drive value of the first backlight block is first adjusted to the maximum backlight drive value, and then the backlight drive values of the M backlight blocks except the first backlight block are adjusted to zero, and then the light intensity distribution data of the first backlight block is collected. If you want to collect the light intensity distribution data of the second backlight block, first adjust the backlight drive value of the second backlight block to the maximum backlight drive value, then adjust the backlight drive values of the M backlight blocks except the second backlight block to zero, and then collect the light intensity distribution data of the second backlight block. The collection method for other backlight blocks is the same as the above method.
[0073] Among them, the method of determining the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block can be: obtaining the light intensity distribution data of each backlight block, mapping the light intensity distribution data of each backlight block to the logarithmic space, and obtaining the data to be fitted for each backlight block. The method of determining the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block can also be: removing Gaussian noise from the light intensity distribution data of each backlight block; mapping the light intensity distribution data of each backlight block with the Gaussian noise removed to the logarithmic space, and obtaining the data to be fitted for each backlight block. The embodiments of the present invention are not limited to this.
[0074] Specifically, a method of fitting the data to be fitted of each backlight block by a binary high-order polynomial to obtain the fitting parameters of each backlight block may be: determining the target range according to the light intensity distribution data of the target backlight block; and obtaining the fitting parameters of the target backlight block according to the data to be fitted of the pixels within the target range, the number of pixels within the target range, and the position coordinates of the pixels within the target range relative to the center point of the target backlight block. For example, each backlight block may correspond to a set of fitting parameters.
[0075] In one embodiment, the data to be fitted of each backlight block includes: the data to be fitted of the pixel points corresponding to each backlight block;
[0076] Accordingly, a binary high-order polynomial fitting is performed on the data to be fitted of each backlight block to obtain the fitting parameters of each backlight block, including:
[0077] Determine the target range according to the light intensity distribution data of the target backlight block;
[0078] The fitting parameters of the target backlight block are determined based on the following formula:
[0079] A * =(D T D) -1 D T Z * ;
[0080] Where D = [D1; D2; L; D N ], is the pixel data to be fitted within the target range, s takes values from 1 to N, N is the number of pixels within the target range, Z s =D s A i,j , X s =[1,x,x 2 ,L,x k ],Y s =[1,y,y 2 ,L,y k ],k 2 is the degree of the binary high-order polynomial, flatten() is a matrix vectorization function, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, A * are the fitting parameters of the target backlight block.
[0081] The method of determining the target range according to the light intensity distribution data of the target backlight block may be: determining the influence area of the target backlight block relative to the liquid crystal panel according to the light intensity distribution data of the target backlight block.
[0082] The to-be-fitted data of the pixel points within the target range refers to: the to-be-fitted data of the pixel points within the target range corresponding to the target backlight block.
[0083] Specifically, the fitting parameters of the target backlight block may be determined by:
[0084] Perform a binary multiple polynomial fitting on the pixel data to be fitted within the target range. The fitting function is as follows:
[0085]
[0086] Among them, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, k 2 is the degree of the polynomial, A is the fitting parameter of the target backlight block, and f(x, y) is the backlight estimation distribution function.
[0087] To further reduce the impact of noise on the fitting results, the fitting data intercepts the effective part and intercepts the data within the data fluctuation area. To reduce the number of parameters required for fitting and improve the fitting accuracy, the embodiment of the present invention divides the to-be-fitted data of the pixel points within the target range into 9 parts for fitting. To increase the algorithm speed, the embodiment of the present invention uses matrix operations during fitting, and the fitting algorithm is implemented as follows:
[0088] Given the target backlight block corresponding to the data to be fitted Z s =D s A i,j ,in, X=[1,x,x 2 ,L,x k ],Y=[1,y,y 2 ,L,y k ], A is a column vector with dimension (k+1) 2 The vector of , through the least squares method, minimizes the following objective function:
[0089]
[0090] Since this problem is a convex problem, its optimal solution parameters can be directly solved:
[0091] A * =(D T D) -1 D T Z * ;
[0092] Where D = [D1; D2; L; D N ], is the pixel data to be fitted within the target range, s takes values from 1 to N, N is the number of pixels within the target range, Zs =D s A i,j , X s =[1,x,x 2 ,L,x k ],Y s =[1,y,y 2 ,L,y k ],k 2 is the degree of the binary high-order polynomial, flatten() is a matrix vectorization function, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, A * are the fitting parameters of the target backlight block.
[0093] In one embodiment, determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block includes:
[0094] Determine the light intensity value corresponding to the target pixel based on the following formula;
[0095]
[0096] Where BL(m,n) is the backlight driving value of the backlight block in the mth row and nth column, f m,n (x, y) is the backlight brightness contribution value of the backlight block in the mth row and nth column to the position of coordinate (x, y), A is the fitting parameter corresponding to the backlight block in the mth row and nth column, BL max is the maximum backlight drive value.
[0097] Specifically, the dynamic local dimming algorithm backlight extraction module is run to extract the driving value of each backlight block and drive the corresponding backlight panel. The backlight distribution of each pixel is calculated in combination with the above backlight block distribution fitting parameters. The calculation formula is as follows:
[0098]
[0099] Where BL(m,n) is the backlight driving value of the backlight block in the mth row and nth column, f m,n (x, y) is the backlight brightness contribution value of the backlight block in the mth row and nth column to the position of coordinate (x, y), A is the fitting parameter corresponding to the backlight block in the mth row and nth column, BL max is the maximum backlight drive value.
[0100] In one embodiment, after determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, the method further includes:
[0101] Perform pixel compensation on the pixel value of each pixel point according to the light intensity value corresponding to each pixel point;
[0102] driving the backlight panel according to the driving value of each backlight block;
[0103] The pixel value of the compensated pixel point is sent to the screen driving board, so that the screen driving board displays according to the pixel value of the compensated pixel point.
[0104] Specifically, the method of performing pixel compensation on the pixel value of each pixel point according to the light intensity value corresponding to each pixel point can be: performing pixel compensation on the pixel value of each pixel point in the original input image according to the light intensity value corresponding to each pixel point in the original input image.
[0105] In one embodiment, determining the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block includes:
[0106] Removing Gaussian noise from the light intensity distribution data of each backlight block;
[0107] The light intensity distribution data of each backlight block after removing Gaussian noise is mapped to the logarithmic space to obtain the data to be fitted for each backlight block.
[0108] Specifically, the light intensity distribution data after superposition and denoising is mapped to the logarithmic space to obtain the data to be fitted. In the logarithmic space, the change trend of the light intensity is relatively gentle, that is, a lower-order polynomial can achieve a higher fitting accuracy. After using the logarithmic space fitting, return to the original brightness value space. According to the Taylor expansion formula, the fitting polynomial at this time has an infinite order, which is equivalent to the Gaussian kernel in the SVM. The exponential function can be used to achieve infinite-order polynomial fitting, which greatly improves the fitting accuracy of the function and reduces the degree of freedom of the fitting parameters.
[0109] In one embodiment, light intensity distribution data of each backlight block is obtained;
[0110] When the backlight driving value of the first backlight block is the maximum backlight driving value and the backlight driving values of the remaining backlight blocks are zero, the light intensity distribution data of the first backlight block is collected.
[0111] The first backlight block may be any backlight block, that is, the acquisition process of each backlight block is the same as the above method.
[0112] Specifically, when the backlight driving value of the first backlight block is the maximum backlight driving value, and the backlight driving values of the remaining backlight blocks are zero, the light intensity distribution data of the first backlight block is collected. For example, if the backlight panel includes: M+1 backlight blocks, if the light intensity distribution data of the first backlight block is to be collected, the backlight driving value of the first backlight block is first adjusted to the maximum backlight driving value, and then the backlight driving values of the M backlight blocks other than the first backlight block are adjusted to zero, and then the light intensity distribution data of the first backlight block is collected. If the light intensity distribution data of the second backlight block is to be collected, the backlight driving value of the second backlight block is first adjusted to the maximum backlight driving value, and then the backlight driving values of the M backlight blocks other than the second backlight block are adjusted to zero, and then the light intensity distribution data of the second backlight block is collected, and the collection method of the other backlight blocks is the same as the above method.
[0113] In a specific example, Figure 1a As shown, the embodiment of the present disclosure discloses an algorithm for estimating the light type distribution of a single backlight block based on a two-dimensional polynomial fitting. The algorithm includes the following parts: sequentially collecting the light intensity distribution data of a single backlight block for multiple times; performing denoising on the light intensity distribution data of the backlight block; mapping the light intensity distribution of the backlight block to the logarithmic space to obtain the distribution data Z^ in the logarithmic space; sequentially fitting the distribution data Z^ with a binary high-order polynomial Z^=f(x,y) to obtain the fitting parameters; mapping the fitting function from the logarithmic space back to the original space; combining the driving value of each backlight block and the fitting parameters of the above-mentioned backlight blocks to calculate the light intensity value at each pixel point by a weighted accumulation method to obtain the overall backlight distribution data.
[0114] In a specific example, the disclosed embodiment uses a CMOS industrial camera to collect data on the light intensity distribution of each single backlight block, and uses superposition denoising to remove Gaussian noise from the collected data. Among them, the collection device is not limited to a CMOS camera, and the collected data can describe the real light intensity distribution. The light intensity distribution data after superposition denoising is mapped to the logarithmic space to obtain the data Z^ to be fitted. In the logarithmic space, the change trend of the light intensity is relatively gentle, that is, a lower-order polynomial can achieve a higher fitting accuracy. A binary multi-time polynomial fitting is performed on the data to be fitted for the pixel points within the target range. The fitting function is as follows:
[0115]
[0116] Among them, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, k 2 is the degree of the polynomial, A is the fitting parameter of the target backlight block, and f(x, y) is the backlight estimation distribution function.
[0117] To further reduce the impact of noise on the fitting results, the fitting data intercepts the effective part and intercepts the data within the data fluctuation area. To reduce the number of parameters required for fitting and improve the fitting accuracy, the embodiment of the present invention divides the to-be-fitted data of the pixel points within the target range into 9 parts for fitting. To increase the algorithm speed, the embodiment of the present disclosure uses matrix operations during fitting, and the fitting algorithm is implemented as follows:
[0118] Given the target backlight block corresponding to the data to be fitted Z s =D s A i,j ,in, X=[1,x,x 2 ,L,x k ],Y=[1,y,y 2 ,L,y k ], A is a column vector with dimension (k+1) 2 The vector of , through the least squares method, minimizes the following objective function:
[0119]
[0120] Since this problem is a convex problem, its optimal solution parameters can be directly solved:
[0121] A * =(D T D) -1 D T Z * ;
[0122] Where D = [D1; D2; L; D N ], is the pixel data to be fitted within the target range, s takes values from 1 to N, N is the number of pixels within the target range, Z s =D s A i,j , X s =[1,x,x 2 ,L,x k ],Y s =[1,y,y 2 ,L,y k ],k 2 is the degree of the binary high-order polynomial, flatten() is a matrix vectorization function, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, A * are the fitting parameters of the target backlight block.
[0123] It has been verified that when the highest degree of the binary polynomial is 16 (k=4), a relatively accurate fit can be made to Z^, and the average deviation between the fitted data and the real data can be controlled within 0.15, with a relative error of. Figure 1b is the original data distribution diagram, Figure 1c For the distribution diagram of the fitting results, Figure 1d This is the deviation distribution diagram between the real data and the fitted data.
[0124] Run the dynamic local dimming algorithm backlight extraction module to extract the driving value of each backlight block and drive the corresponding backlight panel. Combined with the above backlight block distribution fitting parameters, the backlight distribution of each pixel is calculated. The calculation formula is as follows:
[0125]
[0126] Where BL(m,n) is the backlight driving value of the backlight block in the mth row and nth column, f m,n (x, y) is the backlight brightness contribution value of the backlight block in the mth row and nth column to the position of coordinate (x, y), A is the fitting parameter corresponding to the backlight block in the mth row and nth column, BL max is the maximum backlight drive value.
[0127] In the original brightness value space, the polynomial fitting of the disclosed embodiment is poor, especially in low brightness areas and areas with drastic brightness changes. After adopting logarithmic space fitting, when returning to the original brightness value space, which is equivalent to the Gaussian kernel in SVM, the exponential function can be used to realize infinite order polynomial fitting, which greatly improves the fitting accuracy of the function and reduces the degree of freedom of the fitting parameters.
[0128] The technical solution of this embodiment obtains the original input image; determines the driving value of each backlight block according to the original input image; determines the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block. This not only solves the problem that the light intensity accumulation method requires a large memory to store the light intensity distribution data on each light-emitting block, which greatly wastes hardware resources, and is limited by the table lookup speed and is difficult to achieve real-time playback of dynamic videos, but also solves the problems of poor generalization and large estimation errors. The polynomial fitting method is used instead of the existing table lookup method to obtain the backlight distribution value, which greatly reduces the waste of memory resources.
[0129] Embodiment 2
[0130] Figure 2 This is a schematic diagram of the structure of a light intensity value determination device provided in the second embodiment of the present disclosure. This embodiment is applicable to the case of determining the light intensity value. The light intensity value determination device can be implemented in software and / or hardware. The light intensity value determination device can be integrated in a terminal, such as Figure 2As shown, the light intensity value determination device specifically includes: an acquisition module 210 , a drive value determination module 220 and a light intensity value determination module 230 .
[0131] Wherein, the acquisition module is used to acquire the original input image;
[0132] A driving value determination module, used to determine the driving value of each backlight block according to the original input image;
[0133] The light intensity value determination module is used to determine the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block.
[0134] The above-mentioned product can execute the method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
[0135] The technical solution of this embodiment obtains the original input image; determines the driving value of each backlight block according to the original input image; determines the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block. This not only solves the problem that the light intensity accumulation method requires a large memory to store the light intensity distribution data on each light-emitting block, which greatly wastes hardware resources, and is limited by the table lookup speed and is difficult to achieve real-time playback of dynamic videos, but also solves the problems of poor generalization and large estimation errors. The polynomial fitting method is used instead of the existing table lookup method to obtain the backlight distribution value, which greatly reduces the waste of memory resources.
[0136] Embodiment 3
[0137] Figure 3 This is a schematic diagram of the structure of a terminal device provided in Embodiment 3 of the present disclosure. Figure 3 As shown, the terminal device provided in the third embodiment of the present disclosure includes: one or more processors 31 and a storage device 32; the processor 31 in the terminal device may be one or more, Figure 3 A processor 31 is taken as an example; the storage device 32 is used to store one or more programs; the one or more programs are executed by the one or more processors 31, so that the one or more processors 31 implement the method for determining the light intensity value as described in any one of the embodiments of the present disclosure.
[0138] The terminal device may further include: an input device 33 and an output device 34 .
[0139] The processor 31, storage device 32, input device 33 and output device 34 in the terminal device may be connected via a bus or other means. Figure 3 The example of connecting through bus is taken in the following.
[0140] The storage device 32 in the terminal device is a computer-readable storage medium, which can be used to store one or more programs, and the program can be a software program, a computer executable program, and a module, such as the program instructions / modules corresponding to the light intensity value determination method provided in the first embodiment of the present disclosure (for example, the attached Figure 2 The modules in the light intensity value determination device shown include: an acquisition module 210, a drive value determination module 220 and a light intensity value determination module 230). The processor 31 executes various functional applications and data processing of the terminal device by running the software programs, instructions and modules stored in the storage device 32, that is, the light intensity value determination method in the above method embodiment is implemented.
[0141] The storage device 32 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the storage device 32 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the storage device 32 may further include a memory remotely arranged relative to the processor 31, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0142] The input device 33 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the terminal device. The output device 34 may include a display device such as a display screen.
[0143] Furthermore, when one or more programs included in the terminal device are executed by the one or more processors 31, the program performs the following operations:
[0144] Get the original input image;
[0145] Determining a driving value for each backlight block according to the original input image;
[0146] The light intensity value corresponding to each pixel is determined according to the driving value of each backlight block and the fitting parameter of each backlight block.
[0147] Embodiment 4
[0148] A fourth embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the program is used to perform a method for determining a light intensity value. The method includes:
[0149] Get the original input image;
[0150] Determining a driving value for each backlight block according to the original input image;
[0151] The light intensity value corresponding to each pixel is determined according to the driving value of each backlight block and the fitting parameter of each backlight block.
[0152] Optionally, when the program is executed by a processor, it can also be used to execute the light intensity value determination method provided by any embodiment of the present disclosure.
[0153] The computer storage medium of the disclosed embodiment may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the above. The computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it.
[0154] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to: electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0155] The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination of the above.
[0156] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as python, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0157] Note that the above are only preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art will understand that the present disclosure is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present disclosure. Therefore, although the present disclosure is described in more detail through the above embodiments, the present disclosure is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present disclosure, and the scope of the present disclosure is determined by the scope of the attached claims.
Claims
1. A method for determining a light intensity value, characterized in that: include: Get the original input image; Determining a driving value for each backlight block according to the original input image; Determine the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block; Before determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, the method further includes: Obtaining light intensity distribution data of each backlight block; Determine the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block; Perform binary high-order polynomial fitting on the data to be fitted of each backlight block to obtain the fitting parameters of each backlight block; Determining the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block, including: Removing Gaussian noise from the light intensity distribution data of each backlight block; The light intensity distribution data of each backlight block after removing Gaussian noise is mapped to the logarithmic space to obtain the data to be fitted for each backlight block.
2. The method according to claim 1, characterized in that The data to be fitted for each backlight block includes: the data to be fitted for the pixel points corresponding to each backlight block; Accordingly, a binary high-order polynomial fitting is performed on the data to be fitted of each backlight block to obtain the fitting parameters of each backlight block, including: Determine the target range according to the light intensity distribution data of the target backlight block; The fitting parameters of the target backlight block are determined based on the following formula: A * =(D T D) -1 D T Z * ; Where D = [D1; D2; L; D N ], is the pixel data to be fitted within the target range, s takes values from 1 to N, N is the number of pixels within the target range, Z s =D s A i,j , X s =[1,x,x 2 ,L,x k ],Y s =[1,y,y 2 ,L,y k ],k 2 is the degree of the binary high-order polynomial, flatten() is a matrix vectorization function, (x, y) is the position coordinate of the pixel point within the target range relative to the center point of the target backlight block, A * are the fitting parameters of the target backlight block.
3. The method according to claim 2, characterized in that Determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, including: Determine the light intensity value corresponding to the target pixel based on the following formula; Where BL(m,n) is the backlight driving value of the backlight block in the mth row and nth column, f m,n (x, y) is the backlight brightness contribution value of the backlight block in the mth row and nth column to the position of coordinate (x, y), A is the fitting parameter corresponding to the backlight block in the mth row and nth column, BL max is the maximum backlight drive value.
4. The method according to claim 1, characterized in that: After determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameter of each backlight block, the method further includes: Perform pixel compensation on the pixel value of each pixel point according to the light intensity value corresponding to each pixel point; driving the backlight panel according to the driving value of each backlight block; The pixel value of the compensated pixel point is sent to the screen driving board, so that the screen driving board displays according to the pixel value of the compensated pixel point.
5. The method according to claim 1, characterized in that Obtaining light intensity distribution data of each backlight block; When the backlight driving value of the first backlight block is the maximum backlight driving value and the backlight driving values of the remaining backlight blocks are zero, the light intensity distribution data of the first backlight block is collected.
6. A light intensity value determination device, characterized in that: include: An acquisition module, used to acquire the original input image; A driving value determination module, used to determine the driving value of each backlight block according to the original input image; A light intensity value determination module, used to determine the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block; Also includes: A light intensity distribution data acquisition module, used for acquiring light intensity distribution data of each backlight block before determining the light intensity value corresponding to each pixel point according to the driving value of each backlight block and the fitting parameters of each backlight block; A backlight block data to be fitted determination module, used to determine the data to be fitted for each backlight block according to the light intensity distribution data of each backlight block; A backlight block fitting parameter determination module is used to perform binary high-order polynomial fitting on the to-be-fitted data of each backlight block to obtain the fitting parameters of each backlight block; The module for determining the data to be fitted of the backlight block is specifically used for: Removing Gaussian noise from the light intensity distribution data of each backlight block; The light intensity distribution data of each backlight block after removing Gaussian noise is mapped to the logarithmic space to obtain the data to be fitted for each backlight block.
7. A terminal device, characterized in that: include: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 5.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
Projection automatic geometric correction method based on optical sensor
CN101500172A
Direct type backlight luminance compensation method and display device
CN103295553A
Plane type camera calibration method
CN103854271A
Dynamic regional backlight dimming method based on improved shuffled frog-leaping algorithm
CN107342056A
Method for obtaining high-precision positioning of Gaussian beam based on four-quadrant detector
CN108240791A
