Backlight Reconstruction and Compensation

Abstract

A processor or other circuitry can obtain light emitting element intensity information for an array of light emitting elements in the electronic display. The processor or other circuitry can reconstruct backlight information at multiple locations within the electronic display. The processor or other circuitry also compensates for the display of image data based at least in part on the reconstructed backlight information.

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This patent application claims priority to U.S. Provisional Patent Application No. 63 / 072,091, entitled "Backlight Reconstruction and Compensation," filed on August 28, 2020, the entire contents of which are incorporated herein by reference.

[0002] The present disclosure generally relates to reconstructing the brightness and / or color of a backlight at one or more pixels based on the intensity (e.g., Point Spread Function (PSF)) of a backlight light emitting element (e.g., Light Emitting Diode (LED)). [Background technology]

[0003] This section is intended to introduce the reader to various aspects that may be related to various aspects of the present technology, which are described below and / or claimed. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0004] An electronic display may use one or more light emitting elements (e.g., LEDs) to provide backlighting for displaying images on the electronic display. In embodiments where multiple backlight light emitting elements are used, the response of one or more light emitting elements may have different intensities of light emission rates. In other words, signaling to uniformly backlight at least a portion of the display may appear different due to different intensities of light emission rates of different backlight light emitting elements of the display. These different intensities of light emission rates of different light emitting elements may be due to differences in manufacturing processes, different light emitting element batches, different transmission line differences between the power supply and the respective light emitting elements, and / or other differences in the drive circuitry, light emitting elements, and / or connections between them that may cause different light emitting elements to display different brightness levels. These different brightness levels may cause artifacts to be visible on the display during operation of the display. [Brief description of the drawings]

[0005] The various aspects of the disclosure may be better understood upon reading the following detailed description and by reference to the following drawings.

[0006] [Figure 1] FIG. 1 is a block diagram of an electronic device having a display with light-emitting elements, the electronic device including a Backlight Reconstruction and Compensation (BRC) unit for reconstructing and compensating for intensity differences of the light-emitting elements, according to one embodiment of the present disclosure.

[0007] [Diagram 2] 2 is an example of the electronic device of FIG. 1 according to an embodiment of the present disclosure.

[0008] [Diagram 3] 2 is another example of the electronic device of FIG. 1 according to an embodiment of the present disclosure.

[0009] [Figure 4]2 is another example of the electronic device of FIG. 1 according to an embodiment of the present disclosure.

[0010] [Diagram 5] 2 is another example of the electronic device of FIG. 1 according to an embodiment of the present disclosure.

[0011] [Figure 6] FIG. 2 is a flow diagram of a process for driving a display using backlight reconstruction according to one embodiment of the present disclosure.

[0012] [Figure 7] FIG. 2 is a block diagram of a pixel contrast control (PCC) circuitry including the BRC unit of FIG. 1 according to one embodiment of the present disclosure.

[0013] [Figure 8] 8 is a diagram of overlapping and non-overlapping portions of a display that may be used by the PCC circuitry of FIG. 7 in accordance with one embodiment of the present disclosure.

[0014] [Figure 9] FIG. 2 is a diagram of a backlight array including light emitting elements and grid locations interspersed among the light emitting elements that are used to reconstruct the backlight, according to one embodiment.

[0015] [Figure 10] FIG. 2 is a block diagram of the BRC unit of FIG. 1 according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] One or more specific embodiments of the present disclosure are described below. These described embodiments are merely examples of the technology disclosed herein. Moreover, in order to provide a concise description of these embodiments, not all features of an actual implementation are described herein. As in an engineering or design project, it should be understood that in the development of such an actual implementation, numerous implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that the development effort may be complex and time-consuming, but may nevertheless be a routine exercise in design, fabrication, and manufacture for those skilled in the art having the benefit of this disclosure.

[0017] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more elements. The terms "including" and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. Furthermore, it should be understood that references to "one embodiment," "an embodiment," "embodiments," and "some embodiments" in the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that incorporate the recited features.

[0018] Electronic displays may utilize multiple light emitting elements (e.g., LEDs) in an array (e.g., a two-dimensional array) to provide backlighting to the display in localized backlight zones. Due to the characteristics of various light emitting elements and / or other local backlighting differences between different backlighting zones, the backlight light emitting elements may have different intensities (e.g., point spread functions, referred to herein as PSFs), which may produce display artifacts. Point spread functions can be used to model how light spreads and / or disperses spatially from some or all backlight light emitting elements. In some embodiments, the PSF for each backlight light emitting element may be uniquely determined / modeled for a particular light emitting element. To address such issues, as described in more detail below, backlight reconstruction may be used to determine the brightness and / or color at each pixel value based on the PSF and estimated brightness level of the light emitting element. Using backlight reconstruction, pixel values ​​may be modified to account for the brightness and / or color of the backlight at each pixel location.

[0019] As described in more detail below, an electronic device 10 using backlight reconstruction and compensation, such as the electronic device 10 shown in Figure 1, can be any suitable electronic device, such as a computer, a mobile phone, a portable media device, a wearable device, a tablet, a television, a virtual reality headset, etc. Thus, it should be noted that Figure 1 is merely one example of a particular implementation and is intended to illustrate the types of components that may be present in the electronic device 10.

[0020] In the illustrated embodiment, electronic device 10 includes electronic display 12, one or more input devices 14, one or more input / output (I / O) ports 16, a processor core complex 18 having one or more processor(s) or processor cores, local memory 20, main memory storage 22, network interface 24, power supply 25, and backlight reconstruction and compensation (BRC) unit 26. The various components depicted in FIG. 1 may include hardware elements (e.g., circuitry), software elements (e.g., a tangible, non-transitory computer-readable medium that stores instructions), or a combination of both hardware and software elements. For example, BRC unit 26 may be implemented as instructions stored in main memory storage 22 that are executed using dedicated circuitry and / or processor core complex 18. Additionally, although BRC unit 26 is referred to herein as a "unit," this is intended to illustrate one exemplary form that backlight reconstruction and compensation may take in an electronic device. Indeed, it may be unitary or modular in some cases, but in other cases may represent separate non-unitary components implemented by separate components of electronic device 10. To take one non-limiting example, backlight reconstruction may be independent of compensation (e.g., backlight reconstruction may be performed using software running on processor core complex 18, while compensation may be performed by image processing circuitry in the display pipeline). Note that the various components shown may be combined into fewer components or separated into additional components. For example, local memory 20 and main memory storage 22 may be included in a single component.

[0021] Processor core complex 18 may execute instructions stored in local memory 20 and / or main memory storage device 22 to perform operations such as generating and / or transmitting image data. Processor core complex 18 may thus include one or more processors, such as one or more microprocessors, one or more Application Specific Processors (ASICs), one or more Field Programmable Logic Arrays (FPGAs), one or more Graphics Processing Units (GPUs), etc. Additionally, as previously mentioned, processor core complex 18 may include one or more separate processing logic cores, each of which processes data according to executable instructions.

[0022] Local memory 20 and / or main memory storage device 22 may store executable instructions as well as data to be processed by the cores of processor core complex 18. Thus, in some embodiments, local memory 20 and / or main memory storage device 22 may include one or more tangible, non-transitory computer-readable media. For example, local memory 20 and / or main memory storage device 22 may include Random Access Memory (RAM), Read Only Memory (ROM), rewriteable non-volatile memory such as flash memory, a hard drive, an optical disk, etc.

[0023] The network interface 24 may facilitate communicating data with other electronic devices over a network connection. For example, the network interface 24 (e.g., a radio frequency system) may enable the electronic device 10 to communicatively couple to a Personal Area Network (PAN), such as a Bluetooth® network, a Local Area Network (LAN), such as an 802.11x Wi-Fi® network, and / or a Wide Area Network (WAN), such as a 4G, LTE, or 5G cellular network. The network interface 24 includes one or more antennas configured to communicate over the network(s) connected to the electronic device 10.

[0024] Power supply 25 may include any suitable power source, such as a rechargeable Lithium polymer (Li-poly) battery and / or an Alternating Current (AC) power converter.

[0025] I / O port 16 may enable electronic device 10 to receive input data and / or output data using a port connection. For example, a portable storage device may be connected to I / O port 16 (e.g., a Universal Serial Bus (USB)) to enable processor core complex 18 to communicate data with the portable storage device. I / O port 16 may also include one or more speakers to output audio from electronic device 10.

[0026] The input devices 14 may receive user input to facilitate user interaction with the electronic device 10. For example, the input devices 14 may include one or more of a button, a keyboard, a mouse, a trackpad, etc. The input devices 14 may also include one or more microphones that may be used to capture audio.

[0027] Input device 14 may include a touch-sensing component within electronic display 12. In such an embodiment, the touch-sensing component may receive user input by detecting the presence and / or location of an object touching the surface of electronic display 12.

[0028] Electronic display 12 may include a display panel having one or more display pixels. Electronic display 12 may display a visual representation of information, such as an operating system Graphical User Interface (GUI), an application interface, still images, or moving image content, by controlling emission of light from the display pixels to display image frames based at least in part on corresponding image data. In some embodiments, electronic display 12 may be a display using a Liquid Crystal Display (LCD), a self-emissive display such as an Organic Light-Emitting Diode (OLED) display, or the like.

[0029] BRC unit 26 may be used to reconstruct a backlight for electronic display 12 using the PSF of the light emitting elements of electronic display 12. The backlight reconstruction is used to determine the brightness and / or color of the backlight at each pixel value based on the PSF and the estimated brightness. Using the determined brightness and / or color, BRC unit 26 is used to compensate for different brightness and / or color of the light emitting elements backlighting a particular pixel location. For example, BRC unit 26 may modify the image value for each pixel location inversely proportional to any color and / or brightness variations of the local backlight at the pixel location.

[0030] As mentioned above, electronic device 10 may be any suitable electronic device. For illustrative purposes, one example of a suitable electronic device 10, specifically handheld device 10A, is shown in FIG. 2. In some embodiments, handheld device 10A may be a portable telephone, a media player, a personal data organizer, a handheld gaming platform, and / or the like. For example, handheld device 10A may be a smartphone, such as any iPhone® model available from Apple Inc.

[0031] Handheld device 10A includes an enclosure 28 (e.g., a housing). Enclosure 28 may protect internal components from physical damage and / or may shield from electromagnetic interference. In the illustrated embodiment, electronic display 12 displays a graphical user interface (GUI) 30 having an array of icons 32. By way of example, when an icon 32 is selected by either input device 14 or a touch-sensing component of electronic display 12, a corresponding application program may be launched.

[0032] The input devices 14 may extend across the enclosure 28. As discussed above, the input devices 14 may enable a user to interact with the handheld device 10A. For example, the input devices 14 may enable a user to record audio, activate or deactivate the handheld device 10A, navigate the user interface to a home screen, navigate the user interface to user-configurable application screens, activate a voice recognition feature, provide volume control, and / or toggle between a vibrate mode and a ring mode. The I / O ports 16 may also extend across the enclosure 28. In some embodiments, the I / O ports 16 may include, for example, an audio jack for connecting to an external device. As discussed above, the I / O ports 16 may include one or more speakers for outputting audio from the handheld device 10A.

[0033] Another example of a suitable electronic device 10 is a tablet device 10B shown in FIG. 3. For illustrative purposes, the tablet device 10B may be any iPad® model available from Apple Inc. A further example of a suitable electronic device 10 is a computer 10C shown in FIG. 4. For illustrative purposes, the computer 10C may be any MACBOOK® or IMAC® model available from Apple Inc. Another example of a suitable electronic device 10 is a wearable device 10D shown in FIG. 5. For illustrative purposes, the wearable device 10D may be any Apple Watch® model available from Apple Inc. As shown, the tablet device 10B, the computer 10C, and the wearable device 10D each also include an electronic display 12, an input device 14, and an enclosure 28.

[0034] FIG. 6 is a flow diagram of a process 100 that may be utilized by BRC unit 26. Specifically, BRC unit 26 may obtain light emitting element intensities for an array of light emitting elements of electronic display 12 (block 102). The intensity may relate to the overall brightness of an individual light emitting element and / or may refer to the brightness at different wavelengths (e.g., different colors) of the light emitting element. The intensity of a pixel may be indicated using a point spread function (PSF) that provides different brightness and / or color for different pixel values ​​for one or more light emitting elements of the display. Using the intensity, BRC unit 26 reconstructs a backlight for electronic display 12 (block 104). For example, BRC unit 26 may determine the brightness and / or color for one or more pixels of electronic display 12. For example, BRC unit 26 may determine what the backlight looks like at a point (e.g., pixel) of electronic display 12. The reconstruction may include defining two or more overlapping and / or non-overlapping zones of the pixel to determine the brightness and / or color. The overlapping zones may be defined as extensions of the non-overlapping zones. Using the determined brightness and / or color, BRC unit 26 compensates for backlight unevenness based at least in part on intensity (block 106). For example, image data values ​​(e.g., in the linear or gamma domain) of each pixel may be compensated. In addition to or instead of modifying the image data values, BRC unit 26 may cause the backlight drive to be compensated to increase uniformity.

[0035] FIG. 7 is a block diagram of pixel contrast control (PCC) circuitry 110 including BRC unit 26. BRC unit 26 receives light emitting element intensities 112 and image data 113. As shown, BRC unit 26 includes backlight reconstruction component 114 and backlight compensation component 116. BRC unit 26 also receives brightness estimates 118 from brightness estimation circuitry 120. The brightness estimates are used to estimate the brightness of the individual addressable backlight zones based on content pixel values ​​and generate compensated image data 122 that preserves detail, improves contrast while reducing (e.g., minimizing) halos and flicker, and compensates for backlight brightness and / or color. Statistics circuitry 124 generates statistics including local statistics based on overlapping zones of electronic display 12, local statistics based on non-overlapping zones of electronic display 12, and / or global statistics. Light emitting element processor 126 uses the statistics to calculate the brightness of the individually addressable backlight zones based on content pixel values. Local statistics may be particularly useful in displays with local dimming, while global statistics may be applicable to displays with global backlights as well as displays with local dimming. Statistics calculated in statistics circuitry 124 may include brightness maximum, brightness minimum, brightness average, en-gamma / degamma information, uniformity statistics, and / or other information.

[0036] 8 is a diagram of portions 130 and 131 of electronic display 12. Portions 130 and 131 include non-overlapping zones 132 (individually referred to as non-overlapping zones 132A, 132B, 132C, 132D, 132E, 132F, 132G, and 132H). Portions 130 and 131 also include overlapping zones 134 (individually referred to as 134A and 134B). At the edges of the active area of ​​electronic display 12, overlapping zones 134 begin at the edges of each non-overlapping zone 132 and extend beyond the boundaries of non-overlapping zones 132. As shown, overlapping zone 134A includes a substantial portion (e.g., the entirety) of non-overlapping zone 132A and a vertical overlap portion 136 that extends into portions of non-overlapping zones 132B and 132D. Similarly, overlapping zone 134A includes a horizontal overlap portion 138 that extends into portions of non-overlapping zones 132C and 132D.

[0037] Away from the edges of the active area, overlapping zones 134 may extend in multiple directions around a single non-overlapping zone 132. For example, overlapping zone 134B includes a substantial portion of non-overlapping zone 132F and a first vertical overlap portion 140 that extends above non-overlapping zone 132F into non-overlapping zones 132E and 132G. Overlapping zone 134B also includes a second vertical overlap portion 142 that extends below non-overlapping zone 132F. Overlapping zone 134B also includes a first horizontal overlap portion 144 and a second horizontal overlap portion 146 that extends into non-overlapping zones 132G and 132H.

[0038] 7, light emitting element processor 126 may be included within processor core complex 18, may be executed by processor core complex 18, and / or may include a dedicated co-processor that complements the processing of processor core complex 18. Brightness estimate 118 is calculated from statistics for light emitting elements in the two dimensional array of light emitting elements collected from statistical circuitry 124.

[0039] The light emitting element processor 126 also utilizes a two-dimensional convolution filter 148. The two-dimensional convolution filter 148 applies any suitable filter capable of providing filtering in two dimensions. In one example, the two-dimensional convolution filter 148 includes a two-dimensional FIR filter applied to elements of the data set transmitted from the light emitting element processor 126.

[0040] The light emitting element processor 126 may also utilize a two-dimensional bilateral filter 150. The two-dimensional bilateral filter 150 applies a bilateral filter to the values ​​of multiple (e.g., seven) light emitting elements and takes a weighted average of the values ​​of the multiple light emitting elements. The weighting in the two-dimensional bilateral filter 150 may be based on the distance of the light emitting element from a reference point and / or the intensity of the value of each light emitting element. In some embodiments, the weighted average may be based on long division. However, since the range of expected values ​​is limited, an approximation of the result may be made from one or more data sets. If the initial approximation is sufficiently accurate, the bilateral filtering process continues. If further accuracy is to be used, several (e.g., one) Newton-Raphson update steps may be used to converge from the initial approximation to the desired accuracy.

[0041] The light emitting element processor 126 may also utilize a temporal filter 152 that is used to temporally filter data from the light emitting element processor 126. For example, when the temporal filter 152 is enabled, it may function as an Infinite Impulse Response (IIR) filter. The temporal filter 152 may be configured in a global filtering mode that causes the temporal filter to function as a classical IIR filter with asymmetric gain allowing different transition rates for dark to light and light to dark transitions. When configured in a local filtering mode, local parameters are calculated for each light emitting element based on the previous local parameters and the difference of the light emitting element.

[0042] A copy engine 154 may be used to write the brightness estimates 118 to the backlight reconstruction component 114. The copy engine 154 copies elements of an input data set to multiple output locations and performs optional processing on each output. For example, the optional processing may include enabling / disabling scaling using a scale factor, minimum limits on brightness thresholds, scaling based on system level brightness settings, and / or other processing of the brightness estimates 118 from the light emitting element processor 126.

[0043] The power function 156 may utilize hardware and / or software to adjust the brightness estimate based on the power / power settings of the electronic device 10. The division function 158 may utilize hardware and / or software to perform the division. For example, the division function 158 may include a hardware accelerator that utilizes a polynomial approximation of the division, where the polynomial used to approximate the division is based on the input range of the values ​​being divided. If additional precision is to be used for the long division, a Newton-Raphson update step may be used to converge the polynomial approximation to a point of precision.

[0044] The backlight reconstruction may utilize a backlight grid. The backlight grid includes a grid of light emitting elements and defines several midpoints between the light emitting elements. For example, FIG. 9 illustrates an exemplary grid 160 representing at least a portion of the backlighting for the electronic display 12. As shown, the grid 160 includes twelve light emitting elements 162 in three columns. As shown, grid points 164 are distributed among the light emitting elements 162. The distribution, location, and / or number of the grid points 164 may be set using corresponding input parameters. For example, offset and / or spacing parameters may be used to set how much the grid points 164 are offset from the edge of the active area of ​​the electronic display 12, from another grid point 164, and / or from the light emitting elements 162. Additionally, the number of rows or columns of the grid points 164 may be set using respective number parameters.

[0045] FIG. 10 is a block diagram of one embodiment of the BRC unit 26. As shown, the BRC receives light emitting element intensities 112. The light emitting element intensities 112 may be received as a Singular Value Decomposition (SVD) set 190. Thus, in such an embodiment, the backlight reconstruction may be performed by applying intensities for one or more (e.g., each) light emitting element 162 of the backlight of the electronic display 12. The SVD set 190 may be fetched from the local memory 20 using a Direct Memory Access (DMA) channel. In some embodiments, the SVD set 190 may be stored in the local memory 20 in a raster scan order of the associated light emitting element 162 associated with the light emitting element intensity 112. The number of SVD sets 190 may be controlled using a parameter set for the BRC unit 26 using a SVD number parameter.

[0046] The reconstruction of the backlight at each grid point 164 is accomplished by applying an intensity for each light emitting element 162 to the brightness value of the light emitting element 162 using the brightness estimates described above. In some embodiments, only a portion of the light emitting elements 162 are used to apply intensities for the backlight reconstruction. For each light emitting element 162 used in the backlight reconstruction, the light emitting element intensities 112 of the light emitting element 162 are included in an SVD set 190 (up to a set number, for example, selectable using a set parameter). In each SVD set 190, the grid point coordinates 192 are used to determine how much effect the respective light emitting element has on the backlight at the grid point coordinate 192. For example, horizontal weights 194 and vertical weights 196 can be applied to the light emitting element intensities 112 using one or more multipliers 198 to apply the horizontal weights 194 and vertical weights 196. The weighted intensities 204 from the SVD set 190 are summed in one or more adders 206 to form a weighted sum 208.

[0047] In some embodiments, the light emitting element intensities 112 may exhibit color non-uniformity. For example, the light emitting element intensities 112 may be associated with color shifts in the International Commission on Illumination (CIE) 1931 XYZ color space. Based on the color non-uniformity, chrominance (e.g., (X,Z)) compensation may be enabled in the backlight reconstruction. The chrominance compensation data may be stored in the form of ratios Z / Y 210 and X / Y 212. The weighted sum 208 is multiplied by the brightness estimate 118 in multipliers 214, 216, and 218. In multiplier 214, the weighted sum is multiplied by the brightness estimate 118 plus the ratio Z / Y 219, and in multiplier 216, the weighted sum 208 is multiplied by the brightness estimate 118 plus the ratio X / Y 212. Summing circuitry 220, 222, and 224 may be used to sum the scaled weighted sums 208 for each path in the backlight reconstruction component 114. Each of the outputs of the summing circuitry 220, 222, and 224 is sent to an XYZ to RGB converter 226 that is used to reconstruct the backlight to RGB when backlight color compensation is enabled. For example, a 3×3 transform may be used to convert the calculated XYZ values ​​at each grid point to linear RGB values. When color compensation is not enabled, in some embodiments, the Y channel may be used (through the summing circuitry 222) to simply compensate for luminance.

[0048] Furthermore, when backlight color compensation is enabled, a global target color (e.g., XY color) or a local target color (e.g., XY color) may be calculated in target-to-RGB converter 228. This conversion to the target color is based at least in part on the luminance in the Y channel using the ratio Z / Y 210 and the ratio X / Y 212 (Z is equal to 1-XY).

[0049] When color compensation is enabled, the RGB values ​​of the target color (global or local) and the reconstructed values ​​are sent to an RGB gain calculator 230, which calculates gains for the RGB values. The RGB gains may be calculated using a component-wise division followed by a global scaling of the ratio. The component-wise division may be estimated using one of several (e.g., 16) polynomials. If further precision is to be used, the RGB gain calculator 230 may apply one or more update steps using the Newton-Raphson method. Thus, the reconstructed backlight at each of the grid points 164 may be converted to an RGB gain value using an interpolation engine 234 and pixel coordinates 232.

[0050] As can be appreciated, the grid points 164 may have a resolution less than that of the pixels of the electronic display 12 to reduce the processing / storage costs of determining and / or storing information for each individual pixel. Thus, to accommodate compensation in pixels having a different resolution than the light emitting elements 162, the RGB gain values ​​for each grid point 164 may be used to interpolate pixels between the grid points 164 based on the location of each pixel with respect to the respective grid point 164. For example, the interpolation may include bilinear interpolation, interpolating in both vertical and horizontal directions from each nearest grid point 164. In some embodiments, the grid points 164 may have the same resolution as the pixels of the electronic display 12, and backlight information may be determined and / or stored for each individual pixel.

[0051] In some embodiments, the backlight reconstruction is normalized to an all-on profile 236. The all-on profile 236 represents all light emitting elements 162 set to the same brightness. The all-on profile 236 can be conceptualized as a map of gain. This all-on profile 236 or gain map is static and defined at a resolution of grid points 164. The all-on profile 236 is fetched and stored before the first frame is displayed after powering up the electronic display 12. This all-on profile 236 is combined with a weighted luminance in the Y channel using a multiplier 238. The result of the multiplier is then interpolated in an interpolation engine 240 similar to how the output of the RGB gain calculator 230 is interpolated to pixel resolution.

[0052] The interpolated values ​​from the interpolation engines 234 and 240 are sent to the backlight compensation component 116, which includes a pixel modifier 242. The pixel modifier 242 modifies the image data 113 to generate compensated image data 122. In some embodiments, the compensated image data 122 may undergo further processing. For example, the compensated image data 122 may be used to open liquid crystals (LC) more fully when the backlight is lower than expected. Additionally or alternatively, when one or more grid locations indicate that the blacklight level is above a target value, the backlight level of one or more locations may be reduced to reduce power consumption.

[0053] The components / units described herein may include software implemented in a processor, LED processor, other processor / co-processor using instructions stored in storage device(s) 22 and / or memory 20. Additionally or alternatively, various components and / or units of the components / units described herein may be implemented using application-specific hardware circuitry, such as an Application-Specific Integrated Circuit (ASIC).

[0054] It should be understood that the specific embodiments described above are provided by way of example, and that these embodiments may be capable of various modifications and alternative forms. It should be further understood that the claims are not intended to be limited to the particular forms disclosed, but rather are intended to cover all modifications, equivalents, and alternatives within the spirit and scope of the disclosure.

[0055] The techniques presented and claimed herein refer to and are applied to material objects and practical examples of a practical nature that demonstrably improve the art, and thus are not abstract, intangible, or purely theoretical. Moreover, if any of the claims appended at the end of this specification contain one or more elements designated as "means for [performing] [function]..." or "step for [performing] [function]...", it is intended that such elements be construed under 35 U.S.C. 112(f). However, for claims containing elements designated otherwise, it is intended that such elements not be construed under 35 U.S.C. 112(f).

Claims

1. When executed, the processor: obtaining light emitting element intensity information for an array of light emitting elements of an electronic display, the light emitting element intensity information comprising a singular value decomposition set for a plurality of locations within the electronic display; reconstructing backlight information at the plurality of locations within the electronic display; normalizing the reconstructed backlight information to an all-on profile representing light emitting elements being set to the same brightness, where the all-on profile is a map of gains defined at a grid point resolution where all light emitting elements of the array of light emitting elements are set to the same brightness, where normalizing the reconstructed backlight information includes normalizing the reconstructed backlight information to the all-on profile of gain values ​​mapped for the plurality of locations by multiplying weighted luminance values ​​from the reconstructed backlight information by respective gain values ​​of the all-on profile of gain values; and compensating a display of image data based at least in part on the normalized reconstructed backlight information. A tangible, non-transitory computer-readable medium having instructions stored thereon.

2. The tangible, non-transitory computer-readable medium of claim 1 , wherein the all-on profile comprises a map of static gain for the array of light-emitting elements.

3. 3. The tangible, non-transitory computer-readable medium of claim 2, wherein normalizing the reconstructed backlight information to the all-on profile comprises fetching the all-on profile before a first frame is displayed after powering up the electronic display.

4. 4. The tangible, non-transitory computer-readable medium of claim 3, wherein normalizing the reconstructed backlight information to the all-on profile comprises combining the fetched all-on profile with a weighted luminance in the Y channel using a multiplier applied to the Y channel in an XYZ color space.

5. The tangible, non-transitory computer-readable medium of claim 1 , wherein the array of light-emitting elements comprises a two-dimensional array of light-emitting elements.

6. The tangible, non-transitory computer readable medium of claim 5 , wherein the plurality of locations are distributed among locations of the light emitting elements of the two-dimensional array of light emitting elements.

7. 2. The tangible, non-transitory computer-readable medium of claim 1, wherein compensating the display of the image data includes compensating the image data for different intensities of each light-emitting element of the array of light-emitting elements that affect light emission rates at each location of the plurality of locations.

8. 8. The tangible, non-transitory computer-readable medium of claim 7, wherein compensating the display of the image data comprises determining a backlight level for a plurality of pixels of the electronic display.

9. The tangible, non-transitory computer-readable medium of claim 8 , wherein compensating the display of the image data comprises compensating the image data at the plurality of pixels.

10. The tangible, non-transitory computer-readable medium of claim 8 , wherein determining the backlight level for the plurality of pixels comprises determining the backlight level at each of the plurality of pixels.

11. 11. The tangible, non-transitory computer-readable medium of claim 10, wherein determining the backlight level at each of the plurality of pixels comprises interpolating a respective pixel location backlight level from two or more of the plurality of locations.

12. statistical circuitry configured to generate statistics relating to the display of image data on an electronic display, the statistics including intensity information for a plurality of light emitting elements configured to backlight the electronic display, the intensity information including singular value decomposition sets for a plurality of locations within the electronic display, each of the singular value decomposition sets including decomposed horizontal and vertical weights; and a backlight reconstruction and compensation system configured to receive the image data and the intensity information, said backlight reconstruction and compensation system comprising: backlight reconstruction circuitry configured to receive the intensity information and to reconstruct brightness levels of a backlight at the multiple locations within the electronic display; a backlight compensation circuit configured to receive the reconstructed luminance levels and the image data from the backlight reconstruction circuitry, and normalize the reconstructed luminance levels to an all-on profile representative of the plurality of light emitting elements being set to the same brightness, the all-on profile being a map of gains defined at a resolution of the plurality of locations where all of the plurality of light emitting elements are set to the same brightness, and where normalizing the reconstructed backlight information includes normalizing the reconstructed backlight information to the all-on profile of gain values ​​mapped to the plurality of locations by multiplying weighted luminance values ​​from the reconstructed backlight information by respective gain values ​​of the all-on profile of gain values; and adjust the image data to compensate for backlight unevenness at the plurality of locations based at least in part on the reconstructed luminance levels. Including, the system.

13. The system of claim 12 including the electronic display.

14. The system of claim 12 , wherein the plurality of light emitting elements comprises a two-dimensional array of light emitting elements.

15. The system of claim 14 , wherein the plurality of locations comprises a plurality of grid points, the grid being in a plane of the two-dimensional array of light emitting elements.

16. The system of claim 15 , wherein the reconstructed luminance level comprises a luminance value at each grid point from one or more respective light emitting elements of the plurality of light emitting elements.

17. The system of claim 15 , wherein adjusting the image data includes determining a backlight brightness level for a pixel by interpolating two or more of the plurality of grid points.

18. The system of claim 12 , wherein the intensity information includes color drift information for the plurality of light emitting elements, and adjusting the image data includes compensating for the color drift information.

19. obtaining, in a processor, light emitting element intensity information for an array of light emitting elements of an electronic display, the light emitting element intensity information comprising singular value decomposition sets for a plurality of locations within the electronic display, each singular value decomposition set comprising decomposed horizontal and vertical weights; reconstructing backlight luminance information at the locations within the electronic display using the processor; and normalizing the backlight luminance information to an all-on profile representing light emitting elements of the array of light emitting elements being set to the same brightness, the all-on profile being a map of gains defined at a resolution of the plurality of locations where all light emitting elements of the array of light emitting elements are set to the same brightness, and normalizing the reconstructed backlight information includes normalizing the reconstructed backlight information to the all-on profile of gain values ​​mapped to the plurality of locations by multiplying weighted luminance values ​​from the reconstructed backlight information by respective gain values ​​of the all-on profile of gain values; using the processor to reconstruct backlight chromaticity information at the multiple locations within the electronic display based at least in part on the normalized backlight luminance information; interpolating backlight luminance information for a pixel from two or more of the plurality of locations; interpolating backlight chromaticity information for the pixel from the two or more locations; compensating a display of image data based at least in part on the interpolated backlight luminance information and the interpolated backlight chromaticity information; A method comprising:

Images