Backlight reconstruction and compensation

Abstract

A processor or other circuitry can obtain emission element intensity information for an array of emission elements of an electronic display. The processor or other circuitry can reconstruct backlight information at a plurality of locations within the electronic display. The processor or other circuitry can also compensate for display of image data based at least in part on the reconstructed backlight information.

Description

[0001] Cross Reference to Related Applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 072,091, filed August 28, 2020, entitled “Backlight Reconstruction and Compensation,” which is incorporated herein in its entirety for all purposes. BACKGROUND

[0003] The present disclosure generally relates to reconstructing luminance and / or color of backlight at one or more pixels based on intensity (e.g., point spread function (PSF)) of backlight emitting elements (e.g., light emitting diodes (LEDs)).

[0004] This section is intended to introduce the reader to various aspects of art that can be related to various aspects of the present technology that are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate better understanding of the various aspects of the present disclosure. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0005] Electronic displays can use one or more emitting elements (e.g., LEDs) to provide backlight illumination to display images on the electronic display. In implementations that use more than a single backlight emitting element, the response of the one or more emitting elements can have different emission intensity. In other words, sending a signal to uniformly backlight at least a portion of the display can appear differently due to the different emission intensity of different backlight emitting elements of the display. These different emission intensities of different emitting elements can be attributed to manufacturing process differences, different emitting element batches, differences in different transmission lines between power sources and corresponding emitting elements, and / or other differences in driving circuitry, emitting elements, and / or connections therebetween that can cause different emitting elements to display different luminance levels. These different luminance levels can result in artifacts that are visible on the display during operation of the display. BRIEF DESCRIPTION OF DRAWINGS

[0006] Various aspects of the present disclosure can be better understood when read in conjunction with the following detailed description and drawings, in which:

[0007] Figure 1 is a block diagram of an electronic device having a display with emitting elements in accordance with an embodiment of the present disclosure, wherein the electronic device includes a backlight reconstruction and compensation (BRC) unit to reconstruct and compensate for intensity differences of the emitting elements;

[0008] Figure 2 is a block diagram of an electronic device having a display with emitting elements in accordance with an embodiment of the present disclosure, wherein the electronic device includes a backlight reconstruction and compensation (BRC) unit to reconstruct and compensate for intensity differences of the emitting elements; Figure 1 one example of an electronic device of

[0009] Figure 3 is another example of an electronic device according to embodiments of the disclosure; Figure 1

[0010] Figure 4 is another example of an electronic device according to embodiments of the disclosure; Figure 1

[0011] Figure 5 is another example of an electronic device according to embodiments of the disclosure; Figure 1

[0012] Figure 6 is a flowchart of a process for driving a display using backlight reconstruction according to embodiments of the disclosure;

[0013] Figure 7 is a block diagram of a pixel contrast control (PCC) circuit of a BRC unit according to embodiments of the disclosure; Figure 1

[0014] Figure 8 is a plot of overlapping and non-overlapping portions of a display that can be used by a PCC circuit of Figure 7

[0015] Figure 9 is a plot of a backlight array having emissive elements and grid locations interspersed between the emissive elements and used for reconstructing a backlight according to embodiments; and

[0016] Figure 10 is a block diagram of a BRC unit according to embodiments of the disclosure. Figure 1 DETAILED DESCRIPTION

[0017] One or more specific embodiments of the present disclosure will be described below. These described embodiments are only examples of the presently disclosed techniques. Additionally, in an effort to provide a concise description of these embodiments, all features of an actual implementation can not be described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which can vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0018] ​​​​​​When introducing elements of various embodiments of the disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there can be additional elements other than the listed elements. Additionally, it should be understood that references to "one embodiment," "an embodiment,” or “some embodiments” of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate those features.

[0019] Electronic displays can utilize a plurality of emissive elements (e.g., LEDs) in an array (e.g., a two-dimensional array) to provide backlight illumination to a display in a local backlight region. Due to the properties of various emissive elements and / or other local backlight illumination differences between different backlight illumination regions, the backlight emissive elements can have different intensities (e.g., point spread functions, referred to herein as PSFs) that can produce display artifacts. The point spread functions can be used to model how light spreads and / or distributes in space from some or all of the backlight emissive elements. In some embodiments, the PSF of each backlight emissive element can be uniquely determined / modelled for a particular emissive element. As discussed in detail below, to address such issues, backlight reconstruction can be employed to determine the luminance and / or color at each pixel value based on the PSF of the emissive element and an estimated luminance level. Using backlight reconstruction, the pixel values can be modified to account for the luminance and / or color of the backlight at each pixel location.

[0020] As will be described in greater detail below, electronic device 10 (e.g., the electronic device 10 shown) that uses such backlight reconstruction and compensation can be any suitable electronic device, such as a computer, a mobile phone, a portable media device, a wearable device, a tablet computer, a television, a virtual reality headset, etc. Thus, it should be noted that, Figure 1 the electronic device 10 shown) that uses such backlight reconstruction and compensation can be any suitable electronic device, such as a computer, a mobile phone, a portable media device, a wearable device, a tablet computer, a television, a virtual reality headset, etc. Thus, it should be noted that, Figure 1 is merely one example of a particular implementation and is intended to show the types of components that can be present in the electronic device 10.

[0021] In the depicted embodiment, the electronic device 10 includes an electronic display 12, one or more input devices 14, one or more input / output (I / O) ports 16, a processor core complex 18 having one or more processors or processor cores, a local memory 20, a main memory storage device 22, a network interface 24, a power supply 25, and a backlight reconstruction and compensation (BRC) unit 26. Figure 1The various components described in the middle can include hardware elements (e.g., circuitry), software elements (e.g., tangible, non-transitory computer-readable media storing instructions), or a combination of both software and hardware elements. For example, the BRC unit 26 can be implemented as a special-purpose circuit and / or instructions stored in the main memory storage device 22 that are executed using the processor core complex 18. Moreover, although the BRC unit 26 is referred to herein as a "unit," this is intended to describe one example form that backlight reconstruction and compensation can take in an electronic device. In fact, it can be unitary or modular in some cases, but in other cases can represent separate, non-unitary components implemented by separate components of the electronic device 10. To provide one non-limiting example, backlight reconstruction can be independent of compensation (e.g., backlight reconstruction can be performed using software running on the processor core complex 18, while compensation can be performed by image processing circuitry in the display pipeline). It should also be noted that the various depicted components can be combined into fewer components or separated into additional components. For example, the local memory 20 and the main memory storage device 22 can be included in a single component.

[0022] The processor core complex 18 can execute instructions stored in the local memory 20 and / or the main memory storage device 22 to perform operations such as generating and / or transmitting image data. As such, the processor core complex 18 can include one or more processors, such as one or more microprocessors, one or more application specific processors (ASICs), one or more field programmable logic arrays (FPGAs), one or more graphics processing units (GPUs), etc. Moreover, as previously noted, the processor core complex 18 can include one or more separate processing logic cores each processing data according to executable instructions.

[0023] The local memory 20 and / or the main memory storage device 22 can store executable instructions as well as data to be processed by the cores of the processor core complex 18. Thus, the local memory 20 and / or the main memory storage device 22 can include one or more tangible, non-transitory computer-readable media. For example, the local memory 20 and / or the main memory storage device 22 can include random access memory (RAM), read only memory (ROM), re-writable non-volatile memory (such as flash memory, hard drives, optical discs, etc.).

[0024] Network interface 24 facilitates the transmission of data to other electronic devices via a network connection. For example, network interface 24 (e.g., a radio frequency system) enables electronic device 10 to be communicatively coupled to a personal area network (PAN) (such as a Bluetooth network), a local area network (LAN) (such as an 802.11x Wi-Fi network), and / or a wide area network (WAN) (such as a 4G, LTE, or 5G cellular network). Network interface 24 includes one or more antennas configured to communicate via a network connected to electronic device 10.

[0025] The power source 25 may include any suitable energy source, such as a rechargeable lithium polymer (Li-poly) battery and / or an alternating current (AC) power converter.

[0026] I / O port 16 enables electronic device 10 to receive input data and / or output data using port connections. For example, a portable storage device can be connected to I / O port 16 (e.g., a Universal Serial Bus (USB)), thereby enabling processor core complex 18 to transfer data with the portable storage device. I / O port 16 may include one or more speakers for outputting audio from electronic device 10.

[0027] Input device 14 facilitates user interaction with electronic device 10 by receiving user input. For example, input device 14 may include one or more buttons, a keyboard, a mouse, a touchpad, etc. Input device 14 may also include one or more microphones for capturing audio.

[0028] Input device 14 may include a touch sensing component in electronic display 12. In such embodiments, the touch sensing component can receive user input by detecting the occurrence and / or location of an object touching the surface of electronic display 12.

[0029] The electronic display 12 may include a display panel having one or more display pixels. The electronic display 12 may control the light emitted from the display pixels to present a visual representation of information, such as a graphical user interface (GUI) of an operating system, an application interface, still images, or video content, by displaying image frames, at least in part based on corresponding image data. In some embodiments, the electronic display 12 may be a display using a liquid crystal display (LCD), a self-emitting display (such as an organic light-emitting diode (OLED) display), etc.

[0030] BRC unit 26 can be used to reconstruct the backlight of the electronic display 12 using the PSF of the emitting element of the electronic display 12. Backlight reconstruction is used to determine the brightness and / or color of the backlight at each pixel value based on the PSF and the estimated brightness. Using the determined brightness and / or color, BRC unit 26 is used to compensate for different brightness and / or color of the emitting element illuminating a specific pixel location from the backlight. For example, BRC unit 26 can modify the image value of the corresponding pixel location in contrast to any color and / or brightness fluctuations of the local backlight at the pixel location.

[0031] As described above, electronic device 10 can be any suitable electronic device. For ease of illustration, an example of a suitable electronic device 10, particularly a handheld device 10A, is shown below. Figure 2 As shown in the diagram. In some implementations, the handheld device 10A can be a portable phone, media player, personal data manager, handheld gaming platform, etc. For example, the handheld device 10A can be a smartphone, such as any smartphone available from Apple Inc. model.

[0032] The handheld device 10A includes a housing 28 (e.g., a casing). The housing 28 protects internal components from physical damage and / or shields them from electromagnetic interference. In the depicted embodiment, the electronic display 12 displays a graphical user interface (GUI) 30 with an array of icons 32. For example, when an icon 32 is selected via the input device 14 or a touch-sensing component of the electronic display 12, the corresponding application can be launched.

[0033] Input device 14 extends through housing 28. As described above, input device 14 enables a user to interact with handheld device 10A. For example, input device 14 allows the user to record audio, activate or deactivate handheld device 10A, navigate the user interface to the home screen, navigate the user interface to a user-configurable application screen, activate voice recognition features, provide volume control, and / or switch between vibration and ring modes. I / O port 16 also extends through housing 28. In some embodiments, I / O port 16 may include an audio jack for connecting to an external device. As previously described, I / O port 16 may include one or more speakers for outputting sound from handheld device 10A.

[0034] Another example of a suitable electronic device 10 is Figure 3 The tablet device 10B is shown. For illustrative purposes, the tablet device 10B may be any device available from Apple Inc. Model. Another example of a suitable electronic device 10, especially a computer 10C, is... Figure 4As shown in the figure. For illustrative purposes, computer 10C may be any product available from Apple Inc. or Model. Another example of a suitable electronic device 10, especially a wearable device 10D, is in Figure 5 As shown in the image. For illustrative purposes, the wearable device 10D can be any Apple product available from Apple Inc. Model. As shown in the figure, the tablet device 10B, the computer 10C, and the wearable device 10D each also include an electronic display 12, an input device 14, and a housing 28.

[0035] Figure 6 This is a flowchart of process 100 that can be utilized by BRC unit 26. Specifically, BRC unit 26 can obtain the intensity of the emitting elements of the emitting element array of electronic display 12 (box 102). The intensity may refer to the total luminance of the individual emitting elements and / or may refer to the luminance at different wavelengths (e.g., different colors) of the emitting elements. A point spread function (PSF) can be used to indicate the intensity of a pixel, which provides different luminance and / or color for different pixel values ​​of one or more emitting elements of the display. Using these intensities, BRC unit 26 reconstructs the backlight of electronic display 12 (box 104). For example, BRC unit 26 can determine the luminance and / or color of one or more pixels of electronic display 12. For example, BRC unit 26 can determine what the backlight looks like at a point (e.g., a pixel) of electronic display 12. Reconstruction may include defining two or more overlapping and / or non-overlapping regions of a pixel to determine luminance and / or color. The overlapping region may be defined as an extension of the non-overlapping region. Using the determined luminance and / or color, BRC unit 26 compensates for backlight variations at least in part based on the intensity (box 106). For example, image data values ​​for corresponding pixels can be compensated (e.g., in the linear or gamma domain). As a supplement to or alternative to modifying image data values, BRC unit 26 can compensate the backlight drive to increase uniformity.

[0036] Figure 7This is a block diagram of a pixel contrast control (PCC) circuit 110 including a BRC unit 26. The BRC unit 26 receives emitter intensity 112 and image data 113. As shown, the BRC unit 26 includes a backlight reconstruction component 114 and a backlight compensation component 116. The BRC unit 26 also receives a brightness estimate 118 from a brightness estimation circuit 120. The brightness estimation is used to estimate the brightness of individual addressable backlight areas based on the pixel values ​​of the content to enhance contrast while preserving detail and reducing (e.g., minimizing) halos and flicker, and to generate compensated image data 122 that compensates for backlight brightness and / or color. A statistical circuit 124 generates statistical values, including local statistical values ​​based on overlapping areas of the electronic display 12, local statistical values ​​based on non-overlapping areas of the electronic display 12, and / or global statistical values. The emitter processor 126 uses these statistical values ​​based on the pixel values ​​of the content to calculate the brightness of individually addressable backlight areas. Local statistics are particularly useful in displays with local dimming, while global statistics are applicable to displays with global backlighting and displays with local dimming. The statistics calculated in statistical circuit 124 may include maximum brightness, minimum brightness, average brightness, gamma / anti-gamma information, uniformity statistics, and / or other information.

[0037] Figure 8 This is a graph of portions 130 and 131 of the electronic display 12. In portions 130 and 131, there are non-overlapping regions 132 (referred to as non-overlapping regions 132A, 132B, 132C, 132D, 132E, 132F, 132G, and 132H, respectively). Portions 130 and 131 also include overlapping regions 134 (referred to as 134A and 134B, respectively). At the edges of the effective area of ​​the electronic display 12, the overlapping regions 134 begin at the edges of the corresponding non-overlapping regions 132 and extend beyond the boundaries of the non-overlapping regions 132. As shown, the overlapping region 134A includes most (e.g., all) of the non-overlapping region 132A and a vertical overlap 136 extending into the portions of the non-overlapping regions 132B and 132D. Similarly, the overlapping region 134A includes a horizontal overlap 138 extending into the portions of the non-overlapping regions 132C and 132D.

[0038] Away from the edge of the effective region, the overlapping region 134 may extend around a single non-overlapping region 132 in multiple directions. For example, the overlapping region 134B includes a majority of the non-overlapping region 132F and a first vertical overlap 140 extending above the non-overlapping region 132F into the non-overlapping regions 132E and 132G. The overlapping region 134B also includes a second vertical overlap 142 extending below the non-overlapping region 132F. The overlapping region 134B also includes a first horizontal overlap 144 and a second horizontal overlap 146 extending into the non-overlapping regions 132G and 132H.

[0039] Return to Figure 7 The emitter element processor 126 may be included in the processor core complex 18, may be executed by the processor core complex 18, and / or may include a dedicated coprocessor to supplement the processing of the processor core complex 18. A brightness estimate 118 is calculated based on statistical values ​​collected from statistical circuitry 124 of the emitters in the two-dimensional emitter element array.

[0040] The transmitter element processor 126 also utilizes a two-dimensional convolutional filter 148. The two-dimensional convolutional filter 148 applies any suitable filter that provides two-dimensional filtering. In one example, the two-dimensional convolutional filter 148 includes a two-dimensional FIR filter on the elements of the dataset sent from the transmitter element processor 126.

[0041] The emitter processor 126 may also utilize a two-dimensional bilateral filter 150. The two-dimensional bilateral filter 150 applies a bilateral filter to the values ​​of multiple (e.g., seven) emitters and takes a weighted average of those emitter values. The weighting in the two-dimensional bilateral filter 150 may be based on the distance of the emitter from the reference point and / or the intensity of the corresponding emitter value. In some embodiments, the weighted average may be based on long division. However, since the range of desired values ​​is finite, an approximation of the result can be made from one or more datasets. If the initial approximation is sufficiently accurate, the bidirectional filtering process continues. If additional accuracy is desired, multiple (e.g., one) Newton-Raphson update steps can be used to converge from the initial approximation to the desired accuracy.

[0042] The transmitter element processor 126 may also utilize a time filter 152 for time filtering of data from the transmitter element processor 126. For example, when the time filter 152 is activated, it can act as an infinite impulse response (IIR) filter. The time filter 152 can be configured in a global filtering mode, which causes the time filter to act as a classic IIR filter with asymmetric gain to allow for different transition rates between dark and bright transitions. When configured in a local filtering mode, for each transmitter element, local parameters are calculated based on previous local parameters and transmitter element differences.

[0043] The copy engine 154 can be used to write the brightness estimate 118 to the backlight reconstruction component 114. The copy engine 154 copies elements of the input dataset to multiple output locations, where optional processing is performed for each output. For example, optional processing may include enabling / disabling scaling using a scaling factor, a minimum limit on the brightness threshold, scaling based on system-level brightness settings, and / or other processing of the brightness estimate 118 from the emitter element processor 126.

[0044] The power function 156 can utilize hardware and / or software to adjust the brightness estimate based on the power / power setting of the electronic device 10. The division function 158 can utilize hardware and / or software to perform the division. For example, the division function 158 may include a hardware accelerator utilizing a polynomial approximation of the division, wherein the polynomial used to approximate the division is based on the input range of the dividend value. When additional precision is to be used for long divisions, the polynomial approximation can converge to the precision point using a Newton-Raphson update step.

[0045] Backlight reconstruction can utilize a backlight mesh. The backlight mesh comprises a grid of emitting elements and specifies multiple intermediate points between the emitting elements. For example, Figure 9 An exemplary grid 160 representing at least a portion of the backlight illumination for an electronic display 12 is shown. As shown, the grid 160 comprises twelve emitting elements 162 in three rows. Grid points 164 are distributed among the emitting elements 162, as shown. The distribution, position, and / or number of grid points 164 can be set using corresponding input parameters. For example, offset and / or spacing parameters can be used to set how far the grid points 164 are offset from the edge of the effective area of ​​the electronic display 12, from another grid point 164, and / or from the emitting elements 162. Furthermore, the number of rows or columns of grid points 164 can be set using their respective quantity parameters.

[0046] Figure 10 A block diagram of an embodiment of BRC unit 26 is shown. As shown, the BRC receives the emission element intensity 112. The emission element intensity 112 can be received in a singular value decomposition (SVD) set 190. Therefore, in such embodiments, backlight reconstruction can be performed by applying the intensity of one or more (e.g., each) emission elements 162 of the backlight of the electronic display 12. The SVD set 190 can be retrieved from local memory 20 using a direct memory access (DMA) channel. In some embodiments, the SVD set 190 can be stored in local memory 20 in the raster scan order of the associated emission elements 162 associated with the emission element intensity 112. The number of SVD sets 190 can be controlled using a parameter set of BRC unit 26 and using an SVD number parameter.

[0047] Backlight reconstruction at each grid point 164 is achieved by applying the intensity of each emitting element 162 to the brightness value of the emitting element 162 using the brightness estimation described above. In some embodiments, only a portion of the emitting elements 162 is used to apply the intensity of the backlight reconstruction. For each emitting element 162 used in the backlight reconstruction, the emitting element intensity 112 of the emitting element 162 is included in the SVD set 190 (e.g., up to multiple sets that can be selected using set parameters). In each SVD set 190, the grid point coordinates 192 are used to determine how much influence the corresponding emitting element has on the backlight at the grid point coordinates 192. For example, one or more multipliers 198 can be used to apply horizontal weights 194 and vertical weights 196 to the emitting element intensity 112. The weighted intensity 204 from the SVD set 190 is added together in one or more adders 206 to form a weighted sum 208.

[0048] In some implementations, the emission element intensity 112 may indicate color nonuniformity. For example, the emission element intensity 112 may be related to color shift in the International Commission on Illumination (CIE) 1931 XYZ color space. Based on the color nonuniformity, chromaticity (e.g., (X,Z)) compensation may be activated in backlight reconstruction. Chromaticity compensation data may be stored in the form of ratios Z / Y 210 and X / Y 212. A weighted sum 208 is multiplied by the luminance estimate 118 in multipliers 214, 216, and 218. In multiplier 214, the weighted sum is multiplied by the ratio Z / Y 219 in addition to the luminance estimate 118, and in multiplier 216, the weighted sum 208 is multiplied by the ratio X / Y 212 in addition to the luminance estimate 118. Summing circuits 220, 222, and 224 may be used to sum the scaled weighted sums 208 of the corresponding paths in the backlight reconstruction component 114. The outputs of summing circuits 220, 222, and 224 are each submitted to an XYZ-RGB converter 226, which is used to reconstruct the backlight to RGB when backlight color compensation is enabled. For example, a 3x3 transform can be used to convert the XYZ values ​​calculated at each grid point to linear RGB values. When color compensation is not enabled, in some implementations, the Y channel (via summing circuit 222) can be used to compensate for brightness separately.

[0049] Furthermore, when backlight color compensation is enabled, a global target color (e.g., XY color) or a local target color (e.g., XY color) can be calculated in the target-RGB converter 228. This conversion to the target color is based at least in part on the brightness in the Y channel using a Z / Y ratio 210 and an X / Y ratio 212, where Z equals 1-XY.

[0050] When color compensation is enabled, the RGB values ​​and reconstructed values ​​of the target color (global or local) are transferred to the RGB gain calculator 230, which calculates the gain in the RGB values. The RGB gain can be calculated using component division followed by a global scaling of the ratio. One of several (e.g., 16) polynomials can be used to estimate the component division. If additional precision is desired, the RGB gain calculator 230 can apply one or more update steps using the Newton-Raphson method. Therefore, the reconstructed backlight at each grid point in the grid points 164 can be converted into RGB gain values ​​using the interpolation engine 234 and pixel coordinates 232.

[0051] As can be understood, grid points 164 may be at a lower resolution than the pixels of the electronic display 12 to reduce the processing / storage costs for determining and / or storing information for each individual pixel. Therefore, to accommodate compensation at pixels with a different resolution than the emitting element 162, pixels between grid points 164 may be interpolated using the RGB gain value of each grid point 164 based on the position of the respective pixel relative to the respective grid point 164. For example, interpolation may include bilinear interpolation, interpolating from both the vertical and horizontal directions of the respective nearest grid point 164. In some embodiments, grid points 164 may have the same resolution as the pixels of the electronic display 12, where backlight information may be determined and / or stored for each individual pixel.

[0052] In some implementations, backlight reconstruction is normalized to a full-open curve 236. The full-open curve 236 represents all emitting elements 162 set to the same brightness. The full-open curve 236 can be conceptualized as a gain mapping. This full-open curve 236, or gain mapping, is static and defined using the resolution of grid points 164. The full-open curve 236 is acquired and stored after the electronic display 12 is powered on and before the first frame is displayed. This full-open curve 236 is combined with the weighted brightness in the Y channel using a multiplier 238. The result of the multiplier is then interpolated in the interpolation engine 240, similar to how the output of the RGB gain calculator 230 is interpolated to pixel resolution.

[0053] Interpolated values ​​from interpolation engines 234 and 240 are transmitted to a backlight compensation unit 116 including pixel modifier 242. Pixel modifier 242 modifies image data 113 to generate compensated image data 122. In some embodiments, the compensated image data 122 may undergo additional operations. For example, the compensated image data 122 may be used to enable the liquid crystal (LC) to turn on more fully when the backlight is below a desired value. Additionally or alternatively, the backlight level at one or more grid locations may be reduced to decrease power when one or more grid locations indicate a black light level higher than a target value.

[0054] The components / units described herein may include software implemented in a processor, LED processor, or other processor / coprocessor using instructions stored in storage device 22 and / or memory 20. Additionally or alternatively, the various components and / or units of the components / units described herein may be implemented using dedicated hardware circuitry (e.g., application-specific integrated circuits (ASICs)).

[0055] The specific embodiments described above have been illustrated by way of example, and it should be understood that various modifications and alternatives are permissible. It should also be understood that the claims are not intended to limit us to the specific forms disclosed, but rather to cover all modifications, equivalents, and alternatives falling within the substance and scope of this disclosure.

[0056] The techniques described herein and protected by the claims are referenced and applied to specific examples of physical and practical nature, which significantly improve the technical field and are therefore not abstract, intangible, or purely theoretical. Furthermore, if any claim appended to the end of this specification contains one or more elements designated as "means for [performing] [function]..." or "steps for [performing] [function]...", those elements shall be interpreted in accordance with 35U.SC112(f). However, for any claim containing elements designated in any other manner, those elements shall not be interpreted in accordance with 35U.SC112(f).

Claims

1. A tangible, non-transitory computer-readable medium having instructions stored thereon that, when executed, are configured to cause a processor to perform backlight reconstruction and image data compensation at least in part by: obtaining emissive element intensity information for an array of emissive elements of an electronic display, wherein the emissive element intensity information comprises a set of singular value decompositions for a plurality of locations within the electronic display; reconstructing backlight information at the plurality of locations within the electronic display; normalizing the reconstructed backlight information to a full-on curve representing emissive elements set to a same luminance, wherein the full-on curve is a mapping of static gains defined with a resolution of the plurality of locations, wherein all emissive elements in the array of emissive elements are set to the same luminance, wherein normalizing the reconstructed backlight information comprises multiplying weighted luminance values from the reconstructed backlight information by corresponding gain values of the full-on curve; and compensating display of image data based at least in part on the normalized and reconstructed backlight information.

2. The tangible, non-transitory computer-readable medium of claim 1, wherein normalizing the reconstructed backlight information to the full-on curve comprises acquiring the full-on curve prior to displaying a first frame after the electronic display is powered on.

3. The tangible, non-transitory computer-readable medium of claim 2, wherein normalizing the reconstructed backlight information to the full-on curve comprises combining the acquired full-on curve with weighted luminances in a Y channel using a multiplier.

4. The tangible, non-transitory computer-readable medium of claim 1, wherein the array of emissive elements comprises a two-dimensional array of emissive elements.

5. The tangible, non-transitory computer-readable medium of claim 4, wherein the plurality of locations are interspersed among locations of emissive elements of the two-dimensional array of emissive elements.

6. The tangible, non-transitory computer-readable medium of claim 1, wherein compensating display of the image data comprises compensating the image data for different intensities of respective emissive elements of the array of emissive elements that affect emissivity at each of the plurality of locations.

7. The tangible, non-transitory computer-readable medium of claim 6, wherein compensating display of the image data comprises determining backlight levels for a plurality of pixels of the electronic display.

8. The tangible, non-transitory computer-readable medium of claim 7, wherein compensating display of the image data comprises compensating image data at the plurality of pixels.

9. The tangible, non-transitory computer-readable medium of claim 7, wherein determining the backlight levels for the plurality of pixels comprises determining the backlight level at each of the plurality of pixels.

10. The tangible, non-transitory computer-readable medium of claim 9, wherein determining the backlight level at each of the plurality of pixels comprises interpolating respective pixel location backlight levels from two or more of the plurality of locations.

11. A system for performing backlight reconstruction and image data compensation, the system comprising: statistical circuitry configured to generate statistical values related to display of image data on an electronic display, wherein the statistical values include intensity information for a plurality of emissive elements configured to backlight the electronic display, wherein the intensity information includes a set of singular value decompositions for a plurality of locations within the electronic display, and the set of singular value decompositions each include a decomposed horizontal weight and a vertical weight; backlight reconstruction and compensation system configured to receive the image data and the intensity information, wherein the backlight reconstruction and compensation system includes: backlight reconstruction circuitry configured to receive the intensity information and reconstruct luminance levels of the backlight at the plurality of locations in the electronic display; and backlight compensation circuitry configured to: receive the reconstructed luminance levels from the backlight reconstruction circuitry, and receive the image data; normalize the reconstructed luminance levels to a full-on curve for the plurality of emissive elements set to a same luminance, wherein the full-on curve is a mapping of gains defined with a resolution of the plurality of locations, wherein all of the plurality of emissive elements are set to the same luminance, wherein normalizing the reconstructed luminance levels includes multiplying weighted luminance values from the reconstructed luminance levels by respective gain values of the full-on curve; and adjust the image data to compensate for backlight variations at the plurality of locations based at least in part on the reconstructed luminance levels.

12. The system of claim 11, including the electronic display.

13. The system of claim 11, wherein the plurality of emissive elements includes a two- dimensional array of emissive elements.

14. The system of claim 13, wherein the plurality of locations includes a plurality of grid points of a grid, the grid in a plane of the two-dimensional array of emissive elements.

15. The system of claim 14, wherein the reconstructed luminance levels include a luminance amount at each grid point from one or more respective emissive elements of the plurality of emissive elements.

16. The system of claim 14, wherein adjusting the image data includes determining a backlight luminance level for a pixel by interpolating between two or more grid points of the plurality of grid points.

17. The system of claim 11, wherein the intensity information includes color drift information for the plurality of emissive elements, and adjusting the image data includes compensating for the color drift information.

18. A method for performing backlight reconstruction and image data compensation, the method comprising: at a processor, obtaining emissive element intensity information for an array of emissive elements of an electronic display, wherein the emissive element intensity information includes a set of singular value decompositions for a plurality of locations within the electronic display, and the set of singular value decompositions each include a decomposed horizontal weight and a vertical weight; using the processor, reconstructing backlight luminance information at the plurality of locations within the electronic display; reconstructing backlight luminance information at the plurality of locations within the electronic display using the processor; normalizing the reconstructed backlight luminance information to a full-on curve for the array of emissive elements set to a same luminance, wherein the full-on curve is a map of gains defined with resolution of the plurality of locations, wherein all emissive elements in the array of emissive elements are set to the same luminance, wherein normalizing the reconstructed backlight luminance information includes multiplying weighted luminance values from the reconstructed backlight luminance information by corresponding gain values of the full-on curve; interpolating normalized backlight luminance information for pixels from two or more of the plurality of locations; interpolating backlight chrominance information for the pixels from the two or more locations; and compensating display of image data based at least in part on the interpolated and normalized backlight luminance information and the interpolated backlight chrominance.

Images