Electronic display color accuracy compensation
A multidimensional color lookup table addresses color accuracy issues in electronic displays by correcting white point overcompensation and crosstalk, improving image quality through data transformation and subpixel adjustments.
Patent Information
- Application Number
- JP2024122439
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2017-09-08
- Filing Date
- 2024-07-29
- Publication Date
- 2024-11-13
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Electronic displays experience issues with color accuracy due to current drops and crosstalk, leading to oversaturation and reduced color accuracy, particularly when compensating for variations in display pixels.
A multidimensional color lookup table (CLUT) transforms input image data to correct for white point overcompensation and crosstalk by mapping input data values using empirical data and calculations, adjusting subpixels to improve color accuracy.
The CLUT effectively reduces or eliminates crosstalk-based color errors and oversaturation, enhancing the perceived image quality on electronic displays by compensating for non-linear white point overcompensation and crosstalk.
Smart Images

Figure 2024160259000001_ABST
Abstract
Description
[Background technology]
[0001] This disclosure relates generally to electronic displays, and more specifically to gain applied to display an image or image frame on an electronic display.
[0002] This section is intended to introduce the reader to various aspects that may be related to various aspects of the present technology, which are described below and / or claimed. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
[0003] Electronic devices often use electronic displays to provide visual representations of information by displaying one or more images. Such electronic devices may include computers, mobile phones, portable media devices, tablets, televisions, virtual reality headsets, and vehicle dashboards, among many others. To display an image, the electronic display may control light emission from display pixels based at least in part on image data indicative of target characteristics of the image. The electronic display may be calibrated to compensate for current drops due to resistance on a path from a power source, such as a power management integrated circuit (PMIC), to the electronic display. The compensation may be determined and / or adjusted based on the white point of the electronic display. However, this compensation may result in overcompensation of non-white colors and oversaturation of at least some colors. Summary of the Invention
[0004] A summary of certain embodiments disclosed herein is provided below. It should be understood that these aspects are presented merely to provide the reader with an overview of these specific embodiments, and that these aspects are not intended to limit the scope of this disclosure. Indeed, the disclosure may encompass a variety of aspects that are not set forth below.
[0005] The present disclosure relates generally to improving perceived image quality on an electronic display. To display an image, an electronic display can control light emission from its display pixels based at least in part on image data that indicates target characteristics (e.g., luminance) at image pixels in the image. In some examples, the image data can be generated by an image data source.
[0006] Electronic displays may experience display variations (e.g., current drop) due to connection resistance between the display's power supply and the light-emitting elements. To correct for these display variations, electronic devices (e.g., including displays) may be set to drive levels to produce a target white point for white pixels. However, non-white pixels may be over-saturated. Additionally, the color accuracy of the display may be reduced by crosstalk on the light-emitting elements from the data signals of other light-emitting elements in the display.
[0007] To address white overcompensation and / or other crosstalk, a multi-dimensional color lookup table (CLUT) converts input image data into compensated and / or corrected image data. For example, the CLUT can be populated to map input data values to correct for subsequent white point overcompensation. In other words, the mapping can be used to invert the overcompensation. The use of the CLUT allows for the correction of non-linear white point overcompensation by selecting values that cancel the overcompensation that is mapped using empirical data and / or calculations. Furthermore, the mapping in the CLUT can compensate for crosstalk by taking into account adjacent data values in channels that may cause crosstalk between light emitting element data paths to reduce or eliminate color errors due to crosstalk. In other words, empirical data reflecting crosstalk variations can be input into the CLUT to adjust subpixels based on other subpixels, such as pixel values (e.g., including multiple subpixel values) of the pixel and / or adjacent pixels. [Brief description of the drawings]
[0008] The various aspects of the present disclosure can be better understood by reading the following Detailed Description and by referring to the following drawings. [Figure 1] FIG. 1 is a block diagram of an electronic device including an electronic display for displaying images, according to one embodiment. [Diagram 2] 2 is an example implementation of the electronic device of FIG. 1 according to one embodiment. [Diagram 3] 2 is another example of the electronic device of FIG. 1 according to one embodiment. [Figure 4] 2 is another example of the electronic device of FIG. 1 according to one embodiment. [Diagram 5] 2 is another example of the electronic device of FIG. 1 according to one embodiment. [Figure 6] 2 is a block diagram of a display pipeline implemented in the electronic device of FIG. 1 according to one embodiment. [Figure 7]FIG. 7 is a flow diagram of a process for operating the display pipeline of FIG. 6 according to one embodiment. [Figure 8] 2 is a schematic diagram of a portion of the electronic display of FIG. 1 according to one embodiment. [Figure 9] FIG. 7 is a block diagram of the display pipeline of FIG. 6 with a white compensation circuit according to one embodiment. [Figure 10] 10 is a graph illustrating color accuracy in the display pipeline of FIG. 9 according to one embodiment. [Figure 11] FIG. 10 is a flow diagram of a process that can be used to improve color accuracy in the display pipeline of FIG. 9 according to one embodiment. [Figure 12] FIG. 7 is a block diagram illustrating an embodiment of the display pipeline of FIG. 6 having improved color accuracy using a color lookup table (CLUT) to correct for oversaturation and perform tone compensation, according to one embodiment. [Figure 13] FIG. 7 is a block diagram illustrating an embodiment of the display pipeline of FIG. 6 having improved color accuracy using a color look-up table (CLUT) to correct for oversaturation and using a white point compensation circuit to perform tone compensation, according to one embodiment. [Figure 14] FIG. 7 is a block diagram representing an embodiment of the display pipeline of FIG. 6 having improved color accuracy using a color lookup table (CLUT) to correct for oversaturation mutually exclusive with tone compensation performed in a white point compensation circuit, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] One or more specific embodiments of the present disclosure are described below. These described embodiments are merely examples of the technology disclosed herein. Moreover, in order to provide a concise description of these embodiments, not all features of an actual implementation are described herein. As with any engineering or design project, it should be understood that in the development of any such practical implementation, numerous implementation-specific decisions must be made to achieve the developer's specific objectives, such as compliance with system-related and business-related constraints, which may vary from implementation to implementation. Moreover, it should be understood that the development effort may be complex and time-consuming, but may nevertheless be a routine exercise in design, fabrication, and manufacture for those skilled in the art having the benefit of this disclosure.
[0010] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" mean that there is one or more elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. Further, it should be understood that references to "one embodiment" or "embodiments" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that incorporate the recited features.
[0011] This disclosure relates generally to electronic displays that can be used to present visual representations of information, for example, as images in one or more image frames. To display an image, the electronic display can control light emission from its display pixels based at least in part on image data that indicates target characteristics of the image. For example, the image data can indicate target luminance (e.g., brightness) of particular color components of a portion of the image (e.g., image pixels) that, when blended (e.g., averaged) together, can result in the perception of a range of different colors.
[0012] Electronic displays may experience display variations (e.g., current drop) due to connection resistance between the display's power supply and the light-emitting elements. To correct for these display variations, electronic devices (e.g., including displays) may be set to drive levels to produce a target white point for white pixels. However, non-white pixels may be over-saturated. Additionally, the color accuracy of the display may be reduced by crosstalk on the light-emitting elements from the data signals of other light-emitting elements in the display.
[0013] To address white overcompensation and / or other crosstalk, a multi-dimensional color look-up table (CLUT) converts input image data into compensated and / or corrected image data. For example, the CLUT can be populated to map input data values to correct for subsequent white point overcompensation. In other words, the mapping can be used to invert the overcompensation. The use of the CLUT allows for the correction of non-linear white point overcompensation by selecting values that cancel the overcompensation that is mapped using empirical data and / or calculations. Furthermore, the mapping in the CLUT can compensate for crosstalk by taking into account adjacent data values in channels that may cause crosstalk between light emitting element data paths to reduce or eliminate color errors due to crosstalk. In other words, empirical data reflecting crosstalk variations can be input into the CLUT to adjust subpixels based on other subpixels, such as pixel values (e.g., including multiple subpixel values) of the pixel and / or adjacent pixels.
[0014] In some embodiments, tone compensation, luminance compensation, device-specific calibration, and linear accessibility filters may be used to select values and populate the CLUT and map the input data to corrected and / or compensated data. Additionally or alternatively, device-specific calibration, luminance compensation, linear accessibility filters, and / or tone compensation may be performed in other parts of the display pipeline, including the CLUT.
[0015] Furthermore, the CLUT may be of any suitable size. For example, the size of the CLUT may be based on the number of available colors and / or other parameters of the electronic display. Furthermore, the dimensionality of the CLUT may be set according to the number of indexes used to look up the data. For example, if sub-pixel values are to be compensated and / or corrected from a pixel having three sub-pixels, the CLUT may have at least three dimensions.
[0016] With the foregoing in mind, one embodiment of an electronic device 10 employing an electronic display 12 is shown in Figure 1. As described in more detail below, electronic device 10 may be any suitable electronic device, such as a handheld electronic device, a tablet electronic device, a notebook computer, etc. It should therefore be noted that Figure 1 is merely one example of a particular implementation and is intended to illustrate the types of components that may be present within electronic device 10.
[0017] In the illustrated embodiment, electronic device 10 includes electronic display 12, input device 14, input / output (I / O) ports 16, processor core complex 18 having one or more processor(s) or processor cores, local memory 20, main memory storage 22, network interface 24, power supply 26, and image processing circuitry 27. The various components depicted in FIG. 1 may include hardware elements (e.g., circuitry), software elements (e.g., tangible non-transitory computer-readable media that store instructions), or a combination of both hardware and software elements. It should be noted that the various illustrated components may be combined into fewer components or separated into additional components. For example, local memory 20 and main memory storage 22 may be included in a single component. Additionally, image processing circuitry 27 (e.g., a graphics processing unit) may be included in processor core complex 18.
[0018] As shown, processor core complex 18 is operatively coupled to a local memory 20 and a main memory storage device 22. In some embodiments, local memory 20 and / or main memory storage device 22 may be tangible, non-transitory computer-readable media that store instructions executable by processor core complex 18 and / or data to be processed by processor core complex 18. For example, local memory 20 may include random access memory (RAM) and main memory storage device 22 may include rewriteable non-volatile memory, such as read only memory (ROM), flash memory, a hard drive, an optical disk, etc.
[0019] In some embodiments, processor core complex 18 may execute instructions stored in local memory 20 and / or main memory storage 22 to perform operations such as generating source image data. As such, processor core complex 18 may include one or more general purpose microprocessors, one or more application specific processors (ASICs), one or more field programmable logic arrays (FPGAs), or any combination thereof.
[0020] As shown, processor core complex 18 is also operatively coupled to a network interface 24. Using network interface 24, electronic device 10 may be communicatively coupled to a network and / or other electronic devices. For example, network interface 24 may connect electronic device 10 to a personal area network (PAN), such as a Bluetooth® network, a local area network (LAN), such as an 802.11x Wi-Fi® network, and / or a wide area network (WAN), such as a 4G or LTE® cellular network. In this manner, network interface 24 may enable electronic device 10 to transmit image data to and / or receive image data from the network.
[0021] Additionally, as shown, processor core complex 18 is operably coupled to a power source 26. In some embodiments, power source 26 may provide power to operate processor core complex 18 and / or other components within electronic device 10. Thus, power source 26 may include any suitable energy source, such as a rechargeable lithium polymer (Li-poly) battery and / or an alternating current (AC) power converter.
[0022] Further, as shown, processor core complex 18 is operably coupled to I / O ports 16 and input devices 14. In some embodiments, I / O ports 16 may enable electronic device 10 to interface with various other electronic devices. Additionally, in some embodiments, input devices 14 may enable a user to interact with electronic device 10. For example, input devices 14 may include buttons, a keyboard, a mouse, a trackpad, etc. Additionally or alternatively, electronic display 12 may include touch-sensing components that enable user input to electronic device 10 by detecting the occurrence and / or location of an object touching its screen (e.g., a surface of electronic display 12).
[0023] In addition to enabling user input, electronic display 12 may facilitate providing a visual representation of information by displaying images (e.g., within one or more image frames). For example, electronic display 12 may display an operating system graphical user interface (GUI), an application interface, text, still images, or video content. To facilitate displaying images, electronic display 12 may include a display panel having one or more display pixels. Additionally, each display pixel may include one or more sub-pixels that each control the luminance of one color component (e.g., red, blue, or green).
[0024] As described above, electronic display 12 may display images by controlling the luminance of sub-pixels based at least in part on corresponding image data (e.g., image pixel image data and / or display pixel image data). In some embodiments, the image data may be received from another electronic device, for example, via network interface 24 and / or I / O ports 16. Additionally or alternatively, the image data may be generated by processor core complex 18 and / or image processing circuitry 27.
[0025] As mentioned above, electronic device 10 may be any suitable electronic device. For illustrative purposes, one example of a suitable electronic device 10, specifically handheld device 10A, is shown in FIG. 2. In some embodiments, handheld device 10A may be a portable telephone, a media player, a personal data organizer, a handheld gaming platform, and / or the like. For example, handheld device 10A may be a smartphone, such as any IPHONE® model available from APPLE INC.
[0026] As shown, handheld device 10A includes an enclosure 28 (e.g., housing). In some embodiments, enclosure 28 may protect internal components from physical damage and / or shield from electromagnetic interference. Additionally, as shown, enclosure 28 surrounds electronic display 12. In the illustrated embodiment, electronic display 12 displays a graphical user interface (GUI) 30 having an array of icons 32. By way of example, when an icon 32 is selected by either input device 14 or a touch-sensitive component of electronic display 12, an application program may be launched.
[0027] Additionally, as shown, the input device 14 opens through the enclosure 28. As discussed above, the input device 14 may enable a user to interact with the handheld device 10A. For example, the input device 14 may enable a user to activate or deactivate the handheld device 10A, navigate the user interface to a home screen, navigate the user interface to user-configurable application screens, activate a voice recognition feature, provide volume control, and / or toggle between vibrate and ring modes. As shown, the I / O port 16 also opens through the enclosure 28. In some embodiments, the I / O port 16 may include, for example, an audio jack for connecting to an external device.
[0028] For further illustration, another embodiment of the suitable electronic device 10, specifically tablet device 10B, is shown in FIG. 3. For illustration purposes, tablet device 10B may be any IPAD® model available from APPLE INC. A further embodiment of the suitable electronic device 10, specifically computer 10C, is shown in FIG. 4. For illustration purposes, computer 10C may be any MACBOOK® or IMAC® model available from APPLE INC. Another embodiment of the suitable electronic device 10, specifically watch 10D, is shown in FIG. 5. For illustration purposes, watch 10D may be any APPLE WATCH® model available from APPLE INC. As shown, tablet device 10B, computer 10C, and watch 10D each also include an electronic display 12, an input device 14, an I / O port 16, and an enclosure 28.
[0029] As discussed above, electronic display 12 may display images based at least in part on image data received from, for example, processor core complex 18 and / or image processing circuitry 27. Additionally, as discussed above, the image data may be processed before being used to display an image on electronic display 12. In some embodiments, the display pipeline may process the image data based, for example, on gain values associated with corresponding pixel locations to facilitate improving the perceived image quality of electronic display 12.
[0030] For illustrative purposes, a portion 34 of electronic device 10 including a display pipeline 36 is shown in Figure 6. In some embodiments, display pipeline 36 may be implemented by circuitry within electronic device 10, circuitry within electronic display 12, software running on processor core complex 18, or a combination thereof. For example, display pipeline 36 may be included in processor core complex 18, image processing circuitry 27, a timing controller (TCON) within electronic display 12, or any combination thereof.
[0031] As shown, portion 34 of electronic device 10 also includes image data source 38, display driver 40, controller 42, and external memory 44. In some embodiments, controller 42 can control the operation of display pipeline 36, image data source 38, and / or display driver 40. To facilitate controlling the operation, controller 42 can include a controller processor 50 and controller memory 52. In some embodiments, controller processor 50 can execute instructions stored in controller memory 52. Thus, in some embodiments, controller processor 50 can be included in processor core complex 18, image processing circuitry 27, a timing controller within electronic display 12, a separate processing module, or any combination thereof. Additionally, in some embodiments, controller memory 52 can be included in local memory 20, main memory storage 22, external memory 44, internal memory 46 of display pipeline 36, a separate tangible non-transitory computer readable medium, or any combination thereof.
[0032] In the illustrated embodiment, the display pipeline 36 is communicatively coupled to an image data source 38. In this manner, the display pipeline 36 may receive image data, for example, in a source (e.g., RGB) format, from the image data source 38 corresponding to an image to be displayed on the electronic display 12. In some embodiments, the image data source 38 may be included in the processor core complex 18, the image processing circuitry 27, or a combination thereof.
[0033] As described above, the display pipeline 36 can process image data received from the image data source 38. To process the image data, the display pipeline 36 can include one or more image data processing blocks 54. For example, in the illustrated embodiment, the image data processing block 54 includes a color manager 56. Additionally or alternatively, the image data processing block 54 can include an ambient adaptive pixel (AAP) block, a dynamic pixel backlight (DPB) block, a white point correction (WPC) block, a sub-pixel layout compensation (SPLC) block, a burn-in compensation (BIC) block, a panel response correction (PRC) block, a dithering block, a sub-pixel uniformity compensation (SPUC) block, a content frame dependent duration (CDFD) block, an ambient light sensing (ALS) block, or any combination thereof. The color manager 56 controls and / or compensates for colors within a displayed image presented on the electronic display 12.
[0034] After processing, display pipeline 36 may output processed image data, such as display pixel image data, to display driver 40. Based at least in part on the processed image data, display driver 40 may apply analog electrical signals to display pixels of electronic display 12 to display images within one or more image frames. In this manner, display pipeline 36 may operate to facilitate providing a visual representation of information on electronic display 12.
[0035] For illustrative purposes, one embodiment of a process 60 for operating the display pipeline 36 is shown in FIG. 7. Generally, the process 60 includes receiving image pixel image data (block 62), processing the image pixel image data to determine display pixel image data (block 64), and outputting the display pixel image data (block 66). In some embodiments, the process 60 may be implemented based on circuit connections formed within the display pipeline 36. Additionally or alternatively, in some embodiments, the process 60 may be implemented by using processing circuitry, such as the controller processor 50, to execute instructions stored in a tangible, non-transitory computer-readable medium, such as the controller memory 52.
[0036] As described above, the display pipeline 36 may receive image pixel image data from the image data source 38 indicating target luminance of color components of points (e.g., image pixels) in an image (block 62). In some embodiments, other display parameters may be included, such as pixel grayscale levels, compensation settings, accessibility settings, brightness settings, and / or other factors that may modify the appearance of the display. In some embodiments, the image pixel image data may be in a source format. For example, if the source format is an RGB format, the image pixel image data may indicate a target luminance for a red component, a target luminance for a blue component, and a target luminance for a green component at a corresponding pixel location.
[0037] Additionally, the controller 42 may instruct the display pipeline 36 to process the image pixel image data to determine display pixel image data, correct for white point over-compensation (block 64), and output the display pixel image data to the display driver 40 (block 66). To determine the display pixel image data, the display pipeline 36 may convert the image data from a source format to a display format based on various display parameters. In some embodiments, the display pipeline 36 may determine a display format that may be based at least in part on the layout of sub-pixels in the electronic display 12. For example, the display pipeline 36 may use white point compensation to compensate for current drop in the panel and may also utilize white point compensation to correct for white point over-compensation.
[0038] To help illustrate white point compensation and overcompensation correction, a portion 70 of display 12 is presented in FIG. 8 . Portion 70 includes a portion 72 of an active area of display 12. Portion 72 includes a pixel including three subpixels 74, 76, and 78. In the illustrated embodiment, subpixel 74 corresponds to a red subpixel, subpixel 76 corresponds to a green subpixel, and subpixel 78 corresponds to a blue subpixel. In other embodiments, the subpixels may be oriented differently and / or may correspond to different colors than those represented in portion 72. In some embodiments, a pixel (e.g., portion 72) may include a different number of subpixels other than three.
[0039] This of the pixels in that it employs light-emitting elements 79. Light-emitting elements 79 may include organic light-emitting diodes (OLEDs) and / or any other light-emitting elements. The amount of light emitted from light-emitting elements 79 is based on a respective current 80, 82, or 84. For example, current 80 controls how much red light is emitted from the corresponding light-emitting element 79, current 82 controls how much green light is emitted from the corresponding light-emitting element 79, and current 84 controls how much blue light is emitted from the corresponding light-emitting element 79.
[0040] The amount of power input by currents 80, 82, and 84 is controlled by the voltage difference between ELVDD 86 and ELVSS 88. However, due to resistance 90 in the connection between the power supplies (e.g., PMIC), the voltage across portion 72 may be different than the difference between ELVDD 86 and ELVSS 88. In other words, ΔELVDD 92 and ΔELVSS 94 may reduce the drive current (e.g., current 80) through the corresponding light emitting element 79. This reduction may be referred to as a current drop on the panel of display 12.
[0041] To address the current drop, the display pipeline 100 (e.g., display pipeline 36) attempts to compensate by adjusting the current through the light emitting element 79 to generate a white point corresponding to a grayscale value of 255 that combines the maximum drive of the sub-pixels. This white point compensation is performed in the display pipeline 100, specifically in the white point compensation transform block 102. This white point compensation transform block 102 may receive various parameters that control this compensation. For example, the white point compensation transform block 102 may utilize tone compensation 104, luminance compensation 106, and primary calibration 108 to determine the white point of the display 12. The tone compensation 104 may compensate for the ambient light (e.g., color and / or luminance). For example, tone compensation 104 may be used to compensate for the color and luminance of the ambient light to ensure that the parent of the display image is the same across different ambient light conditions. Additionally or alternatively, tone compensation 104 may be used to set a particular tone for the display image based on a setting. For example, a night mode may be used to reduce blue emission by adjusting the white point determined from the white point compensation transform block 102. Brightness compensation 106 is based on the brightness setting used for display 12. Primary calibration 108 may include panel-specific calibration coefficients that correct for panel variations.
[0042] The color manager 56 may include a three-dimensional color lookup table (CLUT) 110 that can be used to convert image data from one format to another. The color manager 56 may also be used to convert image data to a suitable panel gamut (e.g., color display range) of the display 12 using panel gamut conversion parameters 112 in a CLUT pre-conversion block 113. The panel gamut conversion parameters 112 may include a palette of physical colors available for display using the display 12. The color manager 56 using the three-dimensional lookup table 110 may also be used to convert image data based on linear accessibility filters 114 and non-linear accessibility functions 116. The linear accessibility filters 114 may include various linear filters that change the appearance of the displayed data on the display 12. For example, these linear accessibility filters 114 may include color filters that adjust the input data to compensate for color vision efficiency. For example, the color filters may include grayscale filters, red / green filters for protanopia, green / red filters for protanopia, blue / yellow filters for tritanopia, and / or other custom filters. Because these linear accessibility filters 114 are linear, these filters may be applied in a pre-CLUT transform block 113 in the pipeline 100 before the CLUT 110. The color manager 56 may also include a pre-CLUT range map block 115 that maps colors from the image data to the CLUT 110.
[0043] Non-linear accessibility functions 116 may include other accessibility functions that are non-linear and change the appearance of displayed data on display 12. For example, non-linear accessibility functions 116 may include an invert mode that inverts colors in the image data to aid readability for people with certain vision deficiencies. These non-linear accessibility functions may be applied to post-CLUT range map 118 and / or post-CLUT transform block 120.
[0044] The display pipeline 100 may include other processing blocks. For example, the illustrated embodiment of the display pipeline 100 includes an environmentally adaptive pixel (AAP) block 122 and a dynamic pixel backlight (DPB) block 124. The AAP block 122 can adjust pixel values in image content depending on environmental conditions. The DPB block 124 can adjust the backlight, which sets the backlight of the display 12 according to the image content. For example, in some embodiments, the DPB block 124 can perform histogram equalization on the image data to reduce the backlight output to reduce power consumption without changing the appearance of the image data on the display 12.
[0045] It should be noted that the color accuracy of the display 12 is at least partially driven (e.g., on a frame-by-frame basis) by white point compensation in the white point compensation conversion block 102. As previously discussed, white point compensation using a white point (e.g., grayscale value 255 for a number of pixels) can address some issues with current drop. However, performing white point compensation based on the white point can cause oversaturation of non-white colors due to overcompensation because the compensation is based on the white point rather than on non-white colors (e.g., R=0, G=100, and B=0). Furthermore, color accuracy issues can derive from crosstalk that changes (e.g., increases) emission levels away from the display's target values as the emission target values increase. For example, FIG. 10 identifies a graph 130 illustrating color accuracy for a target color point 132. A first set of emission level points 134 can be relatively close to the target color point 132. A second set of luminance level points 136 can be slightly further from the target color point 132. This greater variance results from the higher luminance levels of the second set of luminance level points 136. The even higher luminance levels of the third set of luminance level points 138 cause the third set of luminance level points 138 to be a varyingly greater distance from the target color point 132.
[0046] To address these issues, the display pipeline 36, 100 may utilize the three-dimensional CLUT 110 to modulate the luminance of a sub-pixel based on the overall current level and / or compensation data in the display 12. In other words, the modulation of the luminance level of the sub-pixel is a function of the current through the other channels. To aid in illustration, FIG. 11 illustrates a process 150 that may be used to improve color accuracy in the display 12 using the CLUT 110. The process 150 includes receiving image values for driving a number of light-emitting elements of the display 12 (block 152). These image values may be included in image data (e.g., a frame of video data) passed to the display pipeline 36, 100 and may correspond to current and / or voltage levels used to drive the light-emitting elements 79 to generate corresponding grayscale levels. In some embodiments, the display pipeline 36, 100 also receives compensation information (block 154). The compensation information may include accessibility settings, luminance compensation, panel-specific calibration, tone compensation, and / or color oversaturation correction. The luminance of the pixels can be used to determine the crosstalk compensation in the CLUT 110. This luminance (e.g., including luminance compensation) may be used for compensation on a panel-by-panel basis. In other words, each panel may be characterized by 1) measuring the CLUT 110 for one or more luminance levels, 2) calculating RGB values to map given targets to the measured colors, 3) setting a linear mapping of gray levels (e.g., R=G=B) to maintain display driver integrated circuit calibration, and 4) checking the integrity of the CLUT 110. In some embodiments, the CLUT 110 values may be averaged for multiple panels to address crosstalk.
[0047] The display pipeline 36, 100 then utilizes the CLUT 110 to look up a drive level for a light emitting element of the plurality of light emitting elements based at least in part on the drive values for the plurality of light emitting elements (block 156). By looking up the drive level for a light emitting element (e.g., a green sub-pixel) based on other light emitting elements (e.g., red and blue sub-pixels), effects related to crosstalk on the display 12 can be reduced and / or eliminated. In addition to or instead of using multiple channel information to calculate the drive level for a single sub-pixel, in some embodiments the lookup table may include compensation information to correct for oversaturation and / or other compensation issues.
[0048] FIG. 12 illustrates an embodiment of a display pipeline 170 that utilizes color oversaturation correction 172 to undo overcompensation that may be induced by the white point compensation transform block 102. In other words, the CLUT 110 may be populated with drive values indexed by input image values that take into account color oversaturation that occurs in the white point compensation transform block 102 and pre-compensate for such overcompensation. In the illustrated embodiment, the CLUT 110 is also populated according to a linear accessibility filter 114, tone compensation 104, luminance compensation 106, primary calibration 108, and / or other compensations / calibrations. By applying all of these compensations to the CLUT 110, panel-to-panel variations can be reduced. In some embodiments, the data in the CLUT 110 may be populated to compensate for crosstalk by considering the drive energy (e.g., current and / or voltage) for other channels and / or luminance compensation 106. In the illustrated embodiment, if any of the factors (e.g., tone compensation 104) change, the CLUT 110 is recalculated. For example, in some embodiments, the CLUT 110 may include a 17x17x17 LUT that is completely recalculated when the tone compensation 104 and / or the linear accessibility filter 114 are changed.
[0049] 13 illustrates an embodiment of a display pipeline 174 similar to display pipeline 170, except that display pipeline 174 utilizes white point compensation transform block 102 to perform tone compensation and utilizes post-CLUT transform block 120 to process linear accessibility filter 114. By applying tone compensation 104 and linear accessibility filter 114 after utilizing CLUT 110, calculations of a different set of LUT inputs may be performed at boot without recalculation required when linear accessibility filter 114, non-linear accessibility function 116, and / or tone compensation 104 are changed. However, tone compensation 104 and / or linear accessibility filter 114 applied after primary calibration 108 may induce panel-to-panel differences.
[0050] 14 illustrates an embodiment of a display pipeline 176 that applies color oversaturation correction 172 mutually exclusive with tone compensation 104. In other words, the primary calibration 108 of the display 12 may be applied to a first portion 178 of the display pipeline 176 (e.g., the CLUT 110) when tone compensation 104 and / or linear accessibility filter 114 are not applied to the image data. Alternatively, the primary calibration 108 may be applied to a second portion 180 of the display pipeline when tone compensation 104 and / or linear accessibility filter 114 are applied to the image data after the CLUT 110. This display pipeline 176 does not utilize repopulation of the CLUT 110 after changing tone compensation 104 and / or linear accessibility filter 114. Additionally, the CLUT 110 may reduce or eliminate panel-to-panel variations because the primary calibration 108 takes into account panel-to-panel variations. However, when tone compensation 104 and / or linear accessibility filter 114 are applied, the resulting displayed image may suffer from saturated colors due to color oversaturation correction 172 not being applied to these functions.
[0051] Although the embodiments described above involve using a three-dimensional CLUT, some embodiments may utilize a multi-dimensional CLUT that includes a number of dimensions different from three. For example, if a pixel includes a different number of sub-pixels (e.g., four sub-pixels RGBW), the CLUT can have a number of dimensions that matches the number of sub-pixels in the pixel.
[0052] Additionally, each of display pipelines 100, 170, 174, and 176 includes a CLUT 110 at a static location. However, in some embodiments, the CLUT 110 may be located at a different location within the display pipeline. For example, instead of using software compensation for crosstalk as described above, the CLUT 110 may be moved closer to the end of the display pipeline to reduce crosstalk without convolving LUT data to address crosstalk.
[0053] It should be understood that the specific embodiments described above are shown by way of example, and that these embodiments may be susceptible to various modifications and alternative forms. It is further to be understood that the claims are not limited to the particular forms disclosed, but rather are intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure.
[0054] The technology presented and claimed herein is applied with reference to tangible objects and specific examples of practical nature that clearly advance the art, and as such is not abstract, insubstantial, or merely theoretical. Moreover, where any of the claims appended at the end of this specification contain one or more elements recited as "means for [performing] ___ [function]" or "step for [performing] ___ [function]," it is intended that such elements are to be construed in accordance with 35 U.S.C. 112(f). However, with respect to any of the claims that contain elements recited in any other manner, it is not intended that such elements are to be construed in accordance with 35 U.S.C. 112(f).
Claims
1. an electronic display including a display area including a plurality of pixels, each pixel including a plurality of sub-pixels; a display pipeline coupled to the electronic display, the display pipeline comprising: Receive image data; performing white point compensation on the image data to compensate for current drop in the display and cause the display to display a target white point when displaying white; correcting white point over-compensation for the image data to reduce potential over-saturation of non-white pixels using the white point compensation; outputting the compensated and corrected image data to the electronic display to facilitate displaying the compensated and corrected image data on the display area. A display pipeline configured as follows: An electronic device comprising:
2. 2. The electronic device of claim 1, wherein the display pipeline includes a multi-dimensional lookup table, and wherein correcting the white point over-compensation includes looking up a value in the multi-dimensional lookup table based at least in part on a color over-compensation correction value determined for the electronic display.
3. The electronic device of claim 2 , wherein the multi-dimensional lookup table includes a number of dimensions equal to the number of sub-pixels corresponding to each pixel of the plurality of pixels.
4. The electronic device of claim 2 , wherein the multi-dimensional lookup table is populated based on crosstalk compensation to compensate for crosstalk between the sub-pixels.
5. 5. The electronic device of claim 4, wherein the crosstalk compensation for a first sub-pixel of the plurality of sub-pixels is based at least in part on drive levels of other sub-pixels of the plurality of sub-pixels.
6. 2. The electronic device of claim 1, wherein the current drop comprises a reduced current through a subpixel due to a resistance between a power source and the display area.
7. The electronic device of claim 1 , wherein correcting the white point over-compensation comprises pre-correcting the white point compensation before performing the white point compensation.
8. Receiving a frame of video data for driving a plurality of light emitting elements in an electronic display; receiving compensation information for the frame of video data; looking up in a multi-dimensional lookup table a transformed drive value for a light emitting element corresponding to the frame of video data, the transformed drive value being looked up at least in part based on values in the frame for other light emitting elements of the plurality of light emitting elements; driving the light emitting element to the converted drive value; A method comprising:
9. 9. The method of claim 8, further comprising populating the multi-dimensional lookup table to compensate for crosstalk between the plurality of light emitting elements.
10. Populating the multi-dimensional lookup table measuring values of the multi-dimensional lookup table for a plurality of brightness levels of the electronic display; Calculating a mapping from the measured colors of the electronic display to a given target; establishing a linear mapping for the grey levels of said electronic display; checking the completeness of the multi-dimensional lookup table for the electronic display; 10. The method of claim 9, comprising:
11. 11. The method of claim 10, wherein populating the multi-dimensional lookup table comprises averaging multi-dimensional lookup tables from a plurality of electronic displays.
12. The method of claim 10 , wherein the gray levels include a red pixel value equal to a green pixel value equal to a blue pixel value.
13. The method of claim 10 , wherein the compensation information comprises a white point compensation correction that corrects for oversaturation of non-white image values in the frame of video data.
14. The method of claim 10 , wherein the compensation information comprises grey level compensation for compensating for a display grey level of the frame of video data based on ambient light.
15. 15. The method of claim 14, wherein the tone compensation comprises adjusting the display tone of the frame of video data based at least in part on the ambient light tone.
16. The method of claim 14 , wherein the grey level compensation comprises compensation to reduce blue light within the display grey levels of the frames of video data.
17. 1. An electronic device comprising: A display pipeline comprising: a color manager configured to receive input image data, the color manager including a multi-dimensional color lookup table configured to convert the input image data into transformed image data; a white point compensation circuit configured to generate a target white point for a white value by compensating for a current drop in the electronic device in the converted image data, the display pipeline being configured to correct over-compensation of non-white pixels by the white point compensation circuit; A display pipeline including: An electronic device comprising:
18. 20. The electronic device of claim 17, wherein correction of overcompensation of non-white pixels is performed within the multidimensional color lookup table, the multidimensional color lookup table including populated values based at least in part on a tone compensation setting and a linear accessibility filter, and wherein changing the tone compensation setting or the linear accessibility filter causes recalculation of the populated values.
19. 20. The electronic device of claim 17, wherein a correction for over-compensation of non-white pixels is performed in the multidimensional color lookup table, and gradation compensation is performed in the white point compensation circuit after the correction for over-compensation of non-white pixels is performed.
20. 20. The electronic device of claim 17, wherein correction for overcompensation of non-white pixels is performed in the multidimensional color lookup table when a tone compensation mode is not set to compensate for ambient light related to tones in the white point compensation circuit.
Citation Information
Patent Citations
Display system with compensation techniques and / or shared level resources
US20160027382A1
