Processing of image to be displayed by display device, method of manufacturing display device and corresponding display device
By storing and using the light source white dot information of the local dimming backlight unit to adjust the image pixel value, the white dot consistency problem caused by LEDs in different color bins is solved, and more efficient manufacturing and lower cost display equipment production is achieved.
Patent Information
- Application Number
- CN202410428684.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-12
- Filing Date
- 2024-04-10
- Publication Date
- 2024-11-12
AI Technical Summary
Ensuring white dot consistency is a challenge in display devices using local dimming backlight units, especially when using LEDs from different color bins, resulting in color differences affect the appearance consistency of the display panel and the quality of the final product .
By storing information related to the white dots of the light source of the local dimming backlight unit and using this information to adjust the pixel value of the image, especially considering the white dot related information of the light source to compensate for the white dot differences caused by different color bin LEDs, thus achieving White dot consistency.
This method allows the use of LEDs from multiple color bins, significantly shortening manufacturing time, improving yield, and reducing the net loss and cost per unit of LEDs, avoiding low production efficiency due to color bin restrictions in monochrome bin schemes and high cost issues.
Smart Images

Figure CN118942409A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method, a computer program code and an apparatus for processing an image to be displayed by a display device, in particular by a display device having a local dimming backlight unit providing essentially white light. The invention further relates to a method for manufacturing a display device, a corresponding display device and a motor vehicle having such a display device. Background Art
[0002] The backlight unit of a display device is usually based on a light guide, into which the light from several light-emitting diodes (LEDs) is coupled. The light propagates in the light guide by total reflection and is coupled out again with the help of microscopic structures on the light guide, resulting in a uniform light distribution. This design enables very compact and efficient display lighting.
[0003] As an alternative to light guide based backlight units, so called matrix backlight units can be used. Matrix backlight units use a large number of light sources arranged in a matrix to generate light. The light sources are arranged on a printed circuit board which is mounted on a back plate. Matrix backlight units usually use a metal back plate and suitable reflectors.
[0004] An increasing number of display applications in the automotive sector are using local dimming backlight units. The reasons include lower power consumption, higher contrast, and improved thermal performance of display devices in high brightness environments.
[0005] At an abstract level, a liquid crystal display (LCD) with a local dimming backlight unit consists of a segmented backlight unit, an LCD panel, and a processor that analyzes the image to be displayed and derives driving values for the segmented backlight unit and the display panel.
[0006] The segmented backlight unit is constructed in such a way that several different areas can be controlled individually depending on the image content to be displayed. In particular, the backlight zones corresponding to brighter image areas will have a higher brightness, while the zones corresponding to dark or black image areas will have a lower brightness or will even be completely turned off.
[0007] For example, US2011 / 0148940 A1 discloses a driving method for local dimming of an LCD device. A frame is divided into a plurality of blocks corresponding to a plurality of dimming blocks of a backlight unit. The average value of each color in the block is obtained by analyzing the image data of the block and determining a local dimming value corresponding to the average value of each color for the block. A maximum value is detected among the average values of the various colors in the block, and a brightness local dimming value corresponding to the maximum value in the block is determined. Then, depending on whether the block is a color area or a non-color area, a plurality of LEDs corresponding to the blocks in the backlight unit are driven on a color basis according to the local dimming value of each color in the block, or on a color basis using the same brightness local dimming value.
[0008] US2007 / 0046485 A1 discloses a technique for setting the voltage and current of LEDs of an LED backlight structure. In one embodiment, a red LED is connected in series between a first voltage regulator and a first controllable current source, a green LED is connected in series between a second voltage regulator and a second controllable current source, and a blue LED is connected in series between a third voltage regulator and a third controllable current source. After all LEDs are mounted on a printed circuit board, each voltage regulator is controlled so that the voltage drop across the current source is minimized, thereby minimizing the energy dissipation of the current source. In addition, the current source is controlled to balance the three colors so as to achieve the target light output of the board using a light detection chamber. The control values used to achieve the target light characteristics are then stored in a memory on the board.
[0009] An important component of a display with a local dimming backlight unit is a processor that generates the required values for the backlight unit and the display panel. The processor analyzes the image to be displayed and determines the necessary appearance of the backlight unit based on the pixel values, in particular their brightness levels.
[0010] Another important role of the processor is to adjust the image sent to the display panel in such a way that the combination of the appearance of the backlight unit and the image effectively displayed on the display panel is substantially the same as the intended target image to be displayed. If this step is missing, the appearance of the resulting image will be significantly different from that of the target image, which may be considered unacceptable.
[0011] A significant driver of the price of local dimming displays is the placement of the LEDs in the backlight unit. The price is driven by several factors. One factor is that a fairly large number of LEDs must be placed. This number can range from hundreds to even thousands of LEDs, which need to be placed in specific locations with a high degree of accuracy. Another factor is that, unlike standard printed circuit board components (where these components are often tightly packed around key components), the LEDs on the backlight unit are distributed over a large area. This limits the speed at which the pick and place machines on the assembly line can place the components, as it takes a lot of time to move from the component pick location to the component placement location and back.
[0012] The consistency of the appearance of a display panel is an important aspect of a display panel, especially for high-end products. This consistency of appearance refers not only to the brightness of the panel, but also to color reproduction and white point. For display applications with local dimming backlight units, the consistency of white point is challenging from a manufacturing perspective. Unlike edge-lit display applications that require a relatively small number of LEDs, local dimming displays have more LEDs, up to thousands. The consistency requirement translates into a requirement that all LEDs come from the same color bin. If some LEDs come from different color bins, the display areas they illuminate will appear slightly different colors, which can be easily noticed at the edges between areas illuminated by LEDs with different color bins. The same is true if a backlight unit is constructed using monochromatic LEDs (e.g., LEDs that emit blue or violet light) in combination with a light conversion foil covering the entire display area, because the quality of the light generated depends not only on the light conversion foil but also on the input monochromatic light, i.e., its dominant wavelength, because part of the light output generated comes directly from the LED. Summary of the invention
[0013] It is an object of the present invention to provide a solution for further improving the perceived quality of images displayed by a display device having a local dimming backlight unit providing substantially white light.
[0014] This object is achieved by a method for processing an image to be displayed according to claim 1, a computer program code according to claim 8, an apparatus according to claim 9, a method for producing a display device according to claim 10, a display device according to claim 14 and a motor vehicle according to claim 15. The dependent claims contain advantageous further developments and improvements of the inventive concept as described below.
[0015] According to a first aspect, a method for processing an image to be displayed by a display device having a local dimming backlight unit providing substantially white light comprises:
[0016] - receiving an image to be displayed;
[0017] - determining a driving value for a light source of a local dimming backlight unit based on an image to be displayed;
[0018] -determining a backlight appearance based on the drive value; and
[0019] - adjusting pixel values of the image based on the backlight appearance, wherein adjusting the pixel values takes into account information related to the white point of the light source.
[0020] Accordingly, a computer program code comprises instructions which, when executed by at least one processor, cause the at least one processor to perform the following steps for processing an image to be displayed by a display device having a local dimming backlight unit providing substantially white light:
[0021] - receiving an image to be displayed;
[0022] - determining a driving value for a light source of a local dimming backlight unit based on an image to be displayed;
[0023] -determining a backlight appearance based on the drive value; and
[0024] - adjusting pixel values of the image based on the backlight appearance, wherein adjusting the pixel values takes into account information related to the white point of the light source.
[0025] The term computer must be understood in a broad sense and includes, in particular, embedded devices and other processor-based data processing devices.
[0026] For example, the computer program code may be available for electronic retrieval or storage on a computer readable storage medium.
[0027] According to another aspect, an apparatus for processing an image to be displayed by a display device having a local dimming backlight unit providing substantially white light comprises:
[0028] - an input terminal for receiving an image to be displayed;
[0029] - a brightness calculation unit for determining a driving value of a light source of a local dimming backlight unit based on an image to be displayed;
[0030] - an appearance estimation unit for determining a backlight appearance based on the drive values; and
[0031] - a pixel adjustment unit for adjusting pixel values of the image based on the backlight appearance, wherein the pixel adjustment unit is configured to adjust the pixel values taking into account information related to the white point of the light source.
[0032] According to yet another aspect, a method for manufacturing a display device having a local dimming backlight unit that provides substantially white light comprises:
[0033] - determining information related to the white point of the light source of the local dimming backlight unit; and
[0034] -Storing the determined information in a memory.
[0035] Therefore, a display device having a local dimming backlight unit providing substantially white light is configured to access a memory storing information related to the white point of the light source of the local dimming backlight unit.
[0036] According to the present invention, instead of ensuring that all LEDs are from the same color bin, information related to the white point of the light source of the local dimming backlight unit is stored in a memory. This information is then used to compensate for differences in the white point of the backlight resulting from the use of LEDs from different color bins. In this way, the constraints imposed on system manufacturing by the white point consistency requirement are eliminated. As a result, LEDs from multiple color bins can be used without adversely affecting the quality of the final product.
[0037] The solution according to the present invention has multiple benefits. Generally, the simplest solution to ensure that all LEDs come from the same color bin is to use a single pick and place arm to place all LEDs from the same component reel / reel / spool. However, this solution is the slowest solution because it is limited by the arm movement time. If several pick and place arms are used to assemble LEDs, all reels fed to these pick and place arms must have the same color bin because each arm is served by a different feeder. This is only possible when all LED reels purchased from LED suppliers have the same color bin. However, this solution is not supported by LED suppliers because it means strict sorting on the corresponding production line. Therefore, this method will be reflected in the LED unit price and will therefore have a great impact on the total system cost. The solution according to the present invention allows the use of multiple reels without the need to purchase all reels with the same color bin. This means that multiple pick and place arms can be used to manufacture a single backlight unit, thereby significantly shortening the manufacturing time and thus increasing the output.
[0038] Another benefit is the number of LEDs in one reel compared to the number of LEDs that need to be placed on a given printed circuit board. For example, assuming a reel with 3000 LEDs and a system with 1300 LEDs, if a single pick and place arm is used to assemble the LEDs to guarantee that all LEDs are from the same color bin, the reel can only be used for two backlight units. This means that only 2600 of the total 3000 LEDs can be used, and the remaining 400 LEDs, or 13.3% of the LEDs, represent losses because they cannot be used in the product. This also applies to solutions using multiple pick and place arms. Simply switching to a larger reel and assuming that the percentage of unusable LEDs decreases as the total number of LEDs increases does not necessarily solve this problem. For example, for a system with 1300 LEDs, only 3900 LEDs can be used in a reel with 5000 LEDs. This means that 1100 LEDs, or 22% of the LEDs, need to be discarded. One possibility to mitigate this problem is to use a reel with a non-standard number of LEDs. However, such a solution would be custom made for a specific project, which would result in a higher cost per LED, as the supplier would have to prepare a special reel. The solution according to the invention allows using all LEDs from the reel, significantly reducing the net loss of LEDs and correspondingly reducing the cost per unit.
[0039] In a preferred embodiment, adjusting the pixel value includes individually adjusting the color channels of the pixel based at least on information related to the white point associated with the corresponding position of the same pixel of the light source. For example, if the white point given by the LED illuminating the current pixel is biased towards blue, a blue channel weight slightly less than one can be generated for the current pixel, while the weights of the green channel and the red channel remain unchanged at one. In this way, the combination of a slightly blue backlight and a pixel with reduced amplitude on the blue channel produces a white point value close to the target value. When the values of certain color channels of a pixel are weighted using sub-unit values, the transmittance of the pixel is slightly reduced. In order to maintain brightness consistency of the display panel, it is advantageous if the backlight is also adjusted so that the overall brightness of the current pixel is maintained at the same level as the brightness of the pixels in the adjacent backlight area.
[0040] In an advantageous embodiment, a crosstalk matrix is used to take into account the white points of neighboring light sources for adjusting pixel values. The white point adjustment weights determined for the backlight area illuminating the currently processed pixel can be used directly for the adjustment of the pixel, which has the benefit of simple circuit implementation and therefore low cost. Alternatively, they can be further combined with weights from neighboring areas using a crosstalk matrix. This variant results in better white point consistency, because light leakage from neighboring areas, i.e. crosstalk, is taken into account when adjusting the current pixel. This aspect is particularly relevant for neighboring backlight areas using LEDs from different color bins.
[0041] In an advantageous embodiment, information related to the white point of the light source is retrieved from a mapping stored in a memory. As already explained above, the color coordinates (i.e. the white point) of the LEDs of the backlight unit depend on the individual color bins of the LEDs. Therefore, during assembly of the backlight unit or during a subsequent calibration process, a mapping can be generated in which information related to the white point of the LEDs is stored for individual positions. This mapping can then be used as a basis for white point compensation. In this way, based on the coordinates of each processed pixel, relevant information related to the white point of the LED illuminating the processed pixel can be retrieved. Based on this information, the necessary color channel weights for the processed pixel can be determined.
[0042] In a preferred embodiment, the information related to the white point of the light source includes calibration data, weights, or information related to the color bins of the light source. When the color bins of the LEDs are stored in a mapping, the mapping can be constructed as a lookup table capable of storing values with a very short word length. For example, if the word stored in the lookup table is only 2 bits, four different LED color bins can be distinguished. The additional bits of the word extend the capability to eight different LED color bins, which is sufficient for most local dimming applications. The stored word is then preferably used as input to an additional lookup table that establishes a correspondence between the digitally encoded color bins and the required white point compensation weights or brightness adjustment coefficients. How the LED color bins are digitally encoded into these bits in the lookup table depends on the application. Of course, the compensation weights or calibration data (such as the individual color coordinates of the LEDs) can also be stored directly in the mapping.
[0043] In an advantageous embodiment, one of the color bins is considered a white point reference. In this approach, one of the LED color bins (e.g., the color bin that produces a final system white point closest to the desired target white point) is considered a white point reference. For the remaining color bins, white point compensation weights are determined in such a way that the resulting white point of the system in those regions corresponding to different LED color bins is placed at the same color coordinates as the reference white point of the reference color bin. Thus, the resulting local dimming display has a white point determined by the LED color bin that is considered a reference.
[0044] In an advantageous embodiment, the weights are derived according to a statistical method. For example, based on typical color coordinates of different color bins, the weights are set to average values so that statistically the resulting white point is consistent with the desired reference white point within some desired limits. In this way, all LEDs from the same color bin will produce the same color compensation weights for all manufactured systems.
[0045] Advantageously, a motor vehicle comprises a display device according to the invention.For example, the motor vehicle may be a passenger car or a truck, or alternatively an aircraft, a rail vehicle or a water vehicle.
[0046] Further features of the present invention will become apparent from the following description and appended claims, taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 schematically illustrates a cross section of a display device having a local dimming backlight unit;
[0048] Figure 2 A method for processing an image to be displayed by a display device having a local dimming backlight unit is schematically illustrated;
[0049] Figure 3 A first embodiment of an apparatus for processing an image to be displayed by a display device having a local dimming backlight unit is schematically illustrated;
[0050] Figure 4 A second embodiment of an apparatus for processing an image to be displayed by a display device having a local dimming backlight unit is schematically illustrated;
[0051] Figure 5 A method for manufacturing a display device having a local dimming backlight unit is schematically illustrated;
[0052] Figure 6 A motor vehicle using a display device according to the invention is schematically illustrated;
[0053] Figure 7 A display with a local dimming backlight unit is shown at an abstract level;
[0054] Figure 8 depicts a simplified block diagram of a known local dimming processor;
[0055] Fig. 9 A simplified block diagram depicting a first embodiment of a local dimming processor; and
[0056] Fig.10 A simplified block diagram of a second embodiment of a local dimming processor is depicted. DETAILED DESCRIPTION
[0057] This specification illustrates the principles of the present disclosure. It will therefore be appreciated that those skilled in the art will be able to design various arrangements that, although not explicitly described or shown herein, embody the principles of the present disclosure.
[0058] All examples and conditional language recited herein are intended for educational purposes to help readers understand the principles of the present disclosure and the concepts contributed by the inventors to advance the art, and should be construed as not being limited to these specifically recited examples and conditions.
[0059] In addition, all statements describing the principles, aspects and embodiments of the present disclosure and specific examples thereof herein are intended to include their structural and functional equivalents. In addition, such equivalents are intended to include currently known equivalents and equivalents developed in the future, i.e., any element that performs the same function developed, no matter how its structure.
[0060] Thus, for example, it will be appreciated by those skilled in the art that the figures presented herein represent conceptual views of illustrative circuitry embodying the principles of the disclosure.
[0061] The functions of the various elements shown in the figures may be provided using dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, these functions may be provided by a single dedicated processor, a single shared processor, or multiple independent processors, some of which may be shared. In addition, the explicit use of the term "processor" or "controller" should not be interpreted as referring exclusively to hardware capable of executing software, and may implicitly include, but are not limited to, digital signal processor (DSP) hardware, system on a chip, microcontroller, read-only memory (ROM), random access memory (RAM), and non-volatile memory for storing software.
[0062] In the claims herein, any element expressed as a means for performing a particular function is intended to encompass any manner of performing that function, including, for example, a combination of circuit elements that perform that function or any form of software, thus including firmware, microcode, etc., in combination with appropriate circuitry for executing the software to perform that function. The disclosure defined by such claims resides in the fact that the functions provided by the various recited means are combined and put together in the manner required by the claims. Therefore, any means that can provide those functions are considered equivalent to those shown herein.
[0063] Figure 1A cross section of a display device 1 with a local dimming backlight unit 2 is schematically shown. The display device 1 has a display panel 8 combined with a front glass 5. The front glass 5 seals the housing 9 of the display device 1 relative to the environment. The local dimming backlight unit 2 for the display panel 8 comprises a backplane 20, which serves as a carrier element for a printed circuit board 3, on which a plurality of light sources 30 (usually light emitting diodes) are arranged. A reflector 4 with a large number of cavities 21 is arranged on the printed circuit board 3. Each cavity 21 accommodates at least one light source 30. In the depicted example, a distance plate 6 carrying an optical foil stack 7 is located between the local dimming backlight unit 2 and the display panel 8. The foils of the optical foil stack 7 have the task of scattering, collecting or guiding the light from the reflector 4 in such a way that the requirements of the light distribution of the local dimming backlight unit 2 are met. Typical films for light manipulation are brightness enhancement films (BEF) and light control films (LCF). The distance plate 6 is a transparent plate that ensures the necessary optical distance between the optical foil stack 7 and the light source 30. The front glass 5, the distance plate 6 and the back plate 20 of the local dimming backlight unit 2 are connected by suitable connecting elements 10 (for example, gluing). Figure 1 In the example of , the local dimming backlight unit 2 provides essentially white light. To this end, the light source 30 may emit white light. Alternatively, the light source 30 may be a monochromatic LED, for example, an LED emitting blue or violet light. In this case, the optical foil stack 7 includes a light conversion foil. The local dimming processor 11 is configured to adjust the pixel values of the image to be displayed. To this end, the local dimming processor 11 utilizes information related to the white point of the light source 30, which is stored in a memory 12 of the display device 1. The local dimming processor 11 and the memory 12 may also be located separately from the display device 1. For example, in a vehicle, image and backlight drive information that are directly adjusted for a local dimming display may be generated in a high-performance computer. In this case, the display device simply uses the image and backlight information generated in different units.
[0064] Figure 2A method for processing an image to be displayed by a display device having a local dimming backlight unit that substantially provides white light is schematically illustrated. In a first step, an image to be displayed is received S1. A drive value of a light source of the local dimming backlight unit is then determined S2 based on the image to be displayed. Based on the drive value, a backlight appearance is determined S3. Pixel values of the image are then adjusted S5 based on the backlight appearance. Information related to the white point of the light source is taken into account in the step of adjusting the pixel value of the S5 image, which information may be retrieved S4 from a mapping stored in a memory. For example, the information related to the white point of the light source may include calibration data, weights, or information related to a color bin of the light source. Adjusting the S5 pixel value may include individually adjusting the color channel of the pixel based at least on information related to the white point associated with a corresponding position of the same pixel of the light source. A crosstalk matrix may be used to take into account the white points of adjacent light sources to adjust the S5 pixel value.
[0065] Figure 3 A block diagram of a first embodiment of an apparatus 40 for processing an image I to be displayed by a display device having a local dimming backlight unit providing substantially white light according to the present invention is schematically shown. The apparatus 40 has an input 41 via which the image I to be displayed is received. A brightness calculation unit 42 is configured to determine a drive value DV of a light source of the local dimming backlight unit based on the image I to be displayed. An appearance estimation unit 43 is configured to determine a backlight appearance BA based on the drive value DV. A pixel adjustment unit 44 is configured to adjust pixel values of the image I based on the backlight appearance BA. The pixel adjustment unit 44 adjusts the pixel values of the image I taking into account information related to a white point WP of the light source, which information can be retrieved from a mapping stored in a memory. The memory can be part of the apparatus or the display device or can be external to both. For example, the information related to the white point WP of the light source can include calibration data CD, weights W, or information related to a color bin CB of the light source. Adjusting the pixel value can include adjusting the color channel of the pixel individually based at least on information related to the white point WP associated with the corresponding position of the same pixel of the light source. The crosstalk matrix can be used to take into account the white point WP of the adjacent light source to adjust the pixel value. p And the drive value DV is provided via an output 47 of the device 40. The output 47 may be combined with the input 41 into a single interface. A local storage unit 46 is provided for storing data during processing.
[0066] The brightness calculation unit 42, the appearance estimation unit 43, and the pixel adjustment unit 44 may be controlled by a control unit 45. A user interface 48 may be provided to enable a user to modify the settings of the brightness calculation unit 42, the appearance estimation unit 43, the pixel adjustment unit 44, and the control unit 45. The brightness calculation unit 42, the appearance estimation unit 43, the pixel adjustment unit 44, and the control unit 45 may be embodied as dedicated hardware units. Of course, they may also be fully or partially combined into a single unit or implemented as software running on a processor (e.g., a CPU or a GPU).
[0067] Figure 4 A block diagram of a second embodiment of an apparatus 50 for processing an image to be displayed by a display device having a local dimming backlight unit providing substantially white light according to the present invention is shown. The apparatus 50 comprises a processing device 52 and a memory device 51. For example, the apparatus 50 may be a computer or an embedded system. The memory device 51 has stored instructions which, when executed by the processing device 52, cause the apparatus 50 to perform steps according to one of the described methods. Thus, the instructions stored in the memory device 51 tangibly embody a program of instructions executable by the processing device 52 to perform program steps as described herein according to the principles of the present invention. The apparatus 50 has an input 53 for receiving data. Data generated by the processing device 52 may be provided via an output 54. In addition, such data may be stored in the memory device 51. The input 53 and the output 54 may be combined into a single bidirectional interface.
[0068] As used herein, the processing device 52 may include one or more processing units, such as a microprocessor, a digital signal processor, or a combination thereof.
[0069] The local storage unit 46 and the memory devices 51 may include volatile and / or non-volatile memory areas and storage devices (eg, hard disk drives, optical drives, and / or solid-state memory).
[0070] Figure 5 A method for manufacturing a display device with a local dimming backlight unit is schematically shown. During assembly S10 of the local dimming backlight unit or during a subsequent calibration process S11, information related to a white point of a light source of the local dimming backlight unit is determined S12. The determined information is stored S13 in a memory, for example, as a mapping of various positions of the light source. For example, the information related to the white point of the light source may include calibration data, weights or information related to a color bin of the light source.
[0071] Figure 6A motor vehicle 60 using a display device 1 according to the present invention is schematically shown. For example, the display device 1 can be arranged in a dashboard. The motor vehicle 60 in this example is a passenger car. With a sensor system 61, data about the vehicle environment can be recorded. In particular, the sensor system 61 can include sensors for detecting the surrounding environment, such as ultrasonic sensors, laser scanners, radar sensors, lidar sensors or cameras. The information recorded by the sensor system 61 can be used to generate content for display by the display device 1. The display device 1 can be part of an infotainment system 62. In this example, other components of the motor vehicle 60 are a navigation system 63 (through which position information can be provided) and a data transmission unit 64. Through the data transmission unit 64, a connection with the back end can be established, for example for receiving software updates for components of the motor vehicle 60. A memory 65 can be used to store data. Data exchange between different components of the motor vehicle 60 is carried out via a network 66.
[0072] Now refer to Figures 7 to 10 To explain further details of the present invention.
[0073] Figure 7 A prior art display device 1 with a local dimming backlight unit is shown at an abstract level. In this example, the backlight unit is divided into four regions R i The image I (ie, the target image) to be displayed by the display device 1 is composed of gradients of several grayscale values. The local dimming processor 11 receives the input image I and calculates the backlight regions R based on the input image I. i These values are sent to the backlight driver 13, which effectively sets the area R of the backlight unit. i In addition, the local dimming processor 11 determines the processed image I that needs to be effectively displayed on the display panel. p , so that the resulting image produced by the entire component matches the appearance of the input image I.
[0074] In the figure, each backlight area R i The brightness generated corresponds to the given backlight area R i The input grayscale gradient of the input image I must be adjusted so that the brightness combination produced by the backlight unit and the display panel matches the desired brightness of the input image I. Given the layout of the backlight unit, it can be seen that the processed image I effectively displayed on the display panel p Instead of a gradient, a repeating pattern of high transmittance bars is presented, followed by several bars with lower transmittance levels. The transmittance of all high transmittance sections is the same, even though the corresponding grey bars from the input image I differ significantly. This is a direct result of the brightness modulation of the backlight area.
[0075] Figure 8 A simplified block diagram of a known local dimming processor 11 is depicted. In order to calculate the required drive value DV for the backlight unit, the local dimming processor 11 must first determine the brightness of the input image I corresponding to each backlight zone. Since the number of backlight zones is typically much lower than the number of pixels of the input image I, this determination can be performed together with a spatial downsampling operation. This allows reducing the processing requirements of the local dimming processor 11. Figure 8 In the embodiment of the present invention, this operation is performed by the backlight brightness calculator / downsampler block 110. Block 110 examines the input image I in a sub-pixel-by-sub-pixel manner and determines which sub-pixels in a particular image area corresponding to a single backlight zone require the greatest backlight intensity. This corresponds to the down-sampling part, as only the sub-pixels in a given area are retained. Block 110 further determines the required backlight level for these sub-pixels, which corresponds to the brightness calculation part.
[0076] The result produced by block 110 is then saved into a buffer 111. This buffer 111 is needed because the local dimming processor 11 can only determine the appearance of the backlight after receiving the entire input image I. This is mainly due to crosstalk between adjacent backlight zones, which usually do not have clear boundaries. A side effect of this buffering is that the output produced by the brightness calculator block 110 can only be used for the next input frame. This is usually possible because consecutive frames in a video stream are usually highly correlated. Only during scene changes will consecutive frames differ significantly.
[0077] In the next step, the local dimming processor 11 calculates the required drive value DV for the LED from the backlight unit based on the buffered output of the backlight brightness calculator 110 and the light spread function (LSF) 112 of each individual backlight zone. This operation is implemented by the LED brightness calculation block 113. The LED drive value DV is sent to the driver of the backlight unit and the backlight appearance estimator 114. The estimated backlight appearance BA is needed to adjust the pixel data sent to the display panel. As mentioned earlier, without this adjustment, the image produced by the local dimming display will look significantly different from the original input image I. The adjustment is performed by first estimating the reciprocal value of the estimated backlight unit brightness corresponding to the processed pixel (done by the reciprocal value estimator 115), and then multiplying the result with the digital code for each color channel from the processed pixel (done by the multiplication block 116). The resulting processed image I is then p The output is provided to a display panel. The estimated backlight appearance BA effectively acts as a spatial weight for processing the input color image in a color channel-by-color channel manner, with each color channel using the same calculated weight for a given pixel, with neighboring pixels typically having slightly different weights due to differences in backlight appearance BA.
[0078] Although in Figure 8 A system operating using three different color channels (i.e., a red channel, a green channel, and a blue channel) is depicted in the drawings, but the described method can also be extended to systems using different primary colors (e.g., red, green, blue and white, or red, green, blue and yellow).
[0079] Fig. 9 A simplified block diagram of a first embodiment of a local dimming processor 11 implementing the solution according to the invention is depicted. As mentioned before, an important step performed by the local dimming processor 11 is to adjust the image to be sent to the display in such a way that the combination between the local dimming backlight and the image effectively displayed on the display panel closely matches the appearance of the input image I. This processing step takes place after the local dimming processor 11 has estimated the backlight appearance BA based on the drive value DV of each LED and the light spread function 112 of the same LED. Figure 8 In this system, only the brightness information of the LED is used to adjust the image to be displayed. Fig. 9 The system uses a modification of this processing step, namely when calculating the pixels of the image to be displayed corresponding to an illuminated area, also taking into account the information about the specific color coordinates of this same area.
[0080] It can be seen that Fig. 9 The system includes an additional LED white point bin compensation block 117 and an additional multiplication block 118 having three multipliers, each of which operates on a dedicated color channel. Of course, the described solution is not limited to specific primary colors. In addition, although hardware multiplier blocks 116, 118 are depicted, other approaches may be used, such as using a lookup table.
[0081] The purpose of the additional LED white point bin compensation block 117 is to track which backlight zone illuminates the currently processed pixel and to generate a white point compensation coefficient CC for the current pixel based on the corresponding white point of the backlight zone given primarily by the LED color bins. White point compensation is preferably achieved by adjusting the color channels of the selected pixels individually. For example, if the white point given by the LED illuminating the current pixel is biased towards blue, the LED white point bin compensation block 117 generates a blue channel weight slightly below unity for the current pixel, while the weights for the green and red channels remain unchanged at unity. In this way, the combination of a slightly blue backlight and a pixel with reduced amplitude on the blue channel produces a white point value close to the target value.
[0082] When the values of certain color channels of a pixel are weighted using a sub-unit value, the transmittance of the pixel is slightly reduced. In order to maintain the brightness consistency of the display panel, it is advantageous if the local dimming processor 11 also adjusts the backlight so that the overall brightness of the current pixel is maintained at the same level as the pixel brightness of the adjacent backlight area. To this end, the LED white point bin compensation block 117 is also connected to the LED brightness calculation block 113.
[0083] As previously mentioned, the color coordinates (i.e., white point) of the backlight depend on the color bins of the placed LEDs. However, a map with the positions of the LEDs and their corresponding color bins can generally be constructed during assembly or in a subsequent calibration process. This map is then used as input to the LED white point bin compensation block 117. Thus, based on the coordinates of each processed pixel, block 117 can determine the color bin of the LED that corresponds to the current pixel. Using this information, block 117 can determine the color channel weights of the processed pixel.
[0084] The mapping can be constructed as a lookup table capable of storing values with very short word lengths. For example, if the lookup table stores words with only 2 bits, four different LED color bins can be distinguished. The additional bits of the word extend the capability to eight different LED color bins, which is sufficient for most local dimming applications. The stored word is then preferably used as input to an additional lookup table that establishes a correspondence between the digitally encoded color bins and the required white point compensation weights or brightness adjustment coefficients. How the LED color bins are digitally encoded into these bits in the lookup table depends on the application. Of course, compensation weights or calibration data (such as the individual color coordinates of the LEDs) can also be stored directly in the mapping.
[0085] The white point adjustment weights determined from the lookup table for the backlight zone illuminating the currently processed pixel can be used directly for the adjustment of the pixel, with the benefit of simple circuit implementation and therefore low cost. Alternatively, they can be further combined with weights from neighboring zones using a crosstalk matrix. This variant results in better white point consistency, since light leakage from neighboring zones, i.e. crosstalk, is taken into account when adjusting the current pixel. This aspect is particularly relevant for neighboring backlight zones using LEDs from different color bins.
[0086] The compensation of the white point by the local dimming processor 11 can be implemented in several different ways. In a simple method, one of the LED color bins (e.g., the color bin that produces the final system white point closest to the desired target white point) is considered as a white point reference. For the remaining color bins, the white point compensation weights are determined in such a way that the white point obtained by the system in the area corresponding to the different LED color bins is placed at the same color coordinates as the reference white point of the reference color bin. This determination can be done using a statistical method. Based on the typical color coordinates of the different color bins, the weights are set to the average value so that statistically, the obtained white point is consistent with the reference white point within some desired limits. In this way, all LEDs from the same color bin will produce the same color compensation weights for all manufactured systems. Using this method, the resulting local dimming display has a white point determined by the LED color bin considered as a reference. If the system needs to achieve a target white point, calibration can be performed in a separate step using the same method as the prior art system. In this way, LED color bin compensation and system white point calibration are two independent functions. In addition, the use of statistical data for LED color bin compensation does not require a calibration step in the production line, so this method has no time loss. The resulting inconsistency of the global white point is given by the variance of the color coordinates in the bins relative to the statistical mean.
[0087] Another possibility to achieve white point compensation is to perform a multi-step white point calibration process. This is very useful when the entire system must reach a desired white point that is different from any white point produced by the LED color bins. In this method, the calibration process advantageously performs a separate calibration for each LED color bin so that the white point created by each LED color bin is consistent with the desired target white point. Using the LED mapping determined during LED assembly, the calibration process first illuminates all LEDs in the same color bin while turning off the remaining LEDs. In this configuration, the calibration process determines the necessary weights to bring the actual white point given by the selected color bin to the target white point. In subsequent steps, the calibration process repeats the same calibration for the other color bins in a one-by-one manner. In this way, the calibration process will determine the specific weights for all LED color bins. In this method, no LED color bin is considered as a reference. LED color bin compensation and system white point calibration constitute a single, indivisible step. Although the duration of the calibration process increases proportionally when the number of LED color bins used increases, the benefit of this method is that each individual system manufactured is calibrated as close to the target white point as possible, with less error than the previously described method using statistical data.
[0088] Of course, other white point compensation methods can also be used. For example, the two methods described above can be combined. First, the statistics of the LED color bins are used to bring the backlight to a relatively uniform appearance, and then the weights are further refined during the white point calibration. Another possibility is to consider not only one LED color bin as a reference, but two or more. The remaining LED color bins will be compensated using statistics so that the resulting white point will be as close as possible to one of the reference bins. The compensated display will look like only the reference color bins were used. Finally, the display is brought to a final white point using a multi-step white point calibration procedure, where only the remaining equivalent color bins are compensated. For example, assuming that the system uses four LED color bins, two of the color bins can be considered as reference bins. The other two LED color bins will be compensated by matching one to the first reference color bin and the other to the other reference color bin. As a result, the backlight looks like only two reference color bins were placed, so the multi-step white point calibration will only perform two calibrations for the two equivalent LED color bins instead of four calibrations for the four original color bins. In this way, the duration of the multi-step calibration process is reduced to half of the original duration.
[0089] Fig.10 A simplified block diagram of a second embodiment of the local dimming processor 11 is depicted. In this embodiment of the local dimming processor 11, the backlight appearance BA is estimated directly as a color image calculated based on the color properties of the LED color bins. The advantage of this approach is that the interaction between the different backlight zones is calculated in the same step for both brightness and white point. In addition, three multipliers operating at a data rate given by the pixel clock can be omitted. For this purpose, for a standard system using red, green and blue primary colors, it is necessary to construct a backlight appearance estimator 114 and a reciprocal value estimator 115 with three independent channels, which requires an increase in the silicon area of the local dimming processor 11.
[0090] Reference numerals
[0091] 1 Display Device
[0092] 2 Local dimming backlight unit
[0093] 20 Back Panel
[0094] 21 Cavity
[0095] 3. Printed Circuit Board
[0096] 30 Light Source
[0097] 4 Reflector
[0098] 5 Front glass
[0099] 6 Distance plate
[0100] 7 Foil Stack
[0101] 8 Display Panel
[0102] 9 Housing
[0103] 10 Connecting elements
[0104] 11 Local Dimming Processor
[0105] 110 Backlight brightness calculator / downsampler block
[0106] 111 Buffer
[0107] 112 Light diffusion function
[0108] 113 Brightness calculation block
[0109] 114 Backlight Appearance Estimator
[0110] 115 Reciprocal Estimator
[0111] 116 Multiplication Block
[0112] 117 LED white point compensation block
[0113] 118 Multiplication Block
[0114] 12 Memory
[0115] 13 Backlight Driver
[0116] 40 Devices
[0117] 41 Input
[0118] 42 Brightness calculation unit
[0119] 43 Appearance estimation unit
[0120] 44 pixel adjustment unit
[0121] 45 Control Unit
[0122] 46 Local storage unit
[0123] 47 Output
[0124] 48 User Interface
[0125] 50 Devices
[0126] 51 Memory devices
[0127] 52 Processing equipment
[0128] 53 Input
[0129] 54 Output
[0130] 60 Motor Vehicles
[0131] 61 Sensor System
[0132] 62 Infotainment System
[0133] 63 Navigation System
[0134] 64 Data Transfer Units
[0135] 65 Memory
[0136] 66 Network
[0137] BA Backlight Appearance
[0138] CB Color Bin
[0139] CC compensation coefficient
[0140] CD Calibration Data
[0141] DV Drive Value
[0142] I Image
[0143] I p Processed image
[0144] R i Backlight area
[0145] W Weight
[0146] WP White Spot Information
[0147] S1 receives the image to be displayed
[0148] S2 determines the driving value of the light source
[0149] S3 Determine backlight appearance
[0150] S4 Retrieve white point information
[0151] S5 Adjust pixel value
[0152] S10 is equipped with a local dimming backlight unit
[0153] S11 Calibration Process
[0154] S12 Determine white point information
[0155] S13 stores the white point information in the memory
Claims
1. A method for processing an image (I) to be displayed by a display device (1) having a local dimming backlight unit (2) providing substantially white light, comprising: - receiving (S1) an image (I) to be displayed; - determining (S2) a drive value (DV) of a light source (30) of the local dimming backlight unit (2) based on the image (I) to be displayed; - determining (S3) a backlighting appearance (BA) based on these drive values (DV); and - adjusting (S5) pixel values of the image (I) based on the backlight appearance (BA); It is characterized in that information related to the white points (WP) of the light sources (30) is taken into account in the step of adjusting (S5) the pixel values of the image (I).
2. The method according to claim 1, wherein: This information relating to the white points (WP) of the light sources (30) is retrieved (S4) from a map stored in a memory (12).
3. The method according to claim 1 or 2, wherein: This information related to the white point (WP) of the light sources (30) comprises calibration data (CD), weights (W) or information related to the color bins (CB) of the light sources (30).
4. The method according to claim 3, wherein: One of these color bins (CB) is considered the white point (WP) reference.
5. The method according to claim 3, wherein: These weights (W) are derived based on statistical methods.
6. The method according to any one of the preceding claims, wherein: Adjusting (S5) the pixel value includes individually adjusting the color channels of the pixel based at least on information related to a white point (WP) associated with a corresponding position of the pixel of the light source (30).
7. The method according to claim 6, wherein: The crosstalk matrix is used to take into account the white points (WP) of neighboring light sources (30) to adjust (S5) pixel values.
8. A computer program code comprising instructions which, when executed by at least one processor, cause the at least one processor to perform a method for processing an image (I) to be displayed by a display device (1) according to any one of claims 1 to 7.
9. An apparatus (40) for processing an image (I) to be displayed by a display device (1) having a local dimming backlight unit (2) providing substantially white light, comprising: - an input terminal (41) for receiving (S1) an image (I) to be displayed; - a brightness calculation unit (42) for determining (S2) a drive value (DV) of a light source (30) of the local dimming backlight unit (2) based on the image (I) to be displayed; - an appearance evaluation unit (43) for determining (S3) a backlighting appearance (BA) based on the drive values (DV); and - a pixel adjustment unit (44) for adjusting (S5) pixel values of the image (I) based on the backlight appearance (BA); Characterized in that the pixel adjustment unit (44) adjusts (S5) the pixel values of the image (I) by taking into account information related to the white points (WP) of the light sources (30).
10. A method for manufacturing a display device (1) having a local dimming backlight unit (2) providing substantially white light, comprising: - determining (S12) information related to the white point (WP) of the light source (30) of the local dimming backlight unit (2); as well as - Storing (S13) the determined information in the memory (12).
11. The method according to claim 10, wherein: This information related to the white point (WP) of the light sources (30) comprises calibration data (CD), weights (W) or information related to the color bins (CB) of the light sources (30).
12. The method according to claim 11, wherein: One of the color bins (CB) is considered as a reference for the white points (WP).
13. The method according to claim 11, wherein: These weights (W) are determined using statistical methods.
14. A display device (1) having a local dimming backlight unit (2) providing substantially white light, characterized in that The display device (1) is configured to access a memory (12) storing information related to a white point (WP) of a light source (30) of the local dimming backlight unit (2).
15. A motor vehicle (60) comprising a display device (1) according to claim 14.
