Apparatus and method for pixel illumination compensation for display device having backlight light source array
By using the display driver and the backlight module in the display device for pixel illuminance compensation, the brightness unevenness problem caused by uneven light source arrangement of the backlight illumination system is solved, and the image quality of the miniaturized display device is significantly improved.
Patent Information
- Application Number
- CN202410653397.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-06-02
- Filing Date
- 2024-05-24
- Publication Date
- 2024-12-03
AI Technical Summary
Due to the space limitations of the backlight lighting system, the uneven arrangement of the light sources of the backlight lighting system leads to uneven brightness of the display panel, especially in miniaturized display devices such as head-mounted display devices.
By introducing a display driver and a backlight module in the display device, using a light source brightness compensation block and a driver circuit, input pixel data is processed according to the light source arrangement type of multiple areas defined by the display panel, and compensation coefficients are generated and applied to generate output pixel data, and then Update the target pixel to achieve pixel illuminance compensation.
The image brightness inhomogeneity caused by the non-ideal arrangement of the light source is effectively alleviated, and the brightness uniformity of the display device is improved, especially in miniaturization devices, which significantly improves image performance.
Smart Images

Figure CN119068834A_ABST
Abstract
Description
Technical Field
[0001] The disclosed technology relates generally to display devices, and more particularly to pixel luminance compensation for a display device having an array of backlight light sources. Background Art
[0002] A display device having a light-transmitting display panel, such as a light-transmitting liquid crystal display (LCD) panel, includes a backlighting system to illuminate the light-transmitting display panel. Modern backlighting systems (e.g., direct-lit backlighting, full-array backlighting, etc.) can utilize an array of light sources (such as light-emitting diodes (LEDs)) disposed directly behind the display panel to illuminate the display panel. Using an array of light sources for backlighting facilitates local dimming, which can provide brighter or darker portions on a displayed image to enhance the contrast of the displayed image. Summary of the invention
[0003] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter.
[0004] Generally, in one aspect, one or more embodiments relate to a display device. The display device includes a display panel, a backlight module, and a display driver. The backlight module includes a plurality of light sources to illuminate a plurality of zones defined for the display panel. The display driver is configured to store a first light source arrangement type for a first zone in the plurality of zones. The first light source arrangement type is based at least in part on an arrangement of one or more light sources in the plurality of light sources relative to the first zone. The display driver is further configured to process first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type for the first zone to generate first output pixel data for the first target pixel. The first target pixel is located in the first zone. The display driver is further configured to update the first target pixel based on the first output pixel data.
[0005] Generally, in one aspect, one or more embodiments relate to a display driver. The display driver includes a light source brightness compensation block and a driver circuit. The light source brightness compensation block is configured to store a first light source arrangement type for a first zone in a plurality of zones defined for a display panel, the display panel being illuminated by a backlight module, the backlight module including a plurality of light sources for illuminating the plurality of zones. The first light source arrangement type is based at least in part on an arrangement of one or more light sources in the plurality of light sources relative to the first zone. The light source brightness compensation block is further configured to process first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type in the first zone to generate first output pixel data for the first target pixel. The first target pixel is located in the first zone. The driver circuit is configured to update the first target pixel based on the first output pixel data.
[0006] Generally, in one aspect, one or more embodiments relate to a method for driving a display panel. The method includes storing a first light source arrangement type for a first zone of a plurality of zones defined for a display panel, the display panel being illuminated by a backlight module, the backlight module including a plurality of light sources illuminating the plurality of zones. The first light source arrangement type is based at least in part on an arrangement of one or more of the plurality of light sources relative to the first zone. The method also includes processing first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type for the first zone to generate first output pixel data for the first target pixel. The first target pixel is located in the first zone. The method also includes updating the first target pixel based on the first output pixel data.
[0007] Other aspects of the embodiments will be apparent from the following description and appended claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] In order that the above-mentioned features of the present disclosure can be understood in detail, a more specific description of the present disclosure briefly summarized above can be obtained by reference to embodiments, some of which are shown in the accompanying drawings. However, it should be noted that the drawings only illustrate exemplary embodiments and are therefore not to be considered as limiting the scope of the invention, as the present disclosure may admit to other equally effective embodiments.
[0009] Figure 1 An example display device is shown that includes a display panel illuminated by an array of light sources.
[0010] Figure 2 An example configuration of a display device according to one or more embodiments is shown.
[0011] Figure 3 According to one or more embodiments, Figure 2 A side view of an example configuration of a display device.
[0012] Figure 4 An example configuration of a display driver according to one or more embodiments is shown.
[0013] Figure 5 An example definition of a "zone" of a display panel according to one or more embodiments is shown.
[0014] Figure 6 is an enlarged view showing an example definition of a “region” of a display panel according to one or more embodiments.
[0015] Fig. 7A , 7B 7C and 7D illustrate example light source arrangement types defined for zones of a display panel according to one or more embodiments.
[0016] Figure 8 An example definition of light source arrangement types for respective regions of a display panel according to one or more embodiments is shown.
[0017] Fig. 9 An example configuration of a light source brightness compensation block according to one or more embodiments is shown.
[0018] Fig.10 Example light source arrangement types and corresponding target brightness levels for a 4×3 zone located at the lower left of a display panel are shown in accordance with one or more embodiments.
[0019] Fig.11A Example "zoom-in" panel breakout areas and "copy areas" defined for a display panel are shown in accordance with one or more embodiments.
[0020] Fig. 11B A neighborhood identified for a target pixel is shown in accordance with one or more embodiments.
[0021] Fig. 11C Example interpolation for determining an interpolated target brightness level for a target pixel is shown in accordance with one or more embodiments.
[0022] Fig.12 An example head mounted display (HMD) device 2000 is shown in accordance with one or more embodiments.
[0023] Fig.13 Shown based on Figure 2 The display device shown is another embodiment of a display device configured differently.
[0024] Fig.14 An example definition of a "zone" of a display panel according to one or more embodiments is shown.
[0025] Fig.15A , 15B, 15C, 15D, 15E, and 15F illustrate example light source arrangement types defined for zones of a display panel according to one or more embodiments.
[0026] Fig.16 An example definition of light source arrangement types for respective regions of a display panel according to one or more embodiments is shown.
[0027] Fig.17 A flow chart depicting an example method for pixel illumination compensation in accordance with one or more embodiments is shown.
[0028] For ease of understanding, where possible, the same reference numerals have been used to represent the same elements shared in the drawings. It is expected that the elements disclosed in one embodiment can be advantageously used in other embodiments without specific description. Suffixes can be attached to the reference numerals for distinguishing the same elements from each other. Unless otherwise specified, the drawings mentioned herein should not be understood as being drawn to scale. In addition, in order to clearly present and explain, the drawings are usually simplified and details or parts are omitted. The drawings and discussions are used to explain the principles discussed below, in which the same reference numerals represent the same elements. DETAILED DESCRIPTION
[0029] The following detailed description is merely exemplary in nature and is not intended to limit the disclosed technology or the application and use of the disclosed technology. In addition, it is not intended to be bound by any express or implied theory presented in the foregoing technical field, background technology or the following detailed description.
[0030] In the following detailed description of the embodiments, many specific details are set forth to provide a more thorough understanding of the disclosed technology. However, it is apparent to one of ordinary skill in the art that the disclosed technology can be practiced without these specific details. In other cases, well-known features have not been described in detail to avoid unnecessarily complicating the description.
[0031] The term "coupled" as used herein refers to being directly connected to or connected through one or more intermediate components or circuits. In addition, throughout the application, ordinal numbers (e.g., first, second, third, etc.) can be used as adjectives of elements (i.e., any noun in the present application). The use of ordinal numbers is not to imply or create any particular ordering of elements, nor is it to limit any element to only a single element, unless explicitly disclosed, such as by using the terms "before", "after", "single" and other such terms. On the contrary, the use of ordinal numbers is to distinguish elements. As an example, a first element is different from a second element, and a first element may include more than one element and be after (or before) the second element in the ordering of the element.
[0032] A display device with a light-transmitting display panel, such as a light-transmitting liquid crystal display (LCD) panel, can be configured to illuminate the display panel using an array of light sources (e.g., light-emitting diodes) disposed just behind the display panel. This backlighting technology may be referred to as direct-lit backlighting or full-array backlighting. The light sources may each be configured to illuminate a corresponding area or zone of the display panel. The light sources may be individually controlled to achieve "local dimming," which may provide brighter or darker portions of a displayed image to enhance image contrast.
[0033] One problem is that the light sources of the backlighting system are not necessarily ideally arranged to evenly illuminate the display panel due to the limitations on the space to accommodate the backlighting system. In some cases, the housing that houses the display panel and the backlighting system may not be configured to provide enough space to arrange the desired number of light sources near the edge of the display panel. The problem of lack of sufficient space to accommodate the backlighting system can be serious, especially in miniaturized display devices such as head mounted display (HMD) devices for extended reality (XR) applications (including virtual reality (VR), augmented reality (AR), and merged reality (MR), among other examples).
[0034] The present disclosure provides various techniques for alleviating image brightness non-uniformity that may be caused by the non-ideal arrangement of light sources that illuminate the display panel. In one or more embodiments, a display device includes a display panel, a backlight module, and a display driver. The backlight module may include multiple light sources to illuminate multiple zones defined for the display panel. The display driver is configured to store the light source arrangement type of the region of interest in the multiple zones. The display driver is also configured to process the input pixel data of the target pixel located in the region of interest based at least in part on the light source arrangement type of the region of interest to generate output pixel data of the target pixel. The display driver is also configured to update the target pixel based on the output pixel data. Processing the input pixel data based on the stored light source arrangement type can effectively compensate for the image brightness non-uniformity that may be caused by the non-ideal arrangement of the light source. In one embodiment, the compensation coefficient of the target pixel can be determined based at least in part on the light source arrangement type of the region of interest, and the output pixel data can be generated by applying the compensation coefficient to the input pixel data. In the following, a description of various specific embodiments for pixel illumination compensation is given, which is used to alleviate the image brightness non-uniformity that may be caused by the non-ideal arrangement of the light source that illuminates the display panel.
[0035] Figure 1An example display device 100 is shown that includes a display panel 110 illuminated by an array of light sources 120. Note that the light sources 120 are indicated with dashed lines because the light sources 120 are actually located behind the display panel 110. In the example shown, four corners 115 of the display panel 110 are tilted according to the shape of the display panel 110, and the angles of the array of light sources 120 are also tilted. When the display device 100 has a reduced size, the housing (not shown) of the display device 100 can be configured to provide only limited space behind the display panel 110, making it difficult to arrange the light sources at the oblique angles 115. The non-ideal arrangement of the light sources that unevenly illuminate the display panel 110 may result in undesirable image brightness non-uniformity. For example, Figure 1 The light source arrangement may generate dark or dimmed areas 130 at oblique corners 115 of the display panel 110 .
[0036] Figure 2 An example configuration of a display device 1000 according to one or more embodiments is shown. The display device 1000 includes a display panel 200 and is configured to display a desired image on the display panel 200. The display panel 200 may be a light-transmitting display panel, such as an LCD panel. In the illustrated embodiment, the display panel 200 is a rectangular shape with an oblique corner 210. In other embodiments, the display panel 200 may have a different shape (e.g., a rectangular shape with or without one or more notches, an elliptical shape, a hexagonal shape, or an octagonal shape).
[0037] The display device 1000 further includes a display driver 300 and a backlight module 400 and a backlight driver 500. The display driver 300 is configured to receive image data from an image source 600 and drive the display panel 200 to display an image corresponding to the image data. The image source 600 may be a processor such as an application processor, a host, a central processing unit (CPU), a microprocessor unit (MPU), or a processor of a different type configured to provide image data.
[0038] The backlight module 400 and the backlight driver 500 form a backlight illumination system. The backlight module 400 is configured to illuminate the display panel 200 with an array of light sources 420. Since the light sources 420 are located behind the display panel 200, as shown in FIG. Figure 3 As shown, the light source 420 is Figure 2 The light source 420 is located directly behind the display panel 200 so as to be opposite to the display panel 200 and is configured to illuminate a corresponding zone or area of the display panel 200. In the illustrated embodiment, the light sources 420 are spaced at regular intervals to illuminate the display panel 200 as evenly as possible. In one embodiment, each light source 420 includes one or more LEDs. In alternative embodiments, each light source 420 may include a different type of light source. Although Figure 2 97 light sources 420 are shown, but those skilled in the art will appreciate that the backlight module 400 may include more or less than 97 light sources 420. The backlight driver 500 is configured to drive the light sources 420 of the backlight module 400 under the control of the display driver 300 so that each light source 420 emits light having an illumination specified by the display driver 300.
[0039] exist Figure 2 In the illustrated embodiment, the light sources 420 are arranged in an array with oblique angles according to the shape of the display panel 200 with an oblique angle 210. Figure 1 As discussed, such an arrangement of light sources 420 may potentially result in image brightness non-uniformity, thereby generating dark or dim areas at the oblique corners 210 of the display panel 200. In order to mitigate or eliminate image brightness non-uniformity that may be caused by the arrangement of light sources 420, the display driver 300 is configured to process image data to compensate for the image brightness non-uniformity.
[0040] Figure 4 An example configuration of a display driver 300 according to one or more embodiments is shown. In the illustrated embodiment, the display driver 300 includes an image memory 310, an image processing circuit 320, a driver circuit 330, an image analysis circuit 340, and a backlight control circuit 350.
[0041] The image memory 310 is configured to receive the image from the image source 600 ( Figure 2 ) receives image data corresponding to a display image to be displayed on the display panel 200, and stores the received image data therein. In one embodiment, the image data includes raw pixel data of corresponding pixels of the display panel 200. In one embodiment, the raw pixel data of each pixel may include gray levels of corresponding primary colors (e.g., red (R), green (G), and blue (B)). In one embodiment, each pixel of the display panel 200 may include R, G, and B sub-pixels configured to display red, green, and blue, respectively, and the raw pixel data of each pixel may include R, G, and B gray levels that specify the illumination of the R, G, and B sub-pixels, respectively. In an alternative embodiment, the image memory 310 may be omitted, and the raw pixel data may be directly provided to the image processing circuit 320.
[0042] The image processing circuit 320 is configured to apply image processing to the raw pixel data retrieved from the image memory 310 to generate processed pixel data. The image processing circuit 320 includes a light source brightness compensation block 321 that is configured to perform pixel illumination compensation to mitigate image brightness non-uniformity that may be caused by a non-ideal arrangement of the light sources 420 that illuminate the display panel 200, as described above with respect to Figure 1 and Figure 2 The details of pixel illumination compensation will be described in detail later. The image processing performed by the image processing circuit 320 may also include color adjustment, demura correction, deburn correction, image scaling, gamma conversion, or other image processing.
[0043] The driver circuit 330 is configured to receive the processed pixel data from the image processing circuit 320, and to drive or update the pixels of the display panel 200 based at least in part on the processed pixel data. The driver circuit 330 may include a source driver (also referred to as a data driver) configured to generate a data voltage based on the processed pixel data and drive a source line (also referred to as a data line) of the display panel 200 to program or update the pixels of the display panel 200 using the generated data voltage. In one embodiment, each pixel in the display panel 200 may include R, G, and B sub-pixels, and the processed pixel data may specify the illumination level of each of the R, G, and B sub-pixels of each pixel. The driver circuit 330 may be configured to program or update the R, G, and B sub-pixels of each pixel based at least in part on the processed pixel data to control the illumination levels of the R, G, and B sub-pixels.
[0044] The image analysis circuit 340 and the backlight control circuit 350 are jointly configured to generate a backlight control instruction based at least in part on the image data and provide it to the backlight driver 500 to control the respective light sources 420 ( Figure 2 and 3 ). In one embodiment, the raw pixel data is provided to the image analysis circuit 340. In an alternative embodiment, processed pixel data generated by the image processing circuit 320 may be provided to the image analysis circuit 340 instead of the raw pixel data as indicated by the dashed arrow from the image processing circuit 320 to the image analysis circuit 340. The image analysis circuit 340 is configured to analyze the raw pixel data or the processed pixel data to generate analysis data. The analysis data may indicate the illumination distribution of the display image to be displayed on the display panel 200. The backlight control circuit 350 is configured to control the illumination of each light source 420 based at least in part on the analysis data. The analysis data may also be provided to the image processing circuit 320. In such embodiments, the image processing performed by the image processing circuit 320 may be based on the analysis data. The following is a description of pixel illumination compensation performed by the image processing circuit 320 to mitigate image brightness non-uniformity that may be caused by a non-ideal arrangement of the light sources 420.
[0045] In one or more embodiments, a plurality of “zones” are defined for the display panel 200 . The “zones” are used for image analysis performed by the image analysis circuit 340 and / or pixel illumination compensation performed by the light source brightness compensation block 321 . Figure 5 An example definition of zones 230 of a display panel 200 according to one or more embodiments is shown. Zones 230 are defined by dividing panel circumscribed zones 220, which are defined to delimit the range of the display panel 200. In the illustrated embodiment, the panel circumscribed zones 220 are rectangular. In alternative embodiments, the panel circumscribed zones 220 may have different shapes. In the illustrated embodiment, all zones 230 have a square shape. In alternative embodiments, zones 230 may be defined to have different shapes. Each zone 230 is defined so that one light source 420 is opposite to zone 230 at the center (e.g., the geometric center) of zone 230, or no light source is opposite to zone 230. When the projection of light source 420 on display panel 200 falls within zone 230, light source 420 is opposite to zone 230. In the illustrated embodiment, at each oblique angle of the display panel 200, there are six zones 230 with no light source opposite thereto, also as shown in FIG. Figure 6 shown.
[0046] In one or more embodiments, the analysis data generated by the image analysis circuit 340 may include an average picture level (APL) for each zone 230 calculated based on the raw pixel data or the processed pixel data. The APL of a zone 230 may be an average of the illumination levels of the pixels located in the zone 230. In such embodiments, the backlight control circuit 350 may be configured to control the illumination of each light source 420 based on the APL of the zone 230 to which each light source 420 is relative.
[0047] In one or more embodiments, pixel illumination compensation is achieved using light source arrangement types determined for various "zones". The "light source arrangement type" for a zone is based on the arrangement of one or more light sources 420 relative to the zone. In one embodiment, the "light source arrangement type" of a region of interest may indicate the presence or absence of a light source 420 relative to the region of interest. The "light source arrangement type" of a region of interest may also indicate the arrangement of one or more light sources 420 relative to a set of zones adjacent to the region of interest. The "light source arrangement type" of a region of interest may be based at least in part on the number of light sources 420 relative to zones adjacent to the region of interest.
[0048] In one embodiment, the light source brightness compensation block 321 of the image processing circuit 320 may be configured to perform pixel illumination compensation for each pixel based on the light source arrangement type of the area where each pixel of the display panel is located. In one or more embodiments, the light source brightness compensation block 321 may be configured to process the pixel data of the target pixel to reduce the pixel illumination of the target pixel when the light source arrangement type of the area where the target pixel is located indicates that an increased number of light sources 420 are located around the area. The light source brightness compensation block 321 may also be configured to process the pixel data of the target pixel to compensate for the reduction in the pixel illumination of the target pixel when the light source arrangement type indicates that there is no light source 420 relative to the area where the target pixel is located.
[0049] Fig. 7A , 7B 7C and 7D show example light source arrangement types defined for the zones 230 of the display panel 200 according to one or more embodiments. In the illustrated embodiment, a light source arrangement type is selected and defined for each zone 230. Figures 7A to 7D In one embodiment, the light source arrangement type of the region of interest 230 is based on the presence or absence of the light source 420 opposite to the region of interest 230. The light source arrangement type of the region of interest 230 may also be based on the arrangement of the light source 420 opposite to the region 230 adjacent to the region of interest 230.
[0050] Fig. 7A A light source arrangement type "inside", also referred to as type "1", defined for a zone 230A located inside the display panel 200 is shown. Type "1" indicates that one light source 420 is opposite to the zone 230A, and eight light sources 420 are opposite to eight zones adjacent to the zone 230A. Pixels in the type "1" zone 230A are primarily illuminated by the light source 420 opposite to the zone 230A, and supplementarily illuminated by eight light sources 420 opposite to eight zones surrounding the type "1" zone 230A.
[0051] Figure 7B A light source arrangement type "edge", also referred to as type "2", defined for a zone 230B located at an edge of the display panel 200 is shown. Type "2" indicates that one light source 420 is opposite to the zone 230B, and five light sources 420 are opposite to five zones adjacent to the zone 230B. Pixels in the type "2" zone 230B are mainly illuminated by the light source 420 opposite to the zone 230B, and supplementarily illuminated by five light sources 420 opposite to five zones surrounding the type "2" zone 230B.
[0052] Figure 7CA light source arrangement type "corner", also referred to as type "3", defined for a zone 230C located at a corner of the display panel 200 is shown. Type "3" indicates that one light source 420 is opposite to the zone 230C, and four light sources 420 are opposite to four zones adjacent to the zone 230C. Pixels in the type "3" zone 230C are mainly illuminated by the light source 420 opposite to the zone 230C, and supplementarily illuminated by four light sources 420 opposite to four zones surrounding the type "3" zone 230C.
[0053] Fig.7D A light source arrangement type "no light source", also referred to as type "4", is shown defined for a zone 230D with no light source opposite thereto. Type "4" indicates that there is no light source opposite to zone 230D. Pixels in a type "4" zone 230D are illuminated by one or more light sources 420 opposite to a zone adjacent to a type "4" zone 230C, if such light sources 420 exist.
[0054] Figure 8 According to one or more embodiments, Figures 7A-7D In one or more embodiments, the image processing circuit 320 ( Figure 4 The pixel illumination compensation performed in FIG. 1 is based on Figure 8 The types of light source arrangements defined by the various zones 230 shown in FIG.
[0055] Fig. 9 The light source brightness compensation block 321 ( Figure 4 2, the light source brightness compensation block 321 is configured to perform pixel illumination compensation based on the light source arrangement type defined for each zone 230. In the illustrated embodiment, the light source brightness compensation block 321 is configured to receive input pixel data and apply pixel illumination compensation to the input pixel data to generate output pixel data. The input pixel data may be raw pixel data, or may be processed by applying one or more other image processing (e.g., color adjustment, non-uniformity correction, de-burn correction, image scaling) to the image processing circuit 320 ( Figure 4 The output pixel data may be generated by raw pixel data in the display panel 200 as shown in FIG. The output pixel data may be used as processed pixel data provided to the driver circuit 330, which is configured to update the pixels of the display panel 200 based on the processed pixel data. Alternatively, the output pixel data may be further processed (e.g., color adjustment, non-uniformity correction, de-burn correction, image scaling, gamma conversion, or other image processing) and then provided to the driver circuit 330 as processed pixel data.
[0056] exist Fig. 9In the illustrated embodiment, the light source brightness compensation block 321 includes a light source definition memory 322, a brightness register 324, a compensation coefficient determination circuit 326, and a modification circuit 328. The light source definition memory 322 is configured to store the respective regions 230 ( Figure 5 The type of light source arrangement shown in FIG. Figures 7A-7D In an embodiment where four light source arrangement types “1”, “2”, “3” and “4” are defined as shown in FIG8 , the light source definition memory 322 may be configured to store information indicating one of “1”, “2”, “3” and “4” for each zone 230 .
[0057] The brightness register 324 is configured to store a target brightness level for a corresponding light source arrangement type. The target brightness level for a light source arrangement type may indicate a brightness level to be achieved by pixel illumination compensation in a zone having the light source arrangement type (more specifically, at the center of the zone). In one or more embodiments, the target brightness level stored in the brightness register 324 is normalized to take a value between 0 and a predetermined maximum value (e.g., 255), including 0 and the predetermined maximum value. Figures 7A-7D In an embodiment where four light source arrangement types "1", "2", "3" and "4" are defined as shown in FIG8, the brightness register 324 can be configured to store four target brightness levels of the four light source arrangement types "1", "2", "3" and "4", respectively.
[0058] The compensation coefficient determination circuit 326 is configured to determine the compensation coefficient of the pixel based on the light source arrangement type stored in the light source definition memory 322. In one embodiment, the compensation coefficient determination circuit 326 can be configured to determine the compensation coefficient of the target pixel based on the light source arrangement type of the zone where the target pixel is located. The compensation coefficient determination circuit 326 can also be configured to determine the compensation coefficient of the target pixel based on the light source arrangement type of one or more zones adjacent to the zone where the target pixel is located.
[0059] In one or more embodiments, the compensation coefficient determination circuit 326 may be configured to determine the compensation coefficient for each pixel using the target brightness level for each light source arrangement type stored in the brightness register 324. In one implementation, the compensation coefficient determination circuit 326 may be configured to retrieve the target brightness level for the light source arrangement type of the zone where the target pixel is located from the brightness register 324, and determine the compensation coefficient for the target pixel based at least in part on the retrieved target brightness level. The compensation coefficient determination circuit 326 may also be configured to retrieve the target brightness level for the light source arrangement type of the zone adjacent to the zone where the target pixel is located from the brightness register 324, and determine the compensation coefficient for the target pixel based also on the target brightness level of the adjacent zone.
[0060] Fig.10 Example light source arrangement types and corresponding target brightness levels for a 4×3 zone located at the lower left of the display panel 200 according to one or more embodiments are shown. In the illustrated embodiment, the target brightness level for the zone with light source arrangement type “1” is 200, and the target brightness level for the zone with light source arrangement type “2” is 220, where the target brightness levels are normalized to values between 0 and 255, including 0 and 255. Note that the maximum target brightness level is 255. In addition, the target brightness level for the zone with light source arrangement type “3” is 245, and the target brightness level for the zone with light source arrangement type “4” is 255, i.e., the maximum target brightness level.
[0061] The modification circuit 328 is configured to generate output pixel data for each pixel by applying a compensation coefficient determined for each pixel. In one embodiment, the modification circuit 328 can be configured to generate output pixel data for a target pixel by multiplying the input pixel data of the target pixel by the compensation coefficient determined for the target pixel. In an embodiment where both the input pixel data and the output pixel data are in RGB format, the R, G, and B gray levels of the output pixel data can be determined by multiplying the R, G, and B gray levels of the input pixel data by the compensation coefficient, respectively. The following is a detailed description of determining the compensation coefficient for the target pixel.
[0062] In one embodiment, the compensation coefficient determination circuit 326 may be configured to determine the compensation coefficient of the target pixel so that when the stored light source arrangement type of the corresponding area where the target pixel is located indicates that there is no light source relative to the corresponding area, the output pixel data of the target pixel is equal to the input pixel data of the target pixel. Additionally or alternatively, the compensation coefficient determination circuit 326 may be configured to determine the compensation coefficient of the target pixel so that when the light source arrangement type of the corresponding area where the target pixel is located indicates that there is a light source relative to the corresponding area, the grayscale level (e.g., R, G, or B grayscale level) of the output pixel data of the target pixel is less than the corresponding grayscale level (e.g., R, G, or B grayscale level) of the input pixel data of the target pixel. The compensation coefficient determination circuit 326 may also be configured to determine the compensation coefficient of the target pixel based on the number of light sources relative to the area adjacent to the area where the target pixel is located. Note that the light source arrangement type of the area where the target pixel is located indicates the number of light sources relative to the adjacent area. Further details of determining the compensation coefficient according to one or more embodiments are described below.
[0063] refer to Fig.11A, the compensation coefficient determination circuit 326 can be configured to use an "enlarged" panel circumference area 225, which is defined as the panel circumference area 220 plus a series of "replicated areas" 232 surrounding the panel circumference area 220. It should be noted that the enlarged panel circumference area 225 is determined only to facilitate the calculation of the compensation coefficient, including interpolation. The replica area 232 is a "copy" of the outermost area 230 of the panel circumference area 220, wherein the light source arrangement type of the replica area 232 is defined as the same as the light source arrangement type of the adjacent outermost area in the outermost area 230.
[0064] Reference Fig. 11B In one embodiment, the compensation coefficient determination circuit 326 may also be configured to identify four "neighboring areas" 230-1, 230-2, 230-3, and 230-4 of the target pixel from the area 230 and the replica area 232, and determine the compensation coefficient of the target pixel P based on the light source arrangement types of the "neighboring areas" 230-1 to 230-4. The identification of the "neighboring areas" 230-1 to 230-4 may be based on the pixel address of the target pixel (see also Fig. 9 ), where the pixel address indicates the location of the target pixel in the panel circumscribed area 220 defined for the display panel 200. One of the "nearby areas" 230-1 to 230-4 is the area 230 where the target pixel is located, and the three other nearby areas are three of the areas 230 and the replication area 232 that are closest to the target pixel. In the illustrated embodiment, the "nearby areas" 230-1 to 230-4 of the target pixel P are defined by using a reference area 234, which is a square area having the same size as the area 230, and the geometric center of the reference area 235 is located at the target pixel. The "nearby areas" 230-1 to 230-4 can be defined as four of the areas 230 and the replication area 232 that at least partially overlap with the reference area 235. Note that when the target pixel P is located in one of the outermost areas 230, one or more of the nearby areas can be the replication area 232.
[0065] The compensation coefficient determination circuit 326 may also determine the target brightness level of each nearby area by referring to the brightness register 324, which stores the target brightness level of each light source arrangement type. For example, when the light source arrangement type of the nearby area of interest is type "1", the target brightness level of the nearby area of interest may be determined as the target brightness level determined for type "1" (e.g., Fig.10 "200" in the example shown).
[0066] The compensation coefficient determination circuit 326 may also determine an interpolated target brightness level of the target pixel by interpolating a target brightness level of a nearby area based on the position of the target pixel. Fig. 11CAn example of interpolation for determining an interpolated target brightness level for a target pixel according to one or more embodiments is shown. Fig. 11C , (x, y) are the coordinates of the target pixel P. In addition, (x1, y1) are the coordinates of the geometric center of the neighborhood 230-1, (x2, y1) are the coordinates of the geometric center of the neighborhood 230-2, (x1, y2) are the coordinates of the geometric center of the neighborhood 230-3, and (x2, y2) are the coordinates of the geometric center of the neighborhood 230-4. L1, L2, L3, and L4 are the target brightness levels of the neighborhoods 230-1, 230-2, 230-3, and 230-4, respectively.
[0067] In one or more embodiments, horizontal interpolation is first performed to calculate the horizontal interpolation target brightness level L of the intermediate points P1 (x, y1) and P2 (x, y2). P1 and L P2 , and then vertical interpolation is performed to calculate the interpolated target brightness level L of the target pixel P P In one embodiment, the horizontal interpolation target brightness level L may be calculated according to the following equations (1a) and (1b): P1 and L P2 : In this case, the interpolated target brightness level L of the target pixel P can be calculated according to the following equation (2): P : In an alternative embodiment, vertical interpolation may be first performed, and then horizontal interpolation may be performed to calculate the interpolated target brightness level L of the target pixel P in a similar manner. P .
[0068] In one or more embodiments, the interpolated target brightness level L of the target pixel P may be P In one embodiment, the compensation coefficient of the target pixel can be determined by interpolating the target brightness level L P Normalized to a value between 0 and the maximum target brightness level (e.g., 255), that is, by interpolating the target brightness level L P Divided by the maximum target brightness level, the compensation coefficient is determined. The compensation coefficient of the target pixel thus determined can be used to generate output pixel data of the target pixel, such as Fig. 9As shown. Output pixel data of the target pixel may be generated by applying a compensation coefficient determined for the target pixel. In one embodiment, output pixel data of the target pixel may be generated by multiplying input pixel data of the target pixel by a compensation coefficient determined for the target pixel. The target pixel may be updated by the driver circuit 330 based on the output pixel data of the target pixel.
[0069] about Figure 1 to 1 The display device 1000 described in the accompanying drawings may be applicable to an HMD device. Fig.12 An example HMD device 2000 is shown in accordance with one or more embodiments. The HMD device 2000 may be used for extended reality (XR) applications (including virtual reality (VR), augmented reality (AR), and merged reality (MR), among other examples). In the illustrated embodiment, the HMD device 2000 includes a pair of display devices 1000A and 1000B, a pair of lenses 1100A and 1100B, a cover 1200, and a housing 1300. The display devices 1000A and 1000B are each associated with a display device 1000A and 1000B. Figure 1 to Figure 1 1 is configured similarly to the display device 1000 described in the prior art. The display devices 1000A and 1000B are housed in the space between the cover 1200 and the housing 1300, and the lenses 1100A and 1100B are placed in front of the display devices 1000A and 1000B, respectively. In use, the user views the display images displayed on the display devices 1000A and 1000B through the lenses 1100A and 1100B.
[0070] The shape of the display panel and the arrangement of the light source are not limited to the above Figure 1-1 1 described embodiment. Fig.13 Shown based on Figure 2 Another embodiment of a display device 3000 is shown that is configured differently from the display device 1000. In the illustrated embodiment, the display device 3000 includes Figure 2 The display panel 200 is shown to be differently configured as a display panel 3200. The display panel 3200 may be a light-transmitting display panel, such as an LCD panel.
[0071] In the illustrated embodiment, the display panel 3200 is rectangular in shape with a notch 3210. In one embodiment, the display panel 3200 can be used in automotive applications, such as a center console display or other automotive displays. The display panel 3200 can be illuminated by a backlight module having an array of light sources 3420. The array of light sources 3420 is a rectangular array with a notch in the shape of the display panel 3200.
[0072] Similar to About Figure 1 to 1 1 described in the embodiment, as Fig.14As shown, in one or more embodiments, a plurality of regions 3230 may be defined for the display panel 3200. In the illustrated embodiment, the regions 3230 are defined by dividing the panel circumscribed region 3220, which is defined as the circumscribed display panel 3200. Each region 3230 is defined such that one light source 3420 is opposite to the region 3230 at the center (e.g., geometric center) of the region 3230, or no light source is opposite to the region 3230. In the illustrated embodiment, there are 12 regions 3230 in the recess of the display panel 3200 with no light source opposite thereto.
[0073] In order to achieve pixel illumination compensation in a similar manner to the above-described embodiment, a light source arrangement type 3230 is determined for each zone. Fig.15A , Fig. 15B , Fig. 15C , Fig.15D , Fig.15E and Fig.15F Example light source arrangement types defined for zones 3230 of display panel 3200 according to one or more embodiments are shown. In the illustrated embodiment, for each zone 3230, a plurality of light source arrangements are selected and defined. Figures 15A to 15F In one embodiment, the light source arrangement type of the region of interest 3230 is based on the presence or absence of the light source 3420 opposite to the region of interest 3230. The light source arrangement type of the region of interest 3230 may also be based on the arrangement of the light source 3420 opposite to the region 3230 adjacent to the region of interest 3230.
[0074] Fig.15A A light source arrangement type "inside", also referred to as type "1", defined for a zone 3230A located inside the display panel 3200 is shown. Type "1" indicates that one light source 3420 is opposite to the zone 3230A, and eight light sources 3420 are opposite to eight zones adjacent to the zone 3230A. Pixels in the type "1" zone 3230A are primarily illuminated by the light source 3420 opposite to the zone 3230A, and are supplementarily illuminated by eight light sources 3420 opposite to eight zones surrounding the type "1" zone 3230A.
[0075] Fig. 15B A light source arrangement type "edge", also referred to as type "2", defined for a zone 3230B located at the edge of the display panel 3200 is shown. Type "2" indicates that one light source 3420 is opposite to the zone 3230B, and five light sources 3420 are opposite to five zones adjacent to the zone 3230B. Pixels in the type "2" zone 3230B are mainly illuminated by the light source 3420 opposite to the zone 3230B, and are supplementarily illuminated by five light sources 3420 opposite to five zones surrounding the type "2" zone 3230B.
[0076] Fig. 15CA light source arrangement type "recessed corner", also referred to as type "3", defined for a zone 3230C located at a recessed corner of a display panel 3200 is shown. Type "3" indicates that one light source 3420 is opposite to the zone 3230C, and seven light sources 3420 are opposite to seven zones adjacent to the zone 3230C. Pixels in the type "3" zone 3230C are primarily illuminated by the light source 3420 opposite to the zone 3230C, and supplementarily illuminated by seven light sources 3420 opposite to seven zones surrounding the type "3" zone 3230C.
[0077] Fig.15D A light source arrangement type "convex corner", also referred to as type "4", defined for a zone 3230D located at a convex corner of the display panel 3200 is shown. Type "4" indicates that one light source 3420 is opposite to the zone 3230D, and three light sources 3420 are opposite to three zones adjacent to the zone 3230D. Pixels in the type "4" zone 3230D are primarily illuminated by the light source 3420 opposite to the zone 3230D, and are supplementarily illuminated by three light sources 3420 opposite to three zones surrounding the type "4" zone 3230D.
[0078] Fig.15E A light source arrangement type “edge near a concave corner”, also referred to as type “5”, defined for a zone 3230E located at an edge near a concave corner of a display panel 3200 is shown. Type “5” indicates that one light source 3420 is opposite to the zone 3230E, and six light sources 3420 are opposite to six zones adjacent to the zone 3230E. Pixels in the type “5” zone 3230E are primarily illuminated by the light source 3420 opposite to the zone 3230E, and supplementarily by the six light sources 3420 opposite to the six zones surrounding the type “5” zone 3230C.
[0079] Fig.15F A light source arrangement type "no light source", also referred to as type "6", is shown defined for a zone 3230F with no light source opposite thereto. Type "6" indicates that there is no light source opposite to the zone 3230F. Pixels in a type "6" zone 3230F are illuminated by one or more light sources 3420 opposite to a zone adjacent to the type "6" zone 3230F, if such light sources 3420 are present.
[0080] Fig.16 According to one or more embodiments, Figures 15A-15F An example definition of the light source arrangement type for each zone 3230 of the display panel 3200 is shown in FIG. In one or more embodiments, similar to the above-described embodiments, pixel illumination compensation is implemented based on the light source arrangement type determined for each zone 3230 .
[0081] Fig.17A flowchart depicting an example method 1700 for pixel illumination compensation according to one or more embodiments is shown. Although the various steps in the flowchart are presented and described in sequence, those skilled in the art will appreciate that some or all of the steps may be performed in a different order, may be combined or omitted, and some or all of the steps may be performed in parallel. Additional steps may be further performed. Therefore, the scope of the present disclosure should not be considered limited to Fig.17 The specific arrangement of the steps shown.
[0082] The method 1700 includes storing, at step 1702, a backlight module (eg, Figure 4 The display module 400 shown in FIG. 4A illuminates a display panel (eg, Figure 2 The display panel 200 and Fig.13 The display panel 3200 shown in FIG. 3 defines a plurality of regions (eg, Figure 5 The area 230 and Fig.14 The backlight module includes a plurality of light sources (eg, Figure 2 The light source 420 and Fig.13 The first light source arrangement type is based at least in part on the arrangement of one or more of the plurality of light sources relative to the first zone. In one embodiment, the first light source arrangement type can be selected from Figures 7A-7D In another embodiment, the first light source arrangement type can be selected from Figures 15A-15F Types "1" to "6" shown in .
[0083] The method 1700 also includes: at step 1704, processing first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type of the first zone to generate first output pixel data for the first target pixel. The first target pixel is located in the first zone. In one embodiment, a compensation coefficient may be determined for the first target pixel based at least in part on the first light source arrangement type of the first zone, and the compensation coefficient may be applied to the first input pixel data to generate the first output pixel data.
[0084] The method 1700 also includes updating the first destination pixel based on the first output pixel data at step 1706. In one embodiment, the first output pixel data may be further processed (e.g., to implement color adjustment, non-uniformity correction, de-burn correction, image scaling, gamma conversion, or other image processing) to generate processed pixel data, and the updating of the first destination pixel may be based on the processed pixel data.
[0085] While a number of embodiments have been described, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope. Accordingly, the scope of the present invention should be limited only by the appended claims.
Claims
1. A display device, comprising: Display panel; a backlight module, the backlight module comprising a plurality of light sources to illuminate a plurality of zones defined for the display panel; as well as A display driver is configured to: storing a first light source arrangement type for a first zone of the plurality of zones, wherein the first light source arrangement type is based at least in part on an arrangement of one or more light sources of the plurality of light sources relative to the first zone, processing first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type of the first zone to generate first output pixel data for the first target pixel, the first target pixel being located in the first zone, and The first target pixel is updated based on the first output pixel data.
2. The display device according to claim 1, wherein a first group of light sources among the plurality of light sources are respectively opposite to a first group of regions among the plurality of regions, the first group of regions being adjacent to the first region, and Wherein the first light source arrangement type is based at least in part on the arrangement of the first group of light sources. 3 . The display device of claim 2 , wherein the first light source arrangement type is based at least in part on a number of light sources in the first group of light sources.
4. The display device of claim 1 , wherein processing the first input pixel data for the first target pixel comprises: In response to the first light source arrangement type of the first zone indicating the presence of a light source opposite to the first zone, the first output pixel data is generated so that the gray level of the first output pixel data for the first target pixel is less than the gray level of the first input pixel data for the first target pixel. 5 . The display device according to claim 1 , wherein at least one of the plurality of regions is defined such that no light source is opposite to the at least one of the plurality of regions.
6. The display device according to claim 1, wherein a second area of the plurality of areas is defined such that no light source is opposite to the second area, and The display driver is further configured to: storing a second light source arrangement type for the second zone, wherein the second light source arrangement type for the second zone indicates that there is no light source opposite to the second zone, processing second input pixel data for a second target pixel of the display panel based on the second light source arrangement type of the second zone to generate second output pixel data for the second target pixel, the second target pixel being located in the second zone, and The second target pixel is updated based on the second output pixel data.
7. The display device of claim 6, wherein processing the second input pixel data for the second target pixel comprises: In response to the second light source arrangement type of the second zone indicating that there is no light source opposite to the second zone, the second output pixel data is determined to be equal to the second input pixel data.
8. The display device according to claim 1, wherein the display driver is further configured to store a second light source arrangement type of a second zone among the plurality of zones, the second zone being adjacent to the first zone, wherein the second light source arrangement type is based at least in part on an arrangement of one or more of the plurality of light sources relative to the second zone, and Wherein processing the first input pixel data for the first target pixel is further based on the second light source arrangement type of the second zone.
9. The display device of claim 1 , wherein processing the input pixel data of the first target pixel comprises: determining a compensation coefficient for the first target pixel based at least in part on the first light source arrangement type for the first zone; as well as The compensation coefficient is applied to the first input pixel data to generate the first output pixel data.
10. The display device of claim 9, wherein determining the compensation coefficient for the first target pixel comprises: determining a first target brightness level for the first zone based at least in part on the first light source arrangement type; as well as The compensation coefficient for the first target pixel is determined based at least in part on the first target brightness level.
11. The display device according to claim 9, wherein the display driver is further configured to store a second light source arrangement type of a second zone among the plurality of zones, the second zone being adjacent to the first zone, wherein the second light source arrangement type is based at least in part on an arrangement of one or more of the plurality of light sources relative to the second zone, Wherein determining the compensation coefficient for the first target pixel is also based on the second light source arrangement type.
12. The display device of claim 11, wherein determining the compensation coefficient for the first target pixel comprises: determining a first target brightness level for the first zone based at least in part on the first light source arrangement type; determining a second target brightness level for the second zone based at least in part on the second light source arrangement type; determining an interpolated target brightness level based at least in part on the first target brightness level, the second target brightness level, and a position of the first target pixel; as well as The compensation coefficient is determined based at least in part on the interpolated target brightness level.
13. A display driver comprising: The light source brightness compensation block is configured as follows: storing a first light source arrangement type for a first zone of a plurality of zones defined for a display panel, the display panel being illuminated by a backlight module, the backlight module comprising a plurality of light sources to illuminate the plurality of zones, wherein the first light source arrangement type is based at least in part on an arrangement of one or more of the plurality of light sources relative to the first zone, and processing first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type of the first zone to generate first output pixel data for the first target pixel, the first target pixel being located in the first zone, and A driver circuit is configured to update the first target pixel based on the first output pixel data.
14. The display driver according to claim 13, wherein a first group of light sources among the plurality of light sources are respectively opposite to a first group of regions among the plurality of regions, and the first group of regions is adjacent to the first region, Wherein the first light source arrangement type is based at least in part on the arrangement of the first group of light sources. 15 . The display driver of claim 13 , wherein at least one of the plurality of zones is defined such that no light source is opposite to the at least one of the plurality of zones.
16. The display driver according to claim 13, wherein a second zone among the plurality of zones is defined such that no light source is opposite to the second zone, and The light source brightness compensation block is further configured as follows: storing a second light source arrangement type for the second zone, wherein the second light source arrangement type for the second zone indicates that there is no light source opposite to the second zone, processing second input pixel data for a second target pixel of the display panel based on the second light source arrangement type of the second zone to generate second output pixel data for the second target pixel, the second target pixel being located in the second zone, and The second target pixel is updated based on the second output pixel data.
17. The display driver according to claim 13, wherein the light source brightness compensation block is further configured to store a second light source arrangement type of a second zone among the plurality of zones, the second zone being adjacent to the first zone, wherein the second light source arrangement type is based at least in part on an arrangement of one or more of the plurality of light sources relative to the second zone, Wherein processing the first input pixel data for the first target pixel is further based on the second light source arrangement type of the second zone.
18. A method comprising: storing a first light source arrangement type for a first zone of a plurality of zones defined for a display panel, the display panel being illuminated by a backlight module, the backlight module comprising a plurality of light sources to illuminate the plurality of zones, wherein the first light source arrangement type is based at least in part on an arrangement of one or more of the plurality of light sources relative to the first zone, and processing first input pixel data for a first target pixel of the display panel based at least in part on the first light source arrangement type of the first zone to generate first output pixel data for the first target pixel, the first target pixel being located in the first zone, and The first target pixel is updated based on the first output pixel data.
19. The method according to claim 18, wherein a first group of light sources in the plurality of light sources are respectively opposite to a first group of regions in the plurality of regions, the first group of regions being adjacent to the first region, and Wherein the first light source arrangement type is based at least in part on the arrangement of the first group of light sources.
20. The method of claim 18, wherein a second zone of the plurality of zones is defined such that no light source is opposite the second zone, and The method further comprises: storing a second light source arrangement type for the second zone, wherein the second light source arrangement type for the second zone indicates that there is no light source opposite to the second zone; processing second input pixel data for a second target pixel of the display panel based on the second light source arrangement type of the second zone to generate second output pixel data for the second target pixel, the second target pixel being located in the second zone; as well as The second target pixel is updated based on the second output pixel data.
