Display system with modulating front plate

Abstract

A display system having a front panel capable of modulating light to produce an image and a backlight for generating light and color is disclosed. A display having a full color backlight array and a front panel single color light modulation array with front panel light modulation elements enabled to improve resolution by modulating the brightness of regions in each pixel associated with a lower resolution image is also disclosed.

Description

Technical Field

[0001] This disclosure relates to a display system having a front panel capable of modulating light to produce an image and a backlight for generating light and color. Summary of the Invention

[0002] The present invention relates to a display system comprising: a front panel without a color filter; a backlight configured to provide color definition; and a front panel light modulation element enabled to improve resolution by modulating the brightness in each pixel associated with a lower resolution image, wherein the backlight is synchronized with the front panel and the frame rate is adjusted without any risk of color sequence effects at low frame rates. Attached Figure Description

[0003] The foregoing and other advantages of this disclosure will become apparent after reading the following detailed description and after referring to the accompanying drawings.

[0004] Figure 1 A backlight with an array of light sources is shown, wherein at least one area has more than one type of light source.

[0005] Figure 2A and Figure 2B An example of the timing and functions of the front panel and backlight during a subframe is shown. Figure 2A Sequential color programming is shown. Figure 2B This demonstrates interlaced color programming.

[0006] Figure 3A The light source forming the light cone is shown. The front panel is adjusted to ensure uniform light output for each pixel.

[0007] Figure 3B The pillars shown can be random or follow a pattern on the backlight substrate.

[0008] Figure 3C The transparent material between the backlight and the front panel is shown.

[0009] Figure 4A A light guide is shown, which has an angled structure around the device and a base at the backlight, the base being smaller than the front portion coupled to the front panel.

[0010] Figure 4B The structure with an inverted angle on the substrate is shown.

[0011] Figure 4C As shown Figure 4B The cross-sectional view shown is of a structure with an inverted angle on a substrate.

[0012] Figure 5An implementation scheme that allows for higher frame rates is shown.

[0013] Figure 6 A high-performance display is shown.

[0014] Figure 7A The process cycle for generating images using a full-color display as backlight and a higher-resolution monochrome front display with independent subframes for each primary color is shown.

[0015] Figure 7B The process cycle for image generation using a full-color display as backlight and a higher resolution monochrome front display in low-power mode using a single subframe is shown.

[0016] Figure 7C The process cycle for image generation is illustrated using a full-color display as backlight and a higher-resolution monochrome front display, with subframes that produce more than one color during each subframe.

[0017] Figure 8 The processing steps for generating images for full-color low-resolution and high-resolution emitting displays are shown.

[0018] While this disclosure is susceptible to various modifications and alternatives, specific embodiments or particular implementations have been shown by way of example in the accompanying drawings and will be described in detail herein. However, it should be understood that this disclosure is not intended to limit it to the specific forms disclosed. Rather, this disclosure will cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims. Detailed Implementation

[0019] This invention relates to a display system comprising: a front panel capable of modulating light to generate an image; and a backlight for generating light and color, wherein the backlight has a multi-zone array, and each zone has at least two different types of devices generating different light wavelengths, and each zone can generate different brightness and different colors based on the image on the front panel. The front panel is aligned with the backlight.

[0020] exist Figure 1 In the demonstration, the display system has a backlight unit 112 and a light modulation front panel. The backlight has a light source array, wherein at least one area has more than one type of light source.

[0021] The light source can have different color points 102, 104, and 106, such as primary colors (red, green, blue) or other color points, such as white, yellow, etc. The light source can be a miniature LED. They can be grouped 108, so that each group includes a set of devices of different colors. Each light source group 108 corresponds to multiple pixels 110 in the display.

[0022] The following process can be used to determine the brightness and color associated with each light source group: 1. Calculate the brightness of each light source using the color point and brightness of each pixel associated with the light source group. 2. For each light source in the group, select the highest value from a set of calculated brightness values. 3. The selected maximum brightness value is converted into a driving condition that provides that brightness to all pixels associated with the light source group. In one case, the brightness value can be multiplied by the number of pixels associated with the light source group. In another related embodiment, the influence of adjacent light source groups is considered when calculating the driving condition for the current light source group.

[0023] In another related implementation, a function is defined based on the effect of each light source on the pixel. The image is then processed, and the value for each light source is calculated so that the sum of light and color from each light source satisfies the requirements of each pixel.

[0024] In another related implementation, it may be necessary to modify the image to optimize backlight power consumption. For example, suppose the number of pixels in the area with the highest brightness is less than a threshold. In this case, the value is either not considered in the calculator or a weighted average of the values ​​is considered during calculation.

[0025] In one implementation, the light source group associated with the pixel programmed using the new image is turned off. The pixel is programmed using the latest data, and the light source group is turned on using the new values.

[0026] In another related implementation, a pixel has multiple sub-pixels associated with different color points, which may differ from the backlight color point. The color of the sub-pixels can be defined by a color filter to allow specific colors to pass through the sub-pixels.

[0027] In another related embodiment, at least one sub-pixel of a pixel is associated with two color points of the pixel. Here, the front panel is programmed at least twice (the same number of color points associated with a sub-pixel), each time using different color points to program the backlight to the same number.

[0028] In one relevant scenario, pixels generate three primary colors, such as red, green, and blue. Each frame is divided into primary colors associated with the front panel. The backlight has different devices, with color points similar to those for red, green, and blue. Here, during the first subframe, a segment of the front panel is programmed using the first primary color, while the backlight group associated with that segment of the display is programmed to be off. After programming, the devices in the backlight with the primary color points associated with the programmed front panel are turned on based on calculated values. After a predefined emission time, the second subframe begins. The backlight group is turned off, the front panel segment is programmed using different primary color values, and the backlight is turned on using calculated values ​​of the second primary color. This process continues until all primary colors associated with the image and the application on the display are displayed. This process can continue for different frame periods.

[0029] Here, the pixels do not have color filters, allowing each primary color to pass through. This makes it possible to use smaller pixels on the front panel, achieving higher resolution displays, as there is only one subpixel. Furthermore, the lack of color filters makes the pixels more efficient. Here, the colors and brightness generated by the backlight pass through the pixels without being lost due to color filters.

[0030] In relevant implementations, the backlight can generate pseudo-color points, i.e., combinations of two or more colors available in the backlight device. This mode can generate additional subframes for combined colors (such as white). This mode can also be used in another relevant case where the display can switch to a static image or a low frame rate. In another relevant case, monochrome images can be used for specific applications.

[0031] The front panel pixels can be smaller than, the same as, or larger than the light source.

[0032] Figure 2A and Figure 2B An example of the timing and functions of the front panel and backlight during a subframe is shown. Here, when a segment of the display (area) switches to programming mode, the associated backlight area (group) also switches to black or programming. During programming, the contents of the pixels in the front panel are updated using the new frame information. The brightness of the backlight devices is also updated to represent the new frame data of the front panel pixels. To avoid crosstalk or unnecessary emissions, the backlight is in black mode during the programming cycle of the area. The black mode of the backlight can be longer than the programming time of the front panel area.

[0033] In a relevant case, Figure 2A In this process, the same color is used to update the backlight area in each subframe. Figure 2A Sequential color programming is shown.

[0034] Figure 2B Interleaved color programming is illustrated. In another related implementation, each zone can be updated with different colors during the same subframe.

[0035] In one related embodiment, the space between the backlight and the back panel is adjusted to make the output light from the front panel uniform. In another related embodiment, alignment marks are present in the front and back panels so that they can be aligned. In yet another related embodiment, different light patterns are shown in the front panel, and the positions of the front and / or back panels are adjusted so that each pattern has the correct brightness and color. Different patterns can also be used to program the backlight to highlight misalignment. In one related embodiment, the backlight and front panel are fixed after adjustment by adhesive or other methods. A pillar may be present between the back panel and the front panel to prevent the two substrates from collapsing into each other.

[0036] A light-transmitting film can fill the space between the front panel and the backlight substrate. In another related embodiment, a fine film of controllable thickness is formed on the back panel. The front panel is attached to the film. The film can be an adhesive, or another adhesive layer can be formed between the front panel and the transparent film to facilitate lamination of the front panel to the backlight. In one related embodiment, the film can be patterned into isolation areas for each zone. A reflective layer covers the area between each zone to prevent light leakage between zones.

[0037] In another related embodiment, the areas associated with each light source group are isolated. Here, a dam structure can be used to separate each group. The dam layer may have a reflective layer to aid in light isolation and guidance into the areas.

[0038] In another related implementation, the light guide structure can guide light from each region to the associated pixel.

[0039] Figure 3 shows an example of backlight alignment with the front panel. Here, the backlight may have different devices for each area (306, 308, 310) on the back panel 302.

[0040] exist Figure 3A In this configuration, light sources form light cones 312, 314, and 316. The front panel 304 is adjusted to ensure uniform light output for each pixel. Patterns can be used in both the backlight and the front panel to adjust the distance between the front panel 304 and the backlight substrate 302. Furthermore, the light pattern in the backlight and the image pattern in the front panel can be used to align each area in the front panel with its corresponding area in the backlight. Alignment marks 330 and 332 may also be present in the backlight substrate and the front panel to perform the alignment process.

[0041] Pillars can be formed on the backlight to help make the spacing between the front panel and the backlight uniform.

[0042] Figure 3B Pillars 318 are shown, which may be random or follow a pattern on the backlight substrate 302.

[0043] Figure 3CA transparent material 320 is shown between the backlight and the front panel. The transparent material can be patterned to isolate each area. It can also be a light guide for achieving better isolation and optical coupling between the front panel and the backlight.

[0044] Figure 4A A light guide is shown, which has an angled structure around devices 406, 408, and 410 and a base 402 at the backlight, the base being smaller than the front portion 404 coupled to the front panel. A reflective layer may be present on the sidewalls of the structure to further enhance coupling. One method of manufacturing such a structure is to form the structure on a separate substrate.

[0045] Figure 4B A structure 422 with an inverted angle is shown on a substrate 420. This structure can be formed using polymers and photolithography, wet etching, or dry etching. After the substrate is formed, other layers, such as reflectors and openings for device coupling, are formed.

[0046] Figure 4C The cross-section of tangent 424 is shown. Here, a base 422 is formed on a substrate 420. A reflector layer 426 (formed by PECVD, electron beam, sputtering, or other means) is formed on top of the base. The reflective layer opens at 428, where microdevices 406, 408, and 410 will be coupled. The base can be etched to create a housing structure for the devices. The structure is aligned with a backlight and then bonded to the backlight. The structure can be peeled off from the original substrate 420. Peeling can be performed using mechanical, laser, chemical, or other processes.

[0047] In another related embodiment, the embankment is formed on a separate substrate. Here, a transparent polymer or other dielectric layer is formed on the substrate and is etched or stamped to form a beveled structure. A reflective layer is deposited on top of the beveled structure. The reflective layer can be removed from the area on top of the beveled structure. A portion of the same area can be further etched to create a housing for the optical device.

[0048] The beveled structure is aligned with the light source. The structure is bonded to the surface of the backlight (or display) substrate. The reflective layer may be located below the light source in the backlight (or display) substrate. The substrate on the beveled substrate can be removed. In another related embodiment, the beveled substrate is formed on the back of the front panel substrate.

[0049] In all the embodiments presented herein, the optical modulation array should operate at a high frame rate to allow for different color subframes.

[0050] Figure 5An implementation scheme allowing for higher frame rates is shown. Here, several rows are programmed simultaneously using independent data lines. In a related implementation, selection lines (SELs) that enable pixels to acquire data from the data lines (DATA) are simultaneously activated for several rows being programmed simultaneously. Here, the selection lines (SELs) are connected to a single source or sources with different simultaneous programming characteristics. Selection lines (SELs) can also be shared between rows being programmed simultaneously. In one example, each column has three data lines (DATA [j, 1:3]). Each data line is connected to pixels in a different row. The selection lines (SELs) associated with the groups of pixels connected to these data lines are activated simultaneously so that pixels in different rows can be programmed simultaneously. The rows being programmed simultaneously can be adjacent or scattered across different parts of the array. The rows in the array can be divided into multiple groups, each group being programmed simultaneously.

[0051] In one related implementation, the low-resolution image produced by the backlight has full-color information and brightness. The front panel light modulation element improves resolution by modulating the brightness of a region within each pixel associated with the low-resolution image. Here, the front panel has no color filter, so color definition comes solely from the backlight. Furthermore, there is no need to operate the front panel at a high frame rate. Moreover, by synchronizing the backlight and front panel, the frame rate can be adjusted without any challenges associated with color sequencing effects at low frame rates.

[0052] In another embodiment, the display may have two modes. In a high image quality mode, each subframe uses color sequence to produce a low-resolution monochrome image in the backlight and an associated high-resolution image in the front panel. In a low-power mode, the display has one frame, with the backlight having full-color information and low pixel resolution. The high-resolution image produced in the front panel only modulates the brightness.

[0053] In another related embodiment, more than one subframe exists. During each subframe, a full-color image is generated in the backlight, and a front panel light modulation element (LME) is programmed to improve image resolution. In one case, a first image is generated using a backlight full-color LME and a front monochrome LME. The error between the generated image and the actual image is calculated, and a second image is generated using the backlight and the front LME. The first and second images during two different subframes are shown. A third image and a third subframe may also exist to reduce the error between the generated image and the actual image.

[0054] In another related implementation, a first image is generated to limit the subpixel brightness error of each pixel within a threshold boundary. The threshold boundary may have an upper and a lower limit. A second image is also generated based on the difference between the generated image and the actual image to further reduce the error. This process can be extended to include more than just the first and second images.

[0055] In one relevant implementation, subframes and the images generated for each subframe can transition between two actual images. Here, the second or third subframe may contain information from the first and second actual images. This information may be interpolated data between the two actual images.

[0056] A display system includes a low-resolution full-color emitting display, a monochrome high-resolution light-modulated display, and a controller. The controller is responsible for generating an image for each frame and synchronizing the two displays. The emitting display can use miniature LEDs to generate the image.

[0057] Figure 6 A system architecture is shown, comprising a controller 510, an emissive low-resolution display 512, and a high-resolution light-modulated display 514. The controller 510 acquires an image 502 and generates two images 504 and 506 for each display 512 and 514. Each pixel in the low-resolution display is mapped to multiple pixels in the high-resolution display (e.g., a zone).

[0058] like Figure 6 The display system shown can operate in different modes.

[0059] During high-efficiency mode, such as Figure 7A As shown, the controller generates different sets of images representing the primary colors of the display. For example, if the display uses red, green, and blue as primary colors, the emitter display can also generate these primary colors. In this case, the controller generates three sets of images (red, green, and blue) for both displays. The frame is divided into three subframes, each displaying information for each color on both displays. The original image 600 is divided into subframes, as well as low-resolution and high-resolution images. Then, during subsequent cycles 602 and 604, the corresponding low-resolution image is used to program the emitter display, and its equivalent high-resolution image is used to program the monochrome display. This cycle (such as cycle 606) continues until all subframes are completed and a new image is set for display.

[0060] Dividing an image into low-resolution and high-resolution sections for each subframe can be done using different processes. In one relevant implementation, the maximum value of each primary color is extracted for each zone. This value is multiplied by the number of high-resolution pixels in each zone. This value is used to set the corresponding low-resolution pixel. Pixels on the high-resolution display are programmed with values ​​that convert the light received by the pixels from the low-resolution display into values ​​representing the actual image. In one relevant case, the low-resolution image is programmed with the product of the values ​​of pixels in zones with higher expected brightness. This provides margin for correcting the high-resolution image as needed. The on-time of the low-resolution display can be less than a subframe. The duration can be used to adjust the color point of the display. Because the display is of lower resolution, changing the duty cycle is easier to handle than changing the duty cycle of a high-resolution monochrome display.

[0061] In another related pattern, such as Figure 7B As shown, the low-resolution display shows a full-color image once, while the high-resolution display displays a monochrome image associated with the full-color image during each frame. During the first cycle 610, the controller generates two images, one for the full-color low-resolution display and the other for the monochrome high-resolution display. During the next cycle 612, the controller programs both displays with the associated images. Different methods can be used to generate the full-color low-resolution image and the monochrome high-resolution image during the first cycle. In one method, the more dominant color point of the input image in each region is selected, the brightness of the pixels associated with each region in the low-resolution display is calculated to reach the color point, and the pixels associated with each pixel in the high-resolution display region are allowed to reach the brightness associated with the input image. In another associated method, the dominant color point is calculated by weighting the color point of each pixel in the region based on the brightness value. For example, the weight is a function of the eye's sensitivity to colors of different brightness. In one associated example, the weight of high-brightness pixels or very low-brightness pixels can be lower, while the weight of some intermediate range of brightness can be higher.

[0062] In another related mode, the controller generates images with more than one color for low-resolution displays and generates a related monochrome image for high-resolution displays.

[0063] The process is in Figure 7CThe diagram illustrates this process. During the first cycle 622, the controller divides the input image 600 into a set of sub-images. During the second cycle 624, each sub-image generates two images: a color low-resolution image and a monochrome high-resolution image. During the third cycle 626, each subframe displays a color image on a low-resolution color display and a corresponding image on a high-resolution monochrome display. One method for dividing the image into sub-images during cycle 622 is to calculate a first primary color, a second primary color, and a more (if needed) primary color for each region. The first primary color of each region is used to generate the first sub-image, and the second primary color is used to generate the second sub-image. Previous techniques can convert sub-images into high-resolution and low-resolution images. In another related method, if the display has three primary colors, a combination of these colors is used to divide the image into sub-images.

[0064] The following steps are described using the red, green, and blue (RGB) primary colors as an example. Figure 8 Details. 1. Input high-resolution R, G, B images. 2. Divide the image into patches of size (m×n). 3. Calculate the maximum value of each patch to obtain a low-resolution R, G, B image, so as to generate a low-resolution R, G, B image. 4. Based on the color uniformity and structure of the tiles, the following cases are used to calculate grayscale values: A. Case 1: The uniformity of the tiles is almost the same (more than 95% of the pixel values ​​are the same). a. Calculate the ratios and corresponding values ​​between the low-resolution R, G, and B images; update this constant value for grayscale. 5. Scenario 2: 75% of the color is uniform in a small area (more than 75% of the color is the same in a 10×10 area) A. Optimize only the color image using the mean squared error loss function, and calculate the grayscale image value. 6. Case 3: The uniform color in the window area is less than 30%. A. Optimize only for color images using mean squared error and structural similarity index measures, and calculate grayscale image values.

[0065] Additional step: Convert the image to the HSV color space for better human perception and computation.

[0066] Figure 8 Another example is shown below, where a 10×10 resolution reduction is used for low-resolution color displays.

[0067] Divide the high-resolution RGB image into multiple smaller (10×10) windows. • Add padding to the boundaries of the image to fit a 10×10 region. • Padding avoids information loss in the image. • Find the largest pixel value (RGB) in a region of an image. • Helps reduce the resolution of RGB images. • In addition, the maximum value area helps to darken the values ​​in a grayscale image to achieve local darkening. • Grayscale image values ​​are based on the following: Color uniformity in the small window area ○Structural uniformity in the small window area Based on these two parameters, various cases are defined to find grayscale images.

[0068] Case 1 : • The color is almost uniform in the small window area (more than 95% of the colors are the same in a 10×10 area). • In this case, the ratio between the maximum pixel value and the window value will be constant in almost all windows (1). • It can also use the mean, median, and mode, comparing them with the original pixel values ​​to obtain the optimal grayscale value.

[0069] Case 2 : Therefore, the values ​​in an RGB image will be this constant ratio. ○ 75% of the color is uniform in the small window area (more than 75% of the color is the same in the 10×10 area). Here, most values ​​in the grayscale image will be constant because 75% of the values ​​in the image are the same. ○ The remaining values ​​in the grayscale image must be optimized to reduce errors. Because the uniformity is greater than 75%, the error is mostly due to color. ○Optimization makes colors more accurate by maintaining structural similarity. Therefore, there are three matrices. ○ The original image window of an RGB image with dimensions of m×n×3 (here, 10×10×3). ○ The corresponding R, G, B value downsampled image with size 1×1×3 ○ Random initialization values ​​in a 10×10×1 grayscale image (using other initializations). ○The objective function here is the mean squared error. ○ The objective function calculates the reconstruction error between the original matrix and the product of a 10×10×1 matrix and a 1×1×3 matrix. • The original image window of an RGB image with dimensions m×n×3 (here, 10×10×3). • The reconstructed image is the element-wise maximum value of R, G, and B multiplied by the initial grayscale image. • Error = np.sum((original_matrix - reconstructed) **2) • Error, which is calculated as the sum of squared differences (SSE) between the original matrix and the reconstructed matrix. • Minimize the error to obtain the optimal grayscale value. • Use the L-BFGS-B solution method because it allows the inventors to handle bounded optimization. • For each element in a 10×10×1 matrix, set an optimization boundary between 0 and 1. • The optimization method will provide the best values ​​in the 10×10×1 matrix so as to minimize the error when each value is multiplied by the 1×1×3 matrix, thereby effectively approximating the original 10×10×3 matrix as closely as possible under these constraints.

[0070] Case 3 : ○ Less than 30% of the small window area has uniform color (random colors and structural 10×10 area have the same color). Here, the inventor must consider both color and structural similarity in the image. The objective function will be defined based on these two factors. ○ Optimize the values ​​in the grayscale image based on these values. ○ The ionization parameter is the same. ○ The original image window of an RGB image with dimensions of m×n×3 (here, 10×10×3). ○ The corresponding R, G, B value downsampled image with size 1×1×3 ○ ○ Random initialization values ​​in a 10×10×1 grayscale image (using other initializations). The objective function is a combination of both. ○Mean Squared Error (MSE) ○ Structural Similarity Index (SSIM) ○MSE will process color information, and SSIM will process structural similarity. ○mse = np.mean((original_image - new_image) ** 2) ○ssim_value = ssim(original_image, new_image, multichannel=True) ○ It is necessary to maximize SSIM and minimize MSE. The combination of losses is mse + (1 - ssim_value). ○ You can also adjust the weights between these components. ○ Minimize the error to obtain the optimal grayscale value. ○ The L-BFGS-B method is used for solving the problem because it allows the inventors to handle bounded optimization. ○ For each element in a 10×10×1 matrix, set an optimization boundary between 0 and 1. The optimization method will provide the best values ​​in the 10×10×1 matrix so as to minimize the error when each value is multiplied by the 1×1×3 matrix, thereby effectively approximating the original 10×10×3 matrix as closely as possible under these constraints.

[0071] In one related implementation, the full-color low-resolution display is larger than the monochrome display. The low-resolution portion is located around the edges of the image. This pattern follows the characteristics of the human eye, forming a high-resolution image at the center using a combination of a monochrome display and a full-color emitting display, and forming a low-resolution image at the edges using only the full-color display.

[0072] System and Method Implementation Plan

[0073] One embodiment of the present invention discloses a display system (or method) comprising: a front panel enabled to modulate light to generate an image; a backlight unit for generating light and color, wherein the backlight unit has a multi-zone array, wherein each zone has at least two different types of devices that generate different wavelengths of light, and each zone can generate different brightness and different colors based on the image on the front panel, the front panel being aligned with the backlight unit and the front panel being bonded together at a fixed distance.

[0074] The system also includes: front panel frame-by-frame updates, wherein each frame includes pixel information generated by pixels, wherein the multi-zone array is further updated using data based on the maximum value of the brightness of each sub-pixel associated with each backlight zone, wherein the multi-zone array is further turned off while the pixels associated with each zone are being updated in the front panel.

[0075] The system also includes: a sub-pixel per pixel on the front panel, the sub-pixel having no color filter; each frame being divided into more than one sub-frame, and each sub-frame associated with a specific color; the front panel pixels being updated using color data from the image associated with each sub-frame; a multi-zone array being programmed to generate similar colors associated with each sub-frame and each zone; each backlight zone being programmed to control brightness based on pixel data in the sub-frame; and the backlight zones in the multi-zone array being turned off while the pixels associated with a zone are being updated. Here, a low-power mode exists such that at least one sub-frame generates a composite color in the backlight, the composite color comprising colors from both devices.

[0076] The system is still Figure 5 The diagram illustrates an implementation that allows for higher frame rates. Here, several rows are programmed simultaneously using independent data lines. In a related implementation, selection lines (SELs) that enable pixels to acquire data from the data lines (DATA) are simultaneously activated for several rows being programmed simultaneously. Here, the selection lines (SELs) are connected to a single source or sources with different simultaneous programming characteristics. Selection lines (SELs) can also be shared between rows being programmed simultaneously. In one example, each column has three data lines (DATA[j, 1:3]). Each data line is connected to pixels in a different row. The selection lines (SELs) associated with the groups of pixels connected to these data lines are activated simultaneously so that pixels in different rows can be programmed simultaneously. The rows being programmed simultaneously can be adjacent or scattered across different parts of the array. The rows in the array can be divided into multiple groups, each group being programmed simultaneously.

[0077] In one related implementation, the low-resolution image generated by the backlight has full-color information and brightness. The front panel light modulation element improves resolution by modulating the brightness of a region within each pixel associated with the low-resolution image. Here, the front panel has no color filter, so color definition comes solely from the backlight. Furthermore, operating the front panel at a high frame rate is unnecessary.

[0078] Furthermore, by synchronizing the backlight and front panel, the frame rate can be adjusted without any challenges associated with color sequencing effects at low frame rates.

[0079] In another related embodiment, the display may have a high image quality mode and a low power mode. In high quality mode, using color sequencing, each subframe produces a monochrome, low-resolution image in the backlight and generates an associated high-resolution image in the front panel. During low power mode, the display has one frame, with the backlight having full-color information and low pixel resolution. The high-resolution image generated in the front panel only modulates brightness.

[0080] In another related embodiment, there are more than one subframe. During each subframe, a full-color image is generated in the backlight, and the front panel light modulation element (LME) is programmed to improve image resolution. A first image is generated using the backlight full-color and the front monochrome LME. The error between the generated image and the actual image is calculated, and a second image is generated using the backlight and the front panel LME to reduce the error to a default value. The first and second images during two different subframes are shown. A third image and a third subframe may exist to further reduce the error between the generated image and the actual image.

[0081] In another related implementation, a first image is generated to limit the subpixel brightness error of each pixel within a threshold boundary. The threshold boundary may have an upper and a lower limit. A second image is also generated based on the difference between the generated image and the actual image to further reduce the error. This process can be extended to include more than just the first and second images.

[0082] In one relevant implementation, subframes and the images generated for each subframe can transition between two actual images. Here, the second or third subframe may have information from the first and second images, which may be interpolation data between the two actual images.

[0083] While specific embodiments and applications of the invention have been illustrated and described, it should be understood that the invention is not limited to the precise construction and composition disclosed herein, and various modifications, alterations and variations will be clearly apparent in the foregoing description without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A display system, the display system comprising: A front panel, which is enabled to modulate light to generate an image; A backlight unit for generating light and color, wherein the backlight unit has a multi-zone array, wherein each zone has at least two different types of microdevices that generate different wavelengths of light, and each zone is capable of generating different brightness and different colors based on a front panel image; The front panel is aligned with the backlight unit; and The front panel and the backlight unit are attached together at a fixed distance.

2. The system of claim 1, wherein the front panel is updated frame by frame, wherein each frame includes pixel information generated by pixels, wherein the multi-zone array is further updated using data based on the maximum value of the brightness of each sub-pixel associated with each backlight zone, wherein the multi-zone array is further turned off while the pixels associated with each zone are being updated in the front panel.

3. The system of claim 1, wherein each pixel of the front panel has a sub-pixel, the sub-pixel having no color filter, wherein each frame is divided into more than one sub-frame, and each sub-frame is associated with a specific color, wherein the front panel pixels are further updated using color data of the image associated with each sub-frame, wherein the multi-zone array is further programmed to generate similar colors associated with each sub-frame and each zone, wherein each backlight zone is further programmed to control brightness based on pixel data in the sub-frame, and wherein the backlight zone in the multi-zone array is turned off while the pixel associated with the zone is being updated.

4. The system of claim 3, wherein a low-power mode exists such that at least one subframe generates a composite color in the backlight, the composite color comprising colors from both devices.

5. The system of claim 1, wherein more than one line is programmed simultaneously to allow for a higher frame rate.

6. The system of claim 5, wherein there are independent data lines for simultaneous programming of each row.

7. The system of claim 5, wherein the selection lines for the rows used simultaneously are activated together.

8. The system of claim 5, wherein the selection line is connected to a similar source.

9. The system of claim 5, wherein the selection line is shared simultaneously among the rows being programmed.

10. A display having a low-power mode, the display having a full-color backlight array and a front panel monochromatic light modulation array, wherein the backlight array produces full color and the monochromatic front panel light modulation array improves image resolution.

11. The display of claim 10, wherein there is an image quality mode that operates multiple subframes, and each subframe has a full-color backlight image and a monochrome front panel image, and the sum of the images in each subframe produces a first image that approximates the actual image.

12. The display of claim 11, wherein a second image is generated to reduce the error between the first image and the actual image.

13. The display of claim 11, wherein a threshold boundary exists, the threshold boundary using an upper threshold and a lower threshold of sub-pixels to limit the error between the first image and the actual image.

14. A display system, the display system comprising: Front panel, the front panel does not have a color filter. Backlight, which is configured to provide color definition; A front panel light modulation element is enabled to improve resolution by modulating the brightness of a region in each pixel associated with a lower resolution image, wherein the backlight is synchronized with the front panel and the frame rate is adjusted without any risk of color sequence effects at low frame rates.

Images