Image processing device, display device, and method of controlling image processing device

The image processing device addresses flickering by adjusting the brightness of surrounding cells based on input data and using a two-dimensional filter to smoothly transition cell aperture ratios, effectively minimizing flickering.

JP2024162646AInactive Publication Date: 2024-11-21SHARP KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023078370
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-11
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing image processing devices fail to adjust the brightness of surrounding cells when an image smaller than the cell size with higher brightness than surrounding images moves across cell boundaries, leading to flickering issues.

Method used

The image processing device controls the brightness of surrounding cells by generating data based on input image data, considering the distance and brightness of adjacent pixels, using a two-dimensional filter to adjust the brightness distribution and perform filter processing to minimize flickering.

Benefits of technology

The solution effectively suppresses flickering by continuously adjusting the aperture ratio of cells as the high-brightness area moves, ensuring smooth transitions without significant resource or time delays.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162646000001_ABST
    Figure 2024162646000001_ABST
Patent Text Reader

Abstract

To provide an image processing device for providing control to adjust the brightness of peripheral cells surrounding a certain cell when an image having a size smaller than the certain cell and brightness higher than brightness of peripheral images moves within an area inside of the certain cell.SOLUTION: In an image processing device, a first data generation unit generates first data on a first cell based on the input brightness of a plurality of first pixels identified by input image data and the input brightness and positions of a plurality of second pixels identified by the input image data.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an image processing device, a display device, and a method for controlling an image processing device. [Background technology]

[0002] In recent years, as disclosed in the following Patent Document 1, image processing devices have been developed that display images on a display panel unit in which two liquid crystal display panels with different resolutions are superimposed. The display panel unit includes a backlight having a plurality of light-emitting elements, a first panel (monocell) having a plurality of cells, and a second panel (main cell or color cell) having a plurality of pixels. The first panel faces the backlight and controls the amount of light transmission at a first resolution. The second panel faces the first panel and controls the amount of light transmission at a second resolution higher than the first resolution. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2007 / 040139 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the technology disclosed in the above Patent Document 1, when an image smaller than the size of a cell and having a brightness much higher than that of the surrounding images moves in an inner region of a certain cell of the first panel, no control is performed to adjust the actual brightness of the surrounding cells surrounding the certain cell. Therefore, for example, when an image having a brightness much higher than that of the surrounding images crosses the boundary between a certain cell and the surrounding cells, inconveniences such as flickering occur.

[0005] The present disclosure has been made in consideration of the above-mentioned problems. An object of the present disclosure is to provide an image processing device, a display device, and a control method for an image processing device that perform control to adjust the brightness of neighboring cells surrounding a certain cell when an image smaller than the size of the cell and having a higher brightness than the surrounding images moves in an inner region of the certain cell. [Means for solving the problem]

[0006] (1) An image processing device related to the technology described in the present specification is an image processing device that displays an image on a display panel unit including a backlight, a first panel facing the backlight and capable of controlling an amount of light transmission at a first resolution, and a second panel facing the first panel and capable of controlling an amount of light transmission at a second resolution higher than the first resolution, wherein the first panel includes a first cell and a plurality of second cells surrounding the first cell, and the second panel includes a plurality of first pixels positioned facing the first cell and a plurality of second pixels positioned facing the plurality of second cells, the image processing device includes a first data generation unit that generates first data for controlling the first panel based on input image data, and a second data generation unit that generates second data for controlling the second panel based on the input image data and the first data, and the first data generation unit generates the first data for the first cell based on input luminance of the plurality of first pixels specified by the input image data, and input luminance and positions of the plurality of second pixels specified by the input image data.

[0007] (2) In addition to the above (1), the image processing device may be configured such that the first data generating unit generates the first data so as to suppress occurrence of flicker.

[0008] (3) In addition to (1), the image processing device may be configured such that the first data generation unit generates the first data for the first cell based on a distance between a predetermined position inside the first cell and a specific position inside each of the plurality of second pixels and an input luminance of the plurality of second pixels.

[0009] (4) In addition to (3), the image processing device may be configured such that the first data generation unit generates the first data such that an influence of an input luminance of a second pixel, among the plurality of second pixels, which is relatively far from the pixel, on the luminance of the first cell is smaller than an influence of an input luminance of a second pixel, among the plurality of second pixels, which is relatively far from the pixel, on the luminance of the first cell.

[0010] (5) In addition to (4), the image processing device may be configured such that the first data generation unit generates the first data such that a degree of influence of the input luminance of a second pixel, among the plurality of second pixels, whose input luminance is relatively large, on the luminance of the first cell is greater than a degree of influence of the input luminance of a second pixel, among the plurality of second pixels, whose input luminance is relatively small, on the luminance of the first cell.

[0011] (6) In the image processing device, in addition to (1), the first data generation unit may include a representative value setting unit that sets a representative value of each of the multiple second cells based on an input luminance of the multiple second pixels at a position opposite each of the multiple second cells; a luminance centroid calculation unit that calculates a luminance centroid of each of the multiple second cells based on an input luminance and positions of the multiple second pixels; a filter calculation unit that calculates, for each of the multiple second cells, based on the luminance centroid, coefficients of a two-dimensional filter for peripheral cells surrounding the central cell to include the first cell when one of the multiple second cells is set as a central cell; and a filter processing unit that generates the first data for the first cell by applying a filter process to the multiple peripheral cells using the coefficients of the two-dimensional filter, with the representative value as an input luminance of the central cell of the two-dimensional filter for each of the multiple second cells.

[0012] (7) In addition to (6), the image processing device may be configured such that the filter calculation unit calculates filter coefficients of the two-dimensional filter by making a correction to increase the filter coefficients of the two-dimensional filter for the multiple surrounding cells that are located on the side of the luminance center of gravity of the representative position of the central cell, and calculates the coefficients of the two-dimensional filter by making a correction to decrease the filter coefficients of the two-dimensional filter for the multiple surrounding cells that are located on the opposite side of the luminance center of gravity of the representative position of the central cell.

[0013] (8) In addition to (7), the image processing device may be configured such that the filter calculation unit calculates the filter coefficients of the two-dimensional filter after correction by correcting the filter coefficients such that the amount of change due to the correction of the filter coefficients increases as the distance between the representative position of the central cell and the luminance center of gravity increases.

[0014] (9) In the image processing device according to any one of (6) to (8), the two-dimensional filter may be a low-pass filter.

[0015] (10) In addition to any of (1) to (9), the image processing device may further include a backlight data generation unit that generates backlight data for controlling the light emission amount of each of the plurality of light-emitting areas based on the input image data, and a first panel luminance distribution calculation unit that calculates a luminance distribution at the position of the second panel for light traveling from the first panel to the second panel based on the backlight data and the first data, and the second data generation unit may generate the second data based on the input image data and the luminance distribution.

[0016] (11) In addition to any of (1) to (10), the image processing device may be such that, when viewed from the front of the display panel unit, the shapes of each of the first cell and the plurality of second cells are different from the shapes of each of the plurality of first pixels and the plurality of second pixels.

[0017] (12) In addition to any of (1) to (11), the image processing device may be such that, when viewed from the front of the display panel unit, a portion of one of the first cell and the plurality of second cells and a portion of an adjacent cell adjacent to the one cell are mixed in a common area.

[0018] (13) In the image processing device according to any one of (1) to (12) above, the first panel may be a liquid crystal panel.

[0019] (14) In the image processing device according to any one of (1) to (13) above, the second panel may be a liquid crystal panel.

[0020] (15) A display device according to the technology described in the present specification includes the display panel unit and the image processing device described in any one of (1) to (14).

[0021] (16) A control method for an image processing device related to the technology described in the present specification is a control method for an image processing device that displays an image on a display panel unit including a backlight, a first panel facing the backlight and capable of controlling an amount of light transmission at a first resolution, and a second panel facing the first panel and capable of controlling an amount of light transmission at a second resolution higher than the first resolution, the first panel including a first cell and a plurality of second cells surrounding the first cell, and the second panel including a plurality of first pixels positioned facing the first cell and a plurality of second pixels positioned facing the plurality of second cells, the control method for the image processing device including the steps of: generating first data for controlling the first panel based on input image data; and generating second data for controlling the second panel based on the input image data and the first data, and in the step of generating the first data, generating the first data for the first cell based on input luminance of the plurality of first pixels identified by the input image data, and input luminance and positions of the plurality of second pixels identified by the input image data. [Brief description of the drawings]

[0022] [Figure 1] 1 is a block diagram showing an overall configuration of a display device according to a first embodiment. [Diagram 2] 1 is a schematic cross-sectional view of a display panel unit of a display device common to all of the embodiments. [Diagram 3] 2 is a plan view showing a plurality of light-emitting regions of a backlight of a display device common to all of the embodiments. FIG. [Figure 4] FIG. 2 is a diagram for explaining the relationship between the light-emitting region of the backlight and the cells of the first panel (mono-cell) of the display device common to each embodiment. [Diagram 5] FIG. 2 is a diagram for explaining the relationship between a cell of a first panel (mono cell) and a pixel of a second panel (main cell) of the display device common to each embodiment, and a picture element included in the pixel. [Figure 6] A diagram for explaining a first cell and a plurality of first pixels contained in the first cell, as well as a plurality of second cells and a plurality of second pixels contained in the second cell, when viewed from the front and see-through of the first panel and second panel of the display device of embodiment 1. [Figure 7] FIG. 2 is a diagram specifically illustrating an internal configuration of a first example of the image processing device according to the first embodiment. [Figure 8] 4 is a flowchart illustrating a process executed by a first example of the image processing device according to the first embodiment. [Figure 9] FIG. 2 is a diagram specifically illustrating an internal configuration of a second example of the image processing device according to the first embodiment. [Figure 10] 1 is a flowchart 1 for explaining a process executed by a second example of the image processing device according to the first embodiment. [Figure 11] 11 is a flowchart 2 illustrating a process executed by the second example of the image processing device according to the first embodiment. [Figure 12] 11 is a flowchart 3 for explaining a process executed by the second example of the image processing device according to the first embodiment. [Figure 13]FIG. 4 is a diagram showing how the aperture ratio of the cells of the first panel changes with changes in input image data displayed by the display device of the first embodiment. [Figure 14] FIG. 11 is a diagram showing changes in the aperture ratio of the cells of the first panel in response to changes in input image data displayed by a display device of a comparative example. [Figure 15] 4A to 4C are diagrams showing an example of input image data displayed by the display device of the first embodiment and an example of the aperture ratio of a cell of a first panel. [Figure 16] FIG. 11 is a block diagram showing an overall configuration of a display device according to a second embodiment. [Figure 17] FIG. 11 is a diagram specifically illustrating an internal configuration of an example of an image processing device according to the second embodiment. [Figure 18] FIG. 13 is a diagram for explaining a mono-cell two-dimensional filter of a display device of a comparative example. [Figure 19] 13 is a diagram for explaining the relationship between the center position of a central cell of a mono cell and the luminance center of gravity of the display device of the second embodiment. FIG. [Figure 20] 13 is a diagram for explaining a filter process of a mono cell in the display device of the second embodiment. FIG. [Figure 21] FIG. 11 is a diagram for explaining the relationship between a central cell, peripheral cells, a first cell, and a second cell of a two-dimensional filter having, for example, 5 rows and 5 columns in the display device of the second embodiment. [Figure 22] FIG. 11 is a diagram showing an example of filter coefficients before correction of a low-pass filter as an example of a two-dimensional filter used in an image processing device of the display device according to the second embodiment. [Figure 23] FIG. 11 is a diagram showing an example of coordinates of a luminance center of gravity used in an image processing device of a display device according to a second embodiment. [Figure 24] FIG. 11 is a diagram showing an example of constants for calculations used in the image processing device of the display device according to the second embodiment. [Diagram 25] FIG. 11 is a diagram showing an example of correction rates of filter coefficients used in the image processing device of the display device according to the second embodiment. [Figure 26] FIG. 11 is a diagram showing an example of filter coefficients after correction of a two-dimensional filter used in the image processing device of the display device according to the second embodiment. [Figure 27] 13 is a flowchart illustrating a process executed by an example of an image processing device according to the second embodiment. [Figure 28] FIG. 11 is a diagram showing how the aperture ratio of the cells of the first panel changes with changes in input image data displayed by the display device of the second embodiment. [Figure 29] 13 is a diagram showing an example of input image data displayed by the display device of the second embodiment and an example of the aperture ratio of the cells of the first panel. [Diagram 30] FIG. 11 is a block diagram showing an overall configuration of a display device according to a third embodiment. [Diagram 31] FIG. 13 is a diagram specifically illustrating the internal configuration of an image processing device according to the third embodiment. [Diagram 32] 13 is a flowchart illustrating a process executed by an image processing device according to a third embodiment. [Diagram 33] FIG. 13 is a diagram showing a cell of a display device according to a fourth embodiment. [Diagram 34] FIG. 13 is a diagram showing a cell of a display device according to a fifth embodiment. [Diagram 35] FIG. 13 is a diagram showing a specific example of a cell of the display device according to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, an image processing device according to an embodiment of the present disclosure will be described with reference to the drawings. In the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description will not be repeated.

[0024] (Embodiment 1) FIG. 1 is a block diagram showing the overall configuration of a display device 1 according to the present embodiment.

[0025] 1, the display device 1 includes a display panel unit 100 and an image processing device 10 that controls the display panel unit 100. In the display device 1 of the present embodiment, the display panel unit 100 and the image processing device 10 are physically integrated. However, the display panel unit 100 and the image processing device 10 may be physically separated as long as they are connected to each other so as to be able to communicate with each other.

[0026] The display panel unit 100 includes a backlight BL, a backlight driver 40, a first panel WB, a first panel driver 20, a second panel CL, and a second panel driver 30. In this embodiment, each of the first panel WB and the second panel CL is a liquid crystal panel, but may be a panel other than a liquid crystal panel.

[0027] The backlight BL is disposed so as to face the first panel WB (see FIG. 2). The backlight BL has a plurality of light emitting regions LER (see FIG. 3). The resolution of the light emitting regions LER constituting the backlight BL is, for example, 6×4. Each of the light emitting regions LER has a plurality of LEDs (Light Emitting Diodes).

[0028] The LEDs are controlled so that the light emission modes of the LEDs in each light emitting region LER are the same and the entire light emitting region LER emits light to a certain degree uniformly. Then, local dimming can be performed to control the amount of light emitted independently for each of the light emitting regions LER. However, in this embodiment, it is described that local dimming is not performed.

[0029] The backlight driving section 40 drives each of the plurality of light emitting regions LER constituting the backlight BL so as to realize the output of each of the plurality of light emitting regions LER specified by the backlight data generated by the image processing device 10.

[0030] The first panel WB faces the backlight BL and is a liquid crystal display panel capable of controlling the amount of light transmission at a first resolution. The first panel WB is a so-called monochrome panel (hereinafter also referred to as a "mono cell") capable of performing black and white display (see FIG. 2). The first panel WB has a plurality of cells CE (see FIG. 4). The first panel WB may be any panel as long as it is capable of controlling the light transmission of each of the plurality of cells CE. The first panel WB may be, for example, a panel using a MEMS (Micro Electro Mechanical Systems) shutter.

[0031] Each of the cells CE does not have a color filter. Each of the cells CE functions as an opening for adjusting the amount of light emitted by the backlight BL. The area of ​​the opening of the cell CE is variable. The first panel WB is disposed to face the second panel CL (see FIG. 2). The resolution of the cells CE constituting the first panel WB is, for example, 240×135.

[0032] The first panel driving section (hereinafter also referred to as the "mono cell driving section") 20 drives the liquid crystal layer of each of the multiple cells CE constituting the first panel WB so as to realize the aperture ratio of each of the multiple cells CE specified by the data generated by the image processing device 10. In this specification, the aperture ratio of a cell CE means the actual aperture area of ​​the cell CE relative to the maximum aperture area of ​​the cell CE.

[0033] The second panel CL (see FIG. 2) faces the first panel WB and is a liquid crystal display panel capable of controlling the amount of light transmission at a second resolution higher than the first resolution of the first panel BW. The second panel CL is a color panel (hereinafter also referred to as a "main cell") capable of performing color display. The second panel CL has a plurality of pixels PX (see FIG. 5).

[0034] The pixels PX each have a plurality of sub-pixels. In this specification, the sub-pixels are called "picture elements PE (see FIG. 5)." Each of the pixels PX has a picture element PE (red), a picture element PE (G), and a picture element PE (B). The picture element PE (R) has a red color filter and transmits red light. The picture element PE (G) has a green color filter and transmits green light. The picture element PE (B) has a blue color filter and transmits blue light.

[0035] The second panel CL may be any panel other than a liquid crystal display panel, so long as it can control the light transmittance of each of the picture elements PE(red), PE(G), and PE(B) (see FIG. 5). The second panel CL may be, for example, a panel using a MEMS (Micro Electro Mechanical Systems) shutter.

[0036] In addition, the combination of color filters of the plurality of picture elements PE constituting one pixel PX of the second panel CL is not limited to a combination of red, green, and blue, and may be, for example, a combination of yellow, magenta, and cyan. The resolution of each color of the plurality of picture elements PE constituting the second panel CL is, for example, 1920×1080. That is, the resolution of the plurality of pixels PX constituting the second panel CL is, for example, 1920×1080.

[0037] The second panel driving section (hereinafter also referred to as the "main cell driving section") 30 drives the liquid crystal layer of each of the plurality of picture elements PE constituting the second panel CL so as to realize the aperture ratio of each of the plurality of picture elements PE specified by the data generated by the image processing device 10. In this specification, the aperture ratio of the picture element PE means the actual aperture area of ​​the picture element PE relative to the maximum aperture area of ​​the picture element PE.

[0038] The image processing device 10 controls the display panel based on a predetermined control method, and causes the display panel unit 100 to display an image based on input image data input from the outside. In this embodiment, the resolution of the input image data is the same as the resolution of the multiple pixels PX, which is 1920 × 1080. The input image data is data that can specify multiple input gradation values ​​to be input to the multiple picture elements PE of the second panel CL, respectively.

[0039] The input image data is data that can specify an input image by a plurality of input gradation values. The input image specified by the input image data corresponds to an output image displayed on the display panel unit 100. If the resolution of the input image data is different from the resolution of the plurality of pixels PX, for example, a resolution conversion unit that converts the resolution of the input image data into the resolution of the plurality of picture elements PE may be provided before the first data generation unit 11.

[0040] The image processing device 10 includes a first data generating unit 11 and a second data generating unit 12 (hereinafter also referred to as a "main cell driving value calculating unit"). In this embodiment, each of the first data generating unit 11 and the second data generating unit 12 is realized by at least a part of the functions of a processor. However, at least one of the first data generating unit 11 and the second data generating unit 12 may be configured by an electronic circuit dedicated to the image processing of this embodiment.

[0041] Input image data is transmitted from outside the display device 1 to the image processing device 10. The input image data, i.e., the input gradation values ​​of each of the plurality of picture elements PE constituting the first panel CL, is transmitted to a first data generating unit 11 and a second data generating unit 12 inside the image processing device 10.

[0042] The first data generating unit 11 generates first data for controlling the aperture ratio of the plurality of cells CE based on the input image data. The first data is, for example, data corresponding to the resolution of the first panel WB, which is 240×135. The first data generating unit 11 uses the input image data to generate the aperture ratio of each of the plurality of cells CE constituting the first panel WB.

[0043] The second data generating unit 12 generates second data for controlling the aperture ratio of the plurality of pixels PX based on the input image data and the first data. The second data is, for example, data corresponding to the resolution of the second panel CL, which is 1920×1080. The second data generating unit 12 uses the input image data and the first data to generate the aperture ratio of each of the plurality of pixels PX constituting the second panel CL.

[0044] The second data generating unit 12 first uses the first data (driving value of the cell CE) to calculate the luminance distribution of the light that passes from the backlight BL through the cell CE to reach the pixel PX. That is, the second data generating unit 12 calculates the luminance distribution at the position of the main cell, i.e., the second panel CL. Then, the second data generating unit 12 uses the calculated luminance distribution to correct the input image data so as to compensate for the lack of luminance caused by adjusting the amount of light traveling from the backlight BL to each picture element PE by controlling the aperture ratio of each cell CE of the first panel. This generates the second data (driving value of the pixel PX).

[0045] Fig. 2 is a schematic cross-sectional view of the display panel unit 100 of the display device 1 common to each embodiment. As shown in Fig. 2, in the display panel unit 100, a backlight BL, a first panel WB, and a second panel CL are arranged in this order. The backlight BL and the first panel WB are disposed so as to face each other. The first panel WB and the second panel CL are also disposed so as to face each other.

[0046] Fig. 3 is a plan view showing a plurality of light-emitting regions LER of a backlight BL of a display device 1 common to each embodiment. As shown in Fig. 3, the backlight BL is divided into a plurality of light-emitting regions LER, specifically, for example, 6 x 4 = 24 light-emitting regions LER. The image processing device 10 independently controls the output of each of the plurality of light-emitting regions LER. The plurality of LEDs in each of the plurality of light-emitting regions LER are controlled to have the same light-emitting mode.

[0047] However, in this embodiment, the plurality of light emitting regions LER are controlled to have the same brightness. That is, the image processing device 10 and the backlight BL have the ability to perform local dimming, but in this embodiment, local dimming is not performed. Note that the image processing device 10 and the backlight BL of this embodiment may not have the ability to perform local dimming.

[0048] 4 is a diagram for explaining the relationship between the light-emitting region LER of the backlight BL of the display device 1 common to each embodiment and the cells CE of the first panel (mono-cell) WB. As can be seen from FIG. 4, several cells CE are included in one virtual area facing each of the multiple light-emitting regions LER.

[0049] 5 is a diagram for explaining the relationship between the cells CE of the first panel (mono cell) WB of the display device 1 common to each embodiment and the pixels PX and picture elements PE of the second panel (main cell) CL. As can be seen from FIG. 5, several pixels PX are included in one virtual area facing each of the multiple cells CE, and each of the several pixels PX includes three picture elements PE. In other words, several picture elements PE are included in one virtual area facing each of the multiple cells CE.

[0050] As can be seen by comparing FIGS. 3 to 5, the resolution of the multiple light emitting regions LER of the backlight BL, the multiple cells CE of the first panel WB, and the multiple pixels PX and multiple picture elements PE of the second panel CL increases in this order.

[0051] Each light-emitting area LER of the backlight BL is controlled by the image processing device 10 so as to realize the maximum brightness of the input gradation values ​​of several picture elements PE within a virtual area facing that light-emitting area LER, which may be specified by, for example, input image data.

[0052] However, in this embodiment, the image processing device 10 controls the multiple light emitting areas LER of the backlight BL to emit light with the same luminance. That is, local dimming is not performed. In other words, in this embodiment, the light emission amount of each of the multiple light emitting areas LER of the backlight BL specified by the input image data is the same.

[0053] Each cell CE of the first panel WB is controlled by the image processing device 10 so as to realize the luminance of the maximum value of the input gradation values ​​of some picture elements PE in one virtual area facing the cell CE, which can be specified by the input image data, for example. The second panel CL is controlled by the image processing device 10 so as to realize the luminance of each of the plurality of picture elements PE, which can be specified by the input image data.

[0054] Figure 6 is a diagram for explaining a first cell CE and a plurality of first pixels PX contained in the first cell CE, as well as a plurality of second cells CE and a plurality of second pixels PX contained in the second cell CE, when viewed see-through from the front side of the first panel WB and second panel CL of the display device 1 of the present embodiment.

[0055] As shown in Fig. 6, the first panel WB includes a first cell CE arranged at the center position (or a position near the center of the matrix; hereinafter, both are referred to as the center position of the matrix) of a matrix consisting of m x n cells CE (m and n are natural numbers, and at least one of m and n is 2 or more), and a plurality of second cells CE arranged around the first cell CE so as to surround the first cell CE. The first cell CE is, for example, a central cell CE positioned at the center of a 3 x 3 matrix, and the second cells CE are eight peripheral cells CE surrounding the central cell CE. However, the arrangement of the first cell CE and the second cell CE is not limited to the 3 x 3 matrix disclosed in Fig. 6, as long as the relationship between the central position and the peripheral positions surrounding it holds.

[0056] When the first panel WB includes k cells CE, the image processing device 10 performs processing for cases where each of the k cells CE becomes a first cell CE. Therefore, a certain cell CE can become either a first cell CE or a second cell CE. Also, when a cell CE located at the edge of the first panel WB becomes a first cell, the first cell CE may not be located at the center of the matrix.

[0057] The second panel CL includes a plurality of first pixels PX positioned opposite the first cells CE and a plurality of second pixels PX positioned opposite the second cells CE. That is, one cell CE at the center of one set of cells CE consisting of a 3×3 matrix faces the first pixels PX, and eight cells CE at peripheral positions surrounding the central cell CE face the second pixels PX.

[0058] 6, each of the first pixels PX and the second pixels PX is included in an area facing one cell CE. However, some of the first pixels PX or some of the second pixels PX may be disposed across an area facing two cells CE.

[0059] The first data generating unit 11 generates first data for controlling the first panel WB based on the input image data. The first data generating unit 11 includes a distance calculating unit 11A and a first data calculating unit 11B. The distance calculating unit 11A and the first data calculating unit (hereinafter also referred to as a "mono-cell driving value calculating unit") 11B will be described in detail later.

[0060] The first data generation unit 11 generates first data for the first cell CE based on the input luminance of a plurality of first pixels PX identified by the input image data, and the input luminance and positions of a plurality of second pixels PX identified by the input image data.

[0061] Specifically, the distance calculation unit 11A calculates the distance D1 between a specific position of each pixel PX and a predetermined position of the cell CE. At this time, the distance calculation unit 11A calculates the distance D1 based on the pixel PX of the cell CE and the second panel (main cell) CL used in the distance calculation. The reference point of the cell CE is the center position of the cell, specifically, the intersection point of the diagonal lines of the rectangle.

[0062] When performing a process of calculating distance D1 based on pixel PX, it is preferable that the cells CE used in calculating distance D1 for a certain pixel PX include all cells CE included in the first panel WB. However, from the viewpoint of suppressing an increase in time and processing for calculating distance D1, the cells CE used in calculating distance D1 for a certain pixel PX may be limited to cells CE in a predetermined region in the first panel WB that includes some of all cells CE.

[0063] On the other hand, when performing a process of calculating distance D1 based on a cell CE, it is preferable that the pixels PX used in calculating distance D1 for a certain cell CE include all pixels PX included in the second panel CL. However, from the viewpoint of suppressing an increase in time and processing for calculating distance D1, the pixels PX used in calculating distance D1 for a certain cell CE may be limited to pixels PX in a predetermined region in the second panel CL that includes a portion of all pixels PX.

[0064] The first data calculation unit (monocell drive value calculation unit) 11B calculates the drive value of the cell CE according to the distance D1. For example, the following method of calculation is considered. If the distance between a specific position of a pixel PX and the center position of the cell CE is D1, then the drive value = (k / d) x (tone value (luminance) of a pixel PX) or the drive value = (k / d^2) x (tone value (luminance) of a pixel PX).

[0065] However, when a pixel PX is included in an area facing a cell CE, the drive value is the gradation value (luminance) of the pixel PX. The constant k can be changed by a mechanism (such as a register) that can be changed from the outside.

[0066] Since multiple pixels PX exist for a certain cell CE as targets for calculating drive values, the first data calculation unit (mono-cell drive value calculation unit) 11B calculates multiple drive values ​​for the cell CE. The first data calculation unit (mono-cell drive value calculation unit) 11B sets the largest value among the multiple drive values ​​as the drive value for the certain cell CE.

[0067] According to this, when an image smaller than the size of a certain cell CE and brighter than the surrounding images moves in the inner area of ​​the certain cell CE, control can be performed to adjust the brightness of the surrounding cells CE surrounding the certain cell CE.

[0068] In this embodiment, the first data generating unit 11 generates the first data so as to suppress the occurrence of flicker. Therefore, when an image smaller than the size of a certain cell CE and having a brightness extremely higher than the brightness of the surrounding images moves in the inner area of ​​the certain cell CE, the occurrence of flicker can be suppressed.

[0069] Specifically, the first data generating unit 11 generates the first data for the first cell CE based on the distance D1 between a predetermined position (CN) inside the first cell CE and a specific position SC (center position) inside each of the second pixels PX, and the input luminance of the second pixels PX. In this embodiment, the predetermined position inside the first cell CE is the intersection of the diagonals of the rectangular cell CE, that is, the center position CN, but is not limited to this. The specific position SC is the intersection of the diagonals of the rectangular second pixel PX, that is, the center position, but is not limited to this.

[0070] According to the above-mentioned first data, the following (1) is realized: (1) The degree of influence of the input luminance of the second pixel PX having the relatively large distance D1 among the multiple second pixels PX on the luminance of the first cell CE is smaller than the degree of influence of the input luminance of the second pixel PX having the relatively small distance D1 among the multiple second pixels PX on the luminance of the first cell CE.

[0071] Furthermore, according to the first data, the following (2) is realized: (2) The degree of influence of the input luminance of the second pixel PX having a relatively large input luminance among the multiple second pixels PX on the luminance of the first cell CE is larger than the degree of influence of the input luminance of the second pixel PX having a relatively small input luminance among the multiple second pixels PX on the luminance of the first cell CE.

[0072] FIG. 7 is a diagram specifically showing the internal configuration of a first example of the image processing device 10 according to the present embodiment.

[0073] As shown in FIG. 7, the image processing device 10 includes an input image memory M1, a mono-cell data calculation memory M2, a mono-cell drive memory M3, and a main cell drive value memory M4, all of which are not shown in FIG.

[0074] The input image memory M1 is a memory for storing input image data for one frame. The mono cell data calculation memory M2 is a memory for storing calculated values ​​of mono cells for one frame. The mono cell drive value memory M3 is a memory for storing calculated mono cell drive values ​​for one frame.

[0075] The main cell drive value memory M4 is a memory that stores the calculated main cell drive values ​​for one frame. Each of the input image memory M1, the mono cell data calculation memory M2, the mono cell drive memory M3, and the main cell drive value memory M4 is initialized to 0 before the start of the process described using the flowchart shown in FIG.

[0076] FIG. 8 is a flowchart for explaining a process executed by a first example of the image processing device 10 according to the first embodiment.

[0077] In step S1, the image processing device 10 reads one frame of input image data from an external device. The input image data is stored in an input image memory M1. In step S2, the image processing device 10 sets a pixel PX to be the first calculation target among a group of pixels PX included in the input image data. For example, the image processing device 10 sets the leftmost and topmost pixel PX of the input image data as the first calculation target.

[0078] In step S3, the distance calculation unit 11A calculates the distance between the pixel PX to be calculated and the mono cell, specifically, the distance D1 (see FIG. 6) between a specific position SC (center position) of the pixel PX to be calculated and a predetermined position (center position CN) of the cell CE of the first panel WB. That is, the distance calculation unit 11A calculates the distance D1 between the specific position of one pixel PX to be calculated and each center position CN of multiple cells CE associated therewith. Therefore, the distance calculation unit 11A calculates multiple distances D1 for multiple cells CE.

[0079] At this time, the first data calculation unit 11B calculates the drive value so that if the distance D1 is small, the drive value (the value corresponding to the luminance) is increased, and if the distance D1 is large, the drive value (the value corresponding to the luminance) is decreased.

[0080] In step S4, the first data calculation unit (mono-cell drive value calculation unit) 11B calculates a mono-cell drive value (a value corresponding to luminance) according to the distance D1 for each of the mono-cells (each cell CE of the first panel WB). The calculated drive values ​​are stored in the mono-cell calculation memory M2.

[0081] In step S5, the first data calculation unit (mono-cell driving value calculation unit) 11B compares the following (1) and (2) for each of the multiple mono-cells.

[0082] (1) A drive value (corresponding to luminance) according to a distance D1 between a specific position SC of a pixel PX to be previously calculated and a predetermined position (center position CN) of a specific mono cell (cell CE of the first panel WB), which is stored in the mono cell calculation memory M2.

[0083] (2) A drive value (corresponding to luminance) according to a distance D1 between a specific position SC of the pixel PX being calculated this time and a predetermined position (center position CN) of one specific mono cell (cell CE of the first panel WB) As a result, the first data calculation unit (mono-cell drive value calculation unit) 11B selects the larger drive value (corresponding to luminance) for each of the mono-cells as a result of comparing (1) and (2) described above. The selected drive value is overwritten in the mono-cell calculation memory M2.

[0084] In step S6, the image processing device 10 judges whether or not the processes in steps S3 to S5 for all pixels PX included in the input image data have been completed. In some cases, it may not be judged in step S6 that the processes in steps S3 to S5 for all pixels PX included in the input image data have been completed. In this case, in step S7, the image processing device 10 changes the pixel PX to be calculated of the input image data to the next pixel PX, and repeats steps S3 to S6. For example, in step S7, the image processing device 10 sets the pixel PX immediately to the right of the pixel PX currently set as the calculation target as the new calculation target pixel PX. If the pixel PX currently set as the calculation target is the rightmost pixel PX, the image processing device 10 sets the pixel PX at the left end of the row immediately below of the input image data as the new calculation target pixel PX.

[0085] On the other hand, in step S6, it may be determined that the calculations in steps S3 to S5 for all pixels PX included in the input image data have been completed. For example, this may be the case when the pixel PX currently set as the calculation target is the rightmost and bottommost pixel PX of the input image data. In this case, in step S8, the first data calculation unit (mono-cell drive value calculation unit) 11B determines the drive value (value corresponding to luminance) of the first panel (mono-cell) WB.

[0086] At this time, the first panel data calculation unit (mono cell drive value calculation unit) 11B adjusts the drive values ​​of all the cells CE of the first panel WB by multiplying the drive values ​​of the multiple cells CE stored in the mono cell calculation memory M2 by a necessary coefficient or adding an offset. Then, the first panel data calculation unit (mono cell drive value calculation unit) 11B stores the adjusted drive values ​​in the mono cell drive value memory M3.

[0087] In step S10-2, the first panel driver (mono cell driver) 20 drives the mono cells, that is, the first panel WB, using the drive values ​​stored in the above-mentioned mono cell drive value memory M3.

[0088] In step S9, the second data generator 12 calculates the luminance distribution of light that passes through the cell CE from the backlight BL and reaches the pixel PX by using the drive value of the cell CE stored in the mono cell drive value memory M3. That is, the second data generator 12 calculates the luminance distribution at the position of the main cell, i.e., the second panel CL.

[0089] Then, in step S10, the second data generating unit 12 corrects the input image data using the calculated luminance distribution to compensate for the lack of luminance caused by the cell CE restricting the light traveling from the backlight BL to the pixel PX. The second data generating unit 12 stores the corrected input image data (corresponding to the luminance) in the main cell driving value memory M4.

[0090] After that, in step S10-1, the second panel driver (main cell driver) 30 drives the main cells, that is, the second panel CL, using the corrected input image data stored in the main cell driving value memory M4.

[0091] In steps S2 to S7, the image processing device 10 sets a pixel PX to be calculated from the input image data, and calculates the drive value of the cell CE while sequentially changing the pixel PX to be calculated. However, it is also possible to set a cell CE to be calculated from all the cells CE, and calculate the drive value of the cell CE while sequentially changing the cell CE to be calculated. This is the same in the following embodiments.

[0092] It is preferable that the distance calculation unit 11A performs the processes of steps S3 to S5 for all cells CE. However, doing so increases the calculation cost. The pixel PX to be calculated is unlikely to affect cells CE located far from the pixel PX to be calculated. Therefore, the distance calculation unit 11A may perform the processes of steps S3 to S5 for cells CE within a predetermined range from the pixel PX to be calculated. This also applies to the other embodiments described below.

[0093] In the flowchart shown in Fig. 8, the image processing device 10 of this embodiment calculates the distance between the pixel PX to be calculated and the mono cell while sequentially changing the pixel PX to be calculated, using the pixel PX as the reference for calculating the drive value. However, the image processing device 10 may calculate the distance between the pixel PX to be calculated and the mono cell while sequentially changing the mono cell to be calculated, using the mono cell (cell CE) as the reference for calculating the drive value. This is the same in the other embodiments described below.

[0094] FIG. 9 is a diagram specifically showing the internal configuration of a second example of the image processing device 10 according to the present embodiment.

[0095] As can be seen by comparing Fig. 7 and Fig. 9, the internal configuration of the second example is different from that of the first example in that the mono-cell data calculation line memory M2 is composed of mono-cell data calculation line memories M2-1 and M2-2. Specifically, in the mono-cell data calculation memory M2, the drive values ​​(corresponding to luminance) of only one row of the multiple pixels PX forming a matrix that constitutes one frame of input image data are stored alternately in each of the mono-cell data calculation line memories M2-1 and M2-2. Note that the number of line memories (two) described above is just an example. The image processing device 10 may be provided with three or more line memories and used sequentially.

[0096] According to this, the same effects as those obtained by the image processing device 10 of the first embodiment can be obtained with a memory having a smaller capacity than that of the image processing device 10 of the first embodiment.

[0097] FIG. 10 is a flowchart 1 for explaining a process executed by a second example of the image processing device 10 according to the present embodiment.

[0098] In step S11, the image processing device 10 reads one frame of input image data from an external device. The input image data is stored in the input image memory M1.

[0099] In step S12, the image processing device 10 sets the line (row) of the mono cell (first panel WB) to be calculated and the line memory to be used. More specifically, the distance calculation unit 11A sets the line (row) of the first panel WB (mono cell) to be calculated. For example, the topmost line of the first panel WB (mono cell) is set as the line to be calculated first, and the lines below that are successively set as the lines to be calculated. The distance calculation unit 11A also sets one of the mono cell data calculation line memories M2-1 and M2-2 to be used for the subsequent calculations. At this time, the two line memories are used alternately.

[0100] In step S13, the image processing device 10 sets a calculation target range in the input image data. The details of setting the calculation target range will be described later. Then, the image processing device 10 sets the first calculation target pixel PX in the calculation target range of the input image data. For example, the image processing device 10 sets the leftmost and topmost pixel PX in the calculation target range of the input image data as the first calculation target. Pixels PX to be calculated are set in order from the top left pixel PX of the input image data to the right, and when the right end of the input image data is reached, the left end pixel PX of the line one line below the input image data is set as the calculation target pixel PX.

[0101] The difference from step S2 in the first embodiment is that in the processes of steps S13 to S18 in the present embodiment, some pixels PX of the input image data are targeted for calculation, rather than all of the input image data. This will be explained in more detail below.

[0102] In the second example of the image processing device 10 of this embodiment, in the process of steps S13 to S18, data is updated in the calculation of the distance D1 only for one line (row) of a group of cells CE constituting the first panel (mono-cell) WB. Therefore, the process of steps S13 to S18 is performed only for pixels PX of the input image data (i.e., pixels PX included in the calculation target range of the input image data) in which the one line of cells CE is used to calculate the distance D1. The process of step 13 is to set the calculation target range of the input image data. For example, in step 13, the image processing device 10 sets, as the calculation target range, a plurality of lines of the input image data whose vertical distance is within a predetermined range with respect to the one line of the calculation target of the first panel (mono-cell) WB determined in step S12. According to this process, if the one line of the calculation target of the first panel (mono-cell) WB determined in step S12 changes, the calculation target range of the input image data determined in step S13 also changes.

[0103] In step S14, the distance calculation unit 11A calculates the distance D1 between the specific position SC (center position) of the pixel PX to be calculated and a predetermined position (center position CN) of a plurality of mono cells (first panel WB) included in the line to be calculated. That is, the distance calculation unit 11A calculates the distance D1 between one pixel PX to be calculated and each of the plurality of cells CE. In step S15, the first data calculation unit (mono cell drive value calculation unit) 11B calculates the drive value (value corresponding to luminance) of the mono cell (each cell CE of the first panel WB) according to the distance D1.

[0104] In step S16, the first data calculation unit (mono-cell driving value calculation unit) 11B compares the following (1) and (2) for each of the multiple mono-cells.

[0105] (1) A drive value (corresponding to luminance) according to the distance D1 between the pixel PX previously calculated and a specific mono cell (first panel WB) stored in the mono cell calculation line memory (either M2-1 or M2-2) currently being used for calculation

[0106] (2) A drive value (corresponding to luminance) according to the distance D1 between the pixel PX being calculated this time and one specific mono cell (first panel WB) As a result, the first data calculation unit (mono-cell drive value calculation unit) 11B selects the larger drive value (corresponding to luminance) for each of the mono-cells that are the subject of the calculation as a result of the comparison. The selected drive value is overwritten in the mono-cell data calculation line memory (either M2-1 or M2-2) currently being used for the calculation.

[0107] Next, in step S17, the image processing device 10 judges whether or not the processes in steps S14 to S16 for all pixels PX included in the calculation range of the input image data have been completed. In step S17, it may not be judged that the processes in steps S14 to S16 for all pixels PX included in the calculation range of the input image data have been completed. In this case, in step S18, the image processing device 10 changes the calculation target pixel PX of the input image data to the next calculation target pixel PX, and then repeats steps S14 to S17.

[0108] For example, in step S17, the image processing device 10 sets the pixel PX immediately to the right of the pixel PX currently set as the calculation target as the new calculation target pixel PX. If the pixel PX currently set as the calculation target is the rightmost pixel PX, the image processing device 10 sets the leftmost pixel PX of the row immediately below in the input image data as the new calculation target pixel PX.

[0109] On the other hand, in step S17, it may be determined that the processing in steps S14 to S16 has been completed for all pixels PX included in the calculation range of the input image data. This means that the processing for the calculation line of the mono cells has been completed, and the drive values ​​of each mono cell included in the calculation line have been calculated. In this case, in step S19, the second data generator 12 determines whether the drive values ​​(corresponding to luminance) of the cells CE of all lines of the mono cells (first panel WB) have been determined.

[0110] As a result, in step S19, it may not be determined that the drive values ​​(corresponding to luminance) of the cells CE of all lines of all the mono cells (first panel WB) have been determined. In this case, in step S20, the image processing device 10 changes the line to be calculated of the mono cells (first panel WB) to the next line to be calculated. In this case, two line memories are used alternately. After that, in step S21, the image processing device 10 sets the stored information of the line memory to be used next to 0, i.e., initializes it, and repeats steps S13 to S19.

[0111] 11 is a flowchart 2 for explaining a process executed by a second example of the image processing device 10 according to the present embodiment. The process of the flowchart 2 is executed in parallel with and in synchronization with the process of the flowchart 1 shown in FIG.

[0112] 11, in step S31, the image processing device 10 sets a line (row) to be calculated of the mono cell (first panel WB) and a line memory to be used. At this time, the image processing device 10 sets the same line of the mono cell as the line (row) to be calculated of the mono cell (first panel WB) set in step S12 of the flowchart 1 as the line to be calculated in the flowchart 2. The image processing device 10 also sets the same line memory to be used as the line memory set in step S12 as the line memory to be used in the flowchart 2.

[0113] In step S32, the image processing device 10 judges whether or not the calculation of the line to be calculated of the mono cell in the processing of the flowchart 1 is completed. Specifically, the image processing device 10 judges whether or not the judgment result of step S17 of the flowchart 1 is Yes. In step S32, if the calculation of the line to be calculated of the matrix of the cell CE constituting the mono cell (first panel WB) is not completed (specifically, the image processing device 10 judges that the judgment result of step S17 of the flowchart 1 is not Yes), the image processing device 10 repeats the processing of step S32.

[0114] On the other hand, in step S32, there is a case where the calculation of the line to be calculated for the mono cell in the process of the flowchart 1 is completed (specifically, the judgment in step S17 of the flowchart 1 is Yes). In this case, in step S33, the first data calculation unit (mono cell drive value calculation unit) 11B determines the drive value (value corresponding to luminance) of the line to be calculated for the first panel (mono cell) WB. At this time, the first panel data calculation unit (mono cell drive value calculation unit) 11B multiplies the drive values ​​of the multiple cells CE stored in the mono cell calculation line memory by a necessary coefficient or adds an offset. Thereby, the first data calculation unit (mono cell drive value calculation unit) 11B adjusts the drive value of the line to be calculated for the first panel (mono cell) WB. Then, the first panel data calculation unit (mono cell drive value calculation unit) 11B stores the adjusted drive value in an area of ​​the mono cell drive value memory M3 corresponding to the line to be calculated.

[0115] In step S34, the image processing apparatus 10 determines whether or not the calculation has been completed for all lines of the matrix of cells CE constituting the mono cell (first panel WB) of the line to be calculated.

[0116] In step S34, there are cases where processing of all lines of the mono cells (CE of the first panel WB) of the line to be calculated has not been completed. In this case, in step S35, the image processing device 10 changes the line to be calculated of the matrix of the cells CE constituting the mono cell (first panel WB) to the next line. On the other hand, if calculation of all lines to be calculated of the matrix of the cells CE constituting the mono cell (first panel WB) has been completed in step S34, the image processing device 10 ends this process.

[0117] Fig. 12 is a flowchart 3 for explaining a process executed by a second example of the image processing device 10 of the present embodiment. The image processing device 10 executes the process of the flowchart 3, for example, after the process of the flowchart 1 shown in Fig. 10 and the process of the flowchart 2 shown in Fig. 11 are completed and the drive values ​​of all the mono cells are determined.

[0118] In step S41, the second data generator 12 calculates the luminance distribution on the main cells (pixels PX of the second panel CL) in the same manner as in the process of step 9. At the same time, in step S44, the first panel driver (mono cell driver) 20 drives the mono cells (first panel WB) using the drive values ​​stored in the above-mentioned mono cell drive value memory M3.

[0119] In step S42, the second data generator 12 corrects the input image data read from an external device using the calculated luminance distribution as in step S10, and stores the corrected input image data in the main cell driving value memory M4. Then, in step S43, the second panel driver (main cell driver) 30 drives the main cell (second panel CL) using the gradation values ​​of the corrected input image data stored in the main cell driving value memory M4.

[0120] According to the above process, when the first data calculation unit (mono cell drive value calculation unit) 11B performs the process of step S33 for the n-th line of the mono cell in the process of the flowchart 2, the image processing device 10 determines (S20) the next calculation target line (n+1-th line) of the mono cell in the process of the flowchart 1. As a result, the image processing device 10 executes the process for the calculation target line. By performing the process in this manner, the process of the flowchart 1 and the process of the flowchart 2 are executed in parallel.

[0121] Furthermore, the image processing device 10 may perform the process of the flowchart 3 in sequence from the part where the driving values ​​of the predetermined amount of mono cells required for the processes of steps S41 and S42 have been determined by the processes of the flowcharts 1 and 2. In this way, the process of the flowchart 3 is performed in parallel with the processes of the flowcharts 1 and 2.

[0122] As described above, the image processing device 10 can calculate mono cell data using the mono cell data calculation memory M2 (FIG. 7) that stores the calculation values ​​of mono cells for one frame, and can also calculate mono cell data using the mono cell data calculation line memories M2-1 and M2-2 (FIG. 9). The same applies to the other embodiments described below.

[0123] FIG. 13 is a diagram showing changes in the aperture ratio of the cells CE of the first panel WB relative to changes in the input image data IM displayed by the display device 1 of the first embodiment.

[0124] 13(a) shows an example of input image data IM. The input image data IM has a high luminance area BA (e.g., an area including multiple pixels with a gradation value of 255) in a background with low gradation (e.g., gradation value 0). The high luminance area BA moves to the right as time passes.

[0125] 13(b) to 13(e) are diagrams showing the aperture ratios of a plurality of cells CE of the first panel WB corresponding to the input image data IM in grayscale shading. The grayscale shading means that the darker the cell CE, the smaller the aperture ratio, and the lighter the cell CE, the larger the aperture ratio. In addition, in FIG. 13(a) to FIG. 13(e), the high luminance area BA is also drawn superimposed on the cell CE. However, in FIG. 13(a) to FIG. 13(e), the high luminance area BA is drawn in black for easy viewing. As time passes from FIG. 13(b) to FIG. 13(e), the position of the high luminance area BA moves to the right. As shown in FIG. 13(b) to FIG. 13(e), according to the image processing device 10 of the present embodiment, the aperture ratios of the plurality of cells CE change gradually, without abrupt change, as the high luminance area BA moves.

[0126] In FIG. 13(b), the high luminance area BA is located in the cell CE2. Accordingly, the aperture ratio of the cell CE2 is the highest. In FIG. 13(b), the high luminance area BA is located on the left side in the cell CE2. Therefore, in FIG. 13(b), of the cells CE1 and CE3 adjacent to the cell CE2 in the horizontal direction, the cell CE1 relatively closer to the high luminance area BA has a higher aperture ratio than the cell CE3 relatively far from the high luminance area BA. In FIG. 13(c), the high luminance area BA is located on the right side in the cell CE2. Therefore, in FIG. 13(c), of the cells CE1 and CE3 adjacent to the cell CE2 in the horizontal direction, the cell CE3 supposedly closer to the high luminance area BA has a higher aperture ratio than the cell CE1 relatively far from the high luminance area BA. In addition, the cells CE adjacent to these cells CE1 and CE3 in the vertical direction also change in aperture ratio similar to the change in aperture ratio of the cells CE1 and CE3. From FIGS. 13(b) and 13(c), it can be seen that when the high luminance area BA is located within the cell CE2, the aperture ratio of the multiple cells CE also changes depending on the change in the position of the high luminance area BA within the cell CE2.

[0127] In Fig. 13(d), the high-luminance area BA has moved to a position overlapping the boundary between cells CE2 and CE3. In Fig. 13(d), cells CE2 and CE3 are controlled to have the same aperture ratio. In Fig. 13(e), the high-luminance area BA has moved further and is located at the center of cell CE3. In Fig. 13(e), the aperture ratio of cell CE3 is the highest, and cells CE2 and CE4, which are horizontally adjacent to cell CE3, are controlled to have the same aperture ratio.

[0128] As can be seen from Fig. 13, according to the image processing device 10 of this embodiment, the aperture ratio of each cell CE changes continuously both when the high brightness area BA in the input image data IM moves within a certain cell CE and when it moves across multiple cells CE. Therefore, flicker can be suppressed.

[0129] 14 is a diagram showing the change in aperture ratio of the cells CE of the first panel WB with respect to the change in input image data IM displayed by the display device of the comparative example. The input image data IM displayed is the same as the input image data IM shown in FIG. 13(a).

[0130] As shown in FIG. 14(a) and FIG. 14(b), according to the image processing device 10 of the comparative example, even if the high brightness area BA of the input image data moves within the cell CE2, the brightness of the cells CE around the cell CE2 remains low and does not change. Also, in FIG. 14(c), the high brightness area BA moves to a position overlapping the boundary between the cells CE2 and CE3, and the cells CE2 and CE3 are controlled to have the same aperture ratio. Therefore, when the state changes from FIG. 14(b) to FIG. 14(c), the aperture ratio of the cell CE3 changes abruptly from a low state to a high state. Also, in FIG. 14(d), the high brightness area BA moves further and is located at the center of the cell CE3. In FIG. 14(d), the aperture ratio of the cell CE3 is high, and the aperture ratios of the other cells are low. Therefore, when the state changes from FIG. 14(c) to FIG. 14(d), the aperture ratio of the cell CE2 changes abruptly from a high state to a low state.

[0131] As can be seen from FIG. 14, in the display device of the comparative example, when the high brightness area BA in the input image data IM moves within a certain cell CE, the aperture ratio of each cell CE does not change. On the other hand, when moving across a plurality of cells CE, the aperture ratio of each cell CE changes suddenly. Therefore, flicker occurs. In order to make the flicker less noticeable compared to the comparative example, for example, it is possible to increase the aperture ratio of the cell CE in a relatively wide range centered on the cell CE in which the high brightness area BA is located. However, doing so would lose the meaning of overlapping two panels consisting of the first panel WB and the second panel CL (such as increasing the contrast). In contrast, according to the processing of the image processing device 10 of the present embodiment, flicker can be reduced by only increasing the aperture ratio of the cell CE only in a narrow range centered on the cell CE in which the high brightness area BA is located, and even if the amount of increase in the aperture ratio of the cell CE around the cell CE in which the high brightness area BA is located is small.

[0132] Fig. 15 is a diagram showing an example of the input image data IM displayed by the display device 1 of the present embodiment and the aperture ratio of the cell CE of the first panel WB. Fig. 15 shows a situation in which multiple high luminance areas BA exist in an area of ​​one cell CE.

[0133] As shown in FIG. 15, in the image processing device 10 of this embodiment, when multiple high-luminance areas BA included in the input image data IM exist in the area of ​​the cell CE at the center position, the luminance of the cell CE at the peripheral position is generated so as to be influenced by the multiple high-luminance areas BA. Specifically, one of the high-luminance areas BA is located in the upper right of the cell CE at the center position, and the other is located in the lower left. Since it is influenced by these high-luminance areas BA, the aperture ratio of the cell CE located diagonally upward to the right from the cell CE at the center position and the cell CE located diagonally downward to the left from the cell CE at the center position is high. The display of this image processing device 10 is different from the display of the image processing device 10 of the second embodiment described later in that when there are two high-luminance areas BA with a luminance higher than the luminance of the image around the center cell CE, the luminance of the peripheral cell CE is adjusted according to the positions of the two high-luminance areas BA.

[0134] As described above, according to the image processing device 10 of this embodiment, even if the high luminance area BA in the input image data IM moves within an area of ​​one cell CE or across multiple cells CE, the aperture ratio of each cell CE changes continuously. Therefore, flicker can be suppressed. As another means for continuously changing the aperture ratio of each cell CE, a filter process in the time direction can be considered. However, the process in the image processing device 10 of this embodiment is a process that is completed for each frame of input image data, and is not a process that requires multiple consecutive frames of input image data. Therefore, according to the image processing device 10 of this embodiment, resources such as memory required for processing can be reduced, and the delay time caused by the process can be shortened.

[0135] (Embodiment 2) Image processing device 10 of the second embodiment will be described with reference to Figs. 16 to 29. Note that, in the following, description of the same points as those of image processing device 10 of the embodiments will not be repeated. Image processing device 10 of the present embodiment differs from image processing device 10 of the first embodiment in the following points.

[0136] FIG. 16 is a block diagram showing the overall configuration of a display device 1 according to the present embodiment.

[0137] As shown in FIG. 16, the first data generating section 11 includes a representative value setting section 11C, a luminance centroid calculating section 11D, a filter calculating section 11E, and a filter processing section 11F.

[0138] The representative value setting unit 11C sets a representative value for each of the second cells based on the input luminance of the second pixels PX at positions facing each of the second cells CE. Specifically, the representative value setting unit 11C uses, for example, the maximum value of the luminance values ​​of the pixels PX in an area facing one cell CE as the representative value of the cell CE. The luminance centroid calculation unit 11D calculates the luminance centroid of each of the second cells CE based on the input luminance and positions of the second pixels PX.

[0139] The filter calculation unit 11E calculates a filter coefficient for each of the second cells CE. That is, the filter calculation unit 11E calculates filter coefficients of a two-dimensional filter for the center cell CE and a plurality of, for example, eight surrounding cells CE surrounding the center cell CE so as to include the first cell CE, that is, a total of nine cells CE, when one of the second cells CE is set as the center cell CE, based on the luminance center of gravity of the center cell CE. In this case, the filter calculation unit 11E biases the filter coefficients constituting the matrix based on the calculation result of the luminance center of gravity. The filter before the bias is provided is, for example, a low-pass filter such as a Gaussian filter or a smoothing filter.

[0140] The filter processing unit 11F performs a filter process on the representative value of the plurality of cells CE with the second cell CE as the center cell for each of the plurality of second cells CE, using the filter coefficient calculated by the filter calculation unit 11E. This generates the first data for the first cell CE, that is, the driving value of the cell CE. That is, the filter processing unit 11F performs a filter process on the representative value of the plurality of cells CE constituting the first panel WB, thereby performing a blurring process on the representative value of the plurality of cells CE. Note that, as in the first embodiment, a certain cell CE can be either the first cell CE or the second cell CE. Therefore, the processes performed by the representative value setting unit 11C, the luminance centroid calculation unit 11D, the filter calculation unit 11E, and the filter processing unit 11F are ultimately performed on all the cells CE.

[0141] This image processing device 10 can also perform control to adjust the actual brightness of the surrounding cells CE surrounding a certain cell when an image IM that is smaller than the size of the certain cell CE and has a higher brightness than the surrounding images moves in the inner area of ​​the certain cell CE. This allows the image processing device 10 to suppress the occurrence of flicker when an image IM that is smaller than the size of the certain cell CE and has a higher brightness than the surrounding images moves in the inner area of ​​the certain cell CE.

[0142] FIG. 17 is a diagram specifically illustrating an example of the internal configuration of the image processing device 10 of the present embodiment.

[0143] 17, the image processing device 10 of this embodiment differs from the image processing device 10 of the first embodiment in that it includes a luminance calculation memory M5 and a mono-cell representative value memory M40. Also, the image processing device 10 of this embodiment includes a representative value setting unit 11C, a luminance centroid calculation unit 11D, a filter calculation unit 11E, and a filter processing unit 11F instead of the distance calculation unit 11A and the first data calculation unit 11B. In this respect, the image processing device 10 of this embodiment differs from the image processing device 10 of the first embodiment.

[0144] The input image memory M1 is a memory that stores one frame's worth of input image data. The mono cell representative value memory M40 is a memory that stores one frame's worth of mono cells, i.e., representative values ​​(maximum values) of the luminance of a plurality of pixels PX facing the cell CE of the first panel WB. The mono cell drive value memory M3 is a memory that stores a plurality of mono cell drive values ​​calculated for a plurality of pixels PX for one frame.

[0145] The luminance centroid calculation memory M5 is a memory for calculating the luminance centroid of each cell CE for one frame. The luminance centroid calculation memory M5 stores five values ​​of the formulas (3) to (7) described below for each cell CE. The main cell drive value memory M4 is a memory for storing the calculated main cell drive values ​​for one frame, that is, the drive values ​​(luminance) of each pixel PX of the second panel CL.

[0146] FIG. 18 is a diagram for explaining a two-dimensional filter F of a mono cell (cell CE of the first panel WB) of the display device 1 of the comparative example.

[0147] As shown in Fig. 18, the two-dimensional filter used in the image processing device 10 of this embodiment is, for example, a 7x7 BLUR filter (without eccentricity). The two-dimensional filter F has filter coefficients corresponding to one central cell CE provided at the center position thereof and a plurality of, for example, 48 peripheral cells CE provided so as to surround the one central cell CE. The one central cell CE and the 48 peripheral cells CE are arranged in the form of a matrix aligned in each of the vertical direction V (Y direction) and the horizontal direction H (X direction).

[0148] 19 is a diagram for explaining the relationship between the center position CN and the luminance center of gravity LC of the central cell CE of the mono cell (first panel WB) of the display device 1 of the present embodiment. As shown in FIG. 19, the distance between the center position CN of the central cell CE and the luminance center of gravity LC in the central cell CE is D2.

[0149] The filter calculation unit 11E calculates the filter coefficients of the two-dimensional filter by performing correction to increase the filter coefficients of the low-pass filter for the multiple peripheral cells CE present on the side of the luminance center of gravity LC, using the representative position RP of the central cell CE as a reference. Note that the representative position RP is, for example, the center position of the cell CE, specifically, the position of the intersection of the diagonals of the rectangular central cell CE, that is, the center position CN.

[0150] On the other hand, the filter calculation unit 11E performs correction to reduce the filter coefficients of the low-pass filters for the multiple peripheral cells CE that exist on the opposite side to the luminance center of gravity LC with respect to the representative position RP of the central cell CE as a reference, thereby calculating the filter coefficients of the corrected two-dimensional filter.

[0151] Specifically, the filter calculation unit 11E corrects the coefficients of the low-pass filter so that the amount of change due to the correction of the coefficients of the low-pass filter increases as the distance D2 between the representative position RP of the central cell CE and the luminance center of gravity LC increases. As a result, the coefficients of the two-dimensional filter are calculated.

[0152] Fig. 20 is a diagram for explaining the filter process of the mono cell (first panel WB) of the display device 1 of the present embodiment. Fig. 20 shows the upper left peripheral cell matrix UPL, the upper center peripheral cell column UPM, the upper right peripheral cell matrix UPR, the center left peripheral cell row LEM, the center cell CE, the center right peripheral cell row RIM, the lower left peripheral cell matrix LOL, the lower center peripheral cell column LOM, and the lower right peripheral cell matrix LOR.

[0153] Therefore, the filter coefficients of the two-dimensional filter are corrected using the following filter coefficient correction factors Rh+, Rv+, Rh-, and Rv-. Note that, in the coordinate system specified by the H and V directions, the coordinate to the right of the center position in the X direction is expressed with a positive sign, and the coordinate below the center position in the Y direction is expressed with a positive sign.

[0154] The correction factor Rh+ is a value for correcting the filter coefficients located to the right (positive) of the center in the X direction. The correction factor Rh- is a value for correcting the filter coefficients located to the left (negative) of the center in the X direction. The correction factor Rv+ is a value for correcting the filter coefficients located below (positive) the center in the Y direction. The correction factor Rv- is a value for correcting the filter coefficients located above (negative) the center in the Y direction.

[0155] The correction factors Rh+, Rv+, Rh-, and Rv- are calculated by the following formulas.

[0156] (Calculation formula) Correction factor Rh+, Rv+, Rh-, Rv-=(sign) constant C x distance D2 It is to be noted that C is a predetermined value. As described above, the distance D2 is the distance between the center position CN of the center cell CE and the luminance center of gravity LC within the center cell CE.

[0157] Therefore, the greater the distance D2 between the center position CN of the center cell CE and the luminance center of gravity LC, the greater the absolute value of the correction rate of the filter coefficient, and the smaller the distance D2 between the center position CN of the center cell CE and the luminance center of gravity LC, the smaller the absolute value of the correction rate of the filter coefficient. Also, the filter coefficient of the center cell CE is not affected by the position of the luminance center of gravity of the peripheral cells CE.

[0158] The filter calculation unit 11E determines the sign in the calculation formula for the correction factor according to the relationship between the position of the luminance centroid LC of the central cell CE and the central position CN of the central cell CE as follows.

[0159] When the luminance center of gravity LC of the center cell CE is located in the positive direction from the center position CN of the center cell CE in the X direction, the filter calculation unit 11E sets the sign of Rh+ to + and the sign of Rh- to -. When the luminance center of gravity LC of the center cell CE is located in the negative direction from the center position CN of the center cell CE in the X direction, the filter calculation unit 11E sets the sign of Rh+ to - and the sign of Rh- to +.

[0160] When the luminance center of gravity LC of the center cell CE is located in the positive direction from the center position CN of the center cell CE in the Y direction, the filter calculation unit 11E sets the sign of Rv+ to + and the sign of Rv- to -. When the luminance center of gravity LC of the center cell CE is located in the negative direction from the center position CN of the center cell CE in the Y direction, the filter calculation unit 11E sets the sign of Rv+ to - and the sign of Rv- to +.

[0161] In the upper left peripheral cell matrix UPL, the corrected filter coefficients are calculated by adding Rh- and Rv- to the filter coefficients before correction. In the upper center peripheral cell column UPM, the corrected filter coefficients are calculated by adding Rv- to the filter coefficients before correction. In the upper right peripheral cell matrix UPR, the corrected filter coefficients are calculated by adding Rh+ and Rv- to the filter coefficients before correction.

[0162] In the left center peripheral cell row LEM, the calculation is performed by adding Rh- to the filter coefficients before correction, and in the right center peripheral cell row RIM, the calculation is performed by adding Rh+ to the filter coefficients before correction.

[0163] In the lower left peripheral cell matrix LOL, the corrected filter coefficients are calculated by adding Rh- and Rv+ to the filter coefficients before correction. In the lower center peripheral cell matrix LOM, the corrected filter coefficients are calculated by adding Rv+ to the filter coefficients before correction. In the lower right peripheral cell matrix LOR, the corrected filter coefficients are calculated by adding Rh+ and Rv+ to the filter coefficients before correction.

[0164] On the other hand, in the center cell CE, the filter coefficients are not corrected.

[0165] The above-mentioned filter processing is executed for each of a plurality of cells CE. For example, when there are 16×9=144 cells CE, the filter calculation and filter processing using the “corrected 7×7 BLUR filter” are executed 144 times.

[0166] Fig. 21 is a diagram for explaining the relationship between a central cell CE, peripheral cells CE, a first cell, and a second cell of a two-dimensional filter F having, for example, five rows and five columns, in the display device 1 of this embodiment. Fig. 21 shows the two-dimensional filter in correspondence with the cells CE.

[0167] In the two-dimensional filter F shown in Fig. 21, the cell located at the center is the central cell. The 24 cells other than the central cell are peripheral cells. Fig. 21 also shows a case where the cell immediately to the upper left of the central cell is the first cell. The 24 cells other than the first cell are second cells. Thus, in the two-dimensional filter F, each cell has two attributes: an attribute indicating whether it is a central cell or a peripheral cell, and an attribute indicating whether it is a first cell or a second cell.

[0168] Also, as shown in FIG. 21 , the two-dimensional filter F includes a region L located to the upper left of the diagonal K drawn from the upper right to the lower left of the two-dimensional filter F, and a region S located to the lower right of the diagonal K, with the diagonal K being the boundary line.

[0169] Incidentally, the position of the luminance center of gravity LC of the central cell CE of the two-dimensional filter F is located diagonally downward to the right from the center position CN (representative position RP) of the central cell CE. Therefore, the correction factors are Rh+>0, Rv+>0, Rh-<0, and Rv-<0. Due to these correction factors, the two-dimensional filter F is generally corrected so that the filter coefficients located on the upper left side, i.e., in area L, become smaller, and the filter coefficients located on the lower right side, i.e., in area S, become larger.

[0170] In other words, in the two-dimensional filter F shown in Figure 21, the filter coefficient of region L on the opposite side to the side where the luminance center of gravity LC of the central cell CE is shifted from the central position CN of the central cell CE is made smaller, and the filter coefficient of region S on the side where the luminance center of gravity LC of the central cell CE is shifted from the central position CN of the central cell CE is made larger.

[0171] 22 is a diagram showing an example of filter coefficients before correction of a low-pass filter as an example of a two-dimensional filter F used in the image processing device 10 of the display device 1 of the present embodiment. This 5×5 two-dimensional filter F before correction is a Gaussian filter, an example of a low-pass filter. Moreover, this 5×5 two-dimensional filter F before correction is designed so that the sum of all filter coefficients becomes 1.

[0172] 22, two-dimensional filter F has filter coefficients that are symmetrical both left-right and top-bottom. In two-dimensional filter F, the filter coefficients have the largest value in a central cell CE, and become smaller going outward from the central cell CE.

[0173] FIG. 23 is a diagram showing an example of the coordinates of the luminance centroid LC used in the image processing device 10 of the display device 1 of this embodiment.

[0174] As shown in FIG. 23, the coordinates of the luminance center of gravity LC are, for example, 2.5 in the X-axis direction, that is, the H direction, and 2 in the Y-axis direction, that is, the V direction.

[0175] There is an area containing n pixels PX. Let the x-coordinate of the i-th pixel PX be x i Let the y coordinate of the i-th pixel PX be y i Let the brightness (tone value) of the i-th pixel PX be G i In addition, the x-coordinate of the luminance center is c x Let the y coordinate of the luminance center be c y Then, c x and c y is calculated using the following equations (1) and (2).

[0176]

number

[0177]

number

[0178] FIG. 24 is a diagram showing an example of the constant C of the calculation used in the image processing device 10 of the display device 1 of the present embodiment.

[0179] As shown in FIG. 24, the constant C is set to 0.0005.

[0180] Fig. 25 is a diagram showing an example of correction rates of filter correction coefficients used in the image processing device 10 of the display device 1 of the present embodiment. These correction rates are values ​​calculated using the luminance centroid position shown in Fig. 23 and the constant C shown in Fig. 24. As shown in Fig. 25, the correction rates of the filter coefficients are Rh+>0, Rv+>0, Rh-<0, and Rv-<0.

[0181] FIG. 26 is a diagram showing an example of the corrected filter coefficients of the two-dimensional filter F used in the image processing device 10 of the display device 1 of the present embodiment.

[0182] Comparing the filter coefficients after correction shown in Fig. 26 with the filter coefficients before correction shown in Fig. 22, it can be seen that the filter coefficients of the central cell CE are unchanged, but each of the multiple peripheral cells CE is changed according to the correction rate. Specifically, in the filter after correction in Fig. 26, the filter coefficient at the bottom right of the matrix is ​​larger than that of the filter before correction in Fig. 22, and the filter coefficient at the top left of the matrix is ​​smaller.

[0183] FIG. 27 is a flowchart for explaining a process executed by an example of the image processing device 10 according to the present embodiment.

[0184] In step S51, the image processing device 10 reads input image data of one frame from an external device. In step S52, the image processing device 10 sets the first pixel PX to be calculated in the input image data. For example, the image processing device 10 sets the leftmost and uppermost pixel PX of the input image data as the first pixel to be calculated. In step S53, the representative value setting unit 11C compares the previous provisional representative value of the mono cell (cell CE) including the pixel PX to be calculated in its region with the gradation value of the pixel PX to be calculated. If the gradation value of the pixel PX to be calculated is greater than the previous provisional representative value of the mono cell (cell CE) including the pixel PX to be calculated in its region, the representative value setting unit 11C stores the gradation value of the pixel PX to be calculated in the mono cell representative value memory M40 as a new provisional representative value of the mono cell. Note that when the process of step S53 is performed for all pixels PX included in the input image data of one frame, the maximum gradation value among the pixels PX included in the region of the mono cell is selected as the representative value for each mono cell.

[0185] In step S54, the luminance centroid calculation unit 11D performs calculations to calculate the luminance centroid LC. More specifically, the luminance centroid calculation unit 11D calculates values ​​related to the above-mentioned formulas (3) to (5) for the calculation target pixel PX. As a result, the luminance centroid calculation unit 11D calculates the ct x , ct y and cb x (=cb y ) is added to the value of the above-mentioned formulas (3) to (5). When the process of step S54 is performed for all pixels PX included in the input image data of one frame, ct x , ct y and cb x (=cb y ) is calculated.

[0186] In step S55, the image processing apparatus 10 determines whether or not the calculations in steps S53 and S54 have been completed for all pixels PX included in the input image data.

[0187] In step S55, it may not be determined that the calculations in steps S53 and S54 have been completed for all pixels PX included in the input image data. In this case, in step S56, the image processing device 10 changes the pixel PX to be calculated in the input image data to the next pixel PX, and repeats steps S53 to S55.

[0188] On the other hand, if it is determined in step S55 that the calculations in steps S53 and S54 for all pixels PX included in the input image data have been completed, then in step S57, the luminance centroid calculation unit 11D calculates the luminance centroid LC. The calculation method for the luminance centroid LC is as described above. That is, the luminance centroid LC is calculated by performing the calculations of equations (6) and (7). The luminance centroid calculation unit 11D stores the calculated value of the luminance centroid LC in the luminance centroid calculation memory M5.

[0189] Next, in step S58, the filter calculation unit 11E uses the value of the luminance center of gravity LC to calculate a correction factor for the filter coefficients of the two-dimensional filter F, and uses the calculated correction factor to correct the filter coefficients of the two-dimensional filter F. After that, in step S59, the filter processing unit 11F performs filtering on each mono cell (cell CE) using the corrected filter coefficients of the two-dimensional filter.

[0190] Fig. 28 is a diagram showing the change in aperture ratio of the cells CE of the first panel WB in response to a change in the input image data IM displayed by the display device 1 of the present embodiment. Note that the input image data IM is the same as that shown in Fig. 13(a), and is therefore omitted from the illustration. As shown in Fig. 13(a), the input image data IM has a high luminance area BA (e.g., an area including a plurality of pixels with a gradation value of 255) in a background of low gradation (e.g., gradation value 0). The high luminance area BA moves to the right as time passes.

[0191] 28(a) to 28(d) are diagrams showing the aperture ratios of a plurality of cells CE of the first panel WB corresponding to the input image data IM in grayscale shading. In FIG. 28(a) to FIG. 28(d), the grayscale shading means that the darker the cell CE, the smaller the aperture ratio, and the lighter the cell CE, the larger the aperture ratio. In FIG. 28(a) to FIG. 28(d), the high luminance area BA is also drawn superimposed on the cell CE. In FIG. 28(a) to FIG. 28(d), the high luminance area BA is drawn in black for easy viewing. The position of the high luminance area BA moves to the right from FIG. 28(a) to FIG. 28(d). As shown in FIG. 28(a) to FIG. 28(d), according to the image processing device 10 of this embodiment, as in the image processing device 10 of the first embodiment, when the high luminance area BA moves within the area of ​​the cell CE, the aperture ratio of the cells CE located around it changes accordingly. In addition, when the high brightness area BA moves across multiple cells CE, the aperture ratio of each cell CE also changes. Thus, according to the image processing device 10 of this embodiment, the aperture ratio of each cell CE changes continuously both when the high brightness area BA in the input image data IM moves within a certain cell CE and when it moves across multiple cells CE. Therefore, it is possible to suppress flicker.

[0192] Fig. 29 is a diagram showing an example of the input image data IM displayed by the display device 1 of the present embodiment and the aperture ratio of the cell CE of the first panel WB. Fig. 29 shows a situation in which multiple high luminance areas BA exist in an area of ​​one cell CE.

[0193] As shown in Fig. 29, in the image processing device 10 of this embodiment, even if multiple high luminance areas BA exist in an area of ​​one cell CE, the luminance of the surrounding cell CE is determined without being influenced by the multiple high luminance areas BA. In the image processing device 10 of this embodiment, when multiple high luminance areas BA exist in an area of ​​one cell CE, one luminance center of gravity LC that reflects the influence of the luminance of the multiple high luminance areas BA is calculated. As can be seen from Fig. 29, the display of the image processing device 10 of this embodiment is different from the display of the image processing device 10 of embodiment 1 when the luminance center of gravity LC exists at the center position of the central cell CE.

[0194] (Embodiment 3) The image processing device 10 of the third embodiment will be described with reference to Figs. 30 to 32. Note that, in the following, description of the same points as those of the image processing device 10 of the first or second embodiment will not be repeated. The image processing device 10 of the present embodiment differs from the image processing device 10 of the first or second embodiment in the following points.

[0195] FIG. 30 is a block diagram showing the overall configuration of a display device 1 according to the present embodiment.

[0196] In this embodiment, the backlight BL has a plurality of light emitting regions LER whose respective light emission amounts can be adjusted independently. That is, in this embodiment, the image processing device 10 executes local dimming. The image processing device 10 of this embodiment includes a backlight data generating unit 13 and a first panel luminance distribution calculating unit 14. Moreover, the image processing device 10 of this embodiment includes a second data generating unit 22 instead of the second data generating unit 12.

[0197] The backlight data generating unit 13 generates backlight data for controlling the amount of light emitted by each of the light emitting regions LER based on the input image data. The first panel luminance distribution calculating unit 14 calculates the luminance distribution (mono-cell luminance distribution data) at the position of the second panel CL for the light traveling from the first panel WB to the second panel CL based on the backlight data and the first data. The second data generating unit 22 generates the second data based on the input image data and the mono-cell luminance distribution data.

[0198] Image processing device 10 of this embodiment differs from image processing device 10 of embodiments 1 and 2 in that it generates backlight data for controlling the output of multiple light emitting regions LER based on input image data. The backlight data is data corresponding to a resolution of 6×4. Backlight data generator 13 generates output values ​​(for example, lighting rate=actual luminance value / maximum luminance value) of each of multiple light emitting regions LER constituting the backlight BL from the input image data.

[0199] As an example, the backlight data generating unit (backlight luminance distribution calculating unit) 13 obtains a representative value of input gradation values ​​of several picture elements PE included in one virtual area facing one certain light emitting area LER, i.e., several sub-pixels. The representative value is, for example, the maximum value, average value, median value, or 80% of the maximum value of the input gradation values ​​of several picture elements PE included in one virtual area facing one certain light emitting area LER.

[0200] Then, the backlight data generation unit 13 generates a value obtained by dividing a representative value of the input grayscale values ​​of some picture elements PE in that one virtual area by an upper limit value of the input grayscale values ​​as an output value of that one light emitting area LER. The upper limit value of the input grayscale values ​​is the maximum value of the input grayscale values. The backlight data generation unit 13 outputs the output value of each light emitting area LER thus obtained as data for controlling the backlight (backlight data). The backlight drive unit 40 controls the output of each light emitting area LER of the backlight BL according to the backlight data.

[0201] The first panel luminance distribution calculation unit (mono cell luminance distribution calculation unit) 14 calculates mono cell luminance distribution data using the backlight data and the first data. The mono cell luminance distribution data is a luminance distribution at the position of the second panel CL for light that is emitted from each light emitting region LER of the backlight BL, passes through each cell CE of the first panel, and travels toward each picture element PE of the second panel CL. The first panel luminance distribution calculation unit 14 may calculate the mono cell luminance distribution data using a PSF (Point Spread Function) for calculating the distribution of luminance of light traveling from the light emitting region LER included in the backlight BL to the cell CE included in the first panel WB. The first panel luminance distribution calculation unit 14 may also calculate the mono cell luminance distribution data using a PSF (Point Spread Function) for calculating the distribution of luminance of light traveling from the cell CE included in the first panel WB to the picture element PE included in the second panel CL.

[0202] The second data generating unit (main cell driving value calculating unit) 22 generates second data for controlling the aperture ratio of the plurality of picture elements PE by correcting the input image data based on the input image data and the mono cell luminance distribution data. This second data is generated so as to compensate for the lack of luminance caused by adjusting the amount of light traveling from the backlight BL to each picture element PE by controlling the luminance of each light emitting region LER of the backlight BL and controlling the aperture ratio of each cell CE of the first panel. Thereafter, the second data generating unit 12 transmits the second data to the second panel driving unit 30.

[0203] In the first embodiment, the second data generating unit 12 also generates mono cell luminance distribution data. In contrast to this, in the present embodiment, in order to calculate the mono cell luminance distribution data, it is necessary to use backlight data in addition to the first data. Therefore, the image processing device 10 of the present embodiment has a first panel luminance distribution calculation unit 14 in addition to the second data generating unit 22. However, the configuration of the execution part of the process in the image processing device 10 can be appropriately selected. For example, the image processing device 10 of the present embodiment may not have the first panel luminance distribution calculation unit 14, and the second data generating unit 12 may generate the mono cell luminance distribution data. Conversely, the image processing device 10 of the first embodiment may have a processing unit that calculates the mono cell luminance distribution data in addition to the second data generating unit 12.

[0204] FIG. 31 is a diagram specifically showing the internal configuration of the image processing device 10 of this embodiment.

[0205] 31, image processing device 10 of the present embodiment includes backlight data memory M6, a backlight data generation unit (backlight luminance distribution calculation unit) 13, and a first panel luminance distribution calculation unit (mono-cell luminance distribution calculation unit) 14. Image processing device 10 of the present embodiment also includes second data generation unit 22 instead of second data generation unit 12. In these respects, image processing device 10 of the present embodiment differs from image processing device 10 of embodiment 1 or 2.

[0206] FIG. 32 is a flowchart for explaining the process executed by the image processing device 10 of the present embodiment.

[0207] As shown in FIG. 32, the image processing device 10 of the present embodiment differs from the image processing device 10 of the first and second embodiments in that it includes steps S71 to S74.

[0208] In step S71, the backlight data generating unit (backlight luminance distribution calculating unit) 13 calculates backlight data, which is control data for each light emitting region LER of the backlight BL, based on the input image data read in step S1. In step S72, the first panel luminance distribution calculating unit (mono-cell luminance distribution calculating unit) 14 calculates mono-cell luminance distribution data. In step S73, the backlight driving unit 40 drives the backlight BL based on the backlight data calculated in step S71.

[0209] Even when the backlight BL executes local dimming as in the image processing device 10 of this embodiment, the same effect as that obtained by the image processing device 10 of other embodiments can be obtained. That is, in both cases where the high brightness area BA in the input image data IM moves within a certain cell CE and where it moves across multiple cells CE, the aperture ratio of each cell CE changes continuously. Therefore, flicker can be suppressed.

[0210] (Embodiment 4) The image processing device of the third embodiment will be described with reference to Fig. 33. Note that, in the following, description of the same points as those of the image processing device of the first to third embodiments will not be repeated. The image processing device of the present embodiment differs from the image processing device of the first to third embodiments in the following points.

[0211] FIG. 33 is a diagram showing a cell CE of the display device 1 according to the fourth embodiment.

[0212] As shown in Fig. 33, in a front view of the display panel unit 100 of the display device 1 of the present embodiment, the shape of each of the first cell CE and the second cells CE is different from the shape of each of the first pixels PX and the second pixels PX. For example, when the shape of each of the pixels PX in a front view is rectangular or square, the shape of the cell CE may be a hexagon or a mixture of an octagon and a rectangle. With such an image processing device 10 of the display device 1 of the present embodiment, it is possible to obtain the same effect as that obtained with the image processing device 10 of the display device 1 of the first to third embodiments.

[0213] (Embodiment 5) The image processing device of the third embodiment will be described with reference to Fig. 34 and Fig. 35. Note that, in the following, description of the same points as those of the image processing device of the first to fourth embodiments will not be repeated. The image processing device of this embodiment differs from the image processing device of the first to fourth embodiments in the following points.

[0214] FIG. 34 is a diagram showing a cell CE of the display device 1 of the present embodiment.

[0215] 34, in a front view of the display panel unit 100 of the display device 1 of the present embodiment, a part of one of the first cell CE and the multiple second cells CE and a part of an adjacent cell CE adjacent to the one cell CE are mixed in a common region CR. With the image processing device 10 of the display device 1 of the present embodiment, it is possible to obtain the same effects as those obtained with the image processing device 10 of the display device 1 of the first to fourth embodiments.

[0216] FIG. 35 is a diagram showing a specific example of the cell CE of the display device 1 of the present embodiment.

[0217] 35, adjacent cells CE have a common region CR. In the common region CR, the first electrode E1 of the first cell CE and the second electrode E2 of the second cell CE are mixed.

[0218] The luminance of a common region CR where two adjacent cells CE overlap is changed by combining the control of the transmittance of each of the two adjacent cells CE. Details of this configuration and control are disclosed in US2021 / 0304686.

[0219] Even in the display device 1 employing a plurality of cells CE having such a relationship, it is possible to obtain the same effects as those obtained by the display devices 1 according to the first to fourth embodiments described above.

[0220] The image processing device and the control method of the image processing device of each of the above-mentioned embodiments may be combined as long as they are not mutually inconsistent. For example, the process using a line memory for calculating mono-cell data, which is described as the second example of the image processing device 10 of the first embodiment, may be combined with the image processing device described as the third or fourth embodiment. The image processing device 10 and the image processing method of the other embodiments may also be combined as long as they are not mutually inconsistent. [Explanation of symbols]

[0221] 1 Display device 10 Image processing device 100 Display panel unit 11 First data generation unit 12 Second data generation unit CE Cell CL 2nd Panel CR common area D1,D2 distance PX pixels WB 1st Panel

Claims

1. Backlight and a first panel facing the backlight and capable of controlling an amount of light transmission at a first resolution; a second panel facing the first panel and capable of controlling an amount of light transmission at a second resolution higher than the first resolution; An image processing device that displays an image on a display panel unit comprising: the first panel includes a first cell and a plurality of second cells surrounding the first cell; the second panel includes a plurality of first pixels facing the first cells and a plurality of second pixels facing the second cells; The image processing device includes: a first data generating unit that generates first data for controlling the first panel based on input image data; a second data generating unit that generates second data for controlling the second panel based on the input image data and the first data, The first data generating unit generates the first data for the first cell based on input luminances of the first pixels specified by the input image data, and input luminances and positions of the second pixels specified by the input image data. Image processing device.

2. The first data generating unit generates the first data so as to suppress occurrence of flicker. The image processing device according to claim 1 .

3. The first data generating unit generates the first data for the first cell based on distances between a predetermined position inside the first cell and specific positions inside each of the plurality of second pixels and input luminance of the plurality of second pixels. The image processing device according to claim 1 .

4. the first data generation unit generates the first data such that an influence of an input luminance of a second pixel, which is relatively far from the plurality of second pixels, on a luminance of the first cell is smaller than an influence of an input luminance of a second pixel, which is relatively far from the plurality of second pixels, on a luminance of the first cell. The image processing device according to claim 3 .

5. the first data generating unit generates the first data such that an influence of the input luminance of a second pixel having a relatively large input luminance among the plurality of second pixels on a luminance of the first cell is greater than an influence of the input luminance of a second pixel having a relatively small input luminance among the plurality of second pixels on a luminance of the first cell. The image processing device according to claim 4.

6. The first data generation unit is a representative value setting unit that sets a representative value of each of the second cells based on input luminance of the second pixels at positions facing each of the second cells; a luminance centroid calculation unit that calculates a luminance centroid of each of the second cells based on input luminance and positions of the second pixels; a filter calculation unit that calculates, for each of the second cells, coefficients of a two-dimensional filter for peripheral cells surrounding a central cell to include the first cell when one of the second cells is set as a central cell based on the luminance centroid; and a filter processing unit that generates the first data for the first cell by performing a filter process on the peripheral cells of each of the second cells using a coefficient of the two-dimensional filter, with the representative value being an input luminance of the center cell of the two-dimensional filter; Equipped with The image processing device according to claim 1 .

7. The filter calculation unit a correction is performed to increase the filter coefficients of the two-dimensional filter for the plurality of peripheral cells that are present on the side of the luminance center of gravity relative to the representative position of the central cell, thereby calculating the filter coefficients of the two-dimensional filter; a correction is performed to reduce the filter coefficients of the two-dimensional filter for the plurality of peripheral cells that are present on the opposite side of the luminance center of gravity from the representative position of the central cell, thereby calculating the coefficients of the two-dimensional filter. The image processing device according to claim 6.

8. the filter calculation unit calculates a corrected filter coefficient of the two-dimensional filter by correcting the filter coefficient such that a change amount due to the correction of the filter coefficient increases as a distance between the representative position of the central cell and the luminance center of gravity increases. The image processing device according to claim 7.

9. The two-dimensional filter is a low-pass filter. The image processing device according to any one of claims 6 to 8.

10. The backlight has a plurality of light-emitting regions whose light emission amount can be adjusted, a backlight data generation unit that generates backlight data for controlling the amount of light emitted by each of the plurality of light emitting regions based on the input image data; a first panel luminance distribution calculation unit that calculates a luminance distribution at a position of the second panel for light traveling from the first panel to the second panel based on the backlight data and the first data; Equipped with The second data generating unit generates the second data based on the input image data and the luminance distribution. The image processing device according to any one of claims 1 to 8.

11. When viewed from the front of the display panel unit, the first cell and the second cells have different shapes from the first pixels and the second pixels. The image processing device according to any one of claims 1 to 8.

12. When viewed from the front of the display panel unit, a part of one of the first cell and the plurality of second cells and a part of an adjacent cell adjacent to the one cell are mixed in a common area. The image processing device according to any one of claims 1 to 8.

13. The first panel is a liquid crystal panel. The image processing device according to any one of claims 1 to 8.

14. The second panel is a liquid crystal panel. The image processing device according to any one of claims 1 to 8.

15. A display device comprising the display panel unit and the image processing device according to any one of claims 1 to 8.

16. Backlight and a first panel facing the backlight and capable of controlling an amount of light transmission at a first resolution; a second panel facing the first panel and capable of controlling an amount of light transmission at a second resolution higher than the first resolution; Equipped with the first panel includes a first cell and a plurality of second cells surrounding the first cell; a control method for an image processing device for displaying an image on a display panel unit including a plurality of first pixels positioned opposite the first cells and a plurality of second pixels positioned opposite the second cells, the method comprising: The method for controlling the image processing device includes: generating first data for controlling the first panel based on input image data; generating second data for controlling the second panel based on the input image data and the first data; In the step of generating the first data, the first data for the first cell is generated based on input luminances of the first pixels specified by the input image data, and input luminances and positions of the second pixels specified by the input image data. A method for controlling an image processing device.

Citation Information

Patent Citations

  • Liquid crystal display device drive method, liquid crystal display device, and television receiver

    WO2007040139A1