Display device

Abstract

To provide a display device that can achieve both various handling in accordance with the position where a user views an image and an effect of increasing the contrast of the image further.SOLUTION: A display device includes a first panel, a second panel, a light source that emits light from the other surface side of the first panel, and an acquisition unit that acquires user's information including information expressing a position of a user's eye (right eye Ea, left eye Eb) for the display device. The first panel includes a plurality of light control pixels 148. The second panel includes a plurality of pixels 48. A blurring process to make the light control pixels 148 transmit light is performed. The light control pixels 148 exist in the periphery of the pixels 48 that are controlled to transmit light in accordance with an input image signal. The range (blurring range De) including the light control pixels 148 to which the blurring process is applied in the first panel is in accordance with the user's eye position.SELECTED DRAWING: Figure 13

Description

[Technical field]

[0001] The present disclosure relates to a display device. [Background technology]

[0002] A configuration is known in which a light control panel is provided between a liquid crystal display panel and a light source to further increase the contrast of an image (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2019 / 225137 Summary of the Invention [Problem to be solved by the invention]

[0004] By making the range through which the light-adjusting panel transmits light wider than the range of pixels controlled to transmit light in the liquid crystal display panel, the image can be viewed with good image quality regardless of the position from which the user views the image, such as an oblique viewpoint. On the other hand, simply expanding the range through which the light-adjusting panel transmits light makes it difficult to fully achieve the effect of further enhancing the contrast of the image. Therefore, a mechanism has been required to achieve both a wider range of response to the position from which the user views the image and the effect of further enhancing the contrast of the image.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a display device that can simultaneously accommodate a wider variety of positions from which a user views an image and further enhance the contrast of the image. [Means for solving the problem]

[0006] A display device according to one embodiment of the present disclosure comprises a first panel, a second panel arranged to face the first panel on one side of the first panel, a light source that irradiates light from the other side of the first panel, and an acquisition unit that acquires user information including information indicating at least one of the position of a user's eyes facing the second panel on one side of the second panel and the position of the user's head, wherein the first panel comprises a plurality of dimming pixels, the second panel comprises a plurality of pixels, and a blurring process is applied to the dimming pixels located around a pixel that is controlled to transmit light according to an input image signal, causing the dimming pixels to transmit light, and a blurring range that includes the dimming pixels to which the blurring process is applied on the first panel corresponds to the position of the user's eyes or the position of the user's head. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of a main configuration of a display device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing the positional relationship between the display panel, the light control panel, and the light source device. [Diagram 3] FIG. 3 is a diagram showing an example of a pixel arrangement of an image display panel. [Figure 4] FIG. 4 is a cross-sectional view showing an example of a schematic cross-sectional structure of an image display panel. [Diagram 5] FIG. 5 is a diagram showing the principle of occurrence of double images and image chipping and examples thereof. [Figure 6] FIG. 6 is a graph showing an example of the relationship between the distance from a dimming pixel that shares an optical axis with a pixel that is controlled to transmit light at the highest gradation, and the degree to which light is controlled to be transmitted by a blurring process. [Figure 7] FIG. 7 is a diagram showing an example of a display output content based on an input signal to the display device. [Figure 8] FIG. 8 is a diagram showing a light transmission range of a light control panel to which blurring processing is applied based on the display output content shown in FIG. [Figure 9] FIG. 9 is a block diagram illustrating an example of a functional configuration of the signal processing unit. [Figure 10] FIG. 10 is a schematic diagram showing the blurring range required when the position of the user's eyes relative to the display panel is unknown. [Figure 11] FIG. 11 is a schematic diagram showing the blurring range required when the position of the user's eyes relative to the display panel is clear. [Figure 12] FIG. 12 is a schematic diagram showing the blurring range required when the position of the user's eyes relative to the display panel is clear. [Figure 13] FIG. 13 is a diagram showing the maximum angle that the user's line of sight can form when it is assumed that the user's eyes can move within the maximum movable range Dmax in the X direction. [Figure 14] FIG. 14 is a diagram showing an example of the reference axis angle with respect to the display area when the user's face is positioned diagonally in the X direction with respect to the display area. [Figure 15] FIG. 15 is a diagram showing the angle between the line of sight from one eye and the Z axis to the other end in the X direction of the display area when the user's face is in the position shown in FIG. 14, and the angle between the line of sight from the other eye and the Z axis to the other end. [Figure 16] FIG. 16 is a diagram showing the concept of deriving the blur range based on the Y-direction positions of the user's face and eyes relative to the display area. [Figure 17] FIG. 17 is a schematic diagram showing an example of the arrangement of a display panel and an imaging section. [Figure 18] FIG. 18 is a schematic diagram showing a mechanism for recognition processing of a user's face captured within the imaging range of an image captured by an imaging section. [Figure 19] FIG. 19 is a schematic diagram showing an example of a blur range derived in response to the position of the user's eyes relative to the display panel. [Figure 20] FIG. 20 is a flowchart showing an example of a process flow for applying the blur range and performing display output. [Figure 21] FIG. 21 is a diagram showing a display device 1 in which a distance measuring section is further provided in addition to the configuration shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, each embodiment of the present disclosure will be described with reference to the drawings. Note that the disclosure is merely an example, and those who are skilled in the art can easily come up with appropriate modifications while maintaining the gist of the invention are naturally included in the scope of the present disclosure. In addition, in order to make the explanation clearer, the drawings may be schematic in terms of the width, thickness, shape, etc. of each part compared to the actual embodiment, but they are merely examples and do not limit the interpretation of the present disclosure. In addition, in this specification and each figure, elements similar to those described above with respect to the previous figures may be given the same reference numerals, and detailed explanations may be omitted as appropriate.

[0009] (Embodiment 1) FIG. 1 is a diagram showing an example of a main configuration of a display device 1 of the first embodiment. The display device 1 of the first embodiment includes a signal processing unit 10, a display unit 20, a light source device 50, a light source control circuit 60, a dimming unit 70, and an imaging unit 90. The signal processing unit 10 performs various outputs based on an input signal IP input from an external control device 2, and controls the operations of the display unit 20, the light source device 50, and the dimming unit 70. The input signal IP is a signal that functions as data for displaying and outputting an image on the display device 1, and is, for example, an RGB image signal. The input signal IP corresponds to the resolution of the display panel 30. That is, the input signal IP includes pixel signals corresponding to the number of pixels 48 of the display panel 30 described later and the arrangement in the X direction and the Y direction. The signal processing unit 10 outputs an output image signal OP generated based on the input signal IP to the display unit 20. The signal processing unit 10 also outputs a dimming signal DI generated based on the input signal IP to the dimming unit 70. Furthermore, when the input signal IP is input, the signal processing unit 10 outputs a light source drive signal BL for controlling the lighting of the light source device 50 to the light source control circuit 60. The light source control circuit 60 is, for example, a driver circuit for the light source device 50, and operates the light source device 50 in response to the light source drive signal BL. The light source device 50 has a light source that emits light from a light emitting area LA. In the first embodiment, the light source control circuit 60 operates the light source device 50 so that a constant amount of light is irradiated from the light emitting area LA of the light source device 50 in response to the display timing of a frame image.

[0010] The display unit 20 includes a display panel 30 and a display panel drive unit 40. The display panel 30 includes a display area OA in which a plurality of pixels 48 are provided. The plurality of pixels 48 are arranged, for example, in a matrix. The display panel 30 of the first embodiment is a liquid crystal image display panel. The display panel drive unit 40 includes a signal output circuit 41 and a scanning circuit 42. The signal output circuit 41 is a circuit that functions as a so-called source driver, and drives the plurality of pixels 48 in response to an output image signal OP. The scanning circuit 42 is a circuit that functions as a so-called gate driver, and outputs a drive signal that scans the plurality of pixels 48 arranged in a matrix in units of a predetermined row (for example, one row). The pixels 48 are driven to output a gradation value according to the output image signal OP at the timing when the drive signal is output.

[0011] The dimming unit 70 adjusts the amount of light emitted from the light source device 50 and output through the display area OA. The dimming unit 70 has a dimming panel 80 and a dimming panel drive unit 140. The dimming panel 80 has a dimming area DA that is provided so as to be able to change the light transmittance. The dimming area DA is disposed at a position superimposed on the display area OA from a planar viewpoint. The dimming area DA covers the entire display area OA from a planar viewpoint. The light-emitting area LA covers the entire display area OA and the entire dimming area DA from a planar viewpoint. The planar viewpoint is a viewpoint from the front of the XY plane.

[0012] FIG. 2 is a diagram showing the positional relationship between the display panel 30, the light control panel 80, and the light source device 50. In the first embodiment, as illustrated in FIG. 2, the display panel 30, the light control panel 80, and the light source device 50 are stacked. Specifically, the light control panel 80 is stacked on the irradiation surface side where the light is output from the light source device 50. In addition, the display panel 30 is stacked on the opposite side of the light source device 50 with the light control panel 80 sandwiched therebetween. The light irradiated from the light source device 50 is adjusted in amount in the light control area DA of the light control panel 80 to illuminate the display panel 30. The display panel 30 is illuminated from the back side where the light source device 50 is located, and displays and outputs an image on the opposite side (display surface side). In this way, the light source device 50 functions as a backlight that illuminates the display area OA of the display panel 30 from the back. In addition, in the first embodiment, the light control panel 80 is provided between the display panel 30 and the light source device 50. Hereinafter, the direction in which the display panel 30, the light control panel 80, and the light source device 50 are stacked is referred to as the Z direction. Moreover, the two directions perpendicular to the Z direction are the X direction and the Y direction. The X direction and the Y direction are perpendicular to each other. A plurality of pixels 48 are arranged in a matrix along the X direction and the Y direction. Specifically, the number of pixels 48 arranged in the X direction is h, and the number of pixels 48 arranged in the Y direction is v. h and v are natural numbers greater than or equal to 2.

[0013] A first polarizer P1 is provided on the rear side of the light control panel 80. A second polarizer P2 is provided on the display surface side of the light control panel 80. A third polarizer P3 is provided on the rear side of the display panel 30. A fourth polarizer P4 is provided on the display surface side of the display panel 30. A diffusion layer P5 is provided between the second polarizer P2 and the third polarizer P3. Each of the first polarizer P1, the second polarizer P2, the third polarizer P3, and the fourth polarizer P4 passes polarized light in a specific direction and does not pass polarized light in other directions. The polarization direction of the polarized light passed by the first polarizer P1 is orthogonal to the polarization direction of the polarized light passed by the second polarizer P2. The polarization direction of the polarized light passed by the second polarizer P2 is the same as the polarization direction of the polarized light passed by the third polarizer P3. The direction of polarization of the polarized light that the third polarizer P3 passes through is orthogonal to the direction of polarization of the polarized light that the fourth polarizer P4 passes through. The diffusion layer P5 diffuses the incident light and emits it. Since the polarized light of the second polarizer P2 and the third polarizer P3 has the same direction of polarization, one of them may be omitted. An improvement in transmittance can be expected. When both the second polarizer P2 and the third polarizer P3 are provided, the contrast can be improved compared to the case where only one of them is provided. In addition, when either the second polarizer P2 or the third polarizer P3 is omitted, it is preferable to omit the second polarizer P2 from the viewpoint of expecting the effect of improving the contrast by limiting the polarized light direction diffused by the diffusion layer P5 with the third polarizer P3.

[0014] FIG. 3 is a diagram showing an example of a pixel arrangement of the display panel 30. As illustrated in FIG. 3, the pixel 48 has, for example, a first subpixel 49R, a second subpixel 49G, and a third subpixel 49B. The first subpixel 49R displays a first primary color (e.g., red). The second subpixel 49G displays a second primary color (e.g., green). The third subpixel 49B displays a third primary color (e.g., blue). Thus, the pixels 48 arranged in a matrix on the display panel 30 include the first subpixel 49R that displays a first color, the second subpixel 49G that displays a second color, and the third subpixel 49B that displays a third color. The first color, the second color, and the third color are not limited to the first primary color, the second primary color, and the third primary color, and may be different colors such as complementary colors. In the following description, when it is not necessary to distinguish between the first subpixel 49R, the second subpixel 49G, and the third subpixel 49B, they are referred to as subpixels 49.

[0015] The pixel 48 may have a subpixel 49 in addition to the first subpixel 49R, the second subpixel 49G, and the third subpixel 49B. For example, the pixel 48 may have a fourth subpixel that displays a fourth color. The fourth subpixel displays the fourth color (for example, white). When illuminated with the same light source illumination amount, the fourth subpixel is preferably brighter than the first subpixel 49R that displays the first color, the second subpixel 49G that displays the second color, and the third subpixel 49B that displays the third color.

[0016] More specifically, the display device 1 is a transmissive color liquid crystal display device. As illustrated in Fig. 3, the display panel 30 is a color liquid crystal display panel, in which a first color filter that passes a first primary color is arranged between the first sub-pixel 49R and the image observer, a second color filter that passes a second primary color is arranged between the second sub-pixel 49G and the image observer, and a third color filter that passes a third primary color is arranged between the third sub-pixel 49B and the image observer. The first color filter, the second color filter, and the third color filter are included in a filter film 26 described later.

[0017] When the fourth subpixel is provided, no color filter is disposed between the fourth subpixel and the image observer. In this case, a large step is generated in the fourth subpixel. For this reason, the fourth subpixel may be provided with a transparent resin layer instead of a color filter. This can prevent a large step from being generated in the fourth subpixel.

[0018] The signal output circuit 41 is electrically connected to the display panel 30 by a signal line DTL. The display panel drive unit 40 uses a scanning circuit 42 to select a sub-pixel 49 in the display panel 30 and control the on / off state of a switching element (e.g., a thin film transistor (TFT)) for controlling the operation (light transmittance) of the sub-pixel 49. The scanning circuit 42 is electrically connected to the display panel 30 by a scanning line SCL.

[0019] In the first embodiment, the signal lines DTL are aligned in the X direction. Each signal line DTL extends in the Y direction. The scanning lines SCL are aligned in the Y direction. Each scanning line SCL extends in the X direction. Therefore, in the first embodiment, the pixels 48 are driven in units of a pixel column (line) including a plurality of pixels 48 aligned in the X direction so as to share the scanning line SCL, in response to a drive signal output from the scanning circuit 42. Hereinafter, when simply referred to as a line, it refers to a pixel column including a plurality of pixels 48 aligned in the X direction so as to share the scanning line SCL.

[0020] The direction along which each scanning line SCL extends is referred to as the horizontal scanning direction. The direction in which the multiple scanning lines SCL are arranged is referred to as the vertical scanning direction. In the first embodiment, the X direction corresponds to the horizontal scanning direction, and the Y direction corresponds to the vertical scanning direction.

[0021] FIG. 4 is a cross-sectional view showing an example of a schematic cross-sectional structure of the display panel 30. The array substrate 30a has a filter film 26 provided above a pixel substrate 21 such as a glass substrate, a counter electrode 23 provided above the filter film 26, an insulating film 24 provided in contact with the counter electrode 23, a pixel electrode 22 on the insulating film 24, and a first alignment film 28 provided on the uppermost surface side of the array substrate 30a. The counter substrate 30b includes a counter pixel substrate 31 such as a glass substrate, a second alignment film 38 provided on the lower surface of the counter pixel substrate 31, and a polarizing plate 35 provided on the upper surface. The array substrate 30a and the counter substrate 30b are fixed via a seal portion 29. A liquid crystal layer LC1 is sealed in a space surrounded by the array substrate 30a, the counter substrate 30b, and the seal portion 29. The liquid crystal layer LC1 includes liquid crystal molecules whose alignment direction changes depending on an applied electric field. The liquid crystal layer LC1 modulates light passing through the liquid crystal layer LC1 depending on the state of the electric field. The direction of the liquid crystal molecules in the liquid crystal layer LC1 changes depending on an electric field applied between the pixel electrode 22 and the counter electrode 23, thereby changing the amount of light transmitted through the display panel 30. Each of the sub-pixels 49 has a pixel electrode 22. A plurality of switching elements for individually controlling the operations (light transmittance) of the sub-pixels 49 are electrically connected to the pixel electrode 22.

[0022] The light control unit 70 includes a light control panel 80 and a light control panel drive unit 140. The light control panel 80 of the first embodiment has a similar configuration to the display panel 30 shown in FIG. 4, except that the filter film 26 is omitted. Therefore, unlike the pixel 48 (see FIG. 3) including the first subpixel 49R, the second subpixel 49G, and the third subpixel 49B differentiated by the colors of the color filters, the light control panel 80 includes a light control pixel 148 that is not provided with a color filter (see FIG. 1). That is, the light control panel 80 is a monochrome liquid crystal panel.

[0023] The signal output circuit 141 and the scanning circuit 142 included in the dimming panel driving unit 140 have the same configuration as the display panel driving unit 40, except that the object to be connected is the dimming panel 80. The signal line ADTL between the dimming panel 80 and the dimming panel driving unit 140 shown in FIG. 1 has the same configuration as the signal line DTL described with reference to FIG. 3. The scanning line ASCL between the dimming panel 80 and the dimming panel driving unit 140 shown in FIG. 1 has the same configuration as the scanning line SCL described with reference to FIG. 3. However, the size of the range controlled as one dimming pixel 148 in the dimming panel 80 includes a plurality of pixels 48 from a planar viewpoint. In the description of the first embodiment, the width in the X direction controlled as one dimming pixel 148 corresponds to the width of three pixels 48 arranged in the X direction. Also, the width in the Y direction controlled as one dimming pixel 148 corresponds to the width of three pixels 48 arranged in the Y direction. Therefore, 3×3=9 pixels 48 are arranged in the range controlled as one dimming pixel 148. The number of pixels 48 in the range controlled as one dimming pixel 148 illustrated here is merely an example and is not limited thereto, and can be changed as appropriate. For example, 2×2=4 pixels 48 may be arranged in the range controlled as one dimming pixel 148.

[0024] In the dimming panel 80, one pixel electrode 22 or multiple pixel electrodes 22 may be provided in an area controlled as one dimming pixel 148. When multiple pixel electrodes 22 are provided in an area controlled as one dimming pixel 148, the multiple pixel electrodes 22 are controlled to have the same potential. This allows the multiple pixel electrodes 22 to behave substantially in the same way as one pixel electrode 22.

[0025] In the first embodiment, the arrangement of the pixels 48 in the display area OA is the same as the arrangement of the dimming pixels 148 in the dimming area DA. Therefore, in the first embodiment, the number of pixels 48 arranged in the X direction of the display area OA is the same as the number of pixels 148 arranged in the X direction of the dimming area DA. Also, in the first embodiment, the number of pixels 48 arranged in the Y direction of the display area OA is the same as the number of dimming pixels 148 arranged in the Y direction of the dimming area DA. Also, in the first embodiment, the display area OA and the dimming area DA overlap from the viewpoint of the XY plane. Also, the Z direction corresponds to the optical axis LL of the light irradiated from the light emitting area LA of the light source device 50. Therefore, one of the multiple pixels 48 and one dimming pixel 148 at a position overlapping with the pixel 48 from the viewpoint of the XY plane share the optical axis LL. However, the light irradiated from the light emitting area LA is incoherent light that diffuses radially. Therefore, light rays not directed along the optical axis LL may also enter the light adjusting pixel 148 and the pixel 48.

[0026] Light emitted from the light source device 50 enters the dimming panel 80 through the first polarizing plate P1. Of the light that enters the dimming panel 80, the light that passes through the dimming pixels 148 enters the display panel 30 through the second polarizing plate P2, the diffusion layer P5, and the third polarizing plate P3. Of the light that enters the display panel 30, the light that passes through the pixels 48 is output through the fourth polarizing plate P4. Based on the light output in this manner, a user of the display device 1 visually recognizes an image output from the display device 1.

[0027] If we consider the case where an image is viewed from the front of the plate surface (XY plane) of the display device 1, if the dimming pixel 148, which shares the optical axis LL with the pixel 48 controlled to transmit light in order to display an image in the display panel 30, is controlled to transmit light, the user of the display device 1 can view the image output by the display device 1 without any problem. In this case, the dimming pixel 148, which shares the optical axis LL with the pixel 48 controlled not to transmit light in the display panel 30, is controlled not to transmit light. On the other hand, the user of the display device 1 does not necessarily view the image from the front of the plate surface (XY plane) of the display device 1. If the pixel 48 and the dimming pixel 148 are controlled in the same way as when an image is viewed from the front of the plate surface (XY plane) of the display device 1 described above, a user who views the fourth polarizing plate P4 side of the display device 1 from an angle (oblique angle) intersecting the plate surface and the Z direction may view a double image or a missing image.

[0028] FIG. 5 is a diagram showing the principle and examples of double images and image chipping. FIG. 5 shows a schematic diagram of the display device 1 in a "panel schematic diagram". In the schematic cross-sectional view, pixels 48 in which the orientation of liquid crystal is controlled to transmit light and light adjustment pixels 148 are shown as white rectangles. In addition, in the schematic cross-sectional view, a group of multiple pixels 48 in which the orientation of liquid crystal is controlled to block light is shown as a light shielding section 48D with a rectangle in a dot pattern. In addition, in the schematic cross-sectional view, a group of multiple light adjustment pixels 148 in which the orientation of liquid crystal is controlled to block light is shown as a light shielding section 148D with a rectangle in a dot pattern.

[0029] The light that has passed through the dimming pixel 148 and passed through the stacked structure (second polarizer P2, diffusion layer P5, third polarizer P3) between the dimming pixel 148 and pixel 48 and is then refracted due to the difference in refractive index between the stacked structure and the air on the exit surface side when it is emitted from the exit surface side of the display panel 30 through a fourth polarizer P4 (not shown) (see FIG. 2). In FIG. 5, the refraction is shown by the difference between the travel angle θ2 of the light inside the display device 1, which is due to the difference between the refractive index n2 of the stacked structure and the refractive index n1 of the air, and the emission angle θ1 of the light outside the exit surface of the display device 1.

[0030] More specifically, the following formula (1) is established. If the Z-direction interval between the pixel 48 and the dimming pixel 148 is d, the following formula (2) is established. In formula (2), p is the width of the pixel 48 in the X direction. m is a numerical value indicating the number of pixels 48 when the positional deviation in the X direction between the light emission point on the dimming pixel 148 side and the light incidence point on the pixel 48 side caused by the light travel angle θ2 in the display device 1 is converted into the number of pixels 48. Note that the refractive index (n1) of air is 1.0, and the refractive index (n2) of the laminated structure (the second polarizing plate P2, the diffusion layer P5, and the third polarizing plate P3) is a value different from 1.0. Then, based on formulas (1) and (2), formula (3) is established. Therefore, based on formula (3), the blurring range mp corresponding to θ1, centered on the optical axis LL, can be calculated from n1, n2, and θ1. The dimming pixels 148 included in the blurring range mp are controlled to transmit light. Note that d is, for example, the interval between the middle position of the pixel 48 in the Z direction and the middle position of the dimming pixel 148 in the Z direction. The middle position of the pixel 48 in the Z direction is the middle position of the display panel 30 in the Z direction. The middle position of the dimming pixel 148 in the Z direction is the middle position of the dimming panel 80 in the Z direction. Also, d can be regarded as the distance of the liquid crystal layer LC1 between the display panel 30 and the dimming panel 80. n1sinθ1=n2sinθ2…(1) dtanθ2=mp…(2) mp=dtan{sin -1 (n1sinθ1 / n2)}…(3)

[0031] As shown in the "Panel Schematic Diagram" of the "Double Image", due to the refraction described above, if it is assumed that the light is not blocked by the light blocking portion 48D, the light L1 that passes through the dimming pixel 148 will be emitted as light V1. In reality, the light is blocked by the light blocking portion 48D, so the light V1 does not exit. Also, the light L2 that passes through the dimming pixel 148 will be emitted as light V2. Also, if it is assumed that the light is not blocked by the light blocking portion 148D, the light that passes through the light propagation axis L3 shown by the dashed line will be emitted as light V3.

[0032] Here, when the emission surface of the display device 1 in the state of the "panel schematic diagram" of the "double image" is viewed from the front, both sides in the X direction sandwiching the light shielding portion 48D should be lit. That is, there is one non-emitting (black) region when viewed from the front. On the other hand, when the emission surface of the display device 1 is viewed from an oblique angle that produces an emission angle Θ1 with respect to the XY plane and the X direction, there are optical axes of light L1 and L3 that do not actually occur, sandwiching light V2. That is, two non-emitting (black) regions are generated, lined up in the X direction sandwiching light V2. In this way, an image formed by one non-emitting (black) region when viewed from the front may be viewed as a double image formed by two non-emitting (black) regions at an oblique angle. In FIG. 5, an example of the occurrence of such a double image is illustrated as an "example of viewing from an oblique viewpoint" of the "double image".

[0033] Also, as shown in the "Panel Schematic Diagram" of "Image Dropout", if it is assumed that the light is not blocked by the light shielding portion 148D, the light L4 will be emitted as the light V4. In reality, the light is blocked by the light shielding portion 148D, so the light V4 is not emitted. Also, if it is assumed that the light is not blocked by the light shielding portion 148D, the light L5 will be emitted as the light V5. In reality, the light is blocked by the light shielding portion 148D, so the light V5 is not emitted. Even if the light is not blocked by the light shielding portion 148D, the light is blocked by the light shielding portion 48D, so the light V5 is not emitted. Also, if it is assumed that the light is not blocked by the light shielding portion 48D, the light L6 transmitted through the light adjustment pixel 148 will be emitted as the light V6. In reality, the light is blocked by the light shielding portion 48D, so the light V6 is not emitted.

[0034] Here, in the state of the "Panel Schematic Diagram" of "Image Dropout", the light-shielding portion 48D is generated so as to sandwich the light-transmittable pixel 48 in the X direction, so that one light-emitting region sandwiched between non-light-emitting (black) regions should be visible from the front viewpoint. On the other hand, when the emission surface of the display device 1 is viewed from an oblique angle that produces an emission angle Θ1 with respect to the XY plane and the X direction, the light-emitting region is not visible. This is because, as described above, none of the lights V4, V5, and V6 are emitted. In this way, an image formed by one light-emitting region when viewed from the front viewpoint may not be visible at an oblique angle. Image dropout when the display device 1 is viewed from an oblique angle occurs in this way. In FIG. 5, an example of the occurrence of such image dropout is illustrated as "Example of Viewing from an Oblique Viewpoint" of "Image Dropout". Note that the dimming pixel 148 shown in FIG. 5 has the same width in the X direction as the pixel 48 in order to make it easier to understand the positional correspondence with the pixel 48, but in reality, a plurality of pixels 48 are included within the range of one dimming pixel 148 as described above.

[0035] Therefore, in the first embodiment, blurring is applied in controlling the range through which the light control panel 80 transmits light. The blurring refers to a process of controlling the dimming pixels 148 so that the light control panel 80 transmits light in a wider range than the light transmission range that occurs when the input signal IP is faithfully reflected. Therefore, the range through which light can be transmitted by the light control panel 80 to which the blurring process is applied is wider than the range through which light can be transmitted by the display panel 30. The blurring process will be described below with reference to FIG. 6.

[0036] FIG. 6 is a graph showing an example of the relationship between the distance from the dimming pixel 148 that shares the optical axis LL with the pixel 48 controlled to transmit light at the highest gradation and the degree of control to transmit light by blurring processing. In the graph of FIG. 6, the horizontal axis indicates the distance, and the vertical axis indicates the degree of light transmission. Note that the distance is set to a position where the dimming pixel 148 that shares the optical axis LL with the pixel 48 controlled to transmit light at the highest gradation is at a distance of "0". Also, it is assumed that the dimming pixel 148 adjacent to the dimming pixel 148 at the distance of "0" is at a distance of "1" from the dimming pixel 148 at the distance of "0". Also, it is assumed that the other dimming pixels 148 are arranged in the X direction or Y direction at a distance of the number of dimming pixels 148 intervening therebetween +1, based on the dimming pixel 148 at the distance of "0". In addition, FIG. 6 shows an example in which the gradation of the light transmittance is 8 bits (256 gradations), but this is merely an example and is not limiting, and can be changed as appropriate.

[0037] 6, in the first embodiment, not only the dimming pixel 148 at a distance of "0" that shares the optical axis LL with the pixel 48 controlled to transmit light, but also the dimming pixel 148 at a distance within the range of 1 to 6 are controlled to transmit light by the blurring process. The dimming pixel 148 at a distance of "1" is controlled to transmit light to the same degree as the dimming pixel 148 at a distance of "0". The dimming pixels 148 at a distance of "2" or more are controlled to transmit less light as the distance increases.

[0038] Note that the specific setting of the range of distance from the dimming pixel 148 at a distance of "0" to which light is to be transmitted by the blurring process is arbitrary. More specifically, the range from the dimming pixel 148 at a distance of "0" to which the blurring process is applied is set based on the allowable angle (Θ1) at which an oblique viewpoint is established for the display device 1 and on specifications such as the size of the interval d described above. The specified range is also set based on the same concept for the range (predetermined range) that is the target of the blurring process centered on a certain pixel 48 in the process based on the gradation value of the pixel 48 by the blurring process unit 12 described later.

[0039] FIG. 7 is a diagram showing an example of display output contents based on an input signal IP for the display device 1. FIG. 8 is a diagram showing a light transmission range by a light control panel 80 to which a blurring process is applied based on the display output contents shown in FIG. 7. In FIGS. 7 and 8, a range controlled to transmit light is shown in white, and a range controlled not to transmit light is shown in a dot pattern. As shown by comparing FIG. 7 and FIG. 8, in the light control panel 80 to which a blurring process is applied, the light control pixels 148 are controlled so that light is transmitted over a wider range compared to the display output contents. Specifically, the degree of light transmission of the light control pixels 148 is controlled so that the border line of the range through which light is transmitted in the display output contents shown in FIG. 7 is made thicker to expand the range through which light is transmitted further outward.

[0040] 9 is a block diagram showing an example of a functional configuration of the signal processing unit 10. The signal processing unit 10 includes a first gamma conversion unit 11, a blurring processing calculation unit 12, and a second gamma conversion unit 13.

[0041] The first gamma conversion unit 11 performs gamma correction processing when gamma correction is required between the input value and the output value. The input value here is the RGB gradation value of each pixel included in the frame image indicated by the input signal IP. The output value is the brightness of the pixel 48 recognized by a user viewing the display area OA when the pixel 48 included in the display panel 30 is controlled with a voltage according to the input value. In the embodiment, it is assumed that an appropriate output value is obtained by controlling the pixel 48 according to the input value when viewed in a one-to-one relationship between each RGB gradation value and each pixel 48, and no special correction is performed. However, depending on the gamma characteristics of the display panel 30, the first gamma conversion unit 11 performs gamma correction processing.

[0042] In the embodiment, as described above with respect to the first gamma conversion unit 11, the RGB gradation value (input value) indicated by the pixel data given to the pixel 48 at a position where an input signal IP corresponding to one frame image is present is the same as the RGB gradation value (output value) indicated by the pixel data given to the pixel 48 by the output image signal OP based on the input signal IP. Therefore, if the input value is Ic and the output value is g0(Ic), then Ic=g0(Ic) holds. Also, g0(Ic) can be expressed as an RGB gradation value, that is, in the form of (R,G,B)=(α,β,γ). Here, α,β,γ are numerical values ​​corresponding to the number of bits of information indicating the gradation value. For example, in the case of 8 bits, α,β,γ each take a value within the range of 0 to 255.

[0043] The second gamma conversion unit 13 shown in FIG. 9 performs gamma correction processing when gamma correction is required for the dimming grayscale value. In the embodiment, the second gamma conversion unit 13 performs gamma correction processing so that the gamma curve between the case where the dimming panel 80 and the display panel 30 are both at the lowest grayscale (0) and the case where the dimming panel 80 and the display panel 30 are both at the highest grayscale (255 in the case of 8 bits) becomes a desired gamma curve (for example, a gamma curve corresponding to a gamma value of 2.2). If the coefficient used in the gamma correction processing is g1, the dimming grayscale value after the gamma correction processing by the second gamma conversion unit 13 is g1(Ic max +A).

[0044] The first gamma conversion unit 11 shown in FIG. 9 outputs an output image signal OP to the display panel 30. Here, the output image signal OP is a collection of the above-mentioned g0(Ic) for each of the multiple pixels 48. Through the operation of the display panel drive unit 40, each pixel 48 is driven according to g0(Ic). The second gamma conversion unit 13 outputs a dimming signal DI to the dimming panel 80. Here, the dimming signal DI is a collection of the above-mentioned g1(Ic) for each of the multiple dimming pixels 148. max By the operation of the dimming panel drive unit 140, each dimming pixel 148 is a set of g1 (Ic max +A). That is, the dimming panel 80 operates so that the degree of light transmission by each of the plurality of dimming pixels 148 corresponds to the respective dimming gradation values. Note that in the embodiment, the plurality of sub-pixels 49 of one dimming pixel 148 are all driven so that the degree of light transmission corresponds to the dimming gradation value of that one dimming pixel 148.

[0045] The blurring processing calculation unit 12 performs the above-mentioned blurring processing. In addition, the blurring processing calculation unit 12 derives a blurring range. The blurring range refers to a range that includes the light adjustment pixels 148 to which the blurring processing is applied.

[0046] In the embodiment, the blurring processing calculation unit 12 derives the blurring range so that the blurring range corresponds to the position of the user's eyes relative to the display panel 30. Prior to describing a method for determining the blurring range, a comparison between a case in which the position of the user's eyes relative to the display panel 30 is unknown and a case in which the position of the user's eyes relative to the display panel 30 is clear will be described with reference to Figs. 10 to 12. Note that the user refers to a person who views the image output by the display device 1.

[0047] 10 is a schematic diagram showing a blurring range required when it is unknown where the user's eyes are relative to the display panel 30. When it is unknown where the user's eyes are relative to the display panel 30, a predetermined blurring range Da is applied to the light control panel 80 so that blurring processing is applied no matter where the user directs his or her gaze toward the display panel 30.

[0048] Specifically, the blurring range Da is determined in advance according to, for example, the viewing angle of the display panel 30. FIG. 10 shows the viewing angle θa in the X direction according to the panel characteristics of the display panel 30. The angle obtained by dividing the viewing angle θa by two is substituted as θ1 in the formula (3). In addition, n2 in the formula (3) is a value according to the laminated structure (the second polarizing plate P2, the diffusion layer P5, and the third polarizing plate P3) between the light control pixel 148 and the pixel 48, and is specified in advance by a prior measurement or the like. In addition, as described above, n1=1.0. Therefore, the blurring range Da is derived by setting the X-direction distance of the blurring range centered on the light control pixel 148 that overlaps with the pixel 48 controlled to transmit light in the Z direction as mp calculated based on the formula (3). Note that the blurring range Da includes a range that is centered on the light control pixel 148 and is separated to mp on one side in the X direction and a range that is separated to mp on the other side in the X direction. Therefore, the blurring range Da is twice (=2mp) the mp calculated by substituting the angle obtained by dividing the viewing angle θa by 2 as θ1 in equation (3).

[0049] 11 and 12 are schematic diagrams showing the blurring range required when the position of the user's eyes relative to the display panel 30 is known. When the position of the user's eyes relative to the display panel 30 is known, the blurring range is applied to the light control panel 80 based on the angle that the user's eyes make with respect to the pixels 48 that are controlled to transmit light.

[0050] In FIG. 11, it is assumed that the user's face is in front of the pixel 48 controlled to transmit light. Therefore, in the example shown in FIG. 11, the angle θc in the X direction formed by the line of sight Fc from one of the user's eyes Ea to the pixel 48 and the line of sight Fd from the other eye Eb to the pixel 48 with the pixel 48 as the center is substituted as θ1 in the formula (3). Therefore, the blur range Dc is derived by setting the X direction distance of the blur range centered on the light control pixel 148 that overlaps with the pixel 48 controlled to transmit light in the Z direction as mp calculated based on the formula (3). Note that the blur range Dc is twice (=2mp) the calculated mp calculated by substituting the angle θc divided by 1 / 2 as θ1 in the formula (3) in the same way as the blur range Da.

[0051] 10 and 11, the angle θc is smaller than the viewing angle θa, and therefore the blur range Dc is smaller than the blur range Da.

[0052] One eye Ea is the right eye of the user and is located relatively to the left when viewed from the display panel 30. The other eye Eb is the left eye of the user and is located relatively to the right when viewed from the display panel 30.

[0053] In Fig. 12, it is assumed that the user's face is located at a position diagonal to the pixel 48 controlled to transmit light. Even in this case, the angle θe in the X direction formed by the line of sight Fe from one of the user's eyes Ea to the pixel 48 and the line of sight Ff from the other eye Eb to the pixel 48 with the pixel 48 as the center is smaller than the viewing angle θa. Therefore, the blurring range De determined according to the lines of sight Fe and Ff is smaller than the blurring range Da. Note that a specific method for calculating the blurring range (for example, the blurring range De shown in Fig. 12) when the user's face is located at a position diagonal to the pixel 48 controlled to transmit light will be described later.

[0054] As described with reference to FIGS. 10 to 12, when the position of the user's eyes relative to the display panel 30 is clear, the blurring range can be made smaller than when the position of the user's eyes relative to the display panel 30 is unknown.

[0055] A more specific method for deriving the other range will be described below with reference to FIGS.

[0056] 13 is a diagram showing the maximum angle θxmax that the user's line of sight can form when it is assumed that the user's eyes can move within the maximum movable range Dmax in the X direction. The maximum angle θxmax is the angle formed by the lines of sight Fj and Fk. The line of sight Fj is a line of sight directed from one eye Ea to a pixel 48 at the other end of the display area OA in the X direction when the one eye Ea is located at one end of the maximum movable range Dmax in the X direction. The line of sight Fk is a line of sight directed from the other eye Eb to a pixel 48 at one end of the display area OA in the X direction when the other eye Eb is located at the other end of the maximum movable range Dmax in the X direction.

[0057] The maximum angle θxmax is calculated from the following equation (4) based on the panel width PD, the maximum movable range Dmax, and the distance Dis. The panel width PD is the width of the display area OA in the X direction. The maximum movable range Dmax is the length of the range in the X direction over which the user's eyes can move. The distance Dis is the distance in the Z direction between the display area OA and the user's eyes (one eye Ea, the other eye Eb). Note that when calculating the angle to be substituted as θ1 in the above equation (3) from the maximum angle θxmax, the maximum angle θxmax can be divided by 2. θxmax=2×atan[{(Dmax / 2)+(PD / 2)} / Dis]…(4)

[0058] In the explanation with reference to Fig. 10, the viewing angle θa of the display panel 30 is set as the case where the blurring range is maximum, but as shown in Fig. 13, if the user's movement range is assumed to be limited to the maximum movable range Dmax and the maximum angle θxmax is smaller than the viewing angle θa, the blurring range may be calculated by substituting θ1 in the above-mentioned formula (3) as a value obtained by dividing the maximum angle θxmax by 2. Then, the calculated blurring range may be treated as the blurring range when the position of the user's eyes relative to the display panel 30 is unknown.

[0059] FIG. 14 is a diagram showing an example of the reference axis angles θx1 and θx2 with respect to the display area OA when the user's face is at a position diagonal to the X direction with respect to the display area OA. FIG. 14 shows an example in which the user views the display area OA from one end side in the X direction with respect to the display area OA. Here, the midpoint in the X direction between one eye Ea and the other eye Eb is the midpoint CP. As shown in FIG. 14, the angle of the reference line Wa connecting the midpoint CP and one end of the display area OA in the X direction with respect to the axis line (Z axis) along the Z direction is the reference axis angle θx1. Also, the angle of the reference line Wb connecting the midpoint CP and the other end of the display area OA in the X direction with respect to the axis line (Z axis) along the Z direction is the reference axis angle θx2. When the user's face is at a position diagonal to the X direction with respect to the display area OA, the above-mentioned optical axis LL does not follow the Z direction, but shows different inclinations with respect to the Z direction, like the reference lines Wa and Wb, depending on the position of the pixel 48 to which the line of sight is directed.

[0060] As illustrated in FIG. 14, even if the position of the user's face relative to the display area OA is uniquely determined, the angle formed by the Z axis and a straight line connecting a point on the user's face (e.g., the midpoint CP) to each position of the display area OA differs at each position of the display area OA.

[0061] Fig. 15 is a diagram showing an angle θx21 between a line of sight Wb1 from one eye Ea to the other end in the X direction of the display area OA and the Z axis, and an angle θx22 between a line of sight Wb2 from the other eye Eb to the other end and the Z axis when the user's face is at the position shown in Fig. 14. As shown in Figs. 14 and 15, one eye Ea and the other eye Eb are located at an interocular distance Dh in the X direction with a midpoint CP in between. Therefore, the angle θx21 between the line of sight Wb1 from one eye Ea to the other end and the Z axis and the angle θx22 between the line of sight Wb2 from the other eye Eb to the other end and the Z axis are different angles.

[0062] If the angle formed in the X direction by a straight line connecting an eye and a point on the display area OA at which the eye is directed, such as angles θx21 and θx22, with the Z axis, is θx, then θx can be expressed as in the following equation (5): Q in equation (5) is the distance in the X direction between the eye and the point on the display area OA. θx=atan[Q / Dis]…(5)

[0063] As an example, the distance Dis is 50 cm. Also, the distance Qa in the X direction between one eye Ea and the other end of the panel width PD shown in FIG. 15 is 40 cm. In this case, by substituting the distance Qa for Q in equation (5), the angle θx21 can be calculated as θx in equation (5). In this case, the angle θx21 is approximately 38.7°.

[0064] Furthermore, if the interocular distance Dh is 7.2 cm, the distance Qb in the X direction between the other eye Eb and the other end of the panel width PD shown in FIG. 15 is 32.8 cm. Therefore, by substituting the distance Qb for Q in equation (5), the angle θx22 can be calculated as θx in equation (5). The angle θx22 is approximately 33.3°. Therefore, the difference between the angles θx21 and θx22, 5.4°, is the angle between the line of sight Wb1 and the line of sight Wb2. This angle can be derived as the angle corresponding to the angle θe in FIG. 12 described above.

[0065] 12. Also, the line of sight Wb1 in FIG. 15 corresponds to the line of sight Fe in FIG. 12, and the line of sight Wb2 in FIG. 15 corresponds to the line of sight Ff in FIG. 12. Therefore, by substituting the angle θx21 for θ1 in equation (3), the value of mp in equation (3) can be calculated as a value indicating the width De1 shown in FIG. 12. Also, by substituting the angle θx22 for θ1 in equation (3), the value of mp in equation (3) can be calculated as a value indicating the width De2 shown in FIG. Then, the blur range De can be calculated by subtracting the width De2 from the width De1.

[0066] The width De1 is the distance in the X direction between the end position of the light path Ge on the dimming pixel 148 side and the reference axis LZ shown in FIG. 12. The reference axis LZ shown in FIG. 12 is the Z axis passing through the center in the X direction of the pixel 48 controlled to transmit light. The light path Ge is the light path taken between the dimming pixel 148 and the pixel 48 when the light traveling from the dimming pixel 148 side toward the pixel 48 side is light with the line of sight Fe as the light path outside the pixel 48. The light path Gf is the light path taken between the dimming pixel 148 and the pixel 48 when the light traveling from the dimming pixel 148 side toward the pixel 48 side is light with the line of sight Ff as the light path outside the pixel 48. The angle difference between the line of sight Fe and the light path Ge with respect to the reference axis LZ and the angle difference between the line of sight Ff and the light path Gf with respect to the reference axis LZ correspond to the angle difference between the emission angle θ1 and the travel angle θ2 described with reference to FIG. 5 above.

[0067] As described above with reference to FIG. 15, a method for deriving the blur range (blur range De shown in FIG. 5) corresponding to pixel 48 located at the other end of display area OA when the user's face is located diagonally in the X direction from the other end of display area OA has been described. However, the present invention is not limited to the other end of display area OA. By substituting the distances in the X direction between the position in the X direction in display area OA at other positions and each of one eye Ea and the other eye Eb (for example, distances equivalent to distances Qa and Qb shown in FIG. 15) into Q in equation (5) above, it is possible to calculate an angle to be substituted for θ1 in equation (3) above as Qx in equation (5).

[0068] In the description with reference to FIG. 15, the angle in the direction from the other end side of the display area OA to one end side with respect to the Z axis is treated as a positive angle. Therefore, the opposite angle, that is, the angle in the direction from one end side of the display area OA to the other end side with respect to the Z axis, may be treated as a negative angle. This allows the idea described with reference to FIG. 12 and FIG. 15 to be similarly applied even when the angle formed by the line of sight from one eye Ea with respect to a point on the display area OA with the Z axis is a positive angle, and the angle formed by the line of sight from the other eye Eb with respect to the point with the Z axis is a negative angle. That is, in this case, the angle corresponding to the angle θe in FIG. 12 above is the angle obtained by adding the absolute value of the positive angle and the absolute value of the negative angle. In addition, in this case, the blurring range De shown in FIG. 12 is the size obtained by adding the absolute value of the positive width De1 and the absolute value of the negative width De2. By considering plus and minus in this way, it is possible to derive the blur range based on a combination of formula (3) and formula (5) not only when the user's face is located diagonally in the X direction with respect to a point in the display area OA, but also when the user's face is in front of the point as shown in Fig. 11. That is, even when the user's face is in front of the point as shown in Fig. 11, it is possible to derive the blur range based on a combination of formula (3) and formula (5) by setting the angle between the line of sight Fc and the Z axis to a positive angle and the angle between the line of sight Fd and the Z axis to a negative angle.

[0069] The blur range based on the X-direction positions of the user's face and eyes relative to the display area OA has been described above, but the same concept can also be applied to the Y-direction positions of the user's face and eyes relative to the display area OA. However, generally, if one eye Ea and the other eye Eb are aligned in the X-direction, the one eye Ea and the other eye Eb are in the same position in the Y-direction. More specifically, if the X-direction is the horizontal direction, the Y-direction is the vertical direction, and if a person is standing or sitting, the one eye Ea and the other eye Eb are generally aligned in the horizontal direction, so that the one eye Ea and the other eye Eb are in the same position in the vertical direction. In the embodiment, based on such a concept, the blur range is derived based on the Y-direction positions of the user's face and eyes relative to the display area OA.

[0070] FIG. 16 is a diagram showing the concept of deriving the blur range based on the Y-direction positions of the user's face and eyes relative to the display area OA. The eye E shown in FIG. 16 includes the above-mentioned one eye Ea and the other eye Eb. If the angle formed in the Y direction by the straight line connecting the eye E and a point on the display area OA to which the eye E is directed and the Z-axis is θy, θy can be expressed as the following formula (6). T in formula (6) is the distance in the Y direction between the eye and the point on the display area OA. By substituting θy calculated in formula (6) into θ1 in the above-mentioned formula (3), the value of mp in formula (3) can be calculated as the center position of the blur range in the Y direction. θy=atan[T / Dis]…(6)

[0071] The blur range in the Y direction may be a fixed value regardless of the magnitude of the above-mentioned θy, or the blur range in the Y direction may be determined individually in advance according to the magnitude of the above-mentioned θy. For example, the blur range may be applied only to the dimming pixels 148 arranged in the X direction at the Y direction position corresponding to the center position of the blur range in the Y direction indicated by the value of mp calculated by combining the formula (6) and the formula (3). In other words, the derivation of the blur range in the Y direction may be used only as information for deriving the Y direction position of the dimming pixel 148 for forming a blur range for the pixel 48 according to the pixel 48 controlled to transmit light, and may not be intended to form a light transmission range including multiple dimming pixels 148 in the Y direction.

[0072] The above describes the derivation of the blurring range by calculation on the premise that the angle of the eye E with respect to a point on the display area OA is known. The embodiment includes a means for acquiring the angle of the eye E with respect to a point on the display area OA. Specifically, in the embodiment, the imaging unit 90 acquires information regarding the position of the user's eyes with respect to the display area OA. Hereinafter, the mechanism for acquiring information regarding the position of the user's eyes with respect to the display panel 30 by the imaging unit 90 will be described with reference to Figs. 17 and 18.

[0073] FIG. 17 is a schematic diagram showing an example of the arrangement of the display panel 30 and the imaging unit 90. The imaging unit 90 captures an image by directing the angle of view in the facing direction of the display panel 30. Specifically, the imaging unit 90 is a so-called digital camera. More specifically, the imaging unit 90 has an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a lens that collects light on the imaging device, and the like. The imaging unit 90 operates the imaging element to generate image data. As shown in FIG. 17, the imaging unit 90 directs a lens so as to be able to capture an image of the face of a user who is in a position facing the display panel 30 in the Z direction.

[0074] As shown in FIG. 17, the imaging unit 90 is located outside the display panel 30. That is, it is difficult to position the imaging unit 90 at the center of the display panel 30 in the X and Y directions. In FIG. 17, the imaging unit 90 can be positioned at the center of the display panel 30 in the X direction, but cannot be positioned at the center of the display panel 30 in the Y direction. Therefore, it is desirable to perform a correction according to the positional deviation between the imaging unit 90 and the display panel 30. This correction may be performed according to a well-known method, and is not particularly mentioned in the present disclosure, so a detailed description will be omitted.

[0075] 18 is a schematic diagram showing a mechanism of recognition processing of a user's face captured in an imaging range 91 of an image captured by an imaging unit 90. The blurring processing calculation unit 12 uses an image recognition technique such as pattern matching to identify a user's face image 92 included in an imaging range 91 of an image captured by the imaging unit 90. The blurring processing calculation unit 12 also recognizes a right eye image 93 and a left eye image 94 in the face image 92. The blurring processing calculation unit 12 may recognize the user's face, right eye, and left eye in rectangular area units such as a face image area 92a, a right eye area 93a, and a left eye area 94a shown by dashed lines, instead of recognizing the shapes of the face image 92, the right eye image 93, and the left eye image 94 as if they were bordered. Alternatively, the position of the midpoint CP may be fixed on the center line of the face image 92, and the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) may be treated as being located at opposing positions in the X direction within the face image 92 (or the face image area 92a) with the midpoint CP in between. In this case, the positions of the centers of the right-eye image 93 and the left-eye image 94 (or the centers of the right-eye area 93a and the left-eye area 94a) from the midpoint CP are set to a fixed value (e.g., 3.6 cm).

[0076] The blurring processing calculation unit 12, based on the positions of the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) recognized in the image captured by the imaging unit 90, determines the X-direction angle (e.g., the above-mentioned angles θx21, θx22, etc.) and the Y-direction angle (e.g., the above-mentioned θy) between the line of sight from the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) and the Z-axis for each of the multiple pixels 48 of the display panel 30 arranged within the display area OA.

[0077] Information for calculating the X-direction angle and the Y-direction angle between the line of sight and the Z-axis, such as the above-mentioned distances Qa, Qb, and T, is provided so as to be derivable from dimension data measured in advance. That is, depending on where the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) are located within the imaging range 91, the blurring processing calculation unit 12 can specify the X-direction distance (for example, the above-mentioned distances Qa and Qb) and the Y-direction distance (for example, the above-mentioned distance T) between each position of the multiple pixels 48 and the position of one eye Ea (right-eye image 93) and the position of the other eye Eb (left-eye image 94) based on the dimension data. The dimension data is stored in advance in a storage area (for example, a flash memory in the signal processing unit 10) that can be read out from the blurring processing calculation unit 12. Based on the captured image by the imaging unit 90, equations (5) and (6), and the dimensional data, the blurring processing calculation unit 12 determines the X-direction angle (e.g., the above-mentioned angles θx21, θx22, etc.) and the Y-direction angle (e.g., the above-mentioned θy) between the line of sight from the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) for each of the multiple pixels 48 of the display panel 30 arranged within the display area OA and the Z axis.

[0078] In the embodiment, the distance Dis is a fixed value. Specifically, assuming a state in which there is a display device 1 provided in an automobile and a seat (seat) provided in a position facing the display device 1 and in which a user can sit, such an operation is possible in cases where the distance Dis between the user seated in the seat and the display device 1 can be treated as a fixed value.

[0079] Instead of the above-mentioned dimension data, the angle in the X direction and the angle in the Y direction between the line of sight from the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) to the pixel 48 and the Z axis may be recorded in advance as angle data measured in advance, depending on where the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) are located within the imaging range 91. When this angle data is used, the angle data is stored in advance in a storage area that can be read out by the blurring processing calculation unit 12. The blurring processing calculation unit 12 acquires the captured image generated by the imaging unit 90, identifies the positions of the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a), and, by referring to the angle data, specifies the X-direction angle and the Y-direction angle between the line of sight from the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a) for each of the multiple pixels 48 and the Z axis.

[0080] When the positions of the face image 92 (or face image area 92a) and the midpoint CP are identified instead of the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a), the blurring process calculation unit 12 treats one of two positions a fixed distance away from the midpoint CP in the X direction as the position of the right-eye image 93, and the other as the position of the left-eye image 94. Other methods for specifying the angles in the X direction and the Y direction between the lines of sight of the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) and the Z axis for each of the multiple pixels 48 are the same as those described above.

[0081] 19 is a schematic diagram showing an example of a blur range derived in response to the position of the user's eyes relative to the display panel 30. When the X-direction angle and the Y-direction angle between the line of sight of the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) and the Z-axis for each of the multiple pixels 48 are specified, the blur processing calculation unit 12 can calculate the blur range mp based on the above-mentioned formula (3). Therefore, it is possible to individually derive the blur range mp to be applied to the dimming pixel 148 that transmits light irradiated to the pixel 48 that is controlled to transmit light according to the input signal IP among each of the multiple pixels 48.

[0082] 19 shows a schematic diagram of the X-direction width XL and the Y-direction width YL of the blurring range applied to the dimming pixel 148 that transmits light that illuminates the pixel 48 at a position specified by the coordinate (Xp, Yq) that is a combination of the X-direction coordinate Xp and the Y-direction coordinate Yq in the display area OA of the display panel 30. The blurring process calculation unit 12 individually derives the blurring range mp that is applied to the dimming pixel 148 that transmits light that is irradiated to the pixel 48 that is controlled to transmit light in accordance with the input signal IP among the multiple pixels 48.

[0083] The blurring processing calculation unit 12 may employ a method of identifying a pixel 48 that is controlled to transmit light according to the input signal IP among the plurality of pixels 48 based on the input signal IP, calculating the X-direction angle and the Y-direction angle between the line of sight of the right-eye image 93 and the left-eye image 94 (or the right-eye area 93a and the left-eye area 94a) for the identified pixel 48 and the Z-axis, and deriving a blurring range mp to be applied to a dimming pixel 148 that transmits light irradiated to the identified pixel 48. In the process flow described below with reference to FIG. 20, it is assumed that this method is employed.

[0084] 20 is a flow chart showing an example of a process flow for applying a blurring range to perform display output. When an input signal IP is input (step S1), the blurring process calculation unit 12 specifies transparent pixels (step S2). That is, in the process of step S2, the blurring process calculation unit 12 specifies pixels 48 that are controlled to transmit light according to the input signal IP among the multiple pixels 48 based on the input signal IP. Hereinafter, when a transparent pixel is described, it refers to a pixel 48 that is controlled to transmit light according to the input signal IP.

[0085] The blurring processing calculation unit 12 acquires line-of-sight information (step S3). Specifically, an image is captured by the imaging unit 90. The blurring processing calculation unit 12 identifies the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a, or the face image 92 or the face image area 92a and the midpoint CP) of the user included in the captured image by the imaging unit 90.

[0086] The blurring process calculation unit 12 determines whether the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a), or the face image 92 (or the face image area 92a) and the midpoint CP of the user are specified in the process of step S3 (step S4). If the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a), or the face image 92 (or the face image area 92a) and the midpoint CP of the user are specified in the process of step S3 (step S4; Yes), the blurring process calculation unit 12 acquires distance information (step S5). In the embodiment, the distance information is the distance Dis as a fixed value, as described above.

[0087] The blurring processing calculation unit 12 selects one of the transparent pixels identified in the processing of step S2 for which the blurring range mp has not yet been derived (step S6). The blurring processing calculation unit 12 derives the line of sight angle of one eye Ea (for example, the above-mentioned angle θx21) and the line of sight angle of the left eye (for example, the above-mentioned angle θx22) with respect to the transparent pixel selected in the processing of step S6 (step S7). Note that in the processing of step S7, the line of sight angle in the Y direction (for example, the above-mentioned θy) is also derived.

[0088] The blurring processing calculation unit 12 derives a blurring range corresponding to the line of sight angle derived in the process of step S7 (step S8). In the processes of steps S7 and S8, the above-mentioned formulas (3), (5), and (6) as well as data that can be referred to by the blurring processing calculation unit 12 (dimension data or angle data) and the like are used.

[0089] The blurring processing calculation unit 12 determines whether derivation of the blurring range for all transparent pixels identified in the processing of step S2 is completed (step S9). If there is a transparent pixel for which the blurring range has not yet been identified (step S9; No), the process proceeds to the processing of step S6.

[0090] On the other hand, when derivation of the blur range for all transparent pixels is completed (Step S9; Yes), the blurring process calculation unit 12 generates dimming data (Step S11). The dimming data is data that integrates the blur range for each transparent pixel. That is, when the frame image data output by the display panel 30 is drawn in response to the input of the output image signal OP corresponding to the input signal IP, the dimming data is applied to the dimming panel 80, and the blurring range corresponding to the frame image data is applied. The blurring process calculation unit 12 outputs the output image signal OP to the display panel 30 and outputs the dimming data to the dimming panel 80 (Step S12).

[0091] In step S4, if the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a), or the face image 92 (or the face image area 92a) and the midpoint CP of the user cannot be specified in the process of step S3 (step S4; No), the blurring process calculation unit 12 applies the maximum blurring range to all transparent pixels (step S10). The maximum blurring range here is, for example, the blurring range described with reference to the above-mentioned FIG. 10 or the blurring range described with reference to the above-mentioned FIG. 13. The process of step S10 is performed when a reason arises in which the right eye image 93 and the left eye image 94 (or the right eye area 93a and the left eye area 94a), or the face image 92 (or the face image area 92a) and the midpoint CP cannot be specified, for example, when the face of the user is not captured in the image captured by the imaging unit 90 for some reason.

[0092] The above description is based on the assumption that the distance information in step S5, that is, the distance Dis, is a fixed value, but the distance Dis may be made changeable.

[0093] FIG. 21 is a diagram showing a display device 1 in which a distance measuring unit 95 is further provided in addition to the configuration shown in FIG. 1. The distance measuring unit 95 acquires information on the distance Dis. Specifically, the distance measuring unit 95 has a function as a range finder that measures the distance between the user's eyes E or face (for example, the position of the midpoint CP on the user's face) and the display panel 30. The method of realizing the function of the distance measuring unit 95 as a range finder may be, for example, a so-called ultrasonic method that measures the distance to the user by irradiating ultrasonic waves and measuring the time until the reflected waves return, a contrast method (focusing of an image) used in digital cameras, or another method. When the distance measuring unit 95 is provided, the blurring processing calculation unit 12 acquires output information indicating the distance between the user and the display panel 30 from the distance measuring unit 95. The blurring processing calculation unit 12 updates the distance Dis according to the output information. Other processes are the same as those described above.

[0094] As described above, according to the embodiment, the display device 1 includes a first panel (light control panel 80), a second panel (display panel 30) disposed on one side of the first panel so as to face the first panel, a light source (light source device 50) that irradiates light from the other side of the first panel, and an acquisition unit (e.g., an imaging unit 90) that acquires user information including information indicating at least one of the position of the eyes of a person facing the second panel on one side of the second panel and the position of the head of the person. The first panel includes a plurality of light control pixels (light control pixels 148). The second panel includes a plurality of pixels (pixels 48). In the display device 1, a blurring process is applied in which the light control pixels located around the pixel controlled to transmit light according to an input image signal (input signal IP) transmit light, and a blurring range that includes the light control pixels to which the blurring process is applied in the first panel corresponds to the position of the eyes of the person or the position of the head of the person.

[0095] According to the embodiment, by acquiring user information including information indicating the position of the eyes of a person facing the second panel (display panel 30) or the position of the head of the person on one side of the second panel, information on the position at which the user views the image output by the display device 1 based on the user information can be acquired. Therefore, an image to which blurring processing is applied in a blurring range according to the position at which the user views the image can be output. That is, a more diverse response to the position at which the user views the image can be realized. In addition, the blurring processing applied to the first panel (dimming panel 80) facing the second panel can further increase the contrast of the image while suppressing the occurrence of image quality degradation such as the above-mentioned double images and image chipping. In this way, according to the embodiment, it is possible to achieve both a more diverse response to the position at which the user views the image and the effect of further increasing the contrast of the image.

[0096] The blurring range also corresponds to the angle formed by a line (e.g., the above-mentioned line of sight Wb1, Wb2) connecting at least one of a person's eye (e.g., one eye Ea) and a predetermined position (e.g., midpoint CP) on the person's face to the pixel controlled to transmit the light, and a line (Z-axis) perpendicular to the plate surface of the second panel (display panel 30). This makes it possible to more reliably make the blurring range correspond to the position where the person views the image output by the display device 1.

[0097] Furthermore, the above-mentioned user information includes information indicating the distance (distance Dis) between the second panel (display panel 30) and the person's eyes or the person's face. When the user information includes information indicating the distance, the acquisition unit includes a configuration capable of measuring the distance, like the distance measuring unit 95 described above. Furthermore, the blur range further corresponds to the information indicating the distance. This makes it possible to more reliably make the blur range correspond to the position where the person views the image output by the display device 1.

[0098] Furthermore, by deriving the blur range as a fixed distance (distance Dis) between the second panel (display panel 30) and the human eye or the human face, the blur range can be made to correspond to the position where the human views the image output by the display device 1, even if a configuration capable of measuring distance, such as the distance measuring unit 95 described above, is omitted.

[0099] Furthermore, if neither the position of the human eye nor the position of the human head can be acquired, the blurring range is set to a predetermined range. Here, the predetermined range is larger than the blurring range corresponding to the position of the human eye or the position of the human head. As a result, regardless of where the position of the human eye or the position of the human head is, the first panel (dimming panel 80) performs the blurring process, thereby improving the contrast of the image.

[0100] The acquisition unit (imaging unit 90) also includes an imaging element that images one surface of the second panel (display panel 30). This makes it possible to acquire information indicating at least one of the eye position of a person facing the second panel and the head position of the person, based on an image captured by the imaging element.

[0101] Moreover, the signal reflected in the output of the first panel (dimming panel 80) is a signal obtained by performing gamma correction on the image signal (input signal IP) according to a predetermined gamma value. This makes it possible to more appropriately control the degree of light transmission by the dimming pixel (dimming pixel 148) based on the gamma value.

[0102] Moreover, the signal reflected in the output of the second panel (display panel 30) is a signal obtained by performing gamma correction on the image signal (input signal IP) according to the gamma value of the second panel, thereby enabling more appropriate display output according to the gamma characteristics of the second panel.

[0103] In addition, the first panel is a monochrome liquid crystal panel, which makes it easier to increase the light transmittance of the second panel.

[0104] Furthermore, in an output image that includes a high-luminance area surrounded by dark colors such as black, if the blurring range is too wide, halos (chromatic aberration, optical aberration) may occur. In the embodiment, the blurring range can be made to correspond to at least one of the positions of the human eyes and the position of the human head as described above, so that the occurrence of such halos can be suppressed, and further high image quality can be achieved.

[0105] Furthermore, the effect of increasing contrast obtained by corresponding the blurring range to at least one of the positions of the human eyes and the position of the human head as described above can be obtained regardless of the content of the image signal (input signal IP), but the effect is particularly noticeable in images that are bright overall (images with a bright background).

[0106] Furthermore, by identifying transparent pixels at the time of processing in step S2 as described above, it is possible to derive the blurring range limited to transparent pixels, rather than deriving the blurring range corresponding to the positions of all pixels 48. This reduces the processing load required of the blurring processing calculation unit 12. Therefore, the circuit scale of the signal processing unit 10 can be reduced.

[0107] Furthermore, the fact that the blur range can be made small by making it correspond to at least one of the positions of the human eyes and the position of the human head means that even if the interval (d) in the Z direction between the pixel 48 and the dimming pixel 148 is larger, the degree of expansion of the blur range accompanying the expansion of the interval (d) is relatively smaller than when the blur range is larger. Therefore, even if there is a limit to the reduction of the interval (d) for some reason, it is easy to prevent the blur range from becoming too large. Therefore, the required level for thinning the laminated structure of the display panel 30 and the dimming panel 80 of the display device 1 is lowered, and design restrictions can be easily relaxed.

[0108] Here, an example of the effect of making the blurring range correspond to at least one of the position of the human eye and the position of the human head is numerically shown. In one example, the panel width PD is 30 cm, the distance Dis is 50 cm, the maximum movable range Dmax is 80 cm, the interval (d) in the Z direction between the pixel 48 and the dimming pixel 148 is 1.5 mm, the refractive index (n2) of the laminated structure between the dimming pixel 148 and the pixel 48 is 1.4, and the density of the pixel 48 of the display panel 30 and the density of the dimming pixel 148 of the dimming panel 80 are 200 ppi (pixels per inch). In this case, the number of dimming pixels 148 controlled to transmit light for the blurring process for one pixel 48 controlled to transmit light, which are consecutively arranged in the X direction, exceeds 11, depending on the blurring range applied when the position of the human eye and the position of the human head are unknown, for example, as in the process of step S10 described above. In contrast, the number of dimming pixels 148 in the X direction that are controlled to transmit light for the blurring process for one pixel 48 that is controlled to transmit light due to the blurring range applied when at least one of the positions of the human eyes and the position of the human head is clear can be at least 1. That is, even with one dimming pixel 148, it is possible to achieve high contrast by the dimming panel 80 while suppressing the above-mentioned double images and image chipping, and furthermore, it is possible to suppress the possibility of the above-mentioned halo occurring.

[0109] The signal processing unit 10 may be provided as one circuit, or the functions of the signal processing unit 10 may be realized by a combination of multiple circuits.

[0110] Also, the derivation of the line of sight angle in the Y direction (the above-mentioned θy) may be omitted. In that case, the dimming pixel 148 that transmits the light irradiated to the transmissive pixel is the dimming pixel 148 that is located at the same position in the Y direction as the transmissive pixel in the plan view.

[0111] In the above description, the imaging unit 90 functions as an acquisition unit that acquires position information of the eyes or head of a person facing the display panel 30, but the acquisition unit is not limited to the imaging unit 90. For example, when the distance measuring unit 95 is an ultrasonic type or a contrast type, the distance measuring unit 95 may also function as acquiring position information of the eyes or head of a person facing the display panel 30. In addition, as the acquisition unit, other configurations that can identify the face and eyes of a person, such as an infrared camera, may be adopted. In addition, the position of the eyes or head of a person acquired by the acquisition unit may be information indicating a predetermined position. In other words, control may be performed on the premise that the position of the eyes or head of a person facing the display panel 30 does not move.

[0112] In addition, it is not essential that a part of the configuration of the display device 1, such as a configuration functioning as an acquisition unit such as the imaging unit 90 or the distance measurement unit 95, is provided exclusively for the display device 1. For example, when the display device 1 is provided in a device or facility that is naturally provided with a configuration functioning as an acquisition unit, the configuration functioning as an acquisition unit provided in the device or facility may be used.

[0113] Furthermore, other advantageous effects brought about by the aspects described in the embodiments that are obvious from the description in this specification or that can be appropriately thought of by a person skilled in the art are naturally understood to be brought about by the present disclosure. [Explanation of symbols]

[0114] 1 Display device 30 Display Panel 48 pixels 50 Light source device 80 Dimming Panel 90 Imaging section 95 Ranging section 148 dimming pixels

Claims

1. A first panel; a second panel disposed on one side of the first panel so as to face the first panel; a light source that irradiates light from the other surface side of the first panel; an acquisition unit that acquires user information including information indicating at least one of an eye position of a user facing the second panel on one surface side of the second panel and a head position of the user; Equipped with the first panel includes a plurality of dimming pixels; the second panel comprises a plurality of pixels; A blurring process is applied to the light-adjusting pixels located around the pixel that is controlled to transmit light in accordance with an input image signal, so that the light-adjusting pixels transmit light; a blurring range including the light adjusting pixels to which the blurring process is applied in the first panel corresponds to a position of the user's eyes or a position of the user's head; When the position of the user's eyes and the position of the user's head cannot be acquired, the blurring range is set to a predetermined range; The predetermined range is larger than a blur range corresponding to the position of the user's eyes or the position of the user's head. Display device.

2. The blurring range further corresponds to an angle formed by a straight line connecting at least one of the position of the user's eyes and a predetermined position on the user's face with the pixel controlled to transmit the light, and a straight line perpendicular to the plate surface of the second panel. The display device according to claim 1 .

3. the user information includes information indicating a distance between the second panel and the user's eyes or a face of the user, The blur range further corresponds to information indicating the distance. The display device according to claim 1 .

4. The blur range is derived by setting a distance between the second panel and the user's eyes or the user's face as a fixed distance. The display device according to claim 1 .

5. the acquisition unit includes an imaging element that captures an image of one surface side of the second panel, The display device according to claim 1 .

6. the signal reflected in the output of the first panel is a signal obtained by performing gamma correction on the image signal according to a predetermined gamma value; The display device according to claim 1 .

7. the signal reflected in the output of the second panel is a signal obtained by performing gamma correction on the image signal in accordance with a gamma value of the second panel. The display device according to claim 1 .

8. the first panel is a monochrome liquid crystal panel; The display device according to claim 1 .

Images