Display device

Abstract

To provide a display device with which it is possible to more easily suppress a decrease in image quality due to the positional deviation of view points.SOLUTION: A display device comprises: a liquid crystal display panel provided with a plurality of pixels; and a light source provided with a plurality of emission points LP, for irradiating the plurality of pixels of the liquid crystal display panel with light. The ratio of the pitch of a plurality of pixels aligned in a direction X to the pitch of a plurality of emission points LP aligned in the direction X is 1:4n or 1:6n, where n is natural number. A pixel includes a plurality of sub-pixels aligned in the direction X. A pixel PixU located on an emission line of light between the view point of a user directing the line of sight to the image display surface side of the liquid crystal display panel and one emission point LP and controlled to pass the light through is aligned successively with other sub-pixels controlled to pass the light through, to form a transmission region. The width in the direction X of one transmission region is twice the width in the direction X of the pixel.SELECTED DRAWING: Figure 23

Description

[Technical Field]

[0001] The present disclosure relates to a display device. [Background technology]

[0002] BACKGROUND ART Display devices are known that can display and output individual images for a plurality of viewpoints using an image separator such as a parallax barrier (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3865762 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional image separation bands are provided corresponding to a predetermined viewpoint position. Therefore, if the viewpoint deviates from the predetermined viewpoint, even if the positional deviation is small enough to barely allow the image to be seen, the image quality will be degraded, such as the image being perceived as being less bright than the image seen from the predetermined viewpoint. In light of this situation, there has been a demand for a mechanism that can suppress degradation of image quality even when the viewpoint position is deviated.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a display device that can more easily suppress degradation of image quality due to a shift in the position of the viewpoint. [Means for solving the problem]

[0006] A display device according to one embodiment of the present disclosure comprises a liquid crystal display panel having a plurality of pixels, and a light source having a plurality of light-emitting points and irradiating light onto the plurality of pixels of the liquid crystal display panel, wherein the ratio of the pitch of the plurality of pixels arranged in a first direction to the pitch of the plurality of light-emitting points arranged in the first direction is 1:4n or 1:6n, where n is a natural number, the pixels include a plurality of sub-pixels arranged in the first direction, the pixels that are located on a ray of light between a user's viewpoint directing their gaze toward the image display surface of the liquid crystal display panel and one of the light-emitting points and that are controlled to transmit light are arranged contiguously in the first direction with sub-pixels that are included in a pixel other than the pixel and are controlled to transmit light, to form a transmissive region, and the width of one of the transmissive regions in the first direction is twice the width of the pixel in the first direction. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing the main configuration of a display device. [Figure 2] FIG. 2 is a diagram showing an example of a viewpoint-corresponding image. [Figure 3] FIG. 3 is a schematic diagram showing a layered structure of the display panel. [Figure 4] FIG. 4 is a cross-sectional view showing an example in which the light-emitting point pitch is six times the pixel pitch. [Figure 5] FIG. 5 is a diagram showing various parameters related to determining the X-coordinate of a pixel located on the ray of light between the viewpoint and the light-emitting point of light from the (i+1)th light source in the X direction from the origin. [Figure 6] FIG. 6 is a schematic diagram showing examples A and B of the relative angular relationship between a human face and a display device including a display panel. [Figure 7] FIG. 7 is a schematic diagram showing an example of the angle difference between the face and the display panel with respect to the vertical line and the horizontal line. [Figure 8] FIG. 8 is a schematic diagram showing an example of the relationship between the relative angle and the feasibility of individually outputting images to multiple viewpoints by controlling the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described with reference to FIGS. 3 and 4. [Figure 9] FIG. 9 is a schematic diagram showing another example of the relationship between the relative angle and the feasibility of individually outputting images to multiple viewpoints by controlling the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described with reference to FIGS. 3 and 4. [Figure 10] FIG. 10 is a schematic diagram showing an example of pixel arrangement control when the relative angle is 45 degrees (°). [Figure 11] FIG. 11 is a schematic diagram showing an example of pixel arrangement control when the relative angle is 90 degrees (°). [Figure 12] FIG. 12 is a schematic diagram showing an example of the relationship between the relative angle and the feasibility of individual output of images to a plurality of viewpoints when the arrangement control described with reference to FIGS. 10 and 11 is reflected. [Figure 13] FIG. 13 is a diagram showing various parameters related to the derivation of coordinates R_(i,j) and coordinates L_(i,j) based on the positional relationship between the light-emitting point located at coordinates LP(i,j) and the viewpoint. [Figure 14] 14 is a schematic diagram showing the relationship between the length width and the pixel U through which light passes from the light emitting point located at the coordinate LP(i,j) to the viewpoint. The length width is the length widthR or the length widthL. [Figure 15] Figure 15 is a schematic diagram showing an example of the difference between the position of the passing point P_(i,j) at a pixel located on the ray of light between the light emitting point LPP and the viewpoint, and the position of the passing point Q_(i,j) at a pixel located on the ray of light between the light emitting point LPQ and the viewpoint. [Figure 16] FIG. 16 is a diagram showing a coordinate system based on pixel PixU. [Figure 17] FIG. 17 is a schematic diagram showing an outline of drive control of pixel PixU according to the intersection position of the pixel PixU with the ray of light between the light emitting point and the viewpoint. [Figure 18] FIG. 18 is a diagram showing an example of a display output to which the sub-pixel control described with reference to FIG. 17 is applied. [Figure 19] FIG. 19 is a diagram showing another example of a display output to which the sub-pixel control described with reference to FIG. 17 is applied. [Figure 20] FIG. 20 is a diagram illustrating an example of a partial area within the display area of ​​the display panel of the display device. [Figure 21] FIG. 21 is a schematic diagram showing the positional relationship between light emission, pixels, and a viewpoint when there is substantially no positional deviation between the viewpoint and the display device. [Figure 22] FIG. 22 is a schematic diagram showing the positional relationship between light-emitting points, pixels, and a viewpoint when the viewpoint and the display device are in a relationship in which a positional shift is substantially generated. [Figure 23] FIG. 23 is a schematic diagram showing the positional relationship between the light-emitting point, pixel, and viewpoint when the transmission area controlled based on the positional relationship between the pixel and the passing point exceeds one pixel Pix. [Figure 24] FIG. 24 is a schematic diagram showing a drive control different from that shown in FIG. [Figure 25] FIG. 25 is a schematic diagram showing an example of the relationship between the display panel and two viewpoints and the angle of view for each viewpoint. [Figure 26] FIG. 26 is a schematic diagram showing the relationship between the width in the X direction of the light-emitting point where the range AN1 described with reference to FIG. 25 is established and the control pattern of the sub-pixel described with reference to FIGS. 23 and 24. [Figure 27] FIG. 27 is a schematic diagram showing the positional relationship in the Y direction between the light-emitting point, the pixel, and the viewpoint under conditions in which the sub-pixel control pattern described with reference to FIG. 16 and the like is applied. [Figure 28] FIG. 28 is a schematic diagram showing a drive control different from those in FIGS. [Figure 29] FIG. 29 is a schematic diagram showing the positional relationship between light-emitting points, pixels, and viewpoints when the sub-pixel control pattern described with reference to FIG. 28 is applied. [Figure 30] FIG. 30 is a schematic diagram showing an example of the relationship between the display panel and two viewpoints and the angle of view for each viewpoint. [Figure 31] FIG. 31 is a schematic diagram showing the relationship between the width in the Y direction of the light-emitting point where the range AN3 described with reference to FIG. 30 is established and the control pattern of the sub-pixel described with reference to FIGS. [Figure 32] FIG. 32 is a schematic diagram showing an example of a comparison between pixel widths PPx and PPy and an arrangement of sub-pixels. [Figure 33] FIG. 33 is a schematic diagram showing an example of a comparison between pixel widths PPx and PPy and an arrangement of sub-pixels. [Figure 34] FIG. 34 is a schematic diagram showing a distance Th that is determined so that the ratio between the value of distance D1 and the sum of distance Ph and distance Th is equal to the ratio between the value of distance Th and the value of distance D. DETAILED DESCRIPTION OF THE INVENTION

[0008] Each embodiment of the present disclosure will be described below with reference to the drawings. The disclosure is merely an example, and appropriate modifications that a person skilled in the art can easily conceive while maintaining the gist of the invention are naturally included within the scope of the present disclosure. Furthermore, to clarify the explanation, the drawings may show the width, thickness, shape, etc. of each part schematically compared to the actual embodiment, but these are merely examples and are not intended to limit the interpretation of the present disclosure. Furthermore, in this specification and each drawing, elements similar to those described above with reference to the previous drawings will be designated by the same reference numerals, and detailed descriptions may be omitted as appropriate.

[0009] 1 is a block diagram showing the main configuration of a display device 1. The display device 1 includes an imaging unit 2, a distance measurement unit 3, a signal processing unit 10, a display panel 20, and a light source 30. The display device 1 is an information processing device (information processing terminal) that combines an imaging function using the imaging unit 2, a distance measurement function using the distance measurement unit 3, and an image display output function using the signal processing unit 10, the display panel 20, and the light source 30, like a smartphone, for example.

[0010] The imaging unit 2 captures an image. Specifically, the imaging unit 2 has an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging unit 2 generates image data based on an electrical signal output by the imaging element.

[0011] The distance measuring unit 3 measures the distance between the display device 1 and an image capture target facing the image capture unit 2. Specifically, the distance measuring unit 3 includes, for example, a light emitting unit and a light detecting unit constituting a ToF (Time of Flight) sensor. The distance measuring unit 3 including the ToF sensor measures the distance based on the time difference between the light emitting timing when the light emitting unit emits light and the detection timing when the laser light emitted by the light emitting unit is reflected by the image capture target and detected by the light detecting unit. The specific mechanism by which the distance measuring unit 3 measures the distance is not limited to this. For example, an AF function of the camera, such as so-called contrast AF (Auto Focus), may be used, and the distance measured by the distance measuring unit 3 may be the distance at which the image is in focus determined by the AF function of the image capture unit 2. In the embodiment, the image capture unit 2 and the distance measuring unit 3 cooperate to function as an acquisition unit that acquires information indicating the positions of two viewpoints (a first viewpoint E1 (right eye) and a second viewpoint E2 (left eye) described later) of the user facing the display panel 20.

[0012] The imaging unit 2 is provided to capture an image of a user viewing the image display surface of the display panel 20. The distance measuring unit 3 is provided to measure the distance between the image display surface of the display panel 20 and the user viewing the image display surface. Specifically, the imaging unit 2 and the distance measuring unit 3 are arranged, for example, on one side of the housing of the display device 1 where the image display surface of the display panel 20 is exposed.

[0013] The signal processing unit 10 has an eye gaze tracking unit 11 and an image output unit 12. The eye gaze tracking unit 11 acquires information about the position of the user's eye gaze relative to the display panel 20 based on the outputs of the imaging unit 2 and the distance measuring unit 3. Details of the information about the eye gaze position will be described later.

[0014] Based on information about the position of the viewpoint acquired by the gaze tracking unit 11, the image output unit 12 outputs image data corresponding to the position of the viewpoint to the display panel 20. The image data output by the image output unit 12 is, for example, image data based on an image signal IP input to the display device 1 from an external information processing device, but may also be image data pre-stored in a storage device included in the display device 1. The image output unit 12 generates a viewpoint-corresponding image OP from image data based on the image signal IP or image data pre-stored in a storage device included in the display device 1, and outputs image data of the viewpoint-corresponding image OP that corresponds to the position of the viewpoint acquired by the gaze tracking unit 11 to the display panel 20.

[0015] FIG. 2 is a diagram showing an example of a viewpoint-corresponding image OP. As shown in FIG. 2, the viewpoint-corresponding image OP includes multiple pieces of image data. The multiple pieces of image data included in the viewpoint-corresponding image OP are image data corresponding to different viewpoints (more specifically, viewpoints corresponding to one eye of the observer). FIG. 2 illustrates 25 pieces of PNG (Portable Network Graphics) format data with file names sequentially numbered from "0001" to "0025," but the file names, formats, and number of images included in the viewpoint-corresponding image OP are not limited to this and can be changed as appropriate. The image output unit 12 outputs image data corresponding to the position of the viewpoint acquired by the gaze tracking unit 11 from the viewpoint-corresponding image OP including multiple images as exemplified in FIG. 2 to the display panel 20.

[0016] 1, the display panel 20 has a display panel driver circuit 21. The display panel driver circuit 21 has circuits, such as a DDIC (Display Driver Integrated Circuit), that perform various processes related to the image display output of the display panel 20. The display panel driver circuit 21 drives a plurality of pixels Pix included in the display panel 20 in accordance with image data output from the image output unit 12.

[0017] FIG. 3 is a schematic diagram showing the layered structure of the display panel 20. As shown in FIG. 3, the display panel 20 has a first substrate 22 and a second substrate 23. The first substrate 22 and the second substrate 23 are light-transmitting substrates such as glass substrates. The first substrate 22 and the second substrate 23 are layered with a liquid crystal layer sandwiched between them. The liquid crystal layer is sealed between the first substrate 22 and the second substrate 23. The display panel 20 is a so-called liquid crystal display panel.

[0018] Hereinafter, the opposing direction of first substrate 22 and second substrate 23 is referred to as the Z direction. One of the two directions perpendicular to the Z direction is referred to as the X direction, and the other is referred to as the Y direction. The X direction and the Y direction are perpendicular to each other.

[0019] The first substrate 22 has a multi-layer structure formed on its surface facing the second substrate 23. The multi-layer structure includes, for example, a first electrode layer on which multiple pixel electrodes are formed, a second electrode layer on which a common electrode to which a reference potential is applied to the multiple pixels Pix is ​​formed, a circuit-forming layer on which switching elements for transmitting signals individually to each of the multiple pixel electrodes and wiring connected to the switching elements are formed, and an insulating layer for insulating between these layers. The pixel electrodes are individually provided for the sub-pixels included in each of the multiple pixels Pix. The pixels Pix are driven under the control of the display panel driver circuit 21, so that the alignment direction of liquid crystal molecules overlapping the pixel electrodes from a planar viewpoint is controlled to correspond to the potential difference between the common electrode and the pixel electrode. The planar viewpoint refers to a viewpoint from the front, looking at a plane perpendicular to the Z direction (XY plane).

[0020] As shown in FIG. 16 (to be described later), each pixel Pix has a plurality of sub-pixels. For example, each pixel Pix has a sub-pixel provided with a color filter that transmits red (R) light, a sub-pixel provided with a color filter that transmits green (G) light, and a sub-pixel provided with a color filter that transmits blue (B) light. Note that it is not essential for each pixel Pix to have all of these sub-pixels. For example, one of two adjacent pixels Pix may have sub-pixels of some of the multiple colors of sub-pixels, and the other may have some of the other sub-pixels. Furthermore, some or all of the pixels Pix may have sub-pixels provided with color filters that transmit light of a color different from the colors exemplified here. Furthermore, sub-pixels with no colorless filters or color filters may be further provided, and light from these sub-pixels is recognized as, for example, white (W). Furthermore, when a pixel Pix includes the above three sub-pixels, the shape of the pixel Pix is ​​preferably a square (with the same length in the X direction and the Y direction), but a rectangular shape in which one of the sides in the X direction and the Y direction is longer than the other can also be used.

[0021] The second substrate 23 is provided with color filters individually provided for the sub-pixels included in each of the plurality of pixels Pix, a black matrix separating the color filters for each sub-pixel, etc. The common electrode may be provided on the second substrate 23 instead of the first substrate 22.

[0022] The pixel pitch PP shown in FIG. 3 is the width of one second pixel Pix2 in the X direction. Although the first pixel Pix1 and the second pixel Pix2 are depicted separately in FIG. 3, the first pixel Pix1 and the second pixel Pix2 share the same pixel Pix in terms of configuration, and there is no difference in configuration between the first pixel Pix1 and the second pixel Pix2. Therefore, the width of one pixel Pix in the X direction is the pixel pitch PP. Strictly speaking, the pixel pitch PP is the distance between the center line of one side of the black matrix surrounding one pixel Pix in the X direction, which is located at one end of the pixel Pix in the X direction, and the center line of the other side of the black matrix surrounding the pixel Pix in the X direction, which is located at the other end of the pixel Pix in the X direction. Alternatively, the pixel pitch may be the center-to-center distance between sub-pixels of the same color in adjacent pixels when viewed in the X direction.

[0023] The display panel 20 faces the light source 30 via the polarizing layer 24 and the spacer 40. The polarizing layer 24 is provided on the first substrate 22 side of the display panel 20 (the rear surface side of the display panel). The spacer 40 is a plate-like light-transmitting member, such as glass, arranged to face the first substrate 22 with the polarizing layer 24 in between. An adhesive layer 42 is interposed between the spacer 40 and the polarizing layer 24. The adhesive layer 42 bonds the polarizing layer 24 and the spacer 40. Note that if a support material can be provided to maintain the distance between the light source 30 and the polarizing layer 24, a configuration in which an air layer is provided between them can also be adopted.

[0024] As shown in FIG. 3 , the light source 30 includes a surface light source 31, light-emitting points 32, and a light-shielding member 33. The surface light source 31 is a surface light source in which at least the surface facing the display panel 20 emits light. To give a specific configuration example, the surface light source 31 includes, for example, a light guide plate facing the display panel 20 in the Z direction, and a light source element (e.g., an LED (Light Emitting Diode)) that introduces light into the light guide plate from a direction perpendicular to the Z direction. The arrangement of the surface light source 31 shown in FIG. 3 illustrates the arrangement of the light guide plate, and the light source element is not shown. The light-emitting points 32 are holes formed in the light-shielding member 33. The light-shielding member 33 covers the surface of the surface light source 31 facing the spacer 40, except for the area where the light-emitting points 32 are formed. An adhesive layer 43 is interposed between the light-shielding member 33 and the spacer 40. The adhesive layer 43 bonds the polarizing layer 24 and the spacer 40 together. The adhesive layers 42 and 43 are a light-transmitting functional film having double-sided adhesiveness, such as OCA (Optical Clear Adhesive). The light source 30 irradiates the display panel 20 with light generated by the surface light source 31 from a plurality of light-emitting points 32.

[0025] The light-emitting point pitch SpP shown in Fig. 3 is the distance between the center lines of the light-emitting points 32 adjacent to each other in the X direction. The light-emitting point pitch SpP is 4n or 6n times the pixel pitch PP. n is a natural number. n is, for example, 1, but may be 2 or more. Fig. 3 illustrates an example in which the light-emitting point pitch SpP is four times the pixel pitch PP.

[0026] As described above, the image output unit 12 outputs image data corresponding to the position of the viewpoint acquired by the gaze tracking unit 11 from the viewpoint-corresponding image OP to the display panel 20. Hereinafter, when an image is mentioned without special mention, it refers to an image displayed by the display panel 20 in accordance with the image data output by the image output unit 12. The display panel 20 performs display output corresponding to the image data. Therefore, the display panel 20 displays an image corresponding to the position of the viewpoint acquired by the gaze tracking unit 11. FIG. 3 schematically shows the display panel 20 in a state in which images corresponding to the first viewpoint E1 and the second viewpoint E2 are displayed and output, respectively. The first pixel Pix1 is a pixel Pix controlled to display and output an image corresponding to the first viewpoint E1. The second pixel Pix2 is a pixel Pix controlled to display and output an image corresponding to the second viewpoint E2.

[0027] The first viewpoint E1 corresponds to the user's right eye. The second viewpoint E2 corresponds to the user's left eye. The midpoint CP is the midpoint on the line between the first viewpoint E1 and the second viewpoint E2. The position of the midpoint CP generally corresponds to the position of the user's nose in the arrangement direction of the first viewpoint E1 and the second viewpoint E2. FIG. 3 shows a case where the arrangement direction of the first viewpoint E1 and the second viewpoint E2 is the X direction. If the distance in the X direction between the first viewpoint E1 and the midpoint CP and the distance in the X direction between the second viewpoint E2 and the midpoint CP are distance D1, and the distance in the X direction between the first viewpoint E1 and the second viewpoint E2 is distance D2, then distance D2 is twice distance D1.

[0028] Coordinates indicating the position of the midpoint CP relative to the predetermined origin of the display panel 20 can be expressed as (pos_x, pos_y, pos_h). pos_x is the X-coordinate of the midpoint CP. pox_y is the Y-coordinate of the midpoint CP. pox_h is the Z-coordinate of the midpoint CP. The X- and Y-coordinates of the predetermined coordinates of the origin of the display panel 20 are, for example, one of the four vertices of a rectangular display area, as viewed from a planar perspective, in which multiple pixels Pix are arranged on the display panel 20. Alternatively, the center of the display area of ​​the display panel 20 may be the origin. The Z-coordinate of the predetermined coordinates of the origin of the display panel 20 is the position on the center line of the pixels Pix (for example, the first pixel Pix1 and the second pixel Pix2 shown in FIG. 3) in the Z direction. Specifically, the center line of pixel Pix in the Z direction is the center line of the liquid crystal layer sealed between the first substrate 22 and the second substrate 23 in the Z direction, and is preferably located at a height position of d / 2, where d is the cell gap in the display panel 20. The predetermined position of the origin of the display panel 20 is not limited to this and can be any position. Hereinafter, unless otherwise specified, the term "origin" refers to the predetermined origin of the display panel 20.

[0029] The gaze tracking unit 11 identifies the positions of the user's two eyes (right eye and left eye) included in the image captured by the imaging unit 2 within the captured image. This identification is performed, for example, based on pattern matching, but is not limited to this and may be performed, for example, based on image recognition using machine learning. Information indicating the relationship between each position within the imaging range of the captured image and its X-direction coordinate and Y-direction coordinate is held in advance by the signal processing unit 10 and prepared so that it can be referenced by the gaze tracking unit 11. The gaze tracking unit 11 considers the midpoint between the right eye and the left eye in the image captured by the imaging unit 2 as a midpoint CP and identifies the X-direction coordinate and the Y-direction coordinate of the midpoint CP. Note that the method of identifying the position of the midpoint CP is merely an example and is not limited thereto and can be changed as appropriate. For example, the gaze tracking unit 11 may identify the midpoint CP based on the positional relationship between the positions of the user's two eyes (right eye and left eye) included in the image captured by the imaging unit 2 and the position of the user's nose. Furthermore, the gaze tracking unit 11 acquires the value of the distance measured by the distance measuring unit 3 as the value of pos_h. The gaze tracking unit 11 regards the midpoint between the right eye and the left eye in the image captured by the imaging unit 2 as a midpoint CP, and sets the position of the midpoint CP in the Z direction as pos_h. In this way, the gaze tracking unit 11 derives information about the position of the viewpoint.

[0030] Light emitted from each light-emitting point 32 reaches a first viewpoint E1 and a second viewpoint E2. Here, a first pixel Pix1 is located on a ray L1 of light reaching the first viewpoint E1 from each light-emitting point 32. Furthermore, a second pixel Pix2 is located on a ray L2 of light reaching the second viewpoint E2 from each light-emitting point 32. The image output by the first pixel Pix1 and the image output by the second pixel Pix2 are different images. The image output by the first pixel Pix1 is an image corresponding to the position of the first viewpoint E1. The image output by the second pixel Pix2 is an image corresponding to the position of the second viewpoint E2. More specifically, for example, the image 0014.png in FIG. 2 is used as the right-eye viewpoint image, and the image 0012.png is used as the left-eye viewpoint image. These images are combined by a signal processing unit and displayed as a single image (stereoscopic display image). More specifically, the stereoscopic display image, 0014.png, and 0012.png have the same number of pixels. For example, if pixels (n, m+1) (the left indicates the nth row, m+1th position; the same applies hereinafter in this paragraph), (n, m+2), (n, m+3), and (n, m+4) in a pixel row of the stereoscopic display image need to be displayed as left-eye images, left-eye images, right-eye images, and right-eye images, respectively, the pixels (signals) corresponding to (n, m+1) and (n, m+2) in the stereoscopic display image are the pixel signals corresponding to (n, m+1) and (n, m+2) in 0012.png, the left-eye image. Similarly, the pixels (signals) corresponding to (n, m+1) and (n, m+2) in the stereoscopic display image are the pixel signals corresponding to (n, m+3) and (n, m+4) in 0014.png, the right-eye image. Furthermore, depending on the relationship between the user's viewpoint position and each light source (light-emitting point 32), there may be a pixel Pix that does not need to display any image. In this case, the pixel Pix displays an image with the lowest brightness (e.g., a black image). The image output unit 12 outputs image data corresponding to each of a plurality of viewpoints (e.g., a first viewpoint E1 and a second viewpoint E2) to the display panel 20 so that such an image can be displayed.

[0031] The distance in the Z direction between the center line of pixel Pix in the Z direction and midpoint CP can be expressed as distance Ph. The magnitude of distance Ph corresponds to the magnitude of the value of pos_h described above. The distance in the Z direction between the center line of pixel Pix in the Z direction and the point where light starts to be emitted from light-emitting point 32 can be expressed as distance Th. Note that distance Th is significantly smaller than distance Ph. In consideration of this, the center line of pixel Pix in the Z direction may be defined on the same plane as the pixel electrode, or may be defined on the same plane as the rear surface or front surface of second substrate 23, or the front surface of a cover glass provided on display panel 20. In the embodiment, the Z direction position of the point where light starts to be emitted from light-emitting point 32 is the position of the boundary line between light-shielding member 33 and adhesive layer 43.

[0032] The relationship between the light-emitting point pitch (e.g., light-emitting point pitch SpP or light-emitting point pitch SpP2) between light-emitting points 32 adjacent to each other in the X direction, the pitch (pixel pitch PP) of pixels Pix aligned in the X direction, and the relationship between light emitted from each of the light-emitting points 32 to each of the plurality of viewpoints will be described below with reference to Fig. 4. Fig. 4 is a cross-sectional view showing a cut surface of the display panel 20A cut along a plane (XZ plane) perpendicular to the Y direction, similar to the display panel 20 in Fig. 3. The display panel 20 shown in Fig. 1 may be the display panel 20A shown in Fig. 4 and subsequent figures.

[0033] FIG. 4 is a cross-sectional view illustrating an example in which the light-emitting point pitch SpP2, unlike the light-emitting point pitch SpP shown in FIG. 3, is six times the pixel pitch PP. In FIG. 4 and other figures referred to in the description of the embodiment, the rays L(m)1 and L(m)2, connected via a dashed line, are actually a single light ray that shares a common ray. For example, ray L321, which is the ray L(m)1 when m = 32, indicates the ray of light emitted from a single light-emitting point 32. The light emitted by this ray reaches the first viewpoint EC as ray L322, which is the ray L(m)2 when m = 32. While similar expressions are used below, the distance between the display panel 20 and the viewpoint is significantly greater than the pixel pitch PP, etc., and these relationships should be understood as being shown in a single diagram. In FIG. 4, m is a natural number between 32 and 35 or a natural number between 42 and 45. When m is a natural number from 32 to 35, the light ray and ray L31 are light rays that pass through the first pixel PixC and reach the first viewpoint EC. When m is a natural number from 42 to 45, the light ray and ray L41 are light rays that pass through the second pixel PixD and reach the second viewpoint ED. In Figure 4, a line that runs along the Z direction and passes through the second viewpoint ED is shown as a dashed dotted line PS2.

[0034] The first viewpoint EC is either the first viewpoint E1 or the second viewpoint E2 (see FIG. 3). The second viewpoint ED is the other of the first viewpoint E1 or the second viewpoint E2. When the first viewpoint EC is the first viewpoint E1, the first pixel PixC is the first pixel Pix1 (see FIG. 3). When the second viewpoint ED is the second viewpoint E2, the second pixel PixD is the second pixel Pix2 (see FIG. 3).

[0035] 4, the display panel 20A has a configuration in which six pixels Pix are arranged within a light-emitting point pitch SpP2, which is the distance between the center lines of two light-emitting points 32 adjacent to each other in the X direction. The X-direction position of the center lines of each of the two light-emitting points 32 overlaps with the X-direction position of the boundary line between the two pixels Pix adjacent to each other in the X direction when viewed from a plan view.

[0036] For example, as shown in Fig. 4, two of the six pixels Pix are controlled as first pixels PixC. The other two of the six pixels Pix are controlled as second pixels PixD. Of the six pixels Pix, a pixel Pix that does not correspond to either the first pixel PixC or the second pixel PixD is set as a third pixel PixE. The third pixel PixE is a pixel Pix that has the lowest degree of light transmission (for example, black display).

[0037] As shown by ray L41, the ray of light that passes through a second pixel PixD located opposite the second viewpoint ED in the Z direction and reaches the second viewpoint ED, i.e., the ray of light from a light-emitting point 32 located opposite the second viewpoint ED in the Z direction, runs along the Z direction. In FIG. 4, a line that runs along the Z direction and passes through the second viewpoint ED is shown as a dashed-dotted line PS2. Using the light-emitting point 32 that emits ray L41 as a reference, light that reaches the second viewpoint ED from other light-emitting points 32 located farther away from the light-emitting point 32 in the X direction has a ray of light that has a greater inclination angle with respect to the Z direction, as shown by rays L42, L43, L44, L45, and L46, as the distance in the X direction from the light-emitting point 32 increases. Based on these light ray projections, it is determined which of the multiple pixels Pix is ​​to be controlled as the second pixel PixD. Using a similar concept, as shown by the relationship between rays L31, L32, L33, L34, L35, and L36 and the first pixel PixC, which of the multiple pixels Pix will be controlled as the first pixel PixC is determined based on the ray of light emitted from the light emitting point 32 and reaching the first viewpoint EC.

[0038] Depending on the difference in the inclination angles of the rays L42, L43, L44, L45, and L46 relative to the Z direction, the pixels Pix controlled as the second pixels PixD may not necessarily be arranged at equal intervals in the X direction in some locations. Similarly, the pixels Pix controlled as the first pixels PixC may not necessarily be arranged at equal intervals in the X direction in some locations. In response to this control of the arrangement of the first pixels PixC and the second pixels PixD, the third pixels PixE may be arranged as appropriate, or the degree of light transmission may be controlled on a sub-pixel basis, as will be described later with reference to FIG. 17 and other figures. Such arrangement control can more reliably reduce the possibility of crosstalk.

[0039] 4, the midpoint CP is located on the dashed dotted line PC that overlaps with the center line in the X direction of one light-emitting point 32, but it is not essential that the midpoint CP be located at a position that overlaps with the center line in the X direction of the light-emitting point 32. The correspondence between the light from each light-emitting point 32, the positional relationship between the first viewpoint EA and the second viewpoint EB according to the position of the midpoint CP, and the control of the pixels Pix, which are the first pixel PixA and the second pixel PixB, is as described with reference to FIG. 4, regardless of the position of the midpoint CP.

[0040] Next, the basic concept of drive control of the pixel Pix according to the relative positional relationship between the viewpoint and the light emission start point will be described with reference to FIG.

[0041] FIG. 5 is a diagram showing various parameters related to determining the X-direction coordinates R_x(i), L_x(i) of a pixel Pix located on the ray of light between the light-emitting point LP(i) of light from the (i+1)th light source in the X direction from the origin and the viewpoints ER, EL.

[0042] The light-emitting point LP(0) shown in FIG. 5 indicates the emission start point of light from the light-emitting point (e.g., light-emitting point 32) located at the position (first) closest to the origin in the X direction. The light-emitting point LP(i) indicates the emission start point of light from the light-emitting point (e.g., light-emitting point 32) located at the (i+1)th closest position counting from the origin in the X direction. For example, when i=1, the light-emitting point LP(1) indicates the emission start point of light from the light-emitting point (e.g., light-emitting point 32) located at the next closest position (second closest) to the light-emitting point LP(0) counting from the origin in the X direction. Therefore, i is an integer greater than or equal to 0.

[0043] In FIG. 5, the distance in the X direction between the origin and the light-emitting point LP(0) is defined as offset. The distance in the X direction between the origin and the light-emitting point LP(i) can be expressed as offset+(pitch×i). The magnitude of the value of pitch corresponds to the magnitude of the light-emitting point pitch SpP or the magnitude of the light-emitting point pitch SpP2 described above. The offset and offset+(pitch×i) are values ​​determined in advance according to the design of the display device 1, and are parameters that can be referenced in calculations related to determining the coordinates R_x(i) and L_x(i) in the X direction.

[0044] The magnitude of the distance Ph, which will be explained with reference to FIG. 3 and is also shown in FIG. 5, corresponds to the magnitude of the value of pos_h. The magnitude of the distance Px, shown in FIG. 5, corresponds to the magnitude of the value of pos_x. The distance in the Z direction between the light-emitting point LP(0) and the light-emitting point LP(i) and the origin is the distance Th described above. pos_h and pos_x can be acquired by the imaging unit 2 and the distance measuring unit 3.

[0045] Hereinafter, the distance in the X direction between the origin and the coordinate R_x(i) is defined as shiftR_x(i). Also, the distance in the X direction between the coordinate R_x(i) and the viewpoint ER is defined as widthR(i). Also, the distance in the X direction between the light-emitting point LP(i) and the viewpoint ER is defined as widthR_LED(i). The viewpoint ER is the viewpoint of the user's right eye, and is either the first viewpoint E1, EC or the second viewpoint E2, ED.

[0046] Also, the distance in the X direction between the origin and the coordinate L_x(i) is defined as shiftL_x(i). Also, the distance in the X direction between the coordinate L_x(i) and the viewpoint EL is defined as widthL(i). Also, the distance in the X direction between the light-emitting point LP(i) and the viewpoint EL is defined as widthL_LED(i). The viewpoint EL is the viewpoint of the user's left eye, and is the other of the first viewpoint E1, EC or the second viewpoint E2, ED.

[0047] The widthR_LED(i) can be expressed by the following formula (1). D1 in formula (1) etc. is a value indicating the magnitude of the distance D1 described with reference to FIG. 3 and also shown in FIG. 5. The value indicating the magnitude of the distance D1 can be set to a predetermined value based on the average value of a typical user. In the embodiment, the distance D1 is, for example, 31.25 millimeters (mm), but is not limited to this and can be changed as appropriate. widthR_LED(i)=pos_x-D1-{offset+(pitch×i)}…(1)

[0048] The widthR(i) can be expressed by the following formula (2). In formula (2) etc., Th is a value indicating the magnitude of the distance Th. The distance Th is determined in advance according to the design of the display device 1. The idea behind determining the distance Th at the time of design will be described later. widthR(i)=widthR_LED(i)×pos_h / (pos_h+Th)…(2)

[0049] shiftR_x(i) can be expressed as the following equation (3). shiftR_x(i)=pos_x-D1-widthR(i)…(3)

[0050] R_x(i) can be expressed as in the following equation (4). PP in equation (4) etc. is a value indicating the magnitude of the pixel pitch PP. The pixel pitch PP is determined in advance according to the design of the display device 1. Also, int() in equation (4) etc. indicates that an integer value is obtained by truncating the decimal point of the value in parentheses. R_x(i)=int(shiftR_x(i) / PP)…(4)

[0051] The widthL_LED(i) can be expressed as the following equation (5). widthL_LED(i)=pos_x+D1-{offset+(pitch×i)}…(5)

[0052] The widthL(i) can be expressed as the following equation (6). widthL(i)=widthL_LED(i)×pos_h / (pos_h+Th)…(6)

[0053] shiftL_x(i) can be expressed as the following equation (7). shiftL_x(i)=pos_x+D1-widthL(i)…(7)

[0054] L_x(i) can be expressed as the following equation (8). L_x(i)=int(shiftL_x(i) / PP)…(8)

[0055] By designating the pixel Pix arranged corresponding to R_x(i) as the first pixel Pix1, PixC and the pixel Pix arranged corresponding to L_x(i) as the second pixel Pix2, PixD, it is possible to realize display output control according to the positions of the first viewpoint E1, EC and the second viewpoint E2, ED as described with reference to Figures 3 and 4.

[0056] Next, the relative relationship between the alignment direction of two human eyes and the X and Y directions corresponding to the arrangement of the pixels Pix of the display panel 20A will be described with reference to FIGS.

[0057] 6 is a schematic diagram showing examples A and B of the relative angular relationship between a human face HF and a display device 1 including a display panel 20A. Note that the rectangular display panel 20A shown in FIG. 6 and other figures has its longitudinal direction in the Y direction.

[0058] In Example A of FIG. 6, a reference line CLX that runs along the alignment direction of the two eyes on the face HF and passes through the midpoint CP is parallel to the X direction of the display panel 20A. Also, both the midline CLY of the face HF (see "Example B," FIG. 7) and the line that bisects the display panel 20A in the X direction overlap with the line CL. Also, the Y direction and the line CL are parallel. In Example A, similar to the explanation given with reference to FIGS. 3 and 4, the alignment direction of the first viewpoints E1, EC and the second viewpoints E2, ED is along the X direction. Therefore, in Example A, the display output control based on the explanation given with reference to FIGS. 3 and 4 can be applied as is.

[0059] On the other hand, in example B of Figure 6, neither the midline CLY of the face HF nor the line bisecting the display panel 20A in the X direction overlaps with the line CL. Furthermore, the angle pos_r, which is the angle of the face HF relative to the line CL, differs from the angle dev_rot, which is the angle of the display panel 20A relative to the line CL. The angle pos_r is the angle formed by the midline CLY and the line CL. The angle dev_rot is the angle formed by the Y direction and the line CL.

[0060] In example A, it can be considered that the angle pos_r and the angle dev_rot are both 0 degrees (°).

[0061] 7 is a schematic diagram showing an example of the angular difference between the face HF and the display panel 20A based on the vertical line H and the horizontal line V. The vertical line H is aligned with the direction of gravity of the Earth. The horizontal line V is aligned with a plane perpendicular to the vertical line H. The vertical line H shown in FIG. 7 corresponds to the line CL in FIG.

[0062] The face HF shown in Figure 7 includes coordinates P1, P2, and P3. Coordinate P1 indicates the position of the first viewpoint E1, EC. Coordinate P2 indicates the position of the second viewpoint E2, ED. Coordinate P3 indicates a predetermined position (for example, the position of the nose) that overlaps with the midline of the face HF. The coordinates indicating the positions of coordinates P1, P2, and P3 are acquired based on image data captured by the imaging unit 2 and the distance measurement unit 3.

[0063] As a specific example, the gaze tracking unit 11 can identify the X- and Y-coordinates of the positions of the two eyes and nose on a human face HF using image processing technology using OpenCV. The gaze tracking unit 11 performs processing to derive a reference line CLX passing through coordinates P1 and P2. The gaze tracking unit 11 also performs processing to derive a median line CLY as a straight line that is perpendicular to the reference line CLX and passes through coordinate P3. The gaze tracking unit 11 also determines the midpoint between coordinates P1 and P2 as a midpoint CP, and derives the coordinates (pos_x, pos_y, pos_z) of the midpoint CP from the coordinates (X1, Y1, Z1) of coordinate P1 and the coordinates (X2, Y2, Z2) of coordinate P2. Generally, the midpoint CP coincides with the intersection of the reference line CLX and the median line CLY. Among the coordinates P1, P2, and P3, the coordinates (Z1, Z2, Z3) in the Z direction are measured by the distance measurement unit 3. The coordinate (pos_z) in the Z direction of the midpoint CP is treated as the distance Ph.

[0064] Furthermore, the gaze tracking unit 11 acquires information (tilt information) indicating the tilt direction of the display panel 20A relative to the vertical line H and the horizontal line V from the gyro sensor 4 included in the display device 1. The gaze tracking unit 11 derives the angle dev_rot based on the tilt information. The gaze tracking unit 11 identifies the orientations of the display panel 20A in the X direction and the Y direction relative to the vertical line H and the horizontal line V based on the relationship between the vertical line H, the horizontal line V, and the angle dev_rot.

[0065] The gaze tracking unit 11 derives the relative angle rot formed between the reference line CLX and the X direction. In the following description, if the relative angle rot is a positive value, it means that the midline CLY of the face HF is oriented so as to form an angle in the clockwise direction with respect to the Y direction of the display panel 20A. If the relative angle rot is a negative value, it means that the midline CLY of the face HF is oriented so as to form an angle in the counterclockwise direction with respect to the Y direction of the display panel 20A. The relative angle rot can be expressed, for example, in the range from -180 degrees (°) to 180 degrees (°). The angle pos_r is the sum of the angle dev_rot and the relative angle rot.

[0066] The image output unit 12 performs various processes related to display output control for displaying the viewpoint-corresponding image OP on the display panel 20A by referring to information indicating the coordinates (pos_x, pos_y, pos_z) of the midpoint CP and information indicating the relative angle rot (or angle pos_r and angle dev_rot) among the various pieces of information derived and identified by the gaze tracking unit 11. Details of these processes will be described below.

[0067] Depending on the relative angle rot, it may not be possible to achieve individual output of images to multiple viewpoints by controlling the pixels Pix along the X direction of the first pixels Pix1, PixC and the second pixels Pix2, PixD as described with reference to Figures 3 and 4. Below, we will explain the relationship between the relative angle rot and the feasibility of stereoscopic vision.

[0068] FIG. 8 is a schematic diagram showing an example of the relationship between the relative angle rot and the feasibility of individually outputting images to multiple viewpoints by controlling the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described with reference to FIGS. 3 and 4.

[0069] In Figure 8, the "Person" column schematically shows the direction of the person's face HF relative to the display panel 20A shown in the "Device" column. The "Device" column shows the range in which the person's line of sight is directed toward the display panel 20A of the display device 1 as one of ranges Fo1, Fo2, or Fo3. The "Relationship between Output and Recognition (Planar Viewpoint)" column schematically shows the relationship between the light-emitting point 32 and the pixel Pix in a portion of the display panel 20A that includes one of the ranges Fo1, Fo2, or Fo3 shown in the "Device" column. The "Relationship between Output and Recognition (Cross-Sectional Viewpoint)" column shows a cross section at the position indicated by the dashed line and arrow in the "Relationship between Output and Recognition (Planar Viewpoint)."

[0070] When the relative angle rot is 0 degrees (°), as shown schematically in the range Fo1 of the "Relationship between Output and Recognition (Cross-Sectional Viewpoint)," light L3 that passes through the first pixel PixC reaches the first viewpoint EC, and light L4 that passes through the second pixel PixD reaches the second viewpoint ED, by controlling the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD, as described with reference to Figures 3 and 4. In other words, when the relative angle rot is 0 degrees (°), individual output of images to multiple viewpoints can be realized by controlling the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD, as described with reference to Figures 3 and 4.

[0071] On the other hand, when the relative angle rot is 45 degrees (°), as shown schematically in the range Fo2 of the "Relationship Between Output and Recognition (Cross-Sectional Viewpoint)," simply applying the control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described with reference to FIGS. 3 and 4 does not establish a ray of light between the first pixel PixC and the first viewpoint EC and a ray of light between the second pixel PixD and the second viewpoint ED. In other words, when the relative angle rot is 45 degrees (°), simply applying the control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described with reference to FIGS. 3 and 4 makes it difficult to achieve individual output of images to multiple viewpoints. The same applies when the relative angle rot is 90 degrees (°), as shown schematically in the range Fo3 of the "Relationship Between Output and Recognition (Cross-Sectional Viewpoint)."

[0072] Fig. 9 is a schematic diagram showing another example of the relationship between the relative angle rot and the feasibility of individually outputting images to multiple viewpoints by controlling the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described with reference to Figs. 3 and 4. In the configuration shown in Fig. 9, a linear light source 32A is provided instead of the light-emitting point 32 described with reference to Fig. 8. The light-emitting point 32 shown in Fig. 8 is a hole or a light-emitting element that functions as a so-called point light source. On the other hand, the linear light source 32A shown in Fig. 9 is a slit or a light-emitting element that functions as a linear light source along the Y direction.

[0073] Even when a linear light source 32A is used instead of the light-emitting point 32, if the relative angle rot is 0 degrees (°), individual output of images to multiple viewpoints can be achieved by controlling the pixels Pix of the first pixel PixC and the second pixel PixD along the X direction as described with reference to FIGS. 3 and 4. Also, when a linear light source 32A is used instead of the light-emitting point 32, if the relative angle rot is 45 degrees (°), as shown in the "45°" column of FIG. 9, individual output of images to multiple viewpoints can sometimes be achieved by controlling the pixels Pix of the first pixel PixC and the second pixel PixD along the X direction as described with reference to FIGS. 3 and 4, but this is not guaranteed. On the other hand, if the relative angle rot is 90 degrees (°), it is difficult to achieve individual output of images to multiple viewpoints simply by applying the control of the pixels Pix of the first pixel PixC and the second pixel PixD along the X direction as described with reference to FIGS. 3 and 4, regardless of whether the light-emitting point 32 or the linear light source 32A is used.

[0074] As described with reference to Figures 8 and 9, simply applying the control of the pixels Pix along the X direction of the first pixels Pix1 and PixC and the second pixels Pix2 and PixD described with reference to Figures 3 and 4 may make it difficult to achieve individual output of images to multiple viewpoints depending on the relative angle rot. Therefore, in this embodiment, processing (relative angle corresponding processing) is performed to more appropriately control the arrangement of the first pixels Pix1 and PixC and the second pixels Pix2 and PixD in accordance with the relative angle rot. An overview of this processing will be described below with reference to Figures 10 to 12.

[0075] Fig. 10 is a schematic diagram showing an example of pixel arrangement control when the relative angle rot is 45 degrees (°). Fig. 11 is a schematic diagram showing an example of pixel arrangement control when the relative angle rot is 90 degrees (°). Note that the arrangement control of the first pixel PixC and the second pixel PixD in the "Processing Not Reflected" column of Figs. 10 and 11 is the same as that in the "45°" column of Fig. 8. In the embodiment, pixel arrangement control is performed according to the relative angle rot, as shown in the "Processing Reflected" column.

[0076] 10 and 11, the pixel corresponding to the first pixel PixC when the control of the pixels Pix along the X direction of the first pixels Pix1 and PixC and the second pixels Pix2 and PixD described with reference to Figures 3 and 4 is applied is designated as the first pixel PixCB, and the pixel corresponding to the second pixel PixD is designated as the first pixel PixDB. Furthermore, the pixel corresponding to the first pixel PixC determined by the relative angle correspondence process applied in the embodiment is designated as the first pixel PixCA, and the pixel corresponding to the second pixel PixD is designated as the second pixel PixDA.

[0077] For example, when the control of the pixels Pix along the X direction of the first pixels Pix1 and PixC and the second pixels Pix2 and PixD described with reference to FIGS. 3 and 4 is reflected, a first image GC and a second image GD are output so as to be aligned in the X direction within the display panel 20A, as shown in the “Whole” column of the “Unreflected Processing” column in FIGS. 10 and 11 . The first image GC is an image perceived by light passing through the first pixel PixC. The second image GD is an image perceived by light passing through the second pixel PixD. If the relative angle rot is 0 degrees (°), a stereoscopic view is achieved using the first image GC and the second image GD shown in the “Whole” column of the “Unreflected Processing” column. On the other hand, if the relative angle rot is 45 degrees (°) or 90 degrees (°), a stereoscopic view is difficult to achieve using the first image GC and the second image GD shown in the “Whole” column of the “Unreflected Processing” column.

[0078] Therefore, as shown in the "Overall" column of "Processing Reflection" in FIGS. 10 and 11, pixel arrangement control is performed according to the relative angle rot so that the first image GCA and the second image GDA correspond to the arrangement direction of the two eyes in the face HF within the display panel 20A. The first image GCA is an image recognized by light passing through the first pixel PixCA. The second image GDA is an image recognized by light passing through the second pixel PixDA. As shown by the comparison between the first image GC and the first image GCA and the second image GD and the second image GDA, the first image GCA is an image similar to the first image GC. The second image GDA is an image similar to the second image GD. Meanwhile, the relative positional and angular relationship between the first image GCA and the second image GDA is different from the relative positional and angular relationship between the first image GC and the second image GD. The relative positional and angular relationship between the first image GCA and the second image GDA is shifted according to the relative angle rot to correspond to the arrangement direction of the two eyes in the face HF. The process for controlling the arrangement of the first pixel PixCA and the second pixel PixDA is performed so that the relative positional and angular relationship between the first image GCA and the second image GDA is established.

[0079] Fig. 12 is a schematic diagram showing an example of the relationship between the relative angle rot and the feasibility of individual output of images to multiple viewpoints when the arrangement control described with reference to Figs. 10 and 11 is reflected. As shown in the "45°" and "90°" columns in Fig. 12, when the arrangement control described with reference to Figs. 10 and 11 is reflected, light L3 that passes through the first pixel PixCA reaches the first viewpoint EC, and light L4 that passes through the second pixel PixDA reaches the second viewpoint ED. In other words, the arrangement control described with reference to Figs. 10 and 11 makes it possible to realize individual output of images to multiple viewpoints.

[0080] 10 to 12 are described taking as examples the case where the relative angle rot is 45 degrees (°) or 90 degrees (°), but in the embodiment, regardless of the value of the relative angle rot, the arrangement of the first pixel PixCA and the second pixel PixDA with respect to the light-emitting point LP such as the light-emitting point 32 or the linear light source 32A can be made to correspond to the arrangement direction of the two eyes in the face HF. That is, in the embodiment, regardless of the relative angle rot, it is possible to realize individual output of images to multiple viewpoints by controlling the pixels Pix of the first pixel PixC and the second pixel PixD along the X direction as described with reference to FIGS.

[0081] Hereinafter, more specific processing contents regarding the placement control explained with reference to FIGS. 10 to 12 will be explained.

[0082] Figure 13 is a diagram showing various parameters related to the derivation of coordinates R_(i,j) and coordinates L_(i,j) based on the positional relationship between the light-emitting point LP located at coordinates LP(i,j) and the viewpoints ER and EL.

[0083] As described above, the distance in the X direction between the origin and the light-emitting point LP(i) can be expressed as offset + (pitch × i). Hereinafter, when LEDx(i) is used in the equation, LEDx(i) = offset + (pitch × i). Furthermore, when the light-emitting points LP are arranged in a matrix along the X and Y directions, the coordinates of the light-emitting point LP include not only the information on the X-direction coordinate (i) but also the information on the Y-direction coordinate (j). Here, the light-emitting point LP(j) indicates the emission start point of light from the light-emitting point (e.g., the light-emitting point 32) that is located at the j+1th closest position counting from the origin in the Y direction. Therefore, j is an integer equal to or greater than 0. Furthermore, the light-emitting point LP(0) and the light-emitting point LP(i) in FIG. 5 are also the light-emitting point LP(0) or the light-emitting point LP(j) in FIG. 14. In other words, when the light-emitting points LP are arranged in a matrix along the X and Y directions, the coordinates LP(i, j) of the light-emitting point LP include information on the X-direction coordinate and the Y-direction coordinate.

[0084] If the distance in the Y direction between the origin and the light-emitting point LP(i,0) is defined as offset_Y, the distance in the Y direction between the origin and the light-emitting point LP(j) can be expressed as offset_Y + (pitch_Y × j). In the following equations, if LEDy(j) is used, then LEDy(j) = offset_Y + (pitch_Y × j). The magnitude of the value of pitch_Y corresponds to the distance between the center lines in the Y direction of two light-emitting points LP adjacent in the Y direction. offset_Y and offset_Y + (pitch_Y × j) are values ​​determined in advance according to the design of the display device 1, and are parameters that can be referenced in calculations related to determining the coordinate Y(j) in the Y direction.

[0085] Here, the coordinates of the viewpoint ER are (PosR_x, PosR_y). PosR_x indicates the coordinate in the X direction of the viewpoint ER. PosR_y indicates the coordinate in the Y direction of the viewpoint ER. PosR_x can be expressed as in the following equation (9). PosR_y can be expressed as in the following equation (10). In equation (10) and equations (14) and (23) described later, sin indicates sine. In equation (9) and equations (13) and (24) described later, cos indicates cosine. Note that rot in each equation is the value of the relative angle rot. PosR_x=pos_x+D1×cos(rot / 180)…(9) PosR_y=pos_y+D1×sin(rot / 180)…(10)

[0086] The length of the ray of light between the center of the light-emitting point LP located at the coordinate LP(i,j) and the viewpoint ER is defined as widthR_LED. Furthermore, the length of the ray of light between the viewpoint ER and the coordinate R_(i,j) where pixel Pix is ​​located in the Z direction, which is a coordinate located on the ray of light between the center of the light-emitting point LP located at the coordinate LP(i,j), and the viewpoint ER, is defined as widthR. The ratio of the length widthR to the length widthR_LED can be expressed as in the following equation (11). pos_h in equation (11) and equation (15) described later is derived by the distance measurement unit 3, as described above. th in equation (11) and equation (15) described later is predetermined as a design item. Furthermore, the length widthR_LED can be expressed as in equation (12). widthR:widthR_LED=pos_h:(pos_h+th)…(11) widthR_LED={(LEDx-PosR_x) 2 +(LEDy-PosR_y) 2} 1 / 2 …(12)

[0087] Furthermore, the coordinates of the viewpoint EL are (PosL_x, PosL_y). PosL_x indicates the coordinate in the X direction of the viewpoint EL. PosL_y indicates the coordinate in the Y direction of the viewpoint EL. PosL_x can be expressed as in the following equation (13). PosR_y can be expressed as in the following equation (14). PosL_x=pos_x-D1×cos(rot / 180)…(13) PosL_y=pos_y-D1×sin(rot / 180)…(14)

[0088] The length of the ray of light between the center of the light-emitting point LP located at the coordinate LP(i,j) and the viewpoint EL is defined as widthL_LED. Also, the length on the ray of light between the coordinate L_(i,j) where pixel Pix is ​​located in the Z direction, which is a coordinate located on the ray of light between the center of the light-emitting point LP located at the coordinate LP(i,j) and the viewpoint EL, is defined as length widthL. The ratio between length widthL and length widthL_LED can be expressed as in the following equation (15). Also, length widthL_LED can be expressed as in equation (16). widthL:widthL_LED=pos_h:(pos_h+th)…(15) widthL_LED=((LEDx-PosL_x) 2 +(LEDy-PosL_y) 2 ) 1 / 2 …(16)

[0089] FIG. 14 is a schematic diagram showing the relationship between the length width and a pixel PixU, which is a pixel Pix through which light passes from a light-emitting point LP located at coordinates LP(i,j) to a viewpoint EE. Hereinafter, when a pixel PixU is referred to, it refers to a pixel Pix through which light (a ray) passes from the light-emitting point LP to a viewpoint EE, and includes a passing point UP, which will be described later. The length width is either a length widthR or a length widthL. The length width_LED shown in FIG. 14 is widthR_LED when the length width is widthR. The length width_LED is widthL_LED when the length width is widthL. The viewpoint EE shown in FIG. 14 is viewpoint ER when the length width is widthR. The viewpoint EE is viewpoint EL when the length width is widthL. The passing point UP shown in FIG. 14 is R_(i,j) when the length width is widthR. The passing point UP is L_(i,j) when the length width is widthL.

[0090] When the length width is widthR, the coordinates where pixel PixU is located are (shiftR_x, shiftR_y). shiftR_x indicates the X-coordinate of pixel PixU in this case. shiftR_y indicates the Y-coordinate of pixel PixU in this case. shiftR_x can be expressed as in the following equation (17). shiftR_y can be expressed as in the following equation (18). shiftR_x=posR_x+(LEDx-posR_x)×widthR / widthR_LED…(17) shiftR_y=PosR_y+(LEDy-PosR_y)×widthR / widthR_LED…(18)

[0091] When the length width is widthL, the coordinates where pixel PixU is located are (shiftL_x, shiftL_y). shiftL_x indicates the X-coordinate of pixel PixU in this case. shiftL_y indicates the Y-coordinate of pixel PixU in this case. shiftL_x can be expressed as in the following equation (19). shiftL_y can be expressed as in the following equation (20). shiftL_x=posL_x+(LEDx-posL_x)×widthL / widthL_LED…(19) shiftL_y=PosL_y+(LEDy-PosL_y)×widthL / widthL_LED…(20)

[0092] As shown in the positional relationship between the passing point UP and the pixel PixU in FIG. 14, the passing point UP does not necessarily pass through the center of the pixel PixU.

[0093] FIG. 15 is a schematic diagram showing an example of the difference between the position of pass point P_(i,j) at pixel PixP located on the ray of light between light-emitting point LPP and viewpoint EE and the position of pass point Q_(i,j) at pixel PixQ located on the ray of light between light-emitting point LPQ and viewpoint EE. Pass point P_(i,j) and pass point Q_(i,j) are different pass points UP. Light-emitting points LPP and LPQ are any of multiple light-emitting points LP for viewpoint EE, and the position of light-emitting point LPP is different from the position of light-emitting point LPQ. Pass points P_(i,j) and Q_(i,j) are pass points UP. That is, ShiftR_xP indicates the X-coordinate of pass point P_(i,j). ShiftR_yP indicates the Y-coordinate of pass point P_(i,j). ShiftQ_xP indicates the X-coordinate of pass point Q_(i,j). ShiftQ_yP indicates the Y coordinate of the passing point Q_(i,j).

[0094] 15, the passing point P_(i,j) is located near the bottom right of the pixel PixP. On the other hand, the passing point Q_(i,j) is located near the top left of the pixel PixQ. In this way, the position of the passing point UP within the pixel PixU is not constant depending on the positional relationship between the light-emitting point LP and the viewpoint EE.

[0095] In this embodiment, drive control of pixel Pix is ​​performed according to the positional relationship between pass point UP and pixel PixU, i.e., the intersection position of pixel Pix with a ray of light between light-emitting point LP and viewpoint EE. Specifically, the image output unit 12 calculates a decision variable R_x based on the X coordinate of one pass point UP (shiftR_x, shiftR_y) using the following equation (21). The image output unit 12 also calculates a decision variable R_y based on the Y coordinate of the pass point UP using the following equation (22). Note that various calculations (e.g., the above-described equations (9) to (20)) that are the basis of equations (21) and (22) are performed by the image output unit 12 based on the (pos_x, pos_y, pos_h) and relative angle rot derived by the gaze tracking unit 11 and the basic concept based on equations (1) to (8) described with reference to FIG. 5. R_x=shiftR_x / PP-int(shiftR_x / PP)…(21) R_y=shiftR_y / PP-int(shiftR_y / PP)…(22)

[0096] These determination coefficients indicate the pass-through point UP within pixel PixU. More specifically, they indicate the position of pass-through point UP within pixel PixU when viewed from the edge of pixel PixU that is closest to the origin set on the display surface (for example, corner A at the upper left corner of the pixel shown in FIG. 16). More specifically, when R_x=0 and R_y=0, pass-through point UP is located at corner A. Furthermore, when R_x=1 / 2 and R_y=1 / 2, pass-through point UP is located at the center of pixel PixU. Furthermore, when R_x=1 and R_y=1, pass-through point UP is located at the diagonal AA of corner A.

[0097] FIG. 16 is a diagram showing a coordinate system based on pixel PixU. FIG. 17 is a schematic diagram showing an overview of drive control of pixel PixU in accordance with the intersection position of the ray of light between light-emitting point LP and viewpoint EE and pixel PixU. The image output unit 12 applies sub-pixel control corresponding to the decision variables R_x and R_y as sub-pixel control for pixel PixU corresponding to passing point UP of coordinates (shiftR_x, shiftR_y) at which decision variables R_x and R_y are calculated using equations (21) and (22) above. Specifically, as shown in FIG. 17 and FIGS. 24 and 28 (described later), the image output unit 12 applies control corresponding to the pixel signal assigned to at least one of the sub-pixels included in pixel PixU and the sub-pixels included in pixel Pix adjacent to pixel PixU in accordance with the combination of the value of decision variable R_x and the value of decision variable R_y.

[0098] In the following description with reference to Figures 16 and 17 and Figures 24 and 28 (described later), one end in the X direction refers to the left side of the drawing. The other end in the X direction refers to the right side of the drawing. One end in the Y direction refers to the upper side of the drawing. The other end in the Y direction refers to the lower side of the drawing.

[0099] In the description of the embodiment, as shown in Fig. 16 , one pixel Pix has a first subpixel R, a second subpixel G, and a third subpixel B, and the first subpixel R, the second subpixel G, and the third subpixel B are arranged in this order from one end to the other end in the X direction. One pixel Pix including one first subpixel R, one second subpixel G, and one third subpixel B has, for example, a substantially square shape as a whole. Each of the first subpixel R, the second subpixel G, and the third subpixel B has a rectangular shape with the Y direction as the longitudinal direction. The multiple pixels Pix are arranged in a matrix along the X and Y directions.

[0100] In describing the sub-pixel control patterns PaA, PaB, PaC, PaD, PaE, PaF, PaG, PaH, and PaI with reference to Fig. 17, the sub-pixels to be controlled will be described with reference to the coordinate system shown in Fig. 16. The coordinate system using the x and y coordinates shown in Fig. 16 is a relative coordinate system based on pixel PixU and does not directly correspond to the above values ​​of (i, j).

[0101] In FIG. 16, pixel PixU is located at coordinates x=0 and y=0. The coordinates of pixel PixU are (x, y)=(0, 0). The x-coordinate of pixel Pix, which is adjacent to pixel PixU and located at one end in the X direction, is x=-1. "Adjacent" here means adjacent to pixel PixU in either the X direction, the Y direction, or a diagonal direction with respect to pixel PixU. "Diagonal" refers to a direction that intersects both the X direction and the Y direction and is perpendicular to the Z direction. The x-coordinate of pixel Pix, which is adjacent to pixel PixU and located at the other end in the X direction, is x=1. The y-coordinate of pixel Pix, which is adjacent to pixel PixU and located at one end in the Y direction, is y=-1. The y-coordinate of pixel Pix, which is adjacent to pixel PixU and located at the other end in the Y direction, is y=1. For example, a pixel Pix at (x, y)=(-1, -1) refers to a pixel Pix located on one end side in the X direction and one end side in the Y direction relative to pixel PixU and adjacent to pixel PixU.

[0102] When 0≦R_x<1 / 3 and 0≦R_y<1 / 2, the passing point UP is located near one end in the X direction and one end in the Y direction within the pixel PixU. More specifically, the passing point UP is located within a subpixel (first subpixel R) at one end of the pixel PixU and is located above the middle of the subpixel. In this case, the image output unit 12 applies the control pattern PaA. In the control pattern PaA, the third subpixel B at (x, y)=(-1, -1), the first subpixel R and second subpixel G at (x, y)=(0, -1), the third subpixel B at (x, y)=(-1, 0), and the first subpixel R and second subpixel G of the pixel PixU are subject to control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, -1) and the third subpixel B at (x, y) = (-1, 0). Furthermore, pixel control corresponding to the red (R) and green (G) gradation values ​​is distributed and applied to the first and second subpixels R and G at (x, y) = (0, -1) and the first and second subpixels R and G of pixel PixU. Details of the distribution of gradation values ​​in pixel control will be described later. By controlling in this manner, the passing point UP is positioned in the center of all the subpixels lit for the passing point UP.

[0103] If 1 / 3≦R_x<2 / 3 and 0≦R_y<1 / 2, the passing point UP is located in the pixel PixU at or near the midpoint between one end and the other end in the X direction and closer to one end in the Y direction. More specifically, the passing point UP is located in the middle subpixel (second subpixel G) in the pixel PixU and is located above the middle of the subpixel. In this case, the image output unit 12 applies the control pattern PaB. In the control pattern PaB, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, -1) and the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU are subject to control corresponding to the pixel signal. That is, pixel control corresponding to the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal supplied to pixel PixU is distributed and applied to the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, -1) and the first subpixel R, second subpixel G, and third subpixel B of pixel PixU. By controlling in this way, the passing point UP is positioned at the center when viewed across all the subpixels lit for the passing point UP.

[0104] If 2 / 3≦R_x≦1 and 0≦R_y<1 / 2, the passing point UP is located closer to the other end in the X direction and closer to one end in the Y direction within the pixel PixU. More specifically, the passing point UP is located within the subpixel (third subpixel B) on the other end side within the pixel PixU, and is located above the middle of the subpixel. In this case, the image output unit 12 applies the control pattern PaC. In the control pattern PaC, the second subpixel G and third subpixel B at (x, y)=(0, −1), the first subpixel R at (x, y)=(1, −1), the second subpixel G and third subpixel B of the pixel PixU, and the first subpixel R at (x, y)=(1, 0) are subject to control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R at (x, y) = (1, -1) and the first subpixel R at (x, y) = (1, 0). Similarly, pixel control corresponding to the green (G) and green (B) gradation values ​​is distributed and applied to the first and second subpixels R and G at (x, y) = (0, -1) and the first and second subpixels R and G of pixel PixU. By controlling in this manner, the passing point UP is positioned at the center of all the subpixels lit for the passing point UP.

[0105] When 0≦R_x<1 / 3 and R_y=1 / 2, the passing point UP is located near one end in the X direction and midway between one end and the other end in the Y direction within the pixel PixU. More specifically, the passing point UP is located within the subpixel (first subpixel R) at one end of the pixel PixU and is located near the center in the vertical direction (Y direction) within the subpixel. In this case, the image output unit 12 applies the control pattern PaD. In the control pattern PaD, the third subpixel B at (x, y)=(−1, 0) and the first and second subpixels R and G of the pixel PixU are subjected to control corresponding to the pixel signal. That is, among the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to the pixel PixU, pixel control corresponding to the blue (B) gradation value is applied to the third subpixel B at (x, y)=(−1, 0). Furthermore, pixel control corresponding to the red (R) gradation value and green (G) gradation value is applied to the first subpixel R and the second subpixel G of pixel PixU. By controlling in this way, the passing point UP is positioned in the center when viewed as a whole of the subpixels that are lit for the passing point UP.

[0106] When 1 / 3≦R_x<2 / 3 and R_y=1 / 2, the passing point UP is located at or near the midpoint between one end and the other end in the X direction and at the midpoint between one end and the other end in the Y direction within the pixel PixU. More specifically, the passing point UP is located within the middle subpixel (second subpixel G) within the pixel PixU and is located near the center in the vertical direction (Y direction) within the subpixel. In this case, the image output unit 12 applies the control pattern PaE. In the control pattern PaE, the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU are subjected to control corresponding to the pixel signal. That is, pixel control corresponding to the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signals provided to the pixel PixU is applied to the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU. By controlling in this way, the passing point UP is positioned at the center when the sub-pixels that are lit for the passing point UP are viewed as a whole.

[0107] When 2 / 3≦R_x≦1 and R_y=1 / 2, the passing point UP is located in the pixel PixU toward the other end in the X direction and midway between one end and the other end in the Y direction. More specifically, the passing point UP is located within the subpixel (third subpixel B) on the other end side of the pixel PixU and is located near the center in the vertical direction (Y direction) within the subpixel. In this case, the image output unit 12 applies the control pattern PaF. In the control pattern PaF, the second subpixel G and third subpixel B of the pixel PixU and the first subpixel R at (x, y)=(1, 0) are subject to control corresponding to the pixel signal. That is, among the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to the pixel PixU, pixel control corresponding to the red (R) gradation value is applied to the first subpixel R at (x, y)=(1, 0). Furthermore, pixel control corresponding to the green (G) gradation value and green (B) gradation value is applied to the first subpixel R and the second subpixel G of pixel PixU. By controlling in this way, the passing point UP is positioned in the center when viewed as a whole of the subpixels that are lit for the passing point UP.

[0108] When 0≦R_x<1 / 3 and 1 / 2<R_y≦1, the passing point UP is located within the pixel PixU, closer to one end in the X direction and closer to the other end in the Y direction. More specifically, the passing point UP is located within the sub-pixel (the first sub-pixel R) on one end side within the pixel PixU and is located below the midpoint within the sub-pixel. In this case, the image output unit 12 applies the control pattern PaG. In the control pattern PaG, the third sub-pixel B with (x,y)=(-1,0), the first sub-pixel R and the second sub-pixel G of the pixel PixU, the third sub-pixel B with (x,y)=(-1,1), and the first sub-pixel R and the second sub-pixel G with (x,y)=(0,1) are the targets for applying control corresponding to the pixel signals. That is, among the gradation values of red (R), green (G), and blue (B) indicated by the RGB pixel signals given to the pixel PixU, the pixel control corresponding to the gradation value of blue (B) is applied dispersedly to the third sub-pixel B with (x,y)=(-1,0) and the third sub-pixel B with (x,y)=(-1,1). Also, the pixel control corresponding to the gradation values of red (R) and green (G) is applied dispersedly to the first sub-pixel R and the second sub-pixel G of the pixel PixU and the first sub-pixel R and the second sub-pixel G with (x,y)=(0,1). By controlling in this way, the passing point UP will be located at the center when viewed over the entire sub-pixels lit for the passing point UP.

[0109] When 1 / 3 ≦ R_x < 2 / 3 and 1 / 2 < R_y ≦ 1, the passing point UP is located within the pixel PixU at a position near or at the middle position between one end side and the other end side in the X direction and near the other end side in the Y direction. More specifically, the passing point UP is located within the middle sub-pixel (the second sub-pixel G) in the pixel PixU and is located below the midpoint within the sub-pixel. In this case, the image output unit 12 applies the control pattern PaH. In the control pattern PaH, the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B of the pixel PixU, and the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B at (x, y) = (0, 1) are the targets for applying control corresponding to the pixel signal. That is, pixel control corresponding to the red (R) gradation value, green (G) gradation value, and blue (B) gradation value indicated by the RGB pixel signal given to the pixel PixU is dispersed and applied to the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B of the pixel PixU, and the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B at (x, y) = (0, 1). By controlling in this way, the passing point UP will be located at the center when viewed as the entire sub-pixel lit for the passing point UP.

[0110] When 2 / 3 ≦ R_x ≦ 1 and 1 / 2 < R_y ≦ 1, the passing point UP is located near the other end in the X direction and near the other end side in the Y direction within the pixel PixU. More specifically, the passing point UP is located within the sub-pixel on the other end side (the third sub-pixel B) within the pixel PixU and is located below the midpoint within the sub-pixel. In this case, the image output unit 12 applies the control pattern PaI. In the control pattern PaI, the second sub-pixel G and the third sub-pixel B of the pixel PixU, the first sub-pixel R at (x, y) = (1, 0), the second sub-pixel G and the third sub-pixel B at (x, y) = (0, 1), and the first sub-pixel R at (x, y) = (1, 1) are the targets for applying control corresponding to the pixel signals. That is, among the red (R) gradation value, green (G) gradation value, and blue (B) gradation value indicated by the RGB pixel signal given to the pixel PixU, the pixel control corresponding to the red (R) gradation value is dispersed and applied to the first sub-pixel R at (x, y) = (1, 0) and the first sub-pixel R at (x, y) = (1, 1). Also, the pixel control corresponding to the green (G) gradation value and the green (B) gradation value is dispersed and applied to the first sub-pixel R and the second sub-pixel G of the pixel PixU, the first sub-pixel R and the second sub-pixel G at (x, y) = (0, 1). By controlling in this way, the passing point UP will be located at the center when viewed from the entire sub-pixels lit for the passing point UP.

[0111] Next, the details of the dispersion of the gradation values in pixel control will be described. The image output unit 12 applies gradation value control corresponding to the value of R_y in the control patterns PaA, PaB, PaC, PaD, PaE, PaF, PaG, PaH, PaI.

[0112] Specifically, in the control patterns PaA, PaB, and PaC, the first subpixel R, second subpixel G, and third subpixel B located at y=-1 (located above pixel PixU) are controlled so that their gradation values ​​become (0.5-R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. In addition, in the control patterns PaA, PaB, and PaC, the first subpixel R, second subpixel G, and third subpixel B located at y=0 are controlled so that their gradation values ​​become (0.5+R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. That is, in this control, the closer the passing point UP is to an upper pixel within pixel PixU, the larger the gradation value allocated to that upper pixel, but the allocation is at most half of pixel PixU.

[0113] In addition, in the control patterns PaD, PaE, and PaF, the first subpixel R, the second subpixel G, and the third subpixel B located at y=0 are controlled so that their gradation values ​​become the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU.

[0114] In the control patterns PaG, PaH, and PaI, the first subpixel R, the second subpixel G, and the third subpixel B located at y=0 are controlled so that their gradation values ​​are (1.5-R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. In the control patterns PaG, PaH, and PaI, the first subpixel R, the second subpixel G, and the third subpixel B located at y=1 are controlled so that their gradation values ​​are (-0.5+R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. That is, in this control, the closer the passing point UP is to a pixel in the lower row within pixel PixU, the larger the gradation value allocated to that pixel in the lower row, but the allocation is at most half that of pixel PixU.

[0115] Next, an application example of the control described with reference to FIGS. 16 and 17 will be described with reference to FIGS. 18 and 19. Note that FIGS. 18 and 19 illustrate a pixel region in which 14 pixels Pix are arranged in the X direction and 12 pixels Pix in the Y direction. The position of a pixel Pix in the X direction within the pixel region is indicated by a combination of an xp coordinate (xp1, xp2, ..., xp14) and a yp coordinate (yp1, yp2, ..., yp14). For example, a pixel Pix with (xp, yp) = (1, 1) refers to a pixel Pix whose position in the X direction is xp1 and whose position in the Y direction is yp1. Also, in FIGS. 18 and 19, the position of pixel PixU is indicated by a thick-framed rectangle.

[0116] 18 and 19, four light-emitting points LP are arranged from a planar viewpoint. Here, the boundary between xp4 and xp5 is designated xpA. The boundary between xp10 and xp11 is designated xpB. The boundary between yp3 and yp4 is designated ypA. The boundary between yp9 and yp10 is designated ypB. One of the four light-emitting points LP is located at the intersection of xpA and ypA. One of the four light-emitting points LP is located at the intersection of xpA and ypB. One of the four light-emitting points LP is located at the intersection of xpB and ypA. One of the four light-emitting points LP is located at the intersection of xpB and ypB.

[0117] FIG. 18 shows display control of the center of the display screen when the user's viewpoint midpoint CP is aligned with the center of the display screen. The sub-pixel control described with reference to FIG. 17 is applied to FIG. 18. Specifically, based on the above calculations, four pixels Pix for the left eye that include the passing point UP are derived for the four light-emitting points, based on the positional relationship between the rays from each light-emitting point to each viewpoint and the pixel matrix: (xp, yp)=(3,4), (9,4), (3,9), (9,9). Furthermore, four pixels Pix for the right eye that include the passing point UP are derived for the four light-emitting points: (xp, yp)=(6,4), (12,4), (6,9), (12,9). In FIG. 18, control pattern PaB is applied to the four pixels Pix with coordinates (xp, yp)=(3,4), (6,4), (9,4), (12,4). In addition, in FIG. 18, the control pattern PaH is applied to four pixels Pix whose coordinates are (xp, yp)=(3, 9), (6, 9), (9, 9), and (12, 9).

[0118] FIG. 19 shows display control of the right side of the display screen when the user's viewpoint midpoint CP is aligned with the center of the display screen. The sub-pixel control described with reference to FIG. 17 is applied to FIG. 19. Specifically, based on the above calculations, the four pixels Pix for the left eye that include the passing point UP are derived for the four light-emitting points, based on the positional relationship between the rays from each light-emitting point to each viewpoint and the pixel matrix: (xp, yp)=(3,4), (8,4), (3,9), (8,9). Furthermore, the four pixels Pix for the right eye that include the passing point UP are derived for the four light-emitting points: (xp, yp)=(6,4), (11,4), (6,9), (11,9). In FIG. 19, compared to FIG. 18, the positions of the pixels for the right eye and the left eye relative to the light-emitting points located outside the display screen are both shifted inward by one pixel. This also results in different positions of each passing point within each pixel, resulting in different display controls. In Fig. 19, control pattern PaA is applied to two pixels Pix with coordinates (xp, yp) = (3, 4), (6, 4). Control pattern PaC is applied to two pixels Pix with coordinates (xp, yp) = (8, 4), (11, 4). Also in Fig. 19, control pattern PaG is applied to two pixels Pix with coordinates (xp, yp) = (3, 9), (6, 9). Also in Fig. 19, control pattern PaI is applied to two pixels Pix with coordinates (xp, yp) = (8, 9), (11, 9).

[0119] FIG. 20 is a diagram illustrating some regions AR1, AR2, and AR3 within the display region of the display panel 20A of the display device 1. The sub-pixel control described with reference to FIG. 18 is applied, for example, near the midpoint CP. For example, if the midpoint CP overlaps with the region AR1 of the display panel 20A from a planar viewpoint, the sub-pixel control described with reference to FIG. 18 is applied to the region AR1. The sub-pixel control described with reference to FIG. 19 is applied, for example, to a position closer to the viewpoint ER in the X direction from the midpoint CP or a position closer to the viewpoint EL in the X direction from the midpoint CP. For example, if the midpoint CP overlaps with the region AR1 of the display panel 20A from a planar viewpoint, the sub-pixel control described with reference to FIG. 19 is applied to the region AR2. As described with reference to FIGS. 17 to 19, the sub-pixel control is applied according to the position of the passing point UP within each pixel Pix.

[0120] Furthermore, by controlling the sub-pixels according to the position of the passing point UP within each pixel Pix, it is possible to output an image in which the variation in the distance between two adjacent pixels Pix that each contain the passing point UP is reduced.

[0121] For example, in the example shown in Fig. 19, the distance in the X direction between pixel Pix whose xp coordinate is 3 and pixel Pix whose xp coordinate is 6, and the distance in the X direction between pixel Pix whose xp coordinate is 8 and pixel Pix whose xp coordinate is 11, are two pixel Pix. This is called Example 1. On the other hand, the distance in the X direction between pixel Pix whose xp coordinate is 6 and pixel Pix whose xp coordinate is 8 is one pixel Pix. This is called Example 2. In other words, when viewed in terms of the distance between two pixels Pix that include pass point UP, there is a difference of one pixel Pix between Example 1 and Example 2.

[0122] In contrast, the distance in the X direction between (xp,yp)=(3,4),(6,4) where control pattern PaA is applied and (xp,yp)=(8,4),(11,4) where control pattern PaC is applied is equivalent to (5 / 3) pixels Pix. This is referred to as Example 3. Furthermore, the distance in the X direction between the two pixels where control pattern PaA is applied and the distance in the X direction between the two pixels where control pattern PaC is applied are equivalent to two pixels Pix. This is referred to as Example 4. That is, while there was a difference of one pixel Pix between Examples 1 and 2, the difference between Examples 3 and 4, where the sub-pixel control described with reference to FIG. 17 is applied, is reduced to (1 / 3) pixels Pix. In this way, by applying sub-pixel control according to the position of the pass point UP within each pixel Pix, it is possible to more reliably prevent light passing through each pixel PixU from reaching a viewpoint different from the intended viewpoint. In other words, crosstalk can be suppressed. If no sub-pixel control according to the position of the passing point UP within each pixel Pix is ​​applied, and there are only adjacent pixels PixU or only one pixel Pix that transmit light to a different viewpoint, there is a correspondingly high possibility that the light passing through each pixel PixU will reach a viewpoint other than the intended viewpoint. However, by applying sub-pixel control according to the position of the passing point UP within each pixel Pix, this possibility can be further reduced.

[0123] The above explanation has been given using R_x and R_y obtained from equations (21) and (22) as an example when the viewpoint EE is the viewpoint ER, but the same idea can be applied when the viewpoint EE is the viewpoint EL. Specifically, L_x and L_y obtained from the following equations (23) and (24) can be applied instead of the above-mentioned R_x and R_y. L_x=shiftL_x / pix-int(shiftL_x / pix)…(23) L_y=shiftL_y / pix-int(shiftL_y / pix)…(24)

[0124] In a multi-view system, if a positional shift occurs between the viewpoint and the display device 1, the display device 1 may not be able to fully demonstrate the image quality that it can originally provide for each viewpoint, resulting in a degradation of image quality. The positional shift referred to here refers to a positional shift of the user's viewpoint (e.g., viewpoints E1 and E2) relative to the display device 1, based on the position of the viewpoint, which is identified based on information acquired by an acquisition unit (e.g., the imaging unit 2, the distance measurement unit 3, the gyro sensor 4, and the gaze tracking unit 11) that acquires user viewpoint information. Hereinafter, the term "positional shift" simply refers to such a positional shift.

[0125] Ideally, misalignment would be quickly corrected in response to updates to the information acquired by the acquisition unit, resulting in a state where no misalignment is present. However, there is a possibility that the user may view an image with temporary misalignment for some reason. Therefore, a mechanism for suppressing degradation in image quality due to misalignment may be further provided. Hereinafter, a mechanism for suppressing degradation in image quality in an environment where the sub-pixel control described with reference to FIG. 17 is applied will be described with reference to FIGS. 21 to 31. Note that in FIGS. 21 to 23, 27, and 29, in order to more clearly illustrate the relationship between the relative angle rot and each figure, example values ​​of the relative angle rot are provided at the top of the figures, and the orientation of the face HF for each relative angle rot is shown to the left of the values.

[0126] 21 is a schematic diagram showing the positional relationship between the light-emitting point LP, pixel PixU, and viewpoint EE when there is substantially no positional misalignment between the viewpoint EE and the display device 1. The control of the sub-pixels described with reference to FIG. 17 depends on the relationship between the pixel PixU corresponding to the position of the viewpoint EE and the passing point UP. Therefore, as long as there is no positional misalignment, it is possible to achieve display output with good image quality, based on the position of the viewpoint EE at the time when the control pattern of the sub-pixels to be applied is determined.

[0127] FIG. 21 shows "Case 1," "Case 2," and "Case 3" as specific examples. In "Case 1," as shown in the "Applied Control" column, the control pattern PaE is applied to a pixel PixU. In "Case 1," as shown in the "Relationship Between Light Source, Subpixel, and Eye" column, the second subpixel G is located on the ray idq1 between the viewpoint EE and the light-emitting point LP, which is assumed at the time the control pattern PaE is applied. Hereinafter, unless otherwise specified, the term "upper column" refers to the "Applied Control" column. Furthermore, unless otherwise specified, the term "lower column" refers to the "Relationship Between Light Source, Subpixel, and Eye" column. The upper column indicates the control of the subpixel corresponding to the position (assumed position) of the viewpoint EE identified at the time the subpixel control pattern is determined. The lower column indicates the positional relationship between the actual light-emitting point LP, pixel PixU, and viewpoint EE at the time the image is viewed from each viewpoint.

[0128] In the column under "Case q," light from the light-emitting point LP that passes through the first sub-pixel R is indicated as light Rq, where q is a natural number. For example, when q=1, that is, in the column under "Case 1," the light from the light-emitting point LP that passes through the first sub-pixel R is designated by the symbol R1. Based on this concept, the following explanation will be given with reference to the column. In the column under "Case q," light from the light-emitting point LP that passes through the second sub-pixel G is indicated as light Gq. In the column under "Case q," light from the light-emitting point LP that passes through the third sub-pixel B is indicated as light Bq.

[0129] As shown in Figures 16 and 17, in the control pattern PaE, the pass point UP is located at the second subpixel G. Furthermore, "Case 1" is a state in which substantially no misalignment occurs. In the lower column of Case 1, the position in the X direction of the viewpoint EE in a state in which substantially no misalignment occurs is shown as position idp1. In this state, as shown in the lower column of "Case 1," light from the light-emitting point LP can pass through each of the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU to reach the viewpoint EE. Specifically, in the lower column of "Case 1," light R1 passes through the first subpixel R, light G1 passes through the second subpixel G, and light B1 passes through the third subpixel B, and reaches the viewpoint EE as light RGB1. That is, light RGB1 in the lower column of "Case 1" includes light R1, light G1, and light B1.

[0130] In "Case 2" of Fig. 21, as shown in the upper column, control pattern PaF is applied to a certain pixel PixU. Also, in "Case 2," the third subpixel B is located on a ray idq2 between the viewpoint EE and the light-emitting point LP, which is assumed at the time when control pattern PaF is applied. As shown in Figs. 16 and 17, in control pattern PaF, a passing point UP is located at the third subpixel B. Therefore, no positional deviation occurs in "Case 2," and light RGB2, which includes light G2, light B2, and light R2, can reach the viewpoint EE. Note that position idp2 in "Case 2" indicates the position of the viewpoint EE where no positional deviation actually occurs.

[0131] 21 is substantially the same as "Case 1" except that, compared to "Case 1," the position of the viewpoint EE changes from position idp1 to position idp3, and the angle θ3 between the ray idq3 connecting the viewpoint EE and the light-emitting point LP and the Z direction is different from the angle θ1 between the ray idq1 and the Z direction in "Case 1." Therefore, no positional shift occurs in "Case 3," and light RGB3 including light R3, light G3, and light B3 can reach the viewpoint EE.

[0132] 21 and FIG. 22, which will be described later, illustrate a case where the width SS in the X direction of one light-emitting point LP (see FIG. 3) is width SSx1. The width SSx1 is the width SS in the X direction of the light-emitting point LP that corresponds to the width of one pixel Pix in the X direction. In other words, the width SSx1 is the design width in the X direction of the light-emitting point LP that is determined in advance on the assumption that, assuming that no substantial positional misalignment occurs, light from one light-emitting point LP passes through the display panel 20A in the X direction with a width equivalent to one pixel Pix as the center and reaches the viewpoint EE. Note that this design width is determined, for example, in consideration of the distance Ph, which will be described later, but is not limited to this and can be changed as appropriate.

[0133] "Case 1," "Case 2," and "Case 3" shown in FIG. 21 are all based on the premise that there is no misalignment between the light-emitting point LP with width SSx1 and the transmissive region corresponding to one pixel Pix in the X direction, which is controlled to transmit light based on the positional relationship between the pixel PixU and the passing point UP. This "transmissive region corresponding to one pixel Pix" refers to a transmissive region created by controlling sub-pixels, the number of which is the same as the number of sub-pixels in one pixel Pix (for example, three), that are consecutively arranged in the X direction to transmit light. In other words, the control of the sub-pixels described with reference to FIG. 17 is control that forms this "transmissive region corresponding to one pixel Pix" as far as the X direction is concerned.

[0134] FIG. 22 is a schematic diagram showing the positional relationship between the light-emitting point LP, pixel PixU, and viewpoint EE when a positional misalignment occurs between the viewpoint EE and the display device 1. In "Case 4" of FIG. 22, the control pattern PaE is applied to a certain pixel PixU, as in "Case 1" of FIG. 21. However, unlike "Case 1," "Case 4" causes a positional misalignment. The lower section of "Case 4" shows this positional misalignment as the viewpoint EE shifting from position idp1 to position idp4. Due to this positional misalignment, some subpixels that should be located on the ray of light between the light-emitting point LP and viewpoint EE are no longer located on the ray. The lower section of "Case 4" shows an example in which the first subpixel R is no longer located on the ray. Due to this positional misalignment, the light that reaches the viewpoint EE in "Case 4" is light GB4. Light GB4 includes light G4 and light B4, but does not include light that passes through the first subpixel R. As a result, in "Case 4," the red component contained in the image is not visible or the red component is weakened, resulting in color unevenness.

[0135] In "Case 5" in FIG. 22, the control pattern PaF is applied to a certain pixel PixU, as in "Case 2" in FIG. 21. However, unlike "Case 2," "Case 5" experiences a positional shift. The lower section of "Case 5" illustrates this positional shift as the position of the viewpoint EE shifting from position idp2 to position idp5. Due to this positional shift, in "Case 5," the second subpixel G is no longer positioned on the ray of light between the light-emitting point LP and the viewpoint EE. Therefore, in "Case 5," the light RB5 that reaches the viewpoint EE includes light R5 and light B5, but does not include light that passes through the second subpixel G. As a result, in "Case 5," color unevenness occurs, in which the green component in the image is not visible or is weakened.

[0136] In "Case 6" in FIG. 22, similar to "Case 3" in FIG. 21, control pattern PaE is applied to a certain pixel PixU. However, unlike "Case 3," "Case 6" experiences a positional shift. The lower section of "Case 6" illustrates this positional shift as the position of the viewpoint EE shifting from position idp3 to position idp6. Due to this positional shift, in "Case 6," the first subpixel R is no longer positioned on the ray of light between the light-emitting point LP and the viewpoint EE. Therefore, in "Case 6," light GB6 reaching the viewpoint EE includes light G6 and light B6, but does not include light that passes through the first subpixel R. As a result, in "Case 6," color unevenness occurs, in which the red component in the image is not visible or is weakened.

[0137] As explained with reference to Fig. 22, when the width SS (see Fig. 3) in the X direction of one light-emitting point LP is width SSx1 and the "transmissive region of one pixel Pix" is the target of control corresponding to the pixel signal based on the positional relationship between the pixel PixU and the pass point UP, color unevenness may occur due to misalignment. Therefore, by increasing the number of sub-pixels controlled based on the positional relationship between the pixel PixU and the pass point UP, such color unevenness is suppressed.

[0138] Fig. 23 is a schematic diagram showing the positional relationship between the light-emitting point LP, the pixel PixU, and the viewpoint EE when the transparent area controlled based on the positional relationship between the pixel PixU and the passing point UP exceeds the size of one pixel Pix. "Case 7" shown in Fig. 23 shows a case where the transparent area of ​​one pixel Pix in "Case 4" described with reference to Fig. 21 is changed to a transparent area exceeding one pixel Pix. "Case 8" shows a case where the transparent area of ​​one pixel Pix in "Case 5" described with reference to Fig. 22 is changed to a transparent area exceeding one pixel Pix. "Case 9" shows a case where the transparent area of ​​one pixel Pix in "Case 6" described with reference to Fig. 21 is changed to a transparent area exceeding one pixel Pix.

[0139] In "Case 7," "Case 8," and "Case 9" in FIG. 23, in addition to the three subpixels that are the targets of control corresponding to pixel signals by applying the subpixel control described with reference to FIG. 17, three more subpixels are controlled. Hereinafter, in order to distinguish between the targets of control, the three subpixels that are the targets of control corresponding to pixel signals by applying the subpixel control described with reference to FIG. 17 will be referred to as "pre-addition subpixels," and the subpixels that are controlled to transmit light in addition to the pre-addition subpixels will be referred to as "post-addition subpixels." Below, the pre-addition subpixels and post-addition subpixels will be described with reference to the coordinate system shown in FIG. 16. As shown in the lower column of FIG. 23, the post-addition subpixels in "Case 7" and "Case 9" are the third subpixel B at (x, y) = (-1, 0), and the first subpixel R and second subpixel G at (x, y) = (1, 0). As a result, in addition to the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, which are the "pre-addition subpixels" also shown in "Case 4" and "Case 6," the three post-addition subpixels become the targets of control corresponding to the pixel signal.

[0140] 23, the subpixels after addition in "Case 8" are the first subpixel R of pixel PixU, and the second subpixel G and third subpixel B at (x, y) = (1, 0). As a result, in addition to the second subpixel G and third subpixel B of pixel PixU and the first subpixel R at (x, y) = (1, 0), which are the "subpixels before addition" also shown in "Case 5," these three subpixels after addition become targets for application of control corresponding to pixel signals.

[0141] In the embodiment, by generating these "additional sub-pixels," light RGBq emitted from the light-emitting point LP with width SSx1 and reaching the viewpoint EE includes light Rq, light Gq, and light Bq. Specifically, light RGB7 in "Case 7" includes light R7, light G7, and light B7. Light RGB8 in "Case 8" includes light R8, light G8, and light B8. Light RGB9 in "Case 9" includes light R9, light G9, and light B9. Therefore, in the embodiment, the color unevenness that occurred in "Case 4," "Case 5," and "Case 6" is eliminated by generating the additional sub-pixels.

[0142] When the sub-pixel control pattern described with reference to Fig. 23 is applied, the sub-pixels are controlled to transmit light in accordance with the pixel signal assigned to pixel PixU, and the region including the pre-addition sub-pixel and post-addition sub-pixel described above functions as a transmissive region having a width in the X direction equivalent to two pixels Pix (see, for example, transmissive region TRx2 shown in Fig. 26). Below, the sub-pixel control pattern for forming a transmissive region having a width in the X direction equivalent to two pixels Pix will be described with reference to Fig. 24.

[0143] Fig. 24 is a schematic diagram showing a drive control different from that shown in Fig. 17. In describing the sub-pixel control patterns PbA, PbB, PbC, PbD, PbE, PbF, PbG, PbH, PbI, PbJ, PbK, and PbL with reference to Fig. 24, the sub-pixels to be controlled will be described with reference to the coordinate system shown in Fig. 16. Note that in the following description, pixel PixU in each pattern is the pre-addition sub-pixel, and the other lit pixels, which differ for each pattern, are the post-addition sub-pixels.

[0144] If 0≦R_x<1 / 6 and 0≦R_y<1 / 2, the image output unit 12 applies control pattern PbA. In control pattern PbA, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(−1, −1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, −1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(−1, 0), and the first subpixel R, second subpixel G, and third subpixel B of pixel PixU (pixel PixU is (x, y)=(0, 0); the same applies below) are the targets of control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R at (x, y) = (-1, -1), the first subpixel R at (x, y) = (-1, 0), the first subpixel R at (x, y) = (0, -1), and the first subpixel R of pixel PixU. Also, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (-1, -1), the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (0, -1), and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, -1), the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (0, -1), and the third subpixel B of pixel PixU. Details of the distribution of gradation values ​​in pixel control will be described later. By controlling in this way, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0145] If 1 / 6≦R_x<1 / 2 and 0≦R_y<1 / 2, the image output unit 12 applies control pattern PbB. In control pattern PbB, the second subpixel G and third subpixel B at (x, y)=(−1, −1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, −1), the first subpixel R at (x, y)=(1, −1), the second subpixel G and third subpixel B at (x, y)=(−1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, and the first subpixel R at (x, y)=(1, 0) are targets of control corresponding to pixel signals. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (1, 0).Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (-1, -1), the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (0, -1), and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, -1), the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (0, -1), and the third subpixel B of pixel PixU. By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0146] If 1 / 2≦R_x<5 / 6 and 0≦R_y<1 / 2, the image output unit 12 applies control pattern PbC. In control pattern PbC, the third subpixel B at (x, y)=(−1, −1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, −1), the first subpixel R and second subpixel G at (x, y)=(1, −1), the third subpixel B at (x, y)=(−1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, and the first subpixel R and second subpixel G at (x, y)=(1, 0) are subject to control corresponding to pixel signals. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (1, 0). Also, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (0, -1), the second subpixel G at (x, y) = (1, -1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, -1), the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (0, -1), and the third subpixel B of pixel PixU. By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0147] If 5 / 6≦R_x≦1 and 0≦R_y<1 / 2, the image output unit 12 applies control pattern PbD. In control pattern PbD, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, −1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(1, −1), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, and the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(1, 0) are targets of control corresponding to pixel signals. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (1, 0). Also, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (0, -1), the second subpixel G at (x, y) = (1, -1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the third subpixel B at (x, y) = (0, -1), the third subpixel B at (x, y) = (1, -1), the third subpixel B of pixel PixU, and the third subpixel B at (x, y) = (1, 0). By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0148] When 0≦R_x<1 / 6 and R_y=1 / 2, the image output unit 12 applies control pattern PbE. In control pattern PbE, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(−1, 0) and the first subpixel R, second subpixel G, and third subpixel B of pixel PixU are targets of control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is applied in a distributed manner to the first subpixel R at (x, y)=(0, −1) and the first subpixel R of pixel PixU. Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (0, -1) and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (0, -1) and the third subpixel B of pixel PixU. By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels lit for the passing point UP.

[0149] If 1 / 6≦R_x<1 / 2 and R_y=1 / 2, the image output unit 12 applies control pattern PbF. In control pattern PbF, the second subpixel G and third subpixel B at (x, y)=(-1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, and the first subpixel R at (x, y)=(1, 0) are targets of control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is applied in a distributed manner to the first subpixel R of pixel PixU and the first subpixel R at (x, y)=(1, 0). Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (0, -1) and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (0, -1) and the third subpixel B of pixel PixU. By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels lit for the passing point UP.

[0150] If 1 / 2≦R_x<5 / 6 and R_y=1 / 2, the image output unit 12 applies control pattern PbG. In control pattern PbG, the third subpixel B at (x, y)=(-1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, and the first subpixel R and second subpixel G at (x, y)=(1, 0) are targets of control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is applied in a distributed manner to the first subpixel R of pixel PixU and the first subpixel R at (x, y)=(1, 0). Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G of pixel PixU and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (0, -1) and the third subpixel B of pixel PixU. By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels lit for the passing point UP.

[0151] When 5 / 6≦R_x≦1 and R_y=1 / 2, the image output unit 12 applies the control pattern PbH. In the control pattern PbH, the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU and the first subpixel R, second subpixel G, and third subpixel B at (x,y)=(1,0) are the targets of control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to the pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R of the pixel PixU and the first subpixel R at (x,y)=(1,0). Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G of the pixel PixU and the second subpixel G at (x,y)=(1,0). Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the third subpixel B of pixel PixU and the third subpixel B of (x, y) = (1, 0). By controlling in this manner, the passing point UP is positioned in the center when viewed from the entirety of the subpixels that are lit for the passing point UP.

[0152] When 0≦R_x<1 / 6 and 1 / 2≦R_y≦1, the image output unit 12 applies control pattern PbI. In control pattern PbI, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(−1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(−1, 1), and the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, 1) are targets of control corresponding to pixel signals. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R at (x, y) = (-1, 0), the first subpixel R at (x, y) = (-1, 1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (0, 1). Also, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (-1, 1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (0, 1). Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (-1, 1), the third subpixel B of pixel PixU, and the third subpixel B at (x, y) = (0, 1). By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0153] If 1 / 6≦R_x<1 / 2 and 1 / 2≦R_y≦1, the image output unit 12 applies control pattern PbJ. In control pattern PbJ, the second subpixel G and third subpixel B at (x, y)=(−1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, the first subpixel R at (x, y)=(1, 0), the second subpixel G and third subpixel B at (x, y)=(−1, 1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, 1), and the first subpixel R at (x, y)=(1, 1) are targets of control corresponding to pixel signals. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal provided to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R of pixel PixU, the first subpixel R at (x,y)=(0,1), the first subpixel R at (x,y)=(1,0), and the first subpixel R at (x,y)=(1,1). Also, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G at (x,y)=(-1,0), the second subpixel G at (x,y)=(-1,1), the second subpixel G of pixel PixU, and the second subpixel G at (x,y)=(0,1). Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (-1, 1), the third subpixel B of pixel PixU, and the third subpixel B at (x, y) = (0, 1). By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0154] If 1 / 2≦R_x<5 / 6 and 1 / 2≦R_y≦1, the image output unit 12 applies control pattern PbK. In control pattern PbK, the third subpixel B at (x, y)=(−1, 0), the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, the first subpixel R and second subpixel G at (x, y)=(1, 0), the third subpixel B at (x, y)=(−1, 1), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0, 1), and the first subpixel R and second subpixel G at (x, y)=(1, 1) are targets of control corresponding to pixel signals. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal applied to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R of pixel PixU, the first subpixel R at (x,y)=(0,1), the first subpixel R at (x,y)=(1,0), and the first subpixel R at (x,y)=(1,1).Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G of pixel PixU, the second subpixel G at (x,y)=(0,1), the second subpixel G at (x,y)=(1,0), and the second subpixel G at (x,y)=(1,1). Furthermore, pixel control corresponding to the blue (B) gradation value is distributed and applied to the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (-1, 1), the third subpixel B of pixel PixU, and the third subpixel B at (x, y) = (0, 1). By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels that are lit for the passing point UP.

[0155] If 5 / 6≦R_x≦1 and 1 / 2≦R_y≦1, the image output unit 12 applies the control pattern PbL. In the control pattern PbL, the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU, the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(1,0), the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(0,1), and the first subpixel R, second subpixel G, and third subpixel B at (x, y)=(1,1) are targets of control corresponding to the pixel signal. That is, of the red (R), green (G), and blue (B) gradation values ​​indicated by the RGB pixel signal applied to pixel PixU, pixel control corresponding to the red (R) gradation value is distributed and applied to the first subpixel R of pixel PixU, the first subpixel R at (x, y) = (1, 0), the first subpixel R at (x, y) = (0, 1), and the first subpixel R at (x, y) = (1, 1). Also, pixel control corresponding to the green (G) gradation value is distributed and applied to the second subpixel G of pixel PixU, the second subpixel G at (x, y) = (1, 0), the second subpixel G at (x, y) = (0, 1), and the second subpixel G at (x, y) = (1, 1). Furthermore, pixel control corresponding to the green (G) gradation value is distributed and applied to the third subpixel B of pixel PixU, the third subpixel B at (x, y) = (1, 0), the third subpixel B at (x, y) = (0, 1), and the third subpixel B at (x, y) = (1, 1). By controlling in this manner, the passing point UP is positioned in the center when viewed across all the subpixels lit for the passing point UP.

[0156] Next, the details of the distribution of gradation values ​​in pixel control will be explained. The image output unit 12 applies gradation value control corresponding to the value of R_y in the control patterns PbA, PbB, PbC, PbD, PbE, PbF, PbG, PbH, PbI, PbJ, PbK, and PbL.

[0157] Specifically, in the control patterns PbA, PbB, PbC, and PbD, the first subpixel R, second subpixel G, and third subpixel B located at y=-1 (located above pixel PixU) are controlled so that their gradation values ​​become (0.5-R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. In addition, in the control patterns PbA, PbB, PbC, and PbD, the first subpixel R, second subpixel G, and third subpixel B located at y=0 are controlled so that their gradation values ​​become (0.5+R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. That is, in this control, the closer the passing point UP is to an upper pixel within pixel PixU, the larger the gradation value allocated to that upper pixel, but the allocation is at most half that of pixel PixU. Furthermore, in the control patterns PbE, PbF, PbG, and PbH, the first subpixel R, second subpixel G, and third subpixel B located at y=0 are controlled so that their gradation values ​​become the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. In the control patterns PbI, PbJ, PbK, and PbL, the first subpixel R, the second subpixel G, and the third subpixel B located at y=0 are controlled so that their gradation values ​​are (1.5-R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. In the control patterns PbI, PbJ, PbK, and PbL, the first subpixel R, the second subpixel G, and the third subpixel B located at y=1 are controlled so that their gradation values ​​are (-0.5+R_y)×100% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. That is, in this control, the closer the passing point UP is to a pixel in the lower row within pixel PixU, the larger the gradation value allocated to that pixel in the lower row, but the allocation is at most half that of pixel PixU.Hereinafter, the phrase "distribution of gradation values ​​in the pixel control described with reference to FIG. 24" refers to sub-pixel control such that the gradation values ​​of the first sub-pixel R, second sub-pixel G, and third sub-pixel B located at coordinates in the Y direction other than y=0 are lower than the gradation values ​​of the first sub-pixel R, second sub-pixel G, and third sub-pixel B located at y=0, as is performed with the control patterns PbA, PbB, PbC, PbD, PbI, PbJ, PbK, and PbL. When the distribution of gradation values ​​in the pixel control described with reference to FIG. 24 is applied, the sub-pixels are controlled to transmit light in accordance with the pixel signal assigned to pixel PixU, thereby forming a transmissive region having a width in the Y direction that is twice that of pixel Pix.

[0158] The sub-pixel control pattern applied in "Case 7" and "Case 9" in Fig. 23 is control pattern PbG described with reference to Fig. 24. The sub-pixel control pattern applied in "Case 8" in Fig. 23 is control pattern PbH described with reference to Fig. 24.

[0159] Furthermore, since the width of the light-emitting point LP that emits light corresponds to one pixel Pix, the range of one transmissive region that the user recognizes as a light-emitting region corresponds to one pixel Pix. For this reason, the "visible range" in Figure 23 is formed by applying a pattern to the sub-pixels included in the range that the user recognizes as a light-emitting region.

[0160] As explained with reference to Figures 23 and 24, by generating the additional sub-pixels, it is possible to suppress degradation of image quality due to misalignment. In other words, the range of the angle of view in the X direction in which an image can be viewed with good image quality from each viewpoint depends on the width SS of the light-emitting point LP in the X direction. An example of the relationship between the width SS of the light-emitting point LP in the X direction and the angle of view will be explained below with reference to Figures 25 and 26.

[0161] FIG. 25 is a schematic diagram showing an example of the relationship between the display panel 20A and two viewpoints E1 and E2, and the angle of view for each viewpoint E1 and E2. In FIG. 25, viewpoints E1 and E2 are located symmetrically in the X direction across an axis Za in the Z direction that passes through the midpoint CP and focus target FP. The focus target FP is an object toward which the user's line of sight is directed with respect to the display panel 20A. Note that the focus target FP shown in FIG. 25 is a schematic illustration seen from a macro perspective. From a micro perspective, focus targets FP1 and FP2, which are focus targets FP for each of viewpoints E1 and E2, are actually located in different positions (see, for example, FIG. 26). The side of viewpoint E1 with respect to the axis Za is one side in the X direction (the negative (-) side). The side of viewpoint E2 with respect to the axis Za is the other side in the X direction (the positive (+) side). 25, the line of sight from viewpoint E1 to focus object FP is inclined at −4.5 degrees (°) with respect to axis Za. The line of sight from viewpoint E2 to focus object FP is inclined at 4.5 degrees (°) with respect to axis Za.

[0162] In the example shown in FIG. 25, a range AN1 of −1.5 degrees (°) to +2 degrees (°) centered on the line of sight CL1 from viewpoint E1 is shown as a range in which color unevenness due to misalignment does not occur. A range AN1 of −1 degree (°) to +2 degrees (°) centered on the line of sight CL2 from viewpoint E2 is shown as a range in which color unevenness due to misalignment does not occur. A range AN2 of −2.5 degrees (°) and +3 degrees (°) from the range AN1 of viewpoint E1 is shown as a range in which color unevenness occurs but images for each viewpoint are visible. A range AN2 of ±3 degrees (°) from the range AN1 of viewpoint E2 is shown as a range in which color unevenness occurs but images for each viewpoint are visible. These ranges AN1 and AN2 are those in which the subpixel control patterns described with reference to FIGS. 23 and 24 are applied, for example.

[0163] FIG. 26 is a schematic diagram showing the relationship between the width in the X direction of the light-emitting point LP, within which the range AN1 described with reference to FIG. 25 is established, and the control patterns of the subpixels described with reference to FIGS. 23 and 24. FIG. 26 shows a case where the second subpixel G is the focus target FP1, FP2. The focus target FP1 is the focus target FP for the viewpoint E1. The focus target FP2 is the focus target FP for the viewpoint E2. In the embodiment, the user is not aware that the focus targets for the viewpoints E1 and E2 are different focus targets FP1, FP2, respectively, and therefore the focus target from the macroscopic perspective seen from the user is the focus target FP described with reference to FIG. 25. Meanwhile, as a display output mode of a display device that allows the user to view parallax images, individual focus targets FP1, FP2 actually appear at each of the viewpoints E1 and E2. Therefore, with regard to the angle of view described with reference to Fig. 25, strictly speaking, for viewpoint E1, focus target FP1 in Fig. 26 is treated as focus target FP in Fig. 25, and for viewpoint E2, focus target FP2 in Fig. 26 is treated as focus target FP in Fig. 25. In the sub-pixel control patterns described with reference to Figs. 23 and 24, the transparent region controlled to transmit light in accordance with the pixel signal assigned to pixel PixU has a width in the X direction equivalent to two pixels Pix, or six sub-pixels in this embodiment. Therefore, margins EM1 and EM2 of one sub-pixel are generated on one side of lines of sight CL1 and CL2 corresponding to the positions of viewpoints E1 and E2 acquired by the acquisition unit (e.g., the imaging unit 2, the distance measurement unit 3, the gyro sensor 4, and the gaze tracking unit 11) in the X direction, and margins EP1 and EP2 of two sub-pixels are generated on the other side of the X direction.

[0164] In the example shown in Fig. 26, an image substantially similar to that of viewpoint E1 located at line CL1 can be viewed in the range between line CL3 on one side of line CL1 in the X direction and line CL5 on the other side of line CL1 in the X direction. This range corresponds to range AN1 of viewpoint E1 described with reference to Fig. 25. Furthermore, an image substantially similar to that of viewpoint E2 located at line CL2 can be viewed in the range between line CL4 on one side of line CL2 in the X direction and line CL6 on the other side of line CL2 in the X direction. This range corresponds to range AN2 of viewpoint E2 described with reference to Fig. 25.

[0165] Even if the image is output from outside the margins EM1, EM2, EP1, and EP2, as long as it is within the range AN2 described with reference to Figure 25, it is possible to output an image for each viewpoint, although color unevenness will occur due to the colors of all sub-pixels not being consistent.

[0166] The effects of misalignment in the X direction under conditions in which the sub-pixel control patterns described with reference to Figure 16 etc. are applied and methods for dealing with such effects have been described above with reference to Figures 21 to 26. Next, matters related to the Y direction under conditions in which the sub-pixel control patterns described with reference to Figure 16 etc. are applied will be described with reference to Figure 27.

[0167] Fig. 27 is a schematic diagram showing the positional relationship in the Y direction between the light-emitting point LP, pixel PixU, and viewpoint EE under conditions in which the sub-pixel control patterns described with reference to Fig. 16 etc. are applied. As shown in Figs. 16 and 17, in the control pattern PaH, the pass-through point UP is located on one end side of the second sub-pixel G in the Y direction. In the lower column of "Case 11" in Fig. 27, the position of the viewpoint EE in the Y direction is shown as position idp11. "Case 11" illustrates a case in which light from the light-emitting point LP can reach the viewpoint EE by passing through pixel PixU and pixel PixT adjacent to pixel PixU at a position closer to the pass-through point UP.

[0168] On the other hand, in "Case 12" shown in FIG. 27, compared to "Case 11," the position of the viewpoint EE changes from position idp11 to position idp12. Also, compared to "Case 11," in "Case 12," the angle θ12 between the ray idq12 connecting the viewpoint EE and the light-emitting point LP and the Z direction is different from the angle θ11 between the ray idq11 and the Z direction in "Case 11." As a result, in "Case 12," the ratio of the proportion of light from the light-emitting point LP that passes through pixel PixU to the proportion of light that passes through pixel PixT is different from that in "Case 11." In the example shown in FIG. 27, in "Case 11," the ratio of the RGBH light that passes through pixel PixU to the RGBL light that passes through pixel PixT is approximately 2:1. On the other hand, in "Case 11," the ratio of the RGBH light that passes through pixel PixU to the RGBL light that passes through pixel PixT is approximately 1:2. The combination of this difference in ratio and the fact that "the degree of light transmittance of pixel PixU is different from the degree of light transmittance of pixel PixT" results in a difference in the brightness of the display output between "Case 11" and "Case 12."

[0169] Suppose that the pixel signal assigned to pixel PixU when the sub-pixel control described with reference to FIG. 17 is not applied is a pixel signal corresponding to white with maximum brightness. As a specific example, when the pixel signal is expressed as an 8-bit signal for each of RGB, (R, G, B) = (255, 255, 255). When the sub-pixel control described with reference to FIG. 17 is applied to pixel PixU to which such pixel signal is applied, 66% of the 100% brightness white component corresponding to the pixel signal is allocated to pixel PixU, and 33% is allocated to pixel PixT. This is because, as described above, the brightness allocated to pixel PixT is at most half that of pixel PixU. Comparing "Case 11" and "Case 12" under the condition where the sub-pixel control described with reference to FIG. 17 is applied to pixel PixU to which such pixel signal is applied, the light RGB12 perceived from the viewpoint EE in "Case 12" is darker than the light RGB11 perceived from the viewpoint EE in "Case 11." This is because in "Case 11," the ratio of light RGBH passing through pixel PixU, which has a relatively high light transmittance, to light RGBL passing through pixel PixT, which has a relatively low light transmittance, is approximately 2:1, but in "Case 12," the ratio is approximately 1:2. That is, while light RGB11 and light RGB12 both contain light RGBH and light RGBL, light RGB12 has a higher ratio of light RGBL and a lower ratio of light RGBH than light RGB11.

[0170] 27 and FIG. 30, which will be described later, illustrate the case where the width in the Y direction of one light-emitting point LP is width SSy1. Width SSy1 is the width in the Y direction of the light-emitting point LP that corresponds to the width in the Y direction of one pixel Pix. In other words, width SSy1 is the design width in the Y direction of the light-emitting point LP that is determined in advance on the assumption that light from one light-emitting point LP passes through the display panel 20A in the X direction with a width equivalent to one pixel Pix as the center, and reaches the viewpoint EE. Note that this design width is determined, for example, in consideration of a distance Ph, which will be described later, but is not limited to this and can be changed as appropriate.

[0171] As explained in the comparison between "Case 11" and "Case 12" in Figure 27, even if the sub-pixel control pattern described with reference to Figure 17 is the same, there may be an unintended decrease in brightness, as in "Case 12." Therefore, by increasing the number of pixels Pix that are controlled to transmit light based on the positional relationship between pixel PixU and pass point UP, such a decrease in brightness can be suppressed. Below, sub-pixel control patterns (control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL) for forming a transmissive region having a width in the Y direction equivalent to two pixels Pix will be described with reference to Figure 28.

[0172] Fig. 28 is a schematic diagram showing drive control different from Fig. 17 and Fig. 24. The sub-pixel control patterns shown in Fig. 28 are obtained by replacing the control patterns PbA, PbB, PbC, PbD, PbI, PbJ, PbK, and PbL of the sub-pixel control patterns shown in Fig. 24 with control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL. In other words, the control patterns PbE, PbF, PbG, and PbH are common to Fig. 24 and Fig. 28.

[0173] The subpixels to which control corresponding to pixel signals is applied in control pattern PcA are the same as those in control pattern PbA. The subpixels to which control corresponding to pixel signals is applied in control pattern PcB are the same as those in control pattern PbB. The subpixels to which control corresponding to pixel signals is applied in control pattern PcC are the same as those in control pattern PbC. The subpixels to which control corresponding to pixel signals is applied in control pattern PcD are the same as those in control pattern PbD. The subpixels to which control corresponding to pixel signals is applied in control pattern PcI are the same as those in control pattern PbI. The subpixels to which control corresponding to pixel signals is applied in control pattern PcJ are the same as those in control pattern PbJ. The subpixels to which control corresponding to pixel signals is applied in control pattern PcK are the same as those in control pattern PbK. The subpixels to which control corresponding to pixel signals is applied in control pattern PcL are the same as those in control pattern PbL.

[0174] On the other hand, in the control patterns PbA, PbB, PbC, PbD, PbI, PbJ, PbK, and PbL, the distribution of gradation values ​​in pixel control described with reference to Fig. 24 is applied, but in the control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL shown in Fig. 28, the distribution of gradation values ​​in pixel control described with reference to Fig. 24 is not applied. In the control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL shown in Fig. 28, the subpixels are controlled so that the degree of light transmittance of each of two subpixels adjacent in the Y direction is the same.

[0175] In the control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL, the first subpixel R, second subpixel G, and third subpixel B located at y=0 and the first subpixel R, second subpixel G, and third subpixel B located at coordinates in the Y direction other than y=0 are controlled so that their gradation values ​​are both γ% of the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU. γ is a value greater than 0 and less than or equal to 100. For example, the first subpixel R, second subpixel G, and third subpixel B may be controlled so that the red (R), green (G), and blue (B) gradation values ​​indicated by the pixel signal for pixel PixU are applied to both the gradation values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y=0 and the gradation values ​​of the first subpixel R, second subpixel G, and third subpixel B located at a Y-axis coordinate other than y=0. In this case, γ=100. In this way, with the control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL, the degree of light transmission of each of two pixels Pix adjacent in the Y direction in the light transmission region formed by controlling the subpixels to transmit light in accordance with the pixel signals is the same.

[0176] Fig. 29 is a schematic diagram showing the positional relationship between the light-emitting point LP, pixel PixU, and viewpoint EE when the sub-pixel control pattern described with reference to Fig. 28 is applied. "Case 13" shown in Fig. 29 is obtained by replacing the control pattern PaH applied in "Case 11" described with reference to Fig. 27 with the control pattern PcH. Also, "Case 14" is obtained by replacing the control pattern PaH applied in "Case 12" described with reference to Fig. 27 with the control pattern PcH.

[0177] The light RGB13 shown in "Case 13" of FIG. 29 can be ensured to be brighter than the light RGB11 of "Case 11" described with reference to FIG. 27. Furthermore, the light RGB14 shown in "Case 14" of FIG. 30 can be ensured to be brighter than the light RGB11 of "Case 11" because the control pattern applied to the subpixel is the control pattern PcH, unlike the light RGB12 of "Case 12" described with reference to FIG. 27. Furthermore, as shown in "Case 13" and "Case 14" of FIG. 29, even if the position of the viewpoint EE shifts from position idp11 to position idp12, the brightness of the light reaching the viewpoint EE can be made equal. That is, both the light RGB13 and the light RGB14 contain the light RGBH but do not contain the light RGBL. Furthermore, the width in the Y direction of the light-emitting point LP that is the source of the light RGB13 and the light RGB14 is both the width SSy1. Therefore, it can be said that the light RGB13 and the light RGB14 have equal brightness in the Y direction.

[0178] As described with reference to FIGS. 28 and 29, by increasing the number of pixels Pix that are controlled to transmit light, it is possible to suppress a decrease in brightness.

[0179] When the control patterns PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL are applied, the sub-pixels are controlled to transmit light in accordance with the pixel signal assigned to the pixel PixU, thereby forming a transmissive region having a width in the Y direction that is twice that of the pixel Pix (see, for example, the transmissive region TRy2 shown in FIG. 31). Note that in the embodiment, this transmissive region is also a transmissive region having a width in the X direction that is twice that of the pixel Pix (see, for example, the transmissive region TRx2 shown in FIG. 26). Next, an example of the relationship between the width in the Y direction of the light-emitting point LP and the angle of view will be described with reference to FIGS. 30 and 31.

[0180] FIG. 30 is a schematic diagram showing an example of the relationship between the display panel 20A and two viewpoints E1 and E2, and the angle of view for each viewpoint E1 and E2. In the example shown in FIG. 30, viewpoints E1 and E2 are symmetrically positioned in the Y direction across axis Zb, which passes through midpoint CP and focus target FP. Axis Zb is tilted 1.5 degrees toward viewpoint E2 with respect to the Z direction. The viewpoint E1 side with respect to axis Zb is one side (negative (-) side) in the Y direction. The viewpoint E2 side with respect to axis Zb is the other side (positive (+) side) in the Y direction. In the example shown in FIG. 30, the line of sight from viewpoint E1 to focus target FP is tilted by -4.5 degrees with respect to axis Zb. The line of sight from viewpoint E2 to focus target FP is tilted by 4.5 degrees with respect to axis Zb.

[0181] In the example shown in Fig. 30, a range AN3 of ±1.5 degrees (°) from the line of sight is shown as a range where brightness does not decrease. Also, a range AN4 of ±3 degrees (°) on either side of range AN3 is shown as a range where brightness decreases but images for each viewpoint are still visible. These ranges AN3 and AN4 are those in which the subpixel control patterns described with reference to Figs. 28 and 29 are applied, for example.

[0182] Fig. 31 is a schematic diagram showing the relationship between the Y-direction width of the light-emitting point LP, within which the range AN3 described with reference to Fig. 30 is established, and the sub-pixel control patterns described with reference to Figs. 28 and 29. In the sub-pixel control patterns described with reference to Figs. 28 and 29, the transparent region controlled to transmit light in accordance with a pixel signal assigned to pixel PixU has a Y-direction width equivalent to two pixels Pix. As a result, margins EM3 ​​and EM4 of one sub-pixel are generated on one side of the Y-direction from lines of sight CL11 and CL12 corresponding to the positions of viewpoints E1 and E2 acquired by the acquisition unit (e.g., the imaging unit 2, the distance measurement unit 3, the gyro sensor 4, and the gaze tracking unit 11) and margins EP3 and EP4 of two sub-pixels are generated on the other side of the Y-direction.

[0183] In the example shown in Fig. 31, in the range between line CL13 on one side of line CL11 in the Y direction and line CL14 on the other side of line CL11 in the Y direction, an image substantially similar to that of viewpoint E1 located at line CL11 can be viewed. This range corresponds to range AN3 of viewpoint E1 described with reference to Fig. 30. Furthermore, in the range between line CL15 on one side of line CL12 in the Y direction and line CL16 on the other side of line CL12 in the Y direction, an image substantially similar to that of viewpoint E2 located at line CL12 can be viewed. This range corresponds to range AN4 of viewpoint E2 described with reference to Fig. 30.

[0184] Even if the image is outside the margins EM3, EM4, EP3, and EP4, it is possible to output an image for each viewpoint as long as it is within the range AN4 described with reference to Figure 30, although this will result in a decrease in brightness.

[0185] The width SS of the light-emitting point LP in the X direction, i.e., the width SSx1, corresponds to the pixel width PPx (see FIG. 21). The width of the light-emitting point LP in the Y direction, i.e., the width SSy1, corresponds to the pixel width PPy (see FIG. 27). The correspondence between the pixel width PPx and the pixel width PPy will be described below with reference to FIGS. 32 and 33.

[0186] 32 and 33 are schematic diagrams showing a comparison between pixel widths PPx and PPy and an example of the arrangement of sub-pixels. It is desirable that the pixel width PPx be equal to or greater than the pixel width PPy. For example, as shown in FIG. 32, the pixel width PPx may be greater than the pixel width PPy, or as shown in FIG. 33, the pixel width PPx may be equal to the pixel width PPy.

[0187] 32 and 33, subpixels of different colors may be adjacent to each other in the Y direction. When subpixels of different colors are adjacent to each other in the Y direction, the first subpixel R, the second subpixel G, and the third subpixel B are arranged so that one of them is sandwiched between the other two subpixels, and the other two face each other in the Y direction. Of course, as described with reference to FIG. 16, subpixels of the same color may be arranged side by side in the Y direction.

[0188] Although the matters relating to the X direction and the matters relating to the Y direction have been described separately, the embodiment may incorporate both the technical features relating to the X direction and the technical features relating to the Y direction.

[0189] Next, the idea for determining the distance Th when designing the display device will be described with reference to FIG.

[0190] FIG. 34 is a schematic diagram showing a distance Th determined so that the ratio of the value of distance D1 to the sum of distances Ph and Th is equal to the ratio of the value of distance Th to the value of distance D. In FIG. 34, distance D is the distance in the X direction between the midpoint CP and the intersection of the center line of pixel Pix in the Z direction with ray LQ. Ray LQ is a ray of light that reaches a viewpoint (e.g., second viewpoint E2) that is a distance D1 in the X direction from midpoint CP, which is located a distance Ph away from pixel Pix in the Z direction. Ray LQ is a ray of light emitted from a light-emitting point LP (e.g., light-emitting point 32) located opposite midpoint CP in the Z direction. Furthermore, the line connecting the center of the light-emitting point that is the origin of ray LQ and midpoint CP is parallel to the Z direction (perpendicular to the XY plane). In FIG. 34, equation (25) indicating the following ratio holds. D in equation (25) is the value of distance D. (Th+Ph):D1=Th:D…(25)

[0191] Based on the above-mentioned equation (25), the following equation (26) holds. D×(Th+Ph)=D1×Th…(26)

[0192] Based on the above-mentioned equation (26), the following equation (27) holds. (D1-D)×Th=D×Ph…(27)

[0193] Based on the above-mentioned equation (27), the following equation (28) holds: As shown in equation (28), the value of the distance Th can be derived based on the value of the distance Ph (pos_h), the value of the distance D1, and the value of the distance D. Th = Ph × D / (D1-D)…(28)

[0194] The value of the distance Ph can be set to a value that is generally assumed as the distance between the display device 1 and a user viewing an image on the display device 1. For example, when the display device 1 is provided in a mobile terminal such as a smartphone, the distance Ph can be set to, for example, 30 cm (300 mm). The value of the distance D1 can be set to half the average value of the distance between the two eyes of a human (distance D2). As a specific example, D2 = 62.5 mm, that is, D1 = 31.25 mm. Of course, these values ​​of the distance Ph and the distance D1 are merely examples and are not limited to these, and can be changed as appropriate.

[0195] The distance D can be calculated based on the relationship between the pitch of the light-emitting points LP (e.g., the light-emitting point pitch SpP, the light-emitting point pitch SpP2, etc.) and the pixel pitch PP. For example, if the relationship between the pitch of the light-emitting points LP and the pitch of the pixels Pix is ​​1:6n, then the distance D is estimated to be approximately 1.5n times the pixel pitch PP {D=(1.5n)PP}, as shown in FIG. 34 . If the relationship between the pitch of the light-emitting points LP and the pitch of the pixels Pix is ​​1:4, then the distance D is estimated to be approximately the same as the pixel pitch PP (D=nPP). Therefore, the distance Th can be calculated based on the estimated values ​​of the distance Ph and the distance D1, the relationship between the pitch of the light-emitting points LP and the pitch of the pixels Pix, and the pixel pitch PP. By adjusting the thickness of the components included in the spacer 40 in the Z direction according to the calculated distance Th, the display panel 20 can be realized with a distance Th that corresponds to the estimated conditions. The distances D and Th can also be calculated for the display panel 20A using a similar approach. It is expected that the distances Ph and D1 will differ slightly from those defined at the time of design due to actual usage conditions and individual differences among users, but it goes without saying that display devices manufactured based on the above design have redundancy to accommodate such slight differences during use.

[0196] 34, if the pixel width PPx is 0.03 mm and the width of one subpixel in the X direction is 0.01 mm, the width SSx1 will be approximately 0.0315 mm. Also, in this case, if the pixel width PPx is 0.01 mm, the width SSy1 will be approximately 0.0315 mm.

[0197] The pixel width PPx, i.e., the "X-direction width of one pixel Pix," can be determined, for example, based on the intermediate position in the X-direction of a non-light-transmitting portion (black matrix) that separates the pixels Pix arranged in the X-direction. For example, when one pixel Pix includes three subpixels as in the embodiment, the width in the X-direction between a first intermediate position and a second intermediate position (described later) can be considered to be the X-direction width of one pixel Pix. The first intermediate position is the intermediate position in the X-direction of a non-light-transmitting portion that separates a subpixel (e.g., the first subpixel R) located at one end of the pixel Pix in the X-direction from a subpixel (e.g., the third subpixel B) of another pixel Pix adjacent to the subpixel. The second intermediate position is the intermediate position in the X-direction of a non-light-transmitting portion that separates a subpixel (e.g., the third subpixel B) located at the other end of the pixel Pix in the X-direction from a subpixel (e.g., the first subpixel R) of another pixel Pix adjacent to the subpixel. Using a similar concept, the pixel width PPy, i.e., the "width of one pixel Pix in the Y direction," can be determined, for example, based on the midpoint in the Y direction of the non-transmitting portion (black matrix) that separates the pixels Pix aligned in the Y direction. The distance between the centers of adjacent pixels in the x direction may be defined as the pixel pitch in the x direction, and the pixel pitch in the x direction may be defined as the pixel width PPx. In this case, the pixel width PPx × 1 / 3 may be defined as the width of a sub-pixel in the x direction. Similarly, the distance between the centers of adjacent pixels in the y direction may be defined as the pixel pitch, and the pixel pitch may be defined as the pixel width PPy. In this case, the pixel width PPy × 1 / 2 may be defined as the width of a sub-pixel in the y direction.

[0198] Note that the derivation of the value of the distance Th based on equation (28) does not take into consideration the refraction of light that occurs at the interface between the display panel 20 and the air interposed between the display panel 20 and the user. Therefore, by determining the distance Th while further considering the effect of such refraction on the ray of light, crosstalk can be suppressed with higher accuracy.

[0199] According to the embodiment, the display device 1 includes a liquid crystal display panel (for example, the display panel 20 or the display panel 20A) provided with a plurality of pixels (for example, pixels Pix), and a light source (for example, the light source 30) provided with a plurality of light-emitting points (light-emitting points LP, specifically, light-emitting points 32, etc.) that irradiates the plurality of pixels of the liquid crystal display panel with light, and the ratio of the pitch of the plurality of pixels aligned in a first direction (for example, the X direction) to the pitch of the plurality of light-emitting points aligned in the first direction is 1:4n or 1:6n (for example, 1:6), where n is a natural number, and the pixels are arranged at the first A pixel (pixel PixU) includes a plurality of subpixels (e.g., a first subpixel R, a second subpixel G, and a third subpixel B) arranged in the first direction. The pixel is located on a ray of light between the viewpoint of a user directing their gaze toward the image display surface of the liquid crystal display panel and one of the light-emitting points and is controlled to transmit light. The pixel PixU is continuously arranged in the first direction with subpixels included in a pixel other than the pixel PixU and controlled to transmit light, forming a transmissive region (transmissive region TRx2). The width of one of the transmissive regions in the first direction is twice the width of the pixel in the first direction (width SSx1). This makes it easier for the user to view an image with sufficient brightness even if a positional deviation occurs in the first direction, compared to when the width of the light-emitting point in the first direction is equal to or smaller than the width of the pixel in the first direction. Therefore, according to the embodiment, degradation of image quality can be more easily suppressed.

[0200] Furthermore, a plurality of pixels (e.g., pixel Pix) are arranged in a matrix along a first direction (e.g., the X direction) and a second direction (e.g., the Y direction) perpendicular to the first direction, and the ratio of the pitch of the plurality of pixels arranged in the second direction to the pitch of the plurality of light-emitting points (light-emitting points LP, specifically light-emitting points 32, etc.) arranged in the second direction is 1:4n or 1:6n (e.g., 1:6). The width of one transmissive region (transmissive region TRy2) in the second direction is twice the width of the pixel in the second direction. This more reliably realizes the display output of individual images for a plurality of viewpoints. That is, even if the arrangement direction of the plurality of viewpoints (two viewpoints for the right eye and the left eye) from the user does not correspond to the horizontal direction (e.g., the X direction) of the liquid crystal display panel, the display output of individual images for the plurality of viewpoints can be realized. Therefore, according to the embodiment, the relationship between the arrangement direction of the plurality of viewpoints and the display device 1 can be more flexibly accommodated.

[0201] Furthermore, since the width of one transmissive region (transmissive region TRy2) in the second direction (e.g., Y direction) is two pixels (e.g., pixel Pix), and the degree of light transmission of each of two adjacent pixels in the second direction in one transmissive region is the same, it becomes easier for the user to view an image with sufficient brightness even if misalignment occurs in the second direction. Therefore, according to the embodiment, it becomes easier to suppress degradation of image quality.

[0202] The liquid crystal display panel (e.g., display panel 20 or 20A) also includes an acquisition unit (e.g., imaging unit 2, distance measurement unit 3, gyro sensor 4, and gaze tracking unit 11) that acquires viewpoint information of a user viewing the panel, and a control unit (e.g., image output unit 12) that controls the display of an image by operating a plurality of pixels based on the viewpoint information. The viewpoint information includes information (e.g., pos_x, pos_y, pos_h) about the positions of a plurality of viewpoints (e.g., a first viewpoint E1 and a second viewpoint E2, a first viewpoint EC and a second viewpoint ED, etc.) and information indicating the arrangement direction of the plurality of viewpoints (relative angle rot). The control unit drives pixels (pixels Pix including passing point UP) located on a line connecting each light-emitting point and each viewpoint to transmit light and include the driven pixels in a transparent region, based on the angle (relative angle rot) between a predetermined direction (e.g., the X direction) and the arrangement direction in the liquid crystal display panel and the positional relationship between the viewpoint and the light-emitting point. The ratio of the pitch of the pixels aligned in the predetermined direction to the pitch of the light-emitting points aligned in the predetermined direction is 1:4n or 1:6n (e.g., 1:6), where n is a natural number. This allows the display of the pixels to correspond to the angle between the predetermined direction and the alignment direction on the liquid crystal display panel and the positional relationship between the viewpoint and the light-emitting points. Even if the angle is not zero, i.e., even if the alignment direction of the multiple viewpoints (two viewpoints for the right eye and the left eye) from the user does not correspond to the pre-determined horizontal direction (e.g., the X direction) of the liquid crystal display panel, it is possible to display and output individual images for the multiple viewpoints. Therefore, according to the embodiment, the relationship between the alignment direction of the multiple viewpoints and the display device 1 can be more flexibly handled.

[0203] The acquisition unit also includes an imaging unit (e.g., imaging unit 2) that images the user, and a processing unit (e.g., gaze tracking unit 11) that, based on the captured image of the user, identifies the alignment direction of the right and left eyes of the user, the relative rotation angle and positional relationship between the liquid crystal display panel and the alignment direction, etc. This makes it possible to acquire user viewpoint information from the captured image of the user.

[0204] Furthermore, a pixel (e.g., pixel Pix) includes multiple sub-pixels, and a control unit (e.g., image output unit 12) drives the sub-pixels located on the line connecting each light-emitting point and each viewpoint, as well as some of the other sub-pixels adjacent to those sub-pixels, for display. This allows for display output that corresponds to the position on a sub-pixel basis. Therefore, display output that corresponds to the viewpoint position more precisely than when done on a pixel basis can be achieved.

[0205] Furthermore, the control unit (e.g., image output unit 12) transmits light to sub-pixels located closer to the intersection of the optical axis between the viewpoint and the light-emitting point and the sub-pixels included in other pixels adjacent to the pixel including the sub-pixel located at the intersection (the position of the passing point UP) with the optical axis between the viewpoint and the light-emitting point, thereby enabling display output corresponding to that position with higher accuracy.

[0206] The acquisition unit also includes a distance measurement unit (e.g., distance measurement unit 3) that measures the distance between the liquid crystal display panel (e.g., display panel 20 or display panel 20A) and the user. This allows the distance between the liquid crystal panel and the user to be included in the user's viewpoint information. Therefore, display output that corresponds to the viewpoint position with high accuracy can be performed.

[0207] Furthermore, the control unit (e.g., image output unit 12) changes the pixels (e.g., pixel Pix) to be driven for display depending on the liquid crystal display panel (e.g., display panel 20 or display panel 20A) obtained by the processing unit (e.g., gaze tracking unit 11) and the alignment direction of the user's right eye and left eye. As a result of "changing" here, for example, the display mode will be different when the relative angle rot is 45 degrees (°) and when the relative angle rot is an angle other than 45 degrees (e.g., 90 degrees (°)).

[0208] The above-described configuration of the display device 1 is merely an example of an embodiment and is not limited thereto. For example, a point light source may be provided at the position of the light-emitting point LP. That is, the specific configuration of the light-emitting point LP may be a point light source. The point light source may be, for example, a minute LED called a mini LED or a micro LED, but is not limited thereto and may be a point light source realized by other light-emitting elements (for example, an organic light-emitting diode (OLED)). When a point light source is provided at the position of the light-emitting point LP, the light source 30 may have, for example, a configuration including a plurality of point light sources and a substrate on which the plurality of point light sources are mounted.

[0209] It should be noted that in the figures referenced in the above explanation, examples where the relative angle rot is 0 degrees (°), 45 degrees (°), and 90 degrees (°) are specifically noted, but the relative angle rot is not limited to these angles and can be any angle within the range of -180 degrees (°) to 180 degrees (°) depending on the relationship between the display panel 20A and the face HF.

[0210] 8 to 34 have been described using an example in which the correspondence between the pitch of the plurality of pixels Pix and the pitch of the plurality of light-emitting points LP is 1:6, but the various controls described with reference to FIGS. 8 to 34 can also be applied to a case in which the correspondence is 1:4, as shown in FIGS. 3 and 34. The correspondence may be 1:6α or 1:4α, where α is a natural number. The center position of the light-emitting point LP is not limited to a position between two adjacent pixels Pix from a planar viewpoint. For example, the center position of the light-emitting point LP and the center position of the pixel Pix may overlap, or may have another positional relationship.

[0211] The shape and number of sub-pixels provided in a pixel Pix are not limited to those described with reference to FIG. 16 etc. The number of sub-pixels provided in one pixel Pix may be two or less or four or more. The arrangement of the sub-pixels provided in one pixel Pix is ​​not limited to an arrangement along the X direction, but may be an arrangement along the Y direction or in a matrix form. The shape of the sub-pixels when viewed from a plan view is not limited to a rectangular shape, but may be any shape.

[0212] Furthermore, other effects and advantages brought about by the aspects described in this embodiment that are clear from the description in this specification or that can be appropriately thought of by a person skilled in the art are naturally understood to be brought about by the present disclosure. [Explanation of symbols]

[0213] 1 Display device 2. Imaging unit 3 Ranging section 10 Signal Processing Section 20,20A display panel Pix E1,EC First Viewpoint E2,ED Second Viewpoint ER, EL, EE perspectives TRx2,TRy2 transmission area

Claims

1. a liquid crystal display panel provided with a plurality of pixels; a light source provided with a plurality of light-emitting points and configured to irradiate light onto a plurality of pixels of the liquid crystal display panel; a ratio of a pitch of the plurality of pixels arranged in a first direction to a pitch of the plurality of light-emitting points arranged in the first direction is 1:4n or 1:6n; n is a natural number, The pixel includes a plurality of sub-pixels aligned in the first direction, the pixel, which is located on a ray of light between a viewpoint of a user directing his or her gaze toward an image display surface side of the liquid crystal display panel and one of the light-emitting points and is controlled to transmit light, is continuously aligned in the first direction with a sub-pixel included in a pixel other than the pixel, which is controlled to transmit light, to form a transmission region; The width of one of the transmission regions in the first direction is twice the width of the pixel in the first direction. Display device.

2. the plurality of pixels are arranged in a matrix along the first direction and a second direction perpendicular to the first direction, a ratio of a pitch of the plurality of pixels arranged in the second direction to a pitch of the plurality of light-emitting points arranged in the second direction is 1:4n or 1:6n, a width of one of the transmission regions in the second direction being twice the width of the pixel in the second direction; The display device according to claim 1 .

3. a width of one of the transmission regions in the second direction is equal to two pixels; In one of the transmission regions, two pixels adjacent to each other in the second direction have the same degree of light transmittance. The display device according to claim 2 .

4. an acquisition unit that acquires viewpoint information of the user; a control unit that controls display of an image by operation of the plurality of pixels based on the viewpoint information, the viewpoint information includes information about the positions of a plurality of viewpoints and information indicating an arrangement direction of the plurality of viewpoints, the control unit causes at least pixels located on a straight line connecting each light-emitting point and each viewpoint to be included in the transmission area based on a relative rotation angle between the liquid crystal display panel and the alignment direction and a positional relationship between the viewpoint and each light-emitting point. The display device according to claim 1 .

5. The acquisition unit an imaging unit that images the user; a processing unit that identifies the arrangement direction, the relative rotation angle, and the positional relationship of the right eye and the left eye of the user based on the captured image of the user; The display device of claim 4 , comprising:

Images