Display device

By setting pixels and light-emitting points with a specific pitch ratio on the liquid crystal display panel and using sub-pixel control, image quality stability is achieved when the viewpoint position is offset, solving the problem of image quality degradation in the prior art.

CN120821116APending Publication Date: 2025-10-21MAGNOLIA WHITE CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510404024.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-04-02
Filing Date
2025-04-01
Publication Date
2025-10-21

AI Technical Summary

Technical Problem

The existing image separation body easily leads to degradation of image quality when the viewpoint position shifts, and cannot effectively suppress the degradation of image quality.

Method used

By setting the pitch ratio of pixels to light-emitting points on the LCD panel to 1:4n or 1:6n, the width of the transparent area is controlled to be twice the pixel width, and through the arrangement and drive control of sub-pixels, it is ensured that each viewpoint outputs an image independently.

Benefits of technology

The degradation of image quality caused by viewpoint position deviation is effectively suppressed, and the image quality stability of the display device is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120821116A_ABST
    Figure CN120821116A_ABST
Patent Text Reader

Abstract

The invention provides a display device which can more easily suppress image quality reduction caused by position deviation of a viewpoint. The display device is provided with a liquid crystal display panel provided with a plurality of pixels and a light source provided with a plurality of light emitting points (LP) and irradiating the plurality of pixels of the liquid crystal display panel with light, and the ratio of the pitch of the plurality of pixels arranged in the X direction to the pitch of the plurality of light emitting points (LP) arranged in the X direction is 1: 4n or 1: 6n, n being a natural number. The pixels include a plurality of sub-pixels arranged in the X direction, and pixels (PixU), which are located on rays of light between a viewpoint of a user whose line of sight faces the image display surface side of the liquid crystal display panel and one light emitting point (LP) and which are controlled so as to transmit light, and other sub-pixels, which are controlled so as to transmit light, are continuously arranged in the X direction to form a transmission region. The width of one transmission region in the X direction is twice the width of the pixel in the X direction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display device. Background Art

[0002] There is known a display device that can output separate images for multiple viewpoints using an image separator such as a parallax barrier (for example, Patent Document 1).

[0003] Patent Document 1: Japanese Patent No. 3865762

[0004] Conventional image separation bands are set to correspond to the pre-determined viewpoint position. Therefore, if the viewpoint shifts from the pre-determined position, even if the shift is such that the image can barely be visually recognized, image quality will be reduced, resulting in an image that is only visually recognized with less brightness than the image that can be viewed from the pre-determined viewpoint. In light of these circumstances, a mechanism is being sought to suppress image quality degradation even when the viewpoint shifts. Summary of the Invention

[0005] The present disclosure has been made in view of the above-mentioned technical problems, and an object of the present disclosure is to provide a display device that can more easily suppress degradation of image quality due to positional deviation of viewpoints.

[0006] According to one aspect of the present disclosure, a display device comprises: a liquid crystal display panel, provided with a plurality of pixels; and a light source, provided with a plurality of light-emitting points, and irradiating light to the plurality of pixels of the liquid crystal display panel, wherein the ratio of the pitch of the plurality of pixels arranged in a first direction to the pitch of the plurality of light-emitting points arranged in the first direction is 1:4n or 1:6n, where n is a natural number, and the pixel includes a plurality of sub-pixels arranged in the first direction, and the pixel that is located on a ray of light between a viewpoint of a user who directs his sight toward the image display surface side of the liquid crystal display panel and one of the light-emitting points and is controlled to transmit light and the sub-pixels controlled to transmit light included in pixels different from the pixel are continuously arranged in the first direction to form a transmission area, and the width of one of the transmission areas in the first direction is twice the width of the pixel in the first direction. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 This is a block diagram showing the main structure of a display device.

[0008] Figure 2 3 is a diagram showing an example of a viewpoint-corresponding image.

[0009] Figure 3 Schematic diagram showing the stacked structure of a display panel.

[0010] Figure 4This is a cross-sectional view showing an example in which the light-emitting point pitch is six times the pixel pitch.

[0011] Figure 5 This diagram shows various parameters related to determining the X-direction coordinate of a pixel located on a ray of light between the emission point of light from the (i+1)th light source in the X-direction from the origin and the viewpoint.

[0012] Figure 6 Schematic diagrams showing examples A and B of the relative angular relationship between a person's face and a display device including a display panel.

[0013] Figure 7 Schematic diagram showing an example of the angle difference between the face and the display panel based on the vertical line and the horizontal line.

[0014] Figure 8 is to show the relative angle with reference to Figure 3 and Figure 4 This is a schematic diagram showing an example of the relationship between the first pixel PixC and the second pixel PixD for the validity of outputting separate images for a plurality of viewpoints by controlling the pixels Pix along the X direction.

[0015] Figure 9 is to show the relative angle with reference to Figure 3 and Figure 4 This is a schematic diagram of another example of the relationship between the first pixel PixC and the second pixel PixD for the validity of outputting separate images for a plurality of viewpoints by controlling the pixels Pix along the X direction.

[0016] Figure 10 Schematic diagram showing an example of pixel arrangement control when the relative angle is 45 degrees (°).

[0017] Figure 11 Schematic diagram showing an example of pixel arrangement control when the relative angle is 90 degrees (°).

[0018] Figure 12 is shown reflecting the reference Figure 10 and Figure 11 This is a schematic diagram showing an example of the relationship between the relative angle and the validity of outputting individual images for a plurality of viewpoints in the case of the arrangement control described above.

[0019] Figure 13 This is a diagram showing various parameters related to coordinates R_(i, j) and coordinates L_(i, j) derived based on the positional relationship between the light emitting point located at coordinates LP(i, j) and the viewpoint.

[0020] Figure 14LP(i, j) is a schematic diagram showing the relationship between the length width and the pixel PixU through which light passes from the light-emitting point located at the coordinates LP(i, j) to the viewpoint.

[0021] Figure 15 Schematic diagram showing an example of the difference between the position of a passage point P_(i, j) in a pixel located on a ray of light between a light emitting point LPP and a viewpoint and the position of a passage point Q_(i, j) in a pixel located on a ray of light between a light emitting point LPQ and a viewpoint.

[0022] Figure 16 2 is a diagram showing a coordinate system based on the pixel PixU.

[0023] Figure 17 1 is a schematic diagram showing an outline of drive control of the pixel PixU according to the intersection position of the ray of light between the light emitting point and the viewpoint with the pixel PixU.

[0024] Figure 18 This shows that the reference Figure 17 A diagram showing an example of display output for the described sub-pixel control.

[0025] Figure 19 This shows that the reference Figure 17 A diagram showing another example of display output for the described sub-pixel control.

[0026] Figure 20 1 is a diagram illustrating a partial area within the display area of ​​a display panel of a display device.

[0027] Figure 21 This is a schematic diagram showing the positional relationship among the light-emitting point, the pixel, and the viewpoint when there is no substantial positional displacement between the viewpoint and the display device.

[0028] Figure 22 This is a schematic diagram showing the positional relationship among a light-emitting point, a pixel, and a viewpoint when a viewpoint and a display device are substantially positionally misaligned.

[0029] Figure 23 This is a schematic diagram showing the positional relationship among the light-emitting point, the pixel, and the viewpoint when the transmission area controlled based on the positional relationship between the pixel and the passage point exceeds the amount corresponding to one pixel Pix.

[0030] Figure 24 is shown with Figure 17 Schematic diagram of different drive controls.

[0031] Figure 25 This is a schematic diagram showing an example of the relationship between a display panel and two viewpoints, and the viewing angle with respect to each viewpoint.

[0032] Figure 26 Reference Figure 25 The width of the light emitting point in the X direction of the range AN1 described above is the same as the width of the reference Figure 23 and Figure 24 A schematic diagram illustrating the relationship between control modes for the described sub-pixels.

[0033] Figure 27 Is to show the application reference Figure 16 Schematic diagram of the positional relationship between the light-emitting point, pixel and viewpoint in the Y direction under the conditions of the sub-pixel control mode described above.

[0034] Figure 28 is shown with Figure 17 and Figure 24 Schematic diagram of different drive controls.

[0035] Figure 29 Is to show the application reference Figure 28 A schematic diagram showing the positional relationship between the light-emitting point, pixel, and viewpoint in the case of the described sub-pixel control mode.

[0036] Figure 30 This is a schematic diagram showing an example of the relationship between a display panel and two viewpoints, and the viewing angle with respect to each viewpoint.

[0037] Figure 31 Reference Figure 30 The width of the light emitting point in the Y direction of the range AN3 described above is the same as the reference Figure 28 and Figure 29 A schematic diagram illustrating the relationship between control modes for the described sub-pixels.

[0038] Figure 32 This is a schematic diagram showing a comparison between pixel width PPx and pixel width PPy and an example of sub-pixel arrangement.

[0039] Figure 33 This is a schematic diagram showing a comparison between pixel width PPx and pixel width PPy and an example of sub-pixel arrangement.

[0040] Figure 34 Schematic diagram showing the distance Th defined so that the ratio of the value of the distance D1 to the value obtained by adding the distance Ph and the distance Th is equal to the ratio of the value of the distance Th to the value of the distance D. DETAILED DESCRIPTION

[0041] Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be pointed out that what is disclosed is only an example, and appropriate changes that maintain the main purpose of the disclosure and that can be easily thought of by those skilled in the art are of course also within the scope of the present disclosure. In addition, in order to make the description clearer, the width, thickness, shape, etc. of each part in the drawings are sometimes schematically represented compared with the actual aspects, but it is only an example after all and does not limit the interpretation of the present disclosure. In addition, in this specification and the drawings, the same figure marks are marked for the elements that are the same as the elements described in the drawings that have appeared, and the detailed description is sometimes appropriately omitted.

[0042] Figure 1 This is a block diagram showing the main components of a display device 1. The display device 1 includes an imaging unit 2, a distance measuring unit 3, a signal processing unit 10, a display panel 20, and a light source 30. The display device 1 is an information processing device (information processing terminal), such as a smartphone, that combines the imaging function of the imaging unit 2, the distance measuring function of the distance measuring unit 3, and the image display and output functions of the signal processing unit 10, the display panel 20, and the light source 30.

[0043] The imaging unit 2 captures an image. Specifically, the imaging unit 2 includes an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging unit 2 generates image data based on an electrical signal output by the imaging element.

[0044] The distance measuring unit 3 measures the distance between the subject facing the imaging unit 2 and the display device 1. Specifically, the distance measuring unit 3 includes, for example, a light emitting unit and a light detecting unit that constitute a ToF (Time of Flight) sensor. The distance measuring unit 3, including the ToF sensor, measures distance based on the time difference between when the light emitting unit emits light and when the laser light emitted by the light emitting unit is reflected by the subject and detected by the light detecting unit. The specific mechanism by which the distance measuring unit 3 measures distance is not limited to this. For example, the distance measured by the distance measuring unit 3 may be determined as the distance at which the image is in focus using the AF function of the imaging unit 2, such as so-called contrast AF (auto focus). In the embodiment, the imaging unit 2 and the distance measuring unit 3 cooperate to function as an acquisition unit that acquires information indicating the positions of two viewpoints of the user facing the display panel 20 (a first viewpoint E1 (right eye) and a second viewpoint E2 (left eye), described below).

[0045] The imaging unit 2 is designed to capture a user visually viewing the image display surface of the display panel 20. The distance measuring unit 3 is designed to measure the distance between the image display surface of the display panel 20 and the user visually viewing the image display surface. Specifically, the imaging unit 2 and the distance measuring unit 3 are disposed, for example, on one side of the housing of the display device 1 where the image display surface of the display panel 20 is exposed.

[0046] The signal processing unit 10 includes a gaze tracking unit 11 and an image output unit 12. The gaze tracking unit 11 obtains information related to the position of the user's viewpoint relative to the display panel 20 based on the outputs of the imaging unit 2 and the distance measuring unit 3. The details of the information related to the viewpoint position will be described later.

[0047] Based on the information regarding the viewpoint position acquired by the gaze tracking unit 11, the image output unit 12 outputs image data corresponding to the viewpoint position to the display panel 20. The image data output by the image output unit 12 may be, for example, image data based on the image signal IP input to the display device 1 via external information processing, but may also be image data pre-stored in a storage device included in the display device 1. The image output unit 12 generates a viewpoint-corresponding image OP based on the image data based on the image signal IP or image data pre-stored in the storage device included in the display device 1, and outputs the image data in the viewpoint-corresponding image OP corresponding to the viewpoint position acquired by the gaze tracking unit 11 to the display panel 20.

[0048] Figure 2 : is a diagram showing an example of a viewpoint corresponding image OP. Figure 2 As shown, the viewpoint-corresponding image OP includes a plurality of image data. The plurality of image data included in the viewpoint-corresponding image OP is image data corresponding to different viewpoints (more specifically, viewpoints corresponding to a single eye of the observer). Figure 2 In the example, 25 PNG (Portable Network Graphics) format data with consecutive file names from "0001" to "0025" are shown, but the file name, format, and number of images included in the viewpoint corresponding image OP are not limited to these and can be changed as appropriate. The image output unit 12 includes Figure 2 Among the viewpoint corresponding images OP of the plurality of images exemplified above, image data corresponding to the position of the viewpoint acquired by the eye-line tracking unit 11 is output to the display panel 20 .

[0049] like Figure 1As shown, the display panel 20 includes a display panel driver circuit 21. The display panel driver circuit 21 includes, for example, a DDIC (Display Driver Integrated Circuit) or other circuit that performs various processes related to image display output by the display panel 20. The display panel driver circuit 21 drives the plurality of pixels Pix included in the display panel 20 based on image data output from the image output unit 12.

[0050] Figure 3 Schematic diagram showing the stacked structure of the display panel 20. Figure 3 As shown, the display panel 20 includes a first substrate 22 and a second substrate 23. The first substrate 22 and the second substrate 23 are light-transmitting substrates such as glass substrates. The first substrate 22 and the second substrate 23 are stacked with a liquid crystal layer sandwiched therebetween. The liquid crystal layer is sealed between the first substrate 22 and the second substrate 23. The display panel 20 is a so-called liquid crystal display panel.

[0051] Hereinafter, the facing direction of the first substrate 22 and the second substrate 23 is referred to as the Z direction. In addition, one of the two directions perpendicular to the Z direction is referred to as the X direction, and the other is referred to as the Y direction. The X direction and the Y direction are perpendicular to each other.

[0052] The first substrate 22, for example, has a stacked structure formed on the surface on the second substrate 23 side. These layers include a first electrode layer having multiple pixel electrodes formed thereon, a second electrode layer having a common electrode provided with a reference potential for the multiple pixels Pix, a circuit formation layer having switching elements for individually transmitting signals to each of the multiple pixel electrodes and wiring connected to the switching elements, and an insulating layer for insulating these layers. The pixel electrodes are individually provided for the sub-pixels included in each of the multiple pixels Pix. The pixels Pix are driven under the control of the display panel drive circuit 21 so that the alignment direction of the liquid crystal molecules overlapping the pixel electrodes in a planar viewpoint corresponds to the potential difference between the common electrode and the pixel electrodes. The planar viewpoint refers to the viewpoint from which the plane perpendicular to the Z direction (XY plane) is observed.

[0053] As described later Figure 16As shown in FIG, each pixel Pix includes multiple sub-pixels. For example, each pixel Pix includes a sub-pixel with a color filter that transmits red (R) light, a sub-pixel with a color filter that transmits green (G) light, and a sub-pixel with a color filter that transmits blue (B) light. It should be noted that each pixel Pix does not need to include all of these sub-pixels. For example, one of two adjacent pixels Pix may include sub-pixels of a portion of the multiple colors, while the other may include sub-pixels of a different portion. Furthermore, some or all of the pixels Pix may include sub-pixels with color filters that transmit light of a color different from the colors illustrated here. Furthermore, sub-pixels with a colorless filter or no color filter may be provided, with light from such sub-pixels being perceived as white (W), for example. When a pixel Pix includes the three sub-pixels described above, the shape of the pixel Pix is ​​preferably square (with equal lengths in the X and Y directions), but a rectangular shape with one of the X and Y sides being longer than the other is also possible.

[0054] The second substrate 23 is provided with color filters provided for the sub-pixels included in each of the pixels Pix, a black matrix that divides the color filters of each sub-pixel, etc. It should be noted that the common electrode may be provided on the second substrate 23 instead of the first substrate 22 .

[0055] Figure 3 The pixel pitch PP shown is the width of a second pixel Pix2 in the X direction. Figure 3 In the figure, although the first pixel Pix1 and the second pixel Pix2 are depicted separately, the first pixel Pix1 and the second pixel Pix2 are of the same configuration as the common pixel Pix, and there is no structural difference between the first pixel Pix1 and the second pixel Pix2. Therefore, the width of a pixel Pix in the X direction is the pixel pitch PP. Strictly speaking, the pixel pitch PP in the X direction is the distance between the X-direction centerline of one side of the black matrix surrounding a pixel Pix, located on one X-direction end side of the pixel Pix, and the X-direction centerline of the other side located on the other X-direction end side of the pixel Pix. Alternatively, the pixel pitch can be the distance between the centers of sub-pixels of the same color of adjacent pixels when viewed in the X direction.

[0056] The display panel 20 is opposite to the light source 30 via the polarizing layer 24 and the spacer 40. The polarizing layer 24 is provided on the first substrate 22 side of the display panel 20 (the back side of the display panel). The spacer 40 is a plate-shaped light-transmitting component, such as glass, arranged to be opposite to the first substrate 22 via the polarizing layer 24. The adhesive layer 42 bonds the polarizing layer 24 to the spacer 40. It should be noted that if a support can be provided to maintain the distance between the light source 30 and the polarizing layer 24, a structure in which an air layer is provided between them can also be adopted.

[0057] For example, Figure 3 As shown, the light source 30 includes a surface light source 31, a light-emitting point 32, and a light-shielding member 33. The surface light source 31 functions as a surface light source that emits light from at least the side of the display panel 20. Specifically, the surface light source 31 includes, for example, a light guide plate that faces the display panel 20 in the Z direction, and a light source element (e.g., an LED (Light Emitting Diode)) that allows light to enter the light guide plate from a direction perpendicular to the Z direction. Figure 3 The configuration of the surface light source 31 shown shows the configuration of the light guide plate, and the illustration of the light source elements is omitted. The light-emitting point 32 is a hole provided in the light-shielding component 33. The light-shielding component 33 covers the surface of the surface light source 31 on the side of the spacer 40, except for the portion where the light-emitting point 32 is formed. The adhesive layer 43 is interposed between the light-shielding component 33 and the spacer 40. The adhesive layer 43 bonds the polarizing layer 24 to the spacer 40. The adhesive layers 42 and 43 are, for example, a light-transmitting functional film with double-sided adhesiveness such as OCA (Optical Clear Adhesive). The light source 30 irradiates the display panel 20 with light generated by the surface light source 31 from a plurality of light-emitting points 32.

[0058] Figure 3 The light point pitch SpP shown is the distance between the center lines of the adjacent light points 32 in the X direction. The light point pitch SpP is 4n times or 6n times the pixel pitch PP. n is a natural number. For example, n is 1, but it can also be 2 or more. Figure 3 , the case where the light-emitting point pitch SpP is 4 times the pixel pitch PP is illustrated.

[0059] As described above, the image output unit 12 outputs the image data corresponding to the position of the viewpoint acquired by the line of sight tracking unit 11 in the viewpoint corresponding image OP to the display panel 20. Hereinafter, when an image is described without special explanation, it refers to an image displayed and output by the display panel 20 based on the image data output by the image output unit 12. The display panel 20 performs a display output corresponding to the relevant image data. Therefore, the display panel 20 displays an image corresponding to the position of the viewpoint acquired by the line of sight tracking unit 11. Figure 3 , the display panel 20 is schematically shown in a state where it is displaying and outputting images corresponding to the first viewpoint E1 and the second viewpoint E2. The first pixel Pix1 is a pixel Pix controlled to display and output the image corresponding to the first viewpoint E1. The second pixel Pix2 is a pixel Pix controlled to display and output the image corresponding to the second viewpoint E2.

[0060] The first viewpoint E1 corresponds to the user's right eye. The second viewpoint E2 corresponds to the user's left eye. The center point CP is the center point on the straight line between the first viewpoint E1 and the second viewpoint E2. The position of the center point CP generally corresponds to the position of the user's nose in the arrangement direction of the first viewpoint E1 and the second viewpoint E2. Figure 3 , the arrangement direction of the first viewpoint E1 and the second viewpoint E2 is shown as the X direction. If the X-direction distance between the first viewpoint E1 and the center point CP and the X-direction distance between the second viewpoint E2 and the center point CP are denoted as distance D1, and the X-direction distance between the first viewpoint E1 and the second viewpoint E2 are denoted as distance D2, then distance D2 is twice distance D1.

[0061] The coordinates showing the position of the middle point CP relative to the predetermined origin of the display panel 20 are expressed as (pos_x, pos_y, pos_h). pos_x is the coordinate of the middle point CP in the X direction. pox_y is the coordinate of the middle point CP in the Y direction. pox_h is the position of the middle point CP in the Z direction. The coordinates of the X direction and Y direction of the origin of the predetermined display panel 20 may be, for example, the position of one of the four vertices of a display area that is rectangular in a plane viewpoint and in which a plurality of pixels Pix are arranged in the display panel 20. Alternatively, the center of the display area of ​​the display panel 20 may be used as the origin. The coordinate of the Z direction of the origin of the predetermined display panel 20 may also be the position of the pixel Pix (for example Figure 3 Specifically, the Z-direction centerline of pixel Pix refers to the Z-direction centerline of the liquid crystal layer sealed between the first substrate 22 and the second substrate 23. For example, it is preferably set to a height of d / 2 when the cell gap in the display panel 20 is set to d. The position of the predetermined origin of the display panel 20 is not limited to this and can be set to any position. Unless otherwise specified, the reference to the origin hereafter refers to the predetermined origin of the display panel 20.

[0062] The gaze tracking unit 11 determines the positions of the user's two eyes (right eye and left eye) within the captured image captured by the imaging unit 2. This determination is performed, for example, based on pattern matching, but is not limited to this. For example, it may also be performed based on image recognition using machine learning or other methods. Information indicating the relationship between each position within the captured image's capture range and its X and Y coordinates is previously stored by the signal processing unit 10 and prepared so that the gaze tracking unit 11 can refer to it. The gaze tracking unit 11 identifies the midpoint between the right and left eyes in the captured image captured by the imaging unit 2 as the midpoint CP and determines the X and Y coordinates of the midpoint CP. It should be noted that the method for determining the position of the midpoint CP is merely an example and is not limited to this and can be modified as appropriate. For example, the gaze tracking unit 11 may determine the midpoint CP based on the positional relationship between the user's two eyes (right eye and left eye) and the position of the user's nose within the captured image captured by the imaging unit 2. Furthermore, the gaze tracking unit 11 obtains the distance value measured by the distance measuring unit 3 as the value of pos_h. The gaze tracking unit 11 regards the midpoint between the right eye and the left eye in the image captured by the imaging unit 2 as the midpoint CP, and defines the Z-direction position of the midpoint CP as pos_h.

[0063] The light emitted from each light-emitting point 32 reaches the first viewpoint E1 and the second viewpoint E2. Here, the first pixel Pix1 is located on the ray L1 of the light reaching the first viewpoint E1 from each light-emitting point 32. In addition, the second pixel Pix2 is located on the ray L2 of the light reaching the second viewpoint E2 from each light-emitting point 32. The image output by the first pixel Pix1 and the image output by the second pixel Pix2 are different images. The image output by the first pixel Pix1 is an image corresponding to the position of the first viewpoint E1. The image output by the second pixel Pix2 is an image corresponding to the position of the second viewpoint E2. More specifically, for example, using Figure 2In the example, image 0014.png is used as the right-eye viewpoint image, and image 0012.png is used as the left-eye viewpoint image. These images are combined by the signal processing unit and displayed as a single image (stereoscopic display image). To further explain this, for example, if the stereoscopic display image, 0014.png, and 0012.png have the same number of pixels, and if pixels (n, m+1) ((n, m+1) represents the m+1th pixel in row n, and the same applies in the following paragraphs), (n, m+2), (n, m+3), and (n, m+4) in a certain pixel row of the stereoscopic display image are to be displayed in sequence as the left-eye image, the left-eye image, the right-eye image, and the right-eye image, the pixels (signals) corresponding to (n, m+1) and (n, m+2) of 0012.png, which is the left-eye image, use the pixel signals corresponding to (n, m+1) and (n, m+2) of 0012.png, which is the left-eye image. Similarly, the pixels (signals) corresponding to (n, m+3) and (n, m+4) in the stereoscopic display image use the pixel signals corresponding to (n, m+3) and (n, m+4) in 0014.png, the right-eye image. Furthermore, depending on the relationship between the user's viewpoint and the light sources (light-emitting points 32), there may be pixels Pix where no image needs to be displayed. In such cases, these pixels Pix display the image with the lowest brightness (e.g., a black image). To display and output such images, the image output unit 12 outputs image data corresponding to each of multiple viewpoints (e.g., the first viewpoint E1 and the second viewpoint E2) to the display panel 20.

[0064] The distance between the center line of the pixel Pix in the Z direction and the middle point CP in the Z direction is expressed as distance Ph. The size of the distance Ph corresponds to the size of the value of the above-mentioned pos_h. In addition, the distance between the center line of the pixel Pix in the Z direction and the starting point of emission of the light from the light-emitting point 32 in the Z direction is expressed as distance Th. It should be noted that the distance Th is significantly smaller than the distance Ph. In view of such an aspect, the center line of the pixel Pix in the Z direction can be defined on the same plane as the pixel electrode, or on the same plane as the back surface, surface of the second substrate 23, or the surface of the cover glass provided on the display panel 20. In addition, in an embodiment, the position in the Z direction of the starting point of emission of the light from the light-emitting point 32 is set to a position on the boundary line between the shading component 33 and the adhesive layer 43.

[0065] Below, refer to Figure 4 The relationship between the light-emitting point pitch (e.g., light-emitting point pitch SpP or light-emitting point pitch SpP2) between the light-emitting points 32 adjacent in the X direction and the pitch (pixel pitch PP) of the pixels Pix arranged in the X direction and the relationship between the light emitted from each of the plurality of light-emitting points 32 to each of the plurality of viewpoints will be described. Figure 3Similarly, the display panel 20 in Figure 4 3 is a cross-sectional view showing a cut surface of the display panel 20A taken along a plane (XZ plane) perpendicular to the Y direction. Figure 1 The display panel 20 shown may also be Figure 4 And the display panel 20A shown in the following figures.

[0066] and Figure 3 The light point pitch SpP shown is different. Figure 4 This is a cross-sectional view showing an example in which the light-emitting point pitch SpP2 is 6 times the pixel pitch PP. Figure 4 In the figure, the ray L(m)1 and the ray L(m)2 connected by the dotted line actually constitute a ray of light. For example, the ray L321 is a part of the ray L(m)1 when m=32, and represents the ray of light emitted from a certain light-emitting point 32. The ray L322 is a part of the ray L(m)2 when m=32, and represents the state where the ray reaches the first viewpoint EC. Although shown below with similar expressions, it should be understood that the distance between the display panel 20 and the viewpoint is significantly increased compared to the pixel pitch PP, etc., and it is a way of dealing with these relationships by using one diagram. Figure 4 In the equation, m is a natural number from 32 to 35 or a natural number from 42 to 45. When m is a natural number from 32 to 35, the light ray and the ray L31 are the light rays that pass through the first pixel PixC and reach the first viewpoint EC. When m is a natural number from 42 to 45, the light ray and the ray L41 are the light rays that pass through the second pixel PixD and reach the second viewpoint ED. Figure 4 In FIG. 1 , a line along the Z direction and passing through the second viewpoint ED is shown as a single-dot chain line PS2.

[0067] The first viewpoint EC is the first viewpoint E1 and the second viewpoint E2 (refer to Figure 3 ). The second viewpoint ED is the other of the first viewpoint E1 and the second viewpoint E2. When the first viewpoint EC is the first viewpoint E1, the first pixel PixC is the first pixel Pix1 (refer to Figure 3 ). When the second viewpoint ED is the second viewpoint E2, the second pixel PixD is the second pixel Pix2 (refer to Figure 3 ).

[0068] like Figure 4As shown, the display panel 20A is configured such that six pixels Pix are arranged within a light-emitting point pitch SpP2, which is the interval between the X-direction center lines of two adjacent light-emitting points 32 in the X-direction. The X-direction position of the X-direction center line of each of the two light-emitting points 32 overlaps with the X-direction position of the boundary line between the two adjacent pixels Pix in the X-direction when viewed from a planar perspective.

[0069] For example, Figure 4 As shown, two of the six pixels Pix are controlled as first pixels PixC. Furthermore, the other two of the six pixels Pix are controlled as second pixels PixD. Among the six pixels Pix, the pixels Pix that correspond neither to the first pixels PixC nor to the second pixels PixD serve as third pixels PixE. The third pixels PixE are pixels Pix whose light transmission level is set to the lowest (e.g., displayed in black).

[0070] As shown by ray L41, the ray of light that passes through the second pixel PixD at a position opposite to the second viewpoint ED in the Z direction and reaches the second viewpoint ED, that is, the ray of light from the light emitting point 32 opposite to the second viewpoint ED in the Z direction, is along the Z direction. Figure 4 In the figure, a line along the Z direction and passing through the second viewpoint ED is shown as a single-dotted dashed line PS2. With the light emitting point 32 emitting ray L41 as a reference, rays L42, L43, L44, L45, and L46 are used to represent light reaching the second viewpoint ED from other light emitting points 32 located apart from the light emitting point 32 in the X direction. These rays are represented by rays L42, L43, L44, L45, and L46. The farther away from the light emitting point 32 in the X direction, the greater the angle of inclination with respect to the Z direction. Based on these rays, which of the multiple pixels Pix is ​​to be controlled as the second pixel PixD is determined. Based on the same concept, as shown by the relationship between rays L31, L32, L33, L34, L35, and L36 and the first pixel PixC, which of the multiple pixels Pix is ​​to be controlled as the first pixel PixC is determined based on the rays of light emitting from the light emitting point 32 and reaching the first viewpoint EC.

[0071] In other words, the arrangement of the pixels Pix in the X direction, which are controlled to be the second pixels PixD according to the difference in the inclination angles of the rays L42, L43, L44, L45, and L46 relative to the Z direction, may result in portions that are not necessarily suitable for being evenly spaced in the X direction. Based on the same idea, the arrangement of the pixels Pix in the X direction, which are controlled to be the first pixels PixC, may result in portions that are not necessarily suitable for being evenly spaced in the X direction. The third pixels PixE may be appropriately arranged in accordance with the arrangement control of the first pixels PixC and the second pixels PixD, or as described later, Figure 17As described in

[15] , the light transmittance is controlled in sub-pixel units. By controlling the configuration, the possibility of crosstalk can be more effectively reduced.

[0072] It should be pointed out that in Figure 4 In FIG, the intermediate point C is located on the single-point dashed line PC that overlaps with the center line of the X direction of a certain light-emitting point 32, but the intermediate point CP is not necessarily located at a position that overlaps with the center line of the X direction of the light-emitting point 32. The positional relationship between the light from each light-emitting point 32, the first viewpoint EC and the second viewpoint ED corresponding to the position of the intermediate point CP, and the corresponding relationship between the control of the pixel Pix set as the first pixel PixC and the second pixel PixD is as shown in FIG. Figure 4 As described, it is independent of the position of the intermediate point CP.

[0073] Next, refer to Figure 5 The basic concept of driving control of the pixel Pix according to the relative positional relationship between the viewpoint and the light emission starting point will be described.

[0074] Figure 5 This diagram shows various parameters related to determining the X-direction coordinates R_x(i) and L_x(i) of a pixel Pix located on a ray extending from the i+1th luminous point LP(i) from the origin in the X direction to the viewpoints ER and EL.

[0075] Figure 5 The light-emitting point LP(0) shown in the figure represents the emission starting point of light from the light-emitting point (e.g., light-emitting point 32) located closest to the origin in the X direction (the first one). Light-emitting point LP(i) represents the emission starting point of light from the light-emitting point located at the i+1th closest position from the origin in the X direction. For example, when i = 1, light-emitting point LP(1) represents the emission starting point of light from the light-emitting point located at the position closest to the origin after light-emitting point LP(0) in the X direction. In other words, light-emitting point LP(1) represents the second closest position. Therefore, i is an integer greater than or equal to 0.

[0076] exist Figure 5 In [1], the distance in the X direction between the origin and the light-emitting point LP(0) is represented by offset. Furthermore, the distance in the X direction between the origin and the light-emitting point LP(i) is represented by offset+(pitch×i). The value of pitch corresponds to the size of the light-emitting point pitch SpP or the light-emitting point pitch SpP2 described above. Offset and offset+(pitch×i) are predetermined values ​​based on the design of the display device 1 and are reference parameters used in calculations related to determining the X-direction coordinates R_x(i) and L_x(i).

[0077] Reference Figure 3 Explained and also Figure 5 The size of the distance Ph shown in corresponds to the size of the value of pos_h. Figure 5 The distance Px shown corresponds to the value of pos_x. Furthermore, the distance in the Z direction between the light-emitting point LP(0) and the light-emitting point LP(i) and the origin is the distance Th described above. pos_h and pos_x can be acquired by the imaging unit 2 and the distance measuring unit 3.

[0078] Hereinafter, the X-direction distance between the origin and the coordinate R_x(i) is referred to as shiftR_x(i). Furthermore, the X-direction distance between the coordinate R_x(i) and the viewpoint ER is referred to as widthR(i). Furthermore, the X-direction distance between the light-emitting point LP(i) and the viewpoint ER is referred to as widthR_LED(i). The viewpoint ER is the user's right eye viewpoint and is either the first viewpoint E1, EC, or the second viewpoint E2, ED.

[0079] Furthermore, let shiftL_x(i) be the distance in the X direction between the origin and the coordinate L_x(i). Furthermore, let widthL(i) be the distance in the X direction between the coordinate L_x(i) and the viewpoint EL. Furthermore, let widthL_LED(i) be the distance in the X direction between the light-emitting point LP(i) and the viewpoint EL. The viewpoint EL is the viewpoint of the user's left eye and is the other of the first viewpoint E1, EC, or the second viewpoint E2, ED.

[0080] widthR_LED(i) is expressed as the following formula (1). D1 in formula (1) is a reference Figure 3 Explained and also Figure 5 The value of the distance D1 shown in FIG. The value representing the distance D1 based on the average value of general users can be set to a predetermined value. In the embodiment, the distance D1 is, for example, 31.25 millimeters (mm), but is not limited thereto and can be changed as appropriate.

[0081] widthR_LED(i)=pos_x-D1-{offset+(pitch×i)}…(1)

[0082] Width R(i) is represented by the following formula (2). Th in formula (2) and the like is a value indicating the size of the distance Th. The distance Th is predetermined based on the design of the display device 1. The concept for determining the distance Th during design will be described later.

[0083] widthR(i)=widthR_LED(i)×pos_h / (pos_h+Th)…(2)

[0084] shiftR_x(i) is expressed as the following equation (3).

[0085] shiftR_x(i)=pos_x-D1-widthR(i)…(3)

[0086] R_x(i) is represented by the following equation (4). PP in equation (4) and other expressions represents the size of the pixel pitch PP. The pixel pitch PP is predetermined based on the design of the display device 1. Furthermore, int() in equation (4) and other expressions represents an integer value obtained by truncating the decimal point of the value enclosed in parentheses.

[0087] R_x(i)=int(shiftR_x(i) / PP)…(4)

[0088] widthL_LED(i) is expressed by the following equation (5).

[0089] widthL_LED(i)=pos_x+D1-{offset+(pitch×i)}…(5)

[0090] Width L(i) is expressed as the following formula (6).

[0091] widthL(i)=widthL_LED(i)×pos_h / (pos_h+Th)…(6)

[0092] shiftL_x(i) is expressed as the following equation (7).

[0093] shiftL_x(i)=pos_x+D1-widthL(i)…(7)

[0094] L_x(i) is expressed as the following formula (8).

[0095] L_x(i)=int(shiftL_x(i) / PP)…(8)

[0096] By setting the pixels Pix corresponding to R_x(i) as the first pixels Pix1 and PixC, and setting the pixels Pix corresponding to L_x(i) as the second pixels Pix2 and PixD, the same as the reference pixel can be achieved. Figure 3 、 Figure 4 The display output is controlled according to the positions of the first viewpoint E1, EC and the second viewpoint E2, ED.

[0097] Next, refer to Figure 6 and Figure 7 The relative relationship between the arrangement direction of both eyes of a person and the X direction and the Y direction corresponding to the arrangement of the pixels Pix of the display panel 20A will be described.

[0098] Figure 6 Schematic diagrams showing examples A and B of the relative angle relationship between a person's face HF and a display device 1 having a display panel 20A. Figure 6 In the rectangular display panel 20A shown in FIG. 1 , the long side direction of the rectangle is assumed to be the Y direction.

[0099] exist Figure 6 In Example A, the reference line CLX that runs along the arrangement direction of the two eyes in the face HF and passes through the middle point CP is parallel to the X direction of the display panel 20A. Figure 7 ) and the line that bisects the display panel 20A in the X direction overlap with the straight line CL. In addition, the Y direction is parallel to the straight line CL. In the case of Example A, Figure 3 and Figure 4 Similarly, the arrangement direction of the first viewpoints E1 and EC and the second viewpoints E2 and ED is along the X direction. Therefore, in Example A, the reference-based Figure 3 and Figure 4 Display output control of the description is performed.

[0100] on the other hand, Figure 6 In Example B, neither the midline CLY of the face HF nor the line bisecting the display panel 20A in the X direction overlaps the line CL. Furthermore, the angle pos_r, representing the angle of the face HF relative to the line CL, differs from the angle dev_rot, representing the angle of the display panel 20A relative to the line CL. Note that the angle pos_r is the angle formed by the midline CLY and the line CL. Meanwhile, the angle dev_rot is the angle formed by the Y direction and the line CL.

[0101] It should be noted that in Example A, the angle pos_r and the angle dev_rot can both be considered to be 0 degrees (°).

[0102] Figure 7 Schematic diagram showing an example of the angle difference between the face HF and the display panel 20A based on the vertical line H and the horizontal line V. The vertical line H is along the direction of gravity of the earth. The horizontal line V is along a plane perpendicular to the vertical line H. Figure 7 The vertical line H shown is Figure 6 The straight line CL in corresponds to .

[0103] Figure 7The illustrated face HF includes points P1, P2, and P3. Point P1 indicates the position of the first viewpoint E1 and EC. Point P2 indicates the position of the second viewpoint E2 and ED. Point P3 indicates a predetermined position (e.g., the position of the nose) that overlaps with the midline of the face HF. The coordinates indicating the positions of points P1, P2, and P3 are acquired based on image data captured by the imaging unit 2 and the distance measuring unit 3.

[0104] To give a specific example, the gaze tracking unit 11 can determine the X- and Y-coordinates of the positions of the eyes and nose of a person's face HF using OpenCV image processing technology. The gaze tracking unit 11 derives a reference line CLX passing through points P1 and P2. Furthermore, the gaze tracking unit 11 derives a median line CLY as a straight line perpendicular to the reference line CLX and passing through point P3. Furthermore, the gaze tracking unit 11 defines the midpoint between points P1 and P2 as the midpoint CP and derives the coordinates (pos_x, pos_y, pos_z) of the midpoint CP based on the coordinates (X1, Y1, Z1) of point P1 and the coordinates (X2, Y2, Z2) of point P2. Generally, the midpoint CP overlaps with the intersection of the reference line CLX and the median line CLY. Note that the Z-coordinates (Z1, Z2, Z3) of points P1, P2, and P3 are measured by the distance measuring unit 3. The coordinate (pos_z) of the middle point CP in the Z direction is regarded as the distance Ph.

[0105] Furthermore, the gaze tracking unit 11 obtains information (tilt information) indicating the tilt direction of the display panel 20A relative to the vertical line H and the horizontal line V from the gyro sensor 4 included in the display device 1. Based on this tilt information, the gaze tracking unit 11 derives the angle dev_rot. Based on the relationship between the vertical line H, the horizontal line V, and the angle dev_rot, the gaze tracking unit 11 determines the orientation of the display panel 20A in the X and Y directions relative to the vertical line H and the horizontal line V.

[0106] The gaze tracking unit 11 derives the relative angle rot formed between the reference line CLX and the X direction. It should be noted that in the following description, when the relative angle rot is a positive value, it refers to the direction in which the center line CLY of the face HF forms an angle in the clockwise direction relative to the Y direction of the display panel 20A. When the relative angle rot is a negative value, it refers to the direction in which the center line CLY of the face HF forms an angle in the counterclockwise direction relative to the Y direction of the display panel 20A. The relative angle rot can be expressed, for example, in a range of -180 degrees (°) to 180 degrees (°). It should be noted that the angle pos_r is the sum of the angle dev_rot and the relative angle rot.

[0107] The image output unit 12 performs various processes related to display output control for causing the display panel 20A to display the viewpoint-corresponding image OP, referring to the information indicating the coordinates (pos_x, pos_y, pos_z) of the intermediate point CP and the information indicating the relative angle rot (or the angle pos_r and the angle dev_rot), among the various information derived and determined by the gaze tracking unit 11. Details of these processes are described below.

[0108] Due to the relative angle rot, sometimes it is not possible to pass the reference Figure 3 and Figure 4 The control of the pixels Pix along the X direction of the first pixels Pix1, PixC and the second pixels Pix2, PixD described above enables output of separate images for multiple viewpoints. The relationship between the relative angle rot and the validity of stereoscopic vision will be described below.

[0109] Figure 8 is the angle rot relative to the reference Figure 3 and Figure 4 This is a schematic diagram showing an example of the relationship between the first pixel PixC and the second pixel PixD for the validity of outputting separate images for a plurality of viewpoints by controlling the pixels Pix along the X direction.

[0110] Figure 8 In the "Person" column, the orientation of a person's face HF relative to the display panel 20A shown in the "Device" column is schematically shown. In the "Device" column, the range of the person's line of sight relative to the display panel 20A of the display device 1 is shown as any one of the ranges Fo1, Fo2, and Fo3. In the "Output and Recognition Relationship (Planar Viewpoint)" column, the relationship between the light-emitting point 32 and the pixel Pix in a portion of the display panel 20A, including any one of the ranges Fo1, Fo2, and Fo3 shown in the "Device" column, is schematically shown. In the "Output and Recognition Relationship (Cross-Sectional Viewpoint)" column, a cross-section at the position indicated by the dashed line and arrow in the "Output and Recognition Relationship (Planar Viewpoint)" is shown.

[0111] When the relative angle rot is 0 degrees (°), as shown schematically in the range Fo1 of "Relationship between output and recognition (cross-sectional viewpoint)", by referring to Figure 3 and Figure 4 The control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD is described, and the light L3 passing through the first pixel PixC reaches the first viewpoint EC, and the light L4 passing through the second pixel PixD reaches the second viewpoint ED. That is, when the relative angle rot is 0 degrees (°), by referring to Figure 3 and Figure 4The control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described above can realize the output of separate images for multiple viewpoints.

[0112] On the other hand, when the relative angle rot is 45 degrees (°), as shown schematically in the range Fo2 of "Relationship between output and recognition (cross-sectional viewpoint)", if only the reference Figure 3 and Figure 4 If the control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD is described, the light ray between the first pixel PixC and the first viewpoint EC and the light ray between the second pixel PixD and the second viewpoint ED will no longer be valid. That is, when the relative angle rot is 45 degrees (°), if only the reference Figure 3 and Figure 4 Controlling the pixels Pix along the X direction, such as the first pixel PixC and the second pixel PixD, makes it difficult to output images independently for multiple viewpoints. The same applies to the case where the relative angle rot is 90 degrees (as schematically shown in range Fo3 of "Output and Recognition Relationship (Cross-Section Viewpoint)") and the relative angle rot is 45 degrees (as shown in the schematic diagram of range Fo3).

[0113] Figure 9 is the angle rot relative to the reference Figure 3 and Figure 4 This is a schematic diagram showing another example of the relationship between the first pixel PixC and the second pixel PixD in the X direction and the validity of outputting images to multiple viewpoints. Figure 9 In the structure shown, instead of referring to Figure 8 A linear light source 32A is provided at the light emitting point 32 described above. Figure 8 The light emitting point 32 shown is a hole or a light emitting element that functions as a so-called point light source. Figure 9 The illustrated line light source 32A is a slit or a light emitting element that functions as a linear light source along the Y direction.

[0114] Even when the line light source 32A is used instead of the light emitting point 32, if the relative angle rot is 0 degrees (°), by referring to Figure 3 and Figure 4 The control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described above can realize the output of images for multiple viewpoints. In addition, when a linear light source 32A is used instead of the light emitting point 32, when the relative angle rot is 45 degrees (°), as shown in FIG. Figure 9 As shown in the "45°" column, by referring to Figure 3 and Figure 4The control of the first pixel PixC and the second pixel PixD along the X direction can sometimes achieve the output of images for multiple viewpoints, but it is not reliable. On the other hand, when the relative angle rot is 90 degrees (°), whether it is the light point 32 or the line light source 32A, if only the reference Figure 3 and Figure 4 With the control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described above, it is difficult to output images independently for a plurality of viewpoints.

[0115] As reference Figure 8 and Figure 9 As explained above, due to the relative angle rot, if we simply apply the reference Figure 3 and Figure 4 If the pixel Pix along the X direction of the first pixel Pix1, PixC and the second pixel Pix2, PixD described above is controlled, it may be difficult to output images independently for multiple viewpoints. Therefore, in the embodiment, a process (relative angle handling process) is performed to more appropriately control the arrangement of the first pixel Pix1, PixC and the second pixel Pix2, PixD according to the relative angle rot. Figures 10 to 12 The outline of this processing will be described.

[0116] Figure 10 Schematic diagram showing an example of pixel arrangement control when the relative angle rot is 45 degrees (°). Figure 11 is a schematic diagram showing an example of pixel arrangement control when the relative angle rot is 90 degrees (°). Figure 10 and Figure 11 The configuration control of the first pixel PixC and the second pixel PixD in the "unreflected processing" column is the same as Figure 8 The same is true for the "45°" column of FIG. In the embodiment, as shown in the "Reflection Processing" column, pixel arrangement control is performed according to the relative angle rot.

[0117] exist Figure 10 and Figure 11 In the example, the reference Figure 3 and Figure 4 In the control of the pixels Pix along the X direction of the first pixels Pix1, PixC, and the second pixels Pix2, PixD described above, the pixel corresponding to the first pixel PixC is referred to as the first pixel PixCB, and the pixel corresponding to the second pixel PixD is referred to as the first pixel PixDB. Furthermore, the pixel corresponding to the first pixel PixC, determined by the relative angle processing applied in the embodiment, is referred to as the first pixel PixCA, and the pixel corresponding to the second pixel PixD is referred to as the second pixel PixDA.

[0118] For example, consider the following situation: after reflecting the reference Figure 3 and Figure 4 In the case of controlling the pixels Pix along the X direction of the first pixels Pix1, PixC and the second pixels Pix2, PixD described above, as shown in FIG. Figure 10 and Figure 11 As shown in the "Overall" column of "Unreflected Processing", the first image GC and the second image GD are output so as to be arranged in the X direction within the display panel 20A. The first image GC is an image recognized using the light passing through the first pixel PixC. The second image GD is an image recognized using the light passing through the second pixel PixD. If the relative angle rot is 0 degrees (°), stereoscopic vision is established using the first image GC and the second image GD shown in the "Overall" column of "Unreflected Processing". On the other hand, when the relative angle rot is 45 degrees (°) or 90 degrees (°), it is difficult to establish stereoscopic vision using the first image GC and the second image GD shown in the "Overall" column of "Unreflected Processing".

[0119] Therefore, if Figure 10 and Figure 11 As shown in the "Overall" column of the "Reflection Processing" section, pixel placement control is performed according to the relative angle rot so that the first image GCA and the second image GDA within the display panel 20A correspond to the alignment of the eyes on the face HF. The first image GCA is an image recognized using light passing through the first pixel PixCA. The second image GDA is an image recognized using light passing through the second pixel PixDA. As shown by comparing the first image GC with the first image GCA and the second image GD with the second image GDA, the first image GCA is the same image as the first image GC. The second image GDA is the same image as the second image GD. However, the relative positional angular relationship between the first image GCA and the second image GDA differs from the relative positional angular relationship between the first image GC and the second image GD. The relative positional angular relationship between the first image GCA and the second image GDA shifts according to the relative angle rot to correspond to the alignment of the eyes on the face HF. Processing related to the placement control of the first and second pixels PixCA and PixDA is performed to maintain this relative positional angular relationship between the first and second images GCA and GDA.

[0120] Figure 12 is shown reflecting the reference Figure 10 and Figure 11 A schematic diagram showing an example of the relationship between the relative angle rot and the validity of outputting separate images for multiple viewpoints in the case of the configuration control described above. Figure 12As shown in the "45°" and "90°" columns, by reflecting the reference Figure 10 and Figure 11 The arrangement control described above allows the light L3 passing through the first pixel PixCA to reach the first viewpoint EC, and the light L4 passing through the second pixel PixDA to reach the second viewpoint ED. Figure 10 and Figure 11 The described configuration control enables outputting images independently for multiple viewpoints.

[0121] It should be pointed out that in Figures 10 to 12 In the description, the relative angle rot is 45 degrees (°) or 90 degrees (°) as an example. However, in the embodiment, the arrangement of the first pixel PixCA and the second pixel PixDA relative to the light emitting point LP such as the light emitting point 32 or the line light source 32A can be made to correspond to the arrangement direction of the two eyes on the face HF, regardless of the value of the relative angle rot. That is, in the embodiment, by referring to Figure 3 and Figure 4 The control of the pixels Pix along the X direction of the first pixel PixC and the second pixel PixD described above can achieve independent output of images for multiple viewpoints regardless of the relative angle rot.

[0122] Below, for reference Figures 10 to 12 More specific processing contents related to the configuration control described above will be described.

[0123] Figure 13 This diagram shows various parameters related to coordinates R_(i, j) and coordinates L_(i, j) derived based on the positional relationship between the light emitting point LP located at coordinates LP(i, j) and the viewpoints ER and EL.

[0124] As described above, the distance in the X direction between the origin and the light-emitting point LP (i) is expressed as offset + (pitch × i). In the following, when LEDx (i) is set in the formula, LEDx (i) = offset + (pitch × i). In addition, when the light-emitting points LP are arranged in a matrix along the X direction and the Y direction, the coordinates of the light-emitting point LP include not only the information of the coordinate (i) in the X direction, but also the information of the coordinate (j) in the Y direction. Here, it is assumed that the light-emitting point LP (j) represents the emission starting point of the light from the light-emitting point (for example, the light-emitting point 32) arranged at the j+1th closest position from the origin in the Y direction. Therefore, j is an integer greater than 0. In addition, Figure 5 The luminous point LP(0) and the luminous point LP(i) in Figure 14In other words, when the light-emitting points LP are arranged in a matrix along the X and Y directions, the coordinates LP(i, j) of the light-emitting point LP include information indicating the coordinates in the X and Y directions.

[0125] If the Y-direction distance between the origin and light-emitting point LP(i, 0) is represented by offset_Y, the Y-direction distance between the origin and light-emitting point LP(j) is represented by offset_Y + (pitch_Y × j). In the following equation, where LEDy(j) is used, LEDy(j) = offset_Y + (pitch_Y × j). The value of pitch_Y corresponds to the distance between the Y-direction centerlines of two adjacent light-emitting points LP. offset_Y and offset_Y + (pitch_Y × j) are predetermined values ​​based on the design of the display device 1 and are parameters that can be referenced in calculations related to determining the Y-direction coordinate Y(j).

[0126] Here, the coordinates of the viewpoint ER are set to (PosR_x, PosR_y). PosR_x represents the coordinate of the viewpoint ER in the X direction. PosR_y represents the coordinate of the viewpoint ER in the Y direction. PosR_x is expressed as shown in the following equation (9). PosR_y is expressed as shown in the following equation (10). In equation (10) and equations (14) and (23) described later, sin represents sine. In equation (9) and equations (13) and (24) described later, cos represents cosine. It should be noted that rot in each equation is the value of the relative angle rot.

[0127] PosR_x=pos_x+D1×cos(rot / 180)…(9)

[0128] PosR_y=pos_y+D1×sin(rot / 180)…(10)

[0129] The length of the light ray between the center of the light-emitting point LP at coordinates LP(i, j) and the viewpoint ER is defined as widthR_LED. Furthermore, the length of the light ray between the coordinates R_(i, j) and the viewpoint ER, where the pixel Pix is ​​located in the Z direction at coordinates R_(i, j), is defined as widthR. The ratio of widthR to widthR_LED is expressed by the following equation (11). As described above, pos_h in equation (11) and equation (15) described later is derived by the distance measuring unit 3. th in equation (11) and equation (15) described later is predetermined as a design consideration. Furthermore, length widthR_LED is expressed as equation (12).

[0130] widthR∶widthR_LED=pos_h∶(pos_h+th)…(11)

[0131] widthR_LED={(LEDx-PosR_x) 2 + (LEDy-PosR_y) 2} 1 / 2 …(12)

[0132] Furthermore, the coordinates of the viewpoint EL are represented by (PosL_x, PosL_y). PosL_x represents the coordinate of the viewpoint EL in the X direction. PosL_y represents the coordinate of the viewpoint EL in the Y direction. PosL_x is represented by the following equation (13). PosL_y is represented by the following equation (14).

[0133] PosL_x=pos_x-D1×cos(rot / 180)…(13)

[0134] PosL_y=pos_y-D1×sin(rot / 180)…(14)

[0135] The length of the light ray between the center of the luminous point LP at coordinates LP(i, j) and the viewpoint EL is defined as widthL_LED. Furthermore, the length of the light ray between the coordinates L_(i, j) and the viewpoint EL, where the pixel Pix is ​​located in the Z direction at coordinates L_(i, j), is defined as widthL. The ratio of widthL to widthL_LED is expressed by the following equation (15). Furthermore, widthL_LED is expressed by equation (16).

[0136] widthL∶widthL_LED=pos_h∶(pos_h+th)…(15)

[0137] widthL_LED=((LEDx-PosL_x) 2 + (LEDy-PosL_y) 2 ) 1 / 2 …(16)

[0138] Figure 14This is a schematic diagram showing the relationship between the length width and the pixel Pix through which light passes from the luminous point LP located at the coordinates LP(i, j) to the viewpoint EE, that is, the pixel PixU. Hereinafter, when it is described as pixel PixU, it refers to the pixel Pix through which light (light) passes from the luminous point LP to the viewpoint EE, and includes the passing point UP described later. It should be noted that the length width is the length widthR or the length widthL. In addition, when the length width is the length widthR, Figure 14 The length width_LED shown is the length widthR_LED. In addition, when the length width is the length widthL, the length width_LED is widthL_LED. In addition, when the length width is the length widthR, Figure 14 The viewpoint EE shown is the viewpoint ER. In addition, when the length width is the length widthL, the viewpoint EE is the viewpoint EL. In addition, when the length width is the length widthR, Figure 14 The passing point UP is shown as R_(i, j). In addition, when the length width is widthL, the passing point UP is L_(i, j).

[0139] When the length width is widthR, the coordinates of the pixel PixU are (shiftR_x, shiftR_y). shiftR_x represents the X-direction coordinate of the pixel PixU in this case. shiftR_y represents the Y-direction coordinate of the pixel PixU in this case. shiftR_x is expressed as the following equation (17). shiftR_y is expressed as the following equation (18).

[0140] shiftR_x=PosR_x+(LEDx-PosR_x)×widthR / widthR_LED…(17)

[0141] shiftR_y=PosR_y+(LEDy-PosR_y)×widthR / widthR_LED…(18)

[0142] When the length width is widthL, the coordinates of the pixel PixU are (shiftL_x, shiftL_y). shiftL_x represents the X-direction coordinate of the pixel PixU in this case. shiftL_y represents the Y-direction coordinate of the pixel PixU in this case. shiftL_x is expressed as the following equation (19). shiftL_y is expressed as the following equation (20).

[0143] shiftL_x=PosL_x+(LEDx-PosL_x)×widthL / widthL_LED…(19)

[0144] shiftL_y=PosL_y+(LEDy-PosL_y)×widthL / widthL_LED…(20)

[0145] Having said that, Figure 14 As shown in the positional relationship between the passing point UP and the pixel PixU, the passing point UP does not necessarily pass through the center of the pixel PixU.

[0146] Figure 15 This schematic diagram illustrates an example of the difference between the position of a pass-through point P_(i, j) in pixel PixP located on a ray of light between light point LPP and viewpoint EE, and the position of a pass-through point Q_(i, j) in pixel PixQ located on a ray of light between light point LPQ and viewpoint EE. Pass-through points P_(i, j) and Q_(i, j) are different pass-through points UP. Light points LPP and LPQ are any of the multiple light points LP for viewpoint EE, and the position of light point LPP differs from the position of light point LPQ. Pass-through points P_(i, j) and Q_(i, j) are pass-through points UP. Specifically, shiftR_xP represents the X-direction coordinate of pass-through point P_(i, j). shiftR_yP represents the Y-direction coordinate of pass-through point P_(i, j). shiftQ_xP represents the X-direction coordinate of pass-through point Q_(i, j). shiftQ_yP represents the Y-direction coordinate of pass-through point Q_(i, j).

[0147] like Figure 15 In the example shown, the transit point P_(i, j) is located near the lower right of pixel PixP. Meanwhile, the transit point Q_(i, j) is located near the upper left of pixel PixQ. Thus, the position of the transit point UP within pixel PixU varies depending on the positional relationship between the luminous point LP and the viewpoint EE.

[0148] In the embodiment, the driving control of the pixel Pix is ​​performed according to the positional relationship between the passing point UP and the pixel PixU, that is, the intersection position of the ray of light between the luminous point LP and the viewpoint EE and the pixel Pix. Specifically, the image output unit 12 calculates the judgment variable R_x based on the following formula (21) according to the X coordinate of a passing point UP (shiftR_x, shiftR_y). In addition, the image output unit 12 calculates the judgment variable R_y based on the following formula (22) according to the Y coordinate of the passing point UP. It should be noted that the various operations (such as the above-mentioned formulas (9) to (20)) that are the premises of formulas (21) and (22) are performed by the image output unit 12 based on (pos_x, pos_y, pos_h) and the relative angle rot derived by the line of sight tracking unit 11 and the reference Figure 5 The above description is based on the basic ideas of equations (1) to (8).

[0149] R_x=shiftR_x / PP-int(shiftR_x / PP)…(21)

[0150] R_y=shiftR_y / PP-int(shiftR_y / PP)…(22)

[0151] These determination coefficients represent the passing point UP in the pixel PixU. More specifically, they represent the passing point UP in the pixel PixU from the end closest to the origin set on the display surface (for example, Figure 16 The position of the through point UP within the pixel PixU when viewed from the upper left corner A of the pixel shown. More specifically, when R_x = 0 and R_y = 0, the through point UP is located at corner A. Furthermore, when R_x = 1 / 2 and R_y = 1 / 2, the through point UP is located at the center of the pixel PixU. Furthermore, when R_x = 1 and R_y = 1, the through point UP is located at the corner opposite corner A, AA.

[0152] Figure 16 2 is a diagram showing a coordinate system based on the pixel PixU. Figure 17 This is a schematic diagram showing an overview of the drive control of the pixel PixU corresponding to the intersection position of the ray of light between the light emitting point LP and the viewpoint EE with the pixel PixU. As the sub-pixel control related to the pixel PixU corresponding to the passing point UP where the coordinates (shiftR_x, shiftR_y) of the determination variables R_x and R_y are obtained by the above-mentioned equations (21) and (22), the image output unit 12 applies the sub-pixel control corresponding to the determination variables R_x and R_y. Specifically, as Figure 17 and the following Figure 24 and Figure 28As shown, the image output unit 12 applies control corresponding to the pixel signal assigned to the pixel PixU to at least one of the sub-pixels included in the pixel PixU and the sub-pixels included in the pixel Pix adjacent to the pixel PixU, corresponding to the combination of the value of the judgment variable R_x and the value of the judgment variable R_y.

[0153] Below, in reference Figure 16 and Figure 17 and the following Figure 24 and Figure 28 In the description, when referring to one end side in the X direction, it refers to the left side of the drawing. Furthermore, when referring to the other end side in the X direction, it refers to the right side of the drawing. Furthermore, when referring to one end side in the Y direction, it refers to the top side of the drawing. Furthermore, when referring to the other end side in the Y direction, it refers to the bottom side of the drawing.

[0154] In the description of the embodiment, Figure 16 As shown, assume that a pixel Pix includes a first sub-pixel R, a second sub-pixel G, and a third sub-pixel B. The first sub-pixel R, the second sub-pixel G, and the third sub-pixel B are arranged sequentially from one end to the other end in the X direction. A pixel Pix including one first sub-pixel R, one second sub-pixel G, and one third sub-pixel B is, for example, generally square in shape. The first sub-pixel R, the second sub-pixel G, and the third sub-pixel B are each rectangular with their long sides in the Y direction. Multiple pixels Pix are arranged in a matrix along the X and Y directions.

[0155] In reference Figure 17 In the description of the sub-pixel control modes PaA, PaB, PaC, PaD, PaE, PaF, PaG, PaH, and PaI, refer to Figure 16 The coordinate system shown here describes the sub-pixel to be controlled. Figure 16 The coordinate system based on the x-coordinate and the y-coordinate shown is a relative coordinate system based on the pixel PixU, and does not directly correspond to the above-mentioned value of (i, j).

[0156] exist Figure 16, it is assumed that the pixel PixU is located at the coordinates of x=0 and y=0. Assume that the coordinates of the related pixel PixU are (x, y)=(0, 0). The x coordinate of the pixel Pix located on one end side of the X direction adjacent to the pixel PixU is x=-1. Adjacent here means adjacent to the pixel PixU in any direction of the X direction, the Y direction, and the oblique direction relative to the pixel PixU. The oblique direction refers to a direction that intersects both the X direction and the Y direction and is orthogonal to the Z direction. The x coordinate of the pixel Pix located on the other end side of the X direction adjacent to the pixel PixU is x=1. The y coordinate of the pixel Pix located on one end side of the Y direction adjacent to the pixel PixU is y=-1. The y coordinate of the pixel Pix located on the other end side of the Y direction adjacent to the pixel PixU is y=1. For example, a pixel Pix represented by (x, y)=(−1, −1) refers to a pixel Pix located on one end side in the X direction and one end side in the Y direction relative to the pixel PixU and adjacent to the pixel PixU.

[0157] When 0 ≤ R_x < 1 / 3 and 0 ≤ R_y < 1 / 2, the transit point UP is located near one end in the X direction and one end in the Y direction within pixel PixU. More specifically, the transit point UP is located within a subpixel (first subpixel R) at one end within pixel PixU and is located above the halfway point within that subpixel. In this case, the image output unit 12 applies control mode PaA. In control mode PaA, the third subpixel B with (x, y) = (-1, -1), the first subpixel R and second subpixel G with (x, y) = (0, -1), the third subpixel B with (x, y) = (-1, 0), and the first subpixel R and second subpixel G of pixel PixU are the targets of control corresponding to the pixel signal. Specifically, pixel control corresponding to the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU is distributed and applied to the grayscale value of blue (B) for the third subpixel B at (x, y) = (-1, -1) and the third subpixel B at (x, y) = (-1, 0). Furthermore, pixel control corresponding to the grayscale values ​​of red (R) and green (G) is distributed and applied to the first subpixel R and second subpixel G at (x, y) = (0, -1) and the first subpixel R and second subpixel G of pixel PixU. Details of grayscale value distribution in pixel control will be described later. This control ensures that the pass point UP is located in the center of the subpixels lit for the pass point UP.

[0158] When 1 / 3 ≤ R_x < 2 / 3 and 0 ≤ R_y < 1 / 2, the transit point UP is located in the middle of, or near, one end and the other end of the pixel PixU in the X direction, and closer to one end in the Y direction. More specifically, the transit point UP is located in the subpixel (the second subpixel G) in the exact middle of the pixel PixU and is located above the midpoint of that subpixel. In this case, the image output unit 12 applies control mode PaB. In control mode PaB, the first, second, and third subpixels R, G, and B at (x, y) = (0, -1) and the first, second, and third subpixels B of the pixel PixU are subject to control corresponding to the pixel signal. That is, pixel control corresponding to the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU is distributed and applied to the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, -1), as well as the first subpixel R, second subpixel G, and third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0159] When 2 / 3 ≤ R_x ≤ 1 and 0 ≤ R_y < 1 / 2, the transit point UP is located within pixel PixU, closer to the other end in the X direction and closer to one end in the Y direction. More specifically, the transit point UP is located within the subpixel (third subpixel B) at the other end of pixel PixU and is located above halfway within that subpixel. In this case, the image output unit 12 applies control mode PaC. In control mode PaC, the second subpixel G and third subpixel B at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the second subpixel G and third subpixel B in pixel PixU, and the first subpixel R at (x, y) = (1, 0) are the targets of control corresponding to the pixel signal. Specifically, pixel control corresponding to the red (R) grayscale value, green (G) grayscale value, and blue (B) grayscale value indicated by the RGB pixel signals supplied to pixel PixU is distributed and applied to the first subpixel R at (x, y) = (1, -1) and the first subpixel R at (x, y) = (1, 0). Furthermore, pixel control corresponding to the green (G) grayscale value and the blue (B) grayscale value is distributed and applied to the second subpixel G and the third subpixel B at (x, y) = (0, -1), as well as the second subpixel G and the third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0160] When 0 ≤ R_x < 1 / 3 and R_y = 1 / 2, the transit point UP is located within pixel PixU, near one end in the X direction and midway between one end and the other end in the Y direction. More specifically, the transit point UP is located within a subpixel (first subpixel R) at one end of pixel PixU and near the center of that subpixel in the vertical direction (Y direction). In this case, the image output unit 12 applies control mode PaD. In control mode PaD, the third subpixel B at (x, y) = (-1, 0) and the first and second subpixels R and G in pixel PixU are the targets of control corresponding to the pixel signals. That is, the pixel control corresponding to the grayscale value of blue (B) among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU is applied to the third subpixel B at (x, y) = (-1, 0). Furthermore, pixel control corresponding to the grayscale values ​​of red (R) and green (G) is applied to the first subpixel R and the second subpixel G of the pixel PixU. By performing such control, the passing point UP is located in the center of the entire subpixel lit for the passing point UP.

[0161] When 1 / 3 ≤ R_x < 2 / 3 and R_y = 1 / 2, the passing point UP is located in the middle or near the center between one end and the other end of the pixel PixU in the X direction, and in the middle between one end and the other end in the Y direction. More specifically, the passing point UP is located in the subpixel (the second subpixel G) in the exact middle of the pixel PixU, and is located near the center of the subpixel in the vertical direction (Y direction). In this case, the image output unit 12 applies control mode PaE. In control mode PaE, the first subpixel R, the second subpixel G, and the third subpixel B of the pixel PixU are subject to control corresponding to the pixel signals. In other words, the pixel control corresponding to the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to the pixel PixU is applied to the first, second, and third subpixels R, G, and B of the pixel PixU. This control ensures that the passing point UP is located in the center of the subpixels illuminated for the passing point UP.

[0162] When 2 / 3 ≤ R_x ≤ 1 and R_y = 1 / 2, the through point UP is located within pixel PixU, near the other end in the X direction and midway between one end and the other end in the Y direction. More specifically, the through point UP is located within the subpixel (third subpixel B) at the other end of pixel PixU and is located near the center of that subpixel in the vertical direction (Y direction). In this case, the image output unit 12 applies control mode PaF. In control mode PaF, the second subpixel G, the third subpixel B, and the first subpixel R at (x, y) = (1, 0) of pixel PixU are the targets of control corresponding to the pixel signal. That is, the pixel control corresponding to the grayscale value of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU is applied to the first subpixel R at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale values ​​of green (G) and blue (B) is applied to the second subpixel G and the third subpixel B of the pixel PixU. This control ensures that the pass point UP is located in the center of the entire subpixel lit for the pass point UP.

[0163] When 0 ≤ R_x < 1 / 3 and 1 / 2 < R_y ≤ 1, the transit point UP is located within pixel PixU, closer to one end in the X direction and closer to the other end in the Y direction. More specifically, the transit point UP is located within a subpixel (first subpixel R) at one end of pixel PixU and is positioned below halfway within that subpixel. In this case, the image output unit 12 applies control mode PaG. In control mode PaG, the third subpixel B at (x, y) = (-1, 0), the first subpixel R and second subpixel G in pixel PixU, the third subpixel B at (x, y) = (-1, 1), and the first subpixel R and second subpixel G at (x, y) = (0, 1) are the targets of control corresponding to the pixel signal. Specifically, pixel control corresponding to the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU is distributed and applied to the third subpixel B at (x, y) = (-1, 0) and the third subpixel B at (x, y) = (-1, 1). Furthermore, pixel control corresponding to the grayscale values ​​of red (R) and green (G) is distributed and applied to the first subpixel R and the second subpixel G of pixel PixU, as well as the first subpixel R and the second subpixel G at (x, y) = (0, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for the pass point UP.

[0164] When 1 / 3 ≤ R_x < 2 / 3 and 1 / 2 < R_y ≤ 1, the transit point UP is located in the middle of, or near, one end and the other end of the pixel PixU in the X direction, and closer to the other end in the Y direction. More specifically, the transit point UP is located in the subpixel (the second subpixel G) in the exact middle of the pixel PixU and is located below halfway within that subpixel. In this case, the image output unit 12 applies control mode PaH. In control mode PaH, the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU, as well as the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, 1), are the targets of control corresponding to the pixel signal. That is, pixel control corresponding to the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU is distributed and applied to the first subpixel R, second subpixel G, and third subpixel B of pixel PixU, as well as the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0165] When 2 / 3 ≤ R_x ≤ 1 and 1 / 2 < R_y ≤ 1, the transit point UP is located within pixel PixU, closer to the other end in the X direction and closer to the other end in the Y direction. More specifically, the transit point UP is located within the subpixel (third subpixel B) at the other end of pixel PixU and is located below halfway within that subpixel. In this case, the image output unit 12 applies control mode PaI. In control mode PaI, the second subpixel G, third subpixel B, first subpixel R at (x, y) = (1, 0), second subpixel G and third subpixel B at (x, y) = (0, 1), and first subpixel R at (x, y) = (1, 1) of pixel PixU are the targets of control corresponding to the pixel signal. Specifically, pixel control corresponding to the red (R) grayscale value, green (G) grayscale value, and blue (B) grayscale value indicated by the RGB pixel signals supplied to pixel PixU is distributed and applied to the first subpixel R at (x, y) = (1, 0) and the first subpixel R at (x, y) = (1, 1). Furthermore, pixel control corresponding to the green (G) grayscale value and blue (B) grayscale value is distributed and applied to the second subpixel G and the third subpixel B of pixel PixU, and the second subpixel G and the third subpixel B at (x, y) = (0, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for the pass point UP.

[0166] Next, the details of the grayscale value dispersion in pixel control will be described. The image output unit 12 applies grayscale value control corresponding to the value of R_y in the control modes PaA, PaB, PaC, PaD, PaE, PaF, PaG, PaH, and PaI.

[0167] Specifically, in control modes PaA, PaB, and PaC, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y = -1 (located above pixel PixU) are controlled to be (0.5 - R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. Furthermore, in control modes PaA, PaB, and PaC, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y = 0 are controlled to be (0.5 + R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. That is, in this control, although the closer the passing point UP is to the upper pixel in the pixel PixU, the greater the grayscale value allocated to the upper pixel, the maximum allocation is only half of the pixel PixU.

[0168] In addition, in control modes PaD, PaE, and PaF, the first subpixel R, the second subpixel G, and the third subpixel B are controlled so that the grayscale values ​​of the first subpixel R, the second subpixel G, and the third subpixel B located at y=0 are the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU.

[0169] Furthermore, in control modes PaG, PaH, and PaI, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B at y = 0 are controlled to be (1.5 - R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. Furthermore, in control modes PaG, PaH, and PaI, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B at y = 1 are controlled to be (-0.5 + R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. In other words, in this control, while the grayscale value allocated to the pixel PixU increases as the point UP approaches the pixel below it, the maximum allocated grayscale value is only half of the pixel PixU.

[0170] Next, refer to Figure 18 and Figure 19 Reference Figure 16 and Figure 17 The application example of the control described above is explained. Figure 18 and Figure 19 In the example, a pixel area with 14 pixels Pix arranged in the X direction and 12 pixels Pix arranged in the Y direction is taken. In addition, the positions of the pixels Pix in the pixel area are represented by the combination of xp coordinates of xp1, xp2, ..., xp14 and yp coordinates of yp1, yp2, ..., yp14. For example, when referring to the pixel Pix with (xp, yp) = (1, 1), it refers to the pixel Pix with the position xp1 in the X direction and the position yp1 in the Y direction. In addition, Figure 18 and Figure 19 In FIG, the position of the pixel PixU is shown in a thick rectangle.

[0171] In addition, Figure 18 and Figure 19 In the diagram, four luminous points LP are arranged in a planar viewpoint. Here, the boundary between xp4 and xp5 is xpA. Furthermore, the boundary between xp10 and xp11 is xpB. Furthermore, the boundary between yp3 and yp4 is ypA. Furthermore, the boundary between yp9 and yp10 is ypB. One of the four luminous points LP is located at the intersection of xpA and ypA. One of the four luminous points LP is located at the intersection of xpA and ypB. One of the four luminous points LP is located at the intersection of xpB and ypA. One of the four luminous points LP is located at the intersection of xpB and ypB.

[0172] Figure 18 The display control of the center portion of the display screen when the user's viewpoint intermediate point CP is aligned with the center of the display screen is shown. Figure 18 Reference is applied Figure 17 The control of the sub-pixels described. Figure 18 To describe in detail, based on the above calculations, according to the positional relationship between the rays from each luminous point to each viewpoint and the pixel matrix, for the four luminous points, (xp, yp) = (3, 4), (9, 4), (3, 9), (9, 9) are derived as the four pixels Pix for the left eye that include the through point UP. In addition, for the four luminous points, (xp, yp) = (6, 4), (12, 4), (6, 9), (12, 9) are derived as the four pixels Pix for the right eye that include the through point UP. Figure 18 In the example, the control mode PaB is applied to the four pixels Pix with coordinates (xp, yp) = (3, 4), (6, 4), (9, 4), and (12, 4). Figure 18In FIG, the control mode PaH is applied to four pixels Pix with coordinates (xp, yp) = (3, 9), (6, 9), (9, 9), and (12, 9).

[0173] Figure 19 The display control on the right side of the display screen is shown when the user's viewpoint intermediate point CP is aligned with the center of the display screen. Figure 19 Reference is applied Figure 17 The control of the sub-pixels described. Figure 19 To describe in detail, based on the above calculations, according to the positional relationship between the rays from each luminous point to each viewpoint and the pixel matrix, for the four luminous points, (xp, yp) = (3, 4), (8, 4), (3, 9), (8, 9) are derived as the four pixels Pix for the left eye that include the through point UP. In addition, for the four luminous points, (xp, yp) = (6, 4), (11, 4), (6, 9), (11, 9) are derived as the four pixels Pix for the right eye that include the through point UP. Figure 19 In the above Figure 18 In contrast, the pixels for the right eye and the left eye are both offset one pixel inward relative to the positions of the light-emitting points outside the display screen. In addition, the positions of the passing points within each pixel are also different, and as a result, the display control changes accordingly. Figure 19 In the example, the control mode PaA is applied to the two pixels Pix with coordinates (xp, yp) = (3, 4) and (6, 4). The control mode PaC is applied to the two pixels Pix with coordinates (xp, yp) = (8, 4) and (11, 4). Figure 19 In the example, the control mode PaG is applied to the two pixels Pix with coordinates (xp, yp) = (3, 9) and (6, 9). Figure 19 In FIG, the control mode PaI is applied to two pixels Pix with coordinates (xp, yp) = (8, 9) and (11, 9).

[0174] Figure 20 FIG. 1 is a diagram illustrating partial areas AR1 and AR2 within the display area of ​​the display panel 20A of the display device 1. Figure 18 The control of the sub-pixels described above is applied, for example, near the midpoint CP. For example, when the midpoint CP overlaps with the area AR1 of the display panel 20A in a planar viewpoint, refer to Figure 18 The control of the sub-pixels described above is applied to the area AR1. Figure 19 The control of the sub-pixels described above is applied, for example, to a position close to the viewpoint ER in the X direction relative to the midpoint CP or to a position close to the viewpoint EL in the X direction relative to the midpoint CP. For example, when the midpoint CP overlaps with the area AR1 of the display panel 20A in a planar viewpoint, refer to Figure 19The control of the sub-pixels described above is applied to the area AR2. Figures 17 to 19 As described above, sub-pixel control according to the position of the passing point UP in each pixel Pix is ​​applied.

[0175] Furthermore, by controlling the sub-pixels according to the position of the passing point UP in each pixel Pix, it is possible to output an image in which the variation in the interval between two adjacent pixels Pix, each including a passing point UP, is alleviated.

[0176] For example, in Figure 19 In the example shown, the X-direction spacing between the pixel Pix with an xp coordinate of 3 and the pixel Pix with an xp coordinate of 6, and the X-direction spacing between the pixel Pix with an xp coordinate of 8 and the pixel Pix with an xp coordinate of 11, are equivalent to two pixels Pix. This is referred to as the first example. On the other hand, the X-direction spacing between the pixel Pix with an xp coordinate of 6 and the pixel Pix with an xp coordinate of 8 is equivalent to one pixel Pix. This is referred to as the second example. In other words, when viewed from the spacing between the two pixels Pix including the through point UP, the difference between the first and second examples is equivalent to the spacing of one pixel Pix.

[0177] On the other hand, the X-direction spacing between (xp, yp) = (3, 4) and (6, 4) when the control mode PaA is applied and (xp, yp) = (8, 4) and (11, 4) when the control mode PaC is applied is equivalent to (5 / 3) pixels Pix. This is the third example. In addition, the X-direction spacing between two pixels when the control mode PaA is applied and the X-direction spacing between two pixels when the control mode PaC is applied is equivalent to two pixels Pix. This is the fourth example. That is, although there is a difference of one pixel Pix between the first and second examples, when the reference mode PaC is applied, the X-direction spacing between two pixels when the control mode PaA is applied is equivalent to two pixels Pix. Figure 17 The difference between the third and fourth examples of sub-pixel control described above is equivalent to (1 / 3) pixel Pix. Thus, by applying sub-pixel control corresponding to the position of the through-point UP within each pixel Pix, it is possible to more effectively prevent light passing through each pixel PixU from reaching a viewpoint different from the desired viewpoint. In other words, crosstalk can be suppressed. If sub-pixel control corresponding to the position of the through-point UP within each pixel Pix were not applied at all, pixels PixU through which light travels to different viewpoints would be adjacent or spaced only by about one pixel Pix. The likelihood of light passing through each pixel PixU reaching a viewpoint different from the desired viewpoint would increase accordingly. However, by applying sub-pixel control corresponding to the position of the through-point UP within each pixel Pix, this likelihood can be further reduced.

[0178] While the above description uses R_x and R_y calculated using equations (21) and (22) as an example for the case where viewpoint EE is viewpoint ER, the same concept can be applied to the case where viewpoint EE is viewpoint EL. Specifically, instead of using R_x and R_y, L_x and L_y calculated using equations (23) and (24) below can be used.

[0179] L_x=shiftL_x / pix-int(shiftL_x / pix)…(23)

[0180] L_y=shiftL_y / pix-int(shiftL_y / pix)…(24)

[0181] It should be noted that in multi-view scenarios, if there is a positional offset between the viewpoint and the display device 1, image quality may be degraded because the display device 1 cannot fully demonstrate the image quality that it is capable of for each viewpoint. The positional offset referred to here refers to the positional offset of the user's viewpoint (e.g., viewpoints E1 and E2) relative to the display device 1, based on information acquired by a unit that acquires the user's viewpoint information (e.g., the imaging unit 2, the ranging unit 3, the gyro sensor 4, and the gaze tracking unit 11). Hereinafter, when simply referred to as a positional offset, this refers to the relevant positional offset.

[0182] Ideally, the positional shift is corrected promptly based on the update of the information acquired by the acquisition unit so that a state without positional shift can be achieved. However, for some reason, the user may visually confirm the image in a state where the positional shift is temporarily occurring. Therefore, a mechanism for suppressing the degradation of image quality due to positional shift may be further provided. Figures 21 to 31 For use in the application of reference Figure 17 The mechanism of suppressing image quality degradation under the control of the sub-pixel described above is explained. Figures 21 to 23 、 Figure 27 and Figure 29 In order to more clearly show the relationship between the relative angle rot and each figure, based on the example of the numerical value of the relative angle rot marked on the top layer of the figure, the orientation of the facial HF under such relative angle rot is further shown on the left side of the numerical value.

[0183] Figure 21 1 is a schematic diagram showing the positional relationship between the light emitting point LP, the pixel PixU, and the viewpoint EE when there is no substantial positional displacement between the viewpoint EE and the display device 1. Figure 17The sub-pixel control described above corresponds to the relationship between the pixel PixU corresponding to the viewpoint EE and the through-point UP. Therefore, as long as there is no positional shift, high-quality display output can be achieved, based on the position of the viewpoint EE at the time the applied sub-pixel control pattern is determined.

[0184] exist Figure 21 Specific examples are shown in "Case 1," "Case 2," and "Case 3." In "Case 1," as shown in the "Applied Control" column, a control pattern PaE is applied to a certain pixel PixU. Furthermore, in "Case 1," as shown in the "Relationship between Light Source, Sub-Pixels, and Eye," a second sub-pixel G lies on the ray idq1 between the assumed viewpoint EE and the luminous point LP at the time control pattern PaE is applied. Hereinafter, when simply referred to as the "upper column," unless otherwise specified, this refers to the "Applied Control" column. Furthermore, when simply referred to as the "lower column," unless otherwise specified, this refers to the "Relationship between Light Source, Sub-Pixels, and Eye" column. The upper column shows the sub-pixel control corresponding to the position (assumed position) of the viewpoint EE determined at the time the sub-pixel control pattern is determined. The lower column shows the actual positional relationship between the luminous point LP, the pixel PixU, and the viewpoint EE at the time the image is visually recognized from each viewpoint.

[0185] In the lower column of "Case q," light from the light-emitting point LP that passes through the first subpixel R is designated as light Rq. Here, q is a natural number. For example, when q = 1, in the lower column of "Case 1," the light from the light-emitting point LP that passes through the first subpixel R is labeled R1. The following explanation, based on this concept, refers to the lower column. In the lower column of "Case q," light from the light-emitting point LP that passes through the second subpixel G is designated as light Gq. In the lower column of "Case q," light from the light-emitting point LP that passes through the third subpixel B is designated as light Bq.

[0186] like Figure 16 、 Figure 17As shown, under control mode PaE, the passing point UP exists in the second sub-pixel G. Furthermore, "Case 1" is a state in which no substantial positional offset occurs. In the lower column of Case 1, the X-direction position of the viewpoint EE in a state in which no substantial positional offset occurs is shown as position idp1. In this state, as shown in the lower column of "Case 1", light from the luminous point LP can reach the viewpoint EE through each of the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B of the pixel PixU. Specifically, in the lower column of "Case 1", light R1 passes through the first sub-pixel R, light G1 passes through the second sub-pixel G, and light B1 passes through the third sub-pixel B, reaching the viewpoint EE as light RGB1. That is, the light RGB1 in the lower column of "Case 1" includes light R1, light G1, and light B1.

[0187] exist Figure 21 In "Case 2", as shown in the upper column, the control mode PaF is applied to a certain pixel PixU. In addition, in "Case 2", the third sub-pixel B exists on the ray idq2 between the viewpoint EE and the luminous point LP assumed at the time when the control mode PaF is applied. Figure 16 、 Figure 17 As shown, in control mode PaF, the through point UP exists in the third subpixel B. Therefore, in "Case 2," no positional shift occurs, and the light RGB2, including light G2, light B2, and light R2, reaches the viewpoint EE. Note that position idp2 in "Case 2" represents the position of the viewpoint EE, where no substantial positional shift occurs.

[0188] It should be pointed out that Figure 21 Compared to "Case 1," "Case 3" is essentially the same as "Case 1," except that the position of viewpoint EE changes from position idp1 to position idp3, and the angle θ3 between ray idq3 connecting viewpoint EE and light emitting point LP and the Z direction differs from the angle θ1 between ray idq1 and the Z direction in "Case 1." Therefore, in "Case 3," there is no positional shift, and light RGB3, including light R3, light G3, and light B3, reaches viewpoint EE.

[0189] It should be pointed out that in Figure 21 and the following Figure 22 The width SS of one light emitting point LP in the X direction is shown as an example (refer to Figure 3) is the width SSx1. Width SSx1 is the width SS of the light-emitting point LP in the X direction, corresponding to the width of one pixel Pix in the X direction. Specifically, width SSx1 is the design width of the light-emitting point LP in the X direction, determined in advance, assuming that light from one light-emitting point LP passes through the display panel 20A with a width equivalent to one pixel Pix in the X direction, centered around the passage point UP, and reaches the viewpoint EE. This design width takes into account, for example, the distance Ph described below, but is not limited thereto and can be varied as appropriate.

[0190] Figure 21 The "Case 1", "Case 2" and "Case 3" shown are all based on the premise that there is no positional offset between the luminous point LP of width SSx1 and the transmission area equivalent to one pixel Pix in the X direction that is controlled to transmit light based on the positional relationship between the pixel PixU and the passing point UP. The relevant "transmission area equivalent to one pixel Pix" refers to the transmission area generated by the same number of sub-pixels arranged continuously in the X direction as the number of sub-pixels in one pixel Pix (for example, 3) that are controlled to transmit light. That is, referring to Figure 17 The control of the sub-pixels described above is a control for forming only the relevant “transmitting area corresponding to one pixel Pix” in the X direction.

[0191] Figure 22 1 is a schematic diagram showing the positional relationship between the light emitting point LP, the pixel PixU, and the viewpoint EE when the viewpoint EE and the display device 1 are substantially offset from each other. Figure 22 In "Case 4", Figure 21 Similarly to "Case 1", the control pattern PaE is applied to a certain pixel PixU. On the other hand, in "Case 4", unlike "Case 1", a position shift occurs. In the lower column of "Case 4", the relevant position shift is shown as the position of the viewpoint EE shifting from the position idp1 to the position idp4. Due to the relevant position shift, a part of the sub-pixel that should be located on the ray of light between the light-emitting point LP and the viewpoint EE is no longer located on the ray. In the lower column of "Case 4", an example is shown in which the first sub-pixel R is no longer located on the ray. Due to the relevant position shift, the light reaching the viewpoint EE in "Case 4" becomes light GB4. Although light GB4 includes light G4 and light B4, it does not include light passing through the first sub-pixel R. As a result, in "Case 4", color unevenness occurs in which the red component included in the image cannot be visually confirmed or the red component is weakened.

[0192] exist Figure 22 In "Case 5", Figure 21Similarly to "Case 2", the control pattern PaF is applied to a certain pixel PixU. On the other hand, in "Case 5", unlike "Case 2", a position shift occurs. In the lower column of "Case 5", the relevant position shift is shown as the position of the viewpoint EE shifting from the position idp2 to the position idp5. Due to the relevant position shift, in "Case 5", the second sub-pixel G is no longer located on the ray of light between the luminous point LP and the viewpoint EE. Therefore, in "Case 5", although the light RB5 reaching the viewpoint EE includes the light R5 and the light B5, it does not include the light passing through the second sub-pixel G. As a result, in "Case 5", color unevenness occurs, in which the green component included in the image cannot be visually confirmed or the green component is weakened.

[0193] exist Figure 22 In "Case 6", Figure 21 Similarly to "Case 3", the control pattern PaE is applied to a certain pixel PixU. On the other hand, in "Case 6", unlike "Case 3", a position shift occurs. In the lower column of "Case 6", the relevant position shift is shown as the position of the viewpoint EE shifting from the position idp3 to the position idp6. Due to the relevant position shift, in "Case 6", the first sub-pixel R is no longer located on the ray of light between the light-emitting point LP and the viewpoint EE. Therefore, in "Case 6", although the light GB6 reaching the viewpoint EE includes the light G6 and the light B6, it does not include the light passing through the first sub-pixel R. As a result, in "Case 6", color unevenness occurs, in which the red component included in the image cannot be visually confirmed or the red component is weakened.

[0194] As reference Figure 22 As described above, the width SS in the X direction of a light emitting point LP (see Figure 3 ) has a width SSx1, and when the "transmittance area corresponding to one pixel Pix" is controlled based on the positional relationship between the pixel PixU and the pass-through point UP, color unevenness may occur due to positional deviation. Therefore, by increasing the number of sub-pixels controlled based on the positional relationship between the pixel PixU and the pass-through point UP, this related color unevenness can be suppressed.

[0195] Figure 23 This is a schematic diagram showing the positional relationship among the luminous point LP, the pixel PixU, and the viewpoint EE when the transmission area controlled based on the positional relationship between the pixel PixU and the pass-through point UP exceeds the amount corresponding to one pixel Pix. Figure 23 The "Scenario 7" shown shows that reference will be made to Figure 22 In the above-described "Case 4", the transparent area corresponding to one pixel Pix is ​​changed to a transparent area exceeding the amount of one pixel Pix. In addition, "Case 8" shows the case where the reference Figure 22In the above-described "Case 5", the transparent area corresponding to one pixel Pix is ​​changed to a transparent area exceeding the amount of one pixel Pix. In addition, "Case 9" shows the case where the reference Figure 22 The aforementioned “Case 6” is a case where the transmission area corresponding to one pixel Pix is ​​changed to a transmission area exceeding the amount corresponding to one pixel Pix.

[0196] exist Figure 23 In "Case 7", "Case 8" and "Case 9", in addition to controlling the application of reference Figure 17 In addition to the three sub-pixels that are controlled by the control of the sub-pixels described above and that are controlled in accordance with the pixel signal, three more sub-pixels are controlled. Figure 17 The three sub-pixels to which the control corresponding to the pixel signal is applied are described as "pre-addition sub-pixels", and the sub-pixels that are further controlled to transmit light in addition to the pre-addition sub-pixels are described as "post-addition sub-pixels". Figure 16 The coordinate system shown in FIG is used to describe the sub-pixels before and after the addition. Figure 23 As shown in the lower column of , the added subpixels in "Case 7" and "Case 9" are the third subpixel B with (x, y) = (-1, 0) and the first subpixel R and second subpixel G with (x, y) = (1, 0). Therefore, in addition to the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU shown as the "subpixels before addition" in "Case 4" and "Case 6", the three related subpixels after addition become the application targets of control corresponding to the pixel signal.

[0197] In addition, if Figure 23 As shown in the lower column of , the added subpixels in "Case 8" are the first subpixel R of pixel PixU and the second subpixel G and third subpixel B at (x, y) = (1, 0). Thus, in addition to the second subpixel G and third subpixel B of pixel PixU and the first subpixel R at (x, y) = (1, 0), which are also shown as "subpixels before addition" in "Case 5," the three related subpixels after addition become the objects of application of control corresponding to the pixel signal.

[0198] In the embodiment, by generating these "additional sub-pixels," light RGBq emitted from a light-emitting point LP having a width of SSx1 and reaching the viewpoint EE includes light Rq, light Gq, and light Bq. Specifically, light RGB7 in "Case 7" includes light R7, light G7, and light B7. Light RGB8 in "Case 8" includes light R8, light G8, and light B8. Light RGB9 in "Case 9" includes light R9, light G9, and light B9. Thus, the color unevenness generated in "Case 4," "Case 5," and "Case 6" is eliminated by generating the additional sub-pixels in the embodiment.

[0199] In application reference Figure 23 In the case of the sub-pixel control mode described above, the sub-pixels are controlled to transmit light according to the pixel signal assigned to the pixel PixU, so that the area including the sub-pixels before and after the addition is formed as a transmission area having a width in the X direction equivalent to that of two pixels Pix (for example, see Figure 26 The transparent region TRx2 shown in FIG. Figure 24 A control pattern of a sub-pixel for forming a transmissive region having a width in the X direction corresponding to the width of two pixels Pix will be described.

[0200] Figure 24 is shown with Figure 17 Schematic diagram of different drive controls. Figure 24 In the description of the sub-pixel control modes PbA, PbB, PbC, PbD, PbE, PbF, PbG, PbH, PbI, PbJ, PbK, and PbL, refer to Figure 16 Note that in the following description, in each mode, the pixel PixU becomes the above-mentioned pre-addition sub-pixel, and other lit pixels that differ in each mode become post-addition sub-pixels.

[0201] When 0 ≤ R_x < 1 / 6 and 0 ≤ R_y < 1 / 2, image output unit 12 applies control mode PbA. In control mode PbA, the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (-1, -1), the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, -1), the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (-1, 0), and the first subpixel R, second subpixel G, and third subpixel B at pixel PixU (pixel PixU has (x, y) = (0, 0). The same applies hereinafter.) are the targets of control corresponding to the pixel signal. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R at (x, y) = (-1, -1), the first subpixel R at (x, y) = (-1, 0), the first subpixel R at (x, y) = (0, -1), and the first subpixel R of pixel PixU. Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G at (x, y) = (-1, -1), the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (0, -1), and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the blue (B) grayscale value is dispersed and applied to the third subpixel B at (x, y) = (-1, -1), the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (0, -1), and the third subpixel B of pixel PixU. Details of the grayscale value dispersion in pixel control will be described later. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0202] When 1 / 6 ≤ R_x < 1 / 2 and 0 ≤ R_y < 1 / 2, image output unit 12 applies control mode PbB. In control mode PbB, the second subpixel G and third subpixel B at (x, y) = (-1, -1), the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the second subpixel G and third subpixel B at (x, y) = (-1, 0), the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (-1, 0), the first subpixel R, second subpixel G, and third subpixel B at pixel PixU, and the first subpixel R at (x, y) = (1, 0) are controlled accordingly. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (1, 0). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G at (x, y) = (-1, -1), the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (0, -1), and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (-1, -1), the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (0, -1), and the third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0203] When 1 / 2 ≤ R_x < 5 / 6 and 0 ≤ R_y < 1 / 2, image output unit 12 applies control mode PbC. In control mode PbC, the third subpixel B at (x, y) = (-1, -1), the first subpixel R, the second subpixel G, and the third subpixel B at (x, y) = (0, -1), the first subpixel R, the second subpixel G at (x, y) = (1, -1), the third subpixel B at (x, y) = (-1, 0), the first subpixel R, the second subpixel G, and the third subpixel B at (x, y) = (-1, 0), the first subpixel R, the second subpixel G, and the third subpixel B at pixel PixU, and the first subpixel R and the second subpixel G at (x, y) = (1, 0) are controlled accordingly. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (1, 0). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G at (x, y) = (0, -1), the second subpixel G at (x, y) = (1, -1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (-1, -1), the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (0, -1), and the third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0204] When 5 / 6 ≤ R_x ≤ 1 and 0 ≤ R_y < 1 / 2, image output unit 12 applies control mode PbD. In control mode PbD, the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, -1), the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (1, -1), the first subpixel R, second subpixel G, and third subpixel B at pixel PixU, and the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (1, 0) are the targets of control corresponding to the pixel signals. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R at (x, y) = (0, -1), the first subpixel R at (x, y) = (1, -1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (1, 0). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G at (x, y) = (0, -1), the second subpixel G at (x, y) = (1, -1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (0, -1), the third subpixel B at (x, y) = (1, -1), the third subpixel B of the pixel PixU, and the third subpixel B at (x, y) = (1, 0). This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0205] When 0 ≤ R_x < 1 / 6 and R_y = 1 / 2, the image output unit 12 applies control mode PbE. In control mode PbE, the first, second, and third subpixels R, G, and B at (x, y) = (-1, 0) and the first, second, and third subpixels B of pixel PixU are subject to control corresponding to the pixel signals. Specifically, pixel control corresponding to the grayscale value of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU is distributed and applied to the first subpixel R at (x, y) = (0, -1) and the first subpixel R of pixel PixU. Furthermore, pixel control corresponding to the grayscale value of green (G) is distributed and applied to the second subpixel G at (x, y) = (0, -1) and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (0, -1) and the third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0206] When 1 / 6 ≤ R_x < 1 / 2 and R_y = 1 / 2, the image output unit 12 applies control mode PbF. In control mode PbF, the second subpixel G and third subpixel B at (x, y) = (-1, 0), the first subpixel R of pixel PixU, the second subpixel G and third subpixel B, and the first subpixel R at (x, y) = (1, 0) are subject to control corresponding to the pixel signals. Specifically, pixel control corresponding to the grayscale value of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU is distributed and applied to the first subpixel R of pixel PixU and the first subpixel R at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale value of green (G) is distributed and applied to the second subpixel G at (x, y) = (0, -1) and the second subpixel G of pixel PixU. Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (0, -1) and the third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0207] When 1 / 2 ≤ R_x < 5 / 6 and R_y = 1 / 2, the image output unit 12 applies control mode PbG. In control mode PbG, the third subpixel B at (x, y) = (-1, 0), the first subpixel R, the second subpixel G, and the third subpixel B of pixel PixU, and the first subpixel R and the second subpixel G at (x, y) = (1, 0) are subject to control corresponding to the pixel signals. Specifically, the pixel control corresponding to the grayscale value of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU is distributed and applied to the first subpixel R of pixel PixU and the first subpixel R at (x, y) = (1, 0). Furthermore, the pixel control corresponding to the grayscale value of green (G) is distributed and applied to the second subpixel G of pixel PixU and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (0, -1) and the third subpixel B of pixel PixU. This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0208] When 5 / 6 ≤ R_x ≤ 1 and R_y = 1 / 2, the image output unit 12 applies control mode PbH. In control mode PbH, the first, second, and third subpixels R, G, and B of pixel PixU, as well as the first, second, and third subpixels R, G, and B at (x, y) = (1, 0), are subject to control corresponding to the pixel signals. Specifically, pixel control corresponding to the grayscale value of red (R), green (G), and blue (B) indicated by the RGB pixel signal supplied to pixel PixU is distributed and applied to the first subpixel R of pixel PixU and the first subpixel R at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale value of green (G) is distributed and applied to the second subpixel G of pixel PixU and the second subpixel G at (x, y) = (1, 0). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B of pixel PixU and the third subpixel B at (x, y) = (1, 0). This control ensures that the pass point UP is located in the center of the subpixels lit for the pass point UP.

[0209] When 0 ≤ R_x < 1 / 6 and 1 / 2 ≤ R_y ≤ 1, image output unit 12 applies control mode PbI. In control mode PbI, the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (-1, 0), the first subpixel R, second subpixel G, and third subpixel B at pixel PixU, the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (-1, 1), and the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, 1) are the targets of control corresponding to the pixel signals. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R at (x, y) = (-1, 0), the first subpixel R at (x, y) = (-1, 1), the first subpixel R of pixel PixU, and the first subpixel R at (x, y) = (0, 1). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (-1, 1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (0, 1). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (-1, 1), the third subpixel B of the pixel PixU, and the third subpixel B at (x, y) = (0, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0210] When 1 / 6 ≤ R_x < 1 / 2 and 1 / 2 ≤ R_y ≤ 1, image output unit 12 applies control mode PbJ. In control mode PbJ, the second subpixel G and third subpixel B at (x, y) = (-1, 0), the first subpixel R, second subpixel G, and third subpixel B at pixel PixU, the first subpixel R at (x, y) = (1, 0), the second subpixel G and third subpixel B at (x, y) = (-1, 1), the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, 1), and the first subpixel R at (x, y) = (1, 1) are the targets of control corresponding to the pixel signal. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R of pixel PixU, the first subpixel R at (x, y) = (0, 1), the first subpixel R at (x, y) = (1, 0), and the first subpixel R at (x, y) = (1, 1). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G at (x, y) = (-1, 0), the second subpixel G at (x, y) = (-1, 1), the second subpixel G of pixel PixU, and the second subpixel G at (x, y) = (0, 1). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (-1, 1), the third subpixel B of the pixel PixU, and the third subpixel B at (x, y) = (0, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0211] When 1 / 2 ≤ R_x < 5 / 6 and 1 / 2 ≤ R_y ≤ 1, image output unit 12 applies control mode PbK. In control mode PbK, the third subpixel B at (x, y) = (-1, 0), the first subpixel R, the second subpixel G, and the third subpixel B of pixel PixU, the first subpixel R, the second subpixel G at (x, y) = (1, 0), the third subpixel B at (x, y) = (-1, 1), the first subpixel R, the second subpixel G, and the third subpixel B at (x, y) = (0, 1), and the first subpixel R and the second subpixel G at (x, y) = (1, 1) are controlled accordingly to the pixel signals. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R of pixel PixU, the first subpixel R at (x, y) = (0, 1), the first subpixel R at (x, y) = (1, 0), and the first subpixel R at (x, y) = (1, 1). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G of pixel PixU, the second subpixel G at (x, y) = (0, 1), the second subpixel G at (x, y) = (1, 0), and the second subpixel G at (x, y) = (1, 1). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B at (x, y) = (-1, 0), the third subpixel B at (x, y) = (-1, 1), the third subpixel B of the pixel PixU, and the third subpixel B at (x, y) = (0, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0212] When 5 / 6 ≤ R_x ≤ 1 and 1 / 2 ≤ R_y ≤ 1, the image output unit 12 applies control mode PbL. In control mode PbL, the first subpixel R, second subpixel G, and third subpixel B of the pixel PixU; the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (1, 0); the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (0, 1); and the first subpixel R, second subpixel G, and third subpixel B at (x, y) = (1, 1) are the targets of control corresponding to the pixel signal. That is, among the grayscale values ​​of red (R), green (G), and blue (B) indicated by the RGB pixel signals supplied to pixel PixU, the pixel control dispersion corresponding to the grayscale value of red (R) is applied to the first subpixel R of pixel PixU, the first subpixel R at (x, y) = (1, 0), the first subpixel R at (x, y) = (0, 1), and the first subpixel R at (x, y) = (1, 1). Furthermore, the pixel control dispersion corresponding to the grayscale value of green (G) is applied to the second subpixel G of pixel PixU, the second subpixel G at (x, y) = (1, 0), the second subpixel G at (x, y) = (0, 1), and the second subpixel G at (x, y) = (1, 1). Furthermore, pixel control corresponding to the grayscale value of blue (B) is distributed and applied to the third subpixel B of pixel PixU, the third subpixel B with (x, y) = (1, 0), the third subpixel B with (x, y) = (0, 1), and the third subpixel B with (x, y) = (1, 1). This control ensures that the pass point UP is located in the center of the subpixels lit for this pass point UP.

[0213] Next, the details of grayscale value dispersion in pixel control will be described. The image output unit 12 applies grayscale value control corresponding to the value of R_y in control modes PbA, PbB, PbC, PbD, PbE, PbF, PbG, PbH, PbI, PbJ, PbK, and PbL.

[0214] Specifically, in control modes PbA, PbB, PbC, and PbD, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y = -1 (located above pixel PixU) are (0.5 - R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. Furthermore, in control modes PbA, PbB, PbC, and PbD, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y = 0 are (0.5 + R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. That is, in this control, while the grayscale value allocated to the upper pixel increases as the point UP approaches within pixel PixU, this allocation is limited to half of the value allocated to pixel PixU at most. Furthermore, in control modes PbE, PbF, PbG, and PbH, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y = 0 are the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. Furthermore, in control modes PbI, PbJ, PbK, and PbL, the grayscale values ​​of the first subpixel R, second subpixel G, and third subpixel B located at y = 0 are (1.5 - R_y) × 100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal for pixel PixU. In addition, in control modes PbI, PbJ, PbK, and PbL, the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B are controlled so that the grayscale values ​​of the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B located at y=1 are (-0.5+R_y)×100% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal of the pixel PixU. That is, in this control, although the grayscale value allocation to the pixel of the lower layer is larger as the point UP is closer to the pixel PixU, the maximum allocation is only half of the pixel PixU. Hereinafter, in the description “reference Figure 24 In the case of the "dispersion of grayscale values ​​in the pixel control described above", it refers to the control of sub-pixels such that the grayscale values ​​of the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B located at a coordinate in the Y direction other than y=0 are lowered compared to the grayscale values ​​of the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B located at y=0, as performed in the control modes PbA, PbB, PbC, PbD, PbI, PbJ, PbK, and PbL. Figure 24In the case of the dispersion of grayscale values ​​in the pixel control described above, the sub-pixels are controlled to transmit light according to the pixel signal allocated to the pixel PixU, thereby forming a transmissive region having a Y-direction width twice that of the pixel Pix.

[0215] It should be pointed out that in Figure 23 The sub-pixel control mode applied in "Case 7" and "Case 9" is based on Figure 24 The control mode PbG is described. Figure 23 The sub-pixel control mode applied in "Case 8" is based on Figure 24 The control mode PbH is described.

[0216] In addition, since the width of the light-emitting point LP corresponds to one pixel Pix, the range of one transmissive area that the user recognizes as a light-emitting area corresponds to one pixel Pix. Figure 23 For this reason, in the “visually recognized range” of FIG. 1 , patterns are annotated on sub-pixels included in the range recognized by the user as the luminous area.

[0217] As reference Figure 23 and Figure 24 As described above, by generating additional sub-pixels, it is possible to suppress the degradation of image quality due to positional deviation. In other words, the range of the viewing angle in the X direction in which the image can be visually recognized with good image quality from each viewpoint corresponds to the width SS of the light-emitting point LP in the X direction. Figure 25 and Figure 26 An example of the relationship between the width SS of the light emitting point LP in the X direction and the viewing angle will be described.

[0218] Figure 25 2 is a schematic diagram showing an example of the relationship between the display panel 20A and two viewpoints E1 and E2 and the viewing angles with respect to each viewpoint E1 and E2. Figure 25 In FIG, the viewpoint E1 and the viewpoint E2 are located at positions symmetrical in the X direction with respect to the axis Za passing through the intermediate point CP and the focus object FP in the Z direction. The focus object FP is the object from the user's line of sight toward the display panel 20A. It should be noted that Figure 25 The focus object FP shown is a schematic diagram when viewed from a macroscopic perspective. When viewed from a microscopic perspective, the focus objects FP for the viewpoints E1 and E2, that is, the focus objects FP1 and FP2, are actually located at different positions (for example, refer to FIG. Figure 26 ). Let the viewpoint E1 side relative to the axis Za be one side (negative (-) side) in the X direction. Let the viewpoint E2 side relative to the axis Za be the other side (positive (+) side) in the X direction. Figure 25In the example shown, the line of sight from viewpoint E1 toward the focal object FP is inclined by -4.5 degrees (°) relative to the axis Za. The line of sight from viewpoint E2 toward the focal object FP is inclined by 4.5 degrees (°) relative to the axis Za.

[0219] exist Figure 25 In the example shown, the range AN1 from -1.5 degrees (°) to +2 degrees (°) centered on the line of sight CL1 from the viewpoint E1 is shown as a range in which color unevenness due to positional offset does not occur. In addition, the range AN1 from -1 degree (°) to +2 degrees (°) centered on the line of sight CL2 from the viewpoint E2 is shown as a range in which color unevenness due to positional offset does not occur. In addition, the range AN1-2.5 degrees (°) and the range AN2 +3 degrees (°) relative to the viewpoint E1 will produce color unevenness, but are shown as ranges in which images facing each viewpoint can be visually confirmed. In addition, the range AN2 ±3 degrees (°) relative to the viewpoint E2 will produce color unevenness, but is shown as a range in which images facing each viewpoint can be visually confirmed. In addition, such ranges AN1 and AN2 are, for example, obtained by applying reference Figure 23 and Figure 24 The range of the case of the sub-pixel control mode described.

[0220] Figure 26 Reference Figure 25 The width of the light emitting point LP in the X direction within the range AN1 described above is the same as the width of the reference Figure 23 and Figure 24 A schematic diagram showing the relationship between the control modes of the sub-pixels described. Figure 26 , the second sub-pixel G is shown as the focus object FP1, FP2. The focus object FP1 is the focus object FP for the viewpoint E1. The focus object FP2 is the focus object FP for the viewpoint E2. In the embodiment, since the user is not aware that the focus objects of the viewpoints E1 and E2 are different focus objects FP1 and FP2, the focus objects from the user's macroscopic perspective are as shown in FIG. Figure 25 On the other hand, as a display output method for a display device that allows a user to visually recognize a parallax image, in reality, separate focus objects FP1 and FP2 are generated at viewpoints E1 and E2, respectively. Figure 25 Strictly speaking, the viewing angle described is also for viewpoint E1. Figure 26 The focus object FP1 is considered Figure 25 The focal object FP, for viewpoint E2, Figure 26 The focus object FP2 is considered to be Figure 25 The focus object FP. Figure 23 and Figure 24 In the described subpixel control mode, the light transmission area is controlled so that, based on the pixel signal assigned to pixel PixU, it has an X-direction width equivalent to two pixels Pix, or, in the embodiment, six subpixels. Therefore, from the lines of sight CL1 and CL2 corresponding to the positions of viewpoints E1 and E2 acquired by the acquisition unit (e.g., the imaging unit 2, the ranging unit 3, the gyro sensor 4, and the line of sight tracking unit 11), edges EM1 and EM2 corresponding to one subpixel are generated toward one side in the X direction, and edges EP1 and EP2 corresponding to two subpixels are generated toward the other side in the X direction.

[0221] exist Figure 26 In the example shown, within the range between the line CL3 on one side of the line of sight CL1 in the X direction and the line CL5 on the other side of the line of sight CL1 in the X direction, it is possible to visually recognize substantially the same image as that at the viewpoint E1 located at the line of sight CL1. Figure 25 The range AN1 of the viewpoint E1 described above corresponds to this range. In addition, if the range is between the line CL4 on one side of the line of sight CL2 in the X direction and the line CL6 on the other side of the line of sight CL2 in the X direction, it is possible to visually recognize an image that is substantially the same as that of the viewpoint E2 located at the line of sight CL2. The relevant range is similar to the reference range. Figure 25 The range AN2 of the viewpoint E2 described above corresponds.

[0222] It should be noted that even from the outside of the edge parts EM1, EM2, EP1, EP2, if the reference Figure 25 In the described range AN2, although color unevenness occurs due to the mismatch in color of all sub-pixels, it is still possible to output an image for each viewpoint.

[0223] Above, refer to Figures 21 to 26 For application reference Figure 16 The influence of the positional deviation in the X direction under the control mode of the sub-pixel described above and its treatment method are described. Figure 27 For application reference Figure 16 Matters related to the Y direction under the conditions of the sub-pixel control mode described above will be described.

[0224] Figure 27 Is to show the application reference Figure 16 Schematic diagram of the positional relationship between the luminous point LP, the pixel PixU and the viewpoint EE in the Y direction under the control mode of the sub-pixel described in the example. Figure 16 、 Figure 17 As shown, in the control mode PaH, the through point UP exists on one end side of the second sub-pixel G in the Y direction. Figure 27In the lower column of "Case 11," the Y-direction position of viewpoint EE is shown as position idp11. "Case 11" illustrates a case where light from light-emitting point LP can reach viewpoint EE via pixel PixU and pixel PixT, which is adjacent to pixel PixU and located closer to passage point UP.

[0225] on the other hand, Figure 27 Compared with "Case 11", the position of viewpoint EE in "Case 12" shown is changed from position idp11 to position idp12. In addition, compared with "Case 11", the angle θ12 between the ray idq12 connecting viewpoint EE and luminous point LP and the Z direction is different from the angle θ11 between the ray idq11 and the Z direction in "Case 11". Therefore, in "Case 12", the ratio of the proportion of light from luminous point LP that passes through pixel PixU to the proportion of light that passes through pixel PixT is different from that in "Case 11". Figure 27 In the example shown, in "Case 11," the ratio of RGBH light passing through pixel PixU to RGBL light passing through pixel PixT is approximately 2:1. On the other hand, in "Case 12," the ratio of RGBH light passing through pixel PixU to RGBL light passing through pixel PixT is approximately 1:2. This difference in ratios, combined with the different light transmittances of pixel PixU and pixel PixT, results in a difference in brightness of the display output between "Case 11" and "Case 12."

[0226] Assuming no reference is applied Figure 17 In the case of the sub-pixel control described above, the pixel signal assigned to the pixel PixU is a pixel signal corresponding to white with the highest brightness. As a specific example, when the relevant pixel signal is expressed as an 8-bit signal for each of RGB, (R, G, B) = (255, 255, 255). If the reference is applied to the pixel PixU to which the relevant pixel signal is provided, Figure 17 In the control of the sub-pixels described above, 66% of the white component of 100% brightness corresponding to the relevant pixel signal is allocated to the pixel PixU, and 33% is allocated to the pixel PixT. This is because, as mentioned above, the brightness allocated to the pixel PixT is only half of that of the pixel PixU at most. When the reference is applied to the pixel PixU to which the relevant pixel signal is provided, Figure 17When comparing "Case 11" and "Case 12" under the described subpixel control conditions, the light RGB12 visually perceived by viewpoint EE in "Case 12" is darker than the light RGB11 visually perceived by viewpoint EE in "Case 11." This is because in "Case 11," the ratio of light RGBH passing through pixel PixU (with relatively high transmittance) to light RGBL passing through pixel PixT (with relatively low transmittance) is approximately 2:1, whereas in "Case 12," this ratio is approximately 1:2. In other words, while both light RGB11 and light RGB12 include both light RGBH and light RGBL, light RGB12 has a higher ratio of light RGBL and a lower ratio of light RGBH than light RGB11.

[0227] It should be pointed out that in Figure 27 and the following Figure 30 In the example, the Y-direction width of a single light-emitting point LP is represented by width SSy1. Width SSy1 is the Y-direction width of the light-emitting point LP, corresponding to the Y-direction width of a single pixel Pix. In other words, width SSy1 is the design width of the light-emitting point LP in the Y-direction, determined in advance, assuming that light from the light-emitting point LP passes through the display panel 20A with a width equivalent to that of a single pixel Pix in the X-direction, centered at the passage point UP, and reaches the viewpoint EE. This design width takes into account, for example, the distance Ph described later, but is not limited thereto and can be varied as appropriate.

[0228] If through Figure 27 The comparison between "Case 11" and "Case 12" shows that even as a reference Figure 17 Even if the control mode of the sub-pixels described above is the same, the brightness may be unexpectedly reduced as in "Case 12". Therefore, by increasing the number of pixels Pix that are controlled to transmit light based on the positional relationship between the pixel PixU and the pass-through point UP, the corresponding reduction in brightness can be suppressed. Figure 28 Control modes (control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL) for forming sub-pixels having a transmissive region having a width in the Y direction corresponding to two pixels Pix will be described.

[0229] Figure 28 is shown with Figure 17 and Figure 24 Schematic diagram of different drive controls. Figure 28 The control mode of the sub-pixels shown will Figure 24The control modes PbA, PbB, PbC, PbD, PbI, PbJ, PbK, and PbL in the control modes of the sub-pixels shown in FIG. 3 are replaced by the control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL. That is, regarding the control modes PbE, PbF, PbG, and PbH, Figure 24 and Figure 28 General in China.

[0230] The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcA are the same as those in control mode PbA. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcB are the same as those in control mode PbB. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcC are the same as those in control mode PbC. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcD are the same as those in control mode PbD. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcI are the same as those in control mode PbI. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcJ are the same as those in control mode PbJ. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcK are the same as those in control mode PbK. The sub-pixels that are the objects of application of control corresponding to the pixel signal in control mode PcL are the same as those in control mode PbL.

[0231] On the other hand, in the control modes PbA, PbB, PbC, PbD, PbI, PbJ, PbK, and PbL, although the reference Figure 24 The dispersion of grayscale values ​​in pixel control is described, but Figure 28 In the control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL shown, reference is not applied. Figure 24 The dispersion of grayscale values ​​in the pixel control is described. Figure 28 In the control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL shown, the sub-pixels are controlled so that the light transmittance of two sub-pixels adjacent to each other in the Y direction is the same.

[0232] In control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL, the first subpixel R, the second subpixel G, and the third subpixel B are controlled so that the grayscale values ​​of the first subpixel R, the second subpixel G, and the third subpixel B located at y=0 and the grayscale values ​​of the first subpixel R, the second subpixel G, and the third subpixel B located at coordinates in the Y direction other than y=0 are both γ% of the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal of pixel PixU, where γ is a value greater than 0 and less than 100. For example, the first subpixel R, the second subpixel G, and the third subpixel B may be controlled so that the grayscale values ​​of the first subpixel R, the second subpixel G, and the third subpixel B located at y=0 and the grayscale values ​​of the first subpixel R, the second subpixel G, and the third subpixel B located at coordinates in the Y direction other than y=0 are both the grayscale values ​​of red (R), green (G), and blue (B) indicated by the pixel signal of pixel PixU. In this case, γ = 100. Thus, in control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL, in the light transmission area formed by the sub-pixels controlled to transmit light in accordance with the pixel signal, the degree of light transmission of each of two pixels Pix adjacent in the Y direction is the same.

[0233] Figure 29 This shows that the reference Figure 28 A schematic diagram showing the positional relationship among the luminous point LP, the pixel PixU, and the viewpoint EE in the case of the sub-pixel control mode described above. Figure 29 The "Scenario 13" shown will refer to Figure 27 The control mode PaH applied in the "Case 11" described above is replaced by the control mode PcH. Figure 27 The control mode PaH applied in the described “Case 12” is replaced with the control mode PcH.

[0234] Figure 29 The light RGB13 shown in "Case 13" can ensure the reference Figure 27 The brightness of the light RGB11 in the described "Case 11" is greater than that in the "Case 11". Figure 30 The light RGB14 shown in "Case 14" is different from the reference light because the control mode of the applied sub-pixel is changed to the control mode PcH. Figure 27 The light RGB12 of the described "Case 12" is different from that of the light RGB11 of the "Case 11". Figure 29As shown in "Case 13" and "Case 14," even if the viewpoint EE shifts from position idp11 to position idp12, the brightness of the light reaching the viewpoint EE remains the same. That is, both light RGB13 and light RGB14 include light RGBH but not light RGBL. Furthermore, the Y-direction width of the light emitting point LP, which serves as the basis for both light RGB13 and light RGB14, is the same as width SSy1. Therefore, it can be said that light RGB13 and light RGB14 have the same brightness in the Y direction.

[0235] As reference Figure 28 and Figure 29 As described above, by increasing the number of pixels Pix controlled to transmit light, it is possible to suppress a decrease in brightness.

[0236] When the control modes PcA, PcB, PcC, PcD, PcI, PcJ, PcK, and PcL are applied, the sub-pixels are controlled to transmit light according to the pixel signal assigned to the pixel PixU, thereby forming a transmissive area having a Y-direction width twice that of the pixel Pix (for example, see Figure 31 It should be noted that the transmission area in the embodiment is also a transmission area having a width in the X direction twice that of the pixel Pix (for example, see Figure 26 Next, refer to Figure 30 and Figure 31 An example of the relationship between the width of the light-emitting point LP in the Y direction and the viewing angle will be described.

[0237] Figure 30 2 is a schematic diagram showing an example of the relationship between the display panel 20A and two viewpoints E1 and E2 and the viewing angles with respect to each viewpoint E1 and E2. Figure 30 In the example shown, viewpoint E1 and viewpoint E2 are symmetrically positioned in the Y direction with respect to the axis Zb passing through the intermediate point CP and the focal object FP. The axis Zb is inclined 1.5 degrees toward viewpoint E2 relative to the Z direction. The side of viewpoint E1 relative to the axis Zb is set to one side of the Y direction (the negative (-) side). The side of viewpoint E2 relative to the axis Zb is set to the other side of the Y direction (the positive (+) side). Figure 30 In the example shown, the line of sight from viewpoint E1 toward the focal object FP is inclined by -4.5 degrees (°) relative to the axis Zb. The line of sight from viewpoint E2 toward the focal object FP is inclined by 4.5 degrees (°) relative to the axis Zb.

[0238] exist Figure 30In the example shown, the range AN3 of ±1.5 degrees (°) centered on the line of sight is shown as a range where no brightness reduction occurs. In addition, the range AN4 of ±3 degrees (°) sandwiched between the range AN3 is shown as a range where the image facing each viewpoint can be visually recognized, although brightness reduction occurs. Such ranges AN3 and AN4 are, for example, the range where reference is applied. Figure 28 and Figure 29 The range of the sub-pixel control mode is described.

[0239] Figure 31 Reference Figure 30 The width of the light emitting point LP in the Y direction within the range AN3 described above is the same as the width of the reference Figure 28 and Figure 29 A schematic diagram showing the relationship between the control modes of the sub-pixels described. Figure 28 and Figure 29 In the described subpixel control mode, the light transmission area, controlled based on the pixel signal assigned to pixel PixU, has a Y-direction width equivalent to two pixels Pix. Therefore, from the lines of sight CL11 and CL12 corresponding to the positions of viewpoints E1 and E2 acquired by the acquisition unit (e.g., the imaging unit 2, the ranging unit 3, the gyro sensor 4, and the line of sight tracking unit 11), edges EM3 ​​and EM4 corresponding to one subpixel are generated toward one side in the Y direction, and edges EP3 and EP4 corresponding to two subpixels are generated toward the other side in the Y direction.

[0240] exist Figure 31 In the example shown, if the range is between the line CL13 on one side of the line CL11 in the Y direction and the line CL14 on the other side of the line CL11 in the Y direction, it is possible to visually recognize an image that is substantially the same as the image at the viewpoint E1 located at the line CL11. Figure 30 The range AN3 of the viewpoint E1 described above corresponds to this range. In addition, if the range is between the line CL15 on one side of the line CL12 in the Y direction and the line CL16 on the other side of the line CL12 in the Y direction, it is possible to visually confirm an image that is substantially the same as that of the viewpoint E2 located at the line CL12. The relevant range is the same as the reference range. Figure 30 The range AN4 of the viewpoint E2 described above corresponds.

[0241] It should be noted that even from the outside of the edge parts EM3, EM4, EP3, EP4, if the reference Figure 30 Within the range AN4 described above, although a decrease in brightness occurs, images for each viewpoint can be output.

[0242] It should be noted that the width SS of the light emitting point LP in the X direction, that is, the width SSx1 corresponds to the pixel width PPx (refer to Figure 21 ). In addition, the width of the light emitting point LP in the Y direction, that is, the width SSy1 corresponds to the pixel width PPy (refer to Figure 27 ). Below, refer to Figure 32 and Figure 33 The corresponding relationship between the pixel width PPx and the pixel width PPy will be described.

[0243] Figure 32 and Figure 33 1 is a schematic diagram showing a comparison between pixel width PPx and pixel width PPy and an example of sub-pixel arrangement. The pixel width PPx is preferably greater than the pixel width PPy. For example, the pixel width PPx can be as follows: Figure 32 As shown, the pixel width PPy is exceeded, and the pixel width PPx can also be as shown. Figure 33 The pixel width PPy is shown to be the same as that of the pixel width PPy.

[0244] In addition, if Figure 32 and Figure 33 As shown, sub-pixels of different colors may be adjacent in the Y direction. It should be noted that when sub-pixels of different colors are adjacent in the Y direction, a configuration is formed in which one of the first sub-pixel R, the second sub-pixel G, and the third sub-pixel B is sandwiched, and the other two are opposite in the Y direction. Of course, it is also possible to refer to Figure 16 As described above, sub-pixels of the same color are arranged in the Y direction.

[0245] It should be noted that, although matters related to the X direction and matters related to the Y direction are described separately, in the embodiment, both technical features related to the X direction and technical features related to the Y direction may be included.

[0246] Next, refer to Figure 34 The concept for determining the distance Th when designing the display device will be described.

[0247] Figure 34 Schematic diagram showing the distance Th defined so that the ratio of the value of the distance D1 to the value obtained by adding the distance Ph and the distance Th is equal to the ratio of the value of the distance Th to the value of the distance D. Figure 34The distance D in is the distance between the intersection of the center line of the pixel Pix in the Z direction and the ray LQ and the midpoint CP in the X direction. The ray LQ is a ray of light that reaches a viewpoint (for example, the second viewpoint E2) at a distance D1 relative to the midpoint CP in the X direction, and is a ray of light emitted from a light-emitting point LP (for example, the light-emitting point 32) at a position opposite to the midpoint CP in the Z direction, wherein the midpoint CP is at a distance Ph from the pixel Pix in the Z direction. In addition, the straight line connecting the center of the light-emitting point that is the starting point of the ray LQ and the midpoint CP is parallel to the Z direction (perpendicular to the XY plane). In such a Figure 34 In the equation (25), the following ratio is established: D in the equation (25) is the value of the distance D.

[0248] (Th+Ph):D1=Th:D…(25)

[0249] Based on the above formula (25), the following formula (26) holds.

[0250] D×(Th+Ph)=D1×Th…(26)

[0251] Based on the above formula (26), the following formula (27) holds.

[0252] (D1-D)×Th=D×Ph…(27)

[0253] Based on the above equation (27), the following equation (28) holds. As shown in equation (28), the value of the distance Th can be derived based on the value (pos_h) of the distance Ph, the value of the distance D1, and the value of the distance D.

[0254] Th=Ph×D / (D1-D)…(28)

[0255] The value of distance Ph can be set to a value generally assumed to be the distance between a user who visually recognizes the image on display device 1 and display device 1. For example, when display device 1 is provided on a mobile terminal such as a smartphone, 30 cm (300 mm) is assumed as distance Ph. The value of distance D1 can be set to 1 / 2 of the average value of the distance between a person's eyes (distance D2). To give a specific example, assume that D2 = 62.5 mm, that is, D1 = 31.25 mm. Of course, these values ​​of distance Ph and distance D1 are merely examples and are not limited to these, and can be appropriately changed.

[0256] The value of the distance D can be derived from the relationship between the pitch of the light-emitting points LP (e.g., the light-emitting point pitch SpP, the light-emitting point pitch SpP2, etc.) and the pixel pitch PP. For example, if the relationship between the pitch of the light-emitting points LP and the pitch of the pixels Pix is ​​6n:1, then Figure 34As shown, it is assumed that distance D is set to approximately 1.5n times the pixel pitch PP {D = (1.5n) PP}. Furthermore, if the relationship between the pitch of the light-emitting points LP and the pitch of the pixels Pix is ​​4n:1, it is assumed that distance D is set to approximately the same as the pixel pitch PP (D = nPP). Therefore, distance Th can be derived based on the values ​​of distance Ph and distance D1 assumed above, as well as the relationship between the pitch of the light-emitting points LP and the pitch of the pixels Pix and the pixel pitch PP. By adjusting the Z-direction thickness of the components included in the spacer 40 based on the thus derived distance Th, a display panel 20 corresponding to distance Th corresponding to the assumed conditions can be realized. Furthermore, the same concept can be used to derive distances D and Th for the display panel 20A. It should be noted that while these distances Ph and distance D1 are expected to differ slightly from the distances defined in the above design due to actual usage and individual user differences, it goes without saying that a display device manufactured based on the above design has margins to accommodate these slight variations in usage.

[0257] As an example, in the reference Figure 34 With the above-described arrangement and sizes of the components, if the pixel width PPx is 0.03 mm and the width of one sub-pixel in the X direction is 0.01 mm, the width SSx1 is approximately 0.0315 mm. Furthermore, in this case, if the pixel width PPx is 0.01 mm, the width SSy1 is approximately 0.0315 mm.

[0258] It should be noted that the pixel width PPx, or "the width in the X direction equivalent to one pixel Pix," can be determined, for example, based on the X-direction midpoint of the non-transparent portion (black matrix) that divides pixels Pix arranged in the X direction. For example, in the case where a pixel Pix includes three sub-pixels, as in the embodiment, the X-direction width between the first midpoint and the second midpoint, described below, can be considered the X-direction width of one pixel Pix. The first midpoint is the X-direction midpoint that divides the non-transparent portion of the sub-pixel located at one end of the pixel Pix (e.g., the first sub-pixel R) and the adjacent sub-pixel of the other pixel Pix (e.g., the third sub-pixel B). The second midpoint is the X-direction midpoint that divides the non-transparent portion of the sub-pixel located at the other end of the pixel Pix (e.g., the third sub-pixel B) and the adjacent sub-pixel of the other pixel Pix (e.g., the first sub-pixel R). Based on the same idea, the pixel width PPy, or "the width in the Y direction equivalent to one pixel Pix," can be determined, for example, based on the Y-direction center position of the non-transparent portion (black matrix) that divides the pixels Pix arranged in the Y direction. Alternatively, the center spacing between adjacent pixels in the X direction can be defined as the pixel pitch in the X direction, and the pixel pitch in the X direction can be defined as the pixel width PPx. In this case, the pixel width PPx × 1 / 3 can be defined as the width of the sub-pixel in the X direction. Similarly, the center spacing between adjacent pixels in the Y direction can be defined as the pixel pitch, and the pixel pitch can be defined as the pixel width PPy. In this case, the pixel width PPy × 1 / 2 can be defined as the width of the sub-pixel in the Y direction.

[0259] It should be noted that the derivation of the value of distance Th based on equation (28) does not take into account the refraction of light occurring at the interface between the air and display panel 20 between the display panel 20 and the user. Therefore, by further considering the effect of such refraction on light rays when determining distance Th, crosstalk can be suppressed with greater precision.

[0260] According to an embodiment, a display device 1 includes a liquid crystal display panel (e.g., display panel 20 or display panel 20A) provided with a plurality of pixels (e.g., pixel Pix) and a light source (e.g., light source 30) provided with a plurality of light-emitting points (light-emitting points LP, light-emitting points 32 as a specific example) and irradiating light to the plurality of pixels of the liquid crystal display panel. The ratio of the pitch of the plurality of pixels arranged in a first direction (e.g., X direction) to the pitch of the plurality of light-emitting points arranged in the first direction is 1:4n or 1:6n (e.g., 1:6), where n is a natural number, and the pixels included in the first direction are A plurality of sub-pixels (e.g., first sub-pixel R, second sub-pixel G, and third sub-pixel B) arranged in a first direction, located on a ray of light between a user's viewpoint directed toward the image display surface of the liquid crystal display panel and a light-emitting point, and controlled to transmit light, are arranged continuously in the first direction with sub-pixels controlled to transmit light included in pixels other than the pixel, forming a transmissive region (transmissive region TRx2). The width of the transmissive region in the first direction is twice the width of the pixel in the first direction (width SSx1). This makes it easier for the user to visually recognize an image of sufficient brightness even when positional shifts occur in the first direction, compared to a case where the width of the light-emitting point in the first direction is less than the width of the pixel in the first direction. Consequently, according to this embodiment, image quality degradation is more easily suppressed.

[0261] Furthermore, multiple pixels (e.g., pixels Pix) are arranged in a matrix along a first direction (e.g., the X direction) and a second direction orthogonal to the first direction (e.g., the Y direction). The ratio of the pitch of the multiple pixels arranged in the second direction to the pitch of the multiple light-emitting points (light-emitting points LP, specifically light-emitting points 32) arranged in the second direction is 1:4n or 1:6n (e.g., 1:6). The width of a single transmissive region (transmissive region TRy2) in the second direction is twice the width of the pixel in the second direction. This allows for more reliable display and output of separate images for multiple viewpoints. In other words, even when the arrangement direction of the user's multiple viewpoints (the right and left eye viewpoints) does not correspond to the pre-defined horizontal direction (e.g., the X direction) of the liquid crystal display panel, separate images for the multiple viewpoints can still be displayed and output. Therefore, according to this embodiment, the relationship between the arrangement direction of the multiple viewpoints and the display device 1 can be more flexibly addressed.

[0262] Furthermore, the width of a single transmissive region (transmissive region TRy2) in the second direction (e.g., the Y direction) is equivalent to that of two pixels (e.g., pixel Pix). Within this single transmissive region, the degree of light transmission is the same for two adjacent pixels in the second direction. This allows the user to easily visually recognize an image of sufficient brightness even when there is positional displacement in the second direction. Consequently, according to this embodiment, image quality degradation is more easily suppressed.

[0263] The device also includes an acquisition unit (e.g., imaging unit 2, ranging unit 3, gyro sensor 4, and gaze tracking unit 11) for acquiring viewpoint information of a user visually viewing a liquid crystal display panel (e.g., display panel 20 or display panel 20A), and a control unit (e.g., image output unit 12) for controlling the display of an image through the operation of multiple pixels based on this viewpoint information. This viewpoint information includes information (e.g., pos_x, pos_y, pos_h) related to the positions of multiple viewpoints (e.g., first viewpoint E1 and second viewpoint E2, first viewpoint EC and second viewpoint ED, etc.), as well as information indicating the arrangement direction of these multiple viewpoints (relative angle rot). Based on the angle (relative angle rot) between a predetermined direction (e.g., the X direction) in the liquid crystal display panel and this arrangement direction, as well as the positional relationship between the viewpoints and the light-emitting points, the control unit drives at least pixels (including pixels Pix at the through point UP) located on a straight line connecting each light-emitting point and each viewpoint to transmit light, and controls the transmission area to include the pixels being driven for display. The ratio of the pitch of the multiple pixels arranged in the specified direction to the pitch of the multiple light-emitting points arranged in the specified direction is 1:4n or 1:6n (for example, 1:6), where n is a natural number. This allows the display of the multiple pixels to correspond to the angle between the specified direction and the arrangement direction in the liquid crystal display panel, as well as the positional relationship between the viewpoints and the light-emitting points. Even if this angle is not zero, that is, if the arrangement direction of the user's multiple viewpoints (the right and left viewpoints) does not correspond to the pre-defined horizontal direction of the liquid crystal display panel (for example, the X direction), it is still possible to display and output separate images for the multiple viewpoints. Therefore, according to this embodiment, the relationship between the arrangement direction of the multiple viewpoints and the display device 1 can be more flexibly addressed.

[0264] Furthermore, the acquisition unit includes a capture unit (e.g., capture unit 2) for capturing the user, and a processing unit (e.g., gaze tracking unit 11). Based on the captured image of the user, the processing unit determines the alignment direction of the right and left eyes, the relative rotation angle of the liquid crystal display panel relative to the alignment direction, and the positional relationship of the user's right and left eyes. Thus, the user's viewpoint information can be acquired from the image captured by capturing the user.

[0265] Furthermore, a pixel (e.g., pixel Pix) consists of multiple sub-pixels. The control unit (e.g., image output unit 12) displays and drives a sub-pixel located on a straight line connecting each luminous point and each viewpoint, as well as some or all of the other sub-pixels adjacent to that sub-pixel. This allows for display output corresponding to that position on a sub-pixel basis. This allows for more detailed display output corresponding to the viewpoint position than when using pixels.

[0266] Furthermore, the control unit (e.g., image output unit 12) allows light to be transmitted from sub-pixels located closer to the intersection of the optical axis between the viewpoint and the light-emitting point and the sub-pixel, among sub-pixels included in other pixels adjacent to a pixel including a sub-pixel located at a position intersecting the optical axis between the viewpoint and the light-emitting point (a position passing through point UP). This enables display output corresponding to the position with higher precision.

[0267] Furthermore, the acquisition unit includes a distance measuring unit (e.g., distance measuring unit 3) that measures the distance between the liquid crystal display panel (e.g., display panel 20 or display panel 20A) and the user. This includes the distance between the liquid crystal display panel and the user in the user's viewpoint information. This enables display output that more accurately corresponds to the viewpoint position.

[0268] Furthermore, the control unit (e.g., image output unit 12) changes the pixels (e.g., pixel Pix) driven for display based on the alignment of the liquid crystal display panel (e.g., display panel 20 or display panel 20A) and the user's right and left eyes, as determined by the processing unit (e.g., gaze tracking unit 11). As a result of this "change," for example, the display mode may differ when the relative angle rot is 45 degrees (°) versus when the relative angle rot is an angle other than 45 degrees (e.g., 90 degrees (°)).

[0269] It should be noted that the configuration of the display device 1 described above is ultimately only one example of an embodiment and is not limited thereto. For example, a point light source may be provided at the location of the light-emitting point LP. That is, the specific configuration of the light-emitting point LP may also be a point light source. This point light source may be, for example, a tiny LED called a mini LED or a micro LED, but is not limited thereto and may also be a point light source implemented by other light-emitting elements (such as an OLED: Organic Light Emitting Diode). In the case of providing a point light source at the location of the light-emitting point LP, the light source 30 may, for example, be configured to include a plurality of point light sources and a substrate on which the plurality of point light sources are mounted.

[0270] It should be pointed out that in the various figures referred to in the above description, although examples of the relative angle rot being 0 degrees (°), 45 degrees (°), and 90 degrees (°) are specifically described, the relative angle rot is not limited to these angles and can be any angle within the range of -180 degrees (°) to 180 degrees (°) depending on the relationship between the display panel 20A and the facial HF.

[0271] In addition, Figures 8 to 34 In the description, although the correspondence relationship between the pitch of the plurality of pixels Pix and the pitch of the plurality of light emitting points LP is 1:6, the reference Figures 8 to 34 The various controls described are as follows Figure 3 and Figure 34 As shown, this can also be applied to the case where the correspondence is 1:4. Alternatively, the correspondence can be 1:6α or 1:4α. α is a natural number. Furthermore, the center position of the luminous point LP is not limited to the position between two adjacent pixels Pix in a planar viewpoint. For example, the center position of the luminous point LP and the center position of the pixel Pix may overlap, or they may have other positional relationships.

[0272] The form and number of sub-pixels provided in the pixel Pix are not limited to those in FIG. Figure 16 The number of sub-pixels provided in a pixel Pix may be 2 or less, or 4 or more. Furthermore, the arrangement of sub-pixels provided in a pixel Pix is ​​not limited to being arranged along the X direction, but may also be arranged along the Y direction or in a matrix. Furthermore, the shape of the sub-pixels in a planar viewpoint is not limited to being rectangular, but may be any shape.

[0273] In addition, regarding other effects brought about by the method described in this embodiment, as long as they are obvious from the description of this specification or can be appropriately imagined by those skilled in the art, they should of course be understood as brought about by this disclosure.

[0274] Description of Reference Numerals

[0275] 1: Display device, 2: Shooting unit, 3: Distance measuring unit, 10: Signal processing unit, 20, 20A: Display panel, Pix: Pixel, E1, EC: First viewpoint, E2, ED: Second viewpoint, ER, EL, EE: Viewpoints, TRx2, TRy2: Transmission area.

Claims

1. A display device comprising: a liquid crystal display panel having a plurality of pixels; and a light source having a plurality of light-emitting points and irradiating light to a plurality of pixels of the liquid crystal display panel; The ratio of the pitch of the plurality of pixels arranged in the first direction to the pitch of the plurality of light emitting points arranged in the first direction is 1:4n or 1:6n, n is a natural number, The pixel includes a plurality of sub-pixels arranged in the first direction, The pixel controlled to transmit light and sub-pixels controlled to transmit light included in pixels other than the pixel are arranged continuously in the first direction to form a transmission area. The width of one of the transmission areas in the first direction is twice the width of the pixel in the first direction.

2. The display device according to claim 1, wherein The plurality of pixels are arranged in a matrix along the first direction and a second direction orthogonal to the first direction. The ratio of the pitch of the plurality of pixels arranged in the second direction to the pitch of the plurality of light emitting points arranged in the second direction is 1:4n or 1:6n, The width of one of the transmission areas in the second direction is twice the width of the pixel in the second direction.

3. The display device according to claim 2, wherein: The width of one of the transparent areas in the second direction is equivalent to two pixels. In one of the transmission areas, two pixels adjacent to each other in the second direction have the same degree of light transmission.

4. The display device according to any one of claims 1 to 3, wherein: The display device comprises: an acquiring unit, configured to acquire the viewpoint information of the user; and a control unit that controls display of an image by movement of the plurality of pixels based on the viewpoint information; The viewpoint information includes information related to the positions of the plurality of viewpoints and information indicating the arrangement directions of the plurality of viewpoints. The control unit causes the transparent area to include at least pixels located on a straight line connecting each light-emitting point and each viewpoint based on a relative rotation angle of the liquid crystal display panel with respect to the arrangement direction and a positional relationship between the viewpoint and each light-emitting point.

5. The display device according to claim 4, wherein The acquisition unit includes: a photographing unit, configured to photograph the user; and The processing unit determines the arrangement direction, the relative rotation angle, and the positional relationship for the right eye and the left eye of the user based on the captured image of the user.