Display apparatus and display system

Abstract

A display apparatus 1 comprises: a display panel 10 having a display area DA; a light source device 40 that emits, to the display panel 10, first light of a first color, second light of a second color, and third light of a third color in the stated order; a line-of-sight detection sensor 30 that detects a line of sight of a user; and a drive circuit 20 that displays an image in the display area DA. The drive circuit 20: displays a first color image G1 of the first color, a second color image G2 of the second color, and a third color image G3 of the third color in the stated order; estimates, on the basis of the detection result of the line-of-sight detection sensor 30, a viewpoint of the user when displaying the first color image G1, the second color image G2, and the third color image G3; and adjusts the positions of the first color image G1, the second color image G2, and the third color image G3, on the basis of the positional relationship with the viewpoint of the user.

Description

Display device and display system

[0001] The present disclosure relates to a display device and a display system.

[0002] Patent Document 1 discloses an image display device (display device) that displays images using a field sequential color system. The display device of Patent Document 1 controls the display order of multiple color field images for display using the field sequential color system based on the luminance distribution on the observer's retina. This suppresses the occurrence of color breakup, which is a visual afterimage of the field images.

[0003] JP 2010-276966 A

[0004] The color breakup may occur when, for example, the viewer's line of sight moves. There is a demand for further suppression of the occurrence of color breakup in display devices.

[0005] The present disclosure aims to suppress the occurrence of color breakup in a display device that displays images using a field sequential color system.

[0006] A display device according to the present disclosure includes a display panel having a display area, a light source device that emits first light of a first color, second light of a second color, and third light of a third color to the display panel in this order within one frame, a gaze detection sensor that detects a user's gaze, and a drive circuit that displays an image in the display area based on an image signal, wherein the drive circuit generates a first color image corresponding to the first color, a second color image corresponding to the second color, and a third color image corresponding to a third color based on the image signal, and displays the first color image when the first light is emitted, displays the second color image when the second light is emitted, and displays the third color image when the third light is emitted. In addition, the position of the user's viewpoint in the display area is identified based on the detection results of the gaze detection sensor, and the identified position of the user's viewpoint is used to estimate the positions of a first viewpoint which is the user's viewpoint in the display area when the first color image is displayed, a second viewpoint which is the user's viewpoint in the display area when the second color image is displayed, and a third viewpoint which is the user's viewpoint in the display area when the third color image is displayed, and the positions of the first color image, the second color image, and the third color image relative to the display area are adjusted based on the positional relationship between the first viewpoint, the second viewpoint, and the third viewpoint.

[0007] FIG. 1 is a perspective view of a display device according to an embodiment of the present disclosure. FIG. 2 is a cross-sectional view of the display device. FIG. 3 is a diagram illustrating a circuit configuration of a display panel. FIG. 4 is a cross-sectional view of the display panel. FIG. 5 is a diagram illustrating an example of an input image. FIG. 6 is a diagram illustrating a first-color image corresponding to the input image shown in FIG. 5. FIG. 7 is a diagram illustrating a second-color image corresponding to the input image shown in FIG. 5. FIG. 8 is a diagram illustrating a third-color image corresponding to the input image shown in FIG. 5. FIG. 9 is a diagram illustrating the operation of a drive circuit and a light source device when an image is displayed on a display panel. FIG. 10 is a diagram illustrating an example of an image visually recognized by a user when color breakup occurs. FIG. 11 is a flowchart executed by an image processing circuit. FIG. 12 is a diagram illustrating an example of the position of a gaze point when a color image is displayed. FIG. 13A is a diagram illustrating the shift in the X direction for the multiple gaze points shown in FIG. 12. FIG. 13B is a diagram illustrating the shift in the Y direction for the multiple gaze points shown in FIG. 12. FIG. 14 is a flowchart executed by an image processing circuit. FIG. 15 is a diagram illustrating a second-color image whose position relative to the display area has been adjusted. Fig. 16 is a diagram showing a first color image whose position relative to the display area has been adjusted. Fig. 17 is a diagram showing a third color image whose position relative to the display area has been adjusted. Fig. 18 is a perspective view of a display system according to an embodiment of the present disclosure. Fig. 19 is a schematic diagram showing a configuration of the display system. Fig. 20 is a block diagram of the display system. Fig. 21 is a flowchart executed by a drive circuit when a color image is displayed in a display device included in the display system.

[0008] Each embodiment of the present disclosure will be described below with reference to the drawings. The present disclosure is not limited to the contents described in the following embodiments. Furthermore, the components described below include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the components described below can be combined as appropriate.

[0009] It should be noted that the disclosure is merely an example, and appropriate modifications that a person skilled in the art can easily conceive of while maintaining the gist of the present disclosure are naturally included within the scope of the present disclosure. Furthermore, in order to clarify the explanation, the drawings may show the width, thickness, shape, etc. of each part schematically compared to the actual embodiment, but these are merely examples and do not limit the interpretation of the present disclosure. Furthermore, in this specification and each drawing, elements similar to those described above with respect to the previous drawings may be given the same reference numerals, and detailed descriptions may be omitted as appropriate.

[0010] The X and Y directions shown in the drawings correspond to directions parallel to the plate surfaces of the substrates included in the display device 1. The +X and -X sides of the X direction and the +Y and -Y sides of the Y direction correspond to the sides of the display device 1. The Z direction corresponds to the thickness direction of the display device 1, the +Z side of the Z direction corresponds to the front side on which an image is displayed on the display device 1, and the -Z side of the Z direction corresponds to the rear side of the display device 1. Furthermore, in this specification, "planar view" means viewing the display device 1 from the +Z side toward the -Z side along the Z direction. Furthermore, the X, Y, and Z directions are merely examples, and the present disclosure is not limited to these directions.

[0011] <Display Device 1> Fig. 1 is a perspective view of a display device 1 according to an embodiment of the present disclosure. Fig. 2 is a cross-sectional view of the display device 1.

[0012] The display device 1 displays an image based on an image signal output from an external device (not shown) connected by wire or wirelessly. The display device 1 includes a display panel 10, a drive circuit 20, a gaze detection sensor 30, and a light source device 40.

[0013] The display panel 10 is a transmissive liquid crystal display. The display panel 10 may be, for example, a projection display using a reflective liquid crystal and a digital mirror device (DMD), an organic electroluminescence (EL) display, or an inorganic electroluminescence (EL) display. The display panel 10 is a rectangular plate in a planar view, and has a display area DA on its front surface, where an image is displayed. The display area DA is rectangular in a planar view, and has a reference point Ds at its center. The reference point Ds may be located elsewhere, for example, on the periphery of the display area DA. The display panel 10 has a plurality of pixels P arranged in a matrix along the X and Y directions in the display area DA.

[0014] 3 is a diagram showing the circuit configuration of the display panel 10. The display panel 10 includes a switching element SW, a pixel electrode PE, a common electrode CE, a liquid crystal capacitance LC, and a storage capacitance CS, each of which is provided in a plurality of pixels P. An IC chip Ti is disposed on a first substrate 11 (described later) of the display panel 10 shown in FIG. 1. A control substrate CPC is electrically connected to the first substrate 11 via a flexible substrate FPC. A drive circuit 20 is disposed on the IC chip Ti and the control substrate CPC.

[0015] The drive circuit 20 displays an image in the display area DA based on an image signal transmitted from an external device. As shown in Figures 1 and 3, the drive circuit 20 includes an image processing circuit 21, a signal output circuit 22, and a scanning circuit 23. The image processing circuit 21 is disposed on a connected control board CPC. The signal output circuit 22 and the scanning circuit 23 are disposed on an IC chip Ti (Figure 1) included in the first substrate 11.

[0016] The image processing circuit 21 generates a plurality of pixel signals (described later) based on the image signal, and outputs the generated pixel signals to the signal output circuit 22. The image processing circuit 21 also outputs a clock signal to the signal output circuit 22 and the scanning circuit 23, which synchronizes the operation of the signal output circuit 22 with the operation of the scanning circuit 23.

[0017] The signal output circuit 22 outputs the plurality of pixel signals to the corresponding pixels P. As shown in Fig. 3, the signal output circuit 22 and the plurality of pixels P are electrically connected via a plurality of signal lines Lb extending along the Y direction.

[0018] The scanning circuit 23 scans the plurality of pixels P in synchronization with the output of pixel signals by the signal output circuit 22. The scanning circuit 23 and the plurality of pixels P are electrically connected via a plurality of scanning lines Lc extending along the X direction.

[0019] The switching element SW is formed of, for example, a thin film transistor (TFT). In the switching element SW, a source electrode and a signal line Lb are electrically connected, and a gate electrode and a scanning line Lc are electrically connected.

[0020] The pixel electrode PE is connected to the drain electrode of the switching element SW. A plurality of common electrodes CE are arranged corresponding to the plurality of scanning lines Lc. The pixel electrode PE and the common electrode CE are light-transmitting.

[0021] The liquid crystal capacitance LC is a capacitance component of the liquid crystal material of the liquid crystal layer 13, which will be described later, located between the pixel electrode PE and the common electrode CE. The storage capacitance CS is disposed between an electrode having the same potential as the common electrode CE and an electrode having the same potential as the pixel electrode PE.

[0022] 4 is a cross-sectional view of the display panel 10. The display panel 10 further includes a first substrate 11, a second substrate 12, and a liquid crystal layer 13. The first substrate 11, the liquid crystal layer 13, and the second substrate 12 are each light-transmitting and are arranged in this order from the -Z side to the +Z side along the Z direction. The first substrate 11 and the second substrate 12 are rectangular in plan view and are made of, for example, a resin such as polyethylene terephthalate or glass.

[0023] A common electrode CE is disposed on the front surface of the first substrate 11. An insulating layer IL is disposed on the front surface of the common electrode CE, and further, a pixel electrode PE and a first alignment film AL1 are disposed on the front surface of the insulating layer IL.

[0024] The pixel electrodes PE are disposed between the insulating layer IL and the first alignment film AL1. In this manner, the common electrode CE and the pixel electrodes PE are disposed on the first substrate 11. In other words, the display panel 10 is a lateral electric field liquid crystal display.

[0025] The second substrate 12 is located on the front side of the first substrate 11. A second alignment film AL2 is disposed on the back side of the second substrate 12. The alignment directions of the first alignment film AL1 and the second alignment film AL2 are parallel to each other. Note that the alignment directions of the first alignment film AL1 and the second alignment film AL2 may be perpendicular to each other. Note that the signal lines Lb and the scanning lines Lc are not shown in FIG. 4. The signal lines Lb and the scanning lines Lc are disposed on the front side of the first substrate 11.

[0026] The liquid crystal layer 13 is composed of a plurality of liquid crystal molecules LM. The liquid crystal layer 13 is located between the first substrate 11 and the second substrate 12, and overlaps with the display area DA in a planar view. Specifically, the liquid crystal layer 13 is located between a first alignment film AL1 and a second alignment film AL2. The orientation of the liquid crystal molecules LM is regulated by the first alignment film AL1 and the second alignment film AL2.

[0027] The display panel 10 also includes a first polarizer 14 disposed on the back surface of the first substrate 11, and a second polarizer 15 disposed on the front surface of the second substrate 12. The first polarizer 14 has a transmission axis perpendicular to the Z direction. The second polarizer 15 has a transmission axis perpendicular to the transmission axis of the first polarizer 14 and the Z direction. The front surface of the second polarizer 15 corresponds to the front surface of the display panel 10. The rear surface of the first polarizer 14 corresponds to the rear surface of the display panel 10.

[0028] The gaze detection sensor 30 shown in FIG. 1 is disposed on the display panel 10. The gaze detection sensor 30 detects the user's gaze using eye tracking technology. The detection results of the gaze detection sensor 30 are output to the image processing circuit 21. The gaze detection sensor 30 captures the movement of the user's eyeball at a predetermined frequency (e.g., 120 Hz). The captured data is output to the image processing circuit 21. The image processing circuit 21 detects the gaze direction at a predetermined cycle (e.g., 8.33 ms) and records the detection results as time-series data. The number of data items recorded in the image processing circuit 21 is the number (e.g., 120 items) for a predetermined time period (e.g., 1 second). The data is overwritten, starting with the oldest data, each time data captured by the gaze detection sensor 30 is output to the image processing circuit 21. Therefore, the image processing circuit 21 always holds the latest number of data items for a predetermined time period.

[0029] 1 and 2 emits light toward the display panel 10. The light source device 40 includes a light guide plate 41, a plurality of first light emitters 42a, a plurality of second light emitters 42b, a plurality of third light emitters 42c, a prism sheet 43, and a diffusion sheet 44. Hereinafter, when the first light emitters 42a, the second light emitters 42b, and the third light emitters 42c are described without distinction, they may be simply referred to as "light emitters 42."

[0030] In the light source device 40, the light guide plate 41, the prism sheet 43, and the diffusion sheet 44 are arranged in this order from the −Z side to the +Z side along the Z direction. The light emitter 42 is disposed to the side of the light guide plate 41.

[0031] The light guide plate 41 has a rectangular shape in a plan view. As will be described later, light is emitted from a front surface 41a of the light guide plate 41. A reflective sheet (not shown) is disposed on a rear surface 41b of the light guide plate 41.

[0032] The multiple light emitters 42 emit light toward the side surface 41c of the light guide plate 41. The light emitters 42 are, for example, LEDs (Light Emitting Diodes). The light from the light emitters 42 corresponds to the light from the light source device 40. The first light emitter 42a emits a first light of a first color. The second light emitter 42b emits a second light of a second color. The third light emitter 42c emits a third light of a third color. The first color, second color, and third color are different from one another, and the first color is red, the second color is green, and the third color is blue. It goes without saying that the first color, second color, and third color are not limited to the above colors.

[0033] The plurality of light emitters 42 are arranged facing a side surface 41 c of the light guide plate 41 that is orthogonal to the X direction. The plurality of light emitters 42 are arranged along the Y direction. Specifically, one first light emitter 42 a, one second light emitter 42 b, and one third light emitter 42 c aligned along the Y direction constitute one set of light emitters CL, and a plurality of sets of light emitters CL are aligned along the Y direction.

[0034] Light emitted from the light emitter 42 enters the light guide plate 41 from the side surface 41c, is reflected by the inside of the light guide plate 41 and the reflective sheet, and is emitted from the front surface 41a.

[0035] The prism sheet 43 refracts the light emitted from the light guide plate 41 in a direction such that the axis of the light is along the Z direction. The prism sheet 43 has a plurality of prisms 43a that extend along the Y direction and have a triangular cross section, facing the light guide plate 41. The plurality of prisms 43a may be disposed facing the diffusion sheet 44. The light emitted from the prism sheet 43 is incident on the diffusion sheet 44.

[0036] The diffusion sheet 44 diffuses the light emitted from the prism sheet 43. The light emitted from the diffusion sheet 44 is incident on the display panel 10. The light is diffused by the diffusion sheet 44, so that the viewing angle of the display panel 10 can be increased.

[0037] Next, a description will be given of the basic operation of the display device 1 when an image is displayed on the display panel 10. The display panel 10 displays an image in the display area DA by a field sequential color system.

[0038] When the image processing circuit 21 acquires an image signal from an external device, it generates a color image by separating the image contained in the image signal (hereinafter, sometimes referred to as the input image Gi) into each color emitted by the light-emitting element 42.

[0039] Specifically, the image processing circuit 21 generates color images by color-separating the acquired input image Gi according to the color of light from the light emitter 42. That is, the image processing circuit 21 generates a first-color image G1 corresponding to the first color (red) of the input image Gi, a second-color image G2 corresponding to the second color (green) of the input image Gi, and a third-color image G3 corresponding to the third color (blue) of the input image Gi. Note that when the first-color image G1, the second-color image G2, and the third-color image G3 are described without distinction, they will be simply referred to as "color images G."

[0040] 5 is a diagram showing an example of an input image Gi. The input image Gi shown in FIG. 5 is rectangular and has an input image point Di at its center. The image processing circuit 21 causes the reference point Ds (see FIG. 1) of the display area DA to overlap with the input image point Di. In this embodiment, when the input image point Di and the reference point Ds are located, the periphery of the input image Gi overlaps with the periphery of the display area DA.

[0041] The input image Gi has a circular line drawing portion Gia centered at the input image point Di. The input image Gi also has an inner region Gib inside the line drawing portion Gia and an outer region Gic outside the line drawing portion Gia. In the input image Gi, the color of the line drawing portion Gia is black, the color of the inner region Gib is white, and the color of the outer region Gic is gray. In this case, the gradation of the pixel P corresponding to the line drawing portion Gia is the minimum, the gradation of the pixel P corresponding to the inner region Gib is the maximum, and the gradation of the pixel P corresponding to the outer region Gic is smaller than the gradation corresponding to the inner region Gib.

[0042] When the image processing circuit 21 acquires the input image Gi shown in FIG. 5, it generates the following color image G.

[0043] 6 is a diagram showing a first color image G1 corresponding to the input image Gi shown in FIG. The first color image G1 is rectangular and has the same size as the input image Gi, and has a first image point Dg1 at its center, which corresponds to the input image point Di and the reference point Ds. The first color image G1 corresponds to the first color (red) of the input image Gi, and has a first line drawing portion G1a, a first inner region G1b, and a first outer region G1c, which correspond to the line drawing portion Gia, inner region Gib, and outer region Gic of the input image Gi. The gradation of the pixel P corresponding to the first line drawing portion G1a is the minimum, the gradation of the pixel P corresponding to the first inner region G1b is the maximum, and the gradation of the pixel P corresponding to the first outer region G1c is smaller than the gradation of the pixel P corresponding to the first inner region G1b.

[0044] 7 is a diagram showing a second-color image G2 corresponding to the input image Gi shown in FIG. The second-color image G2 is rectangular and has the same size as the input image Gi, and is centered at a second image point Dg2 corresponding to the input image point Di and the reference point Ds. The second-color image G2 corresponds to the second color (green) of the input image Gi, and has a second line drawing portion G2a, a second inner region G2b, and a second outer region G2c corresponding to the line drawing portion Gia, inner region Gib, and outer region Gic of the input image Gi. The gradation of the pixel P corresponding to the second line drawing portion G2a is the minimum, the gradation of the pixel P corresponding to the second inner region G2b is the maximum, and the gradation of the pixel P corresponding to the second outer region G2c is smaller than the gradation of the pixel P corresponding to the second inner region G2b.

[0045] 8 is a diagram showing a third-color image G3 corresponding to the input image Gi shown in FIG. The third-color image G3 has the same rectangular shape as the input image Gi and is centered at a third image point Dg3 corresponding to the input image point Di and the reference point Ds. The third-color image G3 corresponds to the third color (blue) of the input image Gi and has a third line drawing portion G3a, a third inner region G3b, and a third outer region G3c corresponding to the line drawing portion Gia, inner region Gib, and outer region Gic of the input image Gi. The gradation of the pixel P corresponding to the third line drawing portion G3a is the minimum, the gradation of the pixel P corresponding to the third inner region G3b is the maximum, and the gradation of the pixel P corresponding to the third outer region G3c is smaller than the gradation of the pixel P corresponding to the third inner region G3b.

[0046] The gradation of the pixel P corresponding to the first outer region G1c shown in Figure 6, the gradation of the pixel P corresponding to the second outer region G2c shown in Figure 7, and the gradation of the pixel P corresponding to the third outer region G3c shown in Figure 8 are all equal to each other.

[0047] The image processing circuit 21 also generates a pixel signal indicating the gradation of the pixel P. Information on the gradation of the pixel P corresponding to the input image Gi is included in the image signal. The image processing circuit 21 generates, for each of the multiple pixels P, a first pixel signal indicating the gradation of the pixel P corresponding to the first-color image G1, a second pixel signal indicating the gradation of the pixel P corresponding to the second-color image G2, and a third pixel signal indicating the gradation of the pixel P corresponding to the third-color image G3. When the first, second, and third pixel signals are not to be distinguished from one another, they will simply be referred to as "pixel signals."

[0048] Fig. 9 is a diagram showing the operation of the drive circuit 20 and the light source device 40 when an image is displayed on the display panel 10. In Fig. 9, the horizontal axis represents time, and the vertical axis represents the Y-direction positions of multiple pixels P in the display area DA. Fig. 9 shows the operation of the drive circuit 20 and the light source device 40 per frame F. The frame F has a first sub-frame SF1, a second sub-frame SF2, and a third sub-frame SF3, in this order.

[0049] In the first sub-frame SF1, a first-color image G1 corresponding to a first color (red) is displayed. Specifically, during the first scanning period TS1, the scanning circuit 23 scans multiple pixels P. The scanning circuit 23 scans the pixels P in order along the Y direction, from the pixel P furthest on the +Y side to the pixel P furthest on the −Y side. During the first scanning period TS1, the solid lines extending from the +Y side to the −Y side as time passes indicate that the scanning circuit 23 is scanning multiple pixels P (the same applies to the second scanning period TS2 and the third scanning period TS3, described below). The signal output circuit 22 outputs first pixel signals corresponding to the multiple pixels P. As a result, the voltages of the pixels P become voltages corresponding to the first pixel signals, and an electric field corresponding to the first pixel signals is generated in the liquid crystal layer 13, changing the orientation of the liquid crystal molecules LM. As a result, the light transmittance of the liquid crystal layer 13 is adjusted for each pixel P according to the grayscale of the pixel P indicated by the first pixel signal. The voltage applied to pixel P is maintained until it is updated by a second pixel signal in the second sub-frame SF2, as will be described later.

[0050] Subsequently, in the first light emission period TL1, the light source device 40 causes the first light emitter 42a to emit light. The first light of the first light emitter 42a enters the display panel 10 and is emitted from the display area DA with an intensity according to the light transmittance of the liquid crystal layer 13. As a result, the first color image G1 is displayed in the display area DA. That is, the first color image G1 is displayed in the first light emission period TL1.

[0051] In the second sub-frame SF2, a second-color image G2 corresponding to the second color (green) is displayed. Specifically, in the second scanning period TS2, the scanning circuit 23 scans multiple pixels P. The signal output circuit 22 outputs second pixel signals corresponding to the multiple pixels P. As a result, the voltage of the pixel P is updated to a voltage corresponding to the second pixel signal, and an electric field corresponding to the second pixel signal is generated in the liquid crystal layer 13, changing the orientation of the liquid crystal molecules LM. As a result, the light transmittance of the liquid crystal layer 13 is adjusted for each pixel P in accordance with the gradation of the pixel P indicated by the second pixel signal. The voltage applied to the pixel P is maintained until it is updated by a third pixel signal in the third sub-frame SF3, as described below.

[0052] Subsequently, in the second light emission period TL2, the light source device 40 causes the second light emitter 42b to emit light. The second light from the second light emitter 42b enters the display panel 10 and is emitted from the display area DA with an intensity according to the light transmittance of the liquid crystal layer 13. As a result, the second color image G2 is displayed in the display area DA. That is, the second color image G2 is displayed in the second light emission period TL2.

[0053] In the third sub-frame SF3, a third-color image G3 corresponding to a third color (blue) is displayed. Specifically, in the third scanning period TS3, the scanning circuit 23 scans a plurality of pixels P. The signal output circuit 22 outputs third pixel signals corresponding to the plurality of pixels P. As a result, the voltage of the pixel P is updated to a voltage corresponding to the third pixel signal, and an electric field corresponding to the third pixel signal is generated in the liquid crystal layer 13, changing the orientation of the liquid crystal molecules LM. As a result, the light transmittance of the liquid crystal layer 13 is adjusted for each pixel P in accordance with the gradation of the pixel P indicated by the third pixel signal. The voltage applied to the pixel P is maintained until it is updated by the first pixel signal in the first sub-frame SF1 of the next frame F.

[0054] Subsequently, in a third light emission period TL3, the light source device 40 causes the third light emitter 42c to emit light. The third light from the third light emitter 42c enters the display panel 10 and is emitted from the display area DA with an intensity according to the light transmittance of the liquid crystal layer 13. As a result, a third-color image G3 is displayed in the display area DA. That is, the third-color image G3 is displayed in the third light emission period TL3.

[0055] The duration of one frame F is determined as the time during which the light resulting from the combination of the first light, second light, and third light emitted from the display area DA in one frame F is perceived by the human eye. In other words, the human eye perceives light of a color and gradation resulting from the combination of the first color, second color, and third color. Therefore, by displaying the first-color image G1, the second-color image G2, and the third-color image G3 in this order as described above, the user views an image resulting from the combination of the first-color image G1, the second-color image G2, and the third-color image G3. In other words, the image viewed by the user corresponds to the input image Gi.

[0056] In such a display device 1, color breakup, which will be described next, may occur.

[0057] For example, when the image shown in FIG. 5 is displayed in the display area DA, assume that the position of the user's viewpoint (hereinafter sometimes referred to as the point of gaze) on the display area DA moves in the order of a first position Po1, a second position Po2, and a third position Po3 shown in FIG. 5. The first position Po1 is located on the −X side of the second position Po2 along the X direction. The second position Po2 coincides with the input image point Di. The third position Po3 is located on the +X side of the second position Po2 along the X direction. Hereinafter, the direction from the first position Po1 toward the second position Po2 will be referred to as a first movement direction Wo1, the direction from the second position Po2 toward the third position Po3 will be referred to as a second movement direction Wo2, the distance between the first position Po1 and the second position Po2 will be referred to as a first movement distance Lo1, and the distance between the second position Po2 and the third position Po3 will be referred to as a second movement distance Lo2.

[0058] In addition, suppose that the gaze point is located at a first position Po1 when the first color image G1 is displayed, the gaze point is located at a second position Po2 when the second color image G2 is displayed, and the gaze point is located at a third position Po3 on the input image Gi when the third color image G3 is displayed, in which case color breakup occurs, in which the user visually perceives afterimages of the first color image G1, the second color image G2, and the third color image G3.

[0059] 10 is a diagram showing an example of an image visually recognized by a user when color breakup occurs, in which a first color image G1 is indicated by a dashed line, a second color image G2 is indicated by a solid line, and a third color image G3 is indicated by a dashed double-dashed line.

[0060] When the gaze point moves as described above, the position of the color image G is recognized as the position of the second image point Dg2, which corresponds to the average position of the gaze movement during display. Specifically, the first color image G1 is visually recognized by the user in a state where the first image point Dg1 is shifted relative to the second image point Dg2 of the second color image G2 along a first shift direction Wz1, which is the same direction as the first movement direction Wo1 shown in Fig. 5. Furthermore, the third color image G3 is visually recognized by the user in a state where the third image point Dg3 is shifted relative to the second image point Dg2 of the second color image G2 along a second shift direction Wz2, which is the opposite direction to the second movement direction Wo2 shown in Fig. 5.

[0061] The first shift amount Lz1, which is the shift amount between the first color image G1 and the second color image G2 visually recognized by the user, is approximately equal to the first movement distance Lo1 shown in Fig. 5, and the second shift amount Lz2, which is the shift amount between the second color image G2 and the third color image G3 visually recognized by the user, is approximately equal to the second movement distance Lo2 shown in Fig. 5. Furthermore, the second color image G2 is visually recognized by the user in a state where the second image point Dg2 coincides with the reference point Ds of the display area DA.

[0062] In this case, in areas where the first inner region G1b, the second inner region G2b, and the third inner region G3b of the first color image G1, the second color image G2, and the third color image G3 do not overlap, the user sees colors other than white and gray that the input image Gi has (for example, the first color, the second color, and the third color, and a color obtained by combining two of the first color, the second color, and the third color).

[0063] Therefore, the drive circuit 20 suppresses the occurrence of the above-mentioned color breakup. Hereinafter, the operation of the drive circuit 20 to suppress the occurrence of color breakup will be described for a case in which the drive circuit 20 acquires the input image Gi shown in Fig. 5 above in the frame F next to the current frame F (hereinafter, may be referred to as "next frame F"), and when the first color image G1, the second color image G2, and the third color image G3 are displayed, the position of the gaze point moves from the first position Po1 to the second position Po2 and to the third position Po3 in this order.

[0064] Fig. 11 is a flowchart executed by the image processing circuit 21. By executing the flowchart of Fig. 11, the image processing circuit 21 estimates the position of the gaze point when displaying the color image G of the next frame F. The image processing circuit 21 repeatedly executes the flowchart of Fig. 11 for each frame F. As described above, the image processing circuit 21 always holds the latest number of data (detection results of the gaze detection sensor 30) for a predetermined period of time. The data held by the image processing circuit 21 corresponds to the gaze point.

[0065] Fig. 12 is a diagram showing an example of the position of the gaze point Pv when the color image G is displayed. Fig. 12 shows the positions of multiple gaze points Pv from a time point a predetermined time before the current time point (time t0) to the current time point, and an arrow A passing through the multiple gaze points Pv. Arrow A indicates the trajectory of the gaze points Pv. The position of the gaze point Pv at the current time point corresponds to the most recent gaze point Pv. It goes without saying that the position of the gaze point Pv is not limited to the position shown in Fig. 12.

[0066] 11 , the image processing circuit 21 estimates the position of the gaze point Pv when the color image G is displayed in the next frame F. Hereinafter, the gaze point Pv when the first color image G1, the second color image G2, and the third color image G3 are displayed in the next frame F (e.g., the time when the display of the first color image G1, the second color image G2, and the third color image G3 starts) will be referred to as the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3, respectively. In other words, the positions of the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3 correspond to the first position Po1, the second position Po2, and the third position Po3 shown in FIG.

[0067] The image processing circuit 21 estimates the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3 using a plurality of gaze points Pv up to the current frame F shown in FIG.

[0068] Fig. 13A is a diagram showing the transition in the X direction for the multiple gaze points Pv shown in Fig. 12. In Fig. 13A, the horizontal axis represents time, and the vertical axis represents the X coordinate of the display area DA. Fig. 13B is a diagram showing the transition in the Y direction for the multiple gaze points Pv shown in Fig. 12. In Fig. 13B, the horizontal axis represents time, and the vertical axis represents the Y coordinate of the display area DA.

[0069] The image processing circuit 21 generates approximate curves Cx and Cy using the positions of multiple gaze points Pv for each of the shift in the X direction of the gaze point Pv shown in Fig. 13A and the shift in the Y direction of the gaze point Pv shown in Fig. 13B. In Figs. 13A and 13B, the approximate curves Cx and Cy up to the current time (time t0) are shown by solid lines, and the approximate curves Cx and Cy after the current time are shown by dashed lines.

[0070] The image processing circuit 21 identifies (estimates) the points on the dashed approximate curves Cx and Cy corresponding to the first time t1, the second time t2, and the third time t3 at which the first color image G1, the second color image G2, and the third color image G3 of the next frame F are displayed as the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3. The image processing circuit 21 acquires the X coordinates and Y coordinates of the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3, respectively. Note that FIG. 12 shows the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3 estimated as described above.

[0071] In this way, the image processing circuit 21 uses the gaze point Pv identified based on the detection results of the gaze detection sensor 30 to estimate the first viewpoint Pg1 when displaying the first color image G1, the second viewpoint Pg2 when displaying the second color image G2, and the third viewpoint Pg3 when displaying the third color image G3.

[0072] Furthermore, in step S2 shown in FIG. 11, the image processing circuit 21 derives the positional relationship between the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3.

[0073] The image processing circuit 21 first derives the positional relationship between the first viewpoint Pg1 and the second viewpoint Pg2. Specifically, the image processing circuit 21 uses the X and Y coordinates of the first viewpoint Pg1 and the second viewpoint Pg2 to derive a first estimated direction Wg1, shown in FIG. 12 , with the first viewpoint Pg1 as the start point and the second viewpoint Pg2 as the end point. Furthermore, the drive circuit 20 calculates a first estimated distance Lg1, which is the distance between the first viewpoint Pg1 and the second viewpoint Pg2.

[0074] The image processing circuit 21 also derives the positional relationship between the second viewpoint Pg2 and the third viewpoint Pg3. Specifically, the image processing circuit 21 uses the X and Y coordinates of the second viewpoint Pg2 and the third viewpoint Pg3 to derive a second estimated direction Wg2, shown in FIG. 12 , with the second viewpoint Pg2 as its start point and the third viewpoint Pg3 as its end point. The drive circuit 20 then calculates a second estimated distance Lg2, which is the distance between the second viewpoint Pg2 and the third viewpoint Pg3.

[0075] When step S2 shown in FIG. 11 is completed, the image processing circuit 21 returns the program to step S1.

[0076] Fig. 14 is a flowchart executed by the image processing circuit 21. The drive circuit 20 executes the flowchart of Fig. 14 to display a first color image G1, a second color image G2, and a third color image G3. The image processing circuit 21 repeatedly executes the flowchart of Fig. 14 for each frame F. Below, a case where the drive circuit 20 displays the first color image G1, the second color image G2, and the third color image G3 in the next frame F will be described.

[0077] The image processing circuit 21 acquires an input image Gi in step S11 shown in Fig. 14. Subsequently, in step S12, the image processing circuit 21 generates a color image G by color-separating the input image Gi as described above.

[0078] Furthermore, in step S13, the image processing circuit 21 adjusts the position of the color image G with respect to the display area DA. Specifically, the image processing circuit 21 adjusts the positions of the first color image G1, the second color image G2, and the third color image G3 with respect to the display area DA, based on the positional relationships among the first viewpoint Pg1, the second viewpoint Pg2, and the third viewpoint Pg3 estimated as described above.

[0079] 15 shows the second-color image G2 whose position relative to the display area DA has been adjusted. The image processing circuit 21 adjusts the position of the second-color image G2 corresponding to the second color (green) relative to the display area DA by overlapping the reference point Ds of the display area DA with the second image point Dg2. In this case, the periphery of the second-color image G2 overlaps the periphery of the display area DA. In other words, the position of the second-color image G2 coincides with the position of the input image Gi and corresponds to the reference position when adjusting the position of the color image G.

[0080] 16 is a diagram showing the first-color image G1 whose position relative to the display area DA has been adjusted. In FIG. 16, the periphery of the first-color image G1 before its position is adjusted is indicated by a dashed line, and the first-color image G1 after its position has been adjusted is indicated by a solid line. The image processing circuit 21 adjusts the position of the first-color image G1 corresponding to the first color (red) based on the positional relationship between the second-color image G2 and the first-color image G1.

[0081] Specifically, the image processing circuit 21 adjusts the position of the first color image G1 so that the first adjustment direction Wt1, which is the direction from the second image point Dg2 to the first image point Dg1, is the same as the opposite direction of the direction from the first viewpoint Pg1 to the second viewpoint Pg2 (the first estimated direction Wg1 shown in Figure 12), and the first adjustment distance Lt1, which is the distance between the second image point Dg2 and the first image point Dg1, is equal to the distance between the first viewpoint Pg1 and the second viewpoint Pg2 (the first estimated distance Lg1 shown in Figure 12).

[0082] By estimating the first viewpoint Pg1 and the second viewpoint Pg2 as described above, the first estimated direction Wg1 shown in Fig. 12 is approximately along the first movement direction Wo1 shown in Fig. 5 and the first shift direction Wz1 shown in Fig. 10, and the first estimated distance Lg1 shown in Fig. 12 is approximately equal to the first movement distance Lo1 shown in Fig. 5 and the first shift amount Lz1 shown in Fig. 10. Therefore, the first adjustment direction Wt1 shown in Fig. 16 is approximately along the opposite direction to the first shift direction Wz1 shown in Fig. 10, and the first adjustment distance Lt1 shown in Fig. 16 is approximately equal to the first shift amount Lz1 shown in Fig. 10.

[0083] As described above, the position of the second-color image G2 is adjusted so that the second image point Dg2 overlaps with the reference point Ds of the display area DA, and the position of the first-color image G1 is adjusted so that it is shifted relative to the second-color image G2. Thus, the position of the first-color image G1 is adjusted so that it is shifted relative to the display area DA. Specifically, the position of the first-color image G1 is adjusted so that the direction from the reference point Ds toward the first image point Dg1 is the first adjustment direction Wt1, and the distance between the reference point Ds and the first image point Dg1 is the first adjustment distance Lt1.

[0084] 17 is a diagram showing the third-color image G3 whose position relative to the display area DA has been adjusted. In FIG. 17, the periphery of the third-color image G3 before its position is adjusted is indicated by a dashed line, and the third-color image G3 after its position has been adjusted is indicated by a solid line. The image processing circuit 21 adjusts the position of the third-color image G3, which corresponds to the third color (blue), based on the positional relationship between the second-color image G2 and the third-color image G3.

[0085] Specifically, the image processing circuit 21 adjusts the position of the third color image G3 so that the second adjustment direction Wt2, which is the direction from the second image point Dg2 to the third image point Dg3, is the same as the direction from the second viewpoint Pg2 to the third viewpoint Pg3 (the second estimated direction Wg2 shown in Figure 12), and the second adjustment distance Lt2, which is the distance between the second image point Dg2 and the third image point Dg3, is equal to the distance between the second viewpoint Pg2 and the third viewpoint Pg3 (the second estimated distance Lg2 shown in Figure 12).

[0086] By estimating the second viewpoint Pg2 and the third viewpoint Pg3 as described above, the second estimated direction Wg2 shown in Fig. 12 is substantially aligned with the second movement direction Wo2 shown in Fig. 5 and is substantially aligned with the opposite direction of the second shift direction Wz2 shown in Fig. 10. Furthermore, the second estimated distance Lg2 shown in Fig. 12 is substantially equal to the second movement distance Lo2 shown in Fig. 5 and the second shift amount Lz2 shown in Fig. 10. Therefore, the second adjustment direction Wt2 shown in Fig. 17 is substantially aligned with the opposite direction of the second shift direction Wz2 shown in Fig. 10, and the second adjustment distance Lt2 shown in Fig. 17 is substantially equal to the second shift amount Lz2 shown in Fig. 10.

[0087] As described above, the position of the second-color image G2 is adjusted so that the second image point Dg2 overlaps with the reference point Ds of the display area DA, and the position of the third-color image G3 is adjusted so that it is shifted relative to the second-color image G2. Thus, the position of the third-color image G3 is adjusted so that it is shifted relative to the display area DA. Specifically, the position of the third-color image G3 is adjusted so that the direction from the reference point Ds toward the third image point Dg3 is the second adjustment direction Wt2, and the distance between the reference point Ds and the third image point Dg3 is the second adjustment distance Lt2.

[0088] If an image-free area occurs between the periphery of the display area DA and the periphery of the first-color image G1 due to the adjustment of the position of the first-color image G1, the image processing circuit 21 may generate an image identical to the periphery of the first-color image G1 adjacent to the image-free area in the image-free area and add the image to the first-color image G1. The same applies to the second-color image G2 and the third-color image G3.

[0089] Furthermore, in step S14 shown in Fig. 14, the image processing circuit 21 outputs pixel signals corresponding to the color image G whose position has been adjusted. Specifically, the image processing circuit 21 generates pixel signals corresponding to the first color image G1 shown in Fig. 15, the second color image G2 shown in Fig. 16, and the third color image G3 shown in Fig. 17, and outputs the generated pixel signals. As a result, the first color image G1 shown in Fig. 16, the second color image G2 shown in Fig. 15, and the third color image G3 shown in Fig. 17 are displayed in this order in the display area DA.

[0090] When the gaze point Pv moves in the order of the first position Po1, the second position Po2, and the third position Po3 shown in Fig. 5, the second-color image G2 shown in Fig. 15 is viewed without any deviation from the display area DA as described above. In other words, the second-color image G2 shown in Fig. 15 is viewed with the second image point Dg2 and the reference point Ds overlapping each other.

[0091] In this case, the first color image G1 shown in Fig. 16 is viewed in a state where it is shifted by the first shift amount Lz1 along the first shift direction Wz1 shown in Fig. 10 relative to the second color image G2 as described above. As described above, the first adjustment direction Wt1 is approximately along the opposite direction to the first shift direction Wz1 shown in Fig. 10, and the first adjustment distance Lt1 is approximately equal to the first shift amount Lz1 shown in Fig. 10. Therefore, the first color image G1 shown in Fig. 16 is viewed in a state where the first image point Dg1 and the reference point Ds approximately overlap.

[0092] Furthermore, in this case, the third-color image G3 shown in Fig. 17 is viewed in a state where it is shifted by the second shift amount Lz2 along the second shift direction Wz2 shown in Fig. 10 relative to the second-color image G2 as described above. As described above, the second adjustment direction Wt2 is approximately along the opposite direction to the second shift direction Wz2 shown in Fig. 10, and the second adjustment distance Lt2 is approximately equal to the second shift amount Lz2 shown in Fig. 10. Therefore, the third-color image G3 shown in Fig. 17 is viewed in a state where the third image point Dg3 and the reference point Ds approximately overlap.

[0093] Therefore, the user views the first color image G1 shown in Fig. 16, the second color image G2 shown in Fig. 15, and the third color image G3 shown in Fig. 17 in a state where the first image point Dg1, the second image point Dg2, and the third image point Dg3 are overlapped. In other words, the image viewed by the user is a state where the first line drawing portion G1a, the second line drawing portion G2a, and the third line drawing portion G3a are overlapped, and corresponds to the input image Gi shown in Fig. 5.

[0094] When the image processing circuit 21 completes step S14 shown in FIG. 14, it returns the program to step S1.

[0095] In this way, the image processing circuit 21 adjusts the position of the color image G relative to the display area DA, thereby making it possible to suppress the occurrence of color breakup in the display device 1 that displays images using the field sequential color method.

[0096] Furthermore, as described above, the drive circuit 20 aligns the reference point Ds with the second image point Dg2 with respect to the position of the second-color image G2 relative to the display area DA, so that the second-color image G2 ( FIG. 15 ) whose position has been adjusted is not misaligned with respect to the display area DA. In this case, the first-color image G1 ( FIG. 16 ) and the third-color image G3 ( FIG. 17 ) whose positions have been adjusted are misaligned with respect to the display area DA, as described above. In this state, the image viewed by the user corresponds to an image in which the input image Gi is not misaligned with respect to the display area DA.

[0097] Suppose the image processing circuit 21 aligns the reference point Ds with the first image point Dg1 with respect to the position of the first-color image G1 relative to the display area DA, then the first-color image G1, whose position has been adjusted, will not be misaligned with respect to the display area DA, while the second-color image G2 and the third-color image G3, whose positions have been adjusted, will be misaligned with respect to the display area DA. However, the amount of misalignment of the third-color image G3 with respect to the display area DA when the reference point Ds and the first image point Dg1 are aligned is greater than the amount of misalignment of the third-color image G3 with respect to the display area DA when the reference point Ds and the second image point Dg2 are aligned. Thus, the image viewed by the user corresponds to an image in which the input image Gi is misaligned with respect to the display area DA. This also applies when the image processing circuit 21 aligns the reference point Ds with the third image point Dg3, resulting in misalignment of the first-color image G1 and the second-color image G2, whose positions have been adjusted, relative to the display area DA. Therefore, when the image processing circuit 21 aligns the reference point Ds with the second image point Dg2 as described above, the user can more appropriately view the input image Gi in the display area DA.

[0098] Furthermore, as described above, the second color corresponding to the second-color image G2 is green. Humans can more easily see green than red and blue. Furthermore, the second-color image G2 ( FIG. 15 ) whose position has been adjusted as described above is not misaligned with respect to the display area DA. Therefore, by viewing the second-color image G2 corresponding to the easily visible green without any misalignment with respect to the display area DA, the user can more appropriately view the input image Gi in the display area DA compared to viewing either the first-color image G1 corresponding to red or the third-color image G3 corresponding to blue without any misalignment with respect to the display area DA.

[0099] <Display System 2> Next, a display system 2 according to an embodiment of the present disclosure will be described.

[0100] 18 is a perspective view of a display system 2 according to an embodiment of the present disclosure. Images displayed by the display system 2 include, for example, computer graphic images and 360-degree live-action images.

[0101] The display system 2 includes a built-in video signal source Sg. The display system 2 may also acquire an input image from an external device.

[0102] The output image of the video signal source Sg has two different output images that utilize the parallax between the user's eyes: an input image for the user's right eye and an input image for the user's left eye.

[0103] Fig. 19 is a schematic diagram showing the configuration of the display system 2. As shown in Fig. 18 and Fig. 19, the display system 2 includes a mounting part 150, two lenses 160, the display device 1, and a video signal source Sg.

[0104] The wearing unit 150 is worn on the user's head in a manner that covers both of the user's eyes. The wearing unit 150 is, for example, a headset, goggles, a helmet, or a mask. Two lenses 160 and two display devices 1 are fixed to the wearing unit 150. The wearing unit 150 may further include an output unit (not shown) that outputs an audio signal output from the video signal source Sg.

[0105] The two lenses 160 are disposed in positions facing the user's eyes E. The lenses 160 are, for example, convex lenses made of glass. The two lenses 160 correspond to both of the user's eyes. The lenses 160 are disposed between the display device 1 and the user's eyes E.

[0106] Due to the lens action of the lens 160, the light emitted from the display device 1 is focused on the user's eye E, and the user sees an enlarged version of the image displayed in the display area DA.

[0107] The display device 1 is disposed on the opposite side of the user's eyes E across the two lenses 160. The line-of-sight detection sensor 30 is disposed in the mounting portion 150 and is electrically connected to the control board CPC.

[0108] FIG. 20 is a block diagram of a display system 2. The display system 2 includes two display devices 1. That is, the display system 2 includes a first display device 1a and a second display device 1b. The first display device 1a and the second display device 1b are configured in the same manner as the display device 1 described above. That is, the first display device 1a and the second display device 1b include a display panel 10, a drive circuit 20, a gaze detection sensor 30, and a light source device 40, similar to the display device 1 described above. That is, in subframes SF1, SF2, and SF3 of frame F shown in FIG. 9 , a first-color image is displayed in a first light-emitting period TL1, a second-color image is displayed in a second light-emitting period TL2, and a third-color image is displayed in a third light-emitting period TL3.

[0109] The first display device 1a acquires an input image for the left eye. The display area DA of the first display device 1a faces the left eye of the user. The display area DA of the second display device 1b acquires an input image for the right eye. The second display device 1b faces the right eye of the user. Hereinafter, when the first display device 1a and the second display device 1b are described without distinction, they will be simply referred to as "display device 1." Note that the control board CPC of the first display device 1a and the control board CPC of the second display device 1b are integrated, but may be separate.

[0110] The display system 2 may include one display device 1. In this case, in the display area DA, an image for the left eye is displayed in an area corresponding to the left eye, and an image for the right eye is displayed in an area corresponding to the right eye.

[0111] Next, the operation of the display device 1 that displays an image in the display area DA will be described, focusing mainly on the differences from the operation of the display device 1 described above.

[0112] The image processing circuit 21 executes the flowchart shown in FIG. 11 in the same manner as above, and estimates the position of the gaze point Pv when the color image G is displayed.

[0113] 21 is a flowchart executed by the image processing circuit 21 when displaying a color image G in the display device 1 included in the display system 2. In the display system 2, the image processing circuit 21 executes the flowchart shown in FIG. 21 instead of the flowchart in FIG. 14 described above.

[0114] In step S21, the image processing circuit 21 acquires an input image Gi.

[0115] Furthermore, in step S22, the image processing circuit 21 generates a color image G by color-separating the input image Gi. Specifically, the image processing circuit 21 generates a first-color image G1 corresponding to the first color (red) of the input image Gi, a second-color image G2 corresponding to the second color (green) of the input image Gi, and a third-color image G3 corresponding to the third color (blue) of the input image Gi.

[0116] For example, if the input image Gi is the same as the image shown in Figure 5, the first color image G1 generated by the image processing circuit 21 is the same as the image shown in Figure 6, the second color image G2 generated by the image processing circuit 21 is the same as the image shown in Figure 7, and the third color image G3 generated by the image processing circuit 21 is the same as the image shown in Figure 8.

[0117] Furthermore, in step S23, the image processing circuit 21 adjusts the position of the color image G relative to the display area DA. Specifically, in step S23, the image processing circuit 21 adjusts the position of the color image G in the same manner as in step S13 above.

[0118] If adjusting the position of the first-color image G1 results in an area without an image between the periphery of the display area DA and the periphery of the first-color image G1, the image processing circuit 21 increases the size of the input image Gi by the amount of movement of the color image G adjusted by the image processing circuit 21. This prevents the area without an image from occurring. The same applies to the second-color image G2 and the third-color image G3.

[0119] Subsequently, in step S24, the image processing circuit 21 performs lens correction on the color image G. The lens correction is a process of correcting the color image G based on the distortion aberration of the lens 160.

[0120] Distortion occurs in the image viewed by the user through lens 160. In other words, distortion aberration occurs due to lens 160. Specifically, the image viewed by the user through lens 160 has a distortion (so-called pincushion distortion) in which the peripheral edges of the image displayed in display area DA appear to be wider. In other words, with the distortion aberration caused by lens 160, the degree of distortion from the center of color image G toward the outside in the radial direction increases as the image displayed in display area DA moves radially outward (away from the center of the image).

[0121] Therefore, the image processing circuit 21 corrects the color image G to suppress the distortion caused by the lens 160. Specifically, the image processing circuit 21 corrects the color image G so that the color image G has a distortion that makes the center appear bulging (so-called barrel distortion). That is, in the corrected color image G, the degree of distortion toward the center of the image increases the further away from the center of the color image G.

[0122] That is, the image processing circuit 21 corrects the color image G to have distortion in the opposite direction to the direction of the image distortion visually recognized by the user, which is caused by the distortion aberration of the lens 160 .

[0123] Furthermore, in step S25, the image processing circuit 21 outputs pixel signals corresponding to the corrected color image G. As a result, the corrected first color image G1, the corrected second color image G2, and the corrected third color image G3 are displayed in this order in the display area DA.

[0124] By adjusting the position of the color image G as described above, the user views the first color image G1, the second color image G2, and the third color image G3 with the first image point Dg1, the second image point Dg2, and the third image point Dg3 overlapping. Furthermore, by correcting the color image G to have a distortion that is the opposite of the distortion caused by the lens 160 as described above, the user views the first color image G1, the second color image G2, and the third color image G3 with suppressed distortion. In other words, the image viewed by the user corresponds to the input image Gi.

[0125] When the image processing circuit 21 completes step S25, it returns the program to step S21.

[0126] In this way, the image processing circuit 21 adjusts the position of the color image G relative to the display area DA and corrects the color image G to have a distorted state, thereby suppressing the occurrence of color breakup and distortion aberration in a display system 2 equipped with a display device 1 that displays images using a field sequential color method.

[0127] In step S24, the image processing circuit 21 may correct the color image G based on the chromatic aberration of the lens 160 instead of the distortion aberration of the lens 160. That is, the image processing circuit 21 may correct the color image G by setting different magnitudes of distortion aberration for the first color image G1, the second color image G2, and the third color image G3.

[0128] The wavelength of light decreases in the order of first light of the first color (red), second light of the second color (green), and third light of the third color (blue). General optical glass and resin that make up lens 160 have a relationship between wavelength and refractive index called normal dispersion, and the refractive index of the first light, second light, and third light increases in this order.

[0129] Therefore, when the input image Gi is separated into the first, second, and third colors, the size of the image perceived by the user increases as the wavelength of light decreases, in the order of the first-color image G1 of the first color, the second-color image G2 of the second color, and the third-color image G3 of the third color. Therefore, the user perceives the image displayed in the display area DA with a color shift. In other words, chromatic aberration occurs due to the lens 160.

[0130] Therefore, the image processing circuit 21 corrects the color image G to suppress the chromatic aberration caused by the lens 160. Specifically, the image processing circuit 21 corrects the color image G so that the sizes of the third-color image G3 of the third color, the second-color image G2 of the second color, and the first-color image G1 of the first color increase in that order. In other words, the size of the color image G is corrected so that the size relationship between the first-color image G1, the second-color image G2, and the third-color image G3, which occurs due to chromatic aberration, becomes the inverse of that between the first-color image G1, the second-color image G2, and the third-color image G3.

[0131] The image processing circuit 21 uses the size of the second-color image G2 as a reference, that is, the size of the second-color image G2 is equal to the size of the input image Gi.

[0132] In this way, the color image G is corrected to have the inverse relationship of the size relationship between the first color image G1, the second color image G2, and the third color image G3 generated by the lens 160, so that the user views the first color image G1, the second color image G2, and the third color image G3 with suppressed chromatic aberration. By adjusting the position of the color image G as described above, the user views the first color image G1, the second color image G2, and the third color image G3 with the first image point Dg1, the second image point Dg2, and the third image point Dg3 overlapping. In other words, the image viewed by the user corresponds to the input image Gi.

[0133] In step S24, the image processing circuit 21 may correct the color image G based on both the distortion aberration and the chromatic aberration of the lens 160.

[0134] Although preferred embodiments of the present disclosure have been described above, the present disclosure is not limited to such embodiments. The contents disclosed in the embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. Appropriate modifications made within the scope of the present disclosure also naturally fall within the technical scope of the present disclosure.

[0135] For example, in step S13 shown in Figure 14, the image processing circuit 21 may align the reference point Ds with the first image point Dg1 with respect to the position of the first color image G1 relative to the display area DA, and may align the reference point Ds with the third image point Dg3 with respect to the position of the third color image G3 relative to the display area DA.

[0136] Alternatively, one of the first color and the third color corresponding to the first color image G1 and the third color image G3 may be green.

[0137] In the display system 2, the display panel 10 may be detachably attached to the mounting unit 150.

[0138] It goes without saying that the lens 160 is not limited to a convex lens. The distortion caused by the lens 160 may be a distortion that causes the image viewed by the user through the lens 160 to have so-called barrel distortion. In this case, the drive circuit 20 corrects the color image G so that it has so-called pincushion distortion.

[0139] Furthermore, other effects and advantages brought about by the aspects described in the above embodiments that are clear from the description in this specification or that can be appropriately thought of by a person skilled in the art are naturally understood to be brought about by the present disclosure.

[0140] REFERENCE SIGNS LIST 1 Display device 2 Display system 10 Display panel 20 Drive circuit 30 Line-of-sight detection sensor 40 Light source device 160 Lens DA Display area Dg1 First image point Dg2 Second image point Dg3 Third image point Ds Reference point G1 First color image G2 Second color image G3 Third color image Pg1 First viewpoint Pg2 Second viewpoint Pg3 Third viewpoint Pv Point of gaze

Claims

1. A display device comprising: a display panel having a display area; a light source device which emits a first light of a first color, a second light of a second color, and a third light of a third color to the display panel in this order within one frame; a gaze detection sensor which detects a user's gaze; and a drive circuit which displays an image in the display area based on an image signal, wherein the drive circuit generates a first color image corresponding to the first color, a second color image corresponding to the second color, and a third color image corresponding to the third color based on the image signal, displays the first color image when the first light is emitted, displays the second color image when the second light is emitted, and displays the third color image when the third light is emitted, and identifies the position of the user's viewpoint in the display area based on a detection result of the gaze detection sensor, A display device which uses the identified position of the user's viewpoint to estimate the positions of a first viewpoint which is the user's viewpoint in the display area when the first color image is displayed, a second viewpoint which is the user's viewpoint in the display area when the second color image is displayed, and a third viewpoint which is the user's viewpoint in the display area when the third color image is displayed, and adjusts the position of each of the first color image, the second color image, and the third color image relative to the display area based on the positional relationship between the first viewpoint, the second viewpoint, and the third viewpoint.

2. The display device of claim 1, wherein the first color image, the second color image and the third color image have first image points, second image points and third image points corresponding to reference points of the display area, and the driving circuit adjusts the position of the first color image so that the direction from the second image point to the first image point is the same as the reverse direction of the direction from the first viewpoint to the second viewpoint and the distance between the second image point and the first image point is equal to the distance between the first viewpoint and the second viewpoint, and adjusts the position of the third color image so that the direction from the second image point to the third image point is the same as the direction from the second viewpoint to the third viewpoint and the distance between the second image point and the third image point is equal to the distance between the second viewpoint and the third viewpoint.

3. The display device according to claim 2, wherein the drive circuit matches the reference point with the second image point with respect to the position of the second color image relative to the display area.

4. The display device according to claim 3, wherein the second color is green.

5. A display system comprising: a display device according to any one of claims 1 to 4; and a lens, wherein the drive circuit corrects the first color image, the second color image, and the third color image, the positions of which with respect to the display area have been adjusted, based on one of distortion aberration and chromatic aberration caused by the lens.

Images