Display device, display control method, and display control program

Abstract

To provide the user with appropriate stereoscopic images.SOLUTION: The display 1b includes a display unit 10 that includes a plurality of pixels P and provides an image to the user by irradiating light from the pixels P, an optical element provided on the user side rather than the display unit 10, a drive control unit that moves the optical element at a predetermined cycle, and a timing setting unit that sets the light irradiation timing for each pixel P based on the position of the optical element.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to a display device, a display control method, and a display control program. [Background technology]

[0002] There is known a display device that displays a stereoscopic image by making the right and left eyes of a user view images with different parallax and utilizing the difference in convergence. One such display device is a so-called head-mounted display (HMD) that is mounted on the user's head. For example, Patent Document 1 describes a head-mounted display in which a microlens array is disposed between a display and an optical system. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2019 / 044501 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, in a display device that displays a stereoscopic image, it is required to provide the image appropriately to the user.

[0005] In view of the above-mentioned problems, an object of the present invention is to provide a display device, a display control method, and a display control program capable of appropriately providing a stereoscopic image to a user. [Means for solving the problem]

[0006] A display device according to one aspect of the present invention includes a display unit including a plurality of pixels and providing an image to a user by irradiating light from the pixels, an optical element provided closer to the user than the display unit, a drive control unit that moves the optical element at a predetermined cycle, and a timing setting unit that sets the irradiation timing of the light for each pixel based on the position of the optical element.the timing setting unit sets the irradiation timing based also on depth information indicating a position in the depth direction of the image, the timing setting unit acquires information on an irradiation position, which is a position of the optical element where an opening angle of a luminous flux of light from the pixel corresponds to an opening angle of the luminous flux when the light is irradiated toward the user from a depth direction position in the part of the image displayed by that pixel, and sets the timing at which the optical element is within a predetermined distance range from the irradiation position as the irradiation timing for that pixel, the drive control unit moves the display unit at a predetermined period, and the timing setting unit sets the irradiation timing of the light for each pixel based on the position of the display unit.

[0007] A display control method according to one aspect of the present invention includes a drive control step of moving an optical element provided on a user side of a display unit including a plurality of pixels and emitting light from the pixels at a predetermined period, and a timing setting step of setting a timing of emitting the light for each of the pixels based on a position of the optical element. In the timing setting step, the irradiation timing is set based also on depth information indicating the position in the depth direction of the image, in the timing setting step, information on the irradiation position is obtained, which is the position of the optical element corresponding to the opening angle of the light flux from the pixel when the light is irradiated toward the user from a depth direction position in the part of the image displayed by that pixel, and the timing at which the optical element is within a predetermined distance range from the irradiation position is set as the irradiation timing for that pixel, in the drive control step, the display unit is moved at a predetermined period, and in the timing setting step, the irradiation timing of the light is set for each pixel based on the position of the display unit.

[0008] A display control program according to one aspect of the present invention causes a computer to execute a drive control step of moving an optical element provided on a user side of a display unit including a plurality of pixels and emitting light from the pixels at a predetermined period, and a timing setting step of setting a timing of emitting the light for each of the pixels based on a position of the optical element. In the timing setting step, the irradiation timing is set based also on depth information indicating the depth position of the image, and in the timing setting step, information on the irradiation position is obtained, which is the position of the optical element corresponding to the opening angle of the light flux from the pixel when the light is irradiated toward the user from a depth position in the part of the image displayed by that pixel, and the timing at which the optical element is within a predetermined distance range from the irradiation position is set as the irradiation timing for that pixel, and in the drive control step, the display unit is moved at a predetermined period, and in the timing setting step, the irradiation timing of the light is set for each pixel based on the position of the display unit. Effect of the Invention

[0009] According to the present invention, an image can be appropriately provided to a user. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram for explaining the convergence accommodation conflict. [Diagram 2] FIG. 2 is a schematic diagram of the display device according to the first embodiment. [Diagram 3] FIG. 3 is a schematic diagram of each component of the display device according to the first embodiment. [Figure 4] FIG. 4 is a schematic block diagram of the control device according to the first embodiment. [Diagram 5] FIG. 5 is a schematic diagram for explaining the setting of the irradiation timing. [Figure 6] FIG. 6 is a schematic diagram for explaining the setting of the irradiation timing. [Figure 7] FIG. 7 is a schematic diagram for explaining the setting of the irradiation timing. [Figure 8] FIG. 8 is a flowchart illustrating a process flow of the control device according to the present embodiment. [Figure 9] FIG. 9 is a schematic diagram of a display device according to the second embodiment. [Figure 10] FIG. 10 is a graph illustrating the difference in the amount of movement of the display unit when a microlens array is provided. [Figure 11] FIG. 11 is a schematic diagram of a display device according to the third embodiment. [Figure 12] FIG. 12 is a flowchart illustrating a process flow of the control device according to the third embodiment. [Figure 13] FIG. 13 is a schematic diagram of a display device according to the fourth embodiment. [Figure 14] FIG. 14 is a graph illustrating the difference in the amount of movement of the display unit when a microlens array is provided. [Figure 15] FIG. 15 is a schematic diagram of a display device according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiment described below.

[0012] (Convergence regulation conflict) FIG. 1 is a schematic diagram for explaining the convergence accommodation conflict. A display device for displaying a stereoscopic image displays a stereoscopic image by making the right eye and the left eye of a user view images with different parallax and utilizing the difference in convergence. When displaying a stereoscopic image, the display surface on which the image is actually displayed becomes the focal position of the user's eyes, and the position where the lines of sight of the left and right eyes intersect becomes the convergence position. However, as shown in the example of FIG. 1, in a stereoscopic image, the positions of the focal position PO1 and the convergence position PO2 in the Z direction, which is the depth direction of the stereoscopic image, may shift. When the positions of the focal position PO1 and the convergence position PO2 shift, a so-called convergence accommodation conflict occurs, which causes eye strain and so-called 3D sickness. For this reason, it is required to suppress the convergence accommodation conflict. Note that FIG. 1 (A) shows an example in which the focal position PO1 is closer to the user's eye EY than the convergence position PO2, and FIG. 1 (B) shows an example in which the convergence position PO2 is closer to the user's eye EY than the focal position PO1.

[0013] (First embodiment) (Overall configuration of the display device) FIG. 2 is a schematic diagram of a display device according to the first embodiment. The display device 1 according to the first embodiment is a display device that displays a stereoscopic image. As shown in FIG. 2, the display device 1 is a so-called HMD (Head Mount Display) that is worn on the head of a user U. For example, the display device 1 has a display unit 10 worn at a position facing the eye EY of the user U. The display device 1 displays an image on the display unit 10 to provide content to the user U. Note that the configuration of the display device 1 shown in FIG. 2 is an example. For example, the display device 1 may include an audio output unit (speaker) that is worn on the ear of the user U.

[0014] Since the display device 1 is worn by the user U in this manner, the position of the display device 1 with respect to the eyes EY of the user U is fixed. The display device 1 is not limited to being an HMD worn by the user U, and may be a display device fixed to equipment, etc. Even in such a case, it is preferable that the position of the display device 1 with respect to the eyes EY of the user U is fixed, for example, by fixing the position of the display device 1 with respect to the seat of the user U.

[0015] 3 is a schematic diagram of each component of the display device according to the first embodiment. As shown in FIG. 3, the display device 1 has a display unit 10, an eyepiece lens 20, a drive unit 30, a position detection unit 50, and a control device 60.

[0016] (Display) The display unit 10 is a device that displays a stereoscopic image. The display unit 10 is a display having a plurality of self-emitting pixels P (display elements) arranged in a matrix. Since each pixel P of the display unit 10 is self-emitting, the display unit 10 can control the emission (light irradiation) of each pixel P individually. Each pixel P of the display unit 10 may be, for example, an organic light emitting diode (OLED) or an inorganic light emitting diode (micro LED). The surface on which an image is displayed on the display unit 10 is referred to as a display surface 10A. Hereinafter, the direction from the display surface 10A toward the eye EY of the user U is referred to as a direction Z1, and the opposite direction to the direction Z1, i.e., the direction from the eye EY of the user U toward the display surface 10A is referred to as a direction Z2. When there is no need to distinguish between the directions Z1 and Z2, the direction will be referred to as a direction Z. Note that in FIG. 3, the surface of the display unit 10 on the side of the eye EY of the user U is referred to as the display surface 10A, but the display surface 10A is not limited to being the surface on the side of the eye EY of the user U, and may be located inside the surface on the side of the eye EY of the user U. Note that the display unit 10 receives a control signal for controlling the pixels P of the display unit 10 from a control device 60 described later.

[0017] The display unit 10 provides a stereoscopic image to the user U by making the image light L, which is light irradiated (emitted) from each pixel P, reach the eye EY of the user U. More specifically, the display unit 10 controls the emission of each pixel P so that an image for the left eye and an image for the right eye are provided. Of the image light L from each pixel P, the image light L from the pixel P corresponding to the image for the left eye is incident on the left eye of the user U, and the image light L from the pixel P corresponding to the image for the right eye is incident on the left eye of the user U, thereby providing a stereoscopic image to the user U.

[0018] (Eyepiece) The eyepiece 20 is provided on the Z1 direction side of the display unit 10. The eyepiece 20 is an optical element that transmits light (image light). More specifically, the eyepiece 20 is the optical element (lens) that is closest to the eye EY of the user U in the display device 1. The image light L emitted from the display unit 10 passes through the eyepiece 20 and enters the eye EY of the user U. Note that in this embodiment, the optical axis direction in the optical path of the image light L from the eyepiece 20 (eyepiece) to the eye EY of the user U can also be referred to as direction Z. Note that in this embodiment, the eyepiece 20 does not move and its position within the display device 1 is fixed.

[0019] In the example of FIG. 3, only the eyepiece lens 20 is shown as the optical element on the Z1 direction side of the display unit 10, but the present invention is not limited to this, and optical elements other than the eyepiece lens 20 may be provided.

[0020] (Drive unit) The driving unit 30 is a driving mechanism that moves the display unit 10 in the Z direction, and can also be said to be an actuator. The driving unit 30 receives a signal for performing drive control from a control device 60, which will be described later.

[0021] (Position detection section) The position detection unit 50 is a sensor that detects the position in the Z direction of the display unit 10. The position detection unit 50 may be any sensor that can detect the position in the Z direction of the display unit 10. The position information detection unit 50 sends the position detection result to the control device 60.

[0022] (Control device) The control device 60 is a device that controls each part of the display device 1. FIG. 4 is a schematic block diagram of the control device according to the first embodiment. In this embodiment, the control device 60 is a computer, and has a storage unit 62 and a control unit 64. The storage unit 62 is a memory that stores various information such as the contents of calculations and programs of the control unit 64, and includes at least one of a main storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), and an external storage device such as a HDD (Hard Disk Drive). The program for the control unit 64 stored in the storage unit 62 may be stored in a recording medium that can be read by the control device 60.

[0023] The control unit 64 is a calculation device and includes a calculation circuit such as a CPU (Central Processing Unit). The control unit 64 includes an image information acquisition unit 72, a position information acquisition unit 74, a drive control unit 76, a timing setting unit 78, and an irradiation control unit 80. The control unit 64 realizes the image information acquisition unit 72, the position information acquisition unit 74, the drive control unit 76, the timing setting unit 78, and the irradiation control unit 80 by reading and executing a program (software) from the storage unit 62, and executes the processes. The control unit 64 may execute these processes by one CPU, or may include multiple CPUs and execute the processes by the multiple CPUs. At least one of the image information acquisition unit 72, the position information acquisition unit 74, the drive control unit 76, the timing setting unit 78, and the irradiation control unit 80 may be realized by a hardware circuit.

[0024] (Image information acquisition section) The image information acquisition unit 72 acquires image data of a stereoscopic image displayed by the display unit 10. That is, the image information acquisition unit 72 acquires image data of an image for the left eye and image data of an image for the right eye. The image information acquisition unit 72 also acquires depth information indicating a position in the depth direction of the stereoscopic image. The position in the depth direction of the stereoscopic image refers to a position in the depth direction of a virtual image visually recognized by the user U when an image is displayed on the display surface 10A. The depth direction can also be said to be a direction perpendicular to the display surface 10A of the display unit 10, and is the Z direction in this embodiment. The depth information is associated with the image data. Furthermore, a position in the depth direction is set for each image included in one frame of the stereoscopic image, in other words, a position in the depth direction is set for each position on the display surface 10A. Therefore, it can be said that the image information acquisition unit 72 acquires depth information for each position on the display surface 10A for the stereoscopic image. In the stereoscopic image, a position in the depth direction is set for each pixel P, but the positions in the depth direction may be set to be the same for multiple pixels P constituting one image. The image information acquisition unit 72 may acquire image data and depth information by any method, and may read image data and depth information stored in advance in the storage unit 62, or may receive image data and depth information via a communication unit (not shown). The image information acquisition unit 72 may acquire depth information by calculating a position in the depth direction based on the image data.

[0025] (Location information acquisition unit) The position information acquisition unit 74 controls the position detection unit 50 to cause the position detection unit 50 to detect the position of the display unit 10 in the Z direction, and acquires the detection result of the position of the display unit 10 in the Z direction.

[0026] (Drive control unit) The drive control unit 76 controls the drive unit 30 to cause the drive unit 30 to move the display unit 10 in the Z direction. The drive control unit 76 moves the display unit 10 so that the display unit 10 repeats a reciprocating movement (vibration) in the Z direction, in which the display unit 10 moves a predetermined distance in the Z1 direction and then moves a predetermined distance in the Z2 direction. The drive control unit 76 moves the display unit 10 along the Z direction at a predetermined cycle. In other words, the drive control unit 76 causes the display unit 10 to reciprocate in the Z direction at a predetermined cycle. In this embodiment, the cycle of the reciprocating movement in the Z direction (the time it takes for the display unit 10 to return to its original position in the Z direction) is constant, but is not limited to being constant and may be changed.

[0027] (Timing setting unit and irradiation control unit) The timing setting unit 78 sets the irradiation timing of the image light L for each pixel P of the display unit 10. The irradiation control unit 80 controls the pixels P of the display unit 10 based on the image data to irradiate the pixels P with light. The irradiation control unit 80 irradiates the image light L for each pixel P at the irradiation timing for each pixel P set by the timing setting unit 78. That is, the irradiation control unit 80 irradiates a certain pixel P of the display unit 10 with the image light L at the irradiation timing set for that pixel P. The timing setting unit 78 sets the irradiation timing based on the position of the display unit 10 in the Z direction (the optical axis direction of the image light L). More specifically, the timing setting unit 78 sets the irradiation timing based on the depth information of the stereoscopic image and the position of the display unit 10 in the Z direction. Note that the timing setting unit 78 sets the irradiation timing for each pixel P, but is not limited to different irradiation timings for each pixel P. For example, the irradiation timing for a group of pixels P constituting one image (for example, a group of pixels P displaying an image of a house in FIG. 5) may be set to the same timing. The settings of the timing setting section 78 will now be described in more detail.

[0028] 5 to 7 are schematic diagrams for explaining the setting of the irradiation timing. For example, as shown in FIG. 5, the image light L emitted from the pixel P of the display unit 10 is incident on the eye EY of the user U as a light beam having a predetermined opening angle. In this case, the user U unconsciously changes the thickness of the crystalline lens of the eyeball to adjust the focus on the retina to match the opening angle of the light beam. The convergence accommodation conflict refers to a mismatch between the degree of convergence of the left and right eyes (degree of deviation of the left and right eyes) and the state in which the focus is adjusted to the opening angle of the light beam. In contrast, the display device 1 of this embodiment emits the image light L so that the difference between the virtual image opening angle (angle θ1A in the example of FIG. 5), which is the opening angle when it is assumed that light is emitted from the virtual image (convergence position) and enters the eye EY, and the opening angle of the image light L when the image light L is actually emitted from the pixel P and enters the eye EY, becomes small. Here, the opening angle of the image light L is determined according to the distance in the Z direction (optical axis direction) from the display unit 10 (display surface 10A) to the eye EY. In this embodiment, since the display unit 10 is moved in the Z direction at a predetermined period, the timing setting unit 78 sets the timing at which the display unit 10 reaches a position where the difference between the virtual image opening angle and the opening angle of the image light L becomes small as the irradiation timing.

[0029] More specifically, the timing setting unit 78 acquires depth information for each pixel P. That is, the timing setting unit 78 acquires information on the position in the depth direction (Z direction) for each pixel P. Then, based on the depth information of the pixel P, the timing setting unit 78 sets an irradiation position, which is the position of the display unit 10 when irradiation of the image light L to the pixel P is started. The timing setting unit 78 sets, as the irradiation position for the pixel P, a position of the display unit 10 in the Z direction when the opening angle of the actual image light L from the pixel P matches the opening angle of the light flux (virtual image opening angle) when light is irradiated to the eye EY from a position in the depth direction of a portion of a stereoscopic image displayed by the pixel P (the position of a virtual image formed by the pixel P). Then, the timing setting unit 78 sets, as the irradiation timing for the pixel P, the timing at which the display unit 10 reaches a position where the distance between the display unit 10 and the irradiation position is within a predetermined distance range. The timing setting unit 78 sets an irradiation position for each pixel P and an irradiation timing for each pixel P. Note that the timing setting unit 78 sets the irradiation position and irradiation timing for each pixel P, but is not limited to different irradiation positions and irradiation timing for each pixel P. For example, the irradiation positions and irradiation timing for a group of pixels P constituting one image (such as a group of pixels P displaying an image of a house in FIG. 5) may be set to be the same.

[0030] In this embodiment, the timing setting unit 78 sequentially acquires information on the position of the display unit 10 in the Z direction from the position information acquisition unit 74, and when the position of the display unit 10 in the Z direction approaches the irradiation position by a predetermined distance, it is determined that the irradiation timing has come. The predetermined distance here may be set arbitrarily, but in order to reduce the convergence accommodation contradiction, it is preferable to set it to a distance that reduces the difference between the virtual image opening angle and the opening angle of the image light L. In addition, the timing setting unit 78 may use a value quantized in the depth direction as the position in the depth direction of the pixel P used to set the irradiation position. That is, for example, the depth direction is divided into a plurality of numerical ranges, and a predetermined value within the numerical range is set as a reference position for each numerical range. Then, the timing setting unit 78 extracts a numerical range that includes the position in the depth direction of the pixel P acquired by the image information acquisition unit 72, and treats the reference position for the numerical range as the position in the depth direction of the pixel P used to set the irradiation position.

[0031] In this manner, the timing setting unit 78 sets the irradiation timing for each pixel P. Furthermore, the timing setting unit 78 sets a timing after the irradiation timing as the irradiation stop timing. When it is determined that the irradiation timing for a certain pixel P has been reached, the irradiation control unit 80 starts irradiating the pixel P with the image light L. The irradiation control unit 80 irradiates the pixel P with the image light L from the irradiation timing to the irradiation stop timing, and when the irradiation stop timing is reached, stops irradiating the pixel P with the image light L. The irradiation stop timing may be set arbitrarily. For example, a predetermined time after the irradiation timing may be set as the irradiation stop timing, or a timing at which the distance between the display unit 10 and the irradiation position falls outside a predetermined distance range immediately after the irradiation timing may be set as the irradiation stop timing.

[0032] In this way, the display device 1 irradiates the pixel P with the image light L when the irradiation timing is reached, and stops irradiating the image light L when the irradiation stop timing is reached. The image light L is incident on the eye EY of the user U between the irradiation timing and the irradiation stop timing. Therefore, the opening angle of the light flux of the image light L incident on the eye EY becomes close to the virtual image opening angle from the virtual image formed by the pixel P, and the convergence accommodation contradiction can be reduced. Since the display unit 10 reciprocates in the Z direction, the distance from the irradiation position repeatedly becomes within a predetermined distance range and out of the predetermined distance range. The control device 60 irradiates the pixel P with the image light L every time the distance between the display unit 10 and the irradiation position becomes within the predetermined distance range, that is, every time the irradiation timing is reached. Therefore, the user U views a stereoscopic image as a moving image. Furthermore, since the display unit 10 reciprocates in the Z direction, there are two times during one period of reciprocating movement when the distance from the irradiation position becomes a predetermined distance. Therefore, it is desirable to set the frequency of the reciprocating movement of the display unit 10 to at least half the frame rate of the stereoscopic image, although the frequency (period) of the reciprocating movement of the display unit 10 may be set arbitrarily.

[0033] An example of the setting of the above-described irradiation timing will be described with reference to Fig. 5 to Fig. 7. In the following, an example will be taken in which an image of a house, an image of a car, and an image of a helicopter are displayed as a stereoscopic image, and the positions in the depth direction (Z direction) of the image of the car, the image of the house, and the image of the helicopter are farther away from the eye EY of the user U in the order of the image of the car, the image of the house, and the image of the helicopter. That is, the virtual image P2 of the image of the car is located on the Z1 side of the virtual image P1 of the image of the house, and the virtual image P3 of the image of the helicopter is located on the Z2 side of the virtual image P1 of the image of the house.

[0034] FIG. 5 is an example of a case where a virtual image P1 of a house image is visually recognized by a user U. In the example of FIG. 5, the opening angle of the light flux (virtual image opening angle) when light is irradiated from the virtual image P1 (the position in the depth direction of the pixel P constituting the image of the house) to the eye EY is set to angle θ1A. Then, at the position of the display unit 10 where the distance in the Z direction between the display unit 10 and the eyepiece lens 20 is distance D1, the opening angle of the light flux of the image light L from the pixel P constituting the image of the house is set to angle θ1A. In this case, the position where the distance in the Z direction between the eyepiece lens 20 is distance D1 becomes the irradiation position for the pixel P constituting the image of the house, and the timing setting unit 78 sets the timing when the display unit 10 reaches a position where the distance from the irradiation position is within a predetermined distance range as the irradiation timing for the pixel P constituting the image of the house. When the irradiation timing arrives, the irradiation control unit 80 causes the pixel P constituting the image of the house to be irradiated with the image light L. This makes the virtual image opening angle from the virtual image P1 of the image of the house closer to the opening angle of the image light L actually incident on the eye EY of the user U, thereby reducing the convergence accommodation conflict. Note that since the image light L is refracted by the eyepiece lens 20 and incident on the eye EY, the opening angle of the light flux of the image light L here refers to the opening angle of the light flux of the image light L after passing through the eyepiece lens 20.

[0035] FIG. 6 is an example of a case where a virtual image P2 of a car image is viewed by a user U. In the example of FIG. 6, the opening angle of the light flux (virtual image opening angle) when light is irradiated from the virtual image P2 (the position in the depth direction of the pixel P constituting the image of the car) to the eye EY is set to angle θ2A. Then, at the position of the display unit 10 where the distance in the Z direction between the display unit 10 and the eyepiece lens 20 is distance D2, the opening angle of the light flux of the image light L from the pixel P constituting the image of the car is set to angle θ2A. Note that since the virtual image P2 is viewed in the Z1 direction more than the virtual image P1, the angle θ2A is larger than the angle θ1A in FIG. 5, and the distance D2 is shorter than the distance D1 in FIG. 5. In this case, the position where the distance in the Z direction between the eyepiece lens 20 is distance D2 is the irradiation position for the pixel P constituting the image of the car, and the timing setting unit 78 sets the timing when the display unit 10 reaches a position where the distance between the display unit 10 and the irradiation position is within a predetermined distance range as the irradiation timing for the pixel P constituting the image of the car. When the irradiation timing arrives, the irradiation control unit 80 causes light to be irradiated onto the pixels P that constitute the image of the car. This makes the virtual image opening angle from the virtual image P2 of the image of the car closer to the opening angle of the image light L that actually enters the eye EY of the user U, thereby reducing the convergence accommodation conflict.

[0036] FIG. 7 shows an example of a case where a virtual image P3 of a helicopter image is viewed by a user U. In the example of FIG. 7, the opening angle of the light flux (virtual image opening angle) when light is irradiated from the virtual image P3 (the depth direction position of the pixel P constituting the helicopter image) to the eye EY is set to angle θ3A. At a position of the display unit 10 where the distance between the display unit 10 and the eyepiece lens 20 in the Z direction is distance D3, the opening angle of the light flux of the image light L from the pixel P constituting the helicopter image is set to angle θ3A. Note that since the virtual image P3 is viewed in the Z2 direction more than the virtual image P1, the angle θ3A is smaller than the angle θ1A in FIG. 5, and the distance D3 is longer than the distance D1 in FIG. 5. In this case, the position where the distance from the eyepiece lens 20 in the Z direction is distance D3 becomes the irradiation position for the pixel P constituting the helicopter image, and the timing setting unit 78 sets the timing when the display unit 10 reaches a position where the distance between the display unit 10 and the irradiation position is within a predetermined distance range as the irradiation timing for the pixel P constituting the helicopter image. When the irradiation timing arrives, the irradiation control unit 80 causes the pixel P constituting the helicopter image to be irradiated with the image light L. This makes the virtual image opening angle from the virtual image P3 of the helicopter image closer to the opening angle of the image light L that actually enters the eye EY of the user U, and reduces the convergence accommodation contradiction.

[0037] Since the display device 1 sets the illumination timing for each pixel P, there are cases where only some of the pixels P are lit in one frame. For example, only the image of the house is displayed at the timing of FIG. 5, only the image of the car is displayed at the timing of FIG. 6, and only the image of the helicopter is displayed at the timing of FIG. 7. However, due to the afterimage effect caused by consecutively displaying a plurality of frames, the user U recognizes that the house, the car, and the helicopter are in one image. Also, the entire image (here, all of the house, the car, and the helicopter) may be displayed within the display time of one frame. In this case, the drive control unit 76 may move the focal position of the eyepiece 20 by at least half the period of the reciprocating movement within the display time of one frame. This makes it possible to cover all focal positions within the reciprocating movement within the display time of one frame, and to display the entire image.

[0038] In the above description, the timing setting unit 78 sequentially acquires information on the position of the display unit 10 in the Z direction from the detection result of the position detection unit 50 and determines whether the display unit 10 has reached a predetermined distance from the irradiation position, but the present invention is not limited to this. For example, when the display unit 10 is reciprocated in the Z direction at a predetermined cycle, the position (predicted position) of the display unit 10 in the Z direction at each time can be grasped without detection by the position detection unit 50. Therefore, the timing setting unit 78 may acquire information on the position of the display unit 10 in the Z direction from the time information. In this case, the timing setting unit 78 may set the time at which the display unit 10 reaches a predetermined distance from the irradiation position as the irradiation timing based on the information on the predicted position of the display unit 10 at each time and the information on the irradiation position, and when the current time reaches the irradiation timing, it may determine that the display unit 10 has reached the irradiation position and irradiate the pixel P with the image light L.

[0039] (Processing flow) Next, the process flow of the control device 60 described above will be described. FIG. 8 is a flowchart for explaining the process flow of the control device according to this embodiment. The control device 60 causes the display unit 10 to reciprocate in the Z direction at a predetermined cycle by the drive control unit 76. The control device 60 sets the irradiation position for each pixel P from the depth information for each pixel P by the timing setting unit 78 (step S10). The control device 60 sequentially acquires the position of the display unit 10 in the Z direction by the position information acquisition unit 74, and judges for each pixel P whether the display unit 10 has reached within a predetermined distance from the irradiation position (step S12). When the display unit 10 has reached within the predetermined distance from the irradiation position (step S12; Yes), that is, when there is a pixel P for which it is judged that the display unit 10 has reached within the predetermined distance from the irradiation position, the timing setting unit 78 judges that the pixel P has reached the irradiation timing, and the irradiation control unit 80 causes the pixel P to be irradiated with image light L based on the image data (step S14). Thereafter, the irradiation of the image light L is stopped at the irradiation stop timing, and if the process is not to be ended (step S16; No), the process returns to step S10 and continues. On the other hand, if the display unit 10 has not reached within a predetermined distance from the irradiation position (step S12; No), that is, if there is no pixel P for which it is determined that the display unit 10 has reached within the predetermined distance from the irradiation position, the process returns to step S12 and the pixel P is not irradiated with light until the display unit 10 reaches within the predetermined distance from the irradiation position. If the process is to be ended in step S16 (step S16; Yes), the process ends.

[0040] (effect) As described above, the display device 1 according to this embodiment provides a stereoscopic image to the user U, and includes the display unit 10, the drive control unit 76, the timing setting unit 78, and the irradiation control unit 80. The display unit 10 includes a plurality of self-emitting pixels P, and provides a stereoscopic image to the user U by causing the image light L from the pixels P to reach the user U. The drive control unit 76 moves the display unit 10 along the optical axis direction of the image light L (Z direction in this embodiment) at a predetermined period. The timing setting unit 78 sets the irradiation timing of the image light L for each pixel P based on the position of the display unit 10 in the optical axis direction (Z direction in this embodiment). The irradiation control unit 80 causes the pixel P to be irradiated with the image light L at the irradiation timing.

[0041] Here, when a stereoscopic image is displayed, it is required to provide the user with a stereoscopic image appropriately. In contrast, in this embodiment, the display unit 10 is moved in the optical axis direction, and the timing of irradiating the image light L is set based on the position of the display unit 10 in the optical axis direction. Therefore, according to this embodiment, it is possible to make the image light L reach the user U at an appropriate timing based on the position of the display unit 10 in the optical axis direction, and a stereoscopic image can be appropriately provided to the user U. Furthermore, as described above, when a stereoscopic image is displayed, a convergence accommodation conflict may occur. In contrast, in this embodiment, the display unit 10 is moved in the optical axis direction, and the timing of irradiating the image light L is set based on the position of the display unit 10 in the optical axis direction, thereby appropriately adjusting the opening angle of the light flux of the image light L, and the convergence accommodation conflict can be reduced. Furthermore, in this embodiment, the display unit 10 is not moved each time to a position where the opening angle of the light flux of the image light L is appropriate, but is moved at a predetermined period, and light irradiation of the pixel P is controlled at a timing where the opening angle of the light flux of the image light L is appropriate. By controlling the light irradiation in this manner, control delays are suppressed, and the opening angle of the light flux of the image light L can be appropriately adjusted.

[0042] The timing setting unit 78 also sets the irradiation timing based on depth information indicating the position in the depth direction (Z direction in this embodiment) of the stereoscopic image. According to this embodiment, since the irradiation timing is set using the depth information as well, it is possible to appropriately adjust the opening angle of the light flux of the image light L according to the stereoscopic image to be displayed, and it is possible to reduce the convergence accommodation contradiction.

[0043] Further, the timing setting unit 78 acquires information on an irradiation position, which is a position in the optical axis direction of the display unit 10 such that the opening angle of the light beam of the image light L from the pixel P corresponds to the opening angle of the light beam (virtual image opening angle) when the image light L is irradiated toward the user U from a position in the depth direction in the portion of the stereoscopic image displayed by the pixel P. The timing setting unit 78 sets the timing when the display unit 10 is within a predetermined distance range from the irradiation position as the irradiation timing for the pixel P. According to this embodiment, it is possible to cause the pixel P whose opening angle of the light beam and the virtual image opening angle are close to each other to emit light, and not cause the pixel P whose opening angle of the light beam and the virtual image opening angle are far from each other to emit light, so that the convergence accommodation contradiction can be appropriately reduced.

[0044] Further, the display device 1 is provided with an eyepiece lens on the user U side of the display unit 10 in the optical axis direction. By providing the eyepiece lens, the display device 1 can provide the user U with a stereoscopic image appropriately.

[0045] Moreover, the display device 1 is a head-mounted display, and therefore, a stereoscopic image can be appropriately provided by the head-mounted display.

[0046] Second embodiment Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that a microlens array is provided. Descriptions of parts of the second embodiment that are common to the first embodiment will be omitted.

[0047] FIG. 9 is a schematic diagram of a display device according to a second embodiment. As shown in FIG. 9, in the display device 1a according to the second embodiment, a microlens array 20A is provided on the eye EY side of the user U relative to the display unit 10 in the optical axis direction of the image light L. The microlens array 20A is provided between the display unit 10 and the eyepiece lens 20 in the optical axis direction of the image light L. The microlens array 20A is an optical element in which a plurality of lenses are arranged in a matrix along a plane parallel to the display surface 10A. In this embodiment, the pitch of each lens of the microlens array 20A, that is, the distance between the centers of adjacent lenses, is approximately the same as the pitch of the pixels P of the display unit 10 (the distance between the centers of adjacent pixels P), for example, and each lens of the microlens array 20A is provided at a position facing the pixel P of the display unit 10.

[0048] In the second embodiment, the image light L from the display unit 10 passes through the microlens array 20A and the eyepiece lens 20 to reach the eye EY of the user U. Here, the amount of movement of the display unit 10 in the Z direction, that is, the distance between the position furthest in the Z1 direction and the position furthest in the Z2 direction in one cycle of reciprocating movement, needs to be set to a length such that the opening angle of the light beam of the image light L can follow the virtual image opening angle from the virtual image. In contrast, when the microlens array 20A is provided, the opening angle of the light beam of the image light L is widened by the microlens array 20A, so that the degree of change in the opening angle of the light beam of the image light L when the display unit 10 moves a unit distance (sensitivity of the degree of change in the opening angle) becomes large. Therefore, in the second embodiment, the amount of movement of the display unit 10 in the Z direction can be reduced to reduce the load on the drive unit 30 and the display unit 10 associated with the movement of the display unit 10.

[0049] In this way, in the display device 1a according to the second embodiment, the microlens array is provided on the user U side of the display unit 10 in the optical axis direction. By providing the microlens array, the display device 1a can reduce the amount of movement of the display unit 10 while reducing the convergence accommodation conflict.

[0050] FIG. 10 is a graph for explaining the difference in the amount of movement of the display unit when a microlens array is provided. In the following, the results of calculating the difference in the amount of movement required for the display unit 10 between when a microlens array is provided and when it is not provided, using optical simulation, will be explained. In this optical simulation, a 3.5-inch display, an eyepiece focal length of 40 mm, a focal length of each lens of the microlens array of 4.8 mm, and a radius of curvature of each lens of 2.5 mm were used. Note that the lens optical system of an actual HMD generally has a relatively large field curvature due to the limitations on the number of lenses constituting the eyepiece, but the magnitude of the field curvature varies depending on the lens design. Therefore, in this simulation, an ideal lens without aberration was used for calculation in order to see only the change in the focus amount. The light beam of the image light emitted from the display passes through the microlens array, becomes almost parallel light at the eyepiece, and enters the eyepoint. When the light beam is folded back at the eyepoint, it converges on an object point on the virtual image. In this simulation, the virtual image distance was set to 100 m (equivalent to infinity) as the reference, and the movement amount of the display was calculated as the focus amount when the virtual image distance was changed from 5000 mm to 1500 mm. Line N1 in Fig. 10 shows the focus amount for each virtual image distance when a microlens array is not provided, and line N2 shows the focus amount for each virtual image distance when a microlens array is provided. As shown by lines N1 and N2, when a microlens array is provided, the focus amount is reduced, and it is clear that the movement amount of the display can be reduced.

[0051] Third embodiment Next, a third embodiment will be described. The third embodiment differs from the first embodiment in that the eyepiece 20 is moved in the Z direction. In the third embodiment, the description of the configuration common to the first embodiment will be omitted.

[0052] FIG. 11 is a schematic diagram of a display device according to the third embodiment. As shown in FIG. 11, in the display device 1b according to the third embodiment, a driving unit 30 is attached to the eyepiece 20, and the driving unit 30 moves the eyepiece 20 in the Z direction. The driving control unit 76 of the third embodiment moves the eyepiece 20 so that the eyepiece 20 repeats a reciprocating movement (oscillation) in the Z direction, in which the eyepiece 20 moves a predetermined distance in the Z1 direction and then moves a predetermined distance in the Z2 direction. The driving control unit 76 moves the eyepiece 20 in a predetermined cycle along the Z direction. In other words, the driving control unit 76 causes the eyepiece 20 to reciprocate in the Z direction in a predetermined cycle. In this embodiment, the cycle of the reciprocating movement in the Z direction is constant, but is not limited to being constant, and may be changed.

[0053] Moreover, the position detection unit 50 of the third embodiment detects the position in the Z direction of the eyepiece 20. The position information acquisition unit 74 of the third embodiment causes the position detection unit 50 to detect the position in the Z direction of the eyepiece 20, and acquires the detection result of the position of the eyepiece 20 in the Z direction.

[0054] In the third embodiment, the timing setting unit 78 sets the irradiation timing based on the position of the eyepiece lens 20 in the Z direction (the optical axis direction of the image light L). More specifically, the timing setting unit 78 sets the irradiation timing based on depth information of the stereoscopic image and the position of the eyepiece lens 20 in the Z direction.

[0055] More specifically, the timing setting unit 78 acquires depth information for each pixel P. That is, the timing setting unit 78 acquires information on the position in the depth direction (Z direction) for each pixel P. Then, based on the depth information of the pixel P, the timing setting unit 78 sets an irradiation position, which is the position of the eyepiece 20 when irradiation of the image light L to the pixel P is started. The timing setting unit 78 sets, as the irradiation position for the pixel P, the position of the eyepiece 20 in the Z direction when the opening angle of the actual image light L from the pixel P matches the opening angle of the light beam (virtual image opening angle) when light is irradiated to the eye EY from a position in the depth direction of a portion of a stereoscopic image displayed by the pixel P (the position of a virtual image formed by the pixel P). Then, the timing setting unit 78 sets, as the irradiation timing for the pixel P, the timing when the eyepiece 20 reaches a position where the distance between the eyepiece 20 and the irradiation position is within a predetermined distance range. The timing setting unit 78 sets the irradiation position for each pixel P and sets the irradiation timing for each pixel P. Note that the timing setting unit 78 sets the irradiation position and irradiation timing for each pixel P, but is not limited to different irradiation positions and irradiation timing for each pixel P. For example, the irradiation positions and irradiation timing for a group of pixels P constituting one image (such as a group of pixels P displaying an image of a house in FIG. 5) may be set to be the same.

[0056] In this embodiment, the timing setting unit 78 sequentially acquires information on the Z-direction position of the eyepiece 20 from the position information acquisition unit 74, and determines that the irradiation timing has arrived when the Z-direction position of the eyepiece 20 approaches a predetermined distance from the irradiation position. The predetermined distance here may be set arbitrarily, but is preferably set to a distance that reduces the difference between the virtual image opening angle and the opening angle of the image light L in order to reduce the convergence accommodation contradiction.

[0057] In this manner, the timing setting unit 78 sets the irradiation timing for each pixel P. Furthermore, the timing setting unit 78 sets a timing subsequent to the irradiation timing as the irradiation stop timing. When it is determined that the irradiation timing for a certain pixel P has been reached, the irradiation control unit 80 starts irradiating the pixel P with the image light L. The irradiation control unit 80 irradiates the pixel P with the image light L from the irradiation timing to the irradiation stop timing, and stops irradiating the pixel P with the image light L when the irradiation stop timing is reached.

[0058] In the above description, the timing setting unit 78 sequentially acquires information on the position of the eyepiece 20 in the Z direction from the detection result of the position detection unit 50 and determines whether the eyepiece 20 has reached a predetermined distance from the irradiation position, but this is not limited to the above. For example, if the eyepiece 20 is reciprocated in the Z direction at a predetermined cycle, the position (predicted position) of the eyepiece 20 in the Z direction at each time can be grasped without detection by the position detection unit 50. Therefore, the timing setting unit 78 may acquire information on the position of the eyepiece 20 in the Z direction from the time information. In this case, the timing setting unit 78 may set the time at which the eyepiece 20 reaches a predetermined distance from the irradiation position as the irradiation timing based on the information on the predicted position of the eyepiece 20 at each time and the information on the irradiation position, and when the current time reaches the irradiation timing, it may determine that the eyepiece 20 has reached the irradiation position and irradiate the pixel P with light.

[0059] (Processing flow) Next, the process flow of the control device 60 of the third embodiment described above will be described. FIG. 12 is a flowchart for explaining the process flow of the control device according to the third embodiment. The control device 60 causes the drive control unit 76 to move the eyepiece 20 back and forth in the Z direction at a predetermined cycle. The control device 60 sets the irradiation position for each pixel P from the depth information for each pixel P using the timing setting unit 78 (step S10b). The control device 60 sequentially acquires the position of the eyepiece 20 in the Z direction using the position information acquisition unit 74, and judges for each pixel P whether the eyepiece 20 has reached within a predetermined distance from the irradiation position (step S12b). When the eyepiece 20 has reached within the predetermined distance from the irradiation position (step S12b; Yes), that is, when there is a pixel P for which it is judged that the eyepiece 20 has reached within the predetermined distance from the irradiation position, the timing setting unit 78 judges that the pixel P has reached the irradiation timing, and the irradiation control unit 80 causes the pixel P to be irradiated with image light L based on the image data (step S14b). Thereafter, the irradiation of the image light L is stopped at the irradiation stop timing, and if the process is not to be ended (step S16b; No), the process returns to step S10b and continues. On the other hand, if the eyepiece 20 has not reached within the predetermined distance from the irradiation position (step S12b; No), that is, if there is no pixel P for which it is determined that the eyepiece 20 has reached within the predetermined distance from the irradiation position, the process returns to step S12b and light is not irradiated onto pixel P until the eyepiece 20 reaches within the predetermined distance from the irradiation position. If the process is to be ended in step S16b (step S16b; Yes), the process ends.

[0060] (effect) As described above, the display device 1b according to the third embodiment provides a stereoscopic image to the user U, and includes the display unit 10, an optical element, a drive control unit 76, a timing setting unit 78, and an irradiation control unit 80. The display unit 10 includes a plurality of self-emitting pixels P, and provides a stereoscopic image to the user U by making the image light L from the pixels P reach the user U. The optical element (the eyepiece lens 20 in this embodiment) is provided on the user U side of the display unit 10 in the optical axis direction of the image light L. The drive control unit 76 moves the optical element along the optical axis direction of the image light L (the Z direction in this embodiment) at a predetermined period. The timing setting unit 78 sets the irradiation timing of the image light L for each pixel P based on the position of the optical element in the optical axis direction (the Z direction in this embodiment). The irradiation control unit 80 makes the pixel P irradiate the image light L at the irradiation timing.

[0061] Even when the optical element is moved as in the display device 1b of the third embodiment, a stereoscopic image can be appropriately provided to the user U, and the opening angle of the light flux of the image light L can be appropriately adjusted to reduce the convergence accommodation conflict, as in the first embodiment. Furthermore, the optical element is, for example, a lens made of resin or glass, and has a simpler configuration than the display unit 10, so that the risk of malfunction when moved can be reduced.

[0062] Further, the timing setting unit 78 acquires information on an irradiation position, which is a position in the optical axis direction of the optical element such that the opening angle of the light beam of the image light L from the pixel P corresponds to the opening angle of the light beam (virtual image opening angle) when the image light L is irradiated toward the user U from a position in the depth direction in the portion of the stereoscopic image displayed by the pixel P. The timing setting unit 78 sets the timing when the optical element is within a predetermined distance range from the irradiation position as the irradiation timing for the pixel P. According to this embodiment, it is possible to cause the pixel P whose opening angle of the light beam and the virtual image opening angle are close to each other to emit light, and not cause the pixel P whose opening angle of the light beam and the virtual image opening angle are far from each other to emit light, so that the convergence accommodation contradiction can be appropriately reduced.

[0063] The optical element also includes an eyepiece lens 20, and the drive control unit 76 moves the eyepiece lens 20. According to this embodiment, by moving the eyepiece lens 20, a stereoscopic image can be appropriately provided to the user U, and the opening angle of the light flux of the image light L can be appropriately adjusted to reduce the convergence accommodation conflict.

[0064] In the first embodiment, the display unit 10 is moved, and in the third embodiment, the optical element is moved. However, it is also possible to move both the display unit 10 and the optical element.

[0065] (Fourth embodiment) Next, a fourth embodiment will be described. The fourth embodiment differs from the third embodiment in that a microlens array 20A is moved in the Z direction instead of the eyepiece lens 20. In the fourth embodiment, the description of the configuration common to the third embodiment will be omitted.

[0066] FIG. 13 is a schematic diagram of a display device according to the fourth embodiment. As shown in FIG. 13, in the display device 1c according to the fourth embodiment, a microlens array 20A is provided on the eye EY side of the user U relative to the display unit 10 in the optical axis direction of the image light L. The microlens array 20A is provided between the display unit 10 and the eyepiece 20 in the optical axis direction of the image light L. In the fourth embodiment, a driving unit 30 is attached to the microlens array 20A, and the driving unit 30 moves the microlens array 20A in the Z direction. In the fourth embodiment, the contents are the same as those of the third embodiment except that the microlens array 20A is moved instead of the eyepiece 20, so other explanations will be omitted. That is, the contents of the fourth embodiment can be obtained by replacing the "eyepiece 20" in the third embodiment with the "microlens array 20A".

[0067] Thus, in the fourth embodiment, the optical element includes the microlens array 20A, and the drive control unit 76 moves the microlens array 20A. According to this embodiment, by moving the microlens array 20A, a stereoscopic image can be appropriately provided to the user U, and the opening angle of the light flux of the image light L can be appropriately adjusted to reduce the convergence accommodation conflict.

[0068] FIG. 14 is a graph for explaining the difference in the amount of movement of the display unit when a microlens array is provided. Hereinafter, the results of calculating the difference in the amount of movement required for the display unit 10 between when a microlens array is provided and when it is not provided by optical simulation will be explained. This optical simulation is the same as the optical simulation described in the second embodiment except that two types of microlens arrays with a curvature radius of 2.5 mm and 1 mm are prepared, and the microlens array is moved instead of the display. Line N1 in FIG. 14 shows the focus amount for each virtual image distance when the display is moved without providing a microlens array, line N3 shows the focus amount for each virtual image distance when a microlens array with a curvature radius of 2.5 mm is provided, and line N4 shows the focus amount for each virtual image distance when a microlens array with a curvature radius of 1 mm is provided. As shown by lines N1, N3, and N4, it can be seen that when a microlens array is provided, the focus amount is reduced and the amount of movement can be reduced.

[0069] In a configuration in which the microlens array 20A is provided as in the fourth embodiment, the eyepiece 20 may be moved as in the third embodiment, or both the eyepiece 20 and the microlens array 20A may be moved. Also, in the third embodiment, the eyepiece 20 is moved, and in the fourth embodiment, the microlens array 20A is moved, but the optical element to be moved is not limited to the eyepiece 20 or the microlens array 20A, and any optical element provided on the user U side in the optical axis direction relative to the display unit 10 may be moved.

[0070] (Modification) Next, a modified example will be described. A display device 1d according to the modified example differs from the second embodiment in that the display is enlarged by a concave mirror 20C instead of the eyepiece lens 20. Descriptions of the configurations of the modified example and the second embodiment will be omitted.

[0071] FIG. 15 is a schematic diagram of a display device according to a modified example. As shown in FIG. 15, the display device 1d according to the modified example does not have an eyepiece lens 20, and a half mirror 20B and a concave mirror 20C are provided closer to the eye EY of the user U than the display unit 10 in the optical axis direction of the image light L. The half mirror 20B and the concave mirror 20C can also be considered as optical elements. In the modified example, the image light L emitted from the display unit 10 is reflected by the half mirror 20B and enters the concave mirror 20C. The image light L that enters the concave mirror 20C becomes almost parallel light with a slight spread angle at the concave mirror 20C, and passes through the half mirror 20B to enter the eye EY of the user U.

[0072] In the modified example, the microlens array 20A is moved in the same manner as in the second embodiment. Even in the configuration of the modified example, since the microlens array 20A is moved, a stereoscopic image can be appropriately provided to the user U, and the opening angle of the light flux of the image light L can be appropriately adjusted to reduce the convergence accommodation conflict, as in the second embodiment.

[0073] The modified example can be applied to other examples. That is, in the configuration of the modified example, the display unit 10 may be moved, or an optical element other than the half mirror 20B may be moved. Also, the configuration of the display device may be other than the modified examples given in each embodiment and FIG.

[0074] Although the embodiments of the present invention have been described above, the embodiments are not limited to the contents of these embodiments. The above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined, and the configurations of each embodiment can also be combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the gist of the above-described embodiments. [Explanation of symbols]

[0075] 1 Display device 10 Display 20 Eyepiece 30 Drive unit 50 Position detection unit 60 Control device 72 Image information acquisition unit 74 Location information acquisition unit 76 Drive control unit 78 Timing setting section 80 Irradiation control unit L Image light P pixels U User

Claims

1. A display unit including a plurality of pixels and configured to provide an image to a user by emitting light from the pixels; an optical element provided on the user side of the display unit; A drive control unit that moves the optical element at a predetermined period; a timing setting unit that sets the timing of irradiating the light for each pixel based on the position of the optical element; Including, The timing setting unit sets the irradiation timing based on depth information indicating a position in a depth direction of the image, the timing setting unit acquires information on an irradiation position, which is a position of the optical element corresponding to an angle of an opening of a luminous flux of light from the pixel when the light is irradiated from a position in a depth direction of a portion of the image displayed by the pixel toward the user, and sets a timing at which the optical element comes within a predetermined distance range from the irradiation position as the irradiation timing for the pixel; The drive control unit moves the display unit at a predetermined period, the timing setting unit sets the light irradiation timing for each pixel based on a position of the display unit. Display device.

2. The display device according to claim 1 , wherein the optical element includes a microlens array, and the drive control unit moves the microlens array.

3. The display device according to claim 1 or 2, which is a head-mounted display.

4. a drive control step of moving an optical element provided on a user side of a display unit including a plurality of pixels and emitting light from the pixels, at a predetermined period; a timing setting step of setting the light irradiation timing for each pixel based on the position of the optical element; Including, In the timing setting step, the irradiation timing is set based on depth information indicating a position in a depth direction of the image; In the timing setting step, information on an irradiation position is acquired, which is a position of the optical element corresponding to an opening angle of a luminous flux of light from the pixel when the light is irradiated from a position in a depth direction in a portion of the image displayed by the pixel toward the user, and a timing when the optical element comes within a predetermined distance range from the irradiation position is set as the irradiation timing for the pixel; In the drive control step, the display unit is moved at a predetermined period, In the timing setting step, the light irradiation timing is set for each pixel based on a position of the display unit. Display control method.

5. a drive control step of moving an optical element provided on a user side of a display unit including a plurality of pixels and emitting light from the pixels, at a predetermined period; a timing setting step of setting the light irradiation timing for each pixel based on the position of the optical element; The computer executes the following: In the timing setting step, the irradiation timing is set based on depth information indicating a position in a depth direction of the image; In the timing setting step, information on an irradiation position is acquired, which is a position of the optical element corresponding to an opening angle of a luminous flux of light from the pixel when the light is irradiated from a position in a depth direction in a portion of the image displayed by the pixel toward the user, and a timing when the optical element comes within a predetermined distance range from the irradiation position is set as the irradiation timing for the pixel; In the drive control step, the display unit is moved at a predetermined period, In the timing setting step, the light irradiation timing is set for each pixel based on a position of the display unit. Display control program.

Images