Virtual image display device
Patent Information
- Application Number
- JP2022027695
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-02-25
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing virtual image display devices have limitations in detecting the line of sight beyond the viewing angle of the image light due to the smaller size of the infrared light source compared to the RGB light source, restricting the range of eye movement detection.
A virtual image display device utilizing a first and second light guide member with diffraction elements that deflect and guide image and infrared light to enhance the angle of detection, allowing the infrared light to be detected over a wider range than the image light, and incorporating a drive control device to adjust display based on line of sight direction.
Enables detection of the line of sight in a wider range than the viewing angle of the image light while maintaining device compactness, improving detection accuracy and flexibility in display adjustments.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a virtual image display device that enables the observation of a virtual image, and more particularly to a virtual image display device of the type that utilizes diffraction and light guiding. [Background technology]
[0002] A known HMD that enables observation of a virtual image is a device that includes a projector, a camera, a first light-guiding optical element, and a second light-guiding optical element, in which reflected light from the eye is taken into the second light-guiding optical element by a plurality of partially transmissive small planes incorporated in the second light-guiding optical element, and an image of the eye is taken into the camera via the first light-guiding optical element, etc., thereby enabling detection of the gaze direction (Patent Document 1). Patent Document 1 also discloses an optical system for gaze observation that incorporates a light source that emits infrared light and causes the returned reflected light to enter the camera (see Figures 18 and 19 of Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2020-504832 Summary of the Invention [Problem to be solved by the invention]
[0004] In general, in gaze detection, the image viewed by the user is smaller than the range of movement of the user's eyes, so it is desirable to detect the gaze over a range wider than the viewing angle of the image light. The device in Patent Document 1 is configured with separate IR light sources for gaze detection and RGB light sources for image light, but the size of the IR light source is smaller than that of the RGB light source, etc. This limits the range in which the movement of the user's eyes can be detected, making it difficult to detect the gaze over a range wider than the viewing angle of the image light. [Means for solving the problem]
[0005] According to one aspect of the present invention, there is provided a virtual image display device including: an image light generation device that emits image light; an infrared light emission device that emits infrared light; an infrared light receiving device that receives the infrared light; a first light guiding optical system having a first light guiding member, a first incident-side diffraction element provided on an incident side of the first light guiding member, and a first exit-side diffraction element provided on an exit side of the first light guiding member; and a second light guiding optical system having a second light guiding member, a second incident-side diffraction element provided on the incident side of the second light guiding member, and a second exit-side diffraction element provided on the exit side of the second light guiding member, wherein the first incident-side diffraction element deflects the image light emitted from the image light generation device to make it incident on the first light guiding member, and the first exit-side diffraction element deflects the image light guided by the first light guiding member to provide a virtual image to a user. the second incident-side diffraction element deflects the infrared light emitted from the infrared light emitting device and makes it incident on the second light-guiding member; the second incident-side diffraction element deflects the infrared light guided by the second light-guiding member and emits it towards the user's eye position and deflects the infrared light from the user's eye position so that it enters the second light-guiding member; the second incident-side diffraction element emits the infrared light that has been deflected by the second incident-side diffraction element and incident on the second light-guiding member towards the infrared light receiving device; the maximum value of the angle between the infrared light deflected by the second incident-side diffraction element towards the infrared light receiving device and a normal to the second incident-side diffraction element in the light-guiding direction is greater than the maximum value of the angle between the image light incident on the first incident-side diffraction element and a normal to the first incident-side diffraction element.
[0006] A virtual image display device according to one aspect of the present invention includes a first light guiding optical system including an image light generating device that emits image light, an infrared light emitting device that emits infrared light, an infrared light receiving device that receives the infrared light, a first light guiding member, a first incident-side diffraction element provided on an incident side of the first light guiding member, and a first exit-side diffraction element provided on an exit side of the first light guiding member, wherein the first incident-side diffraction element deflects the image light emitted from the image light generating device and the infrared light emitted from the infrared light emitting device, causing them to enter the first light guiding member, and the first exit-side diffraction element deflects the image light emitted from the image light generating device and the infrared light emitted from the infrared light emitting device, causing them to enter the first light guiding member, and the first exit-side diffraction element deflects the image light emitted from the image light generating device and the infrared light emitted from the infrared light receiving ... The guided image light and infrared light are deflected and emitted toward the user's eye position, and the infrared light from the user's eye position is deflected so that it enters the first light-guiding member, and the first incident-side diffraction element emits the infrared light that has been deflected by the first exit-side diffraction element and entered the first light-guiding member toward the infrared light receiving device, and the maximum value of the angle between the infrared light deflected by the first incident-side diffraction element toward the infrared light receiving device and the normal to the first incident-side diffraction element in the light-guiding direction is greater than the maximum value of the angle between the image light incident on the first incident-side diffraction element and the normal to the first incident-side diffraction element. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 2 is a plan view illustrating a state in which an HMD incorporating a virtual image display device is worn. [Figure 2] FIG. 1 is a plan view of a virtual image display device according to a first embodiment. [Figure 3] FIG. 1 is a diagram illustrating a projection device. [Figure 4] FIG. 1 is a diagram illustrating a gaze detection device. [Figure 5] 3A and 3B are diagrams illustrating the states of an infrared light source, an infrared sensor, and a display panel. [Figure 6] FIG. 10 is a conceptual perspective view illustrating a virtual image display device according to a modified example. [Figure 7] FIG. 10 is a plan view of a virtual image display device according to a second embodiment. [Figure 8] 10A and 10B are diagrams illustrating the states of an infrared light source, an infrared sensor, and a display panel according to a second embodiment. [Figure 9] FIG. 10 is a plan view of a virtual image display device according to a third embodiment. [Figure 10] 10A and 10B are diagrams illustrating the states of an infrared light source, an infrared sensor, and a display panel according to a third embodiment. [Figure 11] FIG. 10 is a plan view of a virtual image display device according to a fourth embodiment. [Figure 12] 10A and 10B are diagrams illustrating the states of an infrared light source, an infrared sensor, and a display panel according to a fourth embodiment. [Figure 13] FIG. 10 is a plan view of a virtual image display device according to a fifth embodiment. [Figure 14] 14 is a diagram illustrating a modified example of the virtual image display device shown in FIG. 13. FIG. [Figure 15] FIG. 10 is a plan view of a virtual image display device according to a sixth embodiment. [Figure 16] FIG. 13 is a plan view of a virtual image display device according to a seventh embodiment. [Figure 17] FIG. 13 is a plan view of a virtual image display device according to an eighth embodiment. [Figure 18] FIG. 13 is a plan view of a virtual image display device according to a ninth embodiment. [Figure 19] FIG. 23 is a plan view of a virtual image display device according to a tenth embodiment. [Figure 20] FIG. 23 is a plan view of a virtual image display device according to an eleventh embodiment. [Figure 21] 21 is a diagram illustrating a modified example of the virtual image display device shown in FIG. 20. FIG. [Figure 22] FIG. 23 is a plan view of a virtual image display device according to a twelfth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] [First embodiment] A first embodiment of the virtual image display device according to the present invention will be described in detail below with reference to FIG.
[0009] 1 is a diagram illustrating a wearing state of a head-mounted display (hereinafter also referred to as HMD) 200, in which the HMD 200 allows a user or wearer US wearing the HMD to recognize an image as a virtual image. In FIG. 1 and other figures, X, Y, and Z are Cartesian coordinate systems, and the +X direction corresponds to the horizontal direction in which the eyes EY of the user or wearer US wearing the HMD 200 or virtual image display device 110 are aligned, the +Y direction corresponds to the downward direction perpendicular to the horizontal direction in which the eyes EY are aligned for the wearer US, and the +Z direction corresponds to the forward or front direction for the wearer US. The ±Y directions are parallel to the vertical axis or vertical direction.
[0010] The HMD 200 includes a virtual image display device 110A for the right eye, a virtual image display device 110B for the left eye, and a support device 120 including a pair of temples 120a, 120b that supports the pair of virtual image display devices 110A, 110B. The first virtual image display device 110A is disposed so as to cover the front, i.e., the +Z side, of the right eye EY of the wearer US, and the second virtual image display device 110B is disposed so as to cover the +Z side of the left eye EY of the wearer US. The second virtual image display device 110B has a structure similar to that of the first virtual image display device 110A, but the optical structure of the first virtual image display device 110A is inverted in the left-right +X direction. The following mainly describes the first virtual image display device 110A.
[0011] A first virtual image display device 110A will be described with reference to FIGS. 2 to 4. The virtual image display device 110A shown in FIG. 2 includes a projection device 111, a gaze detection device 112, and a drive control device 80. The projection device 111 displays a virtual image toward the eye EY, and the gaze detection device 112 detects the direction of the eye EY, that is, the gaze direction. The virtual image display device 110A partially transmits external light in the visible range corresponding to a wavelength range of 450 nm to 650 nm, for example, and can display a virtual image with an external image as a background. In other words, the virtual image display device 110A is a see-through virtual image display device.
[0012] The projection device 111 includes an image light generation device 41 that emits image light FL, a first light-guiding optical system 50 that emits the image light FL in the visible range as display light GL, and a first drive circuit 61 that operates the image light generation device 41. The image light generation device 41 includes a display panel 41a and a collimator lens 41b. The image light generation device 41 is disposed on the eye position EP side of the first light-guiding optical system 50, i.e., in the -Z direction. The first light-guiding optical system 50 includes three plate-like members extending approximately parallel to the XY plane. The first diffraction light-guiding member 51, which is disposed closest to the -Z side of the first light-guiding optical system 50, is used for blue display and includes a first light-guiding plate 51a, a first incident diffraction layer 51b, and a first exit diffraction layer 51c. The second diffraction light-guiding member 52, located in the middle, is for displaying green and has a second light guide plate 52a, a second incident diffraction layer 52b, and a second exit diffraction layer 52c. The third diffraction light-guiding member 53, located closest to the +Z side, is for displaying red and has a third light guide plate 53a, a third incident diffraction layer 53b, and a third exit diffraction layer 53c. Of these, the first incident diffraction layer 51b, the second incident diffraction layer 52b, and the third incident diffraction layer 53b each function as a first incident-side diffraction element 50b and deflect the image light FL emitted from the image light generation device 41 and cause the image light FL to enter the light guide plates 51a, 52a, and 53a of the diffraction light-guiding members 51, 52, and 53 in a light-guidable state. The first, second, and third exit diffraction layers 51c, 52c, and 53c each function as a first exit-side diffraction element 50c, and emit the image light FL guided inside the light guide plates 51a, 52a, and 53a toward the outside, where the eye EY is located. The first to third light guide plates 51a, 52a, and 53a are also referred to as first light guide members 50a. The first drive circuit 61 performs signal processing under the control of the drive control device 80, and causes the display panel 41a to perform a display operation. The projection device 111 guides the image light FL generated by the display panel 41a to the eye EY of the wearer US as display light GL, thereby allowing the wearer US to view a virtual image.
[0013] The gaze detection device 112 includes an infrared light emitting device 31 that emits illumination light SL, which is infrared light of a specific wavelength, for example, in the wavelength range of 650 nm to 900 nm, an infrared light receiving device 33 that receives measurement light DL, which is infrared light of the corresponding wavelength, a second light guiding optical system 58 that guides the illumination light SL emitted from the infrared light emitting device 31 to the outside where the eye EY is located and guides the measurement light DL reflected by the eye EY to the infrared light receiving device 33, and a second drive circuit 62 that operates the infrared light emitting device 31 and the infrared light receiving device 33.
[0014] The infrared light emitting device 31 includes an infrared light source 31a and a collimator lens 31b. The infrared light receiving device 33 includes an infrared sensor 33a and a collimator lens 33b. The second light guiding optical system 58 is a plate-like member extending substantially parallel to the XY plane and is disposed closer to the eye position EP than the first light guiding optical system 50 in the normal direction of the second light guiding member 59a. This prevents the infrared light incident on the eye EY and the infrared light reflected by the eye EY from being attenuated by the first light guiding optical system 50 or the first incident-side diffraction element 50b, thereby improving the accuracy of gaze detection while maintaining display image quality. The second light guiding optical system 58 is used for infrared measurement and includes a fourth light guiding plate 58a, a first infrared diffraction layer 58b, and a second infrared diffraction layer 58c. The first infrared diffraction layer 58b and the second infrared diffraction layer 58c function as a second entrance-side diffraction element 59b and a second exit-side diffraction element 59c, respectively. The fourth light guide plate 58a is also referred to as a second light guide member 59a. The infrared light emitting device 31 is arranged closer to the second infrared diffraction layer 58c, i.e., closer to the second exit-side diffraction element 59c, than the image light generating device 41 in the X direction, which is the extension direction of the fourth light guide plate 58a. The infrared light receiving device 33 is arranged closer to the second exit-side diffraction element 59c than the image light generating device 41 and the infrared light emitting device 31 in the X direction. The infrared light emitting device 31 and the infrared light receiving device 33 are arranged on the eye position EP side of the second light guiding optical system 58, i.e., in the -Z direction.
[0015] In the first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, the first region R1 deflects the illumination light SL, which is infrared light emitted from the infrared light emitting device 31, and causes the illumination light SL to enter the fourth light guide plate 58a of the second light-guiding optical system 58 in a light-guidable state. The second region R2 emits the measurement light DL, which is infrared light that has traveled backward from the second infrared diffraction layer 58c, toward the infrared light receiving device 33. The second infrared diffraction layer 58c, i.e., the second incident-side diffraction element 59c, emits the illumination light SL, which has been guided within the fourth light guide plate 58a and propagated to the exit side, toward the outside where the eye EY is located, and deflects the measurement light DL, which is infrared light from the eye position EP, i.e., infrared light reflected by the eye EY, and causes the measurement light DL to enter the fourth light guide plate 58a in a light-guidable state. Here, the "incident side" refers to the side closer to the first incident diffraction layer 51b relative to the first exit diffraction layer 51c, i.e., on the +X side, relative to the projection device 111. The "exit side" refers to the side closer to the first incident diffraction layer 51b relative to the first exit diffraction layer 51b, i.e., on the -X side, relative to the projection device 111. The second drive circuit 62 performs signal processing under the control of the drive control device 80, causes the infrared light source 31a to perform a lighting operation at a predetermined timing, and causes the infrared sensor 33a to perform a brightness pattern detection operation. The gaze detection device 112 as a whole irradiates the eye EY of the wearer US with illumination light SL generated by the infrared light source 31a, detects the eye EY illuminated by the illumination light SL, or the measurement light DL reflected by the eye position EP and traveling backward, and generates a measurement signal. The second drive circuit 62 outputs light intensity pattern information correlated with the orientation of the eye EY to the drive control device 80.
[0016] Below, we will briefly explain the coordination between gaze detection by the gaze detection device 112 and the display operation by the projection device 111. In the gaze detection device 112, the second drive circuit 62 outputs a measurement signal corresponding to the light intensity pattern of the measurement light DL to the drive control device 80. The drive control device 80 calculates the gaze azimuth angle in the vertical Y direction and horizontal X direction based on the measurement signal from the second drive circuit 62. The drive control device 80 causes the display panel 41a to perform a display operation via the first drive circuit 61, and reflects the gaze azimuth angle in this display operation. Specifically, the drive control device 80 converts the gaze azimuth angle into layout information on the display panel 41a, specifically pixel position or localized section information, based on a conversion table stored in advance. Based on this layout information, the drive control device 80 controls the display state of the display panel 41a via the first drive circuit 61, changing the display content, brightness, or resolution. The drive control device 80 can display, for example, a mark or other object image in a local display area on the display panel 41a corresponding to the gaze direction. The drive control device 80 can increase the display brightness in any of the divided areas on the display panel 41a that correspond to the line of sight, such as the center, right, left, top, or bottom, and can decrease the display brightness or stop the display in divided areas that are out of the line of sight. The drive control device 80 can also increase the display resolution in any of the divided areas on the display panel 41a that correspond to the line of sight, such as the center, right, left, top, or bottom, and can decrease the display resolution in divided areas that are out of the line of sight.
[0017] The optical system of the projection device 111 will be described in more detail below with reference to FIG. 3. In the image light generation device 41, the display panel 41a is a display device that emits image light FL to form an image corresponding to a virtual image. Specifically, the display panel 41a is, for example, an organic EL (organic electroluminescence), inorganic EL, or LED array display, and forms a color still or moving image on a two-dimensional display surface 41d. The display panel 41a is not limited to a self-luminous image light generation device, but may be composed of an LCD or other light modulation element, and may form an image by illuminating the light modulation element with a light source such as a backlight. Instead of an LCD, the display panel 41a may also be composed of LCOS (liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like.
[0018] The collimator lens 41b is a projection optical system that includes a lens that collimates incident light, and collimates the image light FL emitted from the display surface 41d of the display panel 41a to have a predetermined beam width, and emits the parallel light at an inclination angle according to the pixel position toward the first to third incident diffraction layers 51b to 53b provided on the first to third diffraction light-guiding members 51 to 53.
[0019] In the first light guide optical system 50, the first light guide plate 51a of the first diffraction light guide member 51 for blue light is a member formed from a parallel plate and has a pair of planes 51i and 51o extending parallel to the XY plane. The first light guide plate 51a has an extension direction in the ±X directions. Here, the extension direction refers to the direction in which the first light guide plate 51a mainly extends, and corresponds to the direction from the entrance surface IS to the exit surface ES of the first light guide plate 51a. In the right region or entrance side region of the first diffraction light guide member 51, i.e., the +X side region, a first incident diffraction layer 51b is provided on the eye EY side, i.e., the -Z side, as a structure accompanying the entrance surface IS, which is a part of or an extended plane of the plane 51i. Furthermore, in the left region or exit-side region, i.e., the -X side region, of the first diffraction light-guiding member 51, a first exit diffraction layer 51c is provided on the eye EY side, i.e., the -Z side, as a structure accompanying an exit surface ES, which is a part of or an extended plane of the plane 51i. The pair of planes 51i and 51o of the first light guide plate 51a function as total reflection surfaces that totally reflect and guide the blue image light LB guided into the first light guide plate 51a via the first entrance diffraction layer 51b, and guide the image light LB with almost no loss. The first light guide plate 51a is molded from a resin or glass having a thickness of, for example, about 0.3 to 2 mm and having high optical transparency.
[0020] The first incident diffraction layer 51b is formed in a rectangular region parallel to the XY plane at a position facing the collimator lens 41b across the second light-guiding optical system 58. The first incident diffraction layer 51b guides the image light LB emitted from the display surface 41d of the display panel 41a and passing through the collimator lens 41b into the first light guide plate 51a. The first incident diffraction layer 51b can be formed integrally with the first light guide plate 51a, or it may be formed separately from the first light guide plate 51a and bonded or attached to the incident surface IS of the first light guide plate 51a. The first incident diffraction layer 51b diffracts the blue image light LB incident thereon so that it propagates within the first light guide plate 51a. Specifically, the first incident diffraction layer 51b is, for example, a surface relief diffraction grating. The first incident diffraction layer 51b includes a number of protrusions or grooves extending linearly in the vertical Y direction and is formed in a pattern having periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the first incident diffraction layer 51b are constant. The grating period of this pattern is set so that the reflection angle or incident angle in the first light guide plate 51a is larger than the critical angle determined by the refractive index of the first light guide plate 51a, so that the blue image light LB propagates within the first light guide plate 51a by total reflection. Note that the first incident diffraction layer 51b is not limited to one having periodic irregularities exposed on the surface, and may also be one having interfaces corresponding to the periodic irregularities embedded therein.
[0021] The first exit diffraction layer 51c is formed in a rectangular region parallel to the XY plane at a position on the -X side of the first entrance diffraction layer 51b and facing the eye position EP. The first exit diffraction layer 51c extracts the image light LB traveling in the -X direction as a whole within the first light guide plate 51a to the outside of the first light guide plate 51a and emits it toward the eye position EP where the eye EY of the wearer US is located. The first exit diffraction layer 51c can be formed integrally with the first light guide plate 51a, or may be formed separately from the first light guide plate 51a and joined or attached to the exit surface ES of the first light guide plate 51a. When the blue image light LB is reflected and propagated by the flat surfaces 51i and 51o of the first light guide plate 51a, the first exit diffraction layer 51c transmits the image light LB by diffraction at one of the flat surfaces 51i and 51o of the first light guide plate 51a and restores the angular information before it entered the first entrance diffraction layer 51b. Specifically, the first-emission diffraction layer 51c is, for example, a surface relief diffraction grating. The first-emission diffraction layer 51c includes a number of protrusions or grooves extending linearly in the vertical Y direction and is formed in a pattern having periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the first-emission diffraction layer 51c are constant. The grating period of this pattern in the X direction is made to match the grating period of the first incident diffraction layer 51b in the X direction. Note that the first-emission diffraction layer 51c is not limited to one having periodic irregularities exposed on the surface, and may also be one in which an interface corresponding to the periodic irregularities is embedded.
[0022] The following describes the guiding of image light LB and the formation of a virtual image using the first diffraction light-guiding member 51. The display panel 41a displays a color still or moving image on a two-dimensional display surface 41d. After passing through the collimator lens 41b, the blue image light LB from the display surface 41d is incident on the first incident diffraction layer 51b at an angle corresponding to the position of the display surface 41d in the X direction in a plan view facing the +Y direction. The blue image light LB is diffracted in an angular direction corresponding to the pitch of the pattern formed on the first incident diffraction layer 51b, and propagates while being totally reflected within the first light guide plate 51a, traveling in the −X direction as a whole. The blue image light LB propagating through the first light guide plate 51a in the −X direction as a whole is diffracted by the first exit diffraction layer 51c and exits from the position of the first exit diffraction layer 51c toward the eye EY. The image light LB emitted from the first emission diffraction layer 51c, i.e., the display light GL, reproduces the angular state in the +X direction when it is emitted from the display surface 41d, while the pupil size is enlarged in the +X direction. That is, the pupil size of the image light LB is enlarged in the horizontal direction after passing through the first diffraction light-guiding member 51, and even if the position of the eye EY is significantly shifted laterally, a virtual image formed by the blue image light LB from the display panel 41a can be observed.
[0023] The second light guide plate 52a of the second diffraction light guide member 52 for green light is a member similar to the first light guide plate 51a of the first diffraction light guide member 51, and has a pair of flat surfaces 52i, 52o extending parallel to the XY plane. In the incident-side region, i.e., +X-side region, of the second diffraction light guide member 52, a second incident diffraction layer 52b is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the incident surface IS, which is a part of the flat surface 52i or an extended flat surface. Furthermore, in the exit-side region, i.e., -X-side region, of the second diffraction light guide member 52, a second exit diffraction layer 52c is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the exit surface ES, which is a part of the flat surface 52i or an extended flat surface. A pair of flat surfaces 52i, 52o in the second light guide plate 52a function as total reflection surfaces that totally reflect and guide the green image light LG that is guided into the second light guide plate 52a via the second incident diffraction layer 52b, and guide the image light LG with almost no loss.
[0024] The second incident diffraction layer 52b is formed in a rectangular region parallel to the XY plane at a position facing the collimator lens 41b across the second light-guiding optical system 58 and the like. The second incident diffraction layer 52b guides the image light LG emitted from the display panel 41a and passing through the collimator lens 41b into the second light guide plate 52a. Like the first incident diffraction layer 51b of the first diffraction light-guiding member 51, the second incident diffraction layer 52b can be formed integrally with the second light guide plate 52a. However, the second incident diffraction layer 52b may be formed separately from the second light guide plate 52a and bonded or attached to the incident surface IS of the second light guide plate 52a. The second incident diffraction layer 52b diffracts the green image light LG and causes it to propagate inside the second light guide plate 52a. Specifically, the second incident diffraction layer 52b is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the second incident diffraction layer 52b is set so that the reflection angle or incidence angle in the second light guide plate 52a is larger than the critical angle determined by the refractive index of the second light guide plate 52a, in order to propagate the green image light LG by total reflection within the second light guide plate 52a. Note that the second incident diffraction layer 52b is not limited to one having periodic irregularities exposed on the surface, and may also be one in which interfaces corresponding to the periodic irregularities are embedded.
[0025] The second exit diffraction layer 52c is formed in a rectangular region parallel to the XY plane at a position facing the eye position EP. The second exit diffraction layer 52c extracts the image light LG, which travels in the −X direction as a whole within the second light guide plate 52a, to the outside of the second light guide plate 52a and emits it toward the eye position EP where the eye EY of the wearer US is located. Like the first exit diffraction layer 51c of the first diffraction light-guiding member 51, the second exit diffraction layer 52c can be formed integrally with the second light guide plate 52a. However, the second exit diffraction layer 52c may be formed separately from the second light guide plate 52a and bonded or attached to the exit surface ES of the second light guide plate 52a. When the green image light LG is reflected and propagated by the flat surfaces 52i and 52o of the second light guide plate 52a, the second exit diffraction layer 52c transmits the image light LG by diffraction at one of the flat surfaces 52i and 52o of the second light guide plate 52a and restores the angular information before it entered the second entrance diffraction layer 52b. Specifically, the second-outlet diffraction layer 52c is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the second-outlet diffraction layer 52c is set to match the grating period in the X direction of the second-inlet diffraction layer 52b. The second-outlet diffraction layer 52c is not limited to one having periodic irregularities exposed on the surface, but may also have an interface corresponding to the periodic irregularities embedded therein.
[0026] The guiding of green image light LG and the formation of a virtual image using the second diffractive light-guiding member 52 are similar to the guiding of blue image light LB and the formation of a virtual image using the first diffractive light-guiding member 51, and detailed explanations will be omitted.
[0027] The third light guide plate 53a of the third diffraction light guide member 53 for red light is a member similar to the first light guide plate 51a of the first diffraction light guide member 51, and has a pair of flat surfaces 53i, 53o extending parallel to the XY plane. In the incident-side region, i.e., +X-side region, of the third diffraction light guide member 53, a third incident diffraction layer 53b is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the incident surface IS, which is a part of or an extended plane of the flat surface 53i. Furthermore, in the exit-side region, i.e., -X-side region, of the third diffraction light guide member 52, a third exit diffraction layer 53c is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the exit surface ES, which is a part of or an extended plane of the flat surface 53i. A pair of flat surfaces 53i, 53o in the third light guide plate 53a function as total reflection surfaces that totally reflect and guide the red image light LR that is guided into the third light guide plate 53a via the third incident diffraction layer 53b, and guide the image light LR with almost no loss.
[0028] The third incident diffraction layer 53b is formed in a rectangular region parallel to the XY plane at a position facing the collimator lens 41b across the second light-guiding optical system 58 and the like. The third incident diffraction layer 53b guides the image light LR emitted from the display panel 41a and passing through the collimator lens 41b into the third light guide plate 53a. Like the first incident diffraction layer 51b of the first diffraction light-guiding member 51, the third incident diffraction layer 53b can be formed integrally with the third light guide plate 53a. However, the third incident diffraction layer 53b may be formed separately from the third light guide plate 53a and bonded or attached to the incident surface IS of the third light guide plate 53a. The third incident diffraction layer 53b diffracts the red image light LR and causes it to propagate inside the third light guide plate 53a. Specifically, the third incident diffraction layer 53b is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the third incident diffraction layer 53b is set so that the reflection angle or incidence angle in the third incident diffraction layer 53b is larger than a critical angle determined by the refractive index of the third incident diffraction layer 53b, in order to propagate the red image light LR by total reflection inside the third light guide plate 53a. Note that the third incident diffraction layer 53b is not limited to one having periodic irregularities exposed on its surface, and may also be one in which interfaces corresponding to the periodic irregularities are embedded.
[0029] The third exit diffraction layer 53c is formed in a rectangular region parallel to the XY plane at a position facing the eye position EP. The third exit diffraction layer 53c extracts the image light LR, which travels in the −X direction as a whole within the third light guide plate 53a, outside the third light guide plate 53a and emits it toward the eye position EP where the eye EY of the wearer US is located. Like the first exit diffraction layer 51c of the first diffraction light-guiding member 51, the third exit diffraction layer 53c can be formed integrally with the third light guide plate 53a. However, the third exit diffraction layer 53c may be formed separately from the third light guide plate 53a and bonded or attached to the exit surface ES of the third light guide plate 53a. When the red image light LR is reflected and propagated by the flat surfaces 53i and 53o of the third light guide plate 53a, the third exit diffraction layer 53c transmits the image light LR by diffraction at some point while restoring the angular information before it entered the third entrance diffraction layer 53b. Specifically, the third-emission diffraction layer 53c is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the third-emission diffraction layer 53c is set to match the grating period in the X direction of the third-incoming diffraction layer 53b. Note that the third-emission diffraction layer 53c is not limited to one having periodic irregularities exposed on the surface, but may also have an interface corresponding to the periodic irregularities embedded therein.
[0030] The guiding of red-green image light LR and the formation of a virtual image using the third diffraction light-guiding member 53 are similar to the guiding of blue image light LB and the formation of a virtual image using the first diffraction light-guiding member 51, and detailed explanations will be omitted.
[0031] On the incident side, the visible image light FL passes with little loss through the first infrared diffraction layer 58b of the second light guiding optical system for infrared 58. Note that because the pitch of the diffraction grating of the first infrared diffraction layer 58b of the second light guiding optical system 58 is relatively larger than the pitch of the diffraction gratings of the third incident diffraction layer 53b and the like, the visible image light FL is partially diffracted by the first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, although depending on its wavelength, but does not satisfy the total reflection condition of the fourth light guiding plate 58a and passes through the fourth light guiding plate 58a to deviate from the optical path.
[0032] Of the image light FL that passes through the second light-guiding optical system 58 and is incident on the first incident diffraction layer 51b of the first diffraction light-guiding member 51, blue image light LB is efficiently diffracted by the first incident diffraction layer 51b and propagates through the first light guide plate 51a, but is partially transmitted through the first incident diffraction layer 51b. Of the image light FL that is incident on the first incident diffraction layer 51b, green image light LG is partially diffracted by the first incident diffraction layer 51b and propagates through the first light guide plate 51a, but is mostly transmitted through the first incident diffraction layer 51b. Of the image light FL that is incident on the first incident diffraction layer 51b, red image light LR does not have a diffracted solution and passes through the first light guide plate 51a.
[0033] The green image light LG that passes through the second light-guiding optical system 58 and the first diffraction light-guiding member 51 and enters the second incident diffraction layer 52b of the second diffraction light-guiding member 52 is efficiently diffracted by the second incident diffraction layer 52b and propagates through the second light guide plate 52a, but is partially transmitted through the second incident diffraction layer 52b. On the other hand, the blue image light LB that enters the second incident diffraction layer 52b is diffracted by the second incident diffraction layer 52b, but the diffraction angle is small, resulting in significant propagation loss. Of the image light FL that enters the second incident diffraction layer 52b, the red image light LR is partially diffracted by the second incident diffraction layer 52b and propagates through the second light guide plate 52a, but most of it passes through the second incident diffraction layer 52b. The diffraction efficiency of the red image light LR propagating through the second light guide plate 52a is significantly lower than the diffraction efficiency of the green image light LG.
[0034] The red image light LR passes through the second light guide optical system 58, the first diffraction light guide member 51, and the second diffraction light guide member 52 and enters the third incident diffraction layer 53b of the third diffraction light guide member 53. The red image light LR is efficiently diffracted by the third incident diffraction layer 53b and propagates through the third light guide plate 53a, but is partially transmitted through the third incident diffraction layer 53b. On the other hand, the green image light LG that enters the third incident diffraction layer 53b is diffracted by the third incident diffraction layer 53b, but the diffraction angle is small, resulting in a large propagation loss. The blue image light LB that enters the third incident diffraction layer 53b is diffracted by the third incident diffraction layer 53b, but the diffraction angle is even smaller, so the blue image light LB does not satisfy the total internal reflection condition of the third light guide plate 53a and passes through the third light guide plate 53a.
[0035] On the exit side, the blue image light LB exiting from the first exit diffraction layer 51c of the first diffraction light-guiding member 51 is partially diffracted by the second infrared diffraction layer 58c of the second light-guiding optical system 58, i.e., the second exit-side diffraction element 59c, but most of the light passes through the second exit-side diffraction element 59c. The green image light LG exiting from the second exit diffraction layer 52c of the second diffraction light-guiding member 52 is partially diffracted by the first exit diffraction layer 51c of the first diffraction light-guiding member 51 or the second exit-side diffraction element 59c of the second light-guiding optical system 58, but most of the light passes through the first exit diffraction layer 51c and the second exit-side diffraction element 59c. The red image light LR emitted from the third exit diffraction layer 53c of the third diffraction light-guiding member 53 is partially diffracted by the first exit diffraction layer 51c of the first diffraction light-guiding member 51, the second exit diffraction layer 52c of the second diffraction light-guiding member 52, and the second exit-side diffraction element 59c of the second light-guiding optical system 58, but most of the light passes through the first exit diffraction layer 51c, the second exit diffraction layer 52c, and the second exit-side diffraction element 59c.
[0036] The optical system of the gaze detection device 112 will be described in more detail below with reference to FIG. 4. In the infrared light emitting device 31, the infrared light source 31a is an optical device that emits illumination light SL, which is infrared light. Specifically, the infrared light source 31a is, for example, an LED array, and forms a predetermined two-dimensional infrared light emission pattern on the light emitting surface 31d. The infrared light source 31a is not limited to one that emits light itself, and may be a combination of a light source and a filter, as long as it can form a discrete light emission pattern or a continuous light emission pattern.
[0037] The collimator lens 31b includes a lens that collimates the incident light, and collimates the illumination light SL emitted from the light-emitting surface 31d of the infrared light source 31a to have a predetermined beam width, and emits the parallel light at an inclination angle according to the pattern position toward the first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, provided in the second light-guiding optical system 58.
[0038] In the infrared light receiving device 33, the infrared sensor 33a is an optical device that detects the measurement light DL, which is infrared light. Specifically, the infrared sensor 33a is, for example, a photodiode array, and detects a two-dimensional infrared projection pattern formed on the photosensitive surface 33d. The infrared sensor 33a may be any sensor that can detect a discrete brightness pattern or a continuous brightness pattern.
[0039] The collimator lens 33b includes a lens that collimates incident light and focuses the parallel components of the infrared measurement light DL emitted from the first infrared diffraction layer 58b onto the photosensitive surface 33d. At this time, the measurement light DL is incident on the photosensitive surface 33d at a position corresponding to the tilt angle of the measurement light DL with respect to the fourth light guide plate 58a. In other words, the infrared brightness pattern formed on the photosensitive surface 33d reflects the distribution of the tilt angle state of the measurement light DL.
[0040] In the second light-guiding optical system 58, the fourth light-guiding plate 58a is a member formed from a parallel plate and has a pair of flat surfaces 58i and 58o extending parallel to the XY plane. The extension direction of the fourth light-guiding plate 58a is the ±X direction. Here, the extension direction refers to the direction in which the fourth light-guiding plate 58a primarily extends, corresponding to the direction from the incident surface IS of the fourth light-guiding plate 58a through the light-receiving surface RS to the target surface OS. In the right-side region or incident-side region of the second light-guiding optical system 58, i.e., the +X side region, a first infrared diffraction layer 58b is provided on the eye EY side, i.e., the -Z side, as a structure associated with the incident surface IS and the light-receiving surface RS, which are part of the flat surface 58i. Furthermore, in the left-side region or exit-side region of the second light-guiding optical system 58, i.e., the -X side region, a second infrared diffraction layer 58c is provided on the eye EY side, i.e., the -Z side, as a structure associated with the target surface OS, which is part of the flat surface 58i or an extended plane of the flat surface 58i. A pair of flat surfaces 58i, 58o in the fourth light guide plate 58a function as total reflection surfaces that totally reflect and guide the infrared illumination light SL that has been guided into the fourth light guide plate 58a via the first infrared diffraction layer 58b, and guide the illumination light SL with almost no loss. The fourth light guide plate 58a has a thickness of, for example, about 1 to 2 mm and is made of resin or glass that has high optical transparency.
[0041] The first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, faces the infrared light emitting device 31, the infrared light receiving device 33, and the image light generating device 41 and is provided in a rectangular region parallel to the XY plane. The second incident-side diffraction element 59b can be formed integrally with the fourth light guide plate 58a, or may be formed separately from the fourth light guide plate 58a and bonded or attached to the incident surface IS of the fourth light guide plate 58a. In the second incident-side diffraction element 59b, the first region R1 faces the collimator lens 31b and guides the illumination light SL that is emitted from the light-emitting surface 31d of the infrared light source 31a and passes through the collimator lens 31b into the interior of the fourth light guide plate 58a. The second region R2 extracts the measurement light DL traveling in the +X direction within the fourth light guide plate 58a as a whole from the fourth light guide plate 58a, emits it toward the collimator lens 33b, and makes it incident on the infrared sensor 33a. The second incident-side diffraction element 59b takes in the infrared illumination light SL that has entered the first region R1 so that it propagates within the fourth light guide plate 58a by diffraction, or emits the measurement light DL that has traveled backward through the fourth light guide plate 58a and entered the second region R2 by diffraction to the outside of the fourth light guide plate 58a by diffraction. The second incident-side diffraction element 59b is, for example, a surface relief diffraction grating. The second incident-side diffraction element 59b is formed in a pattern that includes numerous protrusions or grooves that extend linearly in the vertical Y direction and has periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the second incident-side diffraction element 59b are constant. The grating period of this pattern is set so that the reflection angle or incidence angle in fourth light guide plate 58a is larger than the critical angle determined by the refractive index of fourth light guide plate 58a, so that the illumination light SL or measurement light DL propagates by total reflection within fourth light guide plate 58a. Note that second incident-side diffraction element 59b is not limited to having periodic irregularities exposed on the surface, and may also have interfaces corresponding to the periodic irregularities embedded.
[0042] The second infrared diffraction layer 58c, i.e., the second exit-side diffraction element 59c, is formed in a rectangular region parallel to the XY plane at a position facing the eye position EP. The second exit-side diffraction element 59c diffracts the illumination light SL traveling in the −X direction overall within the fourth light guide plate 58a to the outside of the fourth light guide plate 58a and emits it toward the eye position EP where the eye EY of the wearer US is located, while diffracting the measurement light DL reflected at the eye position EP and incident on the second infrared diffraction layer 58c into the fourth light guide plate 58a so that the measurement light DL travels in the +X direction overall. The second exit-side diffraction element 59c can be formed integrally with the fourth light guide plate 58a, or it may be formed separately from the fourth light guide plate 58a and bonded or attached to the target surface OS of the fourth light guide plate 58a. Specifically, the second exit-side diffraction element 59c is, for example, a surface relief diffraction grating. The second exit-side diffraction element 59c is formed with a pattern that includes a large number of protrusions or grooves that extend linearly in the vertical Y direction and that has periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the second exit-side diffraction element 59c are constant. The grating period of this pattern is made to match the grating period in the X direction of the second entrance-side diffraction element 59b. Note that the second exit-side diffraction element 59c is not limited to one in which the periodic irregularities are exposed on the surface, and it may also be one in which an interface corresponding to the periodic irregularities is embedded.
[0043] A portion of the illumination light SL that is incident on the first region R1 of the second incident-side diffraction element 59b of the second light-guiding optical system 58 travels straight without being diffracted by the second incident-side diffraction element 59b, but passes through the first diffraction light-guiding member 51, the second diffraction light-guiding member 52, and the third diffraction light-guiding member 53. Part of the measurement light DL that is incident on the second exit-side diffraction element 59c of the second light-guiding optical system 58 passes through the second exit-side diffraction element 59c and is incident on the first exit diffraction layer 51c, the second exit diffraction layer 52c, and the third exit diffraction layer 53c, but is hardly coupled to the first diffraction light-guiding member 51, the second diffraction light-guiding member 52, and the third diffraction light-guiding member 53 because there is no diffraction solution or the diffraction efficiency is low.
[0044] FIG. 5 is a diagram illustrating a specific example of the infrared light source 31a, the infrared sensor 33a, and the display panel 41a. In FIG. 5, area AR1 is a front view of the light-emitting surface 31d of the infrared light source 31a, area AR2 is a front view of the photosensitive surface 33d of the infrared sensor 33a, and area AR3 is a front view of the display surface 41d of the display panel 41a. FIG. 5 illustrates an example in which the infrared light source 31a emits light in a discrete light emission pattern and an example in which the infrared sensor 33a detects a discrete brightness pattern. In areas AR1 and AR2 in FIG. 5, the effective area AI of the visible light image is shown superimposed on the effective areas AL and AD of the infrared light.
[0045] 2, the effective area AL which is the light-emitting area of the infrared light emitting device 31 is larger than the effective area AI which is the display area of the image light generation device 41. In other words, the light-emitting area of the infrared light emitting device 31 is larger than the display area of the image light generation device 41. In addition, the effective area AD which is the light-receiving area of the infrared light receiving device 33 is larger than the effective area AI which is the display area of the image light generation device 41. In other words, the light-receiving area of the infrared light receiving device 33 is larger than the display area of the image light generation device 41. It is preferable that the effective area AL of the infrared light emitting device 31 is approximately the same size as the effective area AD of the infrared light receiving device 33. The width 2Wα in the X direction of the effective areas AL, AD of the infrared light is slightly larger than the width 2Wβ in the X direction of the effective area AI of the visible light image. In the illustrated example, the vertical width 2Hα in the Y direction of the effective areas AL and AD of the infrared light is slightly larger than the vertical width 2Hβ in the Y direction of the effective area AI of the visible light image. As a result, the field of view range or viewing angle of the illumination light SL and measurement light DL for the effective areas AL and AD is relatively wider than the field of view range or viewing angle of the image light FL. The effective areas AL, AD, and AI are the device areas of each device 31, 33, and 41, and are arranged approximately symmetrically with respect to reference lines S1 and S2 that pass through the center and extend parallel to the Y direction or X direction. Here, the field of view corresponds to the field angle for the image light generation device 41, and means the azimuthal spread of the infrared light for the infrared light emitting device 31 and the infrared light receiving device 33.
[0046] In the light-emitting surface 31d of the infrared light source 31a, light-emitting points 31p, which are light-emitting elements, are arranged in a grid pattern at predetermined intervals in the effective area AL. In the photosensitive surface 33d of the infrared sensor 33a, detection points 33p, which are light-receiving elements, are arranged in a grid pattern at predetermined intervals in the effective area AD. In the display surface 41d of the display panel 41a, pixels 41r or pixel points 41p of the display area are arranged in a grid pattern in the effective area AI.
[0047] The number or density of the light-emitting points 31p of the infrared light source 31a is smaller than the number or density of the pixels 41r of the display panel 41a. Furthermore, the number or density of the detection points 33p of the infrared sensor 33a is smaller than the number or density of the pixels 41r of the display panel 41a. This allows the number of detection points 33p to be reduced to match the resolution of gaze direction detection, simplifying the structure of the infrared light receiving device 33 and suppressing an increase in the amount of information processing. Each pixel 41r is composed of, for example, four pixel points 41p. Specifically, one pixel 41r includes one red pixel point 41p, one blue pixel point 41p, and two green pixel points 41p. It is preferable that the number of light-emitting points 31p of the infrared light source 31a is approximately the same as the number of detection points 33p of the infrared sensor 33a. Specifically, the light-emitting points 31p are discretely arranged in the effective area AL, for example, in a 19×11 matrix. The detection points 33p are discretely arranged in the effective area AD in a number of, for example, 19x11 pixels in the horizontal and vertical directions. The pixels 41r are discretely arranged in the effective area AI in a number of, for example, 1920x1080 pixels in the horizontal and vertical directions. The pixels 41r are formed by two-dimensionally arranging groups of RGB pixels. The number and sizes of the light-emitting points 31p and detection points 33p can be changed as appropriate. For example, the light-emitting points 31p and detection points 33p may not be discretely arranged as described above, but may be increased in size and arranged continuously.
[0048] The maximum value of the angle α between the measurement light DL deflected by the second incident-side diffraction element 59b toward the infrared light receiving device 33 shown in FIG. 2 and the normal NL of the second incident-side diffraction element 59b in the light guiding direction is larger than the maximum value of the angle β between the image light FL incident on the first incident-side diffraction element 50b and the normal NL of the first incident-side diffraction element 50b. Here, the normal NL of the second incident-side diffraction element 59b corresponds to the normal of the infrared light receiving device 33. The normal of the first incident-side diffraction element 50b or the second incident-side diffraction element 59b is the normal to the plane in which the diffraction element as a whole extends. As shown in FIGS. 2 and 5, in the infrared light receiving device 33, the length Wα from the reference line S1 passing through the center of the effective area AD to the outer frame of the effective area AD in the horizontal X direction corresponds to the maximum value of the angle α between the measurement light DL and the normal NL of the second incident-side diffraction element 59b. The maximum value of the angle α corresponds to the angle of view or viewing angle of the measurement light DL received by the infrared light receiving device 33. Furthermore, in the image light generation device 41, the length Wβ from the reference line S1 passing through the center of the effective area AI in the X direction to the outer frame of the effective area AI corresponds to the maximum value of the angle β formed between the image light FL and the normal NL of the first incident-side diffraction element 50b. The maximum value of the angle β corresponds to the angle of view or viewing angle of the image light FL emitted from the image light generation device 41. The angles α and β have the relationship α>β.
[0049] The same relationship of α>β holds true between the maximum value of the angle α between the illumination light SL in the infrared light emitting device 31 and the normal NL of the second incident-side diffraction element 59b and the maximum value of the angle β between the image light FL in the image light generating device 41 and the normal NL of the first incident-side diffraction element 50b. While the horizontal X-direction angles α and β have been compared above, a similar relationship holds true for the vertical angles α' and β'. It is sufficient that the maximum value of the angle α between the measurement light DL deflected by the second incident-side diffraction element 59b toward the infrared light receiving device 33 and the normal NL of the second incident-side diffraction element 59b in the light guide direction is greater than the maximum value of the angle β between the image light FL incident on the first incident-side diffraction element 50b and the normal NL of the first incident-side diffraction element 50b, in either the horizontal or vertical direction. The relationship of angle α>β preferably holds true when considering the diagonal angles as a whole.
[0050] 2 is illuminated by illumination light SL having an angular distribution that reflects the light-emitting point 31p, corresponding to the light-emitting surface 31d of the infrared light source 31a. Meanwhile, measurement light DL, which is reflected light from the eye position EP, has an angular distribution that reflects the irradiation pattern of the illumination light SL and the orientation of the eye EY, and forms a brightness pattern on the photosensitive surface 33d of the infrared sensor 33a. Light intensity pattern information measured by the photosensitive surface 33d is output to the drive control device 80 via the second drive circuit 62. The drive control device 80 stores correlation data obtained by measuring in advance the correlation between the light intensity pattern information and the orientation of the eye EY. Based on the correlation data, the drive control device 80 can estimate the orientation of the eye EY, i.e., the gaze direction, from the light intensity pattern information.
[0051] FIG. 6 is a conceptual perspective view illustrating a virtual image display device 110A of a modified example. In this case, the second light guide optical system 158 includes a fourth light guide plate 58a, a second incident-side diffraction element 59b, a second exit-side diffraction element 159c, and an intermediate diffraction element 59m. As described above, the second incident-side diffraction element 59b is formed with a diffraction pattern that extends linearly in the vertical Y direction and periodically repeats in the horizontal X direction. The second exit-side diffraction element 159c is formed with a diffraction pattern that extends linearly in the horizontal X direction and periodically repeats in the vertical Y direction. The intermediate diffraction element 59m is formed with a diffraction pattern that extends linearly in the oblique DS1 direction parallel to the XY plane and periodically repeats in the DS2 direction parallel to the XY plane and perpendicular to the DS1 direction. The DS1 direction is rotated 45° counterclockwise with respect to the +X direction and is intermediate between the +X direction and the +Y direction. The grating period in the DS2 direction of the pattern formed on the intermediate diffraction element 59m matches the grating period in the X direction of the pattern formed on the second incident-side diffraction element 59b, and also matches the grating period in the Y direction of the pattern formed on the second exit-side diffraction element 159c.
[0052] The illumination light SL from the infrared light output device 31 enters the second incident-side diffraction element 59b at an angle corresponding to the position of the light-emitting surface 31d in the X direction, is diffracted, and is taken into the fourth light guide plate 58a. The illumination light SL propagates in the -X direction while being totally reflected within the fourth light guide plate 58a, traveling in the -X direction as a whole. The illumination light SL propagates in the -X direction within the fourth light guide plate 58a by diffracting the intermediate diffraction element 59m, bending its overall optical path in the +Y direction, and is shifted to a position in the -X direction that reflects the number of reflections before being diffracted by the intermediate diffraction element 59m. In other words, the intermediate diffraction element 59m serves to expand the horizontal pupil size, which corresponds to the width of the ray of illumination light SL incident on the eye EY in the lateral or X direction. The illumination light SL propagates in the +Y direction throughout the fourth light guide plate 58a via the intermediate diffraction element 59m, and is diffracted by the second exit-side diffraction element 159c and emitted toward the eye EY. The illumination light SL emitted from the second emission-side diffraction element 159c has an expanded pupil size in the +X direction while reproducing the angular state in the +X and +Y directions when emitted from the infrared light emission device 31. In other words, the second light-guiding optical system 158 expands the pupil size in both the vertical and horizontal directions.
[0053] The measurement light DL, which is reflected light from the eye EY illuminated by the illumination light SL, is introduced into the fourth light guide plate 58a by the second exit-side diffraction element 159c, travels backward through the intermediate diffraction element 59m, is extracted to the outside of the fourth light guide plate 58a by the second entrance-side diffraction element 59b, and is incident on the infrared light receiving device 33. The infrared light receiving device 33 acquires luminance pattern information related to the line of sight of the eye EY from an area corresponding to the pupil size enlarged by the second light-guiding optical system 158.
[0054] Although detailed description will be omitted, in the first light guiding optical system 50, the first diffraction light guiding member 51 for blue light includes an incident-side diffraction element, an exit-side diffraction element, and an intermediate diffraction element as elements corresponding to the second incident-side diffraction element 59b, the second exit-side diffraction element 159c, and the intermediate diffraction element 59m of the second light guiding optical system 158. Similarly, the second diffraction light guiding member 52 for green light includes an incident-side diffraction element, an exit-side diffraction element, and an intermediate diffraction element. Furthermore, the third diffraction light guiding member 53 for red light includes an incident-side diffraction element, an exit-side diffraction element, and an intermediate diffraction element.
[0055] The virtual image display device 110 of the first embodiment described above includes the image light generation device 41 that emits image light FL, the infrared light emission device 31 that emits infrared light, the infrared light reception device 33 that receives the infrared light, the first light guiding member 50a, the first light guiding optical system 50 that has the first incident-side diffraction element 50b provided on the incident side of the first light guiding member 50a, and the first exit-side diffraction element 50c provided on the exit side of the first light guiding member 50a, and the second light guiding unit 50b. a second light-guiding optical system 58 having a first light-guiding member 59a, a second incident-side diffraction element 59b provided on the incident side of the second light-guiding member 59a, and a second exit-side diffraction element 59c provided on the exit side of the second light-guiding member 59a, wherein the first incident-side diffraction element 50b deflects the image light FL emitted from the image light generating device 41 and makes it incident on the first light-guiding member 50a, and the first exit-side diffraction element 50c deflects the image light FL guided by the first light-guiding member 50a. The second incident-side diffraction element 59b deflects the infrared light emitted from the infrared light emitting device 31 and makes it incident on the second light-guiding member 59a, the second exit-side diffraction element 59c deflects the infrared light guided by the second light-guiding member 59a and emits it towards the user's eye position EP, and deflects the infrared light from the user's eye position EP so that it is incident on the second light-guiding member 59a, and the second incident-side diffraction element 59b The infrared light deflected by the second exit-side diffraction element 59c and incident on the second light-guiding member 59a is emitted toward the infrared light receiving device 33, and the maximum value of the angle formed by the infrared light deflected by the second entrance-side diffraction element 59b toward the infrared light receiving device 33 and the normal NL of the second entrance-side diffraction element 59b in the light-guiding direction is greater than the maximum value of the angle formed by the image light FL incident on the first entrance-side diffraction element 50b and the normal NL of the first entrance-side diffraction element 50b.
[0056] In the above virtual image display device, the maximum angle formed by the infrared light deflected by the second incident-side diffraction element 59b toward the infrared light receiving device 33 and the normal NL of the second incident-side diffraction element 59b is greater than the maximum angle formed by the image light FL incident on the first incident-side diffraction element 50b and the normal NL of the first incident-side diffraction element 50b, so that the user's line of sight can be detected at a field of view wider than the field of view of the image light FL and the device can be prevented from becoming larger.
[0057] Second Embodiment Hereinafter, a virtual image display device according to a second embodiment of the present invention will be described. Note that the virtual image display device of the second embodiment is a partial modification of the virtual image display device of the first embodiment, and a description of common parts will be omitted.
[0058] The virtual image display device 110 of the second embodiment shown in FIG. 7 is a first virtual image display device 110A for the right eye, and a second virtual image display device 110B for the left eye (see FIG. 1) is not shown.
[0059] In the gaze detection device 112 of the first virtual image display device 110A, the infrared light composite device 131 combines the infrared light emitting device 31 and the infrared light receiving device 33 shown in Fig. 2. The infrared light composite device 131 has a composite unit 131a and a collimator lens 131b. The composite unit 131a combines the infrared light source 31a and the infrared sensor 33a shown in Fig. 2. There are no changes to the first light guiding optical system 50 and the second light guiding optical system 58, and therefore a description thereof will be omitted.
[0060] 8, in the composite unit 131a, the light-emitting point 31p, which is a light-emitting element, and the detection point 33p, which is a light-receiving element, are arranged on the same plane SS. Specifically, the light-emitting point 31p and the detection point 33p are formed on the same device and coexist in approximately the same region.
[0061] 7, the width 2Wα and the height 2Hα of the effective area AD, which is the light-receiving area of the infrared light composite device 131, are slightly larger than the width 2Wβ and the height 2Hβ of the effective area AI, which is the display area of the image light generation device 41. In the example shown, the width 2Wα' of the effective area AL, which is the light-emitting area of the infrared light composite device 131, is approximately the same as the width 2Wβ of the effective area AI, which is the display area of the image light generation device 41, and the height 2Hα of the effective area AL is larger than the height 2Hβ of the effective area AI. Note that the effective area AL may be larger than the effective area AI in the X direction.
[0062] The maximum value of the angle α between the measurement light DL deflected by the second incident-side diffraction element 59b toward the infrared-light composite device 131 and the normal to the second incident-side diffraction element 59b is larger than the maximum value of the angle β between the image light FL incident on the first incident-side diffraction element 50b and the normal to the first incident-side diffraction element 50b. As shown in FIG. 8 , in the infrared-light composite device 131, the length Wα from the reference line S1 of the effective area AD to the outer frame of the effective area AD corresponds to the maximum value of the angle α between the measurement light DL and the normal to the second incident-side diffraction element 59b. Also, in the image light generation device 41, the length Wβ from the reference line S1 of the effective area AI to the outer frame of the effective area AI corresponds to the maximum value of the angle β between the image light FL and the normal to the first incident-side diffraction element 50b. The angle α and the angle β have a relationship of α>β.
[0063] In the example of FIG. 8, in the combined unit 131a of the infrared light combined device 131, the light emitting points 31p and the detection points 33p are arranged in a one-to-one relationship, but the arrangement and corresponding numbers may be biased.
[0064] In the virtual image display device 110 of the second embodiment described above, by arranging the light emitting point 31p and the detection point 33p on the same plane SS in the composite unit 131a, the infrared light composite device 131, which is the active device of the virtual image display device 110, can be made compact, and the width size of the device, i.e., the size in the X direction, can be reduced.
[0065] Third Embodiment The following describes a virtual image display device according to the third embodiment. The virtual image display device of the third embodiment is a partial modification of the virtual image display device of the first embodiment.
[0066] In the projection device 111 of the first virtual image display device 110A shown in Fig. 9, the light-source composite device 141 combines the image light generation device 41 and the infrared light emission device 31 shown in Fig. 2. The light-source composite device 141 has a composite unit 141a and a collimator lens 141b. The composite unit 141a combines the display panel 41a and the infrared light source 31a shown in Fig. 2. The first light-guiding optical system 50 and the second light-guiding optical system 58 remain unchanged, and therefore their description will be omitted.
[0067] In controlling the operation of the display panel and the infrared light source of the combined unit 141a, the first drive circuit 61 synchronizes the display operation of the display panel with the lighting operation of the infrared light source to adjust the light emission timing.
[0068] In the example of FIG. 9, the infrared light source of the composite unit 141a is configured to be operated by the first drive circuit 61, but it may also be configured to be operated by the second drive circuit 62, as in the first embodiment.
[0069] As shown in FIG. 10, in the composite unit 141a, the light-emitting points 31p, which are light-emitting elements, and the pixels 41r are arranged on the same surface SS. Because the number of light-emitting points 31p is not as many as the pixels 41r, the light-emitting points 31p are arranged in the effective area AI in a portion where the pixel points 41p constituting the pixels 41r in the effective area AI have been thinned out. In the example shown in the figure, a configuration can be adopted in which one of the green pixel points 41p of the pixel 41r, which is composed of one red pixel point 41p, one blue pixel point 41p, and two green pixel points 41p, is replaced with the light-emitting point 31p. Note that the arrangement of the light-emitting points 31p and the pixels 41r or pixel points 41p is not limited to the illustrated arrangement, and the light-emitting points 31p may be arranged only on the periphery of the effective area AI.
[0070] 9, the width 2Wα and the height 2Hα of the effective area AD, which is the light-receiving area of the infrared light receiving device 33, are slightly larger than the width 2Wβ and the height 2Hβ of the effective area AI, which is the display area of the light-source composite device 141. In the illustrated example, the width 2Wα and the height 2Hα of the effective area AL, which is the light-emitting area of the light-source composite device 141, are slightly larger than the width 2Wβ and the height 2Hβ of the effective area AI, which is the display area of the light-source composite device 141.
[0071] The maximum value of the angle α between the measurement light DL deflected by the second incident-side diffraction element 59b toward the infrared light receiving device 33 and the normal to the second incident-side diffraction element 59b is larger than the maximum value of the angle β between the image light FL incident on the first incident-side diffraction element 50b and the normal to the first incident-side diffraction element 50b. As shown in FIG. 10 , in the infrared light receiving device 33, the length Wα from the reference line S1 of the effective area AD to the outer frame of the effective area AD corresponds to the maximum value of the angle α between the measurement light DL and the normal to the second incident-side diffraction element 59b. Furthermore, in the light-source composite device 141, the length Wβ from the reference line S1 of the effective area AI to the outer frame of the effective area AI corresponds to the maximum value of the angle β between the image light FL and the normal to the first incident-side diffraction element 50b. The angle α and the angle β have a relationship of α>β.
[0072] In the virtual image display device 110 of the third embodiment described above, by arranging the light-emitting point 31p and the pixel 41r on the same surface SS in the composite unit 141a, the light source composite device 141, which is the active device of the virtual image display device 110, can be made compact, and the width size of the device, i.e., the size in the X direction, can be reduced.
[0073] [Fourth embodiment] The virtual image display device according to the fourth embodiment will be described below. The virtual image display device according to the fourth embodiment is a partial modification of the virtual image display device according to the first embodiment.
[0074] In the projection device 111 or the gaze detection device 112 of the first virtual image display device 110A shown in Fig. 11, a composite device 241 combines the image light generation device 41, the infrared light emission device 31, and the infrared light reception device 33 shown in Fig. 2. The composite device 241 has a composite unit 241a and a collimator lens 241b. The composite unit 241a combines the display panel 41a, the infrared light source 31a, and the infrared sensor 33a shown in Fig. 2. The first light guiding optical system 50 and the second light guiding optical system 58 remain unchanged, and therefore a description thereof will be omitted.
[0075] In the example of FIG. 11, the first driving circuit 261 drives the display panel, the infrared light source, and the infrared sensor of the combined unit 241a.
[0076] As shown in FIG. 12, in the composite unit 241a, the light-emitting points 31p, which are light-emitting elements, the detection points 33p, which are light-receiving elements, and the pixels 41r are arranged on the same surface SS. Because the number of light-emitting points 31p is not as large as the number of pixels 41r, the light-emitting points 31p are arranged in the effective area AI in a portion where the pixel points 41p constituting the pixels 41r in the effective area AI are thinned out. Similarly, the detection points 33p are arranged in the effective area AI in a portion where the pixel points 41p in the effective area AI are thinned out. In the illustrated example, a configuration can be adopted in which, of a pixel 41r composed of one red pixel point 41p, one blue pixel point 41p, and two green pixel points 41p, one green pixel point 41p is replaced with the light-emitting point 31p, and one green pixel point 41p of the pixels 41r adjacent to the replaced pixel 41r is replaced with the detection point 33p. The arrangement of the light emitting points 31p, the detection points 33p, and the pixels 41r or pixel points 41p is not limited to that shown in the figure, and the light emitting points 31p and the detection points 33p may be arranged only on the periphery of the effective area AI.
[0077] 11, the width 2Wα and the height 2Hα of the effective area AD, which is the light receiving area of the combined device 241, are slightly larger than the width 2Wβ and the height 2Hβ of the effective area AI, which is the display area of the combined device 241. In the illustrated example, the width 2Wα and the height 2Hα of the effective area AL, which is the light emitting area of the combined device 241, are slightly larger than the width 2Wβ and the height 2Hβ of the effective area AI, which is the display area of the combined device 241.
[0078] The maximum value of the angle α between the measurement light DL deflected by the second incident-side diffraction element 59b toward the composite device 241 and the normal to the second incident-side diffraction element 59b is larger than the maximum value of the angle β between the image light FL incident on the first incident-side diffraction element 50b and the normal to the first incident-side diffraction element 50b. As shown in FIG. 12 , in the composite device 241, the length Wα from the reference line S1 of the effective area AD to the outer edge of the effective area AD corresponds to the maximum value of the angle α between the measurement light DL and the normal to the second incident-side diffraction element 59b. Also, in the composite device 241, the length Wβ from the reference line S1 of the effective area AI to the outer edge of the effective area AI corresponds to the maximum value of the angle β between the image light FL and the normal to the first incident-side diffraction element 50b. The angle α and the angle β have a relationship of α>β.
[0079] In the virtual image display device 110 of the fourth embodiment described above, by arranging the light emitting point 31p, the detection point 33p, and the pixel 41r on the same plane SS in the composite unit 241a, the composite device 241, which is the active device of the virtual image display device 110, can be made compact, and the width size of the device, i.e., the size in the X direction, can be made even smaller than in the second and third embodiments.
[0080] Fifth Embodiment Hereinafter, a virtual image display device according to a fifth embodiment of the present invention will be described. Note that the virtual image display device of the fifth embodiment is a partial modification of the virtual image display device of the first embodiment, and a description of common parts will be omitted.
[0081] 13, the first light-guiding optical system 250 that outputs the image light FL as the display light GL is a combination of the diffractive light-guiding members 51, 52, and 53 shown in FIG. 2, and enables a single three-color display. The second light-guiding optical system 58 remains unchanged, and a description thereof will be omitted.
[0082] The first light-guiding optical system 250 includes a first light-guiding member 50a, an incident diffraction layer 250b, and an exit diffraction layer 250c. The incident diffraction layer 250b functions as a first incident-side diffraction element 50b, deflecting the image light FL emitted from the image light generating device 41 and allowing the image light FL to enter the first light-guiding member 50a in a light-guidable state. The exit diffraction layer 250c functions as a first exit-side diffraction element 50c, emitting the image light FL guided inside the first light-guiding member 50a toward the outside where the eye EY is located. The first light-guiding member 50a is similar to the light-guiding plates 51a, 52a, and 53a of the diffractive light-guiding members 51, 52, and 53, and enables light to be guided by total reflection using a pair of flat surfaces 50i and 50o. The image light generation device 41 is similar to that shown in FIG. 2, and the image light FL emitted from the image light generation device 41 includes three color image lights LB, LG, and LR.
[0083] The incident diffraction layer 250b or the first incident-side diffraction element 50b takes in the three-color image light LB, LG, LR incident thereon by diffraction action so that the light propagates inside the first light-guiding member 50a, and is specifically a diffraction element formed of, for example, a reflection volume hologram. The three-dimensional pattern recorded in the diffraction element by this reflection volume hologram is set so that the diffraction angles of the image light LB, LG, LR of each color, that is, the reflection angles or incidence angles in the first light-guiding member 50a, are larger than the critical angles determined by the refractive index of the first light-guiding member 50a, so that the three-color image light LB, LG, LR propagate by total reflection inside the first light-guiding member 50a.
[0084] The exit diffraction layer 250c or the first exit-side diffraction element 50c extracts the three-color image light beams LB, LG, and LR traveling in the −X direction as a whole within the first light-guiding member 50a to the outside of the first light-guiding member 50a by diffraction, and emits the image light beams toward the eye position EP where the eye EY of the wearer US is located, and is specifically a diffraction element formed of, for example, a reflection-type volume hologram. The three-dimensional pattern recorded in the diffraction element by this reflection-type volume hologram is set so that, when the image light beams LB, LG, and LR are totally reflected and propagated, the image light beams LB, LG, and LR are transmitted at some point by diffraction, while the angular information before they entered the entrance diffraction layer 250b or the first entrance-side diffraction element 50b is restored.
[0085] The following describes the guiding of image light FL and the formation of a virtual image using the first light-guiding member 50a. Blue image light LB from the display surface 41d passes through the collimator lens 41b and enters the incident diffraction layer 250b at an angle corresponding to the position of the display surface 41d in the X direction in a plan view facing the +Y direction. The blue image light LB is diffracted in an angular direction corresponding to the three-dimensional pattern of the reflective volume hologram diffraction element formed on the incident diffraction layer 250b, and propagates while being totally reflected within the first light-guiding member 50a, traveling in the −X direction as a whole. The other green and red image light LG and LR are also incident on the incident diffraction layer 250b and diffracted, and propagates while being totally reflected within the first light-guiding member 50a, traveling in the −X direction as a whole. The blue image light LB propagating in the −X direction throughout the first light-guiding member 50a is diffracted by the exit diffraction layer 250c and exits from the exit diffraction layer 250c toward the eye EY. The other green and red image light LG and LR are also incident on the emission diffraction layer 250c, diffracted, and emitted from the position of the emission diffraction layer 250c toward the eye EY. In the above manner, the image light LB, LG, and LR emitted from the first light guiding member 50a, i.e., the display light GL, has an enlarged pupil size in the +X direction.
[0086] In this embodiment, the projection device 111 and the gaze detection device 112 may have the configurations of the second to fourth embodiments. The same applies to the following embodiments. For example, as shown in FIG. 14, the virtual image display device 110A may have the composite device 241 shown in FIG. 11.
[0087] In the virtual image display device 110 of the fifth embodiment described above, the first light-guiding optical system 250 combines the first light-guiding optical systems for each color into one, making it easy to make the virtual image display device 110 lighter and thinner.
[0088] Sixth Embodiment Hereinafter, a virtual image display device according to the sixth embodiment will be described. Note that the virtual image display device of the sixth embodiment is a partial modification of the virtual image display device of the first embodiment.
[0089] 15, in the first virtual image display device 110A, the second light-guiding optical system 58 extends substantially parallel to the XY plane, but the width of the fourth light-guiding plate 58a in the horizontal extension direction in which the second light-guiding optical system 58 extends, i.e., the width of the second light-guiding member 59a in the horizontal extension direction is narrower than the width of the light-guiding plates 51a, 52a, 53a in the extension direction of the first light-guiding optical system 50 or the diffractive light-guiding members 51, 52, 53, i.e., the X direction. Also, the second incident-side diffraction element 59b is arranged closer to the second exit-side diffraction element 59c than the first incident-side diffraction element 50b in the X direction, which is the extension direction of the second light-guiding member 59a, and the second incident-side diffraction element 59b and the first incident-side diffraction element 50b are arranged so as not to overlap in the −Z direction, which corresponds to the emission direction of the image light FL. In this case, the width of the second light guiding optical system 58 is narrower than the width of the first light guiding optical system 50, and the second light guiding optical system 58 is shorter than the first light guiding optical system 50 in the X direction, which is the extension direction of the second light guiding member 59a, and the reduction in the width of the second light guiding optical system 58 makes it possible to reduce the size of the second light guiding optical system 58. Furthermore, the image light FL emitted from the image light generation device 41 is incident on the first light guiding optical system 50, i.e., the diffractive light guiding members 51, 52, and 53, without passing through the second light guiding optical system 58, and therefore, loss of light amount due to the second light guiding optical system 58 can be avoided.
[0090] 15 may be modified as follows. For example, the width of the fourth light guide plate 58a in the horizontal extension direction of the second light guide optical system 58, i.e., the X direction, i.e., the width of the second light guide member 59a in the horizontal extension direction, may be equal to the width of the light guide plates 51a, 52a, and 53a in the extension direction of the first light guide optical system 50, i.e., the X direction, but the first infrared diffraction layer 58b may be formed in regions R1 and R2 facing the infrared light emitter 31 and the infrared light receiver 33, respectively, and not in a region facing the image light generator 41. In this case, the second light guide optical system 58 cannot be made smaller, but the loss of light amount due to the second light guide optical system 58 can be reduced.
[0091] Seventh Embodiment The following describes a virtual image display device according to the seventh embodiment. The virtual image display device of the seventh embodiment is a partial modification of the virtual image display device of the first embodiment.
[0092] As shown in FIG. 16 , in the first virtual image display device 110A, the second light-guiding optical system 358 includes an illumination light-guiding optical system 58A and a light-receiving light-guiding optical system 58B. The illumination light-guiding optical system 58A has a fourth light-guiding plate 58a, a first infrared diffraction layer 58ba, and a second infrared diffraction layer 58c. Here, the fourth light-guiding plate 58a is the first infrared light-guiding member. The first infrared diffraction layer 58ba is the first infrared incident-side diffraction element and functions as a part of the second incident-side diffraction element 59b. The light-receiving light-guiding optical system 58B has a fourth light-guiding plate 58a, a first infrared diffraction layer 58bb, and a second infrared diffraction layer 58c. Here, the fourth light-guiding plate 58a is the second infrared light-guiding member. The first infrared diffraction layer 58bb is the second infrared incident-side diffraction element and functions as a part of the second incident-side diffraction element 59b. The first infrared diffraction layer 58ba deflects the illumination light SL, which is infrared light emitted from the infrared light emitter 31, and causes the illumination light SL to enter the fourth light guide plate 58a in a light-guiding state. The first infrared diffraction layer 58bb also emits the measurement light DL, which is infrared light that has traveled backward from the second infrared diffraction layer 58c, toward the infrared light receiving device 33.
[0093] In this case, the optical path of the illumination light SL and the optical path of the measurement light DL can be separated, and the illumination light SL introduced into the fourth light guide plate 58a by the first infrared diffraction layer 58ba can be prevented from being incident on the first infrared diffraction layer 58bb before reaching the second infrared diffraction layer 58c and directly incident on the infrared light receiving device 33. In other words, it is possible to prevent the measurement light DL with the illumination light SL superimposed thereon from being incident on the infrared light receiving device 33, and the accuracy of gaze direction detection by the gaze detection device 112 is improved.
[0094] Eighth Embodiment Hereinafter, a virtual image display device according to the eighth embodiment will be described. Note that the virtual image display device of the eighth embodiment is a partial modification of the virtual image display device of the first embodiment.
[0095] 17, the infrared light emitting device 31 is disposed closer to the second emission-side diffraction element 59c than the infrared light receiving device 33 in the extension direction of the fourth light guide plate 58a, which is the second light guide member 59a. That is, the infrared light emitting device 31 is disposed closer to the image light generating device 41 than the infrared light receiving device 33 in the extension direction of the fourth light guide plate 58a. In this case, the illumination light SL emitted from the infrared light emitting device 31 can be made to enter the second light guide member 59a by the second region R2 on the -X side of the first infrared diffraction layer 58b, and the measurement light DL traveling backward from the second infrared diffraction layer 58c can be made to emit toward the infrared light receiving device 33 by the first region R1 on the +X side of the first infrared diffraction layer 58b.
[0096] In this case, the illumination light SL from the infrared light emitting device 31 is less likely to be incident on the infrared light receiving device 33, and the accuracy with which the line of sight detecting device 112 detects the line of sight direction is improved.
[0097] Ninth Embodiment The following describes a virtual image display device according to the 9th embodiment. The virtual image display device of the 9th embodiment is a partial modification of the virtual image display device of the first embodiment.
[0098] In the first virtual image display device 110A shown in FIG. 18 , a light-shielding film 71 is disposed on the end face EG of the fourth light guide plate 58a of the second light guide optical system 58 on the +X side, i.e., on the side farther from the second exit-side diffraction element 59c. The light-shielding film 71 is attached to the end face EG of the fourth light guide plate 58a. The light-shielding film 71 attenuates visible light and prevents image light FL emitted from the image light generation device 41 from being coupled to the fourth light guide plate 58a and becoming stray light. The light-shielding film 71 may be a reflective film that attenuates visible light by reflection. The light-shielding film 71 may attenuate not only visible light but also infrared light. In this case, it is possible to prevent infrared light from the outside from being coupled to the fourth light guide plate 58a and becoming stray light.
[0099] The light-shielding film 71 may be provided on the −X side of the fourth light guide plate 58a, that is, on the end portion on the second exit-side diffraction element 59c side.
[0100] Tenth Embodiment The following describes a virtual image display device according to the tenth embodiment. The virtual image display device of the tenth embodiment is a partial modification of the virtual image display device of the first embodiment.
[0101] 19 , the width of the light guide plates 51a, 52a, and 53a in the extension direction of the first light guide optical system 50 or the diffractive light guide members 51, 52, and 53, i.e., the X direction, is narrower than the width of the fourth light guide plate 58a in the horizontal extension direction of the second light guide optical system 58, i.e., the X direction. Correspondingly, the first incident-side diffraction element 50b is disposed closer to the second exit-side diffraction element 59c than the second incident-side diffraction element 59b in the X direction, which is the extension direction of the fourth light guide plate 58a. As a result, the image light generation device 41 is disposed closer to the second exit-side diffraction element 59c than the infrared light emitting device 31 and the infrared light receiving device 33 in the X direction, which is the extension direction of the first light guide optical system 50.
[0102] Furthermore, a wavelength selecting member 72 is disposed so as to cover the +X side and the -Z side of the first light guiding optical system 50. The wavelength selecting member 72 is a sheet-like or plate-like member, supported by the support device 120 shown in FIG. 1, and disposed facing the incident-side end 50e of the first light guiding member 50a and the flat surface 51i closest to the second light guiding member 59a. In this case, the wavelength selecting member 72 is disposed apart from the second light guiding member 59a and the like. The wavelength selecting member 72 blocks the illumination light SL and measurement light DL, which are infrared light, and transmits the image light FL. In this case, leakage of infrared light from the second light guiding member 59a to the first light guiding member 50a or the outside can be suppressed, and incident light and returned light from the first light guiding member 50a can be prevented from affecting the measurement of infrared light.
[0103] The wavelength selection member 72 can be, for example, a dichroic filter formed of a multilayer film formed or attached to the surface of a light-transmitting resin substrate, or the material of the substrate itself may have wavelength-selective transmittance.
[0104] In the present embodiment, the image light generation device 41 is disposed closer to the second emission-side diffraction element 59c than the infrared light emission device 31 and the infrared light receiving device 33 in the extension direction of the second light guiding member 59a, i.e., the X direction. As a result, the first light guiding member 50a is shorter than the second light guiding member 59a in its extension direction. As a result, the wavelength selection member 72 is disposed closer to the second emission-side diffraction element 59c than the infrared light emission device 31 and the infrared light receiving device 33. As a result, the area in which the wavelength selection member 72 is provided can be minimized.
[0105] Eleventh Embodiment Hereinafter, a virtual image display device according to an eleventh embodiment of the present invention will be described. Note that the virtual image display device of the eleventh embodiment is a partial modification of the virtual image display device of the first or fifth embodiment, and a description of common parts will be omitted.
[0106] In the first virtual image display device 110A shown in Figure 20, the first light-guiding optical system 350 that emits image light FL as display light GL is a combination of the diffractive light-guiding members 51, 52, and 53 and the second light-guiding optical system 58 shown in Figure 2, and enables three-color display and irradiation and detection of infrared light by itself.
[0107] The first light-guiding optical system 350 includes a first light-guiding member 350a, an incident diffraction layer 350b, and an exit diffraction layer 350c. Among these, the incident diffraction layer 350b functions as the first incident-side diffraction element 50b, deflecting the image light FL emitted from the image light generation device 41 and allowing the light to enter the first light-guiding member 350a in a light-guidable state. The incident diffraction layer 350b also deflects the illumination light SL emitted from the infrared light emission device 31 and allowing the light to enter the first light-guiding member 350a in a light-guidable state. That is, the first incident-side diffraction element 50b of this embodiment also functions as the second incident-side diffraction element 59b shown in FIG. 2. The exit diffraction layer 350c also functions as the first exit-side diffraction element 50c, directing the image light FL guided inside the first light-guiding member 350a toward the outside, where the eye EY is located. Furthermore, the exit diffraction layer 350c exits the image light FL guided inside the first light guiding member 350a toward the outside where the eye EY is located. That is, the first exit-side diffraction element 50c of this embodiment also has the function of the second exit-side diffraction element 59c shown in FIG. 2. The first light guiding member 350a is similar to the light guiding plates 51a, 52a, and 53a of the first light guiding optical system 50 and the light guiding plate 58a of the second light guiding optical system 58 shown in FIG. 2, and enables light guiding by total reflection using a pair of flat surfaces 50i and 50o. The image light generation device 41 is similar to that shown in FIG. 2, and the image light FL exiting from the image light generation device 41 includes three-color image lights LB, LG, and LR.
[0108] The incident diffraction layer 350b or the first incident-side diffraction element 50b takes in the three-color image light LB, LG, and LR or the infrared illumination light SL incident thereon by diffraction so that the light propagates inside the first light-guiding member 350a, and is specifically a diffraction element formed of, for example, a reflection volume hologram. The three-dimensional pattern recorded in the diffraction element by this reflection volume hologram is set so that the diffraction angle of each color of the image light LB, LG, and LR or the infrared illumination light SL in the first light-guiding member 350a, that is, the reflection angle or incidence angle of the image light LB, LG, and LR or the infrared illumination light SL, is larger than a critical angle determined by the refractive index of the first light-guiding member 350a, in order to propagate the three-color image light LB, LG, and LR or the infrared illumination light SL by total reflection inside the first light-guiding member 350a.
[0109] The exit diffraction layer 350c or the first exit-side diffraction element 50c extracts the three-color image light LB, LG, LR or the infrared illumination light SL traveling in the −X direction as a whole within the first light-guiding member 350a to the outside of the first light-guiding member 350a by diffraction action and emits the light toward the eye position EP where the eye EY of the wearer US is located, and is specifically a diffraction element formed of, for example, a reflection-type volume hologram. The three-dimensional pattern recorded in the diffraction element by this reflection-type volume hologram is set to transmit the image light LB, LG, LR or the infrared illumination light SL by diffraction action at some point when the image light LB, LG, LR or the infrared illumination light SL is propagated while being totally reflected, while restoring the angular information before it entered the entrance diffraction layer 250b or the first entrance-side diffraction element 50b.
[0110] In addition, the exit diffraction layer 350c or the first exit-side diffraction element 50c diffracts the measurement light DL that is reflected at the eye position EP and enters the exit diffraction layer 350c, and takes it into the first light-guiding member 350a so that the measurement light DL travels in the +X direction as a whole.
[0111] In this embodiment, the maximum value of the angle formed between the measurement light DL, which is infrared light deflected by the first incident-side diffraction element 50b toward the infrared light receiving device 33, and the normal to the first incident-side diffraction element 50b is larger than the maximum value of the angle formed between the image light FL incident on the first incident-side diffraction element 50b and the normal to the first incident-side diffraction element 50b.
[0112] In this embodiment, the projection device 111 and the gaze detection device 112 may have the configurations of the second to fourth embodiments. For example, as shown in FIG. 21, a virtual image display device 110A may have a composite device 241 shown in FIG.
[0113] In the virtual image display device 110 of the eleventh embodiment described above, the maximum value of the angle between the measurement light DL deflected by the first incident-side diffraction element 50b toward the infrared light receiving device 33 and the normal to the first incident-side diffraction element 50b is larger than the maximum value of the angle between the image light FL incident on the first incident-side diffraction element 50b and the normal to the first incident-side diffraction element 50b. This makes it possible to detect the gaze direction of the wearer US at a field of view wider than the field of view of the image light FL and to prevent the device from becoming larger. Furthermore, the first light-guiding optical system 350 combines the first light-guiding optical system and the second light-guiding optical system for each color into one, making it easy to reduce the weight and thickness of the virtual image display device 110.
[0114] Twelfth Embodiment A virtual image display device according to a twelfth embodiment of the present invention will be described below. The virtual image display device of the twelfth embodiment is a partial modification of the virtual image display device of the first or eleventh embodiment, and a description of common parts will be omitted.
[0115] In the projection device 111 of the first virtual image display device 110A shown in FIG. 22, a composite device 341 combines the image light generation device 41, the infrared light emission device 31, and the infrared light reception device 33 shown in FIG. 2. The composite device 341 has a display panel 41a, a composite unit 341a, a collimator lens 341b, and a dichroic mirror cube 341c. The composite unit 341a combines the infrared light source 31a and the infrared sensor 33a shown in FIG. 2. In the illustrated example, the light guiding optical system employs the configuration of a first light guiding member 350a shown in FIG. 20, but may employ configurations of other embodiments.
[0116] The dichroic mirror cube 341c has a reflecting surface RU that transmits light in a specific wavelength range and reflects light in the remaining wavelength range. The reflecting surface RU reflects image light FL emitted from the display panel 41a and guides it to the first light-guiding member 350a, and transmits illumination light SL emitted from the composite unit 341a and guides it to the first light-guiding member 350a. The reflecting surface RU also transmits measurement light DL emitted from the first light-guiding member 350a and guides it to the composite unit 341a.
[0117] [Other matters] The structure described above is an example, and various modifications can be made within the scope of achieving the same function.
[0118] In the above, the first light-guiding optical system 50 is composed of three diffractive light-guiding members 51, 52, and 53, and the three colors of image light FL (RGB) are guided through the diffractive light-guiding members 51, 52, and 53 of each color. However, the image light generating device 41 may be a monochrome display, and the image light FL may be guided through a single diffractive light-guiding member 51.
[0119] The first infrared diffraction layer 58b or the second entrance-side diffraction element 59b is not limited to a relief diffraction grating but can be replaced with a diffraction element formed by a transmission volume hologram or a reflection volume hologram, the second infrared diffraction layer 58c or the second exit-side diffraction element 59c is not limited to a relief diffraction grating but can be replaced with a diffraction element formed by a transmission volume hologram or a reflection volume hologram, and the first entrance-side diffraction element 50b and the first exit-side diffraction element 50c are not limited to a relief diffraction grating but can be replaced with a diffraction element formed by a transmission volume hologram or a reflection volume hologram.
[0120] In the above, an example in which the image light generating device 41 is configured with the display panel 41a and the collimator lens 41b has been given, but this can be replaced with a MEMS scanner. The MEMS scanner is configured with, for example, a laser light source, a MEMS mirror, and an imaging lens, and the MEMS mirror is provided at the position of the display panel 41a.
[0121] In the above, the virtual image display device 110 and the like can be used as an HMD, but this is not limited to this and the present invention can be applied to various optical devices, for example, a head-up display (HUD).
[0122] Furthermore, the above describes a see-through type virtual image display device that allows the user to see an external image (real object) and a virtual image superimposed on each other, but the present invention is not limited to this and can also be used to display so-called closed-type virtual reality.
[0123] A virtual image display device in a specific aspect includes an image light generation device that emits image light, an infrared light emission device that emits infrared light, an infrared light receiving device that receives the infrared light, a first light guiding optical system having a first light guiding member, a first incident-side diffraction element provided on the incident side of the first light guiding member, and a first exit-side diffraction element provided on the exit side of the first light guiding member, and a second light guiding optical system having a second light guiding member, a second incident-side diffraction element provided on the incident side of the second light guiding member, and a second exit-side diffraction element provided on the exit side of the second light guiding member, wherein the first incident-side diffraction element deflects the image light emitted from the image light generation device to make it incident on the first light guiding member, and the first exit-side diffraction element deflects the image light guided by the first light guiding member to make it incident on a user's The infrared light is emitted toward the eye position, and the second incident-side diffraction element deflects the infrared light emitted from the infrared light emitting device and makes it enter the second light-guiding member, and the second incident-side diffraction element deflects the infrared light guided by the second light-guiding member and emits it toward the user's eye position and deflects the infrared light from the user's eye position so that it enters the second light-guiding member, and the second incident-side diffraction element emits the infrared light that has been deflected by the second incident-side diffraction element and entered the second light-guiding member toward the infrared light receiving device, and the maximum value of the angle between the infrared light deflected by the second incident-side diffraction element toward the infrared light receiving device and the normal to the second incident-side diffraction element in the light-guiding direction is greater than the maximum value of the angle between the image light incident on the first incident-side diffraction element and the normal to the first incident-side diffraction element.
[0124] In the above virtual image display device, the maximum angle formed by the infrared light deflected by the second incident-side diffraction element toward the infrared light receiving device and the normal to the second incident-side diffraction element is greater than the maximum angle formed by the image light incident on the first incident-side diffraction element and the normal to the first incident-side diffraction element, so that the user's line of sight can be detected at a field of view wider than the field of view of the image light, and the device can be prevented from becoming larger.
[0125] A virtual image display device in a specific aspect includes a first light guiding optical system having an image light generating device that emits image light, an infrared light emitting device that emits infrared light, an infrared light receiving device that receives the infrared light, a first light guiding member, a first incident-side diffraction element provided on the incident side of the first light guiding member, and a first exit-side diffraction element provided on the exit side of the first light guiding member, wherein the first incident-side diffraction element deflects the image light emitted from the image light generating device and the infrared light emitted from the infrared light emitting device to make them incident on the first light guiding member, and the first exit-side diffraction element deflects the image light emitted from the image light generating device and the infrared light emitted from the infrared light emitting device to make them incident on the first light guiding member, and the first exit-side diffraction element guides the image light and the infrared light by the first light guiding member. The incident image light and infrared light are deflected and emitted toward the user's eye position, and the infrared light from the user's eye position is deflected so that it enters the first light-guiding member, and the first incident-side diffraction element emits the infrared light that has been deflected by the first exit-side diffraction element and entered the first light-guiding member toward the infrared light receiving device, and the maximum value of the angle between the infrared light deflected by the first incident-side diffraction element toward the infrared light receiving device and the normal to the first incident-side diffraction element in the light-guiding direction is greater than the maximum value of the angle between the image light incident on the first incident-side diffraction element and the normal to the first incident-side diffraction element.
[0126] In the above virtual image display device, the maximum value of the angle formed between the infrared light deflected by the first incident-side diffractive element toward the infrared light receiving device and the normal to the first incident-side diffractive element is greater than the maximum value of the angle formed between the image light incident on the first incident-side diffractive element and the normal to the first incident-side diffractive element, thereby making it possible to detect the direction of the user's line of sight over a wider field of view than that of the image light and to prevent the device from becoming larger. Furthermore, the first light-guiding optical system combines the light-guiding optical system for the image light and the light-guiding optical system for the infrared light into one, making it easy to reduce the weight and thickness of the virtual image display device.
[0127] In a specific aspect, the light receiving area of the infrared light receiving device is larger than the display area of the image light generating device.
[0128] In a specific aspect, the number of light receiving elements of the infrared light receiving device is smaller than the number of pixels in the display area of the image light generating device, in which case the number of light receiving elements can be reduced to match the resolution of the gaze direction detection, thereby simplifying the structure of the infrared light receiving device and suppressing an increase in the amount of information processing.
[0129] In a specific aspect, the infrared light receiving device includes a plurality of light receiving elements, and the plurality of light receiving elements are arranged at predetermined intervals.
[0130] In a specific aspect, the infrared light emitting device includes a plurality of light emitting elements, and the plurality of light emitting elements are arranged at predetermined intervals.
[0131] In a specific aspect, the plurality of light receiving elements and the plurality of light emitting elements are arranged on the same plane, whereby the active device of the virtual image display device can be made compact, and the width size of the virtual image display device can be reduced.
[0132] In a specific aspect, the plurality of light receiving elements, the plurality of light emitting elements, and the plurality of pixels in the display area of the image light generating device are arranged on the same plane, whereby the active devices of the virtual image display device can be made compact, and the width size of the virtual image display device can be further reduced.
[0133] In a specific aspect, the plurality of light receiving elements and the plurality of light emitting elements are arranged around the plurality of pixels in a display area of the image light generating device.
[0134] In a specific aspect, the second light guiding optical system is disposed closer to the user's eye than the first light guiding optical system in the normal direction of the second light guiding member. In this case, it is possible to suppress attenuation of infrared light incident on the eye or infrared light reflected by the eye by the first light guiding optical system or the first incident-side diffraction element, thereby improving the accuracy of gaze detection while maintaining the display image quality.
[0135] In a specific aspect, the second incident-side diffraction element is arranged closer to the second exit-side diffraction element than the first incident-side diffraction element in the extension direction, i.e., the extending direction, of the second light guiding optical system, which prevents the image light and the infrared light from overlapping on the incident side and the second incident-side diffraction element from affecting the image quality.
[0136] In a specific aspect, the infrared light emitting device is disposed closer to the second emission-side diffraction element than the infrared light receiving device in the extension direction, ie, the extending direction, of the second light guiding optical system. [Explanation of symbols]
[0137] 31...infrared light emitting device, 31a...infrared light source, 31b...collimator lens, 31d...light emitting surface, 31p...light emitting point, 33...infrared light receiving device, 33a...infrared sensor, 33b...collimator lens, 33d...photosensitive surface, 33p...detection point, 41...image light generating device, 41a...display panel, 41b...collimator lens, 41d...display surface, 41p...pixel point, 41r...pixel, 50...first light guiding optical system, 50a...first light guiding member, 50b...first incident side diffraction element, 50c...first emission side diffraction element, 51, 52, 53...diffractive light-guiding member, 51a, 52a, 53a...light-guiding plate, 58...second light-guiding optical system, 58A...illumination light-guiding optical system, 58B...light-receiving light-guiding optical system, 58a...light-guiding plate, 58e...end portion, 59a...second light-guiding member, 59b...second incident-side diffraction element, 59c...second exit-side diffraction element, 59m...intermediate diffraction element, 61...first drive circuit, 62...second drive circuit, 71...light-shielding film, 72...wavelength selection member, 80...drive control device, 110...virtual image display device, 110A...first virtual image display device, 110B...second virtual image display device, 111...projection device, 112...gaze detection device, 120...support device, 131...infrared light composite device, 131a...composite unit, 131b...collimator lens, 141...light source composite device, 141a...composite unit, 141b...collimator lens, 158...second light guiding optical system, 159c...second exit-side diffraction element, 241...composite device, 241a...composite unit, 241b...collimator lens, 250...first light guiding optical system, 261...first drive circuit, 341...composite device, 341a...composite unit, 341b...collimator lens, 341c...dichroic mirror cube, 350...first light guiding optical system, 350a...first light guiding member, 358...second light guiding optical system, AL, AD, AI...effective area, DL...measurement light, EP...eye position, ES...exit surface, EY...eye, FL...image light, GL...display light, IS...incident surface, LB, LG, LR...image light, OS...target surface, RS...light intake surface, SL...illumination light, US...wearer
Claims
1. An image light generation device that emits image light, An infrared light emitter that emits infrared light, An infrared light receiving device that receives the aforementioned infrared light, A first light guide optical system comprising a first light guide member, a first incident side diffracting element provided on the incident side of the first light guide member, and a first exit side diffracting element provided on the exit side of the first light guide member, A second light guide optical system comprising a second light guide member, a second incident side diffracting element provided on the incident side of the second light guide member, and a second exit side diffracting element provided on the exit side of the second light guide member, Equipped with, The first incident side diffraction element deflects the image light emitted from the image light generation device and directs it into the first light guide member. The first emission-side diffraction element deflects the image light guided by the first light guide member and emits it towards the user's eye position. The second incident side diffraction element deflects the infrared light emitted from the infrared light emission device and directs it into the second light guide member. The second emission-side diffraction element deflects the infrared light guided by the second light guide member and emits it toward the user's eye position, and deflects the infrared light from the user's eye position so that it is incident on the second light guide member. The second incident side diffracting element deflects the infrared light that has been incident on the second light guide member by the second exit side diffracting element and emits it toward the infrared light receiving device. A virtual image display device wherein the maximum angle between the infrared light deflected by the second incident side diffracting element toward the infrared light receiving device and the normal of the second incident side diffracting element with respect to the light guiding direction is greater than the maximum angle between the image light incident on the first incident side diffracting element and the normal of the first incident side diffracting element.
2. An image light generation device that emits image light, An infrared light emitter that emits infrared light, An infrared light receiving device that receives the aforementioned infrared light, A first light guide optical system comprising a first light guide member, a first incident side diffracting element provided on the incident side of the first light guide member, and a first exit side diffracting element provided on the exit side of the first light guide member, Equipped with, The first incident side diffraction element deflects the image light emitted from the image light generation device and the infrared light emitted from the infrared light emission device and directs them into the first light guide member. The first emission-side diffraction element deflects the image light and infrared light guided by the first light guide member and emits them toward the user's eye position, and deflects the infrared light from the user's eye position so that it is incident on the first light guide member. The first incident side diffraction element deflects the infrared light that has been incident on the first light guide member by the first exit side diffraction element and emits it toward the infrared light receiving device. A virtual image display device wherein the maximum angle between the infrared light deflected by the first incident side diffracting element toward the infrared light receiving device and the normal of the first incident side diffracting element with respect to the light guiding direction is greater than the maximum angle between the image light incident on the first incident side diffracting element and the normal of the first incident side diffracting element.
3. The virtual image display device according to any one of claims 1 and 2, wherein the light-receiving area of the infrared light receiver is larger than the display area of the image light generation device.
4. The virtual image display device according to any one of claims 1 to 3, wherein the infrared light receiving device includes a plurality of light receiving elements, and the number of light receiving elements is less than the number of pixels in the display area of the image light generating device.
5. The virtual image display device according to claim 4, wherein the infrared light receiving device includes a plurality of light receiving elements, and the plurality of light receiving elements are arranged at predetermined intervals.
6. The virtual image display device according to any one of claims 1 to 5, wherein the infrared light emitter includes a plurality of light-emitting elements, and the plurality of light-emitting elements are arranged at predetermined intervals.
7. The virtual image display device according to claim 6, wherein the plurality of light-receiving elements and the plurality of light-emitting elements are arranged on the same plane.
8. The virtual image display device according to claim 6, wherein the plurality of light-receiving elements, the plurality of light-emitting elements, and the plurality of pixels of the display area of the image light generation device are arranged on the same plane.
9. The virtual image display device according to claim 8, wherein the plurality of light-receiving elements and the plurality of light-emitting elements are arranged around a plurality of pixels in the display area of the image light generation device.
10. The virtual image display device according to claim 1, wherein the second light guide optical system is positioned closer to the user's eye position than the first light guide optical system in the direction normal to the second light guide member.
11. The virtual image display device according to any one of claims 1 and 10, wherein the second incident side diffracting element is positioned on the second exit side diffracting element side than the first incident side diffracting element in the extending direction of the second light guide optical system.
12. The virtual image display device according to any one of claims 1, 10, and 11, wherein the infrared light emitter is positioned on the second emitter-side diffracting element side of the infrared light receiving device in the extending direction of the second light guide optical system.
