Virtual image display device
Patent Information
- Application Number
- JP2022027696
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-02-25
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing virtual image display devices using diffraction gratings attenuate infrared light, leading to reduced detection accuracy of the line of sight and compromised display quality.
A virtual image display device with a first and second light guiding optical system, where the second system is positioned closer to the user's eye than the first, utilizing diffraction elements to guide infrared light for line-of-sight detection while maintaining display quality by minimizing attenuation.
Improves line-of-sight detection accuracy while maintaining display image quality by separating and guiding infrared light through a second optical system closer to the eye, reducing interference and loss.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a virtual image display device that enables the observation of a virtual image, and more particularly to a virtual image display device of the type that utilizes diffraction and light guiding. [Background technology]
[0002] A known HMD that enables observation of a virtual image is a device that includes a projector, a camera, a first light-guiding optical element, and a second light-guiding optical element, in which reflected light from the eye is taken into the second light-guiding optical element by a plurality of partially transmissive small planes incorporated in the second light-guiding optical element, and an image of the eye is taken into the camera via the first light-guiding optical element, etc., thereby enabling detection of the gaze direction (Patent Document 1). Patent Document 1 also discloses an optical system for gaze observation that incorporates a light source that emits infrared light and causes the returned reflected light to enter the camera (see Figure 18 of Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2020-504832 Summary of the Invention [Problem to be solved by the invention]
[0004] In the device shown in Patent Document 1, if a diffraction grating is used instead of multiple partially transmissive small planes, the infrared light reflected by the user's eye and entering the camera is significantly attenuated as it passes through the diffraction grating for visible light, making it difficult to improve the accuracy of gaze detection while maintaining the display image quality. [Means for solving the problem]
[0005] A virtual image display device according to one aspect of the present invention includes a first light guiding optical system including an image light generation device that emits image light, an infrared light emitting device that emits infrared light, an infrared light receiving device that receives the infrared light, a first light guiding member, a first incident-side diffraction element that deflects the image light emitted from the image light generation device and makes it incident on the first light guiding member, and a first exit-side diffraction element that deflects the image light guided by the first light guiding member and emits it toward the position of a user's eye, a second light guiding member, a second incident-side diffraction element, and a second exit-side diffraction element. and a second light-guiding optical system that deflects the infrared light emitted from the infrared light-emitting device by the second incident-side diffraction element to make it enter the second light-guiding member, deflects the infrared light guided by the second light-guiding member by the second exit-side diffraction element to make it emit toward the position of the user's eyes, makes the infrared light from the position of the user's eyes enter the second light-guiding member by the second exit-side diffraction element, and emits it toward the infrared light-receiving device by the second incident-side diffraction element, and is arranged closer to the user's eyes than the first light-guiding optical system. [Brief explanation of the drawings]
[0006] [Figure 1] FIG. 2 is a plan view illustrating a state in which an HMD incorporating a virtual image display device is worn. [Figure 2] FIG. 1 is a plan view of a virtual image display device according to a first embodiment. [Figure 3] FIG. 1 is a diagram illustrating a projection device. [Figure 4] FIG. 1 is a diagram illustrating a gaze detection device. [Figure 5] 3A and 3B are diagrams illustrating the states of an infrared light source, an infrared sensor, and a display panel. [Figure 6] FIG. 10 is a conceptual perspective view illustrating a virtual image display device according to a modified example. [Figure 7] FIG. 10 is a plan view of a virtual image display device according to a second embodiment. [Figure 8] FIG. 10 is a plan view of a virtual image display device according to a third embodiment. [Figure 9] 9 is a diagram illustrating a modified example of the virtual image display device shown in FIG. 8. FIG. [Figure 10] FIG. 10 is a plan view of a virtual image display device according to a fourth embodiment. [Figure 11]FIG. 10 is a plan view of a virtual image display device according to a fifth embodiment. [Figure 12] FIG. 10 is a plan view of a virtual image display device according to a sixth embodiment. [Figure 13] FIG. 13 is a plan view of a virtual image display device according to a seventh embodiment. [Figure 14] 10A and 10B are diagrams illustrating an infrared light source and the like in a virtual image display device according to a modified example. DETAILED DESCRIPTION OF THE INVENTION
[0007] [First embodiment] A first embodiment of the virtual image display device according to the present invention will be described in detail below with reference to FIG.
[0008] 1 is a diagram illustrating a wearing state of a head-mounted display (hereinafter also referred to as HMD) 200, in which the HMD 200 allows an observer or wearer US wearing the HMD to recognize an image as a virtual image. In FIG. 1 and other figures, X, Y, and Z represent a Cartesian coordinate system, with the +X direction corresponding to the lateral direction in which the eyes EY of the observer or wearer US wearing the HMD 200 or virtual image display device 110 are aligned, the +Y direction corresponding to the downward direction perpendicular to the lateral direction in which the eyes EY are aligned for the wearer US, and the +Z direction corresponding to the forward or front direction for the wearer US. The ±Y directions are parallel to the vertical axis or vertical direction.
[0009] The HMD 200 includes a virtual image display device 110A for the right eye, a virtual image display device 110B for the left eye, and a support device 120 including a pair of temples 120a, 120b that supports the pair of virtual image display devices 110A, 110B. The first virtual image display device 110A is disposed so as to cover the front, i.e., the +Z side, of the right eye EY of the wearer US, and the second virtual image display device 110B is disposed so as to cover the +Z side of the left eye EY of the wearer US. The second virtual image display device 110B has a structure similar to that of the first virtual image display device 110A, but the optical structure of the first virtual image display device 110A is inverted in the left-right +X direction. The following mainly describes the first virtual image display device 110A.
[0010] A first virtual image display device 110A will be described with reference to FIGS. 2 to 4. The virtual image display device 110A shown in FIG. 2 includes a projection device 111, a line-of-sight detection device 112, and a drive control device 80. The projection device 111 displays a virtual image toward the eye EY, and the line-of-sight detection device 112 detects the direction of the eye EY, that is, the line-of-sight direction. The virtual image display device 110A partially transmits external light in the visible range corresponding to a wavelength range of 450 nm to 650 nm, for example, and can display a virtual image with an external image as a background. In other words, the virtual image display device 110A is a see-through virtual image display device.
[0011] The projection device 111 includes an image light generation device 41 that emits image light FL, a first light-guiding optical system 50 that emits the image light FL in the visible range as display light GL, and a first drive circuit 61 that operates the image light generation device 41. The image light generation device 41 includes a display panel 41a and a collimator lens 41b. The image light generation device 41 is disposed on the eye position EP side of the first light-guiding optical system 50, i.e., in the -Z direction. The first light-guiding optical system 50 includes three plate-like members extending approximately parallel to the XY plane. The first diffraction light-guiding member 51, which is disposed closest to the -Z side of the first light-guiding optical system 50, is used for blue display and includes a first light-guiding plate 51a, a first incident diffraction layer 51b, and a first exit diffraction layer 51c. The second diffraction light-guiding member 52, located in the middle, is for displaying green and has a second light guide plate 52a, a second incident diffraction layer 52b, and a second exit diffraction layer 52c. The third diffraction light-guiding member 53, located closest to the +Z side, is for displaying red and has a third light guide plate 53a, a third incident diffraction layer 53b, and a third exit diffraction layer 53c. Of these, the first incident diffraction layer 51b, the second incident diffraction layer 52b, and the third incident diffraction layer 53b each function as a first incident-side diffraction element 50b and deflect the image light FL emitted from the image light generation device 41 and cause the image light FL to enter the light guide plates 51a, 52a, and 53a of the first light guide optical systems 51, 52, and 53 in a light-guidable state. The first exit diffraction layer 51c, the second exit diffraction layer 52c, and the third exit diffraction layer 53c each function as a first exit-side diffraction element 50c, and emit the image light FL guided inside the light guide plates 51a, 52a, and 53a toward the outside where the eye EY is located. The first drive circuit 61 performs signal processing under the control of the drive control device 80, and causes the display panel 41a to perform a display operation. The projection device 111 guides the image light FL generated by the display panel 41a to the eye EY of the wearer US as display light GL, thereby allowing the wearer US to view a virtual image.
[0012] The gaze detection device 112 includes an infrared light emitting device 31 that emits illumination light SL, which is infrared light of a specific wavelength, for example, in the wavelength range of 650 nm to 900 nm, an infrared light receiving device 33 that receives measurement light DL, which is infrared light of the corresponding wavelength, a second light guiding optical system 58 that guides the illumination light SL emitted from the infrared light emitting device 31 to the outside where the eye EY is located and guides the measurement light DL reflected by the eye EY to the infrared light receiving device 33, and a second drive circuit 62 that operates the image light generating device 41.
[0013] The infrared light emitting device 31 has an infrared light source 31a and a collimator lens 31b. The infrared light receiving device 33 has an infrared sensor 33a and a collimator lens 33b. The second light guiding optical system 58 is a plate-like member extending substantially parallel to the XY plane and is disposed at a position closer to the eye position EP than the first light guiding optical system 50. The second light guiding optical system 58 is used for infrared measurement and has a fourth light guiding plate 58a, a first infrared diffraction layer 58b, and a second infrared diffraction layer 58c. The first infrared diffraction layer 58b and the second infrared diffraction layer 58c function as a second incident-side diffraction element 59b and a second exit-side diffraction element 59c, respectively. The fourth light guiding plate 58a is also referred to as a second light guiding member 59a. The infrared light emitting device 31 is disposed closer to the second infrared diffraction layer 58c, i.e., closer to the second exit-side diffraction element 59c, than the image light generating device 41 in the X direction, which is the extension direction of the fourth light guide plate 58a. The infrared light receiving device 33 is disposed closer to the second exit-side diffraction element 59c than the image light generating device 41 and the infrared light emitting device 31 in the X direction. Correspondingly, the effectively utilized region of the second entrance-side diffraction element 59b is disposed closer to the second exit-side diffraction element 59c than the first entrance-side diffraction element 50b in the X direction, which is the extension direction of the fourth light guide plate 58a. The infrared light emitting device 31 and the infrared light receiving device 33 are disposed on the eye position EP side of the second light guiding optical system 58, i.e., in the -Z direction.
[0014] In the first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, the first region R1 deflects the illumination light SL, which is infrared light emitted from the external light emitting device 31, and causes the illumination light SL to enter the fourth light guide plate 58a of the second light-guiding optical system 58 in a light-guidable state. The second region R2 emits the measurement light DL, which is infrared light that has traveled backward from the second infrared diffraction layer 58c, toward the infrared light receiving device 33. The second infrared diffraction layer 58c, i.e., the second incident-side diffraction element 59c, emits the illumination light SL, which has been guided within the fourth light guide plate 58a and propagated to the exit side, toward the outside where the eye EY is located, and deflects the measurement light DL, which is infrared light from the eye position EP, i.e., infrared light reflected by the eye EY, and causes the measurement light DL to enter the fourth light guide plate 58a in a light-guidable state. Here, the "incident side" refers to the side closer to the first incident diffraction layer 51b relative to the first exit diffraction layer 51c, i.e., on the +X side, relative to the projection device 111. The "exit side" refers to the side closer to the first incident diffraction layer 51b relative to the first exit diffraction layer 51b, i.e., on the -X side, relative to the projection device 111. The second drive circuit 62 performs signal processing under the control of the drive control device 80, causes the infrared light source 31a to perform a lighting operation at a predetermined timing, and causes the infrared sensor 33a to perform a brightness pattern detection operation. The gaze detection device 112 as a whole irradiates the eye EY of the wearer US with illumination light SL generated by the infrared light source 31a, detects the eye EY illuminated by the illumination light SL, or the measurement light DL reflected by the eye position EP and traveling backward, and generates a measurement signal. The second drive circuit 62 outputs light intensity pattern information correlated with the orientation of the eye EY to the drive control device 80.
[0015] Below, we will briefly explain the coordination between gaze detection by the gaze detection device 112 and the display operation by the projection device 111. In the gaze detection device 112, the second drive circuit 62 outputs a measurement signal corresponding to the light intensity pattern of the measurement light DL to the drive control device 80. The drive control device 80 calculates the gaze azimuth angle in the vertical Y direction and horizontal X direction based on the measurement signal from the second drive circuit 62. The drive control device 80 causes the display panel 41a to perform a display operation via the first drive circuit 61, and reflects the gaze azimuth angle in this display operation. Specifically, the drive control device 80 converts the gaze azimuth angle into layout information on the display panel 41a, specifically pixel position or localized section information, based on a conversion table stored in advance. Based on this layout information, the drive control device 80 controls the display state of the display panel 41a via the first drive circuit 61, changing the display content, brightness, or resolution. The drive control device 80 can display, for example, a mark or other object image in a local display area on the display panel 41a corresponding to the gaze direction. The drive control device 80 can increase the display brightness in any of the divided areas on the display panel 41a that correspond to the line of sight, such as the center, right, left, top, or bottom, and can decrease the display brightness or stop the display in divided areas that are out of the line of sight. The drive control device 80 can also increase the display resolution in any of the divided areas on the display panel 41a that correspond to the line of sight, such as the center, right, left, top, or bottom, and can decrease the display resolution in divided areas that are out of the line of sight.
[0016] The optical system of the projection device 111 will be described in more detail below with reference to FIG. 3. In the image light generation device 41, the display panel 41a is a display device that emits image light FL to form an image corresponding to a virtual image. Specifically, the display panel 41a is, for example, an organic EL (organic electroluminescence), inorganic EL, or LED array display, and forms a color still or moving image on a two-dimensional display surface 41d. The display panel 41a is not limited to a self-luminous image light generation device, but may be composed of an LCD or other light modulation element, and may form an image by illuminating the light modulation element with a light source such as a backlight. Instead of an LCD, the display panel 41a may also be composed of LCOS (liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like.
[0017] The collimator lens 41b is a projection optical system that includes a lens that collimates incident light, and collimates the image light FL emitted from the display surface 41d of the display panel 41a to have a predetermined beam width, and emits the parallel light at an inclination angle according to the pixel position toward the first to third incident diffraction layers 51b to 53b provided on the first to third diffraction light-guiding members 51 to 53.
[0018] In the first light guide optical system 50, the first light guide plate 51a of the first diffraction light guide member 51 for blue light is a member formed from a parallel plate and has a pair of planes 51i and 51o extending parallel to the XY plane. The extension direction of the first light guide plate 51a is the ±X direction. Here, the extension direction refers to the direction in which the first light guide plate 51a mainly extends, and corresponds to the direction from the incident surface IS to the exit surface ES of the first light guide plate 51a. In the right region or incident side region of the first diffraction light guide member 51, i.e., the +X side region, a first incident diffraction layer 51b is provided on the eye EY side, i.e., the -Z side, as a structure accompanying the incident surface IS, which is a part of or an extended plane of the plane 51i. Furthermore, in the left region or exit-side region, i.e., the -X side region, of the first diffraction light-guiding member 51, a first exit diffraction layer 51c is provided on the eye EY side, i.e., the -Z side, as a structure accompanying an exit surface ES, which is a part of or an extended plane of the plane 51i. The pair of planes 51i and 51o of the first light guide plate 51a function as total reflection surfaces that totally reflect and guide the blue image light LB guided into the first light guide plate 51a via the first entrance diffraction layer 51b, and guide the image light LB with almost no loss. The first light guide plate 51a is molded from a resin or glass having a thickness of, for example, about 0.3 to 2 mm and having high optical transparency.
[0019] The first incident diffraction layer 51b is formed in a rectangular region parallel to the XY plane at a position facing the collimator lens 41b across the second light-guiding optical system 58. The first incident diffraction layer 51b guides the image light LB emitted from the display surface 41d of the display panel 41a and passing through the collimator lens 41b into the first light guide plate 51a. The first incident diffraction layer 51b can be formed integrally with the first light guide plate 51a, or it may be formed separately from the first light guide plate 51a and bonded or attached to the incident surface IS of the first light guide plate 51a. The first incident diffraction layer 51b diffracts the blue image light LB incident thereon so that it propagates within the first light guide plate 51a. Specifically, the first incident diffraction layer 51b is, for example, a surface relief diffraction grating. The first incident diffraction layer 51b includes a number of protrusions or grooves extending linearly in the vertical Y direction and is formed in a pattern having periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the first incident diffraction layer 51b are constant. The grating period of this pattern is set so that the reflection angle or incident angle in the first light guide plate 51a is larger than the critical angle determined by the refractive index of the first light guide plate 51a, so that the blue image light LB propagates within the first light guide plate 51a by total reflection. Note that the first incident diffraction layer 51b is not limited to one having periodic irregularities exposed on the surface, and may also be one having interfaces corresponding to the periodic irregularities embedded therein.
[0020] The first exit diffraction layer 51c is formed in a rectangular region parallel to the XY plane at a position on the -X side of the first entrance diffraction layer 51b and facing the eye position EP. The first exit diffraction layer 51c extracts the image light LB traveling in the -X direction as a whole within the first light guide plate 51a to the outside of the first light guide plate 51a and emits it toward the eye position EP where the eye EY of the wearer US is located. The first exit diffraction layer 51c can be formed integrally with the first light guide plate 51a, or may be formed separately from the first light guide plate 51a and joined or attached to the exit surface ES of the first light guide plate 51a. When the blue image light LB is reflected and propagated by the flat surfaces 51i and 51o of the first light guide plate 51a, the first exit diffraction layer 51c transmits the image light LB by diffraction at one of the flat surfaces 51i and 51o of the first light guide plate 51a and restores the angular information before it entered the first entrance diffraction layer 51b. Specifically, the first-emission diffraction layer 51c is, for example, a surface relief diffraction grating. The first-emission diffraction layer 51c includes a number of protrusions or grooves extending linearly in the vertical Y direction and is formed in a pattern having periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the first-emission diffraction layer 51c are constant. The grating period of this pattern in the X direction is made to match the grating period of the first incident diffraction layer 51b in the X direction. Note that the first-emission diffraction layer 51c is not limited to one having periodic irregularities exposed on the surface, and may also be one in which an interface corresponding to the periodic irregularities is embedded.
[0021] The following describes the guiding of image light LB and the formation of a virtual image using the first diffraction light-guiding member 51. The display panel 41a displays a color still or moving image on a two-dimensional display surface 41d. After passing through the collimator lens 41b, the blue image light LB from the display surface 41d is incident on the first incident diffraction layer 51b at an angle corresponding to the position of the display surface 41d in the X direction in a plan view facing the +Y direction. The blue image light LB is diffracted in an angular direction corresponding to the pitch of the pattern formed on the first incident diffraction layer 51b, and propagates while being totally reflected within the first light guide plate 51a, traveling in the −X direction as a whole. The blue image light LB propagating through the first light guide plate 51a in the −X direction as a whole is diffracted by the first exit diffraction layer 51c and exits from the position of the first exit diffraction layer 51c toward the eye EY. The image light LB emitted from the first emission diffraction layer 51c, i.e., the display light GL, reproduces the angular state in the +X direction when it is emitted from the display surface 41d, while the pupil size is enlarged in the +X direction. That is, the pupil size of the image light LB is enlarged in the horizontal direction after passing through the first diffraction light-guiding member 51, and even if the position of the eye EY is significantly shifted laterally, a virtual image formed by the blue image light LB from the display panel 41a can be observed.
[0022] The second light guide plate 52a of the second diffraction light guide member 52 for green light is a member similar to the first light guide plate 51a of the first diffraction light guide member 51, and has a pair of flat surfaces 52i, 52o extending parallel to the XY plane. In the incident-side region, i.e., +X-side region, of the second diffraction light guide member 52, a second incident diffraction layer 52b is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the incident surface IS, which is a part of the flat surface 52i or an extended flat surface. Furthermore, in the exit-side region, i.e., -X-side region, of the second diffraction light guide member 52, a second exit diffraction layer 52c is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the exit surface ES, which is a part of the flat surface 52i or an extended flat surface. The pair of flat surfaces 52i, 52o in the second light guide plate 52a function as total reflection surfaces that totally reflect and guide the green image light LG that is guided into the second light guide plate 52a via the second incident diffraction layer 52b, and guide the image light LG with almost no loss.
[0023] The second incident diffraction layer 52b is formed in a rectangular region parallel to the XY plane at a position facing the collimator lens 41b across the second light-guiding optical system 58 and the like. The second incident diffraction layer 52b guides the image light LG emitted from the display panel 41a and passing through the collimator lens 41b into the second light guide plate 52a. Like the first incident diffraction layer 51b of the first diffraction light-guiding member 51, the second incident diffraction layer 52b can be formed integrally with the second light guide plate 52a. However, the second incident diffraction layer 52b may be formed separately from the second light guide plate 52a and bonded or attached to the incident surface IS of the second light guide plate 52a. The second incident diffraction layer 52b diffracts the green image light LG and causes it to propagate inside the second light guide plate 52a. Specifically, the second incident diffraction layer 52b is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the second incident diffraction layer 52b is set so that the reflection angle or incidence angle in the second light guide plate 52a is larger than the critical angle determined by the refractive index of the second light guide plate 52a, in order to propagate the green image light LG by total reflection within the second light guide plate 52a. Note that the second incident diffraction layer 52b is not limited to one having periodic irregularities exposed on the surface, and may also be one in which interfaces corresponding to the periodic irregularities are embedded.
[0024] The second exit diffraction layer 52c is formed in a rectangular region parallel to the XY plane at a position facing the eye position EP. The second exit diffraction layer 52c extracts the image light LG, which travels in the −X direction as a whole within the second light guide plate 52a, to the outside of the second light guide plate 52a and emits it toward the eye position EP where the eye EY of the wearer US is located. Like the first exit diffraction layer 51c of the first diffraction light-guiding member 51, the second exit diffraction layer 52c can be formed integrally with the second light guide plate 52a. However, the second exit diffraction layer 52c may be formed separately from the second light guide plate 52a and bonded or attached to the exit surface ES of the second light guide plate 52a. When the green image light LG is reflected and propagated by the flat surfaces 52i and 52o of the second light guide plate 52a, the second exit diffraction layer 52c transmits the image light LG by diffraction at one of the flat surfaces 52i and 52o of the second light guide plate 52a and restores the angular information before it entered the second entrance diffraction layer 52b. Specifically, the second-outlet diffraction layer 52c is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the second-outlet diffraction layer 52c is set to match the grating period in the X direction of the second-inlet diffraction layer 52b. The second-outlet diffraction layer 52c is not limited to one having periodic irregularities exposed on the surface, but may also have an interface corresponding to the periodic irregularities embedded therein.
[0025] The guiding of green image light LG and the formation of a virtual image using the second diffractive light-guiding member 52 are similar to the guiding of blue image light LB and the formation of a virtual image using the first diffractive light-guiding member 51, and detailed explanations will be omitted.
[0026] The third light guide plate 53a of the third diffraction light guide member 53 for red light is a member similar to the first light guide plate 51a of the first diffraction light guide member 51, and has a pair of flat surfaces 53i, 53o extending parallel to the XY plane. In the incident-side region, i.e., +X-side region, of the third diffraction light guide member 53, a third incident diffraction layer 53b is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the incident surface IS, which is a part of or an extended plane of the flat surface 53i. Furthermore, in the exit-side region, i.e., -X-side region, of the third diffraction light guide member 52, a third exit diffraction layer 53c is provided on the eye EY-side, i.e., -Z-side, as a structure accompanying the exit surface ES, which is a part of or an extended plane of the flat surface 53i. A pair of flat surfaces 53i, 53o in the third light guide plate 53a function as total reflection surfaces that totally reflect and guide the red image light LR that is guided into the third light guide plate 53a via the third incident diffraction layer 53b, and guide the image light LR with almost no loss.
[0027] The third incident diffraction layer 53b is formed in a rectangular region parallel to the XY plane at a position facing the collimator lens 41b across the second light-guiding optical system 58 and the like. The third incident diffraction layer 53b guides the image light LR emitted from the display panel 41a and passing through the collimator lens 41b into the third light guide plate 53a. Like the first incident diffraction layer 51b of the first diffraction light-guiding member 51, the third incident diffraction layer 53b can be formed integrally with the third light guide plate 53a. However, the third incident diffraction layer 53b may be formed separately from the third light guide plate 53a and bonded or attached to the incident surface IS of the third light guide plate 53a. The third incident diffraction layer 53b diffracts the red image light LR and causes it to propagate inside the third light guide plate 53a. Specifically, the third incident diffraction layer 53b is, for example, a surface relief diffraction grating. The grating period of the pattern formed on the third incident diffraction layer 53b is set so that the reflection angle or incident angle in the third incident diffraction layer 53b is greater than the critical angle determined by the refractive index of the third incident diffraction layer 53b, in order to propagate the red image light LR by total reflection within the third light guide plate 53a.
[0028] The third exit diffraction layer 53c is formed in a rectangular region parallel to the XY plane at a position facing the eye position EP. The third exit diffraction layer 53c extracts the image light LR, which travels in the −X direction as a whole within the third light guide plate 53a, outside the third light guide plate 53a and emits it toward the eye position EP where the eye EY of the wearer US is located. Like the first exit diffraction layer 51c of the first diffraction light-guiding member 51, the third exit diffraction layer 53c can be formed integrally with the third light guide plate 53a. However, the third exit diffraction layer 53c may be formed separately from the third light guide plate 53a and bonded or attached to the exit surface ES of the third light guide plate 53a. When the red image light LR is reflected and propagated by the flat surfaces 53i and 53o of the third light guide plate 53a, the third exit diffraction layer 53c transmits the image light LR by diffraction at some point while restoring the angular information before it entered the third entrance diffraction layer 53b. Specifically, the third exit diffraction layer 53c is, for example, a surface relief diffraction grating, and the grating period of the pattern formed on the third exit diffraction layer 53c is set to match the grating period in the X direction of the third entrance diffraction layer 53b.
[0029] The guiding of red-green image light LR and the formation of a virtual image using the third diffraction light-guiding member 53 are similar to the guiding of blue image light LB and the formation of a virtual image using the first diffraction light-guiding member 51, and detailed explanations will be omitted.
[0030] On the incident side, the visible image light FL passes with little loss through the first infrared diffraction layer 58b of the second light guiding optical system for infrared 58. Note that because the pitch of the diffraction grating of the first infrared diffraction layer 58b of the second light guiding optical system 58 is relatively larger than the pitch of the diffraction gratings of the third incident diffraction layer 53b and the like, although the visible image light FL is partially diffracted by the second incident-side diffraction element 59b, depending on its wavelength, it does not satisfy the total reflection condition of the fourth light guiding plate 58a and passes through the fourth light guiding plate 58a to deviate from the optical path.
[0031] Of the image light FL that passes through the second light-guiding optical system 58 and is incident on the first incident diffraction layer 51b of the first diffraction light-guiding member 51, blue image light LB is efficiently diffracted by the first incident diffraction layer 51b and propagates through the first light guide plate 51a, but is partially transmitted through the first incident diffraction layer 51b. Of the image light FL that is incident on the first incident diffraction layer 51b, green image light LG is partially diffracted by the first incident diffraction layer 51b and propagates through the first light guide plate 51a, but is mostly transmitted through the first incident diffraction layer 51b. Of the image light FL that is incident on the first incident diffraction layer 51b, red image light LR does not have a diffracted solution and passes through the first light guide plate 51a.
[0032] The green image light LG that passes through the second light-guiding optical system 58 and the first diffraction light-guiding member 51 and enters the second incident diffraction layer 52b of the second diffraction light-guiding member 52 is efficiently diffracted by the second incident diffraction layer 52b and propagates through the second light guide plate 52a, but is partially transmitted through the second incident diffraction layer 52b. On the other hand, the blue image light LB that enters the second incident diffraction layer 52b is diffracted by the second incident diffraction layer 52b, but the diffraction angle is small, resulting in significant propagation loss. Of the image light FL that enters the second incident diffraction layer 52b, the red image light LR is partially diffracted by the second incident diffraction layer 52b and propagates through the second light guide plate 52a, but most of it passes through the second incident diffraction layer 52b. The diffraction efficiency of the red image light LR propagating through the second light guide plate 52a is significantly lower than the diffraction efficiency of the green image light LG.
[0033] The red image light LB that passes through the second light-guiding optical system 58, the first diffraction light-guiding member 51, and the second diffraction light-guiding member 52 and enters the third incident diffraction layer 53b of the third diffraction light-guiding member 53 is efficiently diffracted by the third incident diffraction layer 53b and propagates through the third light guide plate 53a, but is partially transmitted through the third incident diffraction layer 53b. On the other hand, the green image light LG that enters the third incident diffraction layer 53b is diffracted by the third incident diffraction layer 53b, but the diffraction angle is small, resulting in a large propagation loss. The blue image light LB that enters the third incident diffraction layer 53b is diffracted by the third incident diffraction layer 53b, but the diffraction angle is even smaller, so the blue image light LB does not satisfy the total internal reflection condition of the third light guide plate 53a and passes through the third light guide plate 53a.
[0034] On the exit side, the blue image light LB exiting from the first exit diffraction layer 51c of the first diffraction light-guiding member 51 is partially diffracted by the second exit-side diffraction element 59c of the second light-guiding optical system 58, but most of the light passes through the second exit-side diffraction element 59c. The green image light LG exiting from the second exit diffraction layer 52c of the second diffraction light-guiding member 52 is partially diffracted by the first exit diffraction layer 51c of the first diffraction light-guiding member 51 or the second exit-side diffraction element 59c of the second light-guiding optical system 58, but most of the light passes through the first exit diffraction layer 51c and the second exit-side diffraction element 59c. The red image light LR emitted from the third exit diffraction layer 53c of the third diffraction light-guiding member 53 is partially diffracted by the first exit diffraction layer 51c of the first diffraction light-guiding member 51, the second exit diffraction layer 52c of the second diffraction light-guiding member 52, and the second exit-side diffraction element 59c of the second light-guiding optical system 58, but most of the light passes through the first exit diffraction layer 51c, the second exit diffraction layer 52c, and the second exit-side diffraction element 59c.
[0035] The optical system of the gaze detection device 112 will be described in more detail below with reference to FIG. 4. In the infrared light emitting device 31, the infrared light source 31a is an optical device that emits illumination light SL, which is infrared light. Specifically, the infrared light source 31a is, for example, an LED array, and forms a predetermined two-dimensional infrared light emission pattern on the light emitting surface 31d. The infrared light source 31a is not limited to one that emits light itself, and may be a combination of a light source and a filter, as long as it can form a continuous light emission pattern or a discrete light emission pattern.
[0036] The collimator lens 31b includes a lens that collimates the incident light, and collimates the illumination light SL emitted from the light-emitting surface 31d of the infrared light source 31a to have a predetermined beam width, and emits the parallel light at an inclination angle according to the pattern position toward the first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, provided in the second light-guiding optical system 58.
[0037] In the infrared light receiving device 33, the infrared sensor 33a is an optical device that detects the measurement light DL, which is infrared light. Specifically, the infrared sensor 33a is, for example, a photodiode array, and detects a two-dimensional infrared projection pattern formed on the photosensitive surface 33d. The infrared sensor 33a may be any sensor that can detect a continuous light emission pattern or a discrete brightness pattern.
[0038] The collimator lens 33b includes a lens that collimates incident light and focuses the parallel components of the infrared measurement light DL emitted from the first infrared diffraction layer 58b onto the photosensitive surface 33d. At this time, the measurement light DL is incident on the photosensitive surface 33d at a position corresponding to the tilt angle of the measurement light DL with respect to the fourth light guide plate 58a. In other words, the infrared brightness pattern formed on the photosensitive surface 33d reflects the distribution of the tilt angle state of the measurement light DL.
[0039] In the second light-guiding optical system 58, the fourth light-guiding plate 58a is a member formed from a parallel plate and has a pair of flat surfaces 58i and 58o extending parallel to the XY plane. The extension direction of the fourth light-guiding plate 58a is the ±X direction. Here, the extension direction refers to the direction in which the fourth light-guiding plate 58a primarily extends, corresponding to the direction from the incident surface IS of the fourth light-guiding plate 58a through the light-receiving surface RS to the target surface OS. In the right-side region or incident-side region of the second light-guiding optical system 58, i.e., the +X side region, a first infrared diffraction layer 58b is provided on the eye EY side, i.e., the -Z side, as a structure associated with the incident surface IS and the light-receiving surface RS, which are part of the flat surface 58i. Furthermore, in the left-side region or exit-side region of the second light-guiding optical system 58, i.e., the -X side region, a second infrared diffraction layer 58c is provided on the eye EY side, i.e., the -Z side, as a structure associated with the target surface OS, which is part of the flat surface 58i or an extended plane of the flat surface 58i. A pair of flat surfaces 58i, 58o in the fourth light guide plate 58a function as total reflection surfaces that totally reflect and guide the infrared illumination light SL that has been guided into the fourth light guide plate 58a via the first infrared diffraction layer 58b, and guide the illumination light SL with almost no loss. The fourth light guide plate 58a has a thickness of, for example, about 1 to 2 mm and is made of resin or glass that has high optical transparency.
[0040] The first infrared diffraction layer 58b, i.e., the second incident-side diffraction element 59b, faces the infrared light emitting device 31, the infrared light receiving device 33, and the image light generating device 41 and is provided in a rectangular region parallel to the XY plane. The second incident-side diffraction element 59b can be formed integrally with the fourth light guide plate 58a, or may be formed separately from the fourth light guide plate 58a and bonded or attached to the incident surface IS of the fourth light guide plate 54a. In the second incident-side diffraction element 59b, the first region R1 faces the collimator lens 31b and guides the illumination light SL, which is emitted from the pattern surface 31a of the infrared light source 31a and passes through the collimator lens 31b, into the interior of the fourth light guide plate 58a. The second region R2 extracts the measurement light DL traveling in the +X direction as a whole within the fourth light guide plate 58a, out of the first light guide plate 51a, and emits it toward the collimator lens 33b, where it is incident on the infrared sensor 33a. The second incident-side diffraction element 59b diffracts the infrared illumination light SL that has entered the first region R1 so that it propagates within the fourth light guide plate 58a, or diffracts the measurement light DL that has traveled backward through the fourth light guide plate 58a and entered the second region R2, and emits it out of the fourth light guide plate 58a. Specifically, the second incident-side diffraction element 59b is, for example, a surface relief diffraction grating. The second incident-side diffraction element 59b includes numerous protrusions or grooves that extend linearly in the vertical Y direction and are formed in a pattern that is periodic in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the second incident-side diffraction element 59b are constant. The grating period of this pattern is set so that the reflection angle or incidence angle in fourth light guide plate 58a is larger than the critical angle determined by the refractive index of fourth light guide plate 58a, so that the illumination light SL or measurement light DL propagates by total reflection within fourth light guide plate 58a. Note that second incident-side diffraction element 59b is not limited to having periodic irregularities exposed on the surface, and may also have interfaces corresponding to the periodic irregularities embedded.
[0041] The second infrared diffraction layer 58c, i.e., the second exit-side diffraction element 59c, is formed in a rectangular region parallel to the XY plane at a position facing the eye position EP. The second exit-side diffraction element 59c diffracts the illumination light SL traveling in the −X direction overall within the fourth light guide plate 58a to the outside of the fourth light guide plate 58a and emits it toward the eye position EP where the eye EY of the wearer US is located, while diffracting the measurement light DL reflected at the eye position EP and incident on the second infrared diffraction layer 58c into the fourth light guide plate 58a so that the measurement light DL travels in the +X direction overall. The second exit-side diffraction element 59c can be formed integrally with the fourth light guide plate 58a, or it may be formed separately from the fourth light guide plate 58a and bonded or attached to the target surface OS of the fourth light guide plate 58a. Specifically, the second exit-side diffraction element 59c is, for example, a surface relief diffraction grating. The second exit-side diffraction element 59c is formed with a pattern that includes a large number of protrusions or grooves that extend linearly in the vertical Y direction and that has periodicity in the horizontal X direction. The grating period (pitch) and grating height of the pattern formed on the second exit-side diffraction element 59c are constant. The grating period of this pattern is made to match the grating period in the X direction of the second entrance-side diffraction element 59b. Note that the second exit-side diffraction element 59c is not limited to one in which the periodic irregularities are exposed on the surface, and it may also be one in which an interface corresponding to the periodic irregularities is embedded.
[0042] A portion of the illumination light SL that is incident on the first region R1 of the second incident-side diffraction element 59b of the second light-guiding optical system 58 travels straight without being diffracted by the second incident-side diffraction element 59b, but passes through the first diffraction light-guiding member 51, the second diffraction light-guiding member 52, and the third diffraction light-guiding member 53. Part of the measurement light DL that is incident on the second exit-side diffraction element 59c of the second light-guiding optical system 58 passes through the second exit-side diffraction element 59c and is incident on the first exit diffraction layer 51c, the second exit diffraction layer 52c, and the third exit diffraction layer 53c, but is hardly coupled to the first diffraction light-guiding member 51, the second diffraction light-guiding member 52, and the third diffraction light-guiding member 53 because there is no diffraction solution or the diffraction efficiency is low.
[0043] FIG. 5 is a diagram illustrating specific examples of the infrared light source 31a, the infrared sensor 33a, and the display panel 41a. In FIG. 5, area AR1 is a front view of the light-emitting surface 31a of the infrared light source 31a, area AR2 is a front view of the photosensitive surface 33d of the infrared sensor 33a, and area AR3 is a front view of the display surface 41d of the display panel 41a. In the light-emitting surface 31a of the infrared light source 31a, light-emitting points 31p are arranged in a grid pattern at predetermined intervals within an effective area AL. The light-emitting points 31p are arranged discretely within the effective area AL, for example, in a 19×11 matrix. In the photosensitive surface 33d of the infrared sensor 33a, detection points 33p are arranged in a grid pattern at predetermined intervals within the effective area AD. The detection points 33p are arranged discretely within the effective area AD, for example, in a 19×11 matrix. On the display surface 41d of the display panel 41a, pixel points 41p are arranged in a grid pattern in the effective area AI. The pixel points 41p are arranged discretely in the effective area AI, for example, in a number of 1920 x 1080. The pixel points 41p are a two-dimensional arrangement of RGB pixel groups.
[0044] 2 is illuminated by illumination light SL having an angular distribution that reflects the light-emitting point 31p of the infrared light source 31a. Meanwhile, measurement light DL, which is reflected light from the eye position EP, has an angular distribution that reflects the irradiation pattern of the illumination light SL and the orientation of the eye EY, and forms a brightness pattern on the photosensitive surface 33d of the infrared sensor 33a. Light intensity pattern information measured by the photosensitive surface 33d is output to the drive control device 80 via the second drive circuit 62. The drive control device 80 stores correlation data obtained by measuring in advance the correlation between the light intensity pattern information and the orientation of the eye EY. The drive control device 80 can estimate the orientation of the eye EY from the light intensity pattern information based on the correlation data.
[0045] FIG. 6 is a conceptual perspective view illustrating a virtual image display device 110A of a modified example. In this case, the second light guide optical system 158 includes a fourth light guide plate 58a, a second incident-side diffraction element 59b, a second exit-side diffraction element 159c, and an intermediate diffraction element 59m. As described above, the second incident-side diffraction element 59b is formed with a diffraction pattern that extends linearly in the vertical Y direction and periodically repeats in the horizontal X direction. The second exit-side diffraction element 159c is formed with a diffraction pattern that extends linearly in the horizontal X direction and periodically repeats in the vertical Y direction. The intermediate diffraction element 59m is formed with a diffraction pattern that extends linearly in the oblique DS1 direction parallel to the XY plane and periodically repeats in the DS2 direction parallel to the XY plane and perpendicular to the DS1 direction. The DS1 direction is rotated 45° counterclockwise with respect to the +X direction and is intermediate between the +X direction and the +Y direction. The grating period in the DS2 direction of the pattern formed on the intermediate diffraction element 59m matches the grating period in the X direction of the pattern formed on the second incident-side diffraction element 59b, and also matches the grating period in the Y direction of the pattern formed on the second exit-side diffraction element 159c.
[0046] The illumination light SL from the infrared light output device 31 enters the second incident-side diffraction element 59b at an angle corresponding to the position of the light-emitting surface 31d in the X direction, is diffracted, and is taken into the fourth light guide plate 58a. The illumination light SL propagates in the -X direction while being totally reflected within the fourth light guide plate 58a, traveling in the -X direction as a whole. The illumination light SL propagates in the -X direction within the fourth light guide plate 58a by diffracting the intermediate diffraction element 59m, bending its overall optical path in the +Y direction, and is shifted to a position in the -X direction that reflects the number of reflections before being diffracted by the intermediate diffraction element 59m. In other words, the intermediate diffraction element 59m serves to expand the horizontal pupil size, which corresponds to the width of the ray of illumination light SL incident on the eye EY in the lateral or X direction. The illumination light SL propagates in the +Y direction throughout the fourth light guide plate 58a via the intermediate diffraction element 59m, and is diffracted by the second exit-side diffraction element 159c and emitted toward the eye EY. The illumination light SL emitted from the second emission-side diffraction element 159c has an expanded pupil size in the +X direction while reproducing the angular state in the +X and +Y directions when emitted from the infrared light emission device 31. In other words, the second light-guiding optical system 158 expands the pupil size in both the vertical and horizontal directions.
[0047] The measurement light DL, which is reflected light from the eye EY illuminated by the illumination light SL, is introduced into the fourth light guide plate 58a by the second exit-side diffraction element 159c, travels backward through the intermediate diffraction element 59m, is extracted to the outside of the fourth light guide plate 58a by the second entrance-side diffraction element 59b, and is incident on the infrared light receiving device 33. The infrared light receiving device 33 acquires luminance pattern information related to the line of sight of the eye EY from an area corresponding to the pupil size enlarged by the second light-guiding optical system 158.
[0048] Although detailed description will be omitted, in the first light guiding optical system 50, the first diffraction light guiding member 51 for blue light includes an incident-side diffraction element, an exit-side diffraction element, and an intermediate diffraction element as elements corresponding to the second incident-side diffraction element 59b, the second exit-side diffraction element 159c, and the intermediate diffraction element 59m of the second light guiding optical system 158. Similarly, the second diffraction light guiding member 52 for green light includes an incident-side diffraction element, an exit-side diffraction element, and an intermediate diffraction element. Furthermore, the third diffraction light guiding member 53 for red light includes an incident-side diffraction element, an exit-side diffraction element, and an intermediate diffraction element.
[0049] The virtual image display device 110 of the first embodiment described above includes a first light guiding optical system 50 having an image light generation device 41 that emits image light FL, an infrared light emitting device 31 that emits infrared light, an infrared light receiving device 33 that receives infrared light, a first light guiding member 50a, a first incident-side diffraction element 50b that deflects the image light FL emitted from the image light generation device 41 and makes it incident on the first light guiding member 50a, and a first exit-side diffraction element 50c that deflects the image light FL guided by the first light guiding member 50a and emits it toward the eye position of the user, a second light guiding member 59a, a second incident-side diffraction element 59b, and a second exit-side diffraction element 59c. c, 159c, and a second light-guiding optical system 58 that deflects the infrared light emitted from the infrared light-emitting device 31 by the second incident-side diffraction element 59b to enter the second light-guiding member 59a, deflects the infrared light guided by the second light-guiding member 59a by the second exit-side diffraction elements 59c, 159c to emit it towards the position of the user's eyes, and causes the infrared light from the position of the user's eyes to enter the second light-guiding member 59a by the second exit-side diffraction element 59c and emits it towards the infrared light-receiving device 33 by the second incident-side diffraction element 59b, and is arranged on the side of the eye EY of the user US relative to the first light-guiding optical system 50.
[0050] In the above-mentioned display device 110, the second light-guiding optical system 58, 158 is positioned closer to the eye EY of the wearer US than the first light-guiding optical system 50, so that the illumination light SL, which is infrared light incident on the eye EY, and the measurement light DL, which is infrared light reflected by the eye EY, can be prevented from being attenuated by the first light-guiding optical system 50 or the first incident-side diffraction element 50b, thereby improving the accuracy of gaze detection while maintaining the display image quality.
[0051] Second Embodiment Hereinafter, a virtual image display device according to a second embodiment of the present invention will be described. Note that the virtual image display device of the second embodiment is a partial modification of the virtual image display device of the first embodiment, and a description of common parts will be omitted.
[0052] The virtual image display device 110 of the second embodiment shown in FIG. 7 is a first virtual image display device 110A for the right eye, and a second virtual image display device 110B for the left eye (see FIG. 1) is not shown.
[0053] In the illustrated virtual image display device 110A, the first light-guiding optical system 250 that emits the image light FL as the display light GL is a combination of the first light-guiding optical systems 51, 52, and 53 shown in Fig. 2, and enables a three-color display by itself. The second light-guiding optical system 58 remains unchanged, and a description thereof will be omitted.
[0054] The first light-guiding optical system 250 includes a first light-guiding member 50a, an incident diffraction layer 250b, and an exit diffraction layer 250c. The incident diffraction layer 250b functions as a first incident-side diffraction element 50b, deflecting the image light FL emitted from the image light generating device 41 and allowing the image light FL to enter the first light-guiding member 50a in a light-guidable state. The exit diffraction layer 250c functions as a first exit-side diffraction element 50c, emitting the image light FL guided inside the first light-guiding member 50a toward the outside, where the eye EY is located. The first light-guiding member 50a is similar to the light-guiding plates 51a, 52a, and 53a of the first light-guiding optical systems 51, 52, and 53, and enables light to be guided by total internal reflection using a pair of flat surfaces 50i and 50o. The image light generation device 41 is similar to that shown in FIG. 2, and the image light FL emitted from the image light generation device 41 includes three color image lights LB, LG, and LR.
[0055] The incident diffraction layer 250b or the first incident-side diffraction element 50b takes in the three-color image light LB, LG, LR incident thereon by diffraction action so that the light propagates inside the first light-guiding member 50a, and is specifically a diffraction element formed of, for example, a reflection-type volume hologram. The three-dimensional pattern recorded in this reflection-type volume hologram is set so that the diffraction angles of the image light LB, LG, LR of each color, that is, the reflection angles or incidence angles in the first light-guiding member 50a, are larger than the critical angles determined by the refractive index of the first light-guiding member 50a, so that the three-color image light LB, LG, LR propagate inside the first light-guiding member 50a by total reflection.
[0056] The exit diffraction layer 250c or the first exit-side diffraction element 50c extracts the three-color image light beams LB, LG, and LR traveling in the −X direction as a whole within the first light-guiding member 50a to the outside of the first light-guiding member 50a by diffraction, and emits the light toward the eye position EP where the eye EY of the wearer US is located, and is specifically a diffraction element formed of, for example, a reflection-type volume hologram. The three-dimensional pattern recorded in this reflection-type volume hologram is set so that, when the image light beams LB, LG, and LR are totally reflected and propagated, the image light beams LB, LG, and LR are transmitted at some point by diffraction, while the angular information before they entered the entrance diffraction layer 250b or the first entrance-side diffraction element 50b is restored.
[0057] The following describes the guiding of image light FL and the formation of a virtual image using the first diffraction light-guiding member 51. Blue image light LB from the display surface 41d of the display panel 41a passes through the collimator lens 41b and enters the incident diffraction layer 250b at an angle corresponding to the position of the display surface 41d in the X direction in a plan view facing the +Y direction. The blue image light LB is diffracted in an angular direction corresponding to the three-dimensional pattern of the reflective volume hologram diffraction element formed on the incident diffraction layer 250b, and propagates while being totally reflected within the first light-guiding member 50a, traveling in the −X direction as a whole. The other green and red image light LG and LR are also incident on the incident diffraction layer 250b and diffracted, and propagates while being totally reflected within the first light-guiding member 50a, traveling in the −X direction as a whole. The blue image light LB propagating in the first light-guiding member 50a in the −X direction as a whole is diffracted by the first exit-side diffraction element 50c and exits from the position of the first exit-side diffraction element 50c toward the eye EY. The other green and red image light LG and LR are also incident on the first exit-side diffraction element 50c, are diffracted, and are emitted from the position of the first exit-side diffraction element 50c toward the eye EY. In the above manner, the image light LB, LG, and LR emitted from the first diffraction light-guiding member 51, that is, the display light GL, has an enlarged pupil size in the +X direction.
[0058] In the virtual image display device 110 of the second embodiment described above, the first light-guiding optical system 250 combines the first light-guiding optical systems for each color into one, making it easy to make the virtual image display device 110 lighter and thinner.
[0059] Third Embodiment The following describes a virtual image display device according to the third embodiment. The virtual image display device of the third embodiment is a partial modification of the virtual image display device of the first embodiment.
[0060] 8, in the first virtual image display device 110A, the second light-guiding optical system 58 extends substantially parallel to the XY plane, but the width of the fourth light-guiding plate 58a in the horizontal extension direction in which the second light-guiding optical system 58 extends, i.e., the width in the horizontal extension direction of the second light-guiding member 59a, is narrower than the width of the light-guiding plates 51a, 52a, 53a in the extension direction of the first light-guiding optical system 50 or the diffractive light-guiding members 51, 52, 53, i.e., the X direction. Also, the second incident-side diffraction element 59b is arranged closer to the second exit-side diffraction element 59c than the first incident-side diffraction element 50b in the X direction, which is the extension direction of the second light-guiding member 59a, and the second incident-side diffraction element 59b and the first incident-side diffraction element 50b are arranged so as not to overlap in the −Z direction, which corresponds to the emission direction of the image light FL. In this case, the width of the second light guiding optical system 58 is narrower than the width of the first light guiding optical system 50, and the second light guiding optical system 58 is shorter than the first light guiding optical system 50 in the X direction, which is the extension direction of the second light guiding member 59a, and the reduction in the width of the second light guiding optical system 58 makes it possible to reduce the size of the second light guiding optical system 58. Furthermore, the image light FL emitted from the image light generation device 41 is incident on the first light guiding optical system 50, i.e., the diffractive light guiding members 51, 52, and 53, without passing through the second light guiding optical system 58, and therefore, loss of light amount due to the second light guiding optical system 58 can be avoided.
[0061] Fig. 9 is a diagram illustrating a modified example of the first virtual image display device 110A shown in Fig. 8. In this case, the width of the fourth light guide plate 58a in the horizontal extension direction of the second light guide optical system 58, i.e., the width of the second light guide member 59a in the horizontal extension direction, is equal to the width of the light guide plates 51a, 52a, and 53a in the extension direction of the first light guide optical system 50, i.e., the X direction. However, the first infrared diffraction layer 58b is formed in regions R1 and R2 facing the infrared light emitter 31 and the infrared light receiver 33, and is not formed in the region facing the image light generator 41. In this case, the second light guide optical system 58 cannot be made smaller, but the loss of light amount due to the second light guide optical system 58 can be reduced.
[0062] [Fourth embodiment] The virtual image display device according to the fourth embodiment will be described below. The virtual image display device according to the fourth embodiment is a partial modification of the virtual image display device according to the first embodiment.
[0063] As shown in FIG. 10 , in the first virtual image display device 110A, the second light-guiding optical system 358 includes an illumination light-guiding optical system 58A and a light-receiving light-guiding optical system 58B. The illumination light-guiding optical system 58A on the outside world side has a fourth light-guiding plate 58a, a first infrared diffraction layer 58ba, and a second infrared diffraction layer 58c. Here, the fourth light-guiding plate 58a is the first infrared light-guiding member 8a. The first infrared diffraction layer 58ba is a first infrared incident-side diffraction element and functions as a part of the second incident-side diffraction element 59b. The light-receiving light-guiding optical system 58B on the opposite side to the outside world side has a fourth light-guiding plate 58a, a first infrared diffraction layer 58bb, and a second infrared diffraction layer 58c. Here, the fourth light-guiding plate 58a is the second infrared light-guiding member 8b. The first infrared diffraction layer 58bb is a second infrared incident-side diffraction element and functions as a part of the second incident-side diffraction element 59b. The first infrared diffraction layer 58ba deflects the illumination light SL, which is infrared light emitted from the infrared light emitter 31, and causes the illumination light SL to enter the fourth light guide plate 58a in a light-guidable state. The first infrared diffraction layer 58bb also emits the measurement light DL, which is infrared light that has traveled backward from the second infrared diffraction layer 58c, toward the infrared light receiving device 33.
[0064] In this case, the optical path of the illumination light SL and the optical path of the measurement light DL can be separated, and the illumination light SL introduced into the fourth light guide plate 58a by the first infrared diffraction layer 58ba can be prevented from being incident on the first infrared diffraction layer 58bb before reaching the second infrared diffraction layer 58c and directly incident on the infrared light receiving device 33. In other words, it is possible to prevent the measurement light DL with the illumination light SL superimposed thereon from being incident on the infrared light receiving device 33, and the accuracy of gaze direction detection by the gaze detection device 112 is improved.
[0065] Fifth Embodiment The following describes a virtual image display device according to the fifth embodiment. The virtual image display device of the fifth embodiment is a partial modification of the virtual image display device of the first embodiment.
[0066] 11 , the infrared light emitting device 31 is disposed closer to the second emission-side diffraction element 59c than the infrared light receiving device 33 in the extension direction of the fourth light guide plate 58a, which is the second light guide member 59a. That is, the infrared light emitting device 31 is disposed closer to the image light generating device 41 than the infrared light receiving device 33 in the extension direction of the fourth light guide plate 58a. In this case, the illumination light SL emitted from the infrared light emitting device 31 can be made to enter the second light guide member 59a by the second region R2 on the −X side of the first infrared diffraction layer 58b, and the measurement light DL traveling backward from the second infrared diffraction layer 58c can be made to emit toward the infrared light receiving device 33 by the first region R1 on the +X side of the first infrared diffraction layer 58b.
[0067] In this case, the illumination light SL from the infrared light emitting device 31 is less likely to be incident on the infrared light receiving device 33, and the accuracy with which the line of sight detecting device 112 detects the line of sight direction is improved.
[0068] Sixth Embodiment The following describes a virtual image display device according to the sixth embodiment. The virtual image display device of the sixth embodiment is a partial modification of the virtual image display device of the first embodiment.
[0069] In the first virtual image display device 110A shown in FIG. 12 , a light-shielding film 71 is disposed on the end face EG of the fourth light guide plate 58a of the second light-guiding optical system 58 on the +X side, i.e., the end face 58e on the side farther from the second exit-side diffraction element 59c. The light-shielding film 71 is attached to the end face EG of the fourth light guide plate 58a. The light-shielding film 71 attenuates visible light and prevents image light FL emitted from the image light generation device 41 from being coupled to the fourth light guide plate 58a and becoming stray light. The light-shielding film 71 may be a reflective film that attenuates visible light by reflection. The light-shielding film 71 may attenuate not only visible light but also infrared light. In this case, infrared light from the outside can be prevented from being coupled to the fourth light guide plate 58a and becoming stray light.
[0070] The light-shielding film 71 may be provided on the −X side of the fourth light guide plate 58a, that is, on the end portion on the second exit-side diffraction element 59c side.
[0071] Seventh Embodiment The following describes a virtual image display device according to the seventh embodiment. The virtual image display device of the seventh embodiment is a partial modification of the virtual image display device of the first embodiment.
[0072] 13 , the width of the light guide plates 51a, 52a, and 53a in the extension direction of the first light guide optical system 50 or the diffractive light guide members 51, 52, and 53, i.e., the X direction, is narrower than the width of the fourth light guide plate 58a in the horizontal extension direction of the second light guide optical system 58, i.e., the X direction. Correspondingly, the first incident-side diffraction element 50b is disposed closer to the second exit-side diffraction element 59c than the second incident-side diffraction element 59b in the X direction, which is the extension direction of the fourth light guide plate 58a. As a result, the image light generation device 41 is disposed closer to the second exit-side diffraction element 59c than the infrared light emitting device 31 and the infrared light receiving device 33 in the X direction, which is the extension direction of the first light guide optical system 50.
[0073] Furthermore, a wavelength selecting member 72 is disposed so as to cover the +X side and the -Z side of the first light guiding optical system 50. The wavelength selecting member 72 is a sheet-like or plate-like member, supported by the support device 120 shown in FIG. 1, and disposed facing the incident-side end 50e of the first light guiding member 50a and the flat surface 51i closest to the second light guiding member 59a. In this case, the wavelength selecting member 72 is disposed apart from the second light guiding member 59a and the like. The wavelength selecting member 72 blocks the illumination light SL and measurement light DL, which are infrared light, and transmits the image light FL. In this case, leakage of infrared light from the second light guiding member 59a to the first light guiding member 50a or the outside can be suppressed, and incident light and returned light from the first light guiding member 50a can be prevented from affecting the measurement of infrared light.
[0074] The wavelength selection member 72 can be, for example, a dichroic filter formed of a multilayer film formed or attached to the surface of a light-transmitting resin substrate, or the material of the substrate itself may have wavelength-selective transmittance.
[0075] In the present embodiment, the image light generation device 41 is disposed closer to the second emission-side diffraction element 59c than the infrared light emission device 31 and the infrared light receiving device 33 in the extension direction of the second light guiding member 59a, i.e., the X direction. As a result, the first light guiding member 50a is shorter than the second light guiding member 59a in its extension direction. As a result, the wavelength selection member 72 is disposed closer to the second emission-side diffraction element 59c than the infrared light emission device 31 and the infrared light receiving device 33. As a result, the area in which the wavelength selection member 72 is provided can be minimized.
[0076] [Other matters] The structure described above is an example, and various modifications can be made within the scope of achieving the same function.
[0077] In the above, the first light-guiding optical system 50 is composed of three diffractive light-guiding members 51, 52, and 53, and the three colors of image light FL (RGB) are guided through the diffractive light-guiding members 51, 52, and 53 of each color. However, the image light generating device 41 may be a monochrome display, and the image light FL may be guided through a single diffractive light-guiding member 51.
[0078] The first infrared diffraction layer 58b or the second entrance-side diffraction element 59b is not limited to a relief diffraction grating but can be replaced with a diffraction element formed by a transmission volume hologram or a reflection volume hologram, the second infrared diffraction layer 58c or the second exit-side diffraction element 59c is not limited to a relief diffraction grating but can be replaced with a diffraction element formed by a transmission volume hologram or a reflection volume hologram, and the first entrance-side diffraction element 50b and the first exit-side diffraction element 50c are not limited to a relief diffraction grating but can be replaced with a diffraction element formed by a transmission volume hologram or a reflection volume hologram.
[0079] Modified examples of the infrared light source 31a, infrared sensor 33a, etc. will be described with reference to FIG. 14. In FIG. 14, area BR1 is a front view of the light-emitting surface 31a of the infrared light source 31a, area BR2 is a front view of the photosensitive surface 33d of the infrared sensor 33a, and area BR3 is a front view of the display surface 41d of the display panel 41a. The effective area AL of the infrared light source 31a is equal to the effective area AD of the infrared sensor 33a but is wider than the effective area AI of the display panel 41a. In areas BR1 and BR2 in FIG. 14, the effective area AI of the visible light image is shown superimposed on the effective areas AL and AD of the infrared light. The effective areas AL and AD of the infrared light are slightly larger than the effective area AI of the visible light image. As a result, the angle of view range or viewing angle of the illumination light SL and measurement light DL corresponding to the effective areas AL and AD is relatively wider than the angle of view range or viewing angle of the image light FL. That is, the angle of the illumination light SL or the measurement light DL with respect to the normal to the fourth light guide plate 58a or the target surface OS is larger, for example, by about 1°, than the angle of the image light FL with respect to the normal to the light guide member 50a, the light guide plate 58a, the exit surface ES, etc. In this way, by relatively widening the range of the angle of view of the illumination light SL or the measurement light DL, the detection range of the gaze direction can be widened, and the reliability of gaze detection can be improved.
[0080] In the above, the virtual image display device 110 and the like can be used as an HMD, but this is not limited to this and the present invention can be applied to various optical devices, for example, a head-up display (HUD).
[0081] Furthermore, the above describes a see-through type virtual image display device that allows the user to see an external image (real object) and a virtual image superimposed on each other, but the present invention is not limited to this and can also be used to display so-called closed-type virtual reality.
[0082] A virtual image display device in a specific aspect includes: an image light generation device that emits image light; an infrared light emission device that emits infrared light; an infrared light receiving device that receives infrared light; a first light guiding optical system member having a first light guiding member, a first incident-side diffraction element provided on the incident side of the first light guiding member, and a first exit-side diffraction element provided on the exit side of the first light guiding member; and a second light guiding optical system having a second light guiding member, a second incident-side diffraction element provided on the incident side of the second light guiding member, and a second exit-side diffraction element provided on the exit side of the second light guiding member, wherein the first incident-side diffraction element deflects the image light emitted from the image light generation device and makes it incident on the first light guiding member. The first exit-side diffraction element deflects the image light guided by the first light-guiding member and emits it toward the user's eye position, the second entrance-side diffraction element deflects the infrared light emitted from the infrared light emitting device and makes it incident on the second light-guiding member, the second exit-side diffraction element deflects the infrared light guided by the second light-guiding member and emits it toward the user's eye position and deflects the infrared light from the user's eye position so that it enters the second light-guiding member, and the second entrance-side diffraction element emits the infrared light deflected by the second exit-side diffraction element and incident on the second light-guiding member toward the infrared light receiving device, and the second light-guiding optical system is arranged on the user's eye position side compared to the first light-guiding optical system.
[0083] In the above virtual image display device, the second light-guiding optical system is positioned closer to the user's eye than the first light-guiding optical system, so that the infrared light entering the eye or the infrared light reflected by the eye can be prevented from being attenuated by the first light-guiding optical system or the first incident-side diffraction element, thereby improving the accuracy of gaze detection while maintaining the display image quality.
[0084] In a specific aspect, the infrared light emitting device is disposed closer to the second exit-side diffraction element than the image light generating device in the extending direction, ie, the extending direction, of the second light guiding member.
[0085] In a specific aspect, the image light generation device is disposed closer to the second exit-side diffraction element than the infrared light emission device in the extending direction, ie, the extending direction, of the second light guide member.
[0086] In a specific aspect, the infrared light emitting device and the infrared light receiving device are disposed on the eye position side of the second light guiding optical system, and in this case, the infrared light emitting device and the infrared light receiving device can be disposed adjacent to and directly facing the second light guiding member.
[0087] In a specific aspect, the second incident-side diffraction element is arranged closer to the second exit-side diffraction element than the first incident-side diffraction element in the extension direction, i.e., the extending direction, of the second light guide member, and is arranged so as not to overlap with the first incident-side diffraction element in the exit direction of the image light. In this case, it is possible to prevent the image light and infrared light from overlapping on the incident side, which would otherwise affect the image quality of the second incident-side diffraction element.
[0088] In a specific aspect, the second light guide member is shorter than the first light guide member in the extending direction, i.e., the extending direction, of the second light guide member, which can reduce loss of infrared light in the second light guide member.
[0089] In a specific aspect, the infrared light emitting device is disposed closer to the second emission-side diffraction element than the infrared light receiving device in the extending direction, ie, the extending direction, of the second light guide member.
[0090] In a specific aspect, the second light-guiding member includes a first infrared light-guiding member that guides infrared light from the infrared light emitting device and a second infrared light-guiding member that guides infrared light reflected by the user's eye, and the second incident-side diffraction element includes a first infrared incident-side diffraction element provided in the first infrared light-guiding member and a second infrared incident-side diffraction element provided in the second infrared light-guiding member. In this case, the infrared light for illuminating the eye and the infrared light for measuring the reflex state of the eye can be handled separately.
[0091] In a specific aspect, a light-shielding film or a reflective film is disposed on at least one end of the second light guide member on the incident side or the exit side, which can suppress the generation of stray light with respect to infrared light.
[0092] In a specific aspect, a wavelength selection member that blocks infrared light and transmits image light is disposed facing the end of the first light guiding member on the incident side and the surface on the second light guiding member side. In this case, it is possible to suppress leakage of infrared light from the second light guiding member to the first light guiding member or the outside world side, and to prevent return light from the first light guiding member from affecting measurement of infrared light.
[0093] In a specific aspect, the wavelength selecting member is disposed closer to the second exit-side diffraction element than the infrared light emitting device, which makes it possible to minimize the area in which the wavelength selecting member is provided. [Explanation of symbols]
[0094] 31...infrared light emitting device, 31a...infrared light source, 31b...collimator lens, 31d...light emitting surface, 31p...light emitting point, 33...infrared light receiving device, 33a...infrared sensor, 33b...collimator lens, 33d...photosensitive surface, 33p...detection point, 41...image light generating device, 41a...display panel, 41b...collimator lens, 41d...display surface, 41p...pixel point, 50...first light guiding optical system, 50a...light guiding member, 50b...first incident side diffraction element, 50c...first exit side diffraction element, 50e...end portion, 51, 52, 53...diffractive light guiding member, 51a, 52a, 53a...light guiding plate, 58A...illumination light guiding optical system, 58B...light receiving light guiding optical system , 58a...light guide plate, 58e...end portion, 59a...second light guide member, 59b...second incident-side diffraction element, 59c...second exit-side diffraction element, 59m...intermediate diffraction element, 71...light-shielding film, 72...wavelength selection member, 80...drive control device, 110...virtual image display device, 110A...first virtual image display device, 110B...second virtual image display device, 111...projection device, 112...gaze detection device, 120...support device, AD, AI, AL...effective area, DL...measurement light, SL...illumination light, EP...eye position, ES...exit surface, IS...incident surface, RS...light capture surface, EY...eye, FL...image light, LB, LG, LR...image light, GL...display light, OS...target surface, US...wearer
Claims
1. An image light generation device that emits image light, An infrared light emitter that emits infrared light, An infrared light receiving device that receives the aforementioned infrared light, A first light guide optical system comprising a first light guide member, a first incident side diffracting element provided on the incident side of the first light guide member, and a first exit side diffracting element provided on the exit side of the first light guide member, The second light guide optical system comprises a second light guide member, a second incident side diffracting element provided on the incident side of the second light guide member, and a second exit side diffracting element provided on the exit side of the second light guide member. The first incident side diffraction element deflects the image light emitted from the image light generation device and directs it into the first light guide member. The first emission-side diffraction element deflects the image light guided by the first light guide member and emits it towards the user's eye position. The second incident side diffraction element deflects the infrared light emitted from the infrared light emission device and directs it into the second light guide member. The second emission-side diffraction element deflects the infrared light guided by the second light guide member and emits it toward the user's eye position, and deflects the infrared light from the user's eye position so that it is incident on the second light guide member. The second incident side diffracting element deflects the infrared light that has been incident on the second light guide member by the second exit side diffracting element and emits it toward the infrared light receiving device. The second light-guiding optical system is positioned closer to the user's eye position than the first light-guiding optical system, and is a virtual image display device.
2. The virtual image display device according to claim 1, wherein the infrared light emitter is positioned on the second emission side diffracting element side of the image light generation device in the extending direction of the second light guide member.
3. The virtual image display device according to claim 1, wherein the image light generation device is positioned on the second emission side diffracting element side of the infrared light emission device in the extending direction of the second light guide member.
4. The virtual image display device according to any one of claims 1 to 3, wherein the infrared light emitter and the infrared light receiver are arranged on the eye position side of the second light guide optical system.
5. The virtual image display device according to claim 2, wherein the second incident side diffracting element is positioned on the second exit side diffracting element side of the first incident side diffracting element in the extending direction of the second light guide member, and the second incident side diffracting element and the first incident side diffracting element are positioned so as not to overlap in the direction of emission of the image light.
6. The virtual image display device according to claim 5, wherein the second light guide member is shorter than the first light guide member in the direction of extension of the second light guide member.
7. The virtual image display device according to any one of claims 1 to 6, wherein the infrared light emitter is positioned on the second emission side diffracting element side of the infrared light receiving device in the extending direction of the second light guide member.
8. The second light guide member comprises a first infrared light guide member that guides infrared light from the infrared light emitter and a second infrared light guide member that guides infrared light reflected by the user's eyes. The virtual image display device according to any one of claims 1 to 7, wherein the second incident side diffraction element comprises a first infrared incident side diffraction element provided on the first infrared light guide member and a second infrared incident side diffraction element provided on the second infrared light guide member.
9. The virtual image display device according to any one of claims 1 to 8, wherein a light-shielding film or a reflective film is disposed at at least one end of the incident side and the exit side of the second light guide member.
10. A virtual image display device according to any one of claims 1 to 9, wherein a wavelength-selective member that blocks infrared light and transmits image light is arranged opposite the incident end of the first light guide member and the surface on the second light guide member side.
11. The virtual image display device according to claim 10, wherein the wavelength-selecting member is positioned on the second emission-side diffracting element side of the infrared light emission device.
