Display device

The HMD design addresses the unnatural misalignment issue by positioning the imaging system's entrance pupil closer to the external world and using a shielding mechanism to reduce the perceived discrepancy between the displayed image and the external world, enhancing the immersive experience.

JP2025173704APending Publication Date: 2025-11-28CANON KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024079394
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-05-15
Publication Date
2025-11-28

AI Technical Summary

Technical Problem

Existing video see-through HMDs cause a sense of unnatural misalignment between the displayed image and the external world due to the separation of the entrance pupil of the imaging optical system and the exit pupil of the display optical system, leading to a discrepancy in magnification.

Method used

The HMD design includes an imaging system that captures external images and a display system that allows observation of both the displayed image and the surrounding world, with the entrance pupil of the imaging system positioned closer to the external world than the observation position, and incorporates a shielding mechanism to form a shielded area between the displayed image and the external world, reducing the perceived discrepancy.

Benefits of technology

The design enables a natural coexistence of the displayed image and the external world, minimizing the sense of incongruity and providing a more immersive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025173704000001_ABST
    Figure 2025173704000001_ABST
Patent Text Reader

Abstract

To allow an observer to carry out natural image observation.SOLUTION: A display device 100 has: an imaging system 2 that picks up images of the outside through imaging optical systems 21R, 21L; and a display system 1 that guides light from display elements 12R, 12L displaying original images including outside images created by the imaging system to the eyes of an observer through display optical systems 11R, 11L to allow observation of a display image. Entrance pupils of the imaging optical system are located on the outside of observation positions where the eyes are arranged. The display image and a peripheral outside on the outside of the display image can be observed from the observation positions. The display device 100 has a plurality of shielding means SHR, SHL that form shield areas between the display image and the peripheral outside.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a display device having an imaging system. [Background technology]

[0002] A video see-through head-mounted display (HMD) for mixed reality (MR) and augmented reality (AR) applications combines external images acquired by an imaging system with computer graphics (CG) images and displays them to the observer via a display optical system.

[0003] Patent Document 1 discloses a video see-through HMD with a display optical system using a free-form prism with a transmissive surface, a reflective-transmissive surface, and a reflective surface. In this HMD, an imaging system is provided closer to the outside world than the display optical system, an original image including an outside image acquired by the imaging system is displayed on a display element, and the displayed image is enlarged and displayed via the display optical system. Patent Document 2 discloses a video see-through HMD in which the entrance pupil of the imaging optical system is spaced toward the outside world relative to the exit pupil of the display optical system, and the optical axis of the imaging optical system is aligned with the optical axis of the display optical system. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Patent Publication No. WO2008 / 096719 [Patent Document 2] Patent No. 3604979 Summary of the Invention [Problem to be solved by the invention]

[0005] In the above-mentioned video see-through HMD, it is desirable that the viewer can observe images in a natural way. [Means for solving the problem]

[0006] A display device according to one aspect of the present invention comprises an imaging system that captures an image of the outside world through an imaging optical system, and a display system that enables observation of a displayed image by directing light from a display element that displays an original image including an image of the outside world generated by the imaging system to the viewer's eye via the display optical system. The entrance pupil of the imaging optical system is located closer to the outside world than the observation position where the eye is positioned. From the observation position, the displayed image and the surrounding outside world outside the displayed image can be observed. The display device is characterized by having a shielding means that forms a shielded area between the displayed image and the surrounding outside world. [Effects of the Invention]

[0007] According to the present invention, a displayed image and the outside world can be observed naturally. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 2 is a YZ cross-sectional view of the HMD of the first embodiment. [Figure 2] FIG. 4 is a YZ cross-sectional view showing a state in which the right eye is rotated in the HMD of the first embodiment. [Figure 3] FIG. 2 is an XZ cross-sectional view of the HMD of the first embodiment. [Figure 4] 10A to 10C are diagrams illustrating the effects of the first embodiment. [Figure 5] FIG. 10 is a YZ cross-sectional view of the HMD of the second embodiment. [Figure 6] FIG. 10 is a YZ cross-sectional view of the HMD of the third embodiment. [Figure 7] An enlarged view of a portion of Figure 6. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] The display device of the embodiment has an imaging system that captures an image of the outside world through an imaging optical system, and a display system that enables observation of a displayed image by guiding light from a display element that displays an original image including the outside world image generated by the imaging system to the observer's eyes through the display optical system. The display device is a so-called video see-through + see-around view type HMD that enables observation of a displayed image and the surrounding outside world outside the displayed image from an observation position where the observer's eyes are positioned.

[0011] Although not disclosed in Patent Document 1, such HMDs are required to give the viewer the sensation that the displayed image observed through the HMD and the external world around (surrounding) the HMD coexist. However, as disclosed in Patent Document 2, if the entrance pupil of the imaging optical system and the exit pupil of the display optical system are separated, a difference in magnification occurs in the displayed image relative to the external world around, causing the viewer to perceive an unnatural misalignment between the displayed image and the external world around. In each embodiment, it is possible to reduce this sense of unnatural misalignment between the displayed image and the external world around. [Example]

[0012] FIG. 1 shows the configuration of an HMD 100 as a display device of Example 1, viewed from above. FIG. 1 shows a YZ cross section as a horizontal cross section when the Y axis is defined in the left-right direction (first direction), the Z axis in the visual axis direction which is the front-back direction (up-down direction in the figure), and the X axis in the direction perpendicular to the plane of the figure (second direction: actual vertical direction). The HMD 100 is worn on the observer's head in front of the right eye EBR and left eye EBL. The observer's nose is located between the right eye EBR and left eye EBL.

[0013] The HMD 100 has a display system 1 and an imaging system 2 that is arranged closer to the outside world than a prism element (described later) of the display system 1. The display system 1 is composed of a right eye display system having a right eye display optical system 11R and a right eye display element 12R, and a left eye display system having a left eye display optical system 11L and a left eye display element 12L. The imaging system 2 is composed of a right eye imaging system having a right eye imaging optical system 21R and a right eye imaging element 22R, and a left eye imaging system having a left eye imaging optical system 21L and a left eye imaging element 22L.

[0014] IPR and IPL are the entrance pupils of the right-eye imaging optical system 21R and the left-eye imaging optical system 21L, respectively. The right-eye imaging optical system 21R and the left-eye imaging optical system 21L form optical images of the outside world (external world images) on the right-eye imaging element 22R and the left-eye imaging element 22L, respectively. The right-eye external world image and the left-eye external world image, which are captured images generated based on imaging signals from the right-eye imaging element 22R and the left-eye imaging element 22L, are displayed as original images on the right-eye display element 12R and the left-eye display element 12L, respectively. At this time, original images in which a CG image is synthesized with the external world image may be displayed on the display elements 12R and 12L.

[0015] The right eye display optical system 11R and the left eye display optical system 11L guide the display light from the right eye display element 12R and the left eye display element 12L to the observer's right eye EBR and left eye EBL, respectively, and display an image corresponding to the original image at the same size or enlarged so that it can be viewed by the observer.

[0016] The right-eye and left-eye display systems and the right-eye and left-eye imaging systems have the same configuration, and the components on the right-eye side and the left-eye side are labeled with the letters R and L, respectively.

[0017] The right-eye display optical system 11R has three surfaces: an incident surface SCR, a reflecting surface SBR, and an optical surface (reflecting surface, exit surface) SAR that serves as both a transmitting surface and a reflecting surface, and is configured from an optical element (hereinafter referred to as a prism element) in the shape of a decentered prism whose interior is filled with a medium having a refractive index greater than 1. That is, the right-eye display optical system 11R has the incident surface SCR, the reflecting surface SBR, and the optical surface SAR that serves as both a reflecting surface and an exit surface.

[0018] A light beam (right-eye display light) emitted from the display surface 12Ra of the right-eye display element 12R enters the prism element from the entrance surface SCR of the right-eye display optical system 11R. Inside the prism element, the light beam travels from the display element side to the right (outward in the left-right direction), reflects once on the optical surface SAR, and travels further to the right. It is then reflected again on the reflecting surface SBR, exits from the optical surface SAR, and is guided to the exit pupil DPR (hereinafter referred to as the right-eye exit pupil) of the right-eye display optical system 11R. The right eye EBR of the viewer is positioned at the right-eye exit pupil DPR, which serves as the observation position. In this way, the right-eye display optical system 11R reflects the light beam emitted from the display surface 12Ra multiple times in the horizontal plane (in this embodiment, it reflects twice), folding the optical path and guiding it to the right-eye exit pupil DPR.

[0019] In this case, the ray that is emitted from the center of the display surface (display area) 12Ra of the right-eye display element 12R and guided to the center C of the right-eye exit pupil DPR is called the central field of view chief ray, and after being reflected by the reflecting surface SBR, this central field of view chief ray travels parallel to the Z axis. In this embodiment, the straight line along the optical path that this central field of view chief ray follows after emitting from the right-eye display optical system 11R is called the optical axis of the right-eye display optical system 11R.

[0020] Light rays emitted from each point (pixel) on the display surface 12Ra of the right-eye display element 12R travel in the negative direction in the Y-axis direction (outward from the HMD 100) in the section from the incident surface SCR to the optical surface SAR to the reflecting surface SBR. Furthermore, the light rays travel in the negative, positive, and negative directions in the Z-axis direction in the section from the incident surface SCR to the optical surface SAR to the reflecting surface SBR to the optical surface SAR. In other words, the optical path of the light rays is folded. This achieves a thin right-eye display optical system 11R in the Z-axis direction.

[0021] Like the right-eye display optical system 11R, the left-eye display optical system 11L has three surfaces: an incident surface SCL, a reflecting surface SBL, and an optical surface (reflecting surface, exit surface) SAL that serves as both a transmitting surface and a reflecting surface, and is configured from a decentered prism element whose interior is filled with a medium having a refractive index greater than 1. That is, the left-eye display optical system 11L has an incident surface SCL, a reflecting surface SBL, and an optical surface SAL that serves as both a reflecting surface and an exit surface.

[0022] A light beam (left-eye display light) emitted from the display surface 12La of the left-eye display element 12L enters the prism element from the entrance surface SCL of the left-eye display optical system 11L. Inside the prism element, the light beam travels leftward (outward in the horizontal direction) from the display element side, is reflected once by the optical surface SAL, and travels further leftward. It is then reflected again by the reflecting surface SBL, exits from the optical surface SAL, and is guided to the exit pupil (hereinafter referred to as the left-eye exit pupil) DPL of the left-eye display optical system 11L. The observer's right eye EBL is positioned at the left-eye exit pupil DPL, which serves as the observation position. In this way, the left-eye display optical system 11L reflects the light beam emitted from the display surface 12La multiple times (twice) in the horizontal plane, folding the optical path and guiding it to the right-eye exit pupil DPL.

[0023] In this case, the central field of view chief ray that is emitted from the center of the display surface (display area) 12La of the left eye display element 12L and guided to the center of the left eye exit pupil DPL travels parallel to the Z axis after being reflected by the reflecting surface SBL. In this embodiment, the straight line along the optical path that this central field of view chief ray follows after emitting from the left eye display optical system 11L is defined as the optical axis of the left eye display optical system 11L.

[0024] Light rays emitted from each point (pixel) on the display surface 12La of the left-eye display element 12L travel in the positive direction in the Y-axis direction (outward from the HMD 100) in the section from the incident surface SCL to the optical surface SAL to the reflecting surface SBL. Furthermore, the light rays travel in the negative, positive, and negative directions in the Z-axis direction in the section from the incident surface SCL to the optical surface SAL to the reflecting surface SBL to the optical surface SAL. In other words, the optical path is folded. This achieves a thin left-eye display optical system 11L in the Z-axis direction.

[0025] The display optical system does not necessarily have to be configured with prism elements, but may be configured with a combination of lenses and mirrors, for example.

[0026] For the optical surfaces SAR and SAL, which function as both reflective and transmissive surfaces, it is preferable that the light beam incident thereon is totally reflected at an angle equal to or greater than the critical angle and is transmitted at an angle less than the critical angle, resulting in high light utilization efficiency. Furthermore, a divergent light beam emitted from a point on the display elements 12R and 12L is converted into a parallel light beam by refraction as it passes through the display optical systems 11R and 11L and is guided to the exit pupils DPR and DPL. Therefore, an observer who positions his or her right eye EBR and left eye EBL so that his or her pupils PR and PL are located on the plane of the exit pupils DPR and DPL can view a displayed image as a virtual image at infinity relative to the original image displayed on the display elements 12R and 12L.

[0027] In this case, the light rays that emerge from both ends of the display surface 12Ra in the YZ cross section and reach the center C of the right-eye exit pupil DPR are each the chief ray of the maximum display angle of view ±ωd relative to the optical axis of the right-eye display optical system 11R (hereinafter referred to as the maximum angle of view chief ray). Therefore, the horizontal angle of view (HFOV) of the right-eye display system is 2×ωd. The same applies to the maximum angle of view chief ray that emerges from both ends of the display surface 12La in the YZ cross section and reaches the center of the left-eye exit pupil DPL, and the horizontal angle of view HFOV of the left-eye display system.

[0028] A right-eye imaging system is disposed on the external side of the right-eye display optical system 11R, and a left-eye imaging system is disposed on the external side of the left-eye display optical system 11L. The optical axis of the right-eye imaging optical system 21R in the right-eye imaging system coincides with the optical axis of the right-eye display optical system 11R, and the optical axis of the left-eye imaging system 21L in the left-eye imaging system coincides with the optical axis of the left-eye display optical system 11L. Note that "coincidence" here means that deviations due to manufacturing errors, etc. are allowed.

[0029] Because the display optical systems 11R, 11L and the imaging optical systems 21R, 21L are both thin in the Z-axis direction, it is possible to reduce the distance dpp in the Z-axis direction (visual axis direction) between the entrance pupils IPR, IPL of the imaging optical systems 21R, 21L and the exit pupils DPR, DPL of the display optical systems 11R, 11L. This makes it possible to observe images with less sense of incongruity between the MR space displayed by the HMD 100 and the real space as the outside world.

[0030] In this case, it is desirable to configure the imaging optical systems 21R and 21L so as not to include other bending optical systems, etc., thereby making the entire HMD 100 compact. 15≦dpp≦45 It is preferable to satisfy the following condition. If dpp falls below the lower limit of the condition, the eye relief ER will be insufficient, making it difficult for the viewer to observe an image with their eyes positioned optimally, and bending optical systems or the like will be required for each imaging optical system, resulting in an increase in the size and weight of the HMD 100, which is undesirable. The eye relief ER corresponds to the distance from the exit pupils DPR, DPR to the display optical system 11R (optical surfaces SAR, SAL). If dpp exceeds the upper limit of the condition, it will be difficult to observe a display image (MR space) that is not unnatural compared to real space, which is undesirable.

[0031] In the configuration of the HMD 100 of this embodiment, the distance dpp cannot be set to 0, and therefore, a discrepancy may occur between the MR space observed by the HMD 100 and the surrounding outside world observed as a real space adjacent to the MR space.

[0032] Therefore, in this embodiment, shading portions (shading means) SHR, SHL are provided near the outer edges of the optical surfaces SAR, SAL in the left-right direction (first direction: hereinafter also referred to as the horizontal direction) to block part of the external light from the peripheral external world, that is, to block the viewer's view of part of the peripheral external world. The shading portions SHR, SHL form a shading region of a predetermined width between the MR space observed from the exit pupils DPR, DPL and the peripheral external world. The shading portions SHR, SHL are provided outside the optical effective region of the optical surfaces SAR, SAL, through which display light directed toward the exit pupils DPR, DPL passes.

[0033] The right-eye light-shielding section SHR is set so that the angle of view ωm of a light ray LOR that reaches the center C2 of the second pupil DP2R from the right outside of the HMD100 at the smallest angle of incidence with respect to the visual axis direction (optical axis direction) satisfies the condition of the following formula (1). The second pupil DP2R refers to an area within a predetermined diameter of a plane located at a distance dDpp behind the exit pupil DPR (opposite the outside world side). By setting the distance dDpp to be approximately the same (approximately 10 mm) as the distance from the center of rotation of the right eye EBR to the pupil of the right eye EBR, this becomes a location where a light beam approximately equivalent to the light beam that passes when a user who places their pupil at the exit pupil DPR to look at the center of a displayed image looks at an arbitrary point on the displayed image is focused.

[0034] ωm>ωd (1) On the other hand, the light-shielding part SHL on the left eye side is similarly set so that the angle of view -ωm of the light ray LOL, which reaches the center C2 of the second pupil DP2L from the left outside of the HMD100 at the smallest angle of incidence with respect to the visual axis direction, satisfies the condition of the following equation (1').

[0035] -ωm<-ωd (1′) The observer can easily recognize the discrepancy between the MR space and the peripheral external world when he / she gazes near the outer edge of the optical surfaces SAR and SAL. Figure 2 shows the state in which the right eye EBR gazes at the right edge of the optical surface SAR, i.e., the right eye (eyeball) EBR is rotated by ωm from the visual axis direction.

[0036] In FIG. 2, when a light ray LOR is incident on the center of the pupil EPR of the right eye EBR, a light ray with a field angle ωs (<ωm) is incident on the right end of the pupil EPR from the peripheral external world. Therefore, strictly speaking, external light with a minimum field angle ωs is incident on the right eye EBR gazing near the right end of the optical surface SAR from the peripheral external world. In addition, in this embodiment, a normal person receives light with a field angle of several tens of cd / m 2The second pupil DP2R, which has a diameter of 4 mm, close to the pupil diameter when observing an image with a brightness of 1000 Hz, is filled with a light beam of the maximum display angle of view ωd. Therefore, the maximum display half angle of view ωd2 of the right eye display system for the right eye EBR rotated by ωm is equal to ωd. Therefore, it is desirable that the light-shielding part SHR be provided so as to satisfy the condition of the following formula (2) for the right eye EBR rotated by ωm.

[0037] ωs / ωd2>1 (2) By satisfying this condition, a light-blocking area is formed between the MR space and the surrounding outside world, reducing the degree to which the observer perceives the horizontal deviation between the MR space and the surrounding outside world.

[0038] It is more desirable that the light-shielding portion SHR be provided so as to satisfy the condition of the following formula (2').

[0039] 1.05≦ωs / ωd2≦1.50 (2′) By setting ωs / ωd2 equal to or greater than the lower limit of Equation (2'), the degree to which the observer perceives the difference between the MR space and the surrounding external world in the horizontal direction can be reduced. The closer ωs / ωd2 is to the upper limit of Equation (2'), the more the observer can sense that the MR space and the surrounding external world coexist in the horizontal direction.

[0040] Furthermore, it is more desirable that the light-shielding portion SHR be provided so as to satisfy the condition of the following formula (2″).

[0041] 1.10≦ωs / ωd2≦1.35 (2″) By setting ωs / ωd2 equal to or greater than the lower limit of equation (2"), the degree to which the observer perceives the horizontal discrepancy between the MR space and the surrounding external world can be further reduced. The closer ωs / ωd2 is to the upper limit of equation (2"), the stronger the sense that the MR space and the surrounding external world coexist in the horizontal direction can be given to the observer.

[0042] The conditions of the above formulas (2) to (2'') also apply to the light-shielding part SHL on the left eye side.

[0043] Figure 3 shows the XZ cross section of the right-eye display system and the right-eye imaging system. While Figure 2 explains the shading by the shading parts SHR and SHL in the horizontal direction, Figure 3 explains the shading by the shading part SHR (SHL) in the vertical direction.

[0044] In order to explain the particularly important point of shading the lower side, Figure 3 shows the state in which the right eye EBR is facing downward. The angles of view ωsv, ±ωd2v and the light ray LORv are the angles of view corresponding to the angles of view ωs, ±ωd2 and the light ray LOR in the horizontal direction shown in Figure 2, respectively, with the letter v added.

[0045] In the vertical direction, the light-shielding portion SHR is also preferably provided so as to satisfy the condition of formula (3), which is the same as the condition in the horizontal direction.

[0046] ωsv / ωd2v>1 (3) By satisfying this condition, a light-shielded, shielded area is formed between the MR space and the surrounding outside world, reducing the degree to which the observer perceives the vertical deviation between the MR space and the surrounding outside world.

[0047] Similarly to the horizontal direction, 1.05≦ωsv / ωd2v≦1.50 (3′) It is more desirable to satisfy 1.10≦ωsv / ωd2v≦1.35 (3″) It is more desirable to satisfy the following.

[0048] By setting ωsv / ωd2v to be equal to or greater than the lower limit of equation (3') or (3"), the degree to which the observer perceives the deviation between the MR space and the peripheral outside world in the vertical direction can be reduced or further reduced.The closer ωsv / ωd2v is to the upper limit of equation (3') or (3"), the stronger or more pronounced the sense that the MR space and the peripheral outside world coexist in the vertical direction can be given to the observer.

[0049] Since important information is often present at the observer's hands, feet, etc. on the lower side of the external environment surrounding the HMD 100 compared to the upper side, it is desirable that the conditions of formulas (3) to (3") be satisfied on the lower side of the HMD 100.

[0050] The effects of this embodiment will be described with reference to Figures 4(A) to 4(C). Figure 4(A) shows the real space observed without passing through the HMD, and the dashed frame shows the range observed as an image through the HMD.

[0051] Figure 4(B) shows the MR space as an image observed through a conventional HMD, framed by a solid line, and shows how the real space (peripheral external world) appears shifted around it. As mentioned above, because the distance dpp is not 0, the magnification of the captured MR space is larger than that of the peripheral external world, and the resulting difference in size between the MR space and the peripheral external world is perceived by the observer as a shift. This shift is particularly noticeable when the distance to the subject that straddles the MR space and the peripheral external world is short.

[0052] FIG. 4C shows the MR space and the peripheral external world observed through the HMD 100 of this embodiment. In FIG. 4C, as in FIG. 4B, the magnification of the MR space is greater than that of the peripheral external world. However, in this embodiment, shading sections SHR and SHL are provided on the optical surfaces SAR and SAL of the display optical systems (prism elements) 11R and 11L to form a shielded area between the MR space observable by the observer and the peripheral external world, which cannot be observed. This reduces the observer's awareness of the discrepancy between the MR space and the peripheral external world.

[0053] The shielding area may be formed so as to surround the entire periphery of the MR space as shown in FIG. 4(C), or may be formed on a part of the periphery of the MR space. [Example]

[0054] 5 shows a horizontal cross section (YZ cross section) of an HMD 100′ according to Example 2. In this example, instead of the light-shielding portions SHR, SHL formed on the optical surfaces SAR, SAL in Example 1, a part of the exterior member 101 of the HMD 100 is used as a light-shielding portion. The exterior member 101 has light-transmitting portions (shown in white in the figure) made of a light-transmitting material that face the effective optical areas of the optical surfaces SAR, SAL and the right-eye and left-eye imaging systems, respectively, and an exterior portion (shown in thick black lines) made of a light-shielding material.

[0055] The right-end convex portion PSHR and the left-end convex portion PSHL of the exterior part each block light rays from the peripheral external world that reach the center C2 of the second pupils DP2R, DP2L at a field angle smaller than the minimum field angle (±ωm). The portion of the exterior member 101 from the right end of the light-transmitting portion on the right eye side to the right-end convex portion PSHR and the portion from the left end of the light-transmitting portion on the left eye side to the left-end convex portion PSHL each correspond to a light-shielding portion (shielding means) that forms a shielded area between the MR space and the peripheral external world.

[0056] In this way, by forming a shielding area using the exterior member 101, it is possible to reduce the degree to which the observer is aware of the discrepancy between the MR space and the surrounding external world. [Example]

[0057] FIG. 6 shows a horizontal cross section (YZ cross section) of the HMD 100'' of the third embodiment. FIG. 7 shows a state in which the right eye EBR gazes at the right end of the right eye display optical system (prism element) 11R in the HMD 100''.

[0058] In the first embodiment, the light-shielding portions SHR, SHL formed on the optical surfaces SAR, SAL of the prism elements are provided outside the optically effective areas of the optical surfaces SAR, SAL. In contrast, in the present embodiment, the light-shielding portions SHR, SHL are provided so as to overlap a part of the optically effective area, i.e., so as to narrow the left and right width of the optically effective area compared to the first embodiment.

[0059] Specifically, as shown in FIG. 7, the light-shielding portion SHR is extended inward to a position where light rays with a field angle ωd are no longer incident on the second pupil DP2R with a diameter of 4 mm, compared to Example 1. As a result, compared to Example 1, the light-shielding portion SHR can be provided so as to satisfy the condition of formula (2) (preferably (2′), (2″)), while reducing the display light incident on the right eye EBR rotated by ωm and reducing the amount of reduction in external light from the surrounding external world, without increasing the size of the HMD 100″.

[0060] In this embodiment, the maximum display half angle of view ωd2 of the right eye display system for the right eye EBR rotated by ωm from the visual axis direction satisfies ωd2<ωd. In this case, it is desirable to position the inner end of the light-shielding portion SHR so that the inner edge is outside ER (eye relief)×tanωd so that light of the field of view forming the angle of view ωd is incident on the pupil EPR when the right eye EBR is directed in the visual axis direction. This makes it easier to satisfy the condition of formula (2) compared to Example 1, while keeping the horizontal angle of view 2×ωd when the right eye EBR is directed in the visual axis direction unchanged from Example 1.

[0061] According to the above-described first to third embodiments, by providing a light-shielding portion, it is possible to reduce the degree to which the observer perceives the discrepancy between the MR image and the surrounding external world in a small HMD.

[0062] In the above Examples 1 to 3, an HMD equipped with an imaging system and a display system for the right eye and the left eye has been described, but an HMD equipped with an imaging system and a display system for one eye may also be provided with a shielding means equivalent to the shading section of the above Examples 1 to 3.

[0063] In addition, in the above-described first to third embodiments, the case where a physical shielding means is provided on the optical surfaces SAR, SAL or the exterior member 101 has been described. In contrast to this, a shielding area as a black display area may be included in at least a part of the periphery of the display image (i.e., the original image). In this case, the shielding means corresponds to an image processing circuit or the like that generates the original image to which the shielding area has been added. However, when a black display area is generated in at least a part of the periphery of the display image (original image), the angle of view at which the MR space can be observed is reduced, so it is preferable to provide a physical shielding means as shown in the first to third embodiments to shield the peripheral external world.

[0064] The above embodiment includes the following configurations.

[0065] (Configuration 1) A display device having an imaging system that captures an image of an external world through an imaging optical system, and a display system that enables observation of a displayed image by guiding light from a display element that displays an original image including an external world image generated by the imaging system to an observer's eye through a display optical system, an entrance pupil of the imaging optical system is located closer to the external world than an observation position where the eye is placed; The display image and a surrounding environment outside the display image can be observed from the observation position; A display device comprising a shielding means for forming a shielded area between the displayed image and the surrounding external environment. (Configuration 2) 2. The display device according to claim 1, wherein the display optical system includes an optical element that reflects the light from the display element side toward the outside and guides the light toward the eye. (Configuration 3) 3. The display device according to configuration 1 or 2, wherein the shielding means is provided on the exit surface of the display optical system. (Configuration 4) an exterior member covering the display optical system; 3. The display device according to configuration 1 or 2, wherein the shielding means is provided on the exterior member. (Configuration 5) 2. The display device according to configuration 1, wherein the shielding means is provided outside an optically effective area of ​​the display optical system. (Configuration 6) 2. The display device according to configuration 1, wherein the shielding means is provided so as to overlap a part of an optically effective area of ​​the display optical system. (Configuration 7) In a first direction in which the light incident on the display optical system from the display element travels toward the exit surface of the display optical system, when the eye is facing the edge of the shielding area on the peripheral external environment side, a minimum angle of view at which light from the peripheral external environment is incident on the eye is ωs, and a maximum display half angle of view of the display system with respect to the eye in the above state is ωd2. ωs / ωd2>1 2. The display device according to configuration 1, wherein the following conditions are satisfied: (Configuration 8) 1.05≦ωs / ωd2≦1.50 8. The display device according to configuration 7, wherein the following conditions are satisfied: (Configuration 9) In a second direction orthogonal to a first direction in which the light incident from the display element to the display optical system travels toward an exit surface of the display optical system, when the eye is facing the edge of the shielding area on the peripheral external environment side, the minimum angle of view at which light from the peripheral external environment is incident on the eye is ωsv, and the maximum display half angle of view of the display system with respect to the eye in the above state is ωd2v, ωsv / ωd2v>1 8. The display device according to configuration 7, wherein the following conditions are satisfied: (Configuration 10) the imaging system and the display system are provided for each of the right and left eyes of an observer, The display device according to configuration 1, wherein the outer side is the outer side in at least one of the left-right direction and the up-down direction. (Configuration 11) The display device according to configuration 10, wherein the display optical systems provided for the right eye and the left eye each have an optical element that internally reflects the light from the display element from the inside to the outside in the left-right direction and guides it to the eye. (Configuration 12) 2. The display device according to configuration 1, wherein the shielded region is included in the displayed image.

[0066] The embodiments described above are merely representative examples, and various modifications and alterations are possible to each embodiment when implementing the present invention. [Explanation of symbols]

[0067] 100 HMD 1 Display system 2. Imaging system 11R Right eye display optical system 12R Right eye display element 21R Right eye imaging optical system 22R right eye image sensor 11L Left eye display optical system 12L Left eye display element 21L Left eye imaging optical system 22L left eye image sensor SHR,SHL Light shielding part

Claims

1. A display device having an imaging system that captures an image of an external world through an imaging optical system, and a display system that enables observation of a displayed image by guiding light from a display element that displays an original image including an external world image generated by the imaging system to an observer's eye through a display optical system, an entrance pupil of the imaging optical system is located closer to the external world than an observation position where the eye is placed; The display image and a surrounding environment outside the display image can be observed from the observation position; A display device comprising a shielding means for forming a shielded area between the displayed image and the surrounding external environment.

2. 2. The display device according to claim 1, wherein the display optical system includes an optical element that reflects the light from a display element side toward the outside and guides the light toward the eyes.

3. 2. The display device according to claim 1, wherein the shielding means is provided on an exit surface of the display optical system.

4. an exterior member covering the display optical system; 2. The display device according to claim 1, wherein the shielding means is provided on the exterior member.

5. 2. The display device according to claim 1, wherein the shielding means is provided outside an optically effective area of ​​the display optical system.

6. 2. The display device according to claim 1, wherein the shielding means is provided so as to overlap a part of an optically effective area of ​​the display optical system.

7. In a first direction in which the light incident on the display optical system from the display element travels toward the exit surface of the display optical system, when the eye is facing the edge of the shielding area on the peripheral external environment side, a minimum angle of view at which light from the peripheral external environment is incident on the eye is ωs, and a maximum display half angle of view of the display system with respect to the eye in the above state is ωd2. ωs / ωd2>1 2. The display device according to claim 1, wherein the following conditions are satisfied:

8. 1.05≦ωs / ωd2≦1.50 8. The display device according to claim 7, wherein the following conditions are satisfied:

9. In a second direction orthogonal to a first direction in which the light incident from the display element to the display optical system travels toward an exit surface of the display optical system, when the eye is facing the edge of the shielding area on the peripheral external environment side, the minimum angle of view at which light from the peripheral external environment is incident on the eye is ωsv, and the maximum display half angle of view of the display system with respect to the eye in the above state is ωd2v, ωsv / ωd2v>1 8. The display device according to claim 7, wherein the following conditions are satisfied:

10. the imaging system and the display system are provided for each of the right and left eyes of an observer, 2. The display device according to claim 1, wherein the outer side is the outer side in at least one of the left-right direction and the up-down direction.

11. 11. The display device according to claim 10, wherein the display optical system provided for each of the right eye and the left eye has an optical element that internally reflects the light from the display element from the inside to the outside in the left-right direction and guides it to the eye.

12. The display device according to claim 1 , wherein the shielded area is included in the displayed image.

Citation Information

Patent Citations

  • Image observation device

    JP3604979B2

  • Head-mounted display opening peripheral field of view

    WO2008096719A1