Display unit

Abstract

To prevent erroneous detection and prevent the occurrence of deviation of detection timing in detecting the proximity between a display unit and the face of an observer in a head-mounted display.SOLUTION: A display unit 100 is swingably supported by a head-mounted jig 200 worn on the head of an observer, and comprises observation optical systems (10L, 10R) that guide light to the eyes of the observer, and a detection unit (50) that detects the proximity to the face of the observer. The detection unit (50) is arranged lower than a height position (10a) of an optical axis center (C) of the observation optical systems (10L, 10R), and is directed to detect the nose of the observer. A housing (101) is provided with a nose relief part (40) that avoids the interference with the nose of the observer, and the detection unit (50) is provided on the nose relief part (40).SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display device that is supported so as to be swingable by a head-mounted device that is worn on the head of a viewer. [Background technology]

[0002] In recent years, the use of HMDs (head mounted displays), which are worn on the observer's head and display images in front of the observer's eyes, has been increasing. HMDs are used as devices that allow users to experience artificial reality (virtual reality = VR) and mixed reality (mixed reality = MR) because they allow users to easily view images on a large screen and provide stereoscopic vision. The HMD for realizing MR has an imaging unit for capturing images of a subject corresponding to the left and right eyes of an observer, a display unit for displaying a 3DCG image superimposed on the image captured by the imaging unit, and an observation optical system for projecting an image to the observer. An image is displayed on a display element such as a small liquid crystal panel corresponding to the left and right eyes of the observer, and this image is enlarged through an observation optical system corresponding to each of the left and right eyes of the observer, and then projected onto the left and right eyeballs of the observer. The image captured by the imaging unit is an image having parallax corresponding to both the left and right eyes. Then, by creating a 3DCG image as a parallax image corresponding to both the left and right eyes of the observer and displaying it superimposed on the image captured by the imaging unit, it becomes possible to express a virtual 3DCG image as if it actually exists. By providing a proximity sensor in the HMD that detects the proximity of the observer's face, it becomes possible to configure the device to detect whether the observer is looking at the display. By switching between the operating / non-operating state of each device depending on the detection result of the proximity sensor, it becomes possible to reduce the power consumption of the HMD. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-27489 A Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 discloses a device that is worn on the head to output images, which includes a light-emitting means provided near one ear and a light-receiving means provided near the other ear that is capable of receiving light from the light-emitting means, and which is configured to determine whether or not the device is being worn on the head. However, in the configuration of Patent Document 1, in an HMD that has a flip-up mechanism that allows the viewer to directly view the surroundings without removing the device from the head, it is not possible to detect that the viewer is not looking at the display unit when the device is flipped up.

[0005] The present invention has been made in consideration of the above-mentioned points, and aims to prevent erroneous detection and to prevent deviations in detection timing when detecting the proximity of a display device to a viewer's face in an HMD in which a display device is supported rotatably by a head-mounted device. [Means for solving the problem]

[0006] The display device of the present invention is a display device that is supported so as to be swingable by a head-mounted device that is worn on the head of an observer, and is characterized in that it comprises an observation optical system that guides light to the observer's eyes, and a detection unit that detects proximity to the observer's face, the detection unit being positioned below the height position of the center of the optical axis of the observation optical system and detecting the observer's nose. Effect of the Invention

[0007] According to the present invention, in an HMD in which a display device is supported by a head-mounted device so that the display device can be oscillated, when detecting the proximity of the display device to the observer's face, it is possible to prevent erroneous detection and to prevent deviations in the detection timing. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram showing a display device according to a first embodiment. [Diagram 2] 2 is a diagram showing the rear surface of the display device according to the first embodiment. FIG. [Diagram 3] 1 is a perspective view showing a display device according to a first embodiment. [Figure 4] 1 is a perspective view showing an HMD equipped with a display device according to a first embodiment. [Diagram 5] 1 is a perspective view showing an HMD equipped with a display device according to a first embodiment. [Figure 6] 1 is a perspective view showing an HMD equipped with a display device according to a first embodiment. [Figure 7] 11 is a diagram for explaining a light projection range of a proximity sensor when the display device is in a flip-up position. FIG. [Figure 8] FIG. 13 is a diagram for explaining the influence when a viewer wears glasses. [Figure 9] FIG. 11 is a diagram showing a display device according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. [First embodiment] The display device 100 according to the first embodiment is a display device used in an HMD, as shown in Fig. 4. In the present application, the direction in which the observer faces is defined as the front, and the directions up, down, left, and right as seen from the observer are defined as up, down, left, and right, as shown in Fig. 4. In describing each part of the display device 100, the up, down, left, and right directions will be described in terms of the display device 100 being positioned in front of the observer's eyes, as shown in Fig. 4.

[0010] Fig. 1 is a diagram showing a display device 100, where (a) is a perspective view of the display device 100 seen from the rear (observer side) and (b) is an enlarged perspective view of a portion. Figs. 2(a) and (b) are views showing the rear surface of the display device 100. Fig. 3 is a perspective view of the display device 100 seen from the front. The display device 100 includes a housing 101 that constitutes the exterior of the display device 100. The housing 101 is thin from front to back and is long horizontally.

[0011] As shown in Figures 1 and 2, left and right lenses 10L and 10R constituting an observation optical system that guides light to the observer's eyes are provided on the rear surface of a housing 101. The lenses 10L and 10R are prisms, lenses, etc. that magnify and guide images on a display unit such as an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diode) provided inside the housing 101, and the observer looks through the lenses 10L and 10R to observe the display unit. Hoods 11L and 11R are provided around the lenses 10L and 10R, and as shown in Figures 2(a) and (b), the observer can adjust the positions of the lenses 10L and 10R left and right by operating the hoods 11L and 11R to match the observer's interpupillary distance. A gaze detection unit equipped with a gaze sensor (not shown) and an IRED (infrared light emitting diode) (not shown) is disposed inside lenses 10L and 10R. By processing information on the observer's eye captured by the gaze sensor and the reflected light from the IRED using a signal processing board (not shown), the observer's gaze can be detected and the location at which the observer is gazing can be identified.

[0012] As shown in Fig. 3, left and right imaging cameras 20L and 20R and left and right alignment cameras 21L and 21R are provided on the front surface of the housing 101. The imaging cameras 20L and 20R are stereo cameras that acquire real images to be displayed to an observer via the lenses 10L and 10R. The alignment cameras 21L and 21R are stereo cameras for acquiring the position and orientation of the display device 100 by using feature points such as markers and object edges extracted from the acquired images. The alignment cameras 21L and 21R are monochrome, but aim to achieve high-precision and high-fault-tolerance alignment by utilizing a wide angle of view, a high shutter speed, a long baseline length, and the like. In this embodiment, the imaging cameras 20L, 20R and the alignment cameras 21L, 21R are provided separately, but the imaging cameras 20L, 20R may be configured to acquire display images and alignment information only by using the imaging cameras 20L, 20R. The alignment cameras 21L, 21R may be replaced with distance sensors using ultrasonic waves, infrared rays, or the like.

[0013] A cable 60 is connected to the left end of the top surface of the housing 101. The cable 60 is arranged so as to extend to the side of the display device 100. The display device 100 communicates position information and image data with an external personal computer or controller via the cable 60, generates a display image in which a 3DCG image is superimposed on a real image, and displays the display image on a display unit such as an LCD or OLED. An observer can observe the display unit via an observation optical system.

[0014] Operation buttons 30a to 30c that receive instructions from the observer, power operations, etc. are arranged on the top surface of the housing 101. The operation buttons 30a to 30c are arranged so that the observer can operate them by grasping the top and bottom of the housing 101. This makes it possible to operate the buttons with one hand while suppressing misalignment between the observation optical system and the observer that occurs due to recoil when operating the operation buttons, which can occur when the operation buttons are arranged on the side of the housing 101.

[0015] 4 is a perspective view showing an HMD using the display device 100. The display device 100 is supported so as to be suspended by a head-mounted unit 200, which is a head-mounted device, and thereby the observer can observe the display unit in a hands-free manner.

[0016] Head mounted unit 200 supports display device 100 via vertical movement section 202. Display device 100 has swing section 102 provided on its upper portion supported by vertical movement section 202, and as shown in Fig. 5, display device 100 can be swung back and forth (arrow A1). In addition, vertical movement section 202 can be used to operate dial 201 provided on head mounted unit 200 to move display device 100 in the vertical direction (arrow A2). This, combined with the interpupillary distance adjustment function described above, allows lenses 10L and 10R to be adjusted to the optimal observation position. 6, the head mounted unit 200 is provided with a flip-up mechanism, and can swing the display device 100 to a flip-up position in which the display device 100 is positioned substantially horizontally. This allows the observer to temporarily view the outside directly without removing the HMD from the head H. Since the cable 60 extends to the side of the display device 100, the display device 100 can be flipped up without the cable 60 interfering with the head mounted unit 200.

[0017] 1(a) and (b), a nose relief portion 40 for avoiding interference with the viewer's nose is formed at the bottom of the left-right center of the housing 101. The nose relief portion 40 has a concave shape that widens and deepens toward the bottom to match the shape of the nose (opening 40a). The nose relief portion 40 has a symmetrical curved surface 40b.

[0018] Further, a proximity sensor 50 serving as a detector for detecting the proximity of the observer's face is provided in the nose relief section 40. As shown in Fig. 2, the proximity sensor 50 is disposed below the height position 10a of the optical axis center C of the observation optical system, and detects the observer's nose. The proximity sensor 50 detects the proximity of an object by projecting infrared light radially within a predetermined range and outputting the amount of infrared light received that is reflected by the object and returned. The output value of the proximity sensor 50 is transmitted to a signal processing board (not shown). The signal processing board is disposed above the height position 10a of the optical axis center C of the observation optical system in the housing 101, and is connected to the proximity sensor 50 via a flexible board. The signal processing board determines whether or not an object is present near the proximity sensor 50 by determining whether or not the output value of the proximity sensor 50 exceeds a predetermined threshold value. When the observer is looking through the lenses 10L and 10R, the amount of infrared light reflected by the observer's nose increases, so that it can be detected that the observer's face is close and the observer is looking through the lenses 10L and 10R. Depending on the detection result, the operating and non-operating states of each device, such as a display device such as an LCD or an OLED, can be switched to reduce the power consumption of the display device 100.

[0019] The nose relief portion 40 and the proximity sensor 50 will now be described in further detail. The proximity sensor 50 is disposed in the upper part of the nose relief portion 40, i.e., in the narrow and shallow part of the nose relief portion 40. A flat portion 41 is formed in the bottom of the upper part of the nose relief portion 40 in a one-step deeper form, and a window 51 serving as the light projecting portion and light receiving portion of the proximity sensor 50 is disposed in this flat portion 41. In this way, by providing flat surfaces of the same height within a certain range around the proximity sensor 50, the infrared light projected by the proximity sensor 50 is prevented from being reflected by the housing 101, and false detection is prevented.

[0020] The proximity sensor 50, which projects infrared light radially, is arranged along the concave shape of the nose recess 40, so that the center line 50b of the light projection range (detection range) 50a of the proximity sensor 50 faces downward with respect to the optical axis direction of the observation optical system, as shown in FIG. 1(b) and FIG. 7(c) described later. The optical axis direction is the direction in which the optical axis center C extends and the direction parallel thereto. In this embodiment, the center line 50b of the light projection range 50a faces diagonally downward at about 45 degrees with respect to the optical axis direction.

[0021] In addition, it is desirable that the curved surface 40b of the nose relief portion 40 is set so that the infrared light reflected by the observer's nose is guided to the window 51 of the proximity sensor 50. For example, the concave shape of the nose relief portion 40 is made to have the shape of a part of a spheroid (a 1 / 4 part of a spheroid cut by a plane including the rotation axis and a plane perpendicular to the plane including the center). An ellipse has a property that light rays emitted from one focus are reflected by the surface of the ellipse and collected at the other focus. By disposing the proximity sensor 50 near the focus projection of the bottom of the nose relief portion 40, the infrared light reflected by the nose is reflected by the curved surface 40b and easily returns to the window 51 of the proximity sensor 50. Although the spheroid is described, it may be an approximately spheroid close to a spheroid.

[0022] Next, the action and effect of the HMD according to this embodiment will be described with reference to Figures 7 and 8. Note that Figures 7(a), (b) and Figures 8(a), (b) are comparative examples for this embodiment, but the same components as those in the embodiment will be described with the same reference numerals.

[0023] FIG. 7 is a diagram for explaining the light projection range 50a of the proximity sensor 50 when the display device 100 is in the flip-up position. 7A shows, as a comparative example, an example in which the proximity sensor 50 is disposed above the height position 10a of the optical axis center C of the observation optical system. In this example, the center line 50b of the light projection range 50a of the proximity sensor 50 faces the optical axis direction of the observation optical system. Therefore, in the flip-up position, the center line 50b of the light projection range 50a of the proximity sensor 50 faces approximately directly downward. In this case, the light projection range 50a may overlap the observer's nose, and it may be erroneously detected that the observer is looking into the lenses 10L, 10R when it should be detected that the observer is not looking into the lenses 10L, 10R.

[0024] Fig. 7(b) shows, as a comparative example, an example in which the proximity sensor 50 is disposed near the height position 10a of the optical axis center C of the observation optical system. In this example, the center line 50b of the light projection range 50a of the proximity sensor 50 faces the optical axis direction of the observation optical system. In this case, too, in the flip-up position, the center line 50b of the light projection range 50a of the proximity sensor 50 faces almost directly downward, but the light projection range 50a is away from the observer's nose, making it possible to reduce the possibility of false detection compared to the comparative example in Fig. 7(a).

[0025] 7(c) shows this embodiment. The center line 50b of the light projection range 50a of the proximity sensor 50 faces downward with respect to the optical axis direction of the observation optical system (facing diagonally downward at about 45 degrees with respect to the optical axis direction). Therefore, in the flip-up position, the center line 50b of the light projection range 50a of the proximity sensor 50 faces in the direction opposite to the observer's face. In this case, the light projection range 50a is far away from the observer's nose, so the possibility of false detection can be significantly reduced.

[0026] FIG. 8 is a diagram for explaining the influence when a viewer wears glasses 70. In FIG. 8(a) and (b) show an example in which the proximity sensor 50 is disposed near the height position 10a of the optical axis center C of the observation optical system as a comparative example. FIG. 8(a) shows a state in which the observer is not wearing glasses, and FIG. 8(b) shows a state in which the observer is wearing glasses 70. FIG. 8(a) and (b) show a border state in which the entire image on the display unit can be observed through the lenses 10L and 10R. In this state, it can be said that switching the detection of proximity by the proximity sensor 50 is the most effective for reducing power consumption. As shown in FIG. 8(a) and (b), when the proximity sensor 50 is disposed near the height position 10a, the distance between the proximity sensor 50 and the observer's face (including the glasses 70) changes depending on whether the observer wears the glasses 70, as shown by distance A in FIG. 8(a) and distance B in FIG. 8(b), and a shift occurs in the detection timing by the proximity sensor 50.

[0027] Fig. 8(c) shows this embodiment. Note that Fig. 8(c) shows a cross section of the HMD and glasses 70. Fig. 8(c) shows the boundary state of whether or not the entire image on the display unit can be observed through the lenses 10L and 10R, just like Figs. 8(a) and (b). Since the proximity sensor 50 detects the viewer's nose, the distance C between the proximity sensor 50 and the nose remains the same regardless of whether the viewer wears glasses 70, and there is no lag in the detection timing by the proximity sensor 50.

[0028] In addition, in this embodiment, the proximity sensor 50 detects the viewer's nose, so it does not project infrared light in the direction of the viewer's eyes. Therefore, the infrared light of the proximity sensor 50 does not enter the gaze sensor of the gaze detection unit, and does not affect the performance of the gaze detection unit.

[0029] As described above, in an HMD in which the display device 100 is supported by a head-mounted unit 200 in a rockable manner, when detecting the proximity of the display device 100 to the observer's face, it is possible to prevent erroneous detection and to prevent deviations in the detection timing.

[0030] [Second embodiment] Next, a second embodiment will be described with reference to Fig. 9. In comparison with the first embodiment, the second embodiment is an example in which a reflecting section 42 is provided in the nose relief section 40, which reflects infrared light projected by the proximity sensor 50 and reflected by the viewer's nose in the direction of the proximity sensor 50. Hereinafter, the same components as those in the first embodiment are given the same reference numerals, and their description is omitted, and the differences from the first embodiment will be mainly described.

[0031] FIG. 9 is a diagram showing a display device 100, where (a) is a diagram showing the rear of the display device 100, (b) is an enlarged perspective view of a portion, and (c) is a cross-sectional view taken along line cc in (a). When the observer's nose is the detection target of the proximity sensor 50, the detection target is not a flat surface but an inclined surface with respect to the light projection direction of the proximity sensor 50. Therefore, some of the infrared light projected onto the nose is reflected in a direction different from the direction returning to the proximity sensor 50. Therefore, it is preferable to efficiently guide the infrared light reflected by the nose to the proximity sensor 50. In this embodiment, as shown in Fig. 9, a concave-convex portion functioning as a reflecting portion 42 is formed in the lower portion of the nose relief portion 40. The concave-convex portion is formed with a reflecting surface 42a that is arranged in an arc shape with the window 51 of the proximity sensor 50 as the approximate center and reflects infrared light in the direction of the window 51. As a result, as shown by the arrow L in Fig. 9(c), the infrared light reflected by the nose is reflected by the reflecting surface 42a and returns to the window 51 of the proximity sensor 50, and the infrared light reflected by the nose can be efficiently guided to the proximity sensor 50.

[0032] Although the present invention has been described above with reference to the embodiments, the above embodiments are merely illustrative of the specific examples of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these embodiments. In other words, the present invention can be embodied in various forms without departing from its technical concept or main features.

[0033] The disclosure of this embodiment includes the following configuration. (Configuration 1) A display device supported by a head-mounted device that is attached to the head of an observer so as to be capable of swinging, an observation optical system that guides light to the observer's eye; a detection unit that detects the proximity of the camera to a face of the observer, The display device according to claim 1, wherein the detection unit is disposed below a height position of a center of an optical axis of the observation optical system, and detects the nose of the observer. (Configuration 2) a housing in which the observation optical system is provided, the housing is provided with a nose relief portion for avoiding interference with the viewer's nose, The display device according to configuration 1, wherein the detection unit is provided in the nose recess. (Configuration 3) 3. The display device according to configuration 1 or 2, wherein a center line of a detection range of the detection unit faces downward with respect to an optical axis direction of the observation optical system. (Configuration 4) 4. The display device according to any one of configurations 1 to 3, wherein the detection unit detects the proximity of an object by projecting infrared light and receiving the infrared light reflected by the observer's nose. (Configuration 5) The nose relief portion has a concave shape that becomes wider and deeper toward the bottom, The display device according to configuration 2, wherein the detection unit is disposed above the nose relief portion. (Configuration 6) The display device according to configuration 5, wherein the nose relief portion has a curved surface that is symmetrical on the left and right. (Configuration 7) the detection unit detects the proximity of the observer by projecting infrared light and receiving the infrared light reflected by the observer's nose; The display device according to configuration 2, 5 or 6, wherein the detection unit is disposed on a flat surface provided at the bottom of the nose relief portion. (Configuration 8) the detection unit detects the proximity of the observer by projecting infrared light and receiving the infrared light reflected by the observer's nose; The display device described in configuration 2, 5, 6 or 7, characterized in that the nose relief portion is provided with a reflecting portion that reflects infrared light projected by the detection portion and reflected by the observer's nose in the direction of the detection portion. [Explanation of symbols]

[0034] 10L, 10R: lenses, 40: nose relief portion, 40a: opening, 40b: curved surface, 41: flat portion, 42: reflecting portion, 50: proximity sensor, 100: display device, 101: housing, 200: head mounted unit

Claims

1. A display device that is swingably supported by a head-mounted device that is worn on the head of an observer, a housing provided with an observation optical system that guides light to the observer's eyes and a nose relief portion that prevents interference between the observation optical system and the observer's nose; a detection unit provided in the nose relief portion and configured to detect proximity of the nose relief portion to the viewer's face.

2. The display device according to claim 1 , wherein the detection unit detects proximity by projecting infrared light and receiving the reflected infrared light.

3. A display device as described in Claim 2, characterized in that the nose relief portion is provided with a reflecting portion that further reflects the infrared light reflected by the observer's face.

4. A display device as described in Claim 3, characterized in that the reflective portion has a part of an ellipsoid of revolution.

5. The nose relief portion has a concave shape that widens and deepens toward the bottom, The display device according to claim 1 , wherein the detection unit is disposed above the nose relief portion.

6. The display device according to claim 5 , wherein the nose relief portion has a curved surface that is symmetrical on both sides.

7. A display device as described in Claim 5, characterized in that the detection unit is arranged on a flat surface provided in the nose relief portion.

8. 2. The display device according to claim 1, wherein a center line of the detection range of the detection unit faces downward with respect to the optical axis of the observation optical system.

9. A display device as described in Claim 2, characterized in that the center line of the projection range of the infrared light is downward relative to the optical axis direction of the observation optical system.

Images