Head-mounted display

Abstract

The present invention provides a head-mounted display that prevents light of a predetermined wavelength from entering the user's eyes while allowing the user to smoothly determine the location of the light-emitting region of that predetermined wavelength. [Solution] AR glasses 1 are a see-through type head-mounted display that overlays an image onto a landscape. AR glasses 1 include a filter 4 that blocks light of a predetermined wavelength contained in the landscape, at least one camera 5 that acquires an image of a light-emitting region created when light of a predetermined wavelength is irradiated onto the surface of an object in the landscape, and a display control unit 6a that displays a display image based on the image of the light-emitting region at a position corresponding to the light-emitting region in the landscape.

Description

Technical Field

[0001] The present invention relates to a see-through type head-mounted display that overlays and displays an image on a landscape.

Background Art

[0002] Conventionally, welding surfaces used in various welding operations are known. In Patent Document 1 below, a filter plate that shields harmful light rays such as ultraviolet radiation harmful to the eyes, a sensor that detects the temperature of a welding part corresponding to the visual field area of the filter plate, and a screen that is arranged adjacent to the visual field area and displays the temperature distribution of the welding part are provided. A welding surface is described. The user visually recognizes the welding part through the visual field area of the filter plate and grasps the state of the welding part by checking the temperature distribution displayed on the screen.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When assembling optical components or the like, the positions of the respective optical components are adjusted so that the light from the light source is properly irradiated onto each optical component. In this case, depending on the wavelength and intensity of the light from the light source, it is necessary to avoid this light from directly entering the user's eyes. However, on the other hand, in order to perform the above-mentioned assembly work or the like, the user needs to grasp the position of the light-emitting area generated on the optical component by this light. Therefore, it is desirable to be able to smoothly grasp the light-emitting area of this light while preventing the light of a predetermined wavelength emitted from the light source from directly entering the user's eyes.

[0005] In view of these challenges, the present invention aims to provide a head-mounted display that prevents light of a predetermined wavelength from entering the user's eyes while enabling smooth determination of the location of the light emission region of a predetermined wavelength. [Means for solving the problem]

[0006] The main aspect of the present invention relates to a see-through type head-mounted display that overlays an image onto a landscape. The head-mounted display according to this aspect includes a filter that shields light of a predetermined wavelength contained in the landscape, at least one camera that acquires an image of a light-emitting region generated when the predetermined wavelength of light is irradiated onto the surface of an object in the landscape, and a display control unit that displays a display image based on the image of the light-emitting region at a position in the landscape corresponding to the light-emitting region.

[0007] According to the head-mounted display of this embodiment, light of a predetermined wavelength is blocked by a filter, while a display image based on an image of the light-emitting region is displayed at a position corresponding to the light-emitting region in the landscape. As a result, the user can avoid directly seeing the light of the predetermined wavelength, and can visually confirm the position of the light-emitting region by superimposing the display image at the position corresponding to the light-emitting region in the landscape. Thus, the position of the light-emitting region of the predetermined wavelength can be smoothly grasped while preventing light of the predetermined wavelength from entering the user's eyes. [Effects of the Invention]

[0008] As described above, the present invention provides a head-mounted display that prevents light of a predetermined wavelength from entering the user's eyes while allowing the user to smoothly determine the location of the light emission region of a predetermined wavelength.

[0009] The effects and significance of the present invention will become even clearer from the description of the embodiments shown below. However, the embodiments shown below are merely examples of how to implement the present invention, and the present invention is not limited in any way to those described in the embodiments below. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a perspective view showing the configuration of AR glasses according to Embodiment 1. [Figure 2] Figure 2 is a schematic diagram showing the configuration of an optical scanning device according to Embodiment 1. [Figure 3] Figure 3 is a plan view showing the configuration of AR glasses according to Embodiment 1. [Figure 4] Figures 4(a) to 4(c) illustrate examples of how the AR glasses are used according to Embodiment 1. [Figure 5] Figures 5(a) to 5(c) are diagrams illustrating the procedure for adjusting the position of optical components according to Embodiment 1, respectively. [Figure 6] Figure 6 is a flowchart showing the process for adjusting the position of the displayed image according to Embodiment 1. [Figure 7] Figure 7 is a schematic diagram illustrating the image viewed by the user, the display image based on the image captured by the left camera, and the display image based on the image captured by the right camera, according to Embodiment 1. [Figure 8] Figure 8 is a flowchart showing the display process of the displayed image when using AR glasses according to Embodiment 1. [Figure 9] Figure 9 is a flowchart showing the process for adjusting the position of the displayed image according to Embodiment 2. [Figure 10] Figure 10 is a side view of the AR glasses according to Embodiment 2, as seen from the perspective of a user wearing the AR glasses. [Figure 11] Figure 11 is a perspective view showing the configuration of AR glasses according to Embodiment 3. [Figure 12] Figure 12 is a flowchart showing the process for adjusting the position of the displayed image according to Embodiment 3. [Figure 13] Figure 13 is a perspective view showing the configuration of AR glasses in an example of a modified image display device. [Figure 14] Figure 14 is a plan view showing the configuration of AR glasses in an example of a modified image display device. [Modes for carrying out the invention]

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following embodiments show examples in which the present invention is applied to a see-through type head-mounted display that overlays and displays an image on a landscape. Examples of the head-mounted display include AR glasses and AR goggles. The head-mounted display in the following embodiments is AR glasses. However, the following embodiments are one embodiment of the present invention, and the present invention is not limited to the following embodiments at all.

[0012] For convenience, vertical, horizontal, left, and right directions orthogonal to each other are added to each figure. However, the left and right directions shown in FIGS. 1, 11, and 13 are the left and right directions when viewing the AR glasses 1 from the front, and the left and right directions shown in the other figures are the left and right directions when viewed from the user wearing the AR glasses 1. Also, for convenience, X, Y, and Z axes orthogonal to each other are added to each figure. The X-axis direction, Y-axis direction, and Z-axis direction correspond to the left and right direction, front and back direction, and up and down direction, respectively.

[0013] <Embodiment 1> FIG. 1 is a perspective view showing the configuration of the AR glasses 1.

[0014] The AR glasses 1 include a frame 2, a pair of image display devices 3, a pair of filters 4, a pair of cameras 5, and a substrate 6. The AR glasses 1 are worn on the user's head like ordinary glasses.

[0015] The frame 2 is composed of a front portion 2a, a pair of side portions 2b, and a pair of support portions 2c. The front portion 2a and the pair of side portions 2b surround the front and sides of the user's pair of eyes E and are longer vertically than the range of the user's pair of eyes E in the vertical direction. The pair of support portions 2c extend rearward from the pair of side portions 2b. When the frame 2 is worn by the user, the front portion 2a is positioned in front of the user's pair of eyes E. The frame 2 is made of an opaque material. However, only the region T of the front portion 2a where the filter 4 is installed is made of a transparent material.

[0016] A pair of image display devices 3 are symmetric with respect to the Y-Z plane passing through the center of the AR glass 1. The image display device 3 displays a display image in front of the eyes E of a user wearing the AR glass 1 on the head. The image display device 3 includes an optical scanning device 10 and a light guide plate 20. The optical scanning device 10 is installed on the inner surface of the side portion 2b, and the light guide plate 20 is installed on the rear surface of the front portion 2a. The light guide plate 20 is made of a transparent material.

[0017] The light emitted from the optical scanning device 10 is taken into the light guide plate 20, propagates through the light guide plate 20, and is emitted from the diffraction regions 21b, 22b (see FIG. 3) of the light guide plate 20 arranged in front of the eyes E. The light emitted from the optical scanning device 10 is scanned in the left-right direction and the up-down direction in the diffraction regions 21b, 22b. As a result, a display image is displayed in the display region corresponding to the diffraction regions 21b, 22b.

[0018] A pair of filters 4 are arranged on the front surface of the front portion 2a and are symmetric with respect to the Y-Z plane passing through the center of the AR glass 1. The filter 4 is an optical filter that blocks light of wavelength λ1 and transmits light of wavelengths other than wavelength λ1. The wavelength λ1 is, for example, the wavelength of blue-violet light. Thereby, the user can see light excluding light of wavelength λ1 as the front scenery through the filter 4, the region T of the front portion 2a, and the light guide plate 20, and can see the display image displayed in the display region of the light guide plate 20 superimposed on the front scenery. The wavelength λ1 will be described later with reference to FIG. 4.

[0019] A pair of cameras 5 are symmetric with respect to the Y-Z plane passing through the center of the AR glass 1. The camera 5 is installed on the outer surface of the side portion 2b and images the front scenery. A camera filter 5a is installed at the front end of the camera 5. The camera filter 5a is an optical filter that transmits light of wavelength λ1 and light of wavelength λ2. Thereby, the camera 5 can image only light of wavelengths λ1 and λ2 in the front scenery. The wavelength λ2 will be described later with reference to FIG. 5.

[0020] The circuit board 6 is installed on the outer surface of the right side portion 2b. The circuit board 6 is connected to a pair of optical scanning devices 10 and a pair of cameras 5. A display control unit 6a and an interface 6b are installed on the circuit board 6. The display control unit 6a controls the pair of optical scanning devices 10 to display a display image based on the captured images acquired by the pair of cameras 5 in the display area of ​​the pair of light guide plates 20. The display control unit 6a communicates wirelessly with the input device 7 via the interface 6b.

[0021] The input device 7 is a device for inputting the adjustment amount to the AR glasses 1 when the user adjusts the position of the display image displayed in the display area of ​​the light guide plate 20. The input device 7 includes a mode switching switch 71, buttons 72a and 72b, and a dial 73.

[0022] When the user uses AR glasses 1 to assemble optical components as described later, they operate the mode switch 71 to switch the operation mode to the usage mode. When the user adjusts the position of the displayed image, they operate the mode switch 71 to switch the operation mode to the position adjustment mode. In position adjustment mode, the user presses either button 72a or 72b and then operates the dial 73. The user changes the amount of adjustment in the target direction by rotating the dial 73 and determines the amount of adjustment by pressing the dial 73. The adjustment of the position of the displayed image will be explained later with reference to Figures 4 to 8.

[0023] Figure 2 is a schematic diagram showing the configuration of the optical scanning device 10.

[0024] The optical scanning device 10 comprises a light source 11, a first scanning unit 12, a relay optical system 13, and a second scanning unit 14.

[0025] The light source 11 comprises light-emitting elements 101, 102, and 103, collimator lenses 111, 112, and 113, apertures 121, 122, and 123, a mirror 131, and dichroic mirrors 132 and 133.

[0026] The light-emitting elements 101, 102, and 103 are, for example, semiconductor laser elements. Light-emitting element 101 emits light L1 in the first wavelength band (red wavelength band) included in the range of 600 nm to 700 nm, light-emitting element 102 emits light L2 in the second wavelength band (green wavelength band) included in the range of 500 nm to 600 nm, and light-emitting element 103 emits light L3 in the third wavelength band (blue wavelength band) included in the range of 400 nm to 500 nm. Since the light in each of the above wavelength bands is emitted at a low intensity level that allows the display image to be displayed, there is no safety problem even if this light enters the user's eyes E.

[0027] Collimator lenses 111, 112, and 113 align the light L1, L2, and L3 emitted from light-emitting elements 101, 102, and 103. Apertures 121, 122, and 123 shape the aligned light L1, L2, and L3 into substantially circular beams. The light L1, L2, and L3 that have passed through apertures 121, 122, and 123 are aligned in optical axis with each other by a matching optical system consisting of mirror 131 and dichroic mirrors 132 and 133, and reflected toward the first scanning unit 12.

[0028] The first scanning unit 12 reflects the light L1, L2, and L3 emitted from the light source 11. The first scanning unit 12 is, for example, a MEMS (Micro Electro Mechanical System) mirror. The first scanning unit 12 is configured to rotate the first mirror 12a, which is incident on the light L1, L2, and L3, about an axis 12b parallel to the vertical direction in Figure 1, in accordance with a drive signal. As the first mirror 12a rotates, the direction of light reflection changes. As a result, the light L1 and L2 are scanned horizontally in the diffraction region 21b (see Figure 3) of the light guide plate 20, and the light L3 is scanned horizontally in the diffraction region 22b (see Figure 3) of the light guide plate 20.

[0029] The relay optical system 13 directs the light L1, L2, and L3, reflected by the first scanning unit 12 at a predetermined angle of deflection, toward the center of the second mirror 14a of the second scanning unit 14. The relay optical system 13 also has multiple mirrors, which reflect the light L1, L2, and L3 toward the second scanning unit 14. This allows for a long optical path length within the relay optical system 13, thereby suppressing the angle of deflection of the light as seen from the second mirror 14a.

[0030] The second scanning unit 14 reflects light that has passed through the relay optical system 13. The second scanning unit 14 is, for example, a MEMS mirror. The second scanning unit 14 is configured to rotate the second mirror 14a, into which light L1, L2, and L3 are incident, about an axis 14b parallel to the horizontal direction in Figure 1, in accordance with a drive signal. As the second mirror 14a rotates, the direction of light reflection changes. As a result, light L1 and L2 are scanned vertically in the diffraction region 21b (see Figure 3) of the light guide plate 20, and light L3 is scanned vertically in the diffraction region 22b (see Figure 3) of the light guide plate 20.

[0031] Figure 3 is a plan view showing the configuration of the AR glasses 1. Referring to Figure 3, the configuration of the light guide plate 20 and the display control unit 6a and interface 6b located on the substrate 6 will be described. In Figure 3, for convenience, the portion of the frame 2 other than the area T made of transparent material is shown as halftone dots.

[0032] The light guide plate 20 comprises a first light guide plate 21 and a second light guide plate 22. The first light guide plate 21 is provided with diffraction regions 21a and 21b, and the second light guide plate 22 is provided with diffraction regions 22a and 22b. The diffraction regions 21a and 22a are arranged in the range into which light L1, L2, and L3 reflected by the second mirror 14a (see Figure 2) of the optical scanning device 10 are incident. The diffraction region 21a is provided with a diffraction pattern that selectively acts on the wavelength bands of light L1 and L2, and the diffraction region 22a is provided with a diffraction pattern that selectively acts on the wavelength band of light L3.

[0033] Light L1 and L2 reflected by the second mirror 14a are transmitted through the diffraction region 22a, then diffracted in the diffraction region 21a and taken into the interior of the first light guide plate 21. Similarly, light L3 reflected by the second mirror 14a is diffracted in the diffraction region 22a and taken into the interior of the second light guide plate 22. Subsequently, light L1, L2, and L3 undergo repeated total internal reflection on the inner surfaces of the first light guide plate 21 and the second light guide plate 22, propagating into wavelength-selective diffraction regions 21b and 22b. At this time, diffraction regions for changing the direction of propagation of light L1, L2, and L3, or diffraction regions for expanding the scanning range, may be formed on the inner surfaces of the first light guide plate 21 and the second light guide plate 22.

[0034] In this way, light rays L1 and L2 are scanned through the diffraction region 21b and emitted from the diffraction region 21b in the direction of the eye E. Light ray L3 is scanned through the diffraction region 22b and emitted from the diffraction region 22b in the direction of the eye E. As a result, the user can see the display images drawn in the diffraction regions 21b and 22b respectively as a composite, and the image that the user sees is formed in the landscape in front of them.

[0035] The display control unit 6a includes an arithmetic processing unit such as a CPU or FPGA and memory. The display control unit 6a controls a pair of optical scanning devices 10 and a pair of cameras 5. Interface 6b is a wireless communication unit, such as a Bluetooth® adapter. The display control unit 6a communicates with the input device 7 via interface 6b.

[0036] The display control unit 6a extracts regions corresponding to light of wavelengths λ1 and λ2 from the captured image acquired by the camera 5, based on regions with pixel values ​​above a predetermined threshold, and generates a display image. The display control unit 6a then controls the optical scanning device 10 to display the generated display image in the display region (diffraction regions 21b and 22b). Furthermore, the display control unit 6a adjusts the position of the display image to be displayed in the display region (diffraction regions 21b and 22b) when the user uses the AR glasses 1, based on the adjustment amount input by the user using the input device 7 during the adjustment of the display image position.

[0037] Incidentally, when assembling optical components, the position of each optical component is adjusted so that light from the light source properly illuminates each component. In this case, depending on the wavelength and intensity of the light from the light source, it is necessary to avoid this light directly entering the user's eye E. However, on the other hand, in order to perform the above assembly work, the user needs to know the location of the light-emitting area produced by this light on the optical component. Therefore, it is desirable to be able to smoothly grasp the light-emitting area of ​​this light while preventing the light of a predetermined wavelength emitted from the light source from directly entering the user's eye E.

[0038] In contrast, in this embodiment, light of a predetermined wavelength λ1 is blocked by the filter 4, preventing it from entering the user's eyes E. The camera 5 captures light of wavelength λ1 to generate an image, and the display control unit 6a displays a display image based on the captured image at a position corresponding to the light-emitting region in the landscape. As a result, the user can see the image formed by the display image of the light-emitting region superimposed on the landscape in front of them, allowing them to perform tasks such as assembling optical components smoothly.

[0039] Next, we will describe some examples of how AR glasses 1 can be used.

[0040] Figures 4(a) to 4(c) show the configuration of the optical components to be assembled. Figures 4(a) to 4(c) illustrate the optical components, which include a base 200, a light source 210, and a reflective optical element 220. The light source 210 is mounted on the base 200 and includes a light-emitting element 211 that emits laser light of wavelength λ1. The optical element 220 is an optical component that is subject to position adjustment and has an incident surface 221 on the surface facing the light-emitting element 211 to which light from the light source 210 is incident. When assembling the optical components, the user adjusts the position of the optical element 220, for example, so that the irradiation state of the laser light on the incident surface 221 is appropriate.

[0041] Figure 4(a) shows how the user sees the optical components when they look directly at them without wearing AR glasses 1. Because the laser light is scattered in the light-emitting region A1 around the light-emitting element 211 and in the light-emitting region A2 around the position where the laser light enters the incident surface 221, the user can see light-emitting regions A1 and A2. In reality, the user can hardly see the laser light traveling through space, but for convenience, the optical path of the laser light traveling through space is illustrated with a dashed arrow in Figure 4(a). In this case, the user can directly see light-emitting regions A1 and A2, but in actual work, it is undesirable for laser light with wavelength λ1 to enter the user's eyes E.

[0042] Figure 4(b) shows how the user sees the optical components when viewed through the filter 4, that is, when wearing AR glasses 1 with the image display device 3 omitted. In this case, the light of wavelength λ1 from the light-emitting regions A1 and A2 is blocked by the filter 4. Therefore, although the user can see the scenery in front of them (each optical component), they cannot determine where the light-emitting regions A1 and A2 are located.

[0043] Figure 4(c) shows how the user sees the optical components when wearing the AR glasses 1 (Embodiment 1). In this embodiment, as in Figure 4(b), the light of wavelength λ1 from the light-emitting regions A1 and A2 is blocked by the filter 4. However, in this embodiment, display images based on the captured images of the light-emitting regions A1 and A2 captured by the pair of cameras 5 are superimposed on the display areas D1 of the left and right light guide plates 20 at positions corresponding to the light-emitting regions A1 and A2. As a result, the light of wavelength λ1 is prevented from entering the user's eyes E, and the user can see the images 31 and 32 formed by the display images corresponding to the light-emitting regions A1 and A2 superimposed on the light-emitting regions A1 and A2, thus enabling them to smoothly grasp the positions of the light-emitting regions A1 and A2 with wavelength λ1. Therefore, the user can smoothly perform tasks such as assembling optical components.

[0044] Here, it is assumed that the display images corresponding to the left and right eyes E within the display area D1 are displayed shifted relative to the positions corresponding to the light-emitting areas A1 and A2. In this case, the images 31 and 32 that the user sees will be shifted relative to the light-emitting areas A1 and A2. Therefore, in this embodiment, the position adjustment process shown below is performed so that the images 31 and 32 properly overlap the light-emitting areas A1 and A2.

[0045] Figures 5(a) to 5(c) illustrate the procedure for adjusting the position of optical components. The following explanation will use the optical element 220 shown in Figures 4(a) to 5(c) as the object of position adjustment.

[0046] As shown in Figure 5(a), an adjustment device 230 is used for position adjustment. The adjustment device 230 is equipped with a phosphor 231. The phosphor 231 is an optical filter that converts light of wavelength λ1 to light of wavelength λ2. When the user performs position adjustment, they move the adjustment device 230 to place the phosphor 231 on the incident surface 221 of the optical element 220. In this state, when light of wavelength λ1 is emitted from the light-emitting element 211, the light of wavelength λ1 is irradiated onto the phosphor 231 placed on the incident surface 221, creating an emission region A3. The emission region A3 is located in approximately the same position as the emission region A2 (see Figure 4(a)) which is created when light of wavelength λ1 is irradiated onto the incident surface 221. The wavelength of the light emitted from the emission region A3 is λ2.

[0047] In this case, as shown in Figure 5(b), when viewing the optical component through the filter 4, the user cannot see the emission region A1 at wavelength λ1, but can see the emission region A3 at wavelength λ2. This is because the filter 4 transmits light of wavelengths other than λ1.

[0048] Furthermore, as shown in Figure 5(c), when the user wears the AR glasses 1 and looks at the optical component (Embodiment 1), the user can see the light-emitting region A3 with wavelength λ2 through the filter 4, similar to Figure 5(b). In addition, in Embodiment 1, the display area D1 displays a display image based on the light-emitting region A1 and a display image based on the light-emitting region A3, and the user can see the image 31 based on the display image of the light-emitting region A1 and the image 32 based on the display image of the light-emitting region A3.

[0049] At this time, as shown in Figure 5(c), the position of the light-emitting region A3 and the image 32 may be misaligned. In this case, the user operates the input device 7 to change the position of the display image based on the light-emitting region A3 to a position corresponding to the light-emitting region A3, so that the position of the image 32 overlaps with the position of the light-emitting region A3. The display control unit 6a stores the amount of adjustment for this position adjustment and, when assembling the actual optical components, uses the stored adjustment amount to display the display images corresponding to the light-emitting regions A1 and A2. As a result, as shown in Figure 4(c), the images 31 and 32 are properly superimposed on the light-emitting regions A1 and A2.

[0050] In addition, during position adjustment, the user may operate the input device 7 to change the position of the display image based on the light-emitting region A1 so that the position of the image 31 overlaps with the position of the light-emitting element 211. In this case, the adjustment device 230 (phosphor 231) is not required. The display control unit 6a stores the amount of adjustment for this position adjustment and, when assembling the actual optical components, uses the stored adjustment amount to display the display images corresponding to the light-emitting regions A1 and A2.

[0051] Figure 6 is a flowchart showing the process of adjusting the position of the displayed image. Figure 7 is a schematic diagram showing the image 32 viewed by the user, the displayed image 32a based on the image captured by the left camera 5, and the displayed image 32b based on the image captured by the right camera 5.

[0052] The AR glasses 1 have two operating modes: a position adjustment mode and a usage mode. When the user wants to adjust the position of the displayed image, they operate the mode switch 71 (see Figure 1) on the input device 7 to set the operating mode to position adjustment mode. The optical elements 220 shown in Figures 4(c) and 5(c) will be described below as the target of position adjustment.

[0053] Referring to Figure 6, the user sets the position adjustment mode and then moves the adjustment device 230 to superimpose the phosphor 231 onto the incident surface 221 of the optical element 220 (S11). The display control unit 6a controls a pair of cameras 5 to capture the scenery in front and acquires a pair of captured images of the light-emitting area A3 of the phosphor 231 from the pair of cameras 5 (S12). The display control unit 6a also generates display images 32a and 32b based on the captured images from the left and right cameras 5 and controls the optical scanning device 10 to display the generated display images 32a and 32b in the display area D1 of the light guide plate 20, respectively (S12).

[0054] Next, position adjustment in the depth direction is performed, consisting of steps S13 and S14. The display control unit 6a uses the parallax of the pair of display images 32a and 32b generated in step S11 to calculate the distance in the depth direction (front-to-back direction) of the light-emitting region A3, with the midpoint of the pair of cameras 5 as the origin, by triangulation (S13). This distance calculation is based on the well-known stereo camera method. Then, based on the calculated distance in the depth direction, the display control unit 6a moves the display image 32a from the left camera 5 and the display image 32b from the right camera 5 by the same amount of movement in opposite directions in the left-to-right direction, corresponding to the depth direction of the light-emitting region A3 (S14).

[0055] Referring to Figure 7, before adjustment, the image 32 is formed based on the display image 32a in state (b1) and the display image 32b in state (c1). As shown in state (a1), the image 32 may be misaligned in the depth direction (front-to-back direction) with respect to the target position (light-emitting region A3). In response to this, in step S14 of Figure 6, the display control unit 6a adjusts the left-to-right positions of the display images 32a and 32b, as shown in states (b2) and (c2), so that the depth direction position of the image 32 is appropriate, based on the depth direction distance of the light-emitting region A3 and the assumed positions of the user's left and right eyes E. In this embodiment, the display control unit 6a stores predetermined positions as the assumed positions of the user's left and right eyes E. Thus, as shown in state (a2), once the depth direction adjustment of the image 32 is completed, the interval ΔL1 + ΔR1 between the display image 32a and the display image 32b is determined.

[0056] Returning to Figure 6, next, position adjustment in the up, down, left, and right directions is performed in step S15. If the user determines that the position of the image 32 and the position of the light-emitting area A3 are misaligned in the up, down, left, and right directions, as shown in Figure 5(c), the user operates the input device 7 to input an adjustment amount so that the image 32 overlaps the light-emitting area A3. The display control unit 6a receives the adjustment amounts in the up, down, left, and right directions input by the user and moves the display image 32a based on the left camera 5 and the display image 32b based on the right camera 5 by the same amount in the up, down, left, and right directions (S15).

[0057] Referring to Figure 7, when the display control unit 6a receives input for vertical adjustment via the input device 7, it moves the display images 32a and 32b vertically by the same amount according to the received adjustment amount, while maintaining the interval ΔL1+ΔR1, as shown in states (b3) and (c3). As a result, the image 32 also moves vertically, as shown in state (a3). Furthermore, when the display control unit 6a receives input for horizontal adjustment via the input device 7, it moves the display images 32a and 32b horizontally by the same amount according to the received adjustment amount, while maintaining the state where the interval ΔL2+ΔR2 is equal to the interval ΔL1+ΔR1, as shown in states (b4) and (c4). As a result, the image 32 also moves horizontally, as shown in state (a4), and overlaps with the target position (light-emitting region A3).

[0058] Once the vertical and horizontal position adjustment of the image 32 is complete, the positional displacement amounts ΔXL and ΔYL of the displayed image 32a from its original position and the positional displacement amounts ΔXR and ΔYR of the displayed image 32b from its original position are determined, as shown in states (b5) and (c5).

[0059] Returning to Figure 6, the display control unit 6a stores the interval ΔL1 + ΔR1 between the display image 32a and the display image 32b acquired in step S14, and the positional displacement amounts ΔXL, ΔYL, ΔXR, and ΔYR acquired in step S15, as position adjustment parameters. In this way, the position adjustment of the display images is completed.

[0060] Figure 8 is a flowchart showing the display process of the displayed image when using AR glasses 1.

[0061] When the user uses AR glasses 1 to assemble optical components, they operate the mode selector switch 71 (see Figure 1) on the input device 7 to set the operating mode to the usage mode. The following describes the case where an image 32 is superimposed on the light-emitting region A2 shown in Figure 4(c).

[0062] When the user sets the usage mode, the display control unit 6a reads out the various parameters stored in step S16 of Figure 6 during position adjustment (S1). Subsequently, the display control unit 6a controls the pair of cameras 5 to capture the scenery in front of the light-emitting area A2, and acquires a pair of captured images of the light-emitting area A2 from the pair of cameras 5 (S2). The display control unit 6a also generates a display image 32a based on the image captured by the left camera 5 and a display image 32b based on the image captured by the right camera 5 (S2).

[0063] The display control unit 6a adjusts the positions of the display images 32a and 32b according to the various parameters read in step S1, and displays the adjusted display images 32a and 32b in the display area D1 (S3). Specifically, the display control unit 6a moves the display images 32a and 32b by the same amount of movement, but in opposite directions in the left-right direction, so that the distance between them in the left-right direction is ΔL1 + ΔR1. Furthermore, the display control unit 6a moves the display images 32a and 32b by positional displacement amounts ΔXL and ΔXR in the left-right direction, and by positional displacement amounts ΔYL and ΔYR in the up-down direction. As a result, the image 32 is superimposed on the light-emitting area A2 included in the landscape.

[0064] In steps S2 and S3, it was explained that the display images 32a and 32b based on the light-emitting region A2 are adjusted in position according to the various parameters read in step S1. Similarly, the display images based on other light-emitting regions (for example, light-emitting region A1) are also adjusted in position according to the various parameters read in step S1.

[0065] The display control unit 6a determines whether or not an end command has been input to the power button or the like provided on the AR glasses 1 (S4). The display control unit 6a repeats the processes in steps S2 and S3 at predetermined time intervals until an end command is input (S4: NO), and when an end command is input (S4: YES), it terminates the process shown in Figure 8.

[0066] <Effects of Embodiment 1> According to Embodiment 1, the following effects are achieved.

[0067] The see-through type AR glasses 1 (head-mounted display) that overlays an image onto a landscape comprises a filter 4 that blocks light of wavelength λ1 (a predetermined wavelength) contained in the landscape, a pair of cameras 5 that acquire an image of the light-emitting region A2 that is created when light of wavelength λ1 (a predetermined wavelength) is irradiated onto the incident surface 221 (surface) of an optical element 220 (article) in the landscape, and a display control unit 6a that displays display images 32a and 32b based on the image of the light-emitting region A2 at positions in the landscape corresponding to the light-emitting region A2.

[0068] In this configuration, light of wavelength λ1 is blocked by the filter 4, while display images 32a and 32b based on the captured image of the light-emitting region A2 are displayed at the position corresponding to the light-emitting region A2 in the landscape. This allows the user to avoid directly seeing the light of wavelength λ1 with their eyes E, and to visually confirm the position of the light-emitting region A2 by superimposing the display images 32a and 32b at the position corresponding to the light-emitting region A2 in the landscape. Thus, the position of the light-emitting region A2 of wavelength λ1 can be easily grasped while preventing the light of wavelength λ1 from entering the user's eyes E.

[0069] The AR glasses 1 are equipped with two image display devices 3 that display images 32a and 32b to the left and right eyes E, and two cameras 5 are arranged side by side with a predetermined distance between them. The display control unit 6a calculates the distance to the light-emitting area A3 based on the two display images 32a and 32b (S13 in Figure 6), and controls the position of the display images 32a and 32b based on the calculated distance (S3 in Figure 8).

[0070] With this configuration, the positions of the display images 32a and 32b shown to the left and right eyes E respectively are automatically adjusted based on the distance to the light-emitting region A3. As a result, the position of the image 32 formed by the display images 32a and 32b and the position of the light-emitting region A2 in the landscape are automatically matched in the depth direction. This allows the user to smoothly grasp the correct position of the light-emitting region A2 in the depth direction.

[0071] The AR glasses 1 are equipped with an interface 6b that accepts user input, and the camera 5 acquires an image of the light-emitting region A3 (another light-emitting region) that is generated when light of wavelength λ1 (a predetermined wavelength) is irradiated onto a phosphor 231 placed on the incident surface 221 (surface) of an optical element 220 (article) (S12 in Figure 6). The display control unit 6a displays display images 32a and 32b (other display images) based on the image of the light-emitting region A3 (another light-emitting region) at positions corresponding to the light-emitting region A3 (another light-emitting region) in the landscape (S12), and receives input via the interface 6b to change the position of the displayed display images 32a and 32b (other display images) in the up, down, left, and right directions (directions perpendicular to the depth direction) to the position of the light-emitting region A3 (another light-emitting region) included in the landscape (S15), and controls the display position of the display images 32a and 32b based on the received input (S3 in Figure 8).

[0072] This configuration allows the position of the image 32 formed by the displayed images 32a and 32b to be matched with the position of the light-emitting region A2 in the landscape in the up, down, left, and right directions. As a result, the user can determine the correct position of the light-emitting region A2 in the up, down, left, and right directions.

[0073] Camera 5 is equipped with a camera filter 5a that transmits light from light-emitting region A2 and light from light-emitting region A3 (other light-emitting region), and blocks light other than light from light-emitting region A2 and light-emitting region A3 (other light-emitting region).

[0074] This configuration allows for imaging of light from light-emitting regions A2 and A3 with a simple setup.

[0075] A filter 4 located in front of the eye E blocks light of wavelength λ1, and the portion of frame 2 other than the area T where the filter 4 is installed is made opaque, so that frame 2 surrounds the eye E.

[0076] This configuration ensures that light of wavelength λ1 does not enter the user's eye E.

[0077] <Embodiment 2> In Embodiment 1, the position adjustment of the displayed image in the up, down, left, and right directions was performed by the user via the input device 7, but this may be done automatically by the display control unit 6a.

[0078] Figure 9 is a flowchart showing the process of adjusting the position of the displayed image according to Embodiment 2. In this embodiment, a mode switching switch 71 for switching the operating mode is provided on the circuit board 6, and the input device 7 is omitted. Also, the adjustment tool 230 is not used when adjusting the position.

[0079] When the user sets the position adjustment mode, the display control unit 6a controls the pair of cameras 5 to capture the scenery in front, acquires a pair of captured images of the light-emitting area A2 (see Figure 4(a)) from the pair of cameras 5, and generates display images 32a and 32b based on the captured images from the left and right cameras 5 (S21).

[0080] Next, the display control unit 6a uses the parallax of the pair of display images 32a and 32b generated in step S21 to calculate the three-dimensional coordinates of the position of the light-emitting region A2, with the midpoint of the pair of cameras 5 as the origin, by triangulation (S22).

[0081] Here, the display control unit 6a pre-stores the three-dimensional coordinates of the assumed positions of the user's left and right eyes E, with the midpoint between the pair of cameras 5 as the origin, and the three-dimensional coordinates of the positions of the left and right cameras 5. The assumed position of the user's eyes E is, for example, the central position of the display area (diffraction areas 21b, 22b) of the light guide plate 20. The position of the camera 5 is, for example, the central position of the imaging surface of the camera 5.

[0082] The display control unit 6a adjusts the vertical and horizontal positions of the left and right display images 32a and 32b generated in step S21, based on the coordinates of the position of the light-emitting area A2, the assumed positions of the left and right eyes E, and the positions of the left and right cameras 5, so that the depth and vertical / horizontal positions of the image 32 viewed by the user are appropriate (S23). The display control unit 6a stores the positional displacement amounts ΔXL, ΔYL, ΔXR, and ΔYR (see Figure 7) of the display images 32a and 32b adjusted in step S23 relative to the display images 32a and 32b generated in step S21 as position adjustment parameters (S24). Thus, the position adjustment of the display images is completed.

[0083] In this embodiment, the assumed positions of the user's left and right eyes E are pre-stored in the display control unit 6a. Alternatively, for each user using the AR glasses 1, the central position of the display area of ​​the light guide plate 20 may be adjusted to match the position of the eyes E, and the assumed positions of the eyes E may be stored in the display control unit 6a according to the adjustment of the central position of the display area. In this case, the AR glasses 1 are configured as shown in Figure 10.

[0084] The AR glasses 1 shown in Figure 10, compared to Embodiment 1 shown in Figure 1, are equipped with a stage 300 and position sensors 410 and 420 on the left and right sides of the frame 2, respectively.

[0085] The stage 300 is fixed to the frame 2. The stage 300 comprises a first stage that is movable in the left-right direction relative to the housing of the stage 300, and a second stage that is movable in the up-down direction relative to the first stage. The first stage is moved in the left-right direction by the user rotating a screw-shaped handle 311 around its axis, and the second stage is moved in the up-down direction by the user rotating a screw-shaped handle 321 around its axis. The optical scanning device 10 is installed on the rear side (user side) of the light guide plate 20, and the left-right outer ends of the light guide plate 20 are installed on the second stage of the stage 300.

[0086] Position sensors 410 and 420 are sensors that detect uniaxial position using a variable resistor. Position sensors 410 and 420 are installed in the housing of the stage 300 and are connected to the display control unit 6a. Position sensor 410 detects the left-right position of the slider 312 provided on the first stage which moves left and right, and position sensor 420 detects the up-down position of the slider 322 provided on the second stage which moves up and down. A plus-shaped mark M is provided on the front surface of the light guide plate 20 at the center of the display area of ​​the light guide plate 20, and the filter 4 is installed on the front surface of the light guide plate 20. The left and right cameras 5 are installed in the frame 2 such that the imaging surface of each camera 5 is on the same plane as the assumed position (specified position) in front of the user's eye E.

[0087] In adjusting the center position of the display area of ​​the light guide plate 20 to align with the position of the eyes E, the user wears the AR glasses 1 and operates the handles 311 and 321 to move the positions of the left and right light guide plates 20 in the up, down, left, and right directions so that the left and right marks M are positioned in front of the left and right eyes E. This aligns the center position of the display area of ​​the left and right light guide plates 20 with the positions of the left and right eyes E in the up, down, left, and right directions. The display control unit 6a also acquires the positions of the left and right light guide plates 20 based on the detection signals from the left and right position sensors 410 and 420. This allows the display control unit 6a to accurately determine the assumed position of the user's eyes E, with the midpoint of the pair of cameras 5 as the origin.

[0088] In this embodiment as well, the display processing of the display image when using the AR glasses 1 is performed in the same manner as in Embodiment 1 shown in Figure 8. In this case, in step S3 of Figure 8, the display control unit 6a moves the display images 32a and 32b in the left-right direction by positional displacement amounts ΔXL and ΔXR, and in the up-down direction by positional displacement amounts ΔYL and ΔYR. As a result, the image 32 is superimposed on the light-emitting region A2 included in the landscape.

[0089] <Effects of Embodiment 2> According to Embodiment 2, the following effects are achieved.

[0090] The AR glasses 1 are equipped with two image display devices 3 that display images 32a and 32b to the left and right eyes E, and two cameras 5 are arranged side by side with a predetermined distance between them. The display control unit 6a calculates the coordinates of the light-emitting area A2 based on the two display images 32a and 32b (S22 in Figure 9), and controls the position of the display images 32a and 32b based on the calculated coordinates (S3 in Figure 8).

[0091] With this configuration, the positions of the display images 32a and 32b, which are displayed to the left and right eyes E respectively, are automatically adjusted based on the coordinates of the light-emitting region A2. As a result, the position of the image 32 formed by the display images 32a and 32b and the position of the light-emitting region A2 in the landscape are automatically matched in the depth direction and the up, down, left, and right directions. This allows the user to smoothly grasp the correct position of the light-emitting region A2 in the depth direction and the up, down, left, and right directions.

[0092] Furthermore, the input device 7 becomes unnecessary, and the position of the displayed image is automatically adjusted in position adjustment mode. This eliminates the need for the user to manually adjust the position.

[0093] Furthermore, after the automatic adjustment of the display image position described above, the user may fine-tune the position of the display image by operating the input device 7. In this case, the position adjustment is performed using the input device 7 for adjusting the position of the display image, as shown in Embodiment 3 below.

[0094] <Embodiment 3> In Embodiment 2, the position adjustment of the displayed image was performed entirely automatically, but in Embodiment 3, the position adjustment of the displayed image is performed by the user operating the input device 7.

[0095] Figure 11 is a perspective view showing the configuration of the AR glasses 1 according to Embodiment 3.

[0096] In this embodiment, compared to Embodiment 1 shown in Figure 1, one camera 5 is installed on the front portion 2a. The camera 5 is positioned midway between the user's pair of eyes E by being placed on the YZ plane passing through the center of the AR glasses 1. In addition, a button 72c for adjusting the position of the image 32 in the depth direction is added to the input device 7.

[0097] Figure 12 is a flowchart showing the process for adjusting the position of the displayed image according to Embodiment 3.

[0098] In this embodiment, the process for adjusting the position of the displayed image is similar to that of Embodiment 1 shown in Figure 6, but with the addition of steps S31 and S32 instead of steps S12 to S14. The process that differs from that shown in Figure 6 will be described below.

[0099] In step S31, the display control unit 6a controls the camera 5 to capture the scenery in front and acquires an image of the light-emitting area A3 from the camera 5. The display control unit 6a also generates identical display images 32a and 32b based on the image captured by the camera 5 and controls the optical scanning device 10 to display the generated display images 32a and 32b in the display areas D1 of the left and right light guide plates 20, respectively.

[0100] If the user determines that the depth position of the image 32 shown in Figure 5(c) and the depth position of the light-emitting area A3 are misaligned, the user operates the input device 7 to adjust the depth so that the two are aligned. In step S32, the display control unit 6a receives the depth adjustment amount input by the user and moves the display image 32a based on the left camera 5 and the display image 32b based on the right camera 5 by the same amount in opposite directions in the left-right direction. As a result, the depth adjustment of the image 32 is completed, similar to state (a2) in Figure 7, and the distance ΔL1+ΔR1 between the display image 32a and the display image 32b is determined.

[0101] In this embodiment as well, the display control unit 6a stores the various parameters acquired in steps S32 and S15 of Figure 12, similar to step S16 of Embodiment 1 shown in Figure 6 (S16 in Figure 12). Thus, the position adjustment of the display image is completed. The acquired parameters are used in step S3 of the actual processing shown in Figure 8, similar to Embodiment 1.

[0102] <Effects of Embodiment 3> According to Embodiment 3, the following effects are achieved.

[0103] The AR glasses 1 (head-mounted display) comprises two image display devices 3 that display images 32a and 32b to the left and right eyes E, and an interface 6b that accepts user input. A camera 5 is positioned between the left and right eyes E and acquires an image of the light-emitting region A3 (another light-emitting region) that is generated when light of wavelength λ1 (a predetermined wavelength) is irradiated onto a phosphor 231 placed on the incident surface 221 (surface) of an optical element 220 (article) (S31 in Figure 12). The display control unit 6a displays display images 32a and 32b (other display images) based on the captured image of light-emitting region A3 (other light-emitting region) at positions corresponding to light-emitting region A3 (other light-emitting region) in the landscape (S31). It receives input from interface 6b to change the positions of the displayed display images 32a and 32b (other display images) in the depth direction to the positions of light-emitting region A3 (other light-emitting region) included in the landscape (S32), and controls the display positions of the display images 32a and 32b in the depth direction based on the received input (S3 in Figure 8).

[0104] With this configuration, the user can adjust the positions of the display images 32a and 32b shown to the left and right eyes E respectively based on the distance to the light-emitting region A3, thereby matching the position of the image 32 formed by the display images 32a and 32b with the position of the light-emitting region A2 in the landscape in the depth direction. As a result, the user can determine the correct position of the light-emitting region A2 in the depth direction.

[0105] The display control unit 6a receives input from interface 6b (S15 in Figure 12) to change the position of the displayed images 32a and 32b (other displayed images) in the up, down, left, and right directions (directions perpendicular to the depth direction) to the position of the light-emitting region A3 (other light-emitting region) included in the landscape, and controls the display position of the displayed images 32a and 32b in the up, down, left, and right directions (directions perpendicular to the depth direction) (S3 in Figure 8).

[0106] This configuration allows the position of the image 32 formed by the displayed images 32a and 32b to be matched with the position of the light-emitting region A2 in the landscape in the up, down, left, and right directions. As a result, the user can determine the correct position of the light-emitting region A2 in the up, down, left, and right directions.

[0107] Camera 5 is equipped with a camera filter 5a that transmits light from light-emitting region A2 and light from light-emitting region A3 (other light-emitting region), and blocks light other than light from light-emitting region A2 and light-emitting region A3 (other light-emitting region).

[0108] This configuration allows for imaging of light from light-emitting regions A2 and A3 with a simple setup.

[0109] <Example of changes to the image display device> In this modified example, the optical scanning device 10 with the above configuration may be applied to a retinal direct-drawing type image display device.

[0110] Figure 13 is a perspective view showing the configuration of the AR glasses 1 according to this modified example. In this modified example, compared to Embodiment 1 in Figure 1, the optical scanning device 10 is equipped with a concave mirror 40 instead of the light guide plate 20. The concave mirror 40 is located on the inner surface of the front portion 2a. The concave mirror 40 is a half-mirror that reflects light from the optical scanning device 10 and transmits light from the scenery in front. If the concave mirror 40 is small compared to the user's field of view, the concave mirror 40 may be a total reflection mirror.

[0111] Figure 14 is a plan view showing the configuration of AR glasses 1 in this modified example.

[0112] The concave mirror 40 reflects the light emitted from the optical scanning device 10 and directs it onto the ocular lens E1 of the eye E. The light incident on the eye E is then imaged onto the retina E2 of the eye E by the ocular lens E1. The light incident on the eye E is scanned horizontally and vertically on the retina E2 by the optical scanning device 10. As a result, display images 32a and 32b are displayed on the retina E2 of the left and right eyes E, respectively. Thus, as in Embodiment 1, the user can see the image 32 formed by the display images 32a and 32b superimposed on the scenery in front of them.

[0113] In this modified example, the display control unit 6a may also automatically adjust the position based on the three-dimensional coordinates of the position of the light-emitting area A2, the three-dimensional coordinates of the assumed positions of the user's left and right eyes E, and the three-dimensional coordinates of the positions of the left and right cameras 5. In this case, the assumed position of the user's eyes E is, for example, the central position of the retina E2 of the user's eyes E, and is stored in the display control unit 6a in advance.

[0114] Furthermore, similar to the case in Figure 10, the position of the display area formed on the eye E is adjusted to match the position of the retina E2 of the eye E, and the assumed position of the retina E2 may be stored in the display control unit 6a according to the adjustment of the display area. In this case, compared to the configurations in Figures 13 and 14, the optical scanning device 10 and the concave mirror 40 are installed on the stage 300, the position sensors 410 and 420 are installed on the stage 300, and the filter 4 is installed in front of the concave mirror 40.

[0115] <Other examples of changes> In embodiments 1 to 3 described above, the display control unit 6a extracted regions corresponding to wavelengths λ1 and λ2 from the captured image of the light-emitting region, thereby generating display images 32a and 32b in colors corresponding to wavelengths λ1 and λ2. However, the display control unit 6a is not limited to this and may generate display images 32a and 32b in colors different from those corresponding to wavelengths λ1 and λ2. Furthermore, if there are multiple light-emitting regions, the display control unit 6a may combine the display images corresponding to each of the multiple light-emitting regions with linear display images connecting them.

[0116] In embodiments 1 and 2 described above, the pair of cameras 5 were arranged symmetrically with respect to the YZ plane passing through the center of the AR glasses 1. However, the camera is not limited to this arrangement; it may be positioned at a predetermined distance from each other, or at a position different from a symmetrical position with respect to the YZ plane passing through the center of the AR glasses 1. In embodiment 3 described above, the camera 5 was positioned midway between the user's pair of eyes E by being placed on the YZ plane passing through the center of the AR glasses 1. However, the camera is not limited to this arrangement; it may be positioned slightly offset from the midpoint between the user's pair of eyes E.

[0117] In the embodiments 1 to 3 described above, the region T of the front part 2a on which the filter 4 is installed is made of a transparent material, but an opening may be formed in the region T of the front part 2a that penetrates the front part 2a in the front-to-back direction.

[0118] In Embodiment 1 described above, the parameters for adjusting the position of the display image corresponding to the depth direction were acquired in advance in the position adjustment mode. However, the parameters are not limited to this, and may also be acquired in real time in the usage mode by performing the processing in steps S13 and S14 of Figure 6 based on the display image of the light-emitting region generated by light of wavelength λ1. Furthermore, in Embodiment 2 described above, the parameters for adjusting the position of the display image corresponding to the depth direction and the up / down / left / right direction were acquired in advance in the position adjustment mode. However, the parameters are not limited to this, and may also be acquired in real time in the usage mode by performing the processing in steps S21 to S23 of Figure 9.

[0119] In embodiments 1 to 3 described above, the configuration and layout of the optical system of the optical scanning device 10 are not limited to those shown in Figure 2. For example, the light-emitting elements 101 to 103 are not limited to semiconductor laser elements, but may be other light sources such as light-emitting diodes. The light source 11 does not necessarily have to emit light of three wavelengths, and may be configured to emit light of two or one wavelength. In the configuration of Figure 2, since the image display device 3 is assumed to display a color image, the light source 11 is configured to emit light of three wavelengths L1, L2, and L3. If the image display device 3 is used to display a monochrome image, the light source 11 may be configured to emit light of one or two wavelengths. The configuration of the light source 11 may be appropriately changed to other configurations that can emit substantially parallel light.

[0120] In addition, the embodiments of the present invention can be modified in various ways as appropriate within the scope of the technical idea set forth in the claims.

[0121] (Note) The above description of embodiments discloses the following technologies.

[0122] (Technology 1) A see-through type head-mounted display that overlays images onto landscapes, A filter that blocks light of a predetermined wavelength contained in the aforementioned landscape, At least one camera that acquires an image of a light-emitting region generated when light of a predetermined wavelength is irradiated onto the surface of an object in the landscape, The system includes a display control unit that displays a display image based on the captured image of the light-emitting region at a position in the landscape corresponding to the light-emitting region. A head-mounted display characterized by the following features.

[0123] According to this technology, light of a predetermined wavelength is blocked by a filter, while a display image based on an image of the light-emitting region is displayed at the position corresponding to the light-emitting region in the landscape. As a result, the user can avoid directly seeing the light of the predetermined wavelength, and can visually confirm the position of the light-emitting region by superimposing the display image at the position corresponding to the light-emitting region in the landscape. Therefore, it is possible to smoothly grasp the position of the light-emitting region of the predetermined wavelength while preventing the light of the predetermined wavelength from entering the user's eyes.

[0124] (Technology 2) In the head-mounted display described in Technology 1, It is equipped with two image display devices that display the aforementioned images to the left and right eyes, The aforementioned cameras are arranged side by side with a predetermined distance between them. The display control unit calculates the distance to the light-emitting region based on the two display images and controls the position of the display images based on the calculated distance. A head-mounted display characterized by the following features.

[0125] This technology automatically adjusts the position of the displayed images for each eye based on the distance to the light-emitting area. As a result, the position of the image formed by the displayed image and the position of the light-emitting area in the landscape automatically align in the depth direction. This allows the user to easily grasp the correct position of the light-emitting area in the depth direction.

[0126] (Technology 3) In the head-mounted display described in Technology 2, It has an interface that accepts user input, The camera acquires the captured image of other light-emitting regions that are produced when light of a predetermined wavelength is irradiated onto a phosphor arranged on the surface of the article. The display control unit, A display image based on the captured image of the other light-emitting region is displayed at a position in the landscape corresponding to the other light-emitting region. In a direction perpendicular to the depth direction, the interface receives an input that changes the position of the other displayed image to the position of the other light-emitting region included in the landscape. Based on the received input, the display position of the display image is controlled. A head-mounted display characterized by the following features.

[0127] This technology allows the position of the image formed by the displayed image to be aligned with the position of the luminous area in the landscape, in a direction perpendicular to the depth direction. This enables the user to understand the correct position of the luminous area in a direction perpendicular to the depth direction.

[0128] (Technology 4) In the head-mounted display described in Technology 2 or 3, The camera includes a camera filter that transmits light from the light-emitting region and light from other light-emitting regions, and blocks light other than light from the light-emitting region and light from other light-emitting regions. A head-mounted display characterized by the following features.

[0129] This technology allows for imaging of light from one light-emitting region and light from other light-emitting regions using a simple configuration.

[0130] (Technology 5) In the head-mounted display described in Technology 1, Two image display devices that display the aforementioned images to the left and right eyes, An interface that accepts user input, and features, The aforementioned camera, It is positioned one at a time between the left and right eyes, The image of the other light-emitting region that is produced when light of a predetermined wavelength is irradiated onto a phosphor arranged on the surface of the article is acquired. The display control unit, A display image based on the captured image of the other light-emitting region is displayed at a position in the landscape corresponding to the other light-emitting region. In the depth direction, the interface receives an input to change the position of the other displayed image to the position of the other light-emitting region included in the landscape. Based on the received input, the display position of the display image in the depth direction is controlled. A head-mounted display characterized by the following features.

[0131] This technology allows users to adjust the position of the displayed images in their left and right eyes based on the distance to the light-emitting area, thereby matching the position of the image formed by the displayed image with the position of the light-emitting area in the landscape in the depth direction. As a result, users can understand the correct position of the light-emitting area in the depth direction.

[0132] (Technology 6) In the head-mounted display described in Technology 5, The display control unit, The interface receives an input to change the position of the other displayed image in a direction perpendicular to the depth direction to the position of the other light-emitting region included in the landscape. Based on the received input, the display position of the displayed image in a direction perpendicular to the depth direction is controlled. A head-mounted display characterized by the following features.

[0133] This technology allows the position of the image formed by the displayed image to be aligned with the position of the luminous area in the landscape, in a direction perpendicular to the depth direction. This enables the user to understand the correct position of the luminous area in a direction perpendicular to the depth direction.

[0134] (Technology 7) In the head-mounted display described in Technology 5 or 6, The camera includes a camera filter that transmits light from the light-emitting region and light from other light-emitting regions, and blocks light other than light from the light-emitting region and light from other light-emitting regions. A head-mounted display characterized by the following features.

[0135] This technology allows for imaging of light from one light-emitting region and light from other light-emitting regions using a simple configuration.

[0136] (Technology 8) In the head-mounted display described in Technology 1, It is equipped with two image display devices that display the aforementioned images to the left and right eyes, The aforementioned cameras are arranged side by side with a predetermined distance between them. The display control unit calculates the coordinates of the light-emitting region based on the two display images and controls the position of the display image based on the calculated coordinates. A head-mounted display characterized by the following features.

[0137] This technology automatically adjusts the position of the displayed images for each eye based on the distance to the light-emitting area. As a result, the position of the image formed by the displayed image and the position of the light-emitting area in the landscape automatically align in the depth direction and perpendicular to the depth direction. This allows the user to easily understand the correct position of the light-emitting area in the depth direction and perpendicular to the depth direction. [Explanation of Symbols]

[0138] 1. AR glasses (head-mounted display) 3 Image display device 4 filters 5 Cameras 5a Camera Filter 6a Display Control Unit 6b Interface 32a, 32b Display Images (Other Display Images) 220 Mirror (item) 221 Incidence plane (surface) 231 Phosphors A2 Emitting Region A3 Light-emitting area (other light-emitting areas) E eye

Claims

1. A see-through type head-mounted display that overlays images onto landscapes, A filter that blocks light of a predetermined wavelength contained in the aforementioned landscape, At least one camera that acquires an image of a light-emitting region generated when light of a predetermined wavelength is irradiated onto the surface of an object in the landscape, The system includes a display control unit that displays a display image based on the captured image of the light-emitting region at a position in the landscape corresponding to the light-emitting region. A head-mounted display characterized by the following features.

2. In the head-mounted display according to claim 1, It is equipped with two image display devices that display the aforementioned images to the left and right eyes, The aforementioned cameras are arranged side by side with a predetermined distance between them. The display control unit calculates the distance to the light-emitting region based on the two display images and controls the position of the display images based on the calculated distance. A head-mounted display characterized by the following features.

3. In the head-mounted display according to claim 2, It has an interface that accepts user input, The camera acquires the captured image of other light-emitting regions that are produced when light of a predetermined wavelength is irradiated onto a phosphor arranged on the surface of the article. The display control unit, A display image based on the captured image of the other light-emitting region is displayed at a position in the landscape corresponding to the other light-emitting region. In a direction perpendicular to the depth direction, the interface receives an input that changes the position of the other displayed image to the position of the other light-emitting region included in the landscape. Based on the received input, the display position of the display image is controlled. A head-mounted display characterized by the following features.

4. In the head-mounted display according to claim 3, The camera includes a camera filter that transmits light from the light-emitting region and light from other light-emitting regions, and blocks light other than light from the light-emitting region and light from other light-emitting regions. A head-mounted display characterized by the following features.

5. In the head-mounted display according to claim 1, Two image display devices that display the aforementioned images to the left and right eyes, An interface that accepts user input, and features, The aforementioned camera, It is positioned one at a time between the left and right eyes, The image of the other light-emitting region that is produced when light of a predetermined wavelength is irradiated onto a phosphor arranged on the surface of the article is acquired. The display control unit, A display image based on the captured image of the other light-emitting region is displayed at a position in the landscape corresponding to the other light-emitting region. In the depth direction, the interface receives an input to change the position of the other displayed image to the position of the other light-emitting region included in the landscape. Based on the received input, the display position of the display image in the depth direction is controlled. A head-mounted display characterized by the following features.

6. In the head-mounted display according to claim 5, The display control unit, In a direction perpendicular to the depth direction, the interface receives an input to change the position of the other displayed image to the position of the other light-emitting region included in the landscape. Based on the received input, the display position of the displayed image in a direction perpendicular to the depth direction is controlled. A head-mounted display characterized by the following features.

7. In the head-mounted display according to claim 6, The camera includes a camera filter that transmits light from the light-emitting region and light from other light-emitting regions, and blocks light other than light from the light-emitting region and light from other light-emitting regions. A head-mounted display characterized by the following features.

8. In the head-mounted display according to claim 1, It is equipped with two image display devices that display the aforementioned images to the left and right eyes, The aforementioned cameras are arranged side by side with a predetermined distance between them. The display control unit calculates the coordinates of the light-emitting region based on the two display images and controls the position of the display image based on the calculated coordinates. A head-mounted display characterized by the following features.

Images