Display device
A display device with spatially separated eyepiece and image display components, using position detection to maintain image focus, addresses the burden and stability issues of existing head-mounted devices, ensuring stable image projection despite movement.
Patent Information
- Application Number
- JP2022501699
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-02-19
- Filing Date
- 2021-01-14
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-01-14
AI Technical Summary
The existing head-mounted image display devices are burdensome due to the weight and size of components like the light emitting part, actuator, and drive circuit, which can cause the image to be lost when the observer moves, making it difficult to maintain a stable image projection.
A display device with spatially separated eyepiece and image display components, utilizing position detection devices to control the transfer optical device for maintaining image focus on the observer's retina, even with movement, without the need for a power source on the head-mounted part.
The solution reduces the burden on the observer by minimizing the mass and size of the head-mounted components while ensuring stable image projection, allowing for seamless image observation during movement.
Smart Images

Figure 0007577729000001 
Figure 0007577729000002 
Figure 0007577729000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a display device. [Background technology]
[0002] A head-mounted image display device that is worn on the observer's head is well known, for example from JP 2005-309264 A. The image display device 1 disclosed in this patent publication is composed of a head-mounted unit 6 that is worn on the observer's head and a body-carrying unit 7 that is carried on the observer's body. The head-mounted unit 6 is provided with a convex lens 8 that constitutes the transfer optical system 5, and a part of the azimuth and distance detection system. The head-mounted unit 6 is provided with a light-emitting unit R composed of an infrared LED, an actuator 27 that moves the convex lens 8, and a drive circuit 28. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2005-309264 A Summary of the Invention [Problem to be solved by the invention]
[0004] Incidentally, in the technology disclosed in the above-mentioned Patent Publication, the light-emitting unit R, the actuator 27, and the drive circuit 28 provided in the head mounted unit 6 require a power source (battery), and therefore the structure imposes a burden on the observer, such as an increase in the mass and size of the head mounted unit 6. If it were assumed that the light-emitting unit R, the actuator 27, and the drive circuit 28 were removed and only the convex lens 8 was mounted on the head mounted unit 6, when the observer moves, the positional relationship between the body-worn unit and the head mounted unit would be lost, and the projected image would move away from the observer's pupil, resulting in a problem that it would be difficult to observe the image.
[0005] Therefore, an object of the present disclosure is to provide a display device having a configuration and structure that does not impose a burden on the viewer. [Means for solving the problem]
[0006] In order to achieve the above object, a display device according to a first aspect and a second aspect of the present disclosure includes: An eyepiece optical device, an image display device including an image forming device and a transfer optical device that outputs an image incident from the image forming device to an eyepiece optical device; It is equipped with The eyepiece optical device and the image display device are arranged to be spatially separated from each other, The eyepiece optical device focuses the image from the transfer optical device onto the observer's retina, The image display device further comprises: Control unit, a first position detection device and a second position detection device for detecting the position of the eyepiece optical device; and Transfer optical device and control device, It is equipped with:
[0007] In the display device according to the first aspect of the present disclosure, based on position information of the eyepiece optical device detected by the first position detection device, the transfer optical device / control device, under the control of the control unit, controls the transfer optical device so that the image incident from the image forming device reaches the eyepiece optical device, and based on position information of the eyepiece optical device detected by the second position detection device, the control unit corrects the detection position of the first position detection device.
[0008] In addition, in a display device according to a second aspect of the present disclosure, based on position information of the eyepiece optical device detected by the first position detection device, the transfer optical device / control device, under the control of the control unit, controls the transfer optical device so that an image incident from the image forming device reaches the eyepiece optical device, and based on position information of the eyepiece optical device detected by the first position detection device, or by the second position detection device, or by the first position detection device and the second position detection device, the control unit controls the formation of an image in the image forming device.
[0009] In order to achieve the above object, a display device according to a third aspect of the present disclosure includes: An eyepiece optical device, an image display device including an image forming device and a transfer optical device that outputs an image incident from the image forming device to an eyepiece optical device; It is equipped with The eyepiece optical device and the image display device are arranged to be spatially separated from each other, The eyepiece optical device focuses the image from the transfer optical device onto the observer's retina, The image display device further includes a first position detection device that detects a position of the eyepiece optical device; The first position detection device is light source, 1st optical path combining section, A second optical path synthesis unit, and light receiving section, It is equipped with The image incident from the image forming device is focused on the observer's retina via the second optical path synthesis section, the transfer optical device, and the eyepiece optical device, Light emitted from the light source reaches the eyepiece optical device via the first optical path synthesis unit, the second optical path synthesis unit, and the transfer optical device, is returned to the transfer optical device by the eyepiece optical device, enters the first optical path synthesis unit via the transfer optical device and the second optical path synthesis unit, is emitted from the first optical path synthesis unit in a direction different from the light source, and enters the light receiving unit. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a conceptual diagram of a display device according to a first embodiment. [Diagram 2] FIG. 2 is a schematic diagram of an observer wearing an eyepiece optical device constituting the display device of the first embodiment, as viewed from the front. [Diagram 3] 3A, 3B, and 3C are conceptual diagrams of an image forming apparatus in the display device of the first embodiment. [Figure 4] FIG. 4 is a conceptual diagram showing position detection light in the light receiving section. [Diagram 5] FIG. 5 is a conceptual diagram of the display device for explaining the operation of the display device of the first embodiment. [Figure 6] FIG. 6 is a conceptual diagram of the display device for explaining the operation of the display device of the first embodiment. [Figure 7] FIG. 7 is a conceptual diagram of the display device for explaining the operation of the display device of the first embodiment. [Figure 8] FIG. 8 is a conceptual diagram of the display device for explaining the operation of the display device of the first embodiment. [Figure 9] FIG. 9 is a conceptual diagram of the display device for explaining the operation of the display device of the first embodiment. [Figure 10] FIG. 10 is a conceptual diagram showing position detection light in the light receiving section. [Figure 11] FIG. 11 is a conceptual diagram showing position detection light in the light receiving section. [Figure 12] FIG. 12 is a conceptual diagram showing the position detection light in the light receiving section. [Figure 13] FIG. 13 is a conceptual diagram showing position detection light in the light receiving section. [Figure 14] Figures 14A, 14B and 14C are schematic diagrams showing the behavior of the light beam emitted from the transfer optical device and the positional relationship between the eyepiece optical device and the observer's pupil. In particular, Figure 14C is a diagram for explaining the angle θ1 between a straight line connecting the center of the eyepiece optical device and the center of the observer's pupil and a normal line passing through the center of the eyepiece optical device, and the angle θ2 between the light ray emitted from the center of the image forming device and the normal line passing through the center of the eyepiece optical device when it reaches the eyepiece optical device via the transfer optical device. [Figure 15] Figures 15A and 15B are schematic diagrams showing the behavior of the light beam emitted from the transfer optical device and the positional relationship between the eyepiece optical device and the observer's pupil, and are diagrams for explaining the angle θ1 between a straight line connecting the center of the eyepiece optical device and the center of the observer's pupil and a normal line passing through the center of the eyepiece optical device, and the angle θ2 between a light ray emitted from the center of the image forming device and reaching the eyepiece optical device via the transfer optical device and a normal line passing through the center of the eyepiece optical device. [Figure 16] FIG. 16 is a conceptual diagram of a display device according to the fourth embodiment. [Figure 17]17A and 17B are schematic diagrams showing a state in which the display device of the fourth embodiment is used indoors, and a state in which the image forming device is disposed on the back of a seat. [Figure 18] FIG. 18 is a diagram for explaining an example in which the display device of the fourth embodiment is mounted on a motorcycle. [Figure 19] 19A and 19B are conceptual diagrams of a display device according to a fifth embodiment and a modification thereof. [Figure 20] 20A and 20B are conceptual diagrams of a display device according to the sixth embodiment. [Figure 21] FIG. 21 is a conceptual diagram of a display device according to the seventh embodiment. [Figure 22] 22A, 22B, 22C, and 22D are diagrams illustrating the behavior of a light beam emitted from the transfer optical device and the positional relationship between the eyepiece optical device and the observer's pupil in the display device of Example 8. FIG. [Diagram 23] FIG. 23A is a schematic cross-sectional view showing an enlarged portion of a reflective volume hologram diffraction grating, and FIGS. 23B and 23C are schematic partial cross-sectional views of a reflective blazed diffraction grating and a reflective blazed diffraction grating having a step shape (however, hatched lines are omitted). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, the present disclosure will be described based on examples with reference to the drawings, but the present disclosure is not limited to the examples, and various numerical values and materials in the examples are merely examples. The description will be made in the following order. 1. General Description of the Display Device According to the First to Third Aspects of the Present Disclosure 2. Example 1 (Display Device According to the First to Third Aspects of the Present Disclosure) 3. Example 2 (Modification of Example 1) 4. Example 3 (another variation of Example 1) 5. Example 4 (Modification of Examples 1 to 3) 6. Example 5 (Modification of Example 4) 7. Example 6 (Modification of Examples 1 to 5) 8. Example 7 (Modification of Examples 1 to 6) 9. Example 8 (Modification of Examples 1 to 7) 10.Other
[0012] <General Description of Display Devices According to the First to Third Aspects of the Present Disclosure> In the following description, the horizontal direction of the image formed on the observer's retina may be referred to as the X direction, the vertical direction of the image as the Y direction, and the depth direction of the image as the Z direction. The direction in the transfer optical device that corresponds to the X direction is referred to as the "x direction", the direction in the transfer optical device that corresponds to the Y direction is referred to as the "y direction", and the direction in the transfer optical device that corresponds to the Z direction is referred to as the "z direction". Furthermore, the light incident from the image forming device is referred to as the "image forming light" for convenience, the light incident from the center of the image forming device is referred to as the "image forming central light" for convenience, the light emitted from the light source is referred to as the "position detection light" for convenience, and the light emitted from the center of the light source is referred to as the "position detection central light" for convenience.
[0013] In the display device according to the first aspect of the present disclosure, the control unit can be configured to control the formation of an image in the image forming device based on position information of the eyepiece optical device detected by a first position detection device, or by a second position detection device, or by the first position detection device and the second position detection device.
[0014] In the display device according to the first aspect of the present disclosure including the above-mentioned preferred embodiment, or in the display device according to the second aspect of the present disclosure, The first position detection device is light source, 1st optical path combining section, A second optical path synthesis unit, and light receiving section, It is equipped with The image (image-forming light) incident from the image-forming device passes through the second optical path synthesis section, the transfer optical device, and the eyepiece optical device, and is focused on the observer's retina. The light (position detection light) emitted from the light source can be configured to reach the eyepiece optical device via the first optical path synthesis unit, the second optical path synthesis unit, and the transfer optical device, be returned to the transfer optical device by the eyepiece optical device, be incident on the first optical path synthesis unit via the transfer optical device and the second optical path synthesis unit, be emitted from the first optical path synthesis unit in a direction different from the light source, and be incident on the light receiving unit. Note that, for convenience, a display device according to the first aspect of the present disclosure in this form may be referred to as a "display device according to the 1-A aspect of the present disclosure," and a display device according to the second aspect of the present disclosure in this form may be referred to as a "display device according to the 2-A aspect of the present disclosure."
[0015] In a display device according to aspect 1-A or aspect 2-A of the present disclosure, when the incident position of light (position detection light) incident on the light receiving unit from the first optical path combining unit deviates from a predetermined position (reference position), the transfer optical device / control device can be configured to control the position of the transfer optical device so as to eliminate the deviation.
[0016] In a display device according to aspect 1-A or aspect 2-A of the present disclosure including such a preferred configuration, or in a display device according to the third aspect of the present disclosure, the exit angle from the transfer optical device of the light emitted from the center of the light source (position detection center light) and the exit angle from the transfer optical device of the light emitted from the center of the image forming device (image formation center light) can be configured to be different.
[0017] Furthermore, in a display device according to aspect 1-A or aspect 2-A of the present disclosure including the various preferred configurations described above, or in a display device according to aspect 3 of the present disclosure including the above preferred configurations, the light source can be configured to emit infrared light in an eye-safe wavelength band (e.g., a wavelength of around 1.55 μm).
[0018] Incidentally, the greater the amount of the position detection light returning to the light receiving unit, the higher the position detection resolution can be. On the other hand, since light close to parallel light is irradiated toward the vicinity of the observer's eye in order to detect the position of the eyepiece optical device, the upper limit of the amount of the position detection light must be determined with safety in mind. The exposure limit for the pupil and retina depends on the wavelength of the position detection light, and the allowable amount of light is the largest in the eye-safe wavelength band. This is because light in this eye-safe wavelength band has the property of attenuating in the presence of water molecules and does not reach the retina. For the above reasons, by setting the wavelength band of the position detection light to the eye-safe wavelength band, high safety and high position detection resolution can be achieved. For the same reason, this is also a wavelength band in which the intensity of sunlight near the earth's surface is weak, so the first position detection device has the advantage of being less susceptible to the effects of external light.
[0019] Furthermore, in a display device according to aspect 1-A or aspect 2-A of the present disclosure including the various preferred configurations described above, or in a display device according to aspect 3 of the present disclosure including the above preferred configuration, the light (position detection light) emitted from the light source constituting the first position detection device and incident on the first optical path combination section can be configured to be diverging light.
[0020] Furthermore, in the display device according to the first-A or second-A aspect of the present disclosure including the various preferred configurations described above, or in the display device according to the third aspect of the present disclosure including the various preferred configurations described above, the light receiving unit may be arranged at a position (on the in-focus side) closer to the first light path synthesis unit than the position optically conjugate with the light source. That is, the optical distance from the light receiving unit to the first light path synthesis unit (the sum of the products of the spatial distance of the medium in the light path of the position detection center light and the refractive index of the medium, and when a lens is arranged between the light receiving unit and the first light path synthesis unit, the focal length of the lens is also taken into consideration) is shorter than the optical distance from the light source to the first light path synthesis unit (the sum of the products of the spatial distance of the medium in the light path of the position detection center light and the refractive index of the medium, and when a lens is arranged between the light source and the first light path synthesis unit, the focal length of the lens is also taken into consideration). Furthermore, by disposing the light receiving section at a position (on the in-focus side) closer to the first optical path combining section than the beam waist position (the position where the spot diameter is smallest) of the position detection light, it is possible to improve resistance to foreign matter.
[0021] Furthermore, in the display device according to the first or second embodiment of the present disclosure including the various preferred configurations described above, or in the display device according to the third embodiment of the present disclosure including the various preferred configurations described above, the light receiving section is divided into two types, a non-split type and a split type, depending on the operating principle. The former is a position detection element that detects the position of the position detection light by applying the change in the surface resistance value of the photodiode. The position of the position detection light is detected using the principle that the surface resistance value changes according to the amount of light. The latter detects the position of the position detection light by comparing the voltage of a photodiode that is divided into multiple (for example, four) areas. It can also be composed of multiple photodiodes instead of area division. Since both are analog outputs, the position detection resolution is theoretically infinitesimal. As described above, the light receiving section (a device or element that detects the position of the eyepiece optical device) can be composed of a position detection element (Position Sensitive Detector, PSD), a multi-split photodiode, or multiple photodiodes.
[0022] Examples of the second position detection device include a camera (imaging device), a distance measurement device of the TOF (Time Of Flight) type, and an indirect TOF type distance measurement device. In addition, the camera can be used to measure the size of a retroreflective element (described later) and the distance between a plurality of retroreflective elements to measure the distance to the retroreflective element. The camera can also be used for coarse adjustment to identify the position of the eyepiece optical device when the display device is started to be used. That is, when the display device is started to be used, the position of the eyepiece optical device is found by the camera, the transfer optical device is coarsely adjusted, and when the light receiving unit starts to receive the position detection light, the transfer optical device is finely adjusted by the first position detection device. Alternatively, when the display device is started to be used, the position of the eyepiece optical device is found based on the scanning of the transfer optical device, and when the light receiving unit starts to receive the position detection light, the transfer optical device is finely adjusted by the first position detection device.
[0023] In some cases, the first position detection device may also function as the second position detection device. That is, the light source constituting the first position detection device is intensity-modulated at a high frequency, and the position detection light that collides with and is reflected by the eyepiece optical device is received by the light receiving unit, and the distance to the target (eyepiece optical device) is obtained from the phase delay time of the pulse wave, etc. Specifically, the position detection light is modulated on the order of megahertz to gigahertz, and the signal output by the light receiving unit is divided into a high-frequency component equivalent to the modulation band (a band for detecting the distance to the eyepiece optical device) and a low-frequency component below kilohertz (a band for detecting the position of the eyepiece optical device), and the signal is processed, so that the position of the eyepiece optical device can be obtained without increasing the number of parts or the number of retroreflective elements (described later).
[0024] Furthermore, in the display devices according to the first to third aspects of the present disclosure, including the various preferred embodiments and configurations described above, the first position detection device can also serve as the second position detection device.
[0025] Furthermore, in the display devices according to the first to third aspects of the present disclosure including the various preferred aspects and configurations described above, the transfer optical device can be configured to control the image projection onto the observer's retina along the horizontal direction (X direction) and vertical direction (Y direction) of the image formed on the observer's retina by the transfer optical device / control device. That is, the transfer optical device can be configured to control the movement of light (image forming light) toward the eyepiece optical device in the x direction or y direction.
[0026] Furthermore, in the display devices according to the first to third aspects of the present disclosure including the various preferred forms and configurations described above, the transfer optical device may be configured to be made of a movable mirror, specifically, for example, a combination of two galvanometer mirrors. In order to move the light (image forming light) from the transfer optical device toward the eyepiece optical device in the x direction and / or y direction, the transfer optical device may be, for example, a mirror movable in two directions, specifically, in addition to the combination of two galvanometer mirrors, a two-axis gimbal mirror including a two-axis MEMS (Micro Electro Mechanical Systems) mirror.
[0027] Furthermore, in the display device according to the first to third aspects of the present disclosure including the various preferred forms and configurations described above, the eyepiece optical device may be provided with a position display means (position detection means), specifically, a retroreflective element. Specific examples of the retroreflective element include a retroreflective marker including a retroreflective sheet and a corner cube prism. A corner cube prism is a device in which three flat plates having a light reflecting property are combined at right angles to each other to form a cube apex shape. Since there is only one prism, there is no variation in the surface, and the reflectance can be easily increased, which has the advantage of increasing the amount of return light and improving the resolution. In addition, if a corner cube array in which multiple small corner cube prisms are arranged is used, the thickness of the retroreflective element can be reduced, and the degree of freedom in mounting it to the eyepiece optical device increases.
[0028] Furthermore, in the display devices according to the first to third aspects of the present disclosure including the various preferred forms and configurations described above, the eyepiece optical device may be provided with a hologram element, or the eyepiece optical device may be provided with a diffractive optical element, or the eyepiece optical device may be provided with a light-collecting member and a deflecting member. When the eyepiece optical device is configured with a hologram element, the hologram element may have a light-collecting function. The image forming light incident from the image forming device is incident on the transfer optical device in a state of substantially parallel light, and is emitted from the transfer optical device to the eyepiece optical device, and the eyepiece optical device is arranged so that the pupil of the observer is positioned at the focus of the eyepiece optical device.
[0029] The eyepiece optical device may be configured such that the focusing characteristics for the position detection light have wavelength dependency. In other words, it is preferable that the infrared rays constituting the position detection light are not affected by the focusing characteristics of the eyepiece optical device, or are hardly affected by the focusing characteristics of the eyepiece optical device. For example, when the eyepiece optical device is configured from a hologram element, it is preferable that the infrared rays constituting the position detection light are not focused by the hologram element, or are only focused to a small extent. The hologram element may have a known configuration and structure.
[0030] The eyepiece optical device is attached to the support member, or is provided integrally with the support member, although this is not limited thereto. When the support member is made of a transparent plastic material, examples of the plastic material include polyethylene terephthalate, polyethylene naphthalate, polycarbonate, cellulose ester such as cellulose acetate, fluoropolymers such as polyvinylidene fluoride or copolymers of polytetrafluoroethylene and hexafluoropropylene, polyethers such as polyoxymethylene, polyacetal, polystyrene, polyethylene, polypropylene, polyolefins such as methylpentene polymers, polyimides such as polyamideimide or polyetherimide, polyamide, polyethersulfone, polyphenylene sulfide, polyvinylidene fluoride, tetraacetyl cellulose, phenoxy bromide, polyarylate, polysulfone, etc. When the support member is made of glass, examples of the glass include transparent glass such as soda lime glass and white plate glass.
[0031] Furthermore, in the display device according to the first to third aspects of the present disclosure including the various preferred aspects and configurations described above, the eyepiece optical device and the image display device may be configured to be relatively movable. That is, the image display device may be configured to be disposed at a location away from the observer, or at a location of the observer away from the observer's head. In the latter case, the image display device may be worn as a wearable device on a location of the observer, such as the observer's wrist, away from the observer's head, without being limited thereto. Alternatively, the image display device may be disposed on a personal computer, or may be disposed in a state of being connected to the personal computer. Alternatively, the image display device may be disposed in an external facility, as described later.
[0032] Furthermore, in the display devices according to the first to third aspects of the present disclosure, including the various preferred forms and configurations described above, the eyepiece optical device may be configured to be worn by an observer, or the eyepiece optical device may be configured to be positioned away from the observer (i.e., the eyepiece optical device is not worn by the observer).
[0033] In the display devices according to the first to third aspects of the present disclosure, including the various preferred forms and configurations described above (hereinafter, these may be collectively referred to as "the display devices, etc. of the present disclosure"), the eyepiece optical device and the image display device are arranged spatially separated, but specifically, the eyepiece optical device and the image display device are arranged separately from each other and are not integrally connected.
[0034] In the display device etc. of the present disclosure, the transfer optical device / control device, under the control of the control unit, controls the transfer optical device so that the image incident from the image forming device reaches the eyepiece optical device based on position information of the eyepiece optical device detected by the first position detection device, but the transfer optical device can be controlled so that all of the image incident from the image forming device reaches the eyepiece optical device, or the transfer optical device can be controlled so that only a portion of the image incident from the image forming device reaches the eyepiece optical device. The display device etc. of the present disclosure is a retinal projection type display device based on Maxwellian vision.
[0035] The light (position detection light) emitted from the light source is reflected by the first light path synthesis section and enters the second light path synthesis section. In this case, the light (return light) from the second light path synthesis section passes through the first light path synthesis section and enters the light receiving section. Alternatively, the light (position detection light) emitted from the light source passes through the first light path synthesis section and enters the second light path synthesis section. In this case, the light (return light) from the second light path synthesis section is reflected by the first light path synthesis section and enters the light receiving section. An example of a first light path synthesis section having such a function is a polarizing beam splitter. The polarizing beam splitter transmits P-polarized light and reflects S-polarized light. Alternatively, an example of a first light path synthesis section having such a function is a half mirror.
[0036] The image incident from the image forming device passes through the second optical path synthesis unit and enters the transfer optical device. On the other hand, the light from the light source (position detection light) is reflected by the second optical path synthesis unit, reaches the eyepiece optical device via the transfer optical device, is returned to the transfer optical device by the eyepiece optical device, enters the second optical path synthesis unit, is reflected by the second optical path synthesis unit, and enters the first optical path synthesis unit. Alternatively, the image incident from the image forming device is reflected by the second optical path synthesis unit, and the light from the light source (position detection light) passes through the second optical path synthesis unit, reaches the eyepiece optical device via the transfer optical device, is returned to the transfer optical device by the eyepiece optical device, enters the second optical path synthesis unit, passes through the second optical path synthesis unit, and enters the first optical path synthesis unit. Examples of the second optical path synthesis unit having such a function include a half mirror, a dichroic mirror that reflects light of a specific wavelength and transmits light of other wavelengths, and a cold mirror that reflects only visible light and transmits infrared light.
[0037] The relationships between the first optical path combining section and the second optical path combining section and the image formation light and the position detection light are summarized in Tables 1, 2, 3 and 4 below.
[0038] Wavelength 1st optical path combining section 2nd optical path combining section Image forming light around 450 nm --- transmitted Around 520 nm --- Transmitted Around 640 nm --- Transmission Position detection light: Around 1550 nm Outward path: Reflected Outward path: Reflected Return path: Transmitted Return path: Reflected
[0039] Wavelength 1st optical path combining section 2nd optical path combining section Image forming light around 450 nm --- transmitted Around 520 nm --- Transmitted Around 640 nm --- Transmission Position detection light: Around 1550 nm Outward path: Transmitted Outward path: Reflected Return: Reflection Return: Reflection
[0040] Wavelength 1st optical path combining section 2nd optical path combining section Image forming light around 450 nm --- Reflection Around 520 nm --- Reflection Around 640 nm --- Reflection Position detection light: Around 1550 nm Outward path: Reflected Outward path: Transmitted Return: Transparent Return: Transparent
[0041] Wavelength 1st optical path combining section 2nd optical path combining section Image forming light around 450 nm --- Reflection Around 520 nm --- Reflection Around 640 nm --- Reflection Position detection light Near 1550 nm Outward path: Transmitted Outward path: Transmitted Return path: Reflection Return path: Transmission
[0042] Furthermore, in the display device and the like of the present disclosure including the above-described preferred forms and configurations, the light source can be in a form that emits infrared rays as described above, but is not limited thereto, and can also be in a form that receives visible light having a predetermined wavelength. In the former case (form that emits infrared rays), the light source can be composed of, for example, a light-emitting diode that emits infrared rays, or a semiconductor laser element that emits infrared rays, or a combination of a semiconductor laser element that emits infrared rays and a light diffusion plate. In addition, the light receiving unit can be composed of an imaging device (infrared camera) or a sensor (infrared sensor) that can detect infrared rays, in addition to the above-described non-split type or split type light receiving unit. By mounting a filter (infrared transmission filter) that passes only the wavelength of infrared rays used for detection in front of the imaging device, the image processing in the subsequent stage can be simplified. On the other hand, in the latter case (form that receives visible light having a predetermined wavelength), the light receiving unit can be composed of an imaging device (camera) or a sensor (image sensor) that can detect visible light. In the latter case (a form in which visible light having a predetermined wavelength is received), the eyepiece optical device can be configured to have wavelength-dependent light-gathering characteristics, and can be configured to be made up of lens members or hologram elements, and in some cases, an imaging device (camera) or a sensor constituting the light receiving section can identify the position of the eyepiece optical device by image processing the image of the eyepiece optical device obtained. Although a retroreflective element is not necessary, image processing can be simplified by attaching a color marker to the eyepiece optical device, for example.
[0043] When the position detection light emitted from the light source is made incident on the first optical path synthesis unit via a coupling lens arranged adjacent to the light source in order to make the light incident on the first optical path synthesis unit parallel light, all optical elements through which the position detection light passes (including not only the first optical path synthesis unit, the second optical path synthesis unit, and the transfer optical device, but also the coupling lens) must be made larger than the spot size of the position detection light in the eyepiece optical device. Specifically, it is necessary to design the size of the coupling lens in consideration of the size of the retroreflective element, the margin during various operations, and the deviation of the traveling axis that may occur within the expected range of movement of the observer, which may make it difficult to reduce the size of the display device as a whole. By arranging the light source inside the focal position of the coupling lens, as described above, the light emitted from the light source (position detection light) becomes divergent light, and the display device as a whole can be made smaller. In addition, in optical design, it is desirable to shorten the optical path length (the distance from the light source to the transfer optical device) within the main body as much as possible from the viewpoint of miniaturization.
[0044] The display device or the like of the present disclosure may be provided with a well-known eye tracking device (eye tracking camera). In the eye tracking device, for example, a reflection point of light (for example, near-infrared light) is generated on the cornea, which is then captured by the eye tracking device, and the reflection point of light on the cornea and the pupil are identified from the captured image of the eyeball, and the direction of the eyeball is calculated based on the reflection point of light and other geometric features. In addition, a pupil diameter measuring unit that measures the pupil diameter of the observer may be provided. An example of the pupil diameter measuring unit is a well-known eye tracking device (eye tracking camera). Specifically, based on the image of the eye recorded by the eye tracking device, the distance from the eye tracking device to the pupil is calculated, and the pupil diameter can be obtained from the diameter of the pupil in the captured image. By obtaining the pupil diameter, it is possible to control the brightness of the image and optimize the incidence of the image on the pupil.
[0045] Furthermore, in the display device etc. of the present disclosure including the preferred modes and configurations described above, when the angle between a straight line connecting the center of the eyepiece optical device and the center of the observer's pupil and a normal line passing through the center of the eyepiece optical device is θ1, the angle between a light ray emitted from the center of the image forming device and the normal line passing through the center of the eyepiece optical device when the light ray reaches the eyepiece optical device via the transfer optical device is θ2, and the focal length of the eyepiece optical device is f0 (unit: mm), the diameter of the observer's pupil is strongly dependent on the environment and the state of the observer and is said to be 2 mm to 7 mm, f0 |tan(θ2)-tan(θ1)|≦3.5 Preferably, f0·|tan(θ2)-tan(θ1)|≦1 More preferably, the transfer optical device / control device can be configured to control the transfer optical device so as to satisfy θ1=θ2.
[0046] Furthermore, in the display device and the like of the present disclosure including the preferred forms and configurations described above, the eyepiece optical device may be configured to include a diffraction grating. A diffraction grating is an optical element that generates a diffraction phenomenon by a lattice pattern. A plurality of images are obtained based on k-th order diffracted light (where k=0, ±1, ±2...) emitted from the diffraction grating. When an image composed of parallel light enters the diffraction grating, the light rays constituting each of the images emitted from the diffraction grating also become parallel light.
[0047] Examples of the diffraction grating constituting the eyepiece optical device include, but are not limited to, a transmission type diffraction grating or a transmission type hologram diffraction grating (specifically, a transmission type volume hologram diffraction grating), or a reflection type diffraction grating or a reflection type hologram diffraction grating (specifically, a reflection type volume hologram diffraction grating). When the diffraction grating is constituted by a transmission type diffraction grating or a transmission type hologram diffraction grating, when the incident angle ψ of the light constituting the image is constant, in order to obtain a plurality of images separated by the diffraction grating and output from the diffraction grating, it is necessary to change the value of Θ in various ways. To change the value of Θ, it is sufficient to change the value of the inclination angle φ from formula (B), and also to change the value of the pitch d of the grating surface from formula (A). In other words, by appropriately selecting the value of the inclination angle φ and the value of the pitch d of the grating surface, it is possible to separate an image incident on a diffraction grating made of a volume hologram diffraction grating by the diffraction grating, and to output a plurality of images from the diffraction grating.
[0048] Alternatively, the diffraction grating may have a known configuration and structure, such as a reflective blazed diffraction grating (see FIG. 23B) or a reflective blazed diffraction grating having a step shape (see FIG. 23C), but is not limited to these diffraction gratings. The grating pattern is, for example, configured with linear concaves and convexes arranged in parallel with a period of micrometer size, and the period and pattern thickness (difference in thickness between the concaves and convexes) are appropriately selected based on the wavelength range of the light emitted from the image forming device. The diffraction grating may be manufactured by a known method.
[0049] The diffraction grating constituting the eyepiece optical device may divide the image into at least two images.Specific examples of the diffraction grating include a form in which the image is divided into three images in the horizontal direction, a form in which the image is divided into three images in the vertical direction, a form in which the image is divided crosswise into three images in the horizontal direction and three images in the vertical direction (one image including the central light path overlaps, so the image is divided into a total of five images), a form in which the image is divided into two images in the horizontal direction and two images in the vertical direction, for a total of 2×2=4, and a form in which the image is divided into three images in the horizontal direction and three images in the vertical direction, for a total of 3×3=9.
[0050] In the display device and the like of the present disclosure including the preferred forms and configurations described above, the eyepiece optical device may be of a semi-transmissive (see-through) type, whereby an outside scene can be viewed through the eyepiece optical device. In this case, the eyepiece optical device may be configured to include a hologram element, or may be configured to include a hologram element. In some cases, the eyepiece optical device may be of a non-transmissive type (a form in which an outside scene cannot be viewed through the eyepiece optical device).
[0051] In the display device and the like of the present disclosure including the various preferred forms and configurations described above, the image display device may be arranged in front of the observer. Note that, as long as the image display device is arranged in front of the observer, it may be located higher than the observer's head, may be located at the same level as the observer's head, may be located lower than the observer's head, may be located opposite the observer, or may be located at an angle to the observer, depending on the specifications of the transfer optical device and the eyepiece optical device. When the display device is a non-transmissive type, the image display device may be arranged in front of the observer.
[0052] In the display device and the like of the present disclosure including the various preferred forms and configurations described above, the image forming device may have a plurality of pixels arranged in a two-dimensional matrix. For convenience, such an image forming device configuration is referred to as the "image forming device of the first configuration."
[0053] Examples of the image forming device of the first configuration include an image forming device composed of a reflective spatial light modulator and a light source; an image forming device composed of a transmissive spatial light modulator and a light source; and an image forming device composed of light emitting elements such as organic EL (Electro Luminescence), inorganic EL, light emitting diode (LED), and semiconductor laser element. Among them, an image forming device composed of an organic EL light emitting element (organic EL display device) and an image forming device composed of a reflective spatial light modulator and a light source are preferable. Examples of the spatial light modulator include a light valve, for example, a transmissive or reflective liquid crystal display device such as LCOS (Liquid Crystal On Silicon), and a digital micromirror device (DMD), and examples of the light source include a light emitting element. Furthermore, the reflective spatial light modulator can be configured to include a liquid crystal display device and a polarizing beam splitter that reflects a part of the light from the light source and guides it to the liquid crystal display device, and also passes a part of the light reflected by the liquid crystal display device and guides it to the transfer optical device. Examples of the light emitting element constituting the light source include a red light emitting element, a green light emitting element, a blue light emitting element, and a white light emitting element. Alternatively, the red light, green light, and blue light emitted from the red light emitting element, the green light emitting element, and the blue light emitting element may be mixed and luminance uniformed using a light pipe to obtain white light. Examples of the light emitting element include a semiconductor laser element, a solid-state laser, and an LED. The number of pixels may be determined based on the specifications required for the image forming device, and specific values of the number of pixels may be 320×240, 432×240, 640×480, 1024×768, 1920×1080, etc. In the image forming device of the first configuration, a diaphragm may be disposed at the position of the front focal point (the focal point on the image forming device side) of the lens system (described later).
[0054] Alternatively, the image forming device in the display device or the like of the present disclosure including the above-described preferred forms and configurations may be configured to include a light source and a scanning means for scanning the light emitted from the light source to form an image. For convenience, such an image forming device will be referred to as the "image forming device of the second configuration."
[0055] The light source in the image forming apparatus of the second configuration may be a light emitting element, specifically a red light emitting element, a green light emitting element, a blue light emitting element, or a white light emitting element. Alternatively, the red light, the green light, and the blue light emitted from the red light emitting element, the green light emitting element, and the blue light emitting element may be mixed and luminance uniformed using a light pipe to obtain white light. Examples of the light emitting element include a semiconductor laser element, a solid-state laser, and an LED. The number of pixels (virtual pixels) in the image forming apparatus of the second configuration may also be determined based on the specifications required for the image forming apparatus, and specific values of the number of pixels (virtual pixels) may be 320×240, 432×240, 640×480, 1024×768, 1920×1080, etc. In addition, when a color image is displayed and the light source is composed of red light emitting elements, green light emitting elements, and blue light emitting elements, it is preferable to perform color synthesis using, for example, a cross prism. Examples of the scanning means include a MEMS mirror or a galvanometer mirror having a micromirror that can rotate in two dimensions, which horizontally and vertically scans the light emitted from the light source. In the image forming device of the second configuration, the MEMS mirror or the galvanometer mirror can be disposed at the front focal point (the focal point on the image forming device side) of the lens system (described later).
[0056] In the image forming device of the first configuration or the image forming device of the second configuration, the light that has been converted into a plurality of parallel beams by the lens system (an optical system that converts the emitted light into parallel beams) is made to enter a transfer optical device (specifically, for example, a movable mirror). To generate parallel beams, specifically, as described above, for example, the light emission unit of the image forming device may be positioned at the focal length of the lens system. As the lens system, an optical system having positive optical power as a whole, which is formed by using a convex lens, a concave lens, a free-form prism, or a hologram lens, alone or in combination, may be exemplified. Between the lens system and the transfer optical device, a light shielding unit having an opening may be disposed near the lens system so that undesired light is not emitted from the lens system and enters the transfer optical device.
[0057] In the display device and the like of the present disclosure, the eyepiece optical device can be in a form attached to a frame. The frame includes a front part disposed in front of the viewer, two temple parts rotatably attached to both ends of the front part via hinges, and a nose pad part. An end piece is attached to the tip of each temple part. The front part and the two temple parts can also be configured as one unit. The assembly of the frame (including the rim part) and the nose pad part has a structure substantially the same as that of normal glasses. The material constituting the frame including the nose pad part can be made of the same material as that constituting normal glasses, such as metal, alloy, plastic, or a combination of these. Alternatively, the eyepiece optical device can be in a form attached to goggles or a face mask or formed integrally with the goggles or a face mask, or in a form attached to a face member (face member, mask member) having a shape similar to a disaster prevention mask that can be worn on the viewer's head or formed integrally with the face member.
[0058] The eyepiece optical device worn by the observer has a very simple structure, and since it has no driving section, batteries, etc. for driving it are not required, making it easy to achieve a small and lightweight eyepiece optical device. Unlike conventional HMDs, the image display device is not worn on the observer's head. The image display device is disposed in external equipment, etc., or is worn as a wearable device on the observer's wrist, etc. Examples of image display devices disposed in external equipment, etc. include: (A) An example of an image display device for passengers attached to the back of a seat in a vehicle or aircraft (B) An example of an image display device for audience use attached to the back of the seat (backrest) in a theater, etc. (C) Examples of vehicles, aircraft, automobiles, motorcycles, bicycles, etc. equipped with image display devices for drivers, etc. (D) An example of an image display device being attached to a drone (including an airship type) or a self-propelled agent robot (including an arm-type robot) that can maintain a certain distance from the observer. (E) Examples of use as a replacement for monitors in personal computers, mobile phones, smart watches, etc. (F) Examples of use as a replacement for displays and touch panels in automated teller machines at financial institutions (G) Examples of use as a replacement for displays and touch panels in stores and offices (H) Examples of enlarging or expanding the screen of a mobile phone or personal computer (I) Examples of use as a substitute for display plates used in museums, amusement parks, etc. (J) An example of an image display device for customers attached to tables in coffee shops and cafes (K) Examples of incorporation into full-face helmets and protective face masks
[0059] In the display device etc. of the present disclosure including the various preferred forms and configurations described above, a form can be adopted in which a signal for displaying an image in the image forming device (a signal for forming a virtual image in the eyepiece optical device) is received from the outside (outside the system of the display device). In such a form, information and data on an image to be displayed in the image forming device are recorded, stored, and saved in, for example, a so-called cloud computer or server, and various information and data can be exchanged between the cloud computer or server and the image display device by providing the image display device with a communication means, for example, a telephone line, an optical line, a mobile phone, or a smartphone, or by combining the image display device with a communication means, and a signal based on various information and data, that is, a signal for displaying an image in the image forming device, can be received. Alternatively, a form can be adopted in which a signal for displaying an image in the image forming device is stored in the image display device. The image displayed in the image forming device includes various information and various data. An image display device as a wearable device may also be configured to include a camera (imaging device), and an image captured by the camera may be sent to a cloud computer or server via a communication means, various information or data corresponding to the image captured by the camera may be searched for in the cloud computer or server, the searched information or data may be sent to the image display device via the communication means, and the searched information or data may be displayed as an image on an image forming device.
[0060] The display device etc. of the present disclosure, including the various forms and configurations described above, can be used, for example, to display various information etc. on various sites on the Internet; to display various explanations and symbols, signs, marks, symbols, designs etc. when operating, manipulating, maintaining, disassembling etc. of objects of observation such as various devices; to display various explanations and symbols, signs, marks, symbols, designs etc. relating to objects of observation such as people and objects; to display videos and still images; to display subtitles for movies etc.; to display explanatory text and closed captions relating to images synchronized with the images; to display various explanations and explanatory texts explaining the contents, progress, background etc. of objects of observation in plays, Kabuki, Noh, Kyogen, opera, concerts, ballet, various types of theater, amusement parks, art museums, tourist spots, recreational spots, tourist guides etc., and can be used to display closed captions. In plays, Kabuki, Noh, Kyogen, opera, concerts, ballet, various plays, amusement parks, art museums, tourist spots, sightseeing spots, tourist guides, etc., texts as images related to the observed objects may be displayed on the image forming device at appropriate timing. Specifically, for example, in accordance with the progress of a movie or the like, or in accordance with the progress of a play or the like, an image control signal is sent to the image forming device based on a predetermined schedule or time allocation, by an operator's operation or under the control of a computer, etc., and an image is displayed on the image forming device. In addition, various explanations related to the observed objects such as various devices, people, and objects are displayed, and various explanations related to the observed objects such as various devices, people, and objects are displayed on the image forming device by photographing (capturing) the observed objects such as various devices, people, and objects with a camera and analyzing the photographed (capturing) contents in the image forming device. EXAMPLES
[0061] Example 1 relates to a display device according to the first to third aspects of the present disclosure. A conceptual diagram of the display device of Example 1 is shown in Fig. 1, and a schematic diagram of an observer wearing an eyepiece optical device constituting the display device of Example 1 as viewed from the front is shown in Fig. 2.
[0062] The display device in Example 1 or Examples 2 to 8 described later can be expressed in accordance with the display devices according to the first and second aspects of the present disclosure as follows: An eyepiece optical device 40A, and An image display device 10 including an image forming device 20 and a transfer optical device 30 that outputs an image incident from the image forming device 20 to an eyepiece optical device 40A; It is equipped with The eyepiece optical device 40A and the image display device 10 are arranged to be spatially separated from each other. The eyepiece optical device 40A focuses the image from the transfer optical device 30 onto the retina of the observer 70. The image display device 10 further includes: Control unit 11, a first position detection device 50 and a second position detection device 60 for detecting the position of the eyepiece optical device 40A; and Transfer optical device and control device 31, It is equipped with:
[0063] Alternatively, the display device in Example 1 or Examples 2 to 8 described later can be expressed in accordance with the display device according to the third aspect of the present disclosure as follows: An eyepiece optical device 40A, and An image display device 10 including an image forming device 20 and a transfer optical device 30 that outputs an image incident from the image forming device 20 to an eyepiece optical device 40A; It is equipped with The eyepiece optical device 40A and the image display device 10 are arranged to be spatially separated from each other. The eyepiece optical device 40A focuses the image from the transfer optical device 30 onto the retina of the observer 70. The image display device 10 further includes a first position detection device 50 that detects the position of the eyepiece optical device 40A. The first position detection device 50 is light source 51, first optical path combining section 52; A second optical path synthesis unit 53, and light receiving section 54, It is equipped with:
[0064] The display device in Example 1 or Examples 2 to 8 described below can be expressed in accordance with the display device according to the third aspect of the present disclosure, or in accordance with the preferred embodiments of the display devices according to the first and second aspects of the present disclosure, as follows: An image (image forming light) incident from the image forming device 20 passes through the second optical path synthesis unit 53, the transfer optical device 30, and the eyepiece optical device 40A and is formed on the retina of the observer 70. Light (position detection light) emitted from the light source 51 passes through the first optical path synthesis unit 52, the second optical path synthesis unit 53, and the transfer optical device 30 to reach the eyepiece optical device 40A, is returned to the transfer optical device 30 by the eyepiece optical device 40A, passes through the transfer optical device 30 and the second optical path synthesis unit 53, enters the first optical path synthesis unit 52, is emitted from the first optical path synthesis unit 52 in a direction different from the light source 51, and enters the light receiving unit 54.
[0065] In the display device of Example 1 or Examples 2 to 8 described below, if expressed in accordance with the display device according to the first aspect of the present disclosure, based on position information of the eyepiece optical device 40A detected by the first position detection device 50, the transfer optical device / control device 31, under the control of the control unit 11, controls the transfer optical device 30 so that the image incident from the image forming device 20 reaches the eyepiece optical device 40A, and based on the position information of the eyepiece optical device 40A detected by the second position detection device 60, the control unit 11 corrects the detection position of the first position detection device 50.
[0066] Furthermore, if the display device of Example 1 or Examples 2 to 8 described below is expressed in accordance with a display device according to the second aspect of the present disclosure, or expressed in accordance with a preferred form of the display device according to the first aspect of the present disclosure, based on position information of the eyepiece optical device 40A detected by the first position detection device 50, the transfer optical device / control device 31, under the control of the control unit 11, controls the transfer optical device 30 so that the image incident from the image forming device 20 reaches the eyepiece optical device 40A, and the control unit 11 controls the formation of an image in the image forming device 20 based on the position information of the eyepiece optical device 40A detected by the first position detection device 50, or by the second position detection device 60, or by the first position detection device 50 and the second position detection device 60.
[0067] The light emitted from the light source 51 is reflected by the first optical path combiner 52 and enters the second optical path combiner 53. On the other hand, the light (return light) from the second optical path combiner 53 passes through the first optical path combiner 52 and enters the light receiving unit 54.
[0068] In the display device of Example 1 or Examples 2 to 8 described later, the light source 51 emits infrared rays in an eye-safe wavelength band (for example, a wavelength of about 1.55 μm) that does not interfere with an image. Specifically, the light source 51 is made of a semiconductor laser element that emits infrared rays. In addition, the light emitted from the light source 51 and incident on the first optical path synthesis unit 52 is divergent light. A coupling lens 55 is disposed between the light source 51 and the first optical path synthesis unit 52. The light source 51 is disposed inside the focal position of the coupling lens 55. This makes it possible to make the light emitted from the light source 51 divergent light, thereby realizing a compact display device as a whole. In addition, the first optical path synthesis unit 52 can be configured from a beam splitter, and the second optical path synthesis unit 53 can be configured from a dichroic mirror. The infrared rays (position detection light) emitted from the light source 51 do not interfere with an image.
[0069] The light receiving unit 54 is composed of, but not limited to, a plurality of photodiodes, and detects the position of the position detection light by comparing the voltages of the plurality of photodiodes (specifically, four diodes 54A, 54B, 54C, and 54D). A lens member 56 is disposed between the light receiving unit 54 and the first light path synthesis unit 52. The light receiving unit 54 is disposed at a position (on the in-focus side) closer to the first light path synthesis unit 52 than a position optically conjugate with the light source 51. That is, the light receiving unit 54 is disposed on the first light path synthesis unit side than the beam waist position (the position where the spot diameter is smallest) of the position detection light. This can improve the foreign matter resistance.
[0070] The second position detection device 60 is composed of a camera, a TOF distance measurement device, or an indirect TOF distance measurement device. In the TOF distance measurement device, a pulsed light is irradiated onto the eyepiece optical device 40A, and a time delay is detected when the light travels back and forth between the eyepiece optical device 40A and the camera. In the indirect TOF distance measurement device, a pulsed light is irradiated onto the eyepiece optical device 40A, and a time delay is detected as a phase difference when the light travels back and forth between the eyepiece optical device 40A and the camera.
[0071] In the indirect TOF method, it is not necessary to directly convert the change in the intensity of received light into an electrical signal, and synchronous detection can be performed on the sensor (the amount of phase shift can be detected as the amount of charge). More specifically, under the control of a control circuit provided in the distance measurement device, the distance measurement device captures an image of the eyepiece optical device 40A based on the light emitted from the light source of the distance measurement device in a first period TP1 and a second period TP2, and accumulates a first image signal charge obtained in the light receiving device of the distance measurement device in a first charge accumulation section in the first period TP1, and accumulates a second image signal charge obtained in the light receiving device of the distance measurement device in a second charge accumulation section in the second period TP2. Then, the control circuit calculates the distance from the distance measurement device to the eyepiece optical device 40A based on the first image signal charge accumulated in the first charge accumulation section and the second image signal charge accumulated in the second charge accumulation section. Here, the first image signal charge is Q1, the second image signal charge is Q2, c is the speed of light, and T P is the time (pulse width) of the first period TP1 and the second period TP2, the distance D from the distance measuring device to the eyepiece optical device 40A is D = (c T P / 2)×Q2 / (Q1+Q2) It can be obtained based on the following.
[0072] The transfer optical device 30 is composed of a movable mirror. The transfer optical device 30 is attached to a transfer optical device / controller 31 that controls the movement of the transfer optical device 30, and the transfer optical device / controller 31 is controlled by the control unit 11. The transfer optical device 30 is composed of a combination of two galvanometer mirrors, one for moving the light (image formation light and position detection light) incident on the transfer optical device 30 in the x direction and the other for moving it in the y direction. However, the present invention is not limited to this.
[0073] In the first embodiment, the eyepiece optical device 40A is equipped with a well-known hologram element. In the display device of the first embodiment, the eyepiece optical device 40A is provided with a position display means 41 (position detection means), specifically, a retroreflective element, and more specifically, although not limited to, a retroreflective marker is fixed thereto. The retroreflective marker is a light reflecting part manufactured so that the incident light and the reflected light are in the same direction, and by utilizing this characteristic, in principle, even if the observer 70 moves, the return light always returns to the transfer optical device 30. As a result, the position of the retroreflective marker can be detected regardless of the relative positional relationship between the transfer optical device 30 and the retroreflective marker. It is preferable that the retroreflective marker is a camouflage color with respect to the frame 140. Furthermore, if wavelength selectivity is imparted to the position indication means 41, specifically, if the position indication means 41 is configured and structured to reflect the position detection light and transmit other light, the position indication means 41 may be attached to a hologram element constituting the eyepiece optical device 40A, or may be formed in the hologram element.
[0074] The eyepiece optical device 40A can be configured to be worn by the observer 70. Specifically, the eyepiece optical device 40A is attached to a frame 140 (for example, a glasses-type frame 140) that is worn on the head of the observer 70. More specifically, the eyepiece optical device 40A is fitted into a rim provided on a front part 141. The frame 140 is composed of a front part 141 disposed in front of the observer 70, two temple parts 143 rotatably attached to both ends of the front part 141 via hinges 142, and ear pieces (also called tip parts, earmuffs, or ear pads) 144 attached to the tip of each temple part 143. A nose pad part 140' is also attached. The assembly of the frame 140 and the nose pad part 140' basically has approximately the same structure as that of normal glasses.
[0075] In the image display device of Example 1 or Examples 2 to 8 described below, light emitted from the display device at a certain moment (e.g., equivalent to the size of one pixel or one sub-pixel) reaches the pupil 71 (specifically, the crystalline lens) of the observer 70, and the light passing through the crystalline lens finally forms an image on the retina of the observer 70.
[0076] As shown in FIG. 3A, the image forming device 20 (hereinafter, the image forming device shown in FIG. 3A is referred to as the image forming device 20a) is a first configuration image forming device, and has a plurality of pixels arranged in a two-dimensional matrix. Specifically, the image forming device 20a is composed of a reflective spatial light modulation device and a light source 21a consisting of a light-emitting diode that emits white light. The entire image forming device 20a is housed in a housing 24 (shown by a dashed line in FIG. 3A), and the housing 24 is provided with an opening (not shown), through which light is emitted from an optical system 21d (parallel light emitting optical system, collimated optical system). The reflective spatial light modulation device is composed of a liquid crystal display device (LCD) 21c consisting of LCOS as a light valve. In addition, a polarizing beam splitter 21b is provided that reflects a part of the light from the light source 21a and guides it to the liquid crystal display device 21c, and also passes a part of the light reflected by the liquid crystal display device 21c and guides it to the optical system 21d. The liquid crystal display device 21c includes a plurality of pixels (liquid crystal cells, liquid crystal display elements) (for example, 21d0×480 pixels) arranged in a two-dimensional matrix. The polarizing beam splitter 21b has a known configuration and structure. Unpolarized light emitted from the light source 21a collides with the polarizing beam splitter 21b. In the polarizing beam splitter 21b, the P-polarized component passes through and is emitted outside the system. On the other hand, the S-polarized component is reflected by the polarizing beam splitter 21b, enters the liquid crystal display device 21c, is reflected inside the liquid crystal display device 21c, and is emitted from the liquid crystal display device 21c. Here, of the light emitted from the liquid crystal display device 21c, the light emitted from the pixels displaying "white" contains a large amount of P-polarized component, and the light emitted from the pixels displaying "black" contains a large amount of S-polarized component. Therefore, of the light emitted from the liquid crystal display device 21c and impinging on the polarizing beam splitter 21b, the P polarized component passes through the polarizing beam splitter 21b and is guided to the optical system 21d. On the other hand, the S polarized component is reflected by the polarizing beam splitter 21b and returned to the light source 21a. The optical system 21d is composed of, for example, a convex lens, and the image forming device 20a (more specifically, the liquid crystal display device 21c) is disposed at a focal length (position) of the optical system 21d to generate parallel light.The image emitted from the image forming device 20a reaches the retina of the observer 70 via the transfer optical device 30 and the eyepiece optical device 40A.
[0077] Alternatively, as shown in Fig. 3B, the image forming device 20 (hereinafter, the image forming device shown in Fig. 3B will be referred to as image forming device 20b) is composed of an organic EL display device 22a. An image emitted from the organic EL display device 22a passes through a convex lens 22b, becomes parallel light, and reaches the retina of the observer 70 via the transfer optical device 30 and the eyepiece optical device 40A. The organic EL display device 22a has a plurality of pixels (organic EL elements) (for example, 640 x 480 pixels) arranged in a two-dimensional matrix.
[0078] Alternatively, as shown in FIG. 3C, the image forming apparatus 20 (hereinafter, the image forming apparatus shown in FIG. 3C will be referred to as the image forming apparatus 20c) which is the image forming apparatus of the second configuration, light source 23a, a collimating optical system 23b for converting the light emitted from the light source 23a into parallel light; a scanning means 23d for scanning the parallel light emitted from the collimating optical system 23b; and a relay optical system 23e that relays and emits the parallel light scanned by the scanning means 23d; The image forming device 20c is entirely housed in a housing 24 (shown by a dashed line in FIG. 3C), and the housing 24 is provided with an opening (not shown), through which light is emitted from the relay optical system 23e. The light source 23a is composed of a light-emitting element, specifically, a light-emitting diode or a semiconductor laser element. The light emitted from the light source 23a enters the collimating optical system 23b, which has a positive optical power as a whole, and is emitted as parallel light. The parallel light is reflected by the total reflection mirror 23c, and horizontal and vertical scanning is performed by the scanning means 23d, which is made of MEMS and can rotate a micromirror in two dimensions and scan the incident parallel light two-dimensionally, to form a kind of two-dimensional image, and virtual pixels (the number of pixels can be the same as that of the image forming device 20a, for example) are generated. Then, the light from the virtual pixels passes through a relay optical system (parallel light emitting optical system) 23e composed of a well-known relay optical system, and the image emitted from the image forming device 20c reaches the retina of the observer 70 via the transfer optical device 30 and the eyepiece optical device 40A. If the light source 23a is composed of red, green and blue light emitting elements, the observer 70 can detect a color image, and if the light source 23a is composed of one type of light emitting element, the observer 70 can detect a monochromatic image.
[0079] As described above, the image generated by the image forming device 20 is incident on the transfer optical device (specifically, the movable mirror) 30 in the state of parallel light (or nearly parallel light), and after being reflected by the transfer optical device 30, becomes a light beam directed toward the eyepiece optical device 40A. The eyepiece optical device 40A is disposed so that the pupil of the observer 70 is positioned at the focal point (focal length f0) of the eyepiece optical device 40A, and the projected light beam is collected by the eyepiece optical device 40A and passes through the pupil of the observer 70 to be directly drawn on the retina, enabling the observer 70 to recognize the image.
[0080] In the display device of Example 1 or Examples 2 to 8 described later, the transfer optical device 30 controls the image projection onto the retina of the observer 70 along the horizontal direction (X direction) and / or vertical direction (Y direction) of the image formed on the retina of the observer 70 by the transfer optical device / control device 31. That is, the transfer optical device 30 controls the light toward the eyepiece optical device 40A to move in the x direction and / or y direction. Based on the position information of the eyepiece optical device 40A detected by the first position detection device 50, the transfer optical device / control device 31 controls the transfer optical device 30 under the control of the control unit 11 so that the image incident from the image forming device 20 reaches the eyepiece optical device 40A. However, the transfer optical device 30 may be controlled so that all of the image incident from the image forming device 20 reaches the eyepiece optical device 40A, or the transfer optical device 30 may be controlled so that only a part of the image incident from the image forming device 20 reaches the eyepiece optical device 40A. The display device of Example 1 or Examples 2 to 8 described below is a retinal projection type display device based on Maxwellian vision.
[0081] In the display device of Example 1 or Examples 2 to 8 described below, if the incident position of light (return light) incident on the light receiving unit 54 from the first optical path combining unit 52 deviates from a predetermined position (reference position), the transfer optical device / control device 31 controls the position of the transfer optical device 30 so as to eliminate the deviation, which will be described in detail later.
[0082] In the display device of the first embodiment, the emission angle of the light emitted from the center of the light source 51 (center light for position detection) from the transfer optical device 30 differs from the emission angle of the light emitted from the center of the image forming device 20 (center light for image formation) from the transfer optical device 30 by θ0 (degrees) as shown in Fig. 5. The value of θ0 may be determined based on the specifications required for the display device. In reality, the emission angles differ stereoscopically (three-dimensionally) in the xyz space. In FIG. 1, the exit angle of the light (position detection center light) emitted from the center of the light source 51 from the transfer optical device 30 and the exit angle of the light (image formation center light) emitted from the center of the image forming device 20 from the transfer optical device 30 are illustrated as being the same angle, but in reality, the first unit on which the image forming device 20, the second optical path synthesis unit 53, the transfer optical device 30, and the second position detection device 60 are mounted, and the second unit on which the light source 51, the first optical path synthesis unit 52, the second optical path synthesis unit 53, and the light receiving unit 54 are mounted are arranged so that, for example, the position detection center light from the light source 51 enters the first optical path synthesis unit 52 at 45 degrees, but enters the second optical path synthesis unit 53 at an angle other than 45 degrees. Note that the angle can also be made different by the angle θ0 (degrees) by appropriately setting the relative arrangement angle of the first optical path synthesis unit 52 and the second optical path synthesis unit 53. In this case, the position of the light receiving unit 54 may be optimized as necessary. The light emitted from the center of the light source 51 (position detection center light) and the light emitted from the center of the image forming device 20 (image formation center light) do not necessarily need to intersect at the transfer optical device 30 as shown in FIG. 5, and may be determined based on the specifications required for the display device. For example, they may intersect at the second optical path synthesis unit 53.
[0083] Alternatively, it is preferable to determine the angle θ0 by taking into consideration the following point. That is, when the transfer optical device is controlled so that the image formation central light passes through the center of the eyepiece optical device 40A, within the assumed movement range of the observer, [1] The position display means 41 is always located within the spot of the position detection light. [2] The position detection light including the return light always enters and leaves the transfer optical device 30 and does not go beyond the effective areas of all optical components including the light receiving unit 54. Furthermore, with regard to [1] and [2], it is necessary to design taking into consideration not only the state in which the position display means is stationary, but also the dynamic state (the amount of movement of the position display means in the time between when it moves and when the next feedback is given).
[0084] When an image is observed with one eye, one display device may be used. When an image is observed with both eyes, two display devices may be used, or one display device having the following configuration may be used. That is, a structure may be provided with two eyepiece optical devices 40A, one image forming device, and an image display device having two transfer optical devices 30 that split an image incident from the one image forming device and output it to the two eyepiece optical devices 40A, or a structure may be provided with two eyepiece optical devices 40A, one image forming device, and an image display device having one transfer optical device 30 that receives an image incident from the one image forming device, splits it into two images, and outputs them to the two eyepiece optical devices 40A.
[0085] In the display device of the first embodiment, the transfer optical device / control device 31 controls the transfer optical device 30 under the control of the control unit 11 based on the position information of the eyepiece optical device 40A detected by the first position detection device 50 so that the image incident from the image forming device 20 reaches the eyepiece optical device 40A. Specifically, when the position of the eyepiece optical device 40A changes from a state in which the light (position detection light) from the first optical path synthesis unit 52 is incident on a predetermined position (reference position) of the light receiving unit 54 (specifically, for example, when the viewer 70 moves), a change occurs in the position where the light (position detection light) from the first optical path synthesis unit 52 is incident on the light receiving unit 54. The direction in the light receiving unit 54 corresponding to the x direction is called the "ζ direction", and the direction in the light receiving unit 54 corresponding to the y direction is called the "η direction". Then, a change in the position of the eyepiece optical device 40A in the x direction is a change in the ζ direction of the position where the light from the first optical path synthesis section 52 (position detection light) enters the light receiving section 54. Also, a change in the position of the eyepiece optical device 40A in the y direction is a change in the η direction of the position where the light from the first optical path synthesis section 52 (position detection light) enters the light receiving section 54.
[0086] Therefore, as described above, the transfer optical device / control device 31 controls the position of the transfer optical device 30 so that the light (position detection light) from the first optical path combining unit 52 is incident on a predetermined position on the light receiving unit 54, thereby ensuring that the image forming light from the transfer optical device 30 is incident on the pupil 71 of the observer 70. If the incident position on the light receiving unit 54 of the light incident from the first optical path combining unit 52 deviates from the predetermined position, this "deviation" is detected in the light receiving unit 54 as an error signal (a signal whose voltage changes depending on the amount of deviation). That is, when the voltage value of the signal in a state where the light from the first optical path combining unit 52 (return light of the position detection light) is incident on the light receiving unit 54 at a predetermined position (reference position) is V0, and the voltage value of the signal in a state where the incident position of the light (return light) incident on the light receiving unit 54 from the first optical path combining unit 52 is shifted from the predetermined position (reference position) to the light receiving unit 54 is V1, the transfer optical device / controller 31 controls the position of the transfer optical device 30 so that V1 becomes V0. Note that the position detection light spot on the light receiving unit 54 when the voltage value becomes V0 is indicated by a circle indicated by a solid line "A" in FIG. 4, and the position detection light spot on the light receiving unit 54 when the voltage value becomes V1 is indicated by a circle indicated by a dotted line "B" in FIG. 4. Conceptually, the transfer optical device / controller 31 controls the position of the transfer optical device 30 so that the circle "B" overlaps with the circle "A".
[0087] As described above, the light receiving unit 54 has a structure in which the four photodiodes 54A, 54B, 54C, and 54D are arranged in a square shape (a 2×2 array structure). The output voltage (more precisely, the output is a current, but since it is common to convert it to a voltage by arranging an IV conversion element in the subsequent stage and handle it, a description of this part will be omitted) changes depending on the amount of light received by each of the photodiodes 54A, 54B, 54C, and 54D. The four voltage signals output from each of the photodiodes 54A, 54B, 54C, and 54D are converted into error signals through an operational amplifier calculation circuit provided in the control unit 11. The output signals from each of the photodiodes 54A, 54B, 54C, and 54D are converted into V A ,V B ,V C ,V DThen, the error signals in the ζ direction (corresponding to the x direction) and the η direction (corresponding to the y direction) can be calculated as follows: ζ Error =(V A +V C )-(V B +V D ) η Error =(V A +V B )-(V C +V D )
[0088] In addition, since the magnitude of the error signal changes when the amount of light changes, the error signals in each direction are summed (=V A +V B +V C +V D ) is often used as an actual control signal, but the explanation is omitted here.
[0089] The relationship between the error signal and the positions of the transfer optical device 30 and the eyepiece optical device 40A will be described with reference to FIG. Error If the transfer optical device 30 is controlled so that the value of ζ becomes "0", the image formation central light is emitted from the transfer optical device 30 so that the image formation central light is incident on, for example, the center of the eyepiece optical device 40A. That is, conceptually, by controlling the transfer optical device 30 so that the center of gravity of the position detection light spot indicated by the dotted line "B" in Figure 4 overlaps with the center of the circle indicated by the solid line "A", it is possible to cause the image formation central light to be incident on, for example, the center of the eyepiece optical device 40A. Conversely, ζ Error The value of u is not "0" for some value V X_offset It is possible to create a system (state) in which it is normal for the position detection central light to be incident on the light receiving section 54 while being shifted from the center thereof. In other words, when the position detection light spot is located at the position indicated by the dotted line "B" in Fig. 4, it can be defined as a state in which the image formation central light is incident on the center of the eyepiece optical device 40A.
[0090] Although this is different from the actual situation, in order to simplify the explanation, the eyepiece optical device 40A, the image forming device 20, the transfer optical device 30, the first position detection device 50, the second position detection device 60, and the pupil 71 of the observer 70 are located on the xz plane, and the image formation center light and the position detection center light travel within the xz plane in the following explanation. Since y≡0, the y coordinate value in each (x, y, z) coordinate is omitted and expressed as (x, z) coordinate. Furthermore, the coordinates of the position of the position detection center light in the light receiving unit 54 are expressed as (ζ, η), where the ζ coordinate corresponds to the x coordinate and the η coordinate corresponds to the y coordinate. Since the light receiving unit 54 handles two-dimensional coordinates, the coordinates of the position of the position detection center light are (ζ, η). Since y≡0, η≡0.
[0091] As shown in the conceptual diagram of FIG. 5, the coordinates (x, z) of the transfer optical device 30 onto which the image formation center light is incident are (0, 0). The coordinates of the position of the pupil 71 of the observer 70 are (0, z1), and the coordinates of the position display means 41 of the eyepiece optical device 40A are (x1, z1'). However, for the sake of simplicity of the following explanation, z1=z1'. At this time, the coordinates (ζ, η) of the position of the position detection center light in the light receiving unit 54 are (0, 0). The position of the position detection light spot in the light receiving unit 54 at this time is represented by the solid line "C" in FIG. This state is the initial state.
[0092] As shown in the conceptual diagram of FIG. 6, it is assumed that the observer 70 moves from the initial state (see FIG. 5) in parallel to the x direction (i.e., moves while maintaining the z coordinate (=z1)), and the coordinates of the position of the pupil 71 of the observer 70 become (x2, z1). Accordingly, the coordinates of the position display means 41 of the eyepiece optical device 40A become (x2+x1, z1). At this time, the coordinates of the position of the position detection center light in the light receiving unit 54 change from (0, 0) to (ζ1, 0). The position of the position detection light spot in the light receiving unit 54 at this time is represented by the dashed line "D" in FIG. 10. Then, the transfer optical device / control device 31 controls the position of the transfer optical device 30 so that the coordinates of the position of the position detection center light in the light receiving unit 54 change from (ζ1, 0) to (0, 0).
[0093] Next, as shown in FIG. 7, it is assumed that the pupil 71 of the observer 70 moves to z2 in the z direction away from the transfer optical device 30 while maintaining the x coordinate (=0). The coordinates of the pupil 71 of the observer 70 are (0, z2). At this time, the coordinates of the position display means 41 are (x1, z2). In addition, the coordinates of the position of the position detection central light in the light receiving unit 54 at this time are (ζ2, 0). As is clear from FIG. 7, since the pupil 71 of the observer 70 maintains the x coordinate (=0), it is not necessary to change the image formation central light emitted from the transfer optical device 30. However, the coordinates of the position of the position detection central light in the light receiving unit 54 change from (0, 0) to (ζ2, 0). Therefore, if the image formation central light emitted from the transfer optical device 30 is changed in accordance with the change in the position of the position detection central light in the light receiving unit 54 caused by such movement of the observer 70 in the z direction, the image formation light will not reach the pupil 71 of the observer 70. The value of ζ2 can be expressed as a function of the position (distance) of the eyepiece optical device 40A. Note that k in the following formula (C) is a value that depends on the position (coordinate) of the light receiving unit 54 in the z direction. Therefore, for example, if the relationship between the values of k, x1, and z1 is tabulated, the value of ζ2 can be obtained by determining the value of z2 using the second position detection device 60.
[0094] ζ2=k(1 / z1-1 / z2)x1(C)
[0095] Here, the distance from the transfer optical device 30 to the position display means 41 of the eyepiece optical device 40A is obtained by the second position detection device 60, and therefore the position (z2) of the position display means 41 of the eyepiece optical device 40A with respect to the transfer optical device 30 is obtained. Therefore, the coordinate (ζ2,0) of the position of the position detection center light can be obtained according to the formula (C). The position of the position detection light spot on the light receiving unit 54 at this time is represented by the dotted line "E" in FIG. 11. In this way, by adding a predetermined offset amount to the error signal so that the coordinate (ζ2,0) of the position of the position detection center light on the light receiving unit 54 becomes exactly the coordinate (0,0), the origin [predetermined position (reference position)] of the coordinate of the position display means 41 accompanying the movement of the observer 70 in the z direction can be reset. The position of the position detection light spot on the light receiving unit 54 at this time is represented by the dotted line "E" in FIG. 12. Also, a conceptual diagram of the display device is shown in FIG. 8. As shown in FIG. 7, the light emitted from the center of the image forming device 20 (image forming center light) is different from the emission angle from the transfer optical device 30 by θ0 (degrees). As described above, the value of θ0 is a fixed value determined based on the specifications required for the display device. Here, the angle between the line connecting the transfer optical device 30 and the position display means 41 (shown by a dotted line in FIG. 7 and by a solid line in FIG. 8) and the line connecting the transfer optical device 30 and the pupil 71 of the observer 70 (shown by the z-axis in FIG. 7 and FIG. 8) when the position of the position display means 41 of the eyepiece optical device 40A becomes z2 is θ0'. In this case, the transfer optical device 30 may be controlled so that the position detection light is emitted from the transfer optical device 30 toward the position display means 41 at an angle obtained by subtracting the angle θ0' from the angle θ0 ([θ0-θ0'], which is referred to as the "angle offset value" for convenience). Here, the angle offset value corresponds to the offset amount added to the error signal so that the coordinate (ζ2,0) of the position of the position detection center light in the light receiving unit 54 becomes exactly the coordinate (0,0). If the amount of movement in the x direction is large and the position of the position detection light spot in the light receiving unit 54 is about to go out of the effective detection area of the light receiving unit 54, a predetermined position correction offset amount can be added to the error signal to change the origin of the coordinates of the position display means 41 [predetermined position (reference position)].
[0096] As described above, the coordinates of the position of the position detection light spot on the light receiving unit 54 do not reflect the position of the eyepiece optical device 40A (observer 70) in the z direction. Such a problem is caused by the fact that the emission angle of the image formation light emitted from the transfer optical device 30 does not match the emission angle of the position detection light. In the example shown in FIG. 5, the emission angle of the image formation light emitted from the transfer optical device 30 is 0 degrees, and the emission angle of the position detection light emitted from the transfer optical device 30 is θ0 (degrees). The above problem can be avoided by separating the emission point of the image formation light from the transfer optical device 30 and the emission point of the position detection light from the transfer optical device 30 so that the emission angle of the image formation light emitted from the transfer optical device 30 matches the emission angle of the position detection light. However, the distance between these emission points is too long, which causes a problem of the display device becoming large. Alternatively, the above problem can be avoided by locating the position indication means 41 on the light beam incident on the pupil 71 of the observer 70, or by locating the position indication means 41 so that its center of gravity is on the light beam; however, it is extremely difficult to actually employ such a structure.
[0097] Therefore, the control unit 11 corrects the detection position of the first position detection unit 50 based on the position information of the eyepiece optical device 40A detected by the second position detection unit 60. Specifically, the relationship between the amount of change in the position (distance) to the eyepiece optical device 40A and the amount of change in the position of the position detection center light in the ζ and η directions in the light receiving unit 54 is obtained in advance, the position (distance) of the eyepiece optical device 40A is detected by the second position detection unit 60, and based on the detection result, the detection position of the first position detection unit 50 is corrected (specifically, the detection position of the position detection light in the light receiving unit 54 is corrected). By constantly performing this correction in real time, it is possible to realize a video experience that does not feel strange even if the viewer 70 moves back and forth (z direction) with respect to the display device.
[0098] Next, as shown in the conceptual diagram of FIG. 9, it is assumed that the observer 70 moves from the initial state, and the coordinates of the position of the pupil 71 of the observer 70 change from (0, z1) to (x2, z2). Accordingly, the coordinates of the position display means 41 of the eyepiece optical device 40A change from (x1, z1) to (x2+x1, z2). In addition, the coordinates of the position of the position detection center light in the light receiving unit 54 change from (0, 0) to (ζ3, 0). That is, the distance from the transfer optical device 30 to the position display means 41 of the eyepiece optical device 40A, which is obtained by the second position detection device 60, changes. The position of the position detection light spot in the light receiving unit 54 at this time is represented by a two-dot chain line "F" in FIG. 13. In such a case, the control unit 11 first performs the processing described with reference to FIG. 7, FIG. 8, FIG. 11, and FIG. 12, and then performs the processing described with reference to FIG. 6 and FIG. 10.
[0099] In this way, by analyzing the position change of the position detection light spot on the light receiving unit 54, the direction of the position indication means 41 of the eyepiece optical device 40A when viewed from the transfer optical device 30 can be determined. Also, as described above, the position of the position indication means 41 of the eyepiece optical device 40A can be found with reference to the transfer optical device 30. That is, the above (x2, z2) can be found.
[0100] Then, the origin [predetermined position (reference position)] of the coordinates of the position display means 41 is reset as the observer 70 moves in the z direction, and the circle indicated by dotted line "E" in Figure 12 becomes the reference, so the transfer optical device / control device 31 controls the position of the transfer optical device 30 so that the center of gravity of the position detection light spot indicated by dotted line "F" in Figure 13 overlaps with the center of the circle indicated by dotted line "E".
[0101] The control of the transfer optical device 30 will now be described.
[0102] [Step-A] First, the position information (x, y, z) of the eyepiece optical device 40A is obtained. Specifically, the position information (x, y) of the eyepiece optical device 40A is obtained by the first position detection device 50 (in the above example, the amount of change from the reference (x1, z1)), and the position information (distance information, in the above example, (x2 2 +z2 2 ) 1 / 2 The value of (a) is obtained by the second position detection device 60.
[0103] [Step B] Based on this information, the control unit 11 performs various image processing including image divergence / convergence processing, and image expansion / contraction processing and shift processing. Based on this information, the control unit 11 also determines the amount of offset to be added to the error signal (in the above example, the value of (ζ2,0) is determined). In this way, the incident position of the position detection light on the light receiving unit 54 can be determined to be a predetermined position (reference position). Note that either of these processes may be performed first, or they may be performed simultaneously.
[0104] [Step-C] Then, a voltage signal is obtained from the light receiving unit 54, and an error signal (ζ Error ,η Error ) and based on the error signal, check whether the incident position of the position detection light on the light receiving unit 54 is a specified position (reference position). If the incident position is the specified position (reference position), the transfer optical device 30 is left as it is, and if the incident position is not the specified position (reference position), the transfer optical device 30 is moved so that the incident position is the specified position (reference position).
[0105] The above describes the case where the observer moves on a plane equivalent to the xz plane, but the same can be said for the case where the observer moves on a plane equivalent to the yz plane, and for the case where the observer moves in a space equivalent to the xyz space.
[0106] Also, there may be a misalignment between the designed position of the eyepiece optical device 40A of the display device and the designed detection position of the position detection light in the light receiving unit 54. Such a misalignment may occur, for example, during the manufacture of the display device. Therefore, in order to eliminate such a misalignment, a misalignment compensation signal may be added to the signal from the light receiving unit 54.
[0107] Depending on the relative positional relationship between the transfer optical device 30 and the eyepiece optical device 40A, the image from the image forming device 20 may be displaced from the position observed by the observer 70 (i.e., the observer can observe the image, but the position is displaced), and the image may be distorted. In such a case, the control unit 11 may control the formation of the image in the image forming device 20 based on the position information of the eyepiece optical device 40A detected by the first position detection device 50. Specifically, it is preferable to correct the position of the image formed in the image forming device 20 based on the position information of the eyepiece optical device 40A. Furthermore, depending on the distance from the transfer optical device 30 to the eyepiece optical device 40A detected by the second position detection device 60, problems such as a change in the size of the image formed on the retina of the observer 70, a defocusing of the image, divergence or convergence of the image, or distortion or aberration of the image may occur. In such a case, the control unit 11 can avoid the occurrence of such a problem by controlling the formation of an image in the image forming device 20 based on the position (distance) information from the transfer optical device 30 to the eyepiece optical device 40A detected by the second position detection device 60. In addition, by controlling the emission position of the image from the image forming device, the image can be shifted and the position of the image formed on the retina of the observer 70 can be finely adjusted. That is, specifically, the image forming area in the image forming device is made larger than the image to be displayed, and the image forming position in the image forming area is controlled, specifically, the image emitted from the image forming device can be shifted by moving the image in a direction corresponding to the x direction, or in a direction corresponding to the y direction, or in directions corresponding to the x direction and y direction.
[0108] In the first embodiment, in order to reduce the burden on the observer of wearing the eyepiece optical device, the image forming device, the transfer optical device, the first position detection device, and the second position detection device are arranged on the image display device side. That is, in the display device of the first embodiment, the image display device and the eyepiece optical device are arranged spatially separated, and the transfer optical device is controlled, so that the structure does not impose a burden on the observer, such as an increase in the mass or size of the eyepiece optical device, and the image can be reliably delivered to the observer's pupil without imposing a burden on the observer.
[0109] Next, the position control of the transfer optical device 30 will be described.
[0110] 14A, 14B, 14C, 15A, and 15B are schematic diagrams showing the behavior of the light beam emitted from the transfer optical device 30 and the positional relationship between the eyepiece optical device 40A and the pupil 71 of the observer 70. FIG. 14A shows a case where the positional relationship between the eyepiece optical device 40A and the pupil 71 of the observer 70 is normal. FIG. 14B shows a case where the amount of deviation of the pupil 71 of the observer 70 from the eyepiece optical device 40A becomes d0. FIG. 14C shows a state where the inclination of the transfer optical device 30 is controlled in the state shown in FIG. 14B, and the image emitted from the transfer optical device 30 is formed on the retina of the observer 70. In FIG. 14A and other figures, "O" indicates the rotation center of the transfer optical device 30, and the light beam emitted from the center of the image forming device 20 collides with the rotation center "O" of the transfer optical device 30. 14A, 14B, 14C, 15A and 15B, light rays emitted from the center of image forming device 20 are indicated by thin solid lines, and light rays corresponding to the outer edge of the image are indicated by thin dashed lines.
[0111] First, an ideal state will be described in which the eyepiece optical device 40A is sufficiently large with respect to the relative deviation between the center position of the eyepiece optical device 40A and the center position of the pupil 71 of the observer 70. In this case, the line L1 connecting the center of the eyepiece optical device 40A and the center of the pupil 71 of the observer 70 and the normal line L NLThe angle between these is θ1 (projection angle θ1), the light ray L2 emitted from the center of the image forming device 20 passes through the transfer optical device 30 and reaches the eyepiece optical device 40A, and the normal line L passing through the center of the eyepiece optical device 40A is NL When the angle between the two is θ2 and the focal length of the eyepiece optical device 40A is f0 (unit: mm), f0 |tan(θ2)-tan(θ1)|≦3.5 Preferably, f0·|tan(θ2)-tan(θ1)|≦1 More preferably, the transfer optical device / controller 31 controls the transfer optical device 30 so that θ1 = θ2 is satisfied. Specifically, the tilt of the transfer optical device 30 is controlled. For simplicity, the following description will be given based on an example in which the transfer optical device / controller 31 controls the transfer optical device 30 so that θ1 = θ2 is satisfied.
[0112] The angle θ2 can be determined from equation (1) as shown in FIG. 14C.
[0113] θ1=θ2=tan -1 (d0 / f0) (1)
[0114] Where: d0: Relative positional shift of the image (shift of the observer's pupil relative to the eyepiece optical device) It is.
[0115] On the other hand, when considering an actual display device, the size of the eyepiece optical device 40A is finite. Therefore, if the transfer optical device 30 is controlled to satisfy the formula (1), a state may occur in which the image emitted from the image forming device 20 does not reach the eyepiece optical device 40A, and the image does not reach the pupil 71 of the observer 70. For this reason, it is necessary to add a condition that the formula (1) is satisfied within the spatial range of the eyepiece optical device 40A. Here, two assumptions are made for the state in which the observer 70 cannot observe the image.
[0116] That is, the first premise is that a state in which a part of the image is not to be missing is not allowed. The condition in which the image observed by the observer 70 is not to be allowed to be missing is as shown in the following formula (2) as shown in FIG. 15A. Then, formula (2) is transformed to formula (3). The state shown in FIG. 15A shows a state in which the outer edge of the image output from the transfer optical device 30 has reached the outer edge of the eyepiece optical device 40A, and indicates that if the image output from the transfer optical device 30 moves any further upward in FIG. 15A, a state in which a part of the image is missing will occur.
[0117] |L0·tan(θ2)|≦(w0-i0) / 2 (2) |L0·(d0 / f0)| ≦(w0-i0) / 2 (3)
[0118] Where: L0...Projection distance w0: Size of the eyepiece optical system i0: Length of one side of the projected image (size) It is.
[0119] If it is within the range of formula (3), the transfer optical device 30 should be controlled to satisfy formula (1) (the ideal condition described above). If it is outside this range, it is necessary to control the transfer optical device 30 so that the light beam is projected inside the outer edge of the eyepiece optical device 40A. The above can be summarized as formulas (4-1) and (4-2).
[0120] When |L0·(d0 / f0)|≦(w0-i0) / 2 θ2=tan -1 (d0 / f0) (4-1) If |L0 (d0 / f0)|>(w0-i0) / 2 θ2=tan -1 {(w0-i0) / 2L0) (4-2)
[0121] The second premise is that it is acceptable for a part of the image to be missing. The condition for allowing the image observed by the observer 70 to be missing is given by the following formula (5). Transforming formula (5) gives formula (6). The state shown in FIG. 15B shows a state in which the inner edge of the image output from the transfer optical device 30 has reached the outer edge of the eyepiece optical device 40A, and indicates that if the image output from the transfer optical device 30 moves any further upward in FIG. 15A, the entire image will be missing.
[0122] |L0·tan(θ2)|≦(w0+i0) / 2 (5) |L0·(d0 / f0)| ≦(w0+i0) / 2 (6)
[0123] If it is outside this range, the transfer optical device 30 should be controlled so that at least a part of the light beam falls on the outer edge of the eyepiece optical device 40A. limit is the maximum possible value of θ2 (or the projection angle θ1). limit The possible range of is tan -1 {(w0-i0) / 2L0) < θ limit <tan -1 {(w0+i0) / 2L0) It is.
[0124] θ1≦θ limit in the case of θ2=tan -1 (d0 / f0) (7-1) θ1>θ limit in the case of θ2=θ limit (7-2)
[0125] The maximum value of θ2 (or projection angle θ1) depends on the extent to which image loss is tolerated. limit Also, the maximum value θ of θ2 (or projection angle θ1) can be determined depending on the content of the image. limitFor example, in the case of an image with a black background, it is preferable to set the length (size) i0 of one side of the projected image to a small value.
[0126] The contents shown in formulas (4-1), (4-2), (7-1), and (7-2) indicate that it is necessary to set a limit on θ2 (or projection angle θ1) before projection. Therefore, when the position of the pupil 71 of the observer 70 shifts and the value of the shift amount d0 increases, the observer 70 will eventually be unable to observe the image. The condition under which the image cannot be observed must take into account the size of the pupil of the observer 70, and therefore also varies depending on the environment (brightness, etc.). However, applying the present disclosure is equivalent to improving the robustness of the positional relationship in which the observer 70 can observe the image, and is very useful for observing images more easily. EXAMPLES
[0127] Example 2 is a modification of Example 1. In Example 1, the first position detection device 50 and the second position detection device 60 are separate components. On the other hand, in Example 2, the first position detection device also serves as the second position detection device. That is, the light source 51 constituting the first position detection device 50 is intensity-modulated at a high frequency, and the position detection light that collides with and is reflected by the eyepiece optical device 40A is received by the light receiving unit 54, and the distance to the eyepiece optical device 40A is obtained from the phase delay time of the pulse wave, etc. Specifically, the position detection light is modulated on the order of megahertz to gigahertz. Then, similarly to the first embodiment, the light (position detection light) emitted from the light source 51 reaches the eyepiece optical device 40A via the first optical path synthesis unit 52, the second optical path synthesis unit 53, and the transfer optical device 30, is returned to the transfer optical device 30 by the eyepiece optical device 40A, enters the first optical path synthesis unit 52 via the transfer optical device 30 and the second optical path synthesis unit 53, is emitted from the first optical path synthesis unit 52 in a direction different from that of the light source 51, and enters the light receiving unit 54. Then, the signal output from the light receiving unit 54 is divided into a high-frequency component equivalent to the modulation band (a band for detecting the distance to the eyepiece optical device) and a low-frequency component below kilohertz (a band for detecting the position of the eyepiece optical device), and signal processing is performed. That is, based on the high-frequency component output from the light receiving unit 54, the distance to the eyepiece optical device 40A is detected based on the TOF method or the indirect TOF method. Also, the position of the eyepiece optical device 40A is detected by low-pass filtered low-frequency components below kilohertz.
[0128] In this way, since the first position detection device also serves as the second position detection device, the position of the eyepiece optical device can be obtained without increasing the number of parts or the number of retroreflective elements. In some cases, the distance to the eyepiece optical device may be obtained based on the size (spot size) of the position detection light at the light receiving unit.
[0129] Except for the above points, the configuration and structure of the display device of the second embodiment can be similar to the configuration and structure of the display device described in the first embodiment, so a detailed description will be omitted. EXAMPLES
[0130] Example 3 is also a modification of Example 1. In Example 3, the second position detection device 60 is configured from a camera. The distance to the position display means 41 is measured from the size of the position display means 41 and the distance between the multiple position display means 41. The camera can also be used for coarse adjustment to identify the position of the eyepiece optical device 40B (the position of the observer 70) when the display device is first used. That is, when the display device is first used, the position of the eyepiece optical device 40B (the observer 70) is found by the camera, the transfer optical device 30 is roughly adjusted, and when the light receiving unit 54 starts to receive the position detection light, the transfer optical device 30 is finely adjusted by the first position detection device 50. EXAMPLES
[0131] Example 4 is a modified example of Examples 1 to 3. When superimposition of an image and a background is required, it is desirable that the image display device 10 is not positioned in front of the observer 70. If the image display device is always in the observer's field of view, there is a risk that the observer 70 will not be able to immerse himself in the image and the outside scene. As shown in the conceptual diagram of FIG. 16, in the display device of Example 4, the image display device and the like (not shown) are positioned at a position other than in front of the observer 70. As a result, the observer 70 can observe the image and the outside scene without the image display device and the like intruding into the observer's field of view. That is, the display device can be made semi-transmissive (see-through), and the outside scene can be viewed through the eyepiece optical device 40B. However, if the image display device (specifically, the transfer optical device) is positioned in a position other than directly in front of the observer 70, the projected light will be incident at an angle on the eyepiece optical device 40B, causing the focal position of the eyepiece optical device 40B to shift from the pupil 71 of the observer 70, and there is a risk that the image will not reach the pupil 71 of the observer 70.
[0132] In order to deal with such problems, the eyepiece optical device 40B is provided with a diffractive optical element. The diffractive optical element is composed of a diffracting means 42 having a diffracting function and a focusing means 43 having a focusing function. The diffracting means 42 may be composed of, for example, a transmission type volume hologram diffraction grating, and the focusing means 43 may be composed of, for example, a hologram element. Alternatively, the diffracting means 42 and the focusing means 43 may be composed of a single member. The order of arrangement of the diffracting means 42 and the focusing means 43 may be such that the focusing means 43 is arranged on the observer side, or the diffracting means 42 is arranged on the observer side. The image forming light emitted from the transfer optical device (movable mirror) is deflected by the diffracting means 42, the angle (direction) of travel is changed, and the light is incident on the focusing means 43, and is focused by the focusing means 43 to form an image on the retina of the observer 70. The wavelength selectivity of the focusing function is required to act only on the wavelength of the image forming light emitted from the image forming device. If the wavelength selectivity of the light-collecting function weakens and the eyepiece optical device 40B collects light with wavelengths other than those of the light emitted from the image forming device (for example, light of the outside scene), it becomes difficult for the observer 70 to observe the outside scene.
[0133] When lens members made of ordinary optical glass are used as an eyepiece optical device, there is no wavelength selectivity, and all visible light is focused and reaches the retina of the observer 70, so that the observer can only see the projected image and cannot see the outside scene.
[0134] An example of use of the display device of Example 4 is shown in Fig. 17A, which is a schematic diagram of the state in which the display device of Example 4 is used indoors. An image display device 10 is disposed on a wall surface 81 of a room 80. When an observer 70 stands at a predetermined position in the room 80, an image from the image display device 10 reaches the eyepiece optical device 40B, and the observer 70 can observe this image through the eyepiece optical device 40B.
[0135] Alternatively, another use example of the display device of the fourth embodiment is shown in FIG. 17B, which is a schematic diagram of a state in which the image display device 10 constituting the display device of the fourth embodiment is disposed on the back of the seat 82 and used. When an observer sits on the rear seat 82, an image is emitted from the image display device 10 disposed on the back of the seat 82 in the front toward the eyepiece optical device 40B worn by the observer, and the image reaches the eyepiece optical device 40B, and the observer 70 can observe the image through the eyepiece optical device 40B. More specifically, there are examples in which an image forming device for passengers is attached to the back of the seat back of a vehicle or an airplane, and examples in which an image forming device for audiences is attached to the back of the seat back of a theater or the like. The use examples of the display device described above can also be applied to other embodiments.
[0136] As shown in FIG. 18, an image display device may be attached to the handlebars of a motorcycle, and an eyepiece optical device 40B may be attached to a full-face helmet worn by a motorcycle rider. In FIG. 18, the image forming light and the position detection light are indicated by arrows. It is known that the handlebars of a motorcycle vibrate at a high frequency of 100 Hz or more in some cases. Therefore, if the first position detection device is configured from an imaging device with a few tens to a few hundreds of FPS, the first position detection device cannot detect the position information of the eyepiece optical device due to the vibration transmitted to the image display device, and it becomes impossible to completely remove small shaking from the image, which causes motion sickness. For example, by adopting a distance measurement device of the TOF method or the indirect TOF method as the second position detection device 60 and using the first position detection device 50 composed of a light receiving unit 54 equipped with a plurality of photodiodes 54A, 54B, 54C, and 54D, it becomes possible to handle the movement of the image display device on the order of 10 kHz to 100 kHz, which is further effective for incorporation into a moving object such as a motorcycle. Further application examples of the display device of Example 4 include an image display device incorporated in an automobile and an eyepiece optical device incorporated in the automobile windshield, and an eyepiece optical device incorporated in a protective face mask, etc. EXAMPLES
[0137] The fifth embodiment is a modification of the fourth embodiment. As shown in the conceptual diagram of FIG. 19A, in the display device of the fifth embodiment, the eyepiece optical device 40C and the image display device 10 are relatively movable (i.e., the image display device 10 is disposed away from the observer 70), and the eyepiece optical device 40C is disposed away from the observer 70. That is, the eyepiece optical device 40C is not attached to the observer 70. The eyepiece optical device 40C is a stationary type and is held by a holding member 44, or is built into the holding member 44 as one body. When carrying, the holding member 44 and the eyepiece optical device 40C are folded and stored, and when the display device is used, the eyepiece optical device 40C is assembled. The transfer optical device 30 and the eyepiece optical device 40C only need to be adjusted in position when assembled, and in principle, the positional relationship does not change during use. The image emitted from the image forming device 20 reaches the pupil 71 of the observer 70 via the eyepiece optical device 40C. A retinal projection type mini monitor can be given as an example of such a display device of the fifth embodiment. The eyepiece optical device 40C has the same configuration and structure as the eyepiece optical device 40B described in the fourth embodiment.
[0138] 19B, a stationary eyepiece optical device 40C is incorporated into a glass window 45 or an exhibition window in a museum, art gallery, observation deck, aquarium, etc. In this case, the positions of the transfer optical device 30 and the eyepiece optical device 40C do not change, and the image emitted from the image forming device 20 reaches the pupil 71 of the observer 70 via the eyepiece optical device 40C. Note that in Figures 19A and 19B, as in Figure 16, illustrations of an image display device and the like are omitted. EXAMPLES
[0139] The sixth embodiment is a modification of the first to fifth embodiments.
[0140] The above-mentioned formulas (4-1), (4-2), (7-1), and (7-2) express the position of the projected light in the eyepiece optical device. Here, when the value of the relative positional shift amount of the image (the shift amount of the observer's pupil with respect to the eyepiece optical device) d0 is constant, the value of θ2 (or the projection angle θ1) can be made smaller as the focal length f0 of the eyepiece optical device 40D is increased. In other words, the larger the focal length f0 of the eyepiece optical device 40D, the larger the shift amount d0 that can be handled. Therefore, the value of the controllable shift amount d0 can be increased without destroying the ideal conditions.
[0141] As shown in the conceptual diagram of the eyepiece optical device 40D in FIG. 20A and FIG. 20B, in the display device of the sixth embodiment, the eyepiece optical device 40D includes condensing members 46A and 46B to which the image from the transfer optical device 30 is incident, and deflecting members 47A and 47B to guide the light emitted from the condensing members 46A and 46B to the pupil 71 of the observer 70. The image from the transfer optical device 30 is changed in the condensing members 46A and 46B to the direction toward the deflecting members 47A and 47B. The condensing members 46A and 46B and the deflecting members 47A and 47B are attached to a support member 48, or are provided integrally with the support member 48, although this is not limited thereto. In this way, the condensing members 46A and 46B and the deflecting members 47A and 47B are combined to fold the optical path, thereby extending the focal length f0. As shown in Fig. 20A, the light collecting member 46A is made of a reflective hologram element, and the deflection member 47A is made of a reflective volume hologram diffraction grating, or as shown in Fig. 20B, the light collecting member 46B is made of a transmission hologram lens, and the deflection member 47B is made of a transmission volume hologram diffraction grating. However, the light collecting member and the deflection member are not limited to these. Also, the light from the light collecting member may be totally reflected one or more times within the support member and then incident on the deflection member. EXAMPLES
[0142] Example 7 is a modification of Examples 1 to 6. As shown in the conceptual diagram of FIG. 21, in the display device of Example 7, the eyepiece optical device 40E includes a diffraction grating 49B and further includes a condensing member 49A on the light incident side. The condensing member 49A may be provided between the diffraction grating 49B and the pupil 71 of the observer 70. This provides a structure equivalent to the presence of a plurality of focal points in the eyepiece optical device 40E. That is, even if the image output from the transfer optical device 30 described in Example 1 does not reach the pupil 71 of the observer 70 for various reasons, for example, the 1st order diffracted light, the −1st order diffracted light, etc. reach the pupil 71 of the observer 70 instead of the 0th order diffracted light of the diffraction grating 49B, thereby realizing a system with higher robustness for the observer 70. That is, a display device with higher robustness can be realized while reducing the burden on the observer 70. Furthermore, since a plurality of focal points can be prepared, the range in which the observer 70 can observe the image can be expanded even when the value of θ2 (or the projection angle θ1) is large.
[0143] Examples of configurations that can be used with diffraction grating 49B include splitting the image into three images horizontally, splitting the image into three images vertically, splitting the image crosswise into three images horizontally and three images vertically (one image including the central light path overlaps, so a total of five images are split), splitting the image into two images horizontally and two images vertically for 2 x 2 = 4, and splitting the image into three images horizontally and three images vertically for 3 x 3 = 9. EXAMPLES
[0144] Example 8 is a modification of Examples 1 to 7. In the display device of Example 8, position correction of an image formed in the image forming device 20 is performed based on position information of the eyepiece optical device 40F detected by the first position detection device 50 and position information of the pupil 71 of the viewer 70 detected by the second position detection device 60.
[0145] In the eighth embodiment, an image is formed in an area smaller than the entire image forming area in an image forming apparatus. For example, when the entire image forming area is 1×1, the area in which the image is formed is (p×q). However, 0 <p<1,0<q<1である。
[0146] As shown in the conceptual diagrams of Figures 22A, 22B, 22C, and 22D, the outer edge of an image formed based on the entire image forming area (1 x 1) is indicated by a two-dot chain line, the light from the center of the image formed based on the area (1 x 1) is indicated by a one-dot chain line, and the outer edge of an image formed based on the area (p x q) is indicated by a broken line. In the illustrated example, p = q = 0.5, and when the length (size) of one side of the image formed based on the entire image forming area (1 x 1) is i0, the length (size) of one side of the image formed based on the area (p x q) is i0 / 2.
[0147] Assume that the pupil 71 of the observer 70 moves from the state shown in FIG. 22A to the upper side of the drawing as shown in FIG. 22B. The image observed by the observer 70 in the state shown in FIG. 22A is shown typically by arrow "A", and the image observed by the observer 70 in the state shown in FIG. 22B is shown typically by arrow "B". The image observed by the observer 70 moves below the retina from the state indicated by arrow "A" to the state indicated by arrow "B". In this way, due to the change in the relative position between the eyepiece optical device 40F and the pupil 71 of the observer 70, a movement occurs in the image on the retina observed by the observer 70 as shown in FIG. 22A and FIG. 22B. In such a case, as shown in Fig. 22C and described in Examples 1 to 7, based on the position information of the eyepiece optical device detected by the first position detection device and the position information of the pupil 71 of the observer 70 detected by the second position detection device, the transfer optical device / control device controls the transfer optical device so that the image incident from the image forming device reaches the eyepiece optical device, that is, so that the image incident from the image forming device is formed on the retina of the observer 70 via the eyepiece optical device. The image observed by the observer 70 in the state shown in Fig. 22C is diagrammatically indicated by arrow "C", and the image observed by the observer 70 remains moved below the retina from the state of arrow "A" to the state of arrow "C".
[0148] Therefore, based on the position information of the eyepiece optical device 40F detected by the first position detection device 50 and the position information of the pupil 71 of the observer 70 detected by the second position detection device 60, the position of the image formed in the image forming device 20 is corrected. Specifically, as shown in FIG. 22D, the image forming device 20 moves the region (p×q) to an appropriate position so that the image on the retina does not move when the observer 70 observes the image formed based on the region (p×q), or so that the image on the retina moves as little as possible, and forms an image. For example, when an image is formed in the central region of the image forming device 20 (see FIG. 22A, FIG. 22B, and FIG. 22C), the image forming position in the image forming device 20 is corrected so that the image is formed in the upper region of the image forming device 20 (so that the image emitted from the transfer optical device is emitted from the lower part of the transfer optical device) as shown in FIG. The image observed by the observer 70 in the state shown in FIG. 22D is typically indicated by an arrow "D". That is, the image formation position in the image forming device 20 is shifted in a direction that cancels the relative positional shift between the eyepiece optical device 40F and the pupil 71 of the observer 70. This makes it possible to more reliably prevent the image on the retina observed by the observer 70 from moving as much as possible, and to fix the display position of the image relative to the observer's field of vision as much as possible.
[0149] Although the display device of the present disclosure has been described based on the preferred embodiments, the display device of the present disclosure is not limited to these embodiments. The configuration and structure of the display device, the image display device, the image forming device, the transfer optical device, or the eyepiece optical device can be changed as appropriate. For example, when the observer is in an inappropriate place from the display device, the display device may guide the observer to an appropriate place by voice or image / video. The display device may include multiple image forming devices. That is, the display device may include multiple image forming devices with different positions for emitting images, and may be configured to emit the same image from these multiple image forming devices and receive one of these multiple images with one eyepiece optical device. This allows the degree of freedom of the relative positional relationship between the image forming device and the observer to be increased. That is, for example, when the observer is positioned at a predetermined position, an image from the image forming device reaches the eyepiece optical device, and the observer can observe this image through the eyepiece optical device, and this predetermined position can be enlarged.
[0150] The present disclosure may also be configured as follows. [A01] Display device: First aspect An eyepiece optical device, an image display device including an image forming device and a transfer optical device that outputs an image incident from the image forming device to an eyepiece optical device; It is equipped with The eyepiece optical device and the image display device are arranged to be spatially separated from each other, The eyepiece optical device focuses the image from the transfer optical device onto the observer's retina, The image display device further comprises: Control unit, a first position detection device and a second position detection device for detecting the position of the eyepiece optical device; and Transfer optical device and control device, It is equipped with A display device in which, based on position information of the eyepiece optical device detected by the first position detection device, the transfer optical device / control device, under the control of the control unit, controls the transfer optical device so that the image incident from the image forming device reaches the eyepiece optical device, and based on position information of the eyepiece optical device detected by the second position detection device, the control unit corrects the detection position of the first position detection device. [A02] A display device described in [A01], in which a control unit controls the formation of an image in an image forming device based on position information of the eyepiece optical device detected by a first position detection device, or by a second position detection device, or by the first position detection device and the second position detection device. [A03] The first position detection device is light source, 1st optical path combining section, A second optical path synthesis unit, and light receiving section, It is equipped with The image incident from the image forming device is focused on the observer's retina via the second optical path synthesis section, the transfer optical device, and the eyepiece optical device, A display device described in [A01] or [A02], in which light emitted from a light source reaches an eyepiece optical device via a first optical path synthesis unit, a second optical path synthesis unit, and a transfer optical device, is returned to the transfer optical device by the eyepiece optical device, enters the first optical path synthesis unit via the transfer optical device and the second optical path synthesis unit, is emitted from the first optical path synthesis unit in a direction different from the light source, and enters a light receiving unit. [A04] An optical device described in [A03], in which when the incident position of light entering the light receiving section from the first optical path combining section deviates from a predetermined position, the transfer optical device / control device controls the position of the transfer optical device so as to eliminate the deviation. [A05] The display device according to [A03] or [A04], wherein the exit angle from the transfer optical device of light emitted from the center of the light source is different from the exit angle from the transfer optical device of light emitted from the center of the image forming device. [A06] The display device according to any one of [A03] to [A05], wherein the light source emits infrared rays in an eye-safe wavelength band. [A07] The display device according to any one of [A03] to [A06], wherein the light emitted from the light source and incident on the first optical path combining portion is diverging light. [A08] The display device according to any one of [A03] to [A07], wherein the light receiving section is disposed at a position closer to the first optical path combining section than a position optically conjugate with the light source. [A09] The display device according to any one of [A03] to [A08], wherein the light receiving section is composed of a position sensitive detector, a multi-segment photodiode, or a plurality of photodiodes. [A10] The display device according to any one of [A01] to [A09], wherein the first position detection device also serves as the second position detection device. [A11] A display device described in any one of [A01] to [A10], in which the transfer optical device controls the image projection onto the observer's retina in the horizontal and vertical directions of the image formed on the observer's retina by the transfer optical device / control device. [A12] The optical device according to any one of [A01] to [A11], wherein the transfer optical device is composed of a combination of two galvanometer mirrors. [A13] The optical device according to any one of [A01] to [A12], wherein a retroreflective element is attached to the eyepiece optical device. [A14] The display device according to any one of [A01] to [A13], wherein the eyepiece optical device is provided with a hologram element. [A15] The display device according to any one of [A01] to [A13], wherein the eyepiece optical device is provided with a diffractive optical element. [A16] The display device according to any one of [A01] to [A13], wherein the eyepiece optical device includes a focusing member and a deflection member. [A17] The display device according to any one of [A01] to [A16], wherein the eyepiece optical device and the image display device are relatively movable. [A18] The display device according to any one of [A01] to [A17], wherein the eyepiece optical device is worn by an observer. [A19] The display device according to any one of [A01] to [A17], wherein the eyepiece optical device is disposed at a distance from the viewer. [A20] The angle between the line connecting the center of the eyepiece optical device and the center of the observer's pupil and the normal line passing through the center of the eyepiece optical device is θ1, the angle between the light ray emitted from the center of the image forming device, passing through the transfer optical device, and the normal line passing through the center of the eyepiece optical device is θ2, and the focal length of the eyepiece optical device is f0 (unit: mm), f0 |tan(θ2)-tan(θ1)|≦3.5 The display device according to any one of [A01] to [A19], wherein the transfer optical device / control device controls the transfer optical device so as to satisfy the above. [B01] Display device: Second aspect An eyepiece optical device, an image display device including an image forming device and a transfer optical device that outputs an image incident from the image forming device to an eyepiece optical device; It is equipped with The eyepiece optical device and the image display device are arranged to be spatially separated from each other, The eyepiece optical device focuses the image from the transfer optical device onto the observer's retina, The image display device further comprises: Control unit, a first position detection device and a second position detection device for detecting the position of the eyepiece optical device; and Transfer optical device and control device, It is equipped with Based on position information of the eyepiece optical device detected by the first position detection device, the transfer optical device / control device, under the control of the control unit, controls the transfer optical device so that the image incident from the image forming device reaches the eyepiece optical device, and based on position information of the eyepiece optical device detected by the first position detection device, or by the second position detection device, or by the first position detection device and the second position detection device, the control unit controls the formation of an image in the image forming device. [B02] The display device according to [B01], wherein the first position detection device also serves as the second position detection device. [B03] The first position detection device is light source, 1st optical path combining section, A second optical path synthesis unit, and light receiving section, It is equipped with The image incident from the image forming device is focused on the observer's retina via the second optical path synthesis section, the transfer optical device, and the eyepiece optical device, A display device described in [B01] or [B02], in which light emitted from a light source passes through a first optical path synthesis unit, a second optical path synthesis unit, and a transfer optical device to reach an eyepiece optical device, is returned to the transfer optical device by the eyepiece optical device, passes through the transfer optical device and the second optical path synthesis unit to enter the first optical path synthesis unit, is emitted from the first optical path synthesis unit in a direction different from the light source, and enters the light receiving unit. [B04] An optical device according to [B03], in which when the incident position of light entering the light receiving section from the first optical path combining section deviates from a predetermined position, the transfer optical device / control device controls the position of the transfer optical device so as to eliminate the deviation. [B05] The display device according to [B03] or [B04], wherein the exit angle from the transfer optical device of light emitted from the center of the light source is different from the exit angle from the transfer optical device of light emitted from the center of the image forming device. [B06] The display device according to any one of [B03] to [B05], wherein the light source emits infrared rays in an eye-safe wavelength band. [B07] The display device according to any one of [B03] to [B06], wherein the light emitted from the light source and incident on the first optical path combining portion is diverging light. [B08] The display device according to any one of [B03] to [B07], wherein the light receiving section is disposed at a position closer to the first optical path combining section than a position optically conjugate with the light source. [B09] The display device according to any one of [B03] to [B08], wherein the light receiving section is composed of a position sensitive detector, a multi-segment photodiode, or a plurality of photodiodes. [B10] A display device described in any one of [B01] to [B09], in which the transfer optical device controls the image projection onto the observer's retina in the horizontal and vertical directions of the image formed on the observer's retina by the transfer optical device / control device. [B11] The optical device according to any one of [B01] to [B10], wherein the transfer optical device is composed of a combination of two galvanometer mirrors. [B12] The optical device according to any one of [B01] to [B11], wherein a retroreflective element is attached to the eyepiece optical device. [B13] The display device according to any one of [B01] to [B12], wherein the eyepiece optical device is provided with a hologram element. [B14] The display device according to any one of [B01] to [B12], wherein the eyepiece optical device is provided with a diffractive optical element. [B15] The display device according to any one of [B01] to [B12], wherein the eyepiece optical device includes a focusing member and a deflection member. [B16] The display device according to any one of [B01] to [B15], wherein the eyepiece optical device and the image display device are movable relative to each other. [B17] The display device according to any one of [B01] to [B16], wherein the eyepiece optical device is worn by an observer. [B18] The display device according to any one of [B01] to [B16], wherein the eyepiece optical device is disposed at a location away from the viewer. [B19] Let θ1 be the angle between a straight line connecting the center of the eyepiece optical device and the center of the observer's pupil and a normal line passing through the center of the eyepiece optical device, θ2 be the angle between a light ray emitted from the center of the image forming device and the normal line passing through the center of the eyepiece optical device when the light ray reaches the eyepiece optical device via the transfer optical device, and f0 (unit: mm) be the focal length of the eyepiece optical device. f0 |tan(θ2)-tan(θ1)|≦3.5 The display device according to any one of [B01] to [B18], wherein the transfer optical device / control device controls the transfer optical device so as to satisfy the above. [C01] Display device: Third aspect An eyepiece optical device, an image display device including an image forming device and a transfer optical device that outputs an image incident from the image forming device to an eyepiece optical device; It is equipped with The eyepiece optical device and the image display device are arranged to be spatially separated from each other, The eyepiece optical device focuses the image from the transfer optical device onto the observer's retina, The image display device further includes a first position detection device that detects a position of the eyepiece optical device; The first position detection device is light source, 1st optical path combining section, A second optical path synthesis unit, and light receiving section, It is equipped with The image incident from the image forming device is focused on the observer's retina via the second optical path synthesis section, the transfer optical device, and the eyepiece optical device, A display device in which light emitted from a light source reaches an eyepiece optical device via a first optical path synthesis unit, a second optical path synthesis unit, and a transfer optical device, is returned to the transfer optical device by the eyepiece optical device, enters the first optical path synthesis unit via the transfer optical device and the second optical path synthesis unit, is emitted from the first optical path synthesis unit in a direction different from the light source, and enters a light receiving unit. [C02] The display device according to [C01], wherein an exit angle from the transfer optical device of light emitted from the center of the light source is different from an exit angle from the transfer optical device of light emitted from the center of the image forming device. [C03] The display device according to [C01] or [C02], wherein the light source emits infrared rays in an eye-safe wavelength band. [C04] The display device according to any one of [C01] to [C03], wherein the light emitted from the light source and incident on the first optical path combining portion is diverging light. [C05] The display device according to any one of [C01] to [C04], wherein the light receiving section is disposed at a position closer to the first optical path combining section than a position optically conjugate with the light source. [C06] The display device according to any one of [C01] to [C05], wherein the light receiving section is composed of a position sensitive detector, a multi-segment photodiode, or a plurality of photodiodes. [C07] An optical device according to any one of [C01] to [C06], wherein the transfer optical device is composed of a combination of two galvanometer mirrors. [C08] An optical device according to any one of [C01] to [C07], in which a retroreflective element is attached to the eyepiece optical device. [C09] The display device according to any one of [C01] to [C08], wherein the eyepiece optical device is provided with a hologram element. [C10] The display device according to any one of [C01] to [C11], wherein the eyepiece optical device is provided with a diffractive optical element. [C11] The display device according to any one of [C01] to [C10], wherein the eyepiece optical device includes a focusing member and a deflection member. [C12] The display device according to any one of [C01] to [C11], wherein the eyepiece optical device and the image display device are relatively movable. [C13] The display device according to any one of [C01] to [C12], wherein the eyepiece optical device is worn by an observer. [C14] The display device according to any one of [C01] to [C12], wherein the eyepiece optical device is disposed at a distance from the viewer. [C15] The angle between the line connecting the center of the eyepiece optical device and the center of the observer's pupil and the normal line passing through the center of the eyepiece optical device is θ1, the angle between the light ray emitted from the center of the image forming device and the normal line passing through the center of the eyepiece optical device when the light ray reaches the eyepiece optical device via the transfer optical device is θ2, and the focal length of the eyepiece optical device is f0 (unit: mm), f0 |tan(θ2)-tan(θ1)|≦3.5 The display device according to any one of [C01] to [C14], wherein the transfer optical device / control device controls the transfer optical device so as to satisfy the above. [Explanation of symbols]
[0151] 10 image display device, 11 control unit, 20, 20a, 20b, 20c image forming device, 21a light source, 21b polarizing beam splitter, 21c liquid crystal display device (LCD), 21d optical system, 22a organic EL display device, 22b convex lens, 23a light source, 23b collimating optical system, 23c total reflection mirror, 23d scanning means, 23e relay optical system, 24 housing, 30 transferred light optical device, 31...transfer optical device / control device, 40A, 40B, 40C, 40D, 40E, 40F...eyepiece optical device, 41...position indication means (retroreflective marker), 42...diffraction means, 43...light-collecting means, 44...holding member, 45...glass window, 46, 46A, 46B...light-collecting member, 47, 47A, 47B...deflection member, 48...support member, 49A...light-collecting member, 49B...diffraction grating, 50...first position detection device, 51... Light source, 52...first optical path combining section, 53...second optical path combining section, 54...light receiving section, 55...coupling lens, 56...lens member, 60...second position detection device, 70...observer, 71...eyes, 80...room, 81...wall surface, 82...seat, 140...frame, 140'...nose pad section, 141...front section, 142...hinge, 143...temple section, 144...telescope temple section
Claims
1. An eyepiece optical device, an image display device including an image forming device and a transfer optical device that outputs an image incident from the image forming device to an eyepiece optical device; It is equipped with The eyepiece optical device and the image display device are arranged to be spatially separated from each other, The eyepiece optical device focuses the image from the transfer optical device onto the observer's retina, The image display device further comprises: Control unit, a first position detection device and a second position detection device for detecting the position of the eyepiece optical device; and Transfer optical device and control device, It is equipped with A display device in which, based on position information of the eyepiece optical device detected by a first position detection device, the transfer optical device / control device, under the control of the control unit, controls the transfer optical device so that the image incident from the image forming device reaches the eyepiece optical device, and based on position information of the eyepiece optical device detected by a second position detection device, the control unit corrects the detection position of the first position detection device.
2. The display device described in claim 1, wherein the control unit controls the formation of an image in the image forming device based on position information of the eyepiece optical device detected by the first position detection device, or by the second position detection device, or by the first position detection device and the second position detection device.
3. The first position detection device is light source, first optical path combining section; A second optical path combining unit, and light receiving section, It is equipped with The image incident from the image forming device is focused on the observer's retina via the second optical path synthesis unit, the transfer optical device, and the eyepiece optical device, A display device as described in claim 1, wherein light emitted from a light source passes through a first optical path synthesis section, a second optical path synthesis section, and a transfer optical device to reach an eyepiece optical device, is returned to the transfer optical device by the eyepiece optical device, passes through the transfer optical device and the second optical path synthesis section to enter the first optical path synthesis section, is emitted from the first optical path synthesis section in a direction different from the light source, and enters the light receiving section.
4. The optical device described in claim 3, wherein if the incident position of light entering the light receiving section from the first optical path combining section deviates from a predetermined position, the transfer optical device / control device controls the position of the transfer optical device so as to eliminate the deviation.
5. 4. The display device according to claim 3, wherein an exit angle from the transfer optical device of light emitted from the center of the light source is different from an exit angle from the transfer optical device of light emitted from the center of the image forming device.
6. The display device according to claim 3 , wherein the light source emits infrared light in an eye-safe wavelength range.
7. 4. The display device according to claim 3, wherein the light emitted from the light source and incident on the first optical path combining portion is divergent light.
8. The display device according to claim 3 , wherein the light receiving section is disposed at a position closer to the first optical path combining section than a position optically conjugate with the light source.
9. 4. The display device according to claim 3, wherein the light receiving section is composed of a position sensitive detector, a multi-segment photodiode, or a plurality of photodiodes.
10. 2. The display device according to claim 1, wherein the first position detection device also serves as the second position detection device.
11. 2. The display device according to claim 1, wherein the transfer optical device and control device controls the projection of an image onto the observer's retina along the horizontal and vertical directions of the image formed on the observer's retina.
12. 2. The optical device according to claim 1, wherein the transfer optical device is composed of a combination of two galvanometer mirrors.
13. 2. The optical device of claim 1, wherein the eyepiece optical device is fitted with a retroreflective element.
14. 2. The display device of claim 1, wherein the eyepiece optical device comprises a diffractive optical element.
15. 2. The display device according to claim 1, wherein the eyepiece optical device comprises a focusing member and a deflecting member.
16. 2. The display device according to claim 1, wherein the eyepiece optical device and the image display device are movable relative to each other.
17. 2. The display device of claim 1, wherein the eyepiece optical device is worn by an observer.
18. 2. The display device of claim 1, wherein the eyepiece optics are positioned away from the observer.
Citation Information
Patent Citations
Image display apparatus
JP2005309264A
Image display apparatus
JP2010134051A
Virtual display system and method
US20020060649A1
Image display device and display device
WO2019130988A1
Display device
WO2019181482A1
