Optical device, retinal projection display device, head mounted display device

Abstract

The present invention relates to an optical device, a retinal projection display device, a head mounted display device and an optometry device, and its purpose is to accurately detect the pupil position. To this end, the present invention provides an optical device, which has a light source portion for emitting light; a converging reflection element for converging the light from the light source portion and reflecting it onto an illuminated surface having a curvature; and a position detection element for detecting the position of the reflected light from the illuminated surface.

Description

[0001] This application is a divisional application of the invention patent application with application date of March 6, 2020, application number 202010150228.4, and invention name “Optical device, retinal projection display device, head-mounted display device”. Technical Field

[0002] The invention relates to an optical device, a retinal projection display device, a head mounted display device and an optometry device. Background Art

[0003] With the continuous development of pupil position (line of sight) detection technology, it is expected to be applied to various purposes such as interfaces for electronic device control, image formation support for wearable displays such as head-mounted displays, line of sight data collection for skilled technicians, and product attention analysis. For this reason, pupil position detection devices are required to have detection response performance and be miniaturized and lightweight.

[0004] In response to such requirements, existing technologies, such as Patent Document 1 (US2016 / 0166146) and Patent Document 2 (US2017 / 0276934), disclose technologies for high-speed detection of pupil position by a non-imaging method without using a camera system, by detecting the temporal changes in the intensity of reflected light from a laser that is scanned at high speed on the surface of the eyeball.

[0005] However, in the techniques of Patent Documents 1 and 2, the diameter of the laser beam on the light receiving surface of the photodetector increases due to reflection from the eyeball or cornea having a large curvature, and the pupil position may not be accurately detected. Summary of the invention

[0006] An object of the present invention is to accurately detect the pupil position.

[0007] In order to solve the above-mentioned problems, the present invention provides an optical device, an optical device comprising: a light source portion for emitting light; a converging and reflecting element for converging the light from the light source portion and reflecting it onto an irradiated surface having a curvature; and a position detection element for detecting the position of the reflected light from the irradiated surface.

[0008] The present invention has the effect of being able to accurately detect the pupil position. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 This is a schematic diagram showing an example configuration of the pupil position detection device according to the first embodiment.

[0010] Figure 2Schematic diagram of the relationship between the rotation of the eyeball and the laser incident position of the PSD, wherein (a) is a schematic diagram of the state when the eyeball is not rotating, and (b) is a schematic diagram of the state when the eyeball is rotating.

[0011] Figure 3 The figures illustrate the conditions that an off-axis optical system needs to satisfy. (a) is a schematic diagram of the distance between components, and (b) is a schematic diagram of the geometric distance relationship represented by a coaxial optical system.

[0012] Figure 4 This is a schematic diagram showing an example of the relationship between the effective area diameter of the concave mirror and the laser beam radius on the PSD light-receiving surface.

[0013] Figure 5 This is a block diagram showing an example of the hardware configuration of the processing unit according to the first embodiment.

[0014] Figure 6 This is a functional block diagram showing an example of the processing unit according to the first embodiment.

[0015] Figure 7 This is a flowchart showing an example of processing of the pupil position detection device according to the first embodiment.

[0016] Figure 8 The following is a schematic diagram of the main structure of the pupil position detection device according to the first variant. (a) is a schematic diagram of the cross configuration of the optical path from the VCSEL to the concave mirror and the optical path from the eyeball to the PSD, and (b) is a schematic diagram of the non-cross configuration of the optical path from the VCSEL to the concave mirror and the optical path from the eyeball to the PSD.

[0017] Fig. 9 This is a schematic diagram showing a main structure of a pupil position detection device according to a second modification.

[0018] Fig.10 This is a schematic diagram showing a main structure of a pupil position detection device according to a third modification.

[0019] Fig.11A 1 is a schematic diagram showing a main structure of a pupil position detection device according to a 4A variant, wherein (a) is a top view of the main part and (b) is a view of a portion B in (a) as viewed from the left.

[0020] Fig. 11B This is a schematic diagram of the main structure of an example of a pupil position detection device involved in the 4B variant, wherein (a) is a top view, (b) is a view of part B in (a) seen from the eyeball side, and (c) is a view of part B in (a) seen from the opposite side to the eyeball.

[0021] Fig.12This is a schematic diagram of the main structure of an example of a pupil position detection device involved in the fifth modification.

[0022] Fig.13 It is a schematic diagram of the main structure of an example of a pupil position detection device involved in the sixth variant, wherein (a) is a diagram of a concave mirror viewed from the direction facing the concave surface, and (b) is an AA' cross-sectional diagram of (a).

[0023] Fig.14 The present invention is a schematic diagram of the main structure of a pupil position detection device according to the seventh variant, wherein (a) is a top view of the main part and (b) is a view of part C of (a) as viewed from the eyeball side.

[0024] Fig.15 This is a schematic diagram of an example of a non-coaxial concave mirror.

[0025] Fig.16 is a schematic diagram of an example of a non-diffracted light beam.

[0026] Fig.17 The diagram is a schematic diagram of an example of an off-axis optical system using HOE, wherein (a) is a schematic diagram of HOE generating a single beam of converging laser light, and (b) is a schematic diagram of HOE generating multiple beams of converging laser light.

[0027] Fig.18A It is a schematic diagram of a converging reflective element having a liquid crystal reflective light-condensing structure.

[0028] Fig.18B It is a schematic diagram of the orientation state of liquid crystal molecules in a liquid crystal reflective focusing structure.

[0029] Fig. 18C It is a schematic diagram of the polarization state of the incident light and the outgoing light of the liquid crystal reflective focusing structure.

[0030] Fig.18D It is a schematic diagram of a light-guiding component coupling optical system using a liquid crystal reflective focusing structure.

[0031] Fig.19 This is a schematic diagram showing an example of the configuration of a retinal projection display device according to the second embodiment. DETAILED DESCRIPTION

[0032] Hereinafter, the mode for carrying out the present invention will be described with reference to the drawings. In each of the drawings, the same components are given the same reference numerals and repeated descriptions are omitted.

[0033] In the embodiments, the optical device is described by taking the pupil position detection device of the eyeball as an example, and further, the pupil position detection device is described by taking the example of mounting the pupil position detection device on a glasses-type support body.

[0034] In each embodiment, the right eye of a "person" is used as an example for description, but the same is true for the left eye. Two optical devices or retinal projection display devices can also be provided respectively, suitable for binocular eyeballs.

[0035] [First embodiment]

[0036] <Construction of Pupil Position Detection Device According to First Embodiment>

[0037] Figure 1 This is a schematic diagram for explaining an example of the configuration of a pupil position detection device according to the present embodiment.

[0038] like Figure 1 As shown, the pupil position detection device 10 includes a VCSEL (Vertical Cells Surface Emitting Laser) 1 as an example of a light source unit, a concave mirror 2 , a PSD (Position Sensitive Detector) 3 , and a processing unit 100 .

[0039] The VCSEL 1, the concave mirror 2, and the PSD 3 are arranged on the optical system support 4, and the optical system support 4 is tiltably fixed to the eyeglass frame 22 of the eyeglass type support 20 including the eyeglass lens 21 and the eyeglass frame 22 through the ball joint 4a. The inclination of the optical system support 4 can be adjusted by the ball joint 4a. As the ball joint 4a constituting the fine adjustment mechanism, in addition to the method of fixing by mechanical pressure acting between the ball structure and its shell structure, it can also be fixed by magnetic force acting between the ball structure under the magnetic force and the metal opening structure.

[0040] The glasses-type support body 20 can be mounted on a person's head. After the glasses-type support body 20 is mounted, the optical system including the VCSEL 1, the concave mirror 2 and the PSD 3 is in a state close to the eyeball 30 (in front of the eye).

[0041] As an example of a "light source unit", VCSEL1 has a plurality of light-emitting units arranged two-dimensionally in a plane. Each light-emitting unit emits a laser with directivity and a limited diffusion angle. Here, the emitted laser is an example of "light". "Multiple light-emitting units" are synonymous with "multiple light-emitting points" or "multiple light-emitting elements".

[0042] The light source unit is not limited to VCSEL as long as it can emit light. A plurality of LDs (semiconductor lasers, Laser Diode) and LEDs (light emitting diodes, Light Emitting Diode) that emit laser light may be arranged two-dimensionally in a plane to form the light source unit. Furthermore, a pulse laser that emits pulsed laser light may also be used. In addition, a combination of multiple light sources may also be used to form the light source unit.

[0043] In order not to hinder the recognition of the "person" whose pupil position is detected, it is preferred that the wavelength of the laser light emitted by the VCSEL 1 is a near-infrared wavelength that is not visible light. However, this is not limited to this, and visible light may also be used.

[0044] The laser light L0 emitted from the VCSEL 1 propagates to the space in front of the concave mirror 2 in a direction roughly parallel to the face of the person wearing the eyeglass-type support body 20 or the mirror surface of the installed eyeglass lens 21. The laser light L0 is a divergent light that is propagated by expanding the beam diameter through diffraction of the opening of the emission part of the VCSEL 1. The divergence angle of the divergent light can be controlled by the opening shape of the emission part. The laser light L0 propagates while diverging and enters the concave mirror 2.

[0045] The concave mirror 2 is an example of a converging reflective element, and its reflecting surface has a curvature, which reflects the incident laser light L0 and irradiates the eyeball 30 with a converging laser light (also referred to as converging light) L1. The converging laser light L1 is incident near the pupil 31 of the eyeball 30. The center of the concave curvature of the concave mirror 2 is located at a position away from the optical axis of the optical path from the VCSEL 1 to the concave mirror 2, and the optical system including the VCSEL 1, the concave mirror 2 and the PSD 3 constitutes a so-called off-axis optical system.

[0046] In the off-axis optical system according to the present embodiment, light before reaching the eyeball 30 is folded back at least once without being reflected or scattered by the eyeball 30 , propagates through the space in front of the eyeball 30 adjacent to the eyeball 30 , and reaches the eyeball 30 .

[0047] The incident angle of the focused laser L1 into the eye 30 is adjusted to enter the center of the pupil 31 of the eye 30 at a predetermined angle when looking straight ahead. The VCSEL 1 can emit laser light from multiple light emitting parts, and the laser light emitted from the multiple light emitting parts can irradiate the eye 30 at multiple positions or at multiple angles.

[0048] In addition to having multiple light-emitting parts as described above, VCSEL1 also has the feature of being able to be modulated at high speed. By temporally modulating the laser irradiating the eyeball, a component having a modulation period suitable for the incident laser is extracted from the output signal obtained from the PSD, and the influence of light from the external environment that does not change with the modulation can be removed. As a result, the SN ratio can be improved, which is beneficial for pupil position detection in bright environments, and the amount of laser light irradiating the pupil can also be reduced.

[0049] The pupil surface (corneal surface) of the eyeball 30 is an example of an irradiated surface, which is a transparent body containing water and generally has a reflectivity of 2 to 4%. The convergent laser light L1 incident near the pupil 31 of the eyeball 30 is reflected on the surface of the pupil 31 of the eyeball 30 (also referred to as reflected light), and the reflected light propagates toward the PSD3. Hereinafter, for the sake of simplicity of description, the surface of the eyeball 30 is referred to as the eyeball 30, the surface of the pupil 31 is referred to as the pupil 31, and the surface of the cornea 32 is referred to as the cornea 32.

[0050] Here, the curvature of the reflecting surface of the concave mirror 2 is set to offset the divergence of the reflected laser light caused by the curvature of the eyeball 30 or the cornea 32. In this way, the beam diameter of the laser light L2 propagating toward the PSD 3 will not spread on the light receiving surface of the PSD element.

[0051] Here, a concave mirror is used as an example of a converging reflective element, but as long as it can converge (focus) light, it is not limited to this. A combination of a convex mirror and a plane mirror, or a hologram wavefront control element, a diffraction optical element, etc. can also be used.

[0052] If a deformed aspheric surface having different curvatures in two directions orthogonal to each other in a plane intersecting the optical axis of the converged laser L1 is used as the concave surface of the concave mirror, the beam diameter of the laser L2 can be further reduced and the beam can be shaped into an isotropic state.

[0053] Furthermore, the irradiated surface is not limited to the eyeball 30, and any three-dimensional object having a curvature is applicable to the present embodiment.

[0054] PSD3 is an example of a "light receiving position detection element", which is a two-dimensional light position detection element. It detects the current value corresponding to the distance from the incident light to the electrode in two orthogonal directions within the light receiving surface, and calculates the detection signal indicating the position of the incident light based on the ratio of the current values ​​in the two orthogonal directions and outputs it. PSD3 can output a detection signal indicating the position of the light spot formed on the light receiving surface of PSD3.

[0055] More specifically, PSD3 has four output terminals, a resistor film is arranged on a continuous light-receiving surface (a light-receiving surface without pixel division), and electrode pairs are arranged in two orthogonal directions. The photocurrent generated at the beam spot position is divided into four according to the distance between each output terminal. At this time, the electrical impedance caused by the resistor film takes effect, so that the longer the distance between the beam spot position and the output terminal, the smaller the current. PSD3 can detect the electrical signal passing through the resistor film through the four terminals, and output a detection signal indicating the position within the light-receiving surface obtained by electrical post-processing.

[0056] PSD3 can convert the current generated by photoelectric conversion into an analog voltage signal and output it from four terminals as a detection signal. In other words, PSD3 can detect the incident position by calculating the distance to each terminal using surface resistance.

[0057] However, when an image sensor (camera element) is used as a position detection element instead of PSD3, the output result of the image sensor will change with the incident light intensity of each pixel. If the intensity is low, the output current will decrease. Although it is necessary to increase the output power of the light source to increase the incident light intensity of the image sensor in order to reduce the influence of noise light such as sunlight, in the case of using a device that allows the light emitted by the light source to irradiate the eyeball 30, increasing the incident light intensity is not suitable for eyeball safety.

[0058] When an image sensor is used, image processing is required for position detection, and position accuracy errors may occur during the processing, and the processing load may also increase.

[0059] Using PSD3 as a position detection element, the position is detected using the current division ratio (proportion) divided between the output terminals. Therefore, the position of the incident light can be detected without relying on the intensity of the incident light, and image processing is not required. From this point of view, PSD3 is preferred.

[0060] The configuration of PSD3 described above is only an example, and other configurations are also possible. In the above, a two-dimensional PSD for detecting a two-dimensional position in the light-receiving surface is used as an example of PSD3, but a linear PSD for detecting a linear position in the light-receiving surface may also be used.

[0061] The processing unit 100 outputs a control signal to drive the VCSEL 1 to emit light. The processing unit 100 inputs a detection signal of the PSD 3 and performs processing to detect the position of the pupil 31 of the eyeball 30 as described below. The processing unit 100 can be provided at a location such as the eyeglass frame 22.

[0062] Since the position of the beam spot formed by the laser L2 on the light receiving surface of the PSD3 changes due to the inclination of the eyeball 30, the processing unit 100 can detect the pupil position of the eyeball 30 by converting the detection signal of the PSD3 into coordinate information.

[0063] PSD3 can detect the position of the reflection point and the direction of the normal vector on the eyeball 30, and the pupil position detection device 10 can "infer" the pupil position based on the correspondence between the detected reflection point position and normal vector and the eyeball surface shape model.

[0064] Figure 1 Although an example in which the optical system and the processing unit are provided on the eyeglass frame 22 is shown, the present invention is not limited to this, and a head-mounted display, a skull-type holding structure, etc. may also be used.

[0065] <Eye Movement Tracking Operation of Pupil Position Detection Device According to First Embodiment>

[0066] Next, the tracking operation of the pupil position detection device 10 for the eye movement will be described.

[0067] Since the eyeball 30 may rotate, the direction of the laser light L2 may change, so that the laser light L2 may deviate from the light receiving surface of the PSD 3. In this regard, the pupil position detection device 10 can prevent the laser light L2 from leaving the light receiving surface of the PSD 3 by controlling the light emitting part of the VCSEL 1 to emit light sequentially or selectively.

[0068] Figure 2 It is a schematic diagram used to illustrate the relationship between the rotation of the eyeball 30 and the incident position of the laser L2 in PSD3, wherein (a) is a state where the eyeball is not rotating (when looking straight ahead), and (b) is a state where the eyeball is rotating.

[0069] Figure 2 The figure shows the propagation of laser light emitted from two light emitting parts of the VCSEL 1. The laser light 11 emitted from one of the light emitting parts is indicated by a solid line, and the laser light 12 emitted from the other light emitting part is indicated by a dotted line.

[0070] exist Figure 2 In (a), laser light 11 reflected by eyeball 30 enters near the center of the light receiving surface of PSD 3. Therefore, PSD 3 can detect the position of laser light 11 on the light receiving surface, and pupil position detection device 10 can detect the position of pupil 31 based on the detection signal of PSD 3.

[0071] On the other hand, if the laser light 12 reflected by the eyeball 30 does not enter the light receiving surface of the PSD 3 , the PSD 3 cannot detect the position of the laser light 12 on the light receiving surface, and the pupil position detection device 10 cannot detect the position of the pupil 31 .

[0072] When the eyeball 30 undergoes a large rotation, such as Figure 2 As shown in (b), the laser light 11 reflected by the eyeball 30 does not enter the light receiving surface of the PSD 3. Therefore, the PSD 3 cannot detect the position of the laser light 11 on the light receiving surface, and the pupil position detection device 10 cannot detect the position of the pupil 31.

[0073] The laser 12 reflected by the eyeball 30 enters near the center of the light receiving surface of PSD3. Therefore, PSD3 can detect the position of the laser 12 on the light receiving surface. The pupil position detection device 10 can detect the position of the pupil 31 based on the detection signal of PSD3.

[0074] In this way, the pupil position of the eyeball 30 can only be detected within a limited angle range using light emitted from only one light-emitting unit, but by changing the light-emitting unit of the VCSEL 1, the laser light emitted from a certain light-emitting unit can always be incident on the light-receiving surface of the PSD 3. Therefore, even if the eyeball 30 moves, the state where the laser light reflected by the eyeball 30 does not enter the light-receiving surface of the PSD 3 can be reduced, thereby expanding the range in which the pupil position can be detected.

[0075] In other words, by detecting the fine movement of the eyeball 30 through PSD3 and detecting the coarse movement of the eyeball 30 through the arrangement of multiple light-emitting parts of VCSEL1, it is possible to achieve both high detection resolution and large detection range in the detection of the rotation angle of the eyeball 30.

[0076] The change of the light emitting portion of the VCSEL 1 can be performed in time series according to the driving signal from the processing unit 100 in accordance with (tracking) the eyeball movement of the eyeball 30. By controlling the light emitting portion according to the rotational movement of the eyeball 30, light utilization efficiency can be improved and estimation time can be shortened.

[0077] However, it is not necessary to change the light emitting portion of VCSEL 1 according to the rotational movement of the eyeball. The pupil position detection device 10 may also, for example, make the light emitting portion of VCSEL 1 perform raster scanning (successive light emission) at a predetermined time interval independent of the eyeball movement, and obtain the coarse movement position of the eyeball 30 based on the detection signal of PSD3 at this time.

[0078] exist Figure 2 In order to simplify the description, only lasers emitted from two light-emitting parts are illustrated, but more light-emitting parts of VCSEL 1 can be used according to the rotation of eyeball 30. In this case, in order to accurately detect the position of pupil 31, the number and position of the light-emitting parts of VCSEL 1 are optimized according to the size of the light-receiving surface of PSD 3 and the size of eyeball 30.

[0079] <Off-axis optical system conditions>

[0080] The following describes the conditions that the off-axis optical system including VCSEL 1, concave mirror 2, and PSD 3 needs to meet.

[0081] In this embodiment, the diameter of the effective area of ​​the concave mirror 2 (the area that can reflect the laser, the effective diameter) is determined by the conditions that the laser emitted from VCSEL1 enters the light receiving surface of PSD3 and the conditions that the convergent laser L1 is transformed into parallel light after being reflected by the cornea 32.

[0082] Figure 3 The diagrams are used to illustrate the conditions that an off-axis optical system must meet. (a) is used to illustrate the distance between components, and (b) is used to illustrate the geometric distance relationship represented by a coaxial optical system.

[0083] like Figure 3 As shown in (a), let the distance from VCSEL1 to concave mirror 2 be d0, the distance from concave mirror 2 to cornea 32 be d1, and the distance from cornea 32 to PSD3 be d2. In view of the curvature and effective area of ​​concave mirror 2, for the sake of simplicity, the optical system is set to be a coaxial optical system in which VCSEL1, concave mirror 2, and PSD3 are coaxially arranged.

[0084] Figure 3 (b) shows the situation where the divergent laser from VCSEL 1 is incident on the concave mirror 2, the laser reflected by the concave mirror 2 is converged and incident on the cornea 32, and then the laser reflected by the cornea 32 is incident on the PSD 3. Position 41 indicates the position of the light emitting part of VCSEL 1, position 42 indicates the surface position of the cornea 32, and position 43 indicates the mirror surface position of the concave mirror 2.

[0085] The radius of the beam h psd The calculation can be performed using the following equation (1) derived by ray tracing using the ABCD matrix.

[0086]

[0087] In formula (1), r c is the radius of curvature of the cornea 32, h PSD is the laser beam radius of the light-receiving surface of PSD3, D m is the diameter of the effective area of ​​concave mirror 2, λ is the wavelength of VCSEL1, h UL is the upper limit of the beam radius of the laser light on the light receiving surface of PSD 3 determined by the designer. The second term in the middle of equation (1) is superimposed with the diffusion effect of the laser light caused by the diffraction of the laser light after being reflected by the concave mirror 2.

[0088] Based on equation (1), the diameter D of the effective area of ​​the concave mirror 2 can be determined by equation (2): m .

[0089]

[0090] Here, Figure 4 The diameter D of the effective area of ​​the concave mirror 2 obtained based on equation (2) is: m and the laser beam radius h on the light receiving surface of PSD3 psd A schematic diagram of the relationship between .

[0091] exist Figure 4 In the relationship shown, the laser beam radius h of the light receiving surface of PSD3 is PSD The upper limit h ULis 200um, the distance d1 from the concave mirror 2 to the cornea 32 is 24mm, and the curvature radius r of the cornea 32 is c The diameter of the lens is 8 mm, and the wavelength of the laser is 940 nm. These values ​​are assumed for the spectacle-type support body 20, and any values ​​may be set according to the application and the use environment.

[0092] exist Figure 4 If the diameter D of the effective area of ​​concave mirror 2 is m becomes smaller, the beam radius h of the light receiving surface of PSD3 due to diffraction PSD Rapidly expand. As the effective area diameter D of the concave mirror 2 m The beam radius h of the PSD3 light receiving surface increases. PSD Gradually expands, with the beam radius h PSD As the laser beam expands, the PSD3's resolution in detecting the laser position decreases.

[0093] like Figure 4 As shown, the diameter D of the effective area of ​​the concave mirror 2 m There is a suitable range that can make the beam radius h of the PSD3 light receiving surface PSD Minimize. The shaded area is the appropriate range, and the diameter D of the effective area of ​​the concave mirror 2 that satisfies equation (2) is m Using formula (2), the diameter D of the effective area of ​​the concave mirror 2 can be m Set to 0.225mm≤D m ≤2.574mm. This condition can be met to make the beam radius h on the light receiving surface of PSD3 PSD It is less than 200μm, so that PSD3 can obtain appropriate laser position detection resolution.

[0094] Under the condition that the laser is incident on the eyeball 30 at an incident angle of 60°, if d0=24√3 (mm) is set, the full angle of the laser emitted from the VCSEL 1 needs to be a divergence angle of about 7.1° or less, which can be achieved by controlling the opening of the VCSEL 1.

[0095] <Configuration of Processing Unit of Pupil Position Detection Device According to First Embodiment>

[0096] Next, the hardware configuration of the processing unit 100 according to the present embodiment will be described. Figure 5 FIG. 1 is a block diagram showing an example of a hardware configuration of the processing unit 100 .

[0097] The processing unit 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, a light source driving circuit 105, an A / D (Analog / Digital) conversion circuit 106, and an input / output I / F (Interface) 107. These components are connected to each other via a system bus 108.

[0098] CPU 101 reads programs and data from storage devices such as ROM 102 and SSD 104 to RAM 103, executes processing, and realizes overall control of processing unit 100 and the functions described later. In addition, some or all of the functions of CPU 101 can also be realized by hardware such as ASIC (Application Specific Integrated Circuit) or FPGA (Field-Programmable Gate Array).

[0099] ROM 102 is a non-volatile semiconductor memory (storage device) that can hold programs and data when the power is off. ROM 102 stores programs and data such as BIOS (Basic Input / Output System) and OS settings that are executed when the processing unit 100 is activated. RAM 103 is a volatile semiconductor memory (storage device) that can temporarily store programs and data.

[0100] The SSD 104 is a non-volatile memory that stores programs and various information for executing the processing of the processing unit 100. The SSD may also be a hard disk (Hard Disk Drive).

[0101] The light source driving circuit 105 is a circuit electrically connected to the VCSEL1 and outputs a driving signal such as a driving voltage to the VCSEL1 according to an input control signal. The light source driving circuit 105 can drive multiple light-emitting parts of the VCSEL1 to emit light simultaneously or sequentially. By modulating the cycle of the driving voltage, the light emission can be driven in different light emission cycles.

[0102] As the driving voltage, a rectangular wave or a sine wave, or a voltage waveform with a predetermined waveform shape can be used. The light source driving circuit 105 can change the cycle (frequency) of the voltage waveform to modulate the cycle of the driving voltage signal.

[0103] The A / D conversion circuit 106 is electrically connected to the PSD3 and is a circuit that converts the output analog voltage signal of the output PSD3 into a digital voltage signal after A / D conversion.

[0104] The input / output I / F 107 is an interface for connecting to external devices such as a PC (Personal Computer) and a video device.

[0105] Next, the functional configuration of the processing unit 100 according to the present embodiment will be described. Figure 6 FIG. 1 is a functional block diagram of the processing unit 100. Figure 6 As shown, the processing unit 100 includes a light emitting driving unit 110 , a detection signal input unit 111 , a calculation unit 120 , and a pupil position output unit 130 .

[0106] The light-emitting driving unit 110 outputs a driving signal with a period T1 to the VCSEL1, driving the light-emitting unit of the VCSEL1 to emit light with a period T1. The light-emitting driving unit 110 can be implemented by the light source driving circuit 105 or the like.

[0107] The detection signal input unit 111 is realized by the A / D conversion circuit 106 and the like, and outputs a digital voltage signal obtained by A / D conversion of an analog voltage signal input from the PSD 3 to the eyeball rotation angle estimation unit 121 included in the calculation unit 120 .

[0108] The calculation unit 120 includes an eyeball rotation angle estimation unit 121 and a pupil position acquisition unit 122 , and executes a calculation process for acquiring the pupil position of the eyeball 30 based on the input signal from the detection signal input unit 111 .

[0109] The eyeball rotation angle estimation unit 121 estimates the rotation angle of the eyeball 30 based on the input signal from the detection signal input unit 111, and outputs the estimated rotation angle data to the pupil position acquisition unit 122. The pupil position acquisition unit 122 performs processing to acquire the position of the pupil 31 based on the estimated rotation angle of the eyeball 30. The acquired position data of the pupil 31 is output to an external device or the like via the pupil position output unit 130 implemented by the input / output I / F 107 or the like.

[0110] <Processing of Pupil Position Detection Device According to First Embodiment>

[0111] Next, the processing of the pupil position detection device according to this embodiment will be described.

[0112] Here, first, the preparation for pupil position detection in pupil position detection device 10 is described, and the incident angle of laser light irradiated from VCSEL 1 to eyeball 30 and the calculation formula for the rotation angle of eyeball 30 are determined in advance.

[0113] The calculation formula for the rotation angle of the eyeball 30 is a calculation formula of a linear function or a quadratic function. However, this is not limited to this, and the calculation formula is not limited to the form as long as it can calculate the rotation angle based on the incident angle of the laser and the position on the light receiving surface of the PSD3. As a simple approximate formula, the present embodiment adopts a calculation formula of a quadratic function.

[0114] When determining the angle at which the laser beam enters the eyeball 30, a surface shape model of the eyeball 30 can be used. For example, as a general eyeball surface shape model, a schematic model eye widely used in the past (for example, see "Optical Mechanism of the Eye", Precision Mechanics 27-11, 1961) can be used.

[0115] On the other hand, the incident angle of the laser beam to the eyeball 30 is determined in advance by ray tracing calculations, etc., so that the incident position of the laser beam into the PSD3 becomes the center of the light receiving surface.

[0116] The laser incident position on the light receiving surface of PSD3 can be theoretically analyzed based on the incident angle of the laser to the eyeball 30, the laser reflection position on the eyeball 30, and the slope of the cut surface of the eyeball 30. Then, based on the solution of the theoretical analysis, the inverse formula (approximate formula) for estimating the rotation angle of the eyeball 30 is determined using polynomial approximation.

[0117] The inverse calculation formula for estimating the laser incident angle of the eyeball 30 and the rotation angle of the eyeball 30 is stored in the memory such as ROM102 and SSD104 of the processing unit 100, and is used when the light driving unit 110 changes the light emitting unit and the calculation unit 120 performs pupil position acquisition processing.

[0118] Next, Figure 7 This is a flowchart of an example of processing performed by the pupil position detection device according to this embodiment.

[0119] First, in step S71 , the light-emission driving unit 110 drives the VCSEL 1 to emit light using a light-emission period T1 .

[0120] Next, in step S72 , the detection signal input unit 111 inputs the detection signal of PSD3 and outputs it to the eyeball rotation angle estimation unit 121 provided with the calculation unit 120 .

[0121] Next, in step S73 , the eyeball rotation angle estimation unit 121 substitutes the input signal from the detection signal input unit 111 into the inverse calculation formula for estimating the rotation angle to obtain the eyeball rotation angle, and then outputs the obtained eyeball rotation angle data to the pupil position acquisition unit 122 .

[0122] Next, in step S74 , the pupil position acquisition unit 122 acquires pupil position data using the surface shape model of the eyeball based on the input eyeball rotation angle data, and outputs the pupil position data to an external device via the pupil position output unit 130 .

[0123] In this way, the processing unit 100 can obtain the position of the pupil 31 of the eyeball 30 based on the detection signal output by the PSD3, and output the obtained position data to an external device.

[0124] <Effects, etc.>

[0125] As pupil position (line of sight) detection technology continues to develop, it is expected to be used in a variety of applications, such as interfaces for electronic device control using line of sight, image formation support for portable image display devices such as head-mounted displays or near-eye displays, line of sight data collection for skilled technicians in factories, and product attention analysis (recording). In particular, pupil position detection devices that function as interfaces between electronic devices and humans are required to be real-time and small and lightweight.

[0126] The existing technology obtains the reflected image of the eyeball under the lighting environment and detects the pupil position through the image processing unit based on pattern matching. Therefore, the image processing load is large and a trade-off needs to be made between real-time performance and pupil position detection resolution. Furthermore, it is also necessary to equip the device with a camera, a processor, a driving power supply, etc., so it is difficult to achieve a small and light device.

[0127] In addition, the prior art discloses a technique for quickly detecting the pupil position by detecting the time change of the reflection intensity of the laser light scanned at high speed on the surface of the eyeball without using a camera system. However, this technique may not be able to accurately detect the pupil position because the diameter of the laser beam on the light receiving surface of the photodetector increases due to the reflection of the eyeball and cornea with large curvature.

[0128] In this regard, this embodiment configures an off-axis optical system in front of the eye, which includes a VCSEL1 that emits light, a concave mirror 2 that converts the light into convergent light and reflects the convergent light to an irradiated surface with a curvature, and a PSD3 that receives reflected light of the convergent light reflected by the above-mentioned irradiated surface and detects the position of the reflected light.

[0129] Specifically, before the light reaches the eyeball 30, it propagates through the space in front of the eyeball 30 adjacent to the eyeball 30 at least once without being reflected or scattered by the eyeball 30, and then reaches the eyeball 30. The concave mirror 2 irradiates the eyeball 30 with a focused laser.

[0130] In this way, the curvature of the eyeball 30 or the cornea 32 can be offset by the curvature of the converging laser, so that the laser reflected by the eyeball 30 and the cornea 32 will not diffuse.

[0131] By determining the effective area diameter (opening) D of the concave mirror 2 that satisfies the condition of equation (2): m , the diameter D of the effective area of ​​the concave mirror 2 can be increased m , with a large opening to converge the laser beam and reduce the beam diameter on the light-receiving surface of PSD3.

[0132] In this way, by miniaturizing the laser beam diameter on the light receiving surface of PSD3, the position detection resolution of PSD3 and the detection accuracy of the pupil position can be ensured, thereby accurately detecting the pupil position.

[0133] The pupil position detection device of this embodiment can be modified in various ways, and the following describes the modification examples.

[0134] (First Modification)

[0135] Figure 8 Schematic diagrams for explaining an example of the main structure of the pupil position detection device according to the first variant. (a) is a schematic diagram of a configuration in which the laser light path from VCSEL 1 to concave mirror 2 and the light path from eyeball 30 to PSD3 are intersecting, and (b) is a schematic diagram of a configuration in which the laser light path from VCSEL 1 to concave mirror 2 and the light path from eyeball 30 to PSD3 are not intersecting.

[0136] Figure 8 The off-axis optical system of (a) includes a laser light path 81 from VCSEL1 to the concave mirror 2 (the light path represented by the dotted line), a light path 82 from the concave mirror 2 to the eyeball 30 or the cornea 32 (the light path represented by a one-dot locked line), and a light path 83 from the cornea 32 to the PSD3 (the light path represented by a two-dot locked line).

[0137] When the eyeball 30 is in the normal viewing state, the optical paths 81, 82 and 83 are in the same plane, and the optical path 81 intersects with the optical path 83. However, depending on the position of the light emitting part of the VCSEL 1, sometimes the same plane is deviated, but this case is also included in "the same plane".

[0138] exist Figure 8 In (a), VCSEL1 is arranged perpendicularly to optical path 81, and PSD3 is arranged perpendicularly to optical path 83. In this way, the length of each optical path can be extended, and the laser beam spot on the light receiving surface of PSD3 can be prevented from becoming elliptical, thereby reducing the beam diameter and improving the position detection resolution of PSD3.

[0139] on the other hand, Figure 8The off-axis optical system of (b) includes a laser optical path 84 from VCSEL1 to concave mirror 2 (optical path represented by a dotted line), an optical path 85 from concave mirror 2 to eyeball 30 or cornea 32 (optical path represented by a dotted line), and an optical path 86 from cornea 32 to PSD3 (optical path represented by a two-dot locked line). Optical paths 84, 85, and 86 are in the same plane as Figure 8 (a) The same.

[0140] The optical path 84 is parallel to the tangent plane of the eyeball 30 with a slope of 0 in the normal view state, that is, the reference illuminated surface 90. Here, the reference illuminated surface 90 is an example of a "reference plane". In this way, the emission surface of the VCSEL 1 can be orthogonal to the reference illumination surface 90, and the light receiving surface of the PSD 3 and the emission surface of the VCSEL 1 can be arranged in the same plane. Accordingly, the VCSEL 1 and the PSD 3 can be arranged on the same base plate, which is convenient for the installation of the two.

[0141] (Second example)

[0142] Fig. 9 This is a schematic diagram for explaining an example of the configuration of main parts of a pupil position detection device according to the second modification.

[0143] exist Fig. 9 In the figure, the off-axis optical system includes a laser optical path 91 (optical path shown by a dotted line) from VCSEL1 to concave mirror 2, an optical path 92 (optical path shown by a dotted line) from concave mirror 2 to eyeball 30 or cornea 32, and an optical path 93 (optical path shown by a two-point locked line) from cornea 32 to PSD3. Optical path 91 and optical path 93 intersect, which can extend the optical path length.

[0144] The VCSEL 1 is arranged tilted with respect to the normal viewing direction of the eyeball 30 indicated by the arrow 80 so that the laser light emitted perpendicularly to the emission surface is incident on the vicinity of the center of the concave mirror 2 .

[0145] The VCSEL 1 and PSD 3 are mounted on a FFC (flexible flat cable) 52 fixed to an element support 50. By mounting the VCSEL 1 and PSD 3 on the same FFC 52, power supply lines and signal lines can be efficiently arranged. Here, the FFC 52 is an example of an "electrical board".

[0146] In addition, a driving unit such as a battery 53 and a circuit group 55 for driving the VCSEL 1 and the PSD 3 is fixed on an FPC (flexible substrate) 51. The FPC 51 is fixed on the surface of the element support 50 on the opposite side to the packaging surface of the VCSEL 1 and the PSD 3. By wiring the FFC 52 on the FPC 51 via the connector 54, the space of the driving unit can be saved.

[0147] Here, the circuit group includes an IV conversion circuit using a reverse impedance amplifier (TIA) or the like, an AD conversion circuit, a pupil position estimation circuit, an arithmetic operation circuit, an FPGA circuit, a wireless transmission circuit, and the like.

[0148] By arranging PSD3 in a direction parallel to the normal viewing direction of the eyeball 30, it is easy to install. However, PSD3 can also be arranged so that the light receiving surface is orthogonal to the optical path 93. This can prevent the laser spot on the light receiving surface of PSD3 from becoming elliptical, reduce the beam diameter, and improve the position detection resolution of PSD3.

[0149] (Third Modification)

[0150] Fig.10 This is a schematic diagram for explaining an example of the configuration of main parts of a pupil position detection device according to a third modification.

[0151] exist Fig.10 In FIG. 1 , the off-axis optical system includes a laser optical path 94 (optical path indicated by a dotted line) from VCSEL 1 to concave mirror 2, an optical path 95 (optical path indicated by a dotted line) from concave mirror 2 to eyeball 30 or cornea 32, and an optical path 96 (optical path indicated by a two-dot locked line) from cornea 32 to PSD3. Optical path 94 and optical path 96 intersect to extend the optical path length.

[0152] The second modification shows an example in which the VCSEL 1 is tilted relative to the normal viewing direction of the eyeball 30 so that the laser light emitted perpendicularly to the emission surface is incident on the vicinity of the center of the concave mirror 2. In this modification, a triangular prism 56 is provided between the VCSEL 1 and the concave mirror 2 to deflect the laser light emitted from the VCSEL 1 so that the laser light emitted perpendicularly to the emission surface is incident on the vicinity of the center of the concave mirror 2. The triangular prism 56 is an example of a "deflection element". However, the deflection element is not limited to the triangular prism 56, and may also be a diffraction grating.

[0153] In addition, the second variant gives an example of mounting VCSEL1 and PSD3 on FFC52. In this variant, since VCSEL1 and PSD3 can be arranged in the same plane, VCSEL1 and PSD3 are mounted on FPC57 fixed on the element support body 50. This facilitates power supply and peripheral circuit installation. Fig.10 In the embodiment, FPC 57 is fixed on one side surface of the element support body 50, and FPC 51 on which a battery 53 and a circuit group 55 are mounted is fixed on the surface of the element support body 50 opposite to the surface on which FPC 57 is fixed. FPC 51 and FPC 57 are electrically connected via FFC 52. FPC 51 and 57 are examples of "electrical circuit boards".

[0154] (Variation 4A, Variation 4B)

[0155] Fig.11A This is a schematic diagram for explaining an example of the main part structure of the pupil position detection device involved in the 4A variant. Among them, (a) is a top view of the main part seen from above (positive Y direction), and (b) is a view of part B (the part surrounded by a dotted line) in (a) seen from the eyeball side (positive X direction).

[0156] In this modification, a package 59, a battery 53, and a circuit group 55 are mounted on a circuit board 58 fixed to the eyeglass frame 22. The package 59 has a cover glass 59a and a support frame 59b, and houses and seals the VCSEL 1 and PSD 3 packages.

[0157] By housing VCSEL1 and PSD3 in one package 59, VCSEL1 and PSD3 can be placed close to each other. In addition, by packaging package 59, battery 53, and circuit group 55 on one circuit board 58, a module consisting of package 59, battery 53, and circuit group 55 can be miniaturized.

[0158] Furthermore, a wireless transmission circuit may be included in the circuit group 55 to wirelessly connect the module to an external terminal such as a smartphone or a tablet computer. In this way, the detection signal of the PSD3 can be wirelessly transmitted to the external terminal to operate the external terminal or collect pupil position data.

[0159] exist Fig.11A In order to achieve Figure 6 As shown in the functional structure, the circuit group 55 includes a light-emitting drive circuit, a detection signal amplification and extraction circuit, a pupil position calculation circuit, a wireless transmission circuit, etc. In addition, various functions that can be integrated are installed, such as an interface circuit with external hardware, a storage circuit that stores data in memory, a sensor circuit such as an acceleration sensor that locates the azimuth of the illuminated surface, and a feedback circuit that controls the operation of the light-emitting drive circuit. Fig.11A The Y direction in is an example of the “long side direction of the eyeglass-shaped support body.” As an example of the “long side direction of the eyeglass-shaped support body,” it may be the direction connecting the ear and the bridge of the nose when a person wears the eyeglass support body.

[0160] Fig. 11B This is another example of the main part structure of the pupil position detection device involved in the 4B variant. (a) is a top view of the main part seen from above (positive Y direction), (b) is a view of part B (the part surrounded by a dotted line) in (a) seen from the eyeball side (positive X direction) and the negative X direction, and (c) is a view of part B in (a) seen from the opposite side of the eyeball (negative X direction).

[0161] In this modified example, the circuit board 58 is fixed inside the eyeglass frame 22, and a package 59 for accommodating VCSEL1 and PSD3 is provided on the surface of the circuit board 58 on the eyeball side, and a battery 53 and a circuit group 55 are provided on the side opposite to the eyeball. In other words, the circuit board 58 has a double-sided circuit board structure. The package 59 has a cover glass 59a and a support frame 59b, and the VCSEL1 and PSD3 packages are accommodated and encapsulated inside. Furthermore, a cover structure 58 formed of a resin material of the same color as the eyeglass frame 22 is provided on the opening on the outside. Here, Fig. 11B The X direction in FIG. 1 is an example of the “thickness direction of the eyeglass-type support body”. As an example of the “thickness direction of the eyeglass-type support body”, it can also be a direction perpendicular to the frontal direction connecting the ear and the bridge of the nose when a person wears the eyeglass-type support body.

[0162] exist Fig. 11B In the description of FIG. 2 , an example is given in which the circuit board and the package 59, the circuit group 55, and the battery 53 are completely embedded in the eye frame 22, but they may also be partially embedded. In addition, the circuit group 55 may not be configured so that the package 59 is completely arranged on the back.

[0163] Thus, the above configuration eliminates the protrusion of the package 59 or the recess of the circuit board installation portion, thereby reducing the installation space of the pupil position detection device. In addition, since the double-sided circuit board configuration is adopted, it is expected that the installation space of the pupil position detection device will be reduced.

[0164] (Fifth Modification)

[0165] Fig.12 This is a schematic diagram (part 5) for explaining an example of the main structure of the pupil position detection device involved in the fifth modification.

[0166] The pupil position detection device according to this modification has a plane mirror 2a that reflects the laser light emitted from the VCSEL 1 to the concave mirror 2. The off-axis optical system includes laser light paths 97a and 97b (light paths indicated by dotted lines) from the VCSEL 1 to the concave mirror 2, a light path 98 (light path indicated by a dotted line) from the concave mirror 2 to the eyeball 30 or the cornea 32, and a light path 99 (light path indicated by a two-dot line) from the cornea 32 to the PSD3. The laser light emitted from the VCSEL 1 travels back and forth in the space in front of the eye and enters the eyeball 30.

[0167] By setting a plane mirror 2a, the optical path length from VCSEL1 to the concave mirror 2 can be extended. Extending the optical path length has the following advantages. First, the diameter of the laser beam reaching the converging reflective element can be enlarged. By controlling the wavefront of the laser while the beam diameter is enlarged, the design freedom of the optical system and optical elements using aspherical shapes or non-isotropic shapes (isotropic aspherical surfaces, etc.) is improved. Second, the distance between the converging reflective element provided in the last part of the return optical system and the eyeball on the irradiated surface can be shortened. In other words, even when the angle of the laser incident on the converging reflective element is small, the optical path length reaching the converging reflective element can be adjusted to obtain a small beam diameter on the irradiated surface and the PSD light-receiving surface. Third, the change in the spot position on the PSD light-receiving surface that depends on the eyeball curve angle can be controlled by the optical path length. By designing the optical path length to a strategy range suitable for the size of the PSD light-receiving surface and the eyeball curve angle, a pupil position detection device with the required viewing angle and angular resolution can be realized.

[0168] In addition, the plane mirror 2a and the concave mirror 2 may be arranged oppositely. A second concave mirror may also be provided to replace the plane mirror 2a. Figure 3 As described in , in order to convert the laser light reflected by the eyeball 30 or the cornea 32 into parallel light, it is preferred to appropriately adjust the curvature radius of the concave mirror 2, the plane mirror 2a, and the configuration of the concave mirror 2.

[0169] (Sixth Modification)

[0170] The pupil position detection device according to the sixth modification includes an adjustment mechanism 131 for adjusting the position of the concave mirror 2 and an inclination adjustment mechanism 132 for adjusting the inclination.

[0171] Fig.13 It is a schematic diagram for illustrating an example of the main structure of the pupil position detection device involved in this modified example, wherein (a) is a view of the concave mirror 2 as viewed from the direction facing the concave surface of the concave mirror 2, and (b) is an AA' cross-sectional view of (a).

[0172] Position adjustment mechanism 131 Fig.13 As shown in (a), there are push screws 131a, 131b and 131c, and a frame 131d. The push screws 131a to 131c respectively support three points of the side surface of the concave mirror 2 to form a three-point support mechanism. By making the push screws 131a to 131c move forward and backward independently, the position in the YZ plane and the inclination in the YZ plane can be changed.

[0173] The slope adjustment mechanism 132 is as follows: Fig.13As shown in (b), it has a base plate 132a, a spring 132b, and a push screw 132c. The base plate 132a is a plate-shaped member with the YZ plane as the plane portion, and a protrusion 133 is formed at the center of the plane portion. The negative X-direction front end of the protrusion 133 contacts the surface on the positive X-direction side included in the frame portion 131d of the position adjustment mechanism 131.

[0174] Springs 132b are provided at two locations in the Y direction of the substrate 132a to apply negative X-direction forces to the concave mirror 2. The substrate 132a and the frame 131d are connected via the springs 132b.

[0175] The pressing screw 132c is provided at a position in the Y direction. The pressing screw 132c moves forward and backward in the negative X direction, pushes the concave mirror 2 through the frame 131d, and tilts the concave mirror 2 away from the YZ plane by using the lever principle with the front end of the protrusion 133 as a fulcrum.

[0176] In order to make a more detailed adjustment of the inclination of the concave mirror 2 in the direction away from the YZ plane, it is preferred that the two locations where the spring 132b is provided are located as far away from each other as possible in the Y direction. Similarly, it is preferred that the location where the push screw 132c is provided is located close to the end of the substrate 132a in the Y direction. Although the mechanism in which the push screw 132c is provided at a location in the Y direction so that the concave mirror 2 is tilted around the Z axis is described herein, it is also possible to provide a push screw at one location in the Z direction so that the concave mirror 2 is tilted around the Y axis.

[0177] In this modification, the position and inclination of the laser beam emitted from the concave mirror 2 to the eyeball 30 or the cornea 32 can be adjusted by using the position adjustment mechanism 131 and the inclination adjustment mechanism 132 .

[0178] Fig.13 Although the adjustment mechanism for the position and inclination of the concave mirror 2 is shown, even when an optical element such as a diffraction element is provided instead of the concave mirror 2, the position and inclination of the optical element can be adjusted by the same adjustment mechanism.

[0179] (Seventh Modification)

[0180] Fig.14 This is a schematic diagram for explaining an example of the main part structure of the pupil position detection device involved in the seventh variant. Among them, (a) is a top view of the main part seen from above (positive Y direction), and (b) is a view of part C (the part surrounded by a dotted line) in (a) seen from the eyeball side (positive X direction).

[0181] like Fig.14As shown, the pupil position detection device according to this modification includes a light guide member 150 disposed between the VCSEL 1 and the concave mirror 2 in front of the eyes of a person wearing the spectacle-shaped support body 20. The light guide member 150 can guide the laser light emitted from the VCSEL 1 to the concave mirror 2 by internal propagation.

[0182] The light guide component 150 is, for example, a transparent cylindrical component. Light emitted from the VCSEL 1 enters the interior of the light guide component 150 from the end surface of the light guide component 150 in the negative X direction, passes through the interior, and enters the reflective curved surface 150a formed on the end surface of the light guide component 150 in the positive X direction. The reflective curved surface 150a is a surface that functions as a concave mirror, which can reflect the incident laser light and condense the laser light toward the eyeball 30.

[0183] The "transparency" of the light guide component 150 means that it is transparent to visible light and light emitted by the VCSEL 1. Since it is transparent to visible light, the person wearing the eyeglass-type support body 20 can see the front without being blocked by the light guide component 150. Since it is transparent to the light emitted by the VCSEL 1, the loss caused by light absorption in internal propagation can be reduced. The light guide component 150 is not limited to a cylindrical component, and can have any cross-sectional shape as long as it is a columnar component.

[0184] like Fig.14 As shown, the light guide member 150 is supported by a light guide member support 151. The light guide member support 151 is fixed to a circuit board support 58a, which is used to support a circuit board 58 on which the VCSEL 1 and the PSD 3 are mounted. Therefore, the VCSEL 1, the concave mirror 2, and the PSD 3 are supported as an L-shaped structure in a fixed positional relationship.

[0185] The light guide component support 151 and the circuit board support 58a can rotate in the outer circumferential direction of the cylindrical shape and can move forward and backward in the optical axis direction. Therefore, it is possible to adjust the position where the laser reflected by the reflective curved surface 150a at the end of the light guide component 150 enters the eyeball 30 or the cornea 32.

[0186] The light guide member support 151 is provided with an opening so that the positions of the VCSEL 1 and the PSD 3 mounted on the circuit board 58 will not change as the position of the light guide member support 151 is adjusted.

[0187] The pupil position detection device according to this modification example is configured so that the optical elements such as the VCSEL 1 , the light guide member 150 , and the PSD 3 can be integrated into one body, so that the pupil position detection device can be miniaturized.

[0188] (Eighth Modification)

[0189] The pupil position detection device according to the eighth variation has a non-coaxial concave mirror 2 b for the concave mirror 2 .

[0190] Fig.15 2b is a schematic diagram for explaining an example of the structure of a non-coaxial concave mirror 2b. The non-coaxial concave mirror 2b includes a Fig.15 The two curved surfaces have an axially symmetrical shape about the central axis D represented by a dotted line, and the centers of curvature of the two curved surfaces are located at different symmetrical positions with the central axis D as the center.

[0191] More specifically, if Fig.15 As shown, the non-coaxial concave mirror 2b includes a curved surface 2b1 and a curved surface 2b2 at positions symmetrical around the central axis D, and the center of curvature 2b21 of the curved surface 2b1 and the center of curvature 2b22 of the curved surface 2b2 are respectively located at positions deviated from the central axis D in a direction intersecting the central axis D. The curved surface 2b1 and the curved surface 2b2 can be either spherical or aspherical.

[0192] By optimizing the shapes of the curved surfaces 2b1 and 2b2 of the non-coaxial concave mirror 2b, the laser reflected by the eyeball 30 or the cornea 32 can be converted into a non-diffracted beam and propagated to the PSD 3. The non-diffracted beam is, for example, a Bessel beam having a concentric circular beam profile.

[0193] Fig.16 The divergent laser light emitted from the VCSEL 1 is converted into a convergent laser light by the non-coaxial concave mirror 2 b and enters the eyeball 30 or the cornea 32 .

[0194] Fig.16 In the non-coaxial concave mirror 2b, the laser light L3 represented by the solid line and the laser light L4 represented by the dotted line are propagated as two parallel laser light beams with slightly different angles after being reflected by the eyeball 30 or the cornea 32 when observed in a two-dimensional plane (in the actual three-dimensional space, the projection components on the optical axis are equal in size and have light rays with the same size of wave number vectors directed inward in the same radial direction).

[0195] This laser Fig.16 In the area shaded by diagonal lines, the beam profile becomes a Bessel function shape as a result of interference caused by the light wave vector components relative to the optical axis. The beam can propagate over a long distance along the optical axis without changing its diameter.

[0196] By making the laser light L5 (the part with oblique lines) incident on the light receiving surface of the PSD 3 a non-diffracted light beam, the mounting position of the PSD 3 can be made more secure. The area where the non-diffracted light beam is formed may also be the position before the laser light is reflected on the eyeball 30. In this case, the robustness of the position of the spectacle-type support body 20 can be improved.

[0197] (9th Modification)

[0198] The pupil position detection device according to this modification example includes HOEs (Holographic Optical Devices) 2c and 2d, which are used to replace the concave mirror 2. Here, the HOEs 2c and 2d are both examples of "diffraction-type reflective elements".

[0199] Fig.17 Schematic diagrams for explaining an example of an off-axis optical system using HOE, wherein (a) shows a case where HOE2c generates a single beam of converging laser light, and (b) shows a case where HOE2d generates multiple beams of converging laser light. Here, HOE2c and HOE2d are both examples of "converging reflective elements" and examples of "diffraction-type reflective elements".

[0200] HOE can reflect the light incident vertically on the surface in an oblique direction. Fig.17 As shown in (a), the HOE2c can be configured so that the plane portion 2cs of the HOE2c is opposite to the emission surface 1s of the VCSEL1 while irradiating the eyeball 30 with laser light. This facilitates position correspondence during installation. In addition, since the HOE2c can be made thin, the pupil position detection device can be miniaturized.

[0201] On the other hand, the laser light emitted from one light emitting portion of the VCSEL 1 can generate a plurality of focused laser lights, and the focused laser lights can be simultaneously irradiated to a plurality of positions of the eyeball 30 . Fig.17 (b) An example is given of using HOE2d's 0th-order light L90, +1st-order diffracted light L91, and -1st-order diffracted light L92 to generate three converging laser beams.

[0202] exist Figure 2 3 describes that the detection range is expanded by shifting the light emitting portion of VCSEL1 in response to the large rotational movement of the eyeball 30. In this regard, in this modification, the convergence position of one light emitting portion of VCSEL1 can be set to three. In this way, even if the eyeball 30 makes a larger rotational movement, the laser reflected by the eyeball 30 or the cornea 32 can be prevented from deviating from the light receiving surface of PSD3, thereby expanding the detection range of the rotation angle.

[0203] In addition to HOEs, diffractive optical elements (DOE) elements and Fresnel lenses can also be used.

[0204] (10th Modification)

[0205] The pupil position detection device according to this modification example includes a first converging reflection element 200 having a liquid crystal portion 202 enclosing an anisotropic molecular material, instead of the concave mirror 2. Here, the anisotropic molecular material refers to a liquid crystal material or the like.

[0206] Fig.18A 2 is a schematic diagram for explaining an off-axis optical system structure using the first converging reflective element 200. Fig.18A As shown, the first converging reflective element 200 includes a supporting substrate 201, a liquid crystal portion 202, and a 1 / 4 wavelength shift portion 203. Here, the first converging reflective element 200 is an example of a "converging reflective element", and the liquid crystal portion 202 is an example of a "sealing portion".

[0207] The linearly polarized light emitted from the VCSEL 1 is converted into circularly polarized light by the 1 / 4 wavelength shift section 203, and enters the liquid crystal section 202. The light reflected by the liquid crystal section 202 toward the eyeball 30 passes through the 1 / 4 wavelength shift section 203 in the opposite direction to the direction when it was emitted, and is converted back into linearly polarized light, and enters the corneal surface of the eyeball 30. Thereafter, the light reflected on the corneal surface enters the PSD3.

[0208] The liquid crystal portion 202 is as follows Fig.18B As shown, it includes a supporting substrate 2021, an alignment film 2022, an alignment film 2023, and a transmissive supporting substrate 2024 that allows light to pass therethrough.

[0209] The internal space of the film formed by the alignment films 2022 and 2023 contains liquid crystal molecules 2025. The liquid crystal molecules 2025 are arranged in a spiral shape in a direction perpendicular to the planes of the alignment films 2022 and 2023.

[0210] The orientation of the liquid crystal molecules 2025 is three-dimensionally controlled by the orientation films 2022 and 2023. Specifically, the orientation films 2022 and 2023 are each divided into microscopic spatial regions within the plane, and each region is irradiated with UV light polarized in a specific direction to implement photo-orientation, thereby controlling the orientation of the liquid crystal molecules 2025 in each microscopic spatial region.

[0211] In other words, the liquid crystal molecules 2025 are aligned to form a three-dimensional quasi-periodic structure inside the liquid crystal portion 202. Here, the quasi-periodic structure refers to a structure in which the structural period or phase is adjusted three-dimensionally to exhibit light-concentrating properties.

[0212] from Fig.18B Light incident on the liquid crystal portion 202 from right to left passes through the supporting substrate 2024 and the orientation film 2023, is reflected by the liquid crystal molecules 2025, passes through the orientation film 2023 and the supporting substrate 2024 in the opposite direction to that from which it came, and is emitted from the liquid crystal portion 202.

[0213] exist Fig.18BIn the example, by adjusting the orientation direction on the surface of the orientation film 2022 or 2023 corresponding to the starting position of the spiral structure of the liquid crystal molecule 2025, the equiphase surface 2026 showing the curve of the spiral structure is concavely curved relative to the incident direction of light. As a result, the liquid crystal molecule 2025 can function as a lens, and the light reflected by the liquid crystal molecule 2025 and traveling to the right of the figure can be converged. The technology for making the liquid crystal molecule function as an optical element such as a lens can apply the known technology (for example, refer to Nature Photonics Vol, 10 (2016) p.389), and the detailed description is omitted here. Fig.18B In the figure, 2027 indicated by a dotted line represents light incident on the liquid crystal portion 202, and 2028 indicated by a two-dot line represents light reflected by the liquid crystal portion 202 and converged.

[0214] Next reference Fig. 18C , further illustrating the optical properties of the liquid crystal portion 202. Fig. 18C (a) and (b) show the liquid crystal section 202 that converges right-handed circularly polarized light. The liquid crystal section 202 has different reflection characteristics or transmission characteristics for right-handed polarized light and left-handed polarized light, depending on the rotation direction of the liquid crystal molecules 2025.

[0215] exist Fig. 18C In (a), the light converted into circularly polarized light by the 1 / 4 wavelength shifting section 203 enters the liquid crystal section 202. The light reflected by the liquid crystal section 202 passes through here in the opposite direction to when it came, passes through the 1 / 4 wavelength shifting component again, returns to linearly polarized light, and irradiates the eyeball 30. In order to minimize the laser intrusion into the eyeball 30, it is preferred that the linearly polarized light be S-polarized light having an electric field vibration plane in the direction perpendicular to the paper surface.

[0216] on the other hand, Fig. 18C (b) shows an example of a case where the light from VCSEL 1 is randomly polarized light without polarization control. Among the randomly polarized light incident on the liquid crystal unit 202, only the right-handed circularly polarized light is reflected by the reflective support substrate 2021 and converges, and is converted into linearly polarized light by passing through the 1 / 4 wavelength shift unit 203. The left-handed polarized light component directly transmits the support substrate 201 and does not irradiate the corneal surface.

[0217] The pupil position detection device according to this modification can control the three-dimensional orientation distribution of the liquid crystal molecules 2025 by controlling the two-dimensional orientation of the orientation films 2022 and 2023, thereby providing a thin first converging reflective element 200 with high reflection and diffraction efficiency. In addition, polarization selectivity can be imparted to the first converging reflective element 200, providing a pupil position detection device that takes into account both reducing the number of optical components and ensuring eye safety against lasers.

[0218] (11th Modification)

[0219] The pupil position detection device according to this modification example includes a second converging reflection element 210 containing an anisotropic molecular material.

[0220] Fig.18D 2 is a schematic diagram for explaining an example of an off-axis optical system using the second converging reflective element 210. Fig.18D As shown, the second converging reflective element 210 includes a liquid crystal portion 211, a light guide member 212, and a 1 / 4 wavelength shift portion 213. Here, the second converging reflective element 210 is an example of a "converging reflective element", and the liquid crystal portion 211 is an example of an "anisotropic molecular material".

[0221] The liquid crystal section 211 is provided in contact with the interface of the light guide region in the light guide member 212. The liquid crystal section 211 is similar to the liquid crystal section 202, and liquid crystal molecules form a three-dimensional quasi-periodic structure inside the liquid crystal section 211.

[0222] The light emitted from the VCSEL 1 passes through the inclined surface of the incident end of the light guide component 212 and is coupled in the light guide component 212. Alternatively, the light may be coupled in the light guide component 212 by using a grating, but considering the ease and accuracy of installation, it is preferred that the mounting substrate surface of the VCSEL 1 and the light guide component 212 be orthogonal.

[0223] The light coupled in the light guide member 212 is repeatedly totally reflected on the interface of the light guide member 212, and propagates from the inside of the light guide member 212 to the vicinity of the eye. Among the light propagating in the light guide member 212, the right circularly polarized light or the left circularly polarized light is selectively reflected by the liquid crystal portion 211, converged by the lens function of the liquid crystal portion 211, and converted into linearly polarized light (S polarized light) by the 1 / 4 wavelength shift portion 213, and then irradiated to the corneal surface of the eyeball 30.

[0224] When the light guide member 212 is used, it is difficult to illuminate the corneal surface with light at a small angle relative to the corneal surface, so the light is reflected by the liquid crystal portion 211 near the front of the eyeball 30. At this time, in order to make the light incident on the PSD3, it is necessary to converge the light to a position (specular reflection position) moved from the pupil center position on the cornea to the side of the PSD3.

[0225] The pupil position detection device according to this modification example can allow the light emitted from the VCSEL 1 to irradiate the corneal surface while ensuring the optical path length in the light guide component 212, thereby achieving miniaturization of the device. Fig.14 With the same frame structure, VCSEL1, light guide component 212, PSD3, etc. can be integrated into one.

[0226] [Second Embodiment]

[0227] Next reference Fig.19 , describing a retinal projection display device according to a second embodiment.

[0228] Fig.19 This is a schematic diagram for explaining an example of the structure of a retinal projection display device involved in this embodiment.

[0229] The retinal projection display device 60 includes an RGB (Red, Green, Blue) laser light source 61 , a scanning mirror 62 , a plane mirror 63 , a half mirror 64 , an image generating unit 65 , and the pupil position detecting device 10 .

[0230] The RGB laser light source 61 temporally modulates the RGB3-color laser light and outputs it. The scanning mirror 62 performs two-dimensional scanning on the light from the RGB laser light source 61. The scanning mirror 62 is a MEMS mirror or the like. However, it is not limited thereto, as long as it is a polygon mirror, a scanning galvanometer mirror or the like having a reflective portion for scanning light. The MEMS mirror is relatively advantageous in terms of miniaturization and light weight. The driving method of the MEMS mirror can be any one of electrostatic, piezoelectric, electromagnetic or the like.

[0231] The plane mirror 63 reflects the scanning light of the scanning mirror 62 toward the half mirror 64. The half mirror 64 allows a part of the incident light to pass through and reflects the other part to the eyeball 30. The half mirror 64 has a concave curved surface shape, so that the reflected light converges near the pupil 31 of the eyeball 30 and forms an image at the position of the retina 33. Thus, the image formed by the scanning light is projected onto the retina 33. The light 61a shown by the dotted line in the figure represents the light that forms the image on the retina 33. The light amount of the reflected light and the transmitted light of the half mirror 64 does not necessarily need to be 1 to 1.

[0232] The pupil position detection device 10 detects the position of the pupil 31 in response to the eye movement, and sends a feedback signal of the position of the pupil 31 to the image generation unit 65 .

[0233] The image generation unit 65 has a function of controlling the deflection angle of the scanning mirror 62 and the light emission of the RGB laser light source 61. The image generation unit 65 receives a feedback signal of the position of the pupil 31 from the pupil position detection device 10, and controls the deflection angle of the scanning mirror 62 and the light emission of the RGB laser light source 61 according to the position of the pupil 31 detected by the pupil position detection device 10, thereby rewriting the projection angle or image content of the image. In this way, an image of the position change of the pupil 31 that tracks the movement of the eyeball (eye tracking) can be formed on the retina 33.

[0234] The above shows a head mounted display (HMD) using the retinal projection display device 60 as an example of a wearable terminal. However, the retinal projection display device 60 as a head mounted display can not only be directly mounted on the head of a "person", but can also be indirectly mounted on the head of a "person" through components such as a fixing part (head mounted display device). It can also be a binocular retinal projection display device having a pair of retinal projection display devices 60 for left and right eyes.

[0235] [Comparison between the pupil position detection device according to the embodiment and the eye tracking device disclosed in Patent Document 1]

[0236] Hereinafter, the pupil position detection device described in Patent Document 1 and pupil position detection device 10 of the embodiment will be compared. Fig.19 This is a schematic diagram of the eye detection device described in Patent Document 1. The device described in Patent Document 1 uses a laser light source, scans the laser with a MEMS mirror, and changes the incident angle of the light emitted to the eyeball. In contrast, the embodiment uses a VCSEL having multiple light-emitting parts as a light source, and changes the incident angle of the light emitted to the eyeball by changing the light-emitting part of the VCSEL. In this way, the embodiment does not use a movable part to change the incident angle of the light emitted to the eyeball. Therefore, compared with a structure with movable parts, it is advantageous in terms of vibration resistance and external impact resistance.

[0237] The device described in Patent Document 1 detects the reflected light intensity of the light irradiating the cornea by means of a photodetector, whereas the embodiment uses a PSD to detect the position of the light that is reflected by the eyeball and enters the light receiving surface of the PSD. Since the PSD detects the position of the incident light without depending on the light intensity, the position detection sensitivity is high even if the reflected light amount is different due to the reflection position of the light of the eyeball, etc. As a result, the tilt position of the eyeball, such as the pupil, can be detected with high accuracy.

[0238] The embodiment has a light-emitting driving unit 110, and the light-emitting driving unit 110 staggers the positions of the light-emitting units of the VCSEL and the light-emitting time between the light-emitting units to perform individual lighting. In this way, the gross movement of the eyeball can be captured, so that the reflected light of the eyeball is projected onto the light-receiving surface of the PSD, and the micro-movement of the eyeball can be captured by detecting the position of the PSD.

[0239] In the device described in Patent Document 1, the eyeball position is estimated from the two peak intensities of the reflected light of the eyeball on the time axis (the reflection positions of two points on the cornea). In the embodiment, the eyeball position is estimated based on the reflection position of one point on the eyeball such as the cornea. For this reason, the VCSEL and PSD do not necessarily need to be symmetrically positioned. In the embodiment, the PSD can also be configured on the same side as the VCSEL, rather than near the regular reflection (specular reflection) angle of the eyeball.

[0240] Although the examples of the embodiments of the present invention have been described above, the present invention is not limited to these specific embodiments, and various modifications and changes can be made within the scope of the gist of the present invention described in the scope of the patent application.

[0241] In addition, the information of the pupil position detected by the pupil position detection device 10 can also be used for eye tracking in an electronic device input device. Figure 1 The output of the pupil position detection device 10 is used as input information of an electronic device for eye tracking, etc. Thus, robust eye detection with head position deviation etc. can be achieved.

[0242] Furthermore, it can also be applied to an optometry device having the function of detecting eyeball inclination and pupil position (cornea). An optometry device refers to a device capable of performing various inspections such as vision inspection, eye refraction inspection, intraocular pressure inspection, and eye axis length inspection. An optometry device is a device capable of performing non-contact inspection of the eyeball, and has a support portion for supporting the face of the examinee, an optometry window, a display portion for keeping the examinee's eyeball direction (line of sight direction) at a certain level during optometry, a control portion, and a measuring portion. In order to improve the measurement accuracy of the measuring portion, the eyeball (line of sight) needs to be fixedly fixed on one point, and the subject fixes the face on the support portion and looks at the display displayed on the display portion through the optometry window. At this time, when detecting the eyeball inclination position, the eyeball inclination position detection device of this embodiment can be used. The eyeball inclination position detection device is arranged on the side of the measuring portion so that the measurement will not be hindered. The eyeball inclination position (line of sight) information obtained by the eyeball inclination position detection device can be fed back to the control portion, so that the corresponding eyeball inclination position information can be measured.

[0243]

Explanation of symbols

[0244] 1 VCSEL (an example of a light source)

[0245] 2 Concave reflector (an example of a converging reflective element)

[0246] 2a Plane mirror

[0247] 2b Non-coaxial concave mirror (an example of a converging reflective element)

[0248] 2c, 2d HOE (one is a converging reflective element, the other is a diffractive reflective element)

[0249] 3 PSD (an example of a position detection device)

[0250] 10 Pupil position detection device

[0251] 20 glasses type support

[0252] 21. Eyeglass lenses

[0253] 22 glasses frames

[0254] 30 Eyeball (one irradiated surface)

[0255] 31 pupil

[0256] 32 Cornea

[0257] 33 Retina

[0258] 50 Component support

[0259] 51 FPC (an example of a driver substrate)

[0260] 52 FFC (an example of a driver substrate)

[0261] 53 Batteries

[0262] 54 Connectors

[0263] 55 Circuit Group

[0264] 56 Triangular prism (an example of a deflection element)

[0265] 57 FPC

[0266] 58 Circuit Board

[0267] 59 Packaging

[0268] 60 Retinal projection display device

[0269] 61 RGB laser light source

[0270] 62 Scanning mirror

[0271] 63 plane mirror

[0272] 64 Half Mirror

[0273] 65 Image Generator

[0274] 90 Reference irradiated surface

[0275] 100 Processing Department

[0276] 101 CPU

[0277] 102 ROM

[0278] 103 RAM

[0279] 104 SSD

[0280] 105 Light source driving circuit

[0281] 106 A / D conversion circuit

[0282] 107 Input / Output I / F

[0283] 110 Light Emitting Driver

[0284] 111 Detection signal input unit

[0285] 120 Operation unit

[0286] 121 Eyeball rotation angle estimation unit

[0287] 122 Pupil position acquisition unit

[0288] 130 Pupil position output

[0289] 131 Position adjustment mechanism

[0290] 132 Tilt adjustment mechanism

[0291] 150 Light guide

[0292] 151 light guide component support

Claims

1. An optical device for detecting the tilt position of an eyeball or the pupil position of an eyeball, the optical device comprising: A light source portion, for emitting light; A converging reflective element, used for converging the light emitted from the light source portion and reflecting it toward the eyeball; as well as, A position detection element is used to detect the position of the light reflected on the eyeball, the front view direction of the eyeball intersects with the direction of the light emitted from the light source to the converging reflection element, and the light before reaching the eyeball is transmitted at least once before reaching the eyeball. When the distance between the converging reflective element and the illuminated surface of the eyeball illuminated by the light is set to d1, the diameter of the effective area of ​​the converging reflective element is D m , the radius of curvature of the irradiated surface is r c , the wavelength of the light from the light source is λ, and the beam radius on the light receiving surface of the position detection element is h UL When , the following equation is satisfied:

2. The optical device according to claim 1, wherein: The light source unit is provided closer to the eyeball than the position detection unit in a direction parallel to the normal viewing direction.

3. The optical device according to claim 1, wherein: The converging reflective element does not use a movable part when detecting the tilt position of the eyeball or the pupil position of the eyeball.

4. The optical device according to claim 1, wherein: When the position detection unit detects the tilt position of the eyeball or the pupil position of the eyeball, reflected light from the eyeball is incident from a plurality of angles.

5. The optical device according to claim 1, wherein: The reflected light incident on the position detection unit from the eyeball is incident on the light receiving surface of the position detection unit at a non-perpendicular angle.

6. The optical device according to claim 1, characterized in that The light source unit and the position detection unit are supported by the same member.

7. The optical device according to claim 1, wherein: The optical path between the light source section and the converging reflective element intersects with the optical path between the illuminated surface of the eyeball illuminated by the light and the position detecting element.

8. The optical device according to claim 7, wherein: A deflection element is provided on an optical path from the light source to the converging reflective element, and is used to deflect light emitted from the light source.

9. The optical device according to claim 1, wherein: The optical path from the light source to the converging reflective element is parallel to a predetermined reference plane that is tangent to the illuminated surface of the eyeball illuminated by the light.

10. The optical device according to claim 1, wherein: The optical system support body is further provided for supporting the light source unit, the position detection element, and an electric component board on which a light source driving circuit for driving the light source unit is mounted.

11. The optical device according to claim 1, wherein: The converging reflecting element includes surfaces with different curvatures in two directions, one direction being parallel to a plane containing an optical axis of light propagating between the converging reflecting element and an irradiated surface on the eyeball illuminated by the light, and an optical axis of light propagating between the irradiated surface and the position detection element, and the other direction being orthogonal to the plane.

12. The optical device according to claim 1, wherein: The converging reflective element has at least one of a position adjustment mechanism and a tilt adjustment mechanism. The position adjustment mechanism is used to adjust the position of the converging reflective element, and the tilt adjustment mechanism is used to adjust the tilt of the converging reflective element.

13. The optical device according to claim 1, wherein: A light guide member is provided between the light source unit and the converging reflective element, and guides the light emitted by the light source unit to the converging reflective element through internal propagation.

14. The optical device according to claim 13, wherein: The converging reflective element is formed on one end surface of the light guide member.

15. An optical device according to any one of claims 1 to 14, wherein: The converging reflective element has a packaging portion in which anisotropic molecular materials are packaged. The anisotropic molecular material is oriented in such a manner as to form a three-dimensional quasi-periodic structure inside the encapsulation portion.

16. An optical device according to any one of claims 1 to 14, wherein: The converging reflective element has: a light guide member for internally transmitting light emitted from the light source portion, and The encapsulation part is arranged to be in interface contact with the light-guiding region of the light-guiding component, wherein anisotropic molecular materials are encapsulated. The anisotropic molecular material is oriented to form a three-dimensional quasi-periodic structure inside the packaging portion.

17. An optical device according to any one of claims 1 to 14, wherein: The converging reflective element comprises a non-coaxial concave mirror.

18. An optical device according to any one of claims 1 to 14, wherein: The converging reflective element comprises a diffractive reflective element.

19. The optical device according to claim 7, wherein: The converging reflective element includes a diffractive reflective element that illuminates a plurality of locations on the illuminated surface.

20. An optical device according to any one of claims 1 to 14, wherein: The converging reflection element and the position detection element are arranged in directions of symmetrical angles centered on the normal direction of the illuminated surface.

21. An optical device according to any one of claims 1 to 14, wherein: The light source unit, the converging reflective element, and the position detecting element are all arranged in an installation plane including an optical axis of light propagating between the converging reflective element and the illuminated surface, and an optical axis of light propagating between the illuminated surface and the position detecting element. The light source unit and the position detection element are arranged close to each other on one side surface of the installation surface along the normal direction of the illuminated surface, The converging reflective element is disposed on the other side surface of the installation surface with respect to the normal direction of the illuminated surface.

22. An optical device according to any one of claims 1 to 14, wherein: The light source unit, the converging reflective element, and the position detecting element are all disposed on a supporting body and arranged along a thickness direction of the supporting body.

23. An optical device according to any one of claims 1 to 14, wherein: The light source unit, the converging reflective element, and the position detecting element for receiving light are all disposed on a supporting body and arranged along a length direction of the supporting body.

24. The optical device according to claim 10, wherein: The light source unit and the position detection element for receiving light are provided on one side surface of the electrical substrate. The other side surface of the electrical substrate has at least one of the light source driving circuit and the computing device, the light source driving circuit is used to drive the light source unit, and the computing device is used to process the output of the position detection element.

25. An optical device according to any one of claims 1 to 14, 19, 24, wherein: The light emitted by the light source device has directivity.

26. An optical device according to any one of claims 1 to 14, 19, 24, wherein: The position detection device is an imaging element.

27. A retinal projection display device, wherein: An optical device according to any one of claims 1 to 26.

28. A head mounted display device comprising the optical device according to any one of claims 1 to 26.

29. An optometry device comprising the optical device according to any one of claims 1 to 26.

Images