Information detection device, video projection device, information detection method and video projection method

Abstract

The purpose of the present invention is to provide a new technology for detecting information about the direction of sight, pupil position, etc. The present technology provides an information detection device, including: an irradiation unit, which irradiates an eyeball with light; a scanning mirror, which scans the reflected light from the eyeball; and a detection unit, which detects the reflected light scanned by the scanning mirror. The present technology also provides an image projection device, which includes the above-mentioned constituent elements. In addition, the present technology provides an information detection method, including: an irradiation step of irradiating the eyeball with light; a scanning step of scanning the reflected light from the eyeball using a scanning mirror; and a detection step for detecting the reflected light scanned by the scanning mirror. The present technology also provides an image projection method including the steps.

Description

Technical Field

[0001] The present technology relates to an information detection device, a video projection device, an information detection method and a video projection method. More specifically, the present technology relates to an information detection device, a video projection device, an information detection method and a video projection method capable of detecting pupil positions. Background Art

[0002] In recent years, technology for displaying videos superimposed on external scenes such as real scenes has attracted attention. This technology is also called augmented reality (AR) technology. An example of a product using this technology is a head-mounted display. The head-mounted display is used by wearing it on the user's head. In an image display method using a head-mounted display, for example, in addition to light from the outside world, light from the head-mounted display illuminates the user's eyes, whereby a video is superimposed on an image of the outside world for display.

[0003] In order to present a video to a user through a head-mounted display, the user's line of sight direction or pupil position can be grasped. Regarding the technology for grasping the user's line of sight direction or pupil position, for example, the following patent document 1 describes a scanning display device, characterized in that a line of sight detection device is incorporated, which detects the user's line of sight direction while sharing the optical system of the scanning display device. In addition, the pupil detection device described in the following patent document 2 includes: a detection unit, which detects the intensity of a light beam reflected on the surface of the eyeball among the light beams incident on the surface of the eyeball as a reflected light beam intensity signal; and a processing unit, which acquires the pupil position based on the intensity change of the reflected light beam represented by the intensity signal output from the detection unit. In addition, the focus control device for a camera described in the following patent document 3 is characterized in that it includes in the camera: a line of sight detection means, which is used to detect which part of the viewfinder the photographer is looking at based on the line of sight of the photographer; a means for confirming the line of sight of the photographer in the viewfinder field detected by the line of sight detection means and for setting the focal value of the camera based on the confirmation result.

[0004] Citation List

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2003-029198

[0007] Patent Document 2: Japanese Patent Application Publication No. 2006-058505

[0008] Patent Document 3: Japanese Patent Application Publication No. HEI 05-317260 Summary of the invention

[0009] Technical issues

[0010] A head mounted display is used by being worn on the head of a user, and therefore is expected to be more compact. It is also expected to further reduce the power consumption of the head mounted display.

[0011] An object of the present technology is to provide a new technology for detecting information such as a gaze direction or a pupil position. In particular, an object of the present technology is to reduce the size of a device for detecting such information and / or reduce its power consumption.

[0012] Technical solutions to problems

[0013] The present technology provides an information detection device, including: an irradiation unit that irradiates an eyeball with light; a scanning mirror that scans reflected light from the eyeball; and a detection unit that detects the reflected light scanned by the scanning mirror.

[0014] According to an embodiment of the present technology, the information detection device may further include a controller that estimates the pupil position or the line of sight direction of the eyeball based on the reflected light detected by the detection unit.

[0015] According to an embodiment of the present technology, the controller can estimate the pupil position or the line of sight direction of the eyeball based on the scanning oscillation angle of the scanning mirror and the reflected light detected by the detection unit.

[0016] According to an embodiment of the present technology, the controller can estimate the pupil position or the line of sight direction of the eyeball based on the scanning oscillation angle of the scanning mirror and the intensity of the reflected light detected by the detection unit.

[0017] According to an embodiment of the present technology, the irradiation unit may be configured to irradiate the eyeball with the light without passing through the scanning mirror.

[0018] According to an embodiment of the present technology, the irradiation unit may be configured to irradiate the eyeball with the light via the scanning mirror.

[0019] According to one embodiment of the present technology, the light used to illuminate the eyeball may be non-visible light.

[0020] According to one embodiment of the present technology, the light used to illuminate the eyeball may be infrared light.

[0021] According to one embodiment of the present technology, the light used to illuminate the eyeball may be a beam of light.

[0022] In addition, the present technology provides a video projection device, including: an irradiation unit, which irradiates an eyeball with light; a scanning mirror, which scans the reflected light from the eyeball; a detection unit, which detects the reflected light scanned by the scanning mirror; a controller, which estimates the pupil position of the eyeball based on the reflected light detected by the detection unit; and a video display light irradiation unit, which irradiates the pupil position estimated by the controller with video display light, so that the video display light passes through the pupil position.

[0023] According to one embodiment of the present technology, the video display light can be gathered near the pupil, and the retina can be illuminated with the video display light.

[0024] According to one embodiment of the present technology, the eyeball can be illuminated by the video display light via the scanning mirror.

[0025] According to an embodiment of the present technology, the video projection device may be a glasses display.

[0026] Furthermore, the present technology provides an information detection method, including: irradiating an eyeball with light; scanning reflected light from the eyeball by a scanning mirror; and detecting the reflected light scanned by the scanning mirror.

[0027] In addition, the present technology provides a video projection method, comprising: irradiating an eyeball with light; scanning the reflected light from the eyeball through a scanning mirror; detecting the reflected light scanned by the scanning mirror; estimating the pupil position of the eyeball based on the reflected light detected in the detection step; and irradiating the pupil position estimated in the estimation step with video display light so that the video display light passes through the pupil position.

[0028] Advantageous Effects of the Invention

[0029] In this technology, the reflected light from the eyeball is detected via the scanning mirror. Therefore, the size and power consumption of the detection unit can be reduced.

[0030] Note that the effects exerted by the present technology are not necessarily limited to the effects described here, but any of the effects described here can be exerted. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a schematic diagram of an information detection device according to the present technology.

[0032] Figure 2 FIG. 1 is a diagram showing an example of a scanning line of a scanning mirror.

[0033] Figure 3 is a schematic diagram of an information detection device according to the present technology.

[0034] Figure 4 is a schematic diagram of a video projection device according to the present technology.

[0035] Figure 5 is a schematic diagram of a video projection device according to the present technology.

[0036] Figure 6 is a schematic diagram of a video projection device according to the present technology.

[0037] Figure 7 : is a diagram showing an example of the flow of the information detection method according to the present technology.

[0038] Figure 8 : is a diagram showing an example of the flow of a video projection method according to the present technology.

[0039] Fig. 9 is a diagram showing an example of a head-mounted display according to the present technology.

[0040] Fig.10 is a diagram showing an example of a head-mounted display according to the present technology.

[0041] Fig.11 : is a diagram showing a configuration example of an information detection device according to the present technology.

[0042] Fig.12 is a graph showing the relationship between light intensity and scanning oscillation angle.

[0043] Fig.13 : is a diagram showing a configuration example of an information detection device according to the present technology.

[0044] Fig.14 is a graph showing the relationship between light intensity and scanning oscillation angle.

[0045] Fig.15 : is a diagram showing a configuration example of an information detection device according to the present technology.

[0046] Fig.16 is a graph showing the relationship between light intensity and scanning oscillation angle.

[0047] Fig.17 : is a diagram showing a configuration example of a video projection device according to the present technology.

[0048] Fig.18 : is a diagram showing a configuration example of a video projection device according to the present technology.

[0049] Fig.19 : is a diagram showing a configuration example of a video projection device according to the present technology. DETAILED DESCRIPTION

[0050] Hereinafter, suitable embodiments for implementing the present technology will be described. Note that the embodiments described below show representative embodiments of the present technology, and the scope of the present technology is not limited to these embodiments. Note that the description of the present technology is given in the following order.

[0051] 1. First Embodiment (Information Detection Device)

[0052] (1) Description of the First Embodiment

[0053] (2) First Example of the First Embodiment (Information Detection Device)

[0054] (3) Second Example of First Embodiment (Information Detection Device)

[0055] 2. Second Embodiment (Video Projection Device)

[0056] (1) Description of the Second Embodiment

[0057] (2) First Example of Second Embodiment (Video Projection Device)

[0058] (3) Second Example of the Second Embodiment (Video Projection Device)

[0059] (4) Third Example of Second Embodiment (Video Projection Device)

[0060] 3. Third embodiment (information detection method)

[0061] (1) Description of the Third Embodiment

[0062] (2) Example of the third embodiment (information detection method)

[0063] 4. Fourth Embodiment (Video Projection Method)

[0064] (1) Description of the Fourth Embodiment

[0065] (2) Example of the fourth embodiment (video projection method)

[0066] 5. Device configuration example

[0067] 6. Examples

[0068] (1) Example 1 (Simulation of the first example of the first embodiment)

[0069] (2) Example 2 (Simulation of the second example of the first embodiment)

[0070] (3) Example 3 (Simulation of the Second Example of the First Embodiment)

[0071] (4) Example 4 (Simulation of the first example of the second embodiment)

[0072] (5) Example 5 (Simulation of the Second Example of the Second Embodiment)

[0073] (6) Example 6 (Simulation of the third example of the second embodiment)

[0074] 1. First Embodiment (Information Detection Device)

[0075] (1) Description of the First Embodiment

[0076] The information detection device according to the present technology includes: an irradiation unit that irradiates an eyeball with light; a scanning mirror that scans the reflected light from the eyeball; and a detection unit that detects the reflected light scanned by the scanning mirror. That is, the reflected light from the eyeball reaches the detection unit via the scanning mirror. As a result, information about the eyeball, for example, information about the line of sight direction, pupil position, etc., can be detected based on the detected reflected light.

[0077] In addition, as described above, since the reflected light from the eyeball reaches the detection unit via the scanning mirror, the scanning mirror is driven, so that, for example, the reflected light from various positions of the eyeball can be detected by one light detection element. Therefore, the size of the detection unit can be reduced. In addition, since the number of light detection elements constituting the detection unit of the device according to the present technology can be small, the power consumption of the device is small.

[0078] In addition, as described above, since the reflected light from the eyeball reaches the detection unit via the scanning mirror, noise components such as ambient light or stray light can be eliminated.

[0079] In the sight line detection device described in Patent Document 1, for example, four infrared sensors are provided on a concave mirror in front of the eye to detect infrared rays reflected on the eyeball. Each of the plurality of infrared sensors detects infrared rays reflected on the eyeball. Then, the device detects the position of the eyeball based on a plurality of detection values. However, in such a detection method, the detection accuracy is insufficient in some cases. In addition, since the device includes a plurality of infrared sensors, its power consumption is large.

[0080] In the information detection device according to the present technology, the light reflected on the eyeball reaches the detection unit via the scanning mirror. That is, the information detection device according to the present technology can detect the reflected light from various positions of the eyeball. Therefore, the detection accuracy of the information detection device according to the present technology is high. In addition, the information detection device according to the present technology can detect the reflected light from various positions of the eyeball by using, for example, a light detection element by driving the scanning mirror. Therefore, the power consumption of the information detection device according to the present technology is small.

[0081] The pupil detection device described in the above-mentioned patent document 2 scans infrared rays and irradiates the eyes with infrared rays. Patent document 2 discloses a pupil detection unit that receives infrared light reflected on the eyes through a condenser lens. However, when receiving infrared light through the condenser lens, the device is easily affected by ambient light or stray light.

[0082] In the focus control device described in Patent Document 3, infrared light reflected on the eyeball is also collected by the light receiving lens. Therefore, this device is also easily affected by ambient light or stray light.

[0083] When performing light detection using the information detection device according to the present technology, the reflected light from the eyeball reaches the detection unit via the scanning mirror. That is, the angle of the light reaching the detection unit is limited. Therefore, using the information detection device according to the present technology can reduce the influence of noise components (such as ambient light or stray light).

[0084] (2) First Example of the First Embodiment (Information Detection Device)

[0085] In the following, reference will be made to Figure 1 An example of an information detection device according to the present technology is described. Figure 1 is a schematic diagram of an information detection device according to the present technology. In this schematic diagram, the traveling direction of light used for information detection by using the information detection device is indicated by an arrow.

[0086] like Figure 1 As shown, the information detection device 100 includes an irradiation unit 101 , a light guiding unit 102 , a scanning mirror 103 , a detection unit 104 , and a controller 105 .

[0087] The irradiation unit 101 irradiates the eyeball 150 with light 161. The light 161 to be emitted is used to detect information about the eyeball. The light 161 to be emitted is advantageously non-visible light, and more advantageously infrared light. If the light to be emitted is non-visible light, especially infrared light, the burden on the eye during information detection is reduced. In addition, such light reduces the influence on the external scene or video recognized by the user.

[0088] For example, if the information detecting device 100 is a glasses-like device, for example, the irradiation unit 101 may be attached to any position of a frame or a lens of the glasses-like device, or may be formed as a part of the frame or the lens.

[0089] The irradiation unit 101 may be arranged so that the light 161 passes through the light guide unit 102 and reaches the eyeball 150. For example, the irradiation unit 101 may be arranged on the surface of the frame or lens of the eyeglass-like device opposite to the eyeball-side surface. Alternatively, the irradiation unit 101 may be arranged so that the light 161 reaches the eyeball 150 without passing through the light guide unit 102. In this case, for example, the irradiation unit 101 may be arranged on the eyeball side of the frame or lens of the eyeglass-like device. The irradiation unit 101 may be, for example, a planar light source.

[0090] Advantageously, the eyeball is illuminated with the light 161 as parallel light. This enables more accurate information detection. For example, in the case where the irradiation unit 101 is configured so that the light 161 passes through the light guide unit 102 and reaches the eyeball 150, the light guide unit 102 can collimate the light 161. Alternatively, for example, in the case where the irradiation unit 101 is set so that the light 161 reaches the eyeball 150 without passing through the light guide unit 102, the irradiation unit 101 itself can be configured to output the light 161 as parallel light.

[0091] The eyeball 150 is irradiated with the light 161 emitted by the irradiation unit 101 and passing only through the light guide unit 102. That is, the eyeball 150 is irradiated with the light 161 without the scanning mirror 103. Therefore, the emitted light 161 is not affected by the reflectivity of the scanning mirror 103.

[0092] The light guiding unit 102 may have a property of transmitting the light 161 emitted from the irradiation unit 101. In addition, the light guiding unit 102 may have a property of reflecting the reflected light 162 from the eyeball toward the scanning mirror 103. An example of the light guiding unit having such a property may include a holographic optical element.

[0093] In the case where the light emitted from the irradiation unit 101 is not parallel light, it is advantageous that the light guide unit 102 may have optical properties that collimate the light.

[0094] For example, in the case where the information detecting device 100 is a glasses-like device, for example, the light guiding unit 102 may be a lens itself of the glasses-like device, or may be configured as a part of the lens.

[0095] The scanning mirror 103 may be, for example, a micro-electromechanical system (MEMS) mirror. The scanning mirror 103 scans the reflected light 162 from the eyeball reflected by the light guide unit 102. The scanning mirror 103 is driven to change the orientation of the surface of the scanning mirror 103, whereby the reflected light 162 reflected at various positions of the eyeball 150 is reflected by the scanning mirror 103 and advances to the detection unit 104.

[0096] The scanning mirror 103 may be configured so that the reflected light 162 reflected by the light guide unit 102 reaches the detection unit 104. In order for the reflected light 162 reflected by the light guide unit 102 to reach the scanning mirror 103, an optical system may be appropriately provided on the path of the reflected light between the light guide unit 102 and the scanning mirror 103. In addition, in order for the reflected light 162 reflected by the scanning mirror 103 to reach the detection unit 104, an optical system may also be appropriately provided on the path of the reflected light between the scanning mirror 103 and the detection unit 104.

[0097] For example, in the case where the information detecting device 100 is a glasses-like device, the scanning mirror 103 may be attached to an arbitrary position of a temple 111 of the glasses-like device, or may be provided so as to be included in the temple.

[0098] In the present technology, scanning may include guiding the reflected light reflected at various reflection positions of the eyeball to a predetermined light detecting element by a scanning mirror. For example, in the present technology, scanning includes guiding the reflected light reflected at each reflection position from a certain point of the eyeball to another point thereof to the light detecting element by driving the scanning mirror. The reflection position of the reflected light guided to the light detecting element may be moved one-dimensionally or two-dimensionally. Advantageously, the reflection position of the reflected light guided to the light detecting element may be moved two-dimensionally.

[0099] This allows for more precise information about the eye.

[0100] Figure 2 2 shows an example of the scanning line of the scanning mirror 103. Figure 2 As shown, by driving the scanning mirror 103, the position of the reflected light scanned by the scanning mirror moves from position "a" to position "b". Next, the position of the reflected light scanned by the scanning mirror moves from position "c" to position "d". Similarly, the position of the reflected light scanned by the scanning mirror moves from position "e" to position "f", from position "g" to position "h", from position "i" to position "j", and from position "k" to position "l". In this way, the reflection position of the reflected light scanned by the scanning mirror 103 can be moved two-dimensionally. On the scanning line from position "e" to position "f" and on the scanning line from position "g" to position "h", the reflected light reflected on the eyeball (or pupil) 150 is detected. In response to the change in the position of the eyeball 150, the scanning line or the position on the scanning line where the reflected light reflected on the eyeball 150 is detected can be changed.

[0101] The detection unit 104 detects the reflected light 162 reflected by the scanning mirror 103. The detection unit 104 includes, for example, a photodiode. Those skilled in the art can appropriately select the type of the detection unit 104 according to the type of light to be detected. For example, if the reflected light 162 is infrared light, the detection unit 104 includes an infrared sensor.

[0102] For example, the detection unit 104 can detect the intensity of the reflected light 162. The intensity of the reflected light 162 is different depending on the position of the eyeball 150 where the reflected light 162 is reflected. For example, the intensity of the reflected light reflected at the pupil part is different from the intensity of the reflected light reflected at the iris part. In addition, the intensity of the reflected light reflected on the surface of the eyeball (e.g., the cornea) is stronger than the intensity of the scattered light reflected on the fundus of the eyeball (e.g., the retina). Therefore, the pupil position and / or the line of sight direction can be estimated based on the orientation of the surface of the scanning mirror 103 or the scanning oscillation angle and the light intensity detected by the detection unit 104.

[0103] In addition, in another embodiment, the detection unit 104 may generate an image based on the detected reflected light 162. For example, the detection unit 104 may include an image sensor, such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD), in particular an infrared image sensor, to generate an image based on the reflected light 162. For example, the controller 105 performs image processing on the image generated based on the reflected light 162, thereby obtaining information about the eyeball (e.g., pupil position or sight direction).

[0104] The detection unit 104 may be connected to a controller 105. The controller 105 may process information about the light detected by the detection unit 104, such as intensity.

[0105] For example, in the case where the information detection device 100 is a glasses-like device, the detection unit 104 may be attached to any position of the temple of the glasses-like device, or may be provided so as to be included in the temple.

[0106] The controller 105 can obtain information about the eyeball (e.g., pupil position, sight line direction, or rotation angle of the eyeball) based on the reflected light (e.g., intensity of the reflected light, etc.) detected by the detection unit 104. For example, the controller 105 can perform estimation processing of the pupil position or sight line direction of the eyeball based on the reflected light.

[0107] In addition, the controller 105 may be connected to the scanning mirror 103 to be able to control the scanning mirror 103. For example, the controller 105 may drive the scanning mirror 103 within a predetermined scanning oscillation angle. The controller 105 is able to obtain information related to the scanning mirror 103, for example, information about the orientation of the surface of the scanning mirror, the scanning oscillation angle, etc.

[0108] Advantageously, the controller 105 can obtain information about the eyeball based on the information about the scanning mirror 103 and the information about the reflected light detected by the detection unit 104. For example, the controller 105 can estimate, for example, the pupil position, the line of sight direction, or the rotation angle of the eyeball based on the scanning oscillation angle of the scanning mirror 103 and the reflected light detected by the detection unit 104 (particularly, the intensity of the reflected light).

[0109] The controller 105 may include a processor such as a central processing unit (CPU) and a memory such as a random access memory (RAM) and / or a read-only memory (ROM). The memory may store a program for causing the device to perform the information detection method or the video projection method according to the present technology, etc. The processor may implement the functions of the controller 105.

[0110] The controller 105 may control the irradiation of light by the irradiation unit 101. For example, the controller 105 may turn on or off the irradiation of light by the irradiation unit 101, or may change the intensity or type of light to be emitted. In addition, the controller 105 may control the driving of the scanning mirror 103. For example, the controller 105 may change the scanning oscillation angle of the scanning mirror 103. In addition, the controller 105 may control the detection performed by the detection unit 104. For example, the controller 105 may turn on or off the detection operation performed by the detection unit 104.

[0111] For example, when the information detection device 100 is a glasses-like device, the controller 105 may be configured to be included in the temples of the glasses-like device. Alternatively, the controller 105 may be provided in a device different from the glasses-like device and may be connected to the glasses-like device by wire or wirelessly.

[0112] For example, if the surface of the scanning mirror 103 is oriented as shown in FIG. Figure 1 , then the reflected light (for example, including surface reflected light or corneal reflected light) passing through the position 171 on the eyeball 150 is reflected by the scanning mirror 103 and detected by the detection unit 104. If the orientation of the surface of the scanning mirror 103 is changed to Figure 1 In the direction shown on the right side of the scanning mirror 103, the reflected light passing through the position 172 on the eyeball 150 (for example, scattered light reflected on the iris) is reflected by the scanning mirror 103 and detected by the detection unit 104. The intensity of the reflected light passing through the position 171 and the intensity of the reflected light passing through the position 172 are different from each other. In this way, the reflection position on the eyeball 150 of the reflected light reaching the detection unit 104 is different depending on the orientation of the surface of the scanning mirror 103. Therefore, if the scanning mirror 103 is driven, information related to the reflected light reflected at various positions on the eyeball 150 can be obtained.

[0113] The obtained information about the reflected light corresponds to, for example, the orientation or scanning oscillation angle of the surface of the scanning mirror 103. Therefore, based on the obtained information about the light and the orientation or scanning oscillation angle of the surface of the scanning mirror 103, information about the eyeball 150 can be obtained.

[0114] In addition, unlike the case of the information detection device 300 described below in "(3) Second example of the first embodiment (information detection device)", the light from the irradiation unit 101 of the information detection device 100 is emitted to the eyeball without a scanning mirror or a half-reflecting mirror. Therefore, the utilization efficiency of the light from the irradiation unit 101 of the information detection device 100 can be higher than the utilization efficiency of the light from the irradiation unit 301 of the information detection device 300. In addition, the information detection device 100 is not easily affected by stray light caused by a scanning mirror or a half-reflecting mirror.

[0115] (3) Second Example of First Embodiment (Information Detection Device)

[0116] In the following, reference will be made to Figure 3 Another example of the information detection device according to the present technology is described. Figure 3 is a schematic diagram of an information detection device according to the present technology. In this schematic diagram, the traveling direction of light used for information detection by using the information detection device is indicated by an arrow.

[0117] like Figure 3 As shown, the information detection device 300 includes an irradiation unit 301, a light guide unit 302, a scanning mirror 303, a detection unit 304, and a controller 305. The information detection device 300 also includes a semi-reflective mirror 306. Among these components, the scanning mirror 303, the detection unit 304, and the controller 305 are the same as the scanning mirror 103, the detection unit 104, and the controller 105 described above in "(2) First example of the first embodiment (information detection device)". The information detection device 100 is configured to irradiate the eyeball with light emitted by the irradiation unit 101 in the absence of the scanning mirror 103, while the information detection device 300 irradiates the eyeball with light emitted by the irradiation unit 301 via the scanning mirror 303. Therefore, the irradiation unit 301 and the light guide unit 302 are mainly described below.

[0118] The irradiation unit 301 is configured to irradiate the eyeball with the light 361 via the scanning mirror 303. That is, the light 361 is scanned and emitted toward the eyeball.

[0119] Advantageously, the light 361 can be emitted from the irradiation unit 301 as a beam of light (particularly a laser beam). More advantageously, the irradiation unit 301 emits a beam of infrared light. The irradiation unit 301 can emit, for example, an infrared laser. This makes it possible, for example, to more clearly detect reflected light from the pupil portion. Therefore, the pupil position can be estimated more accurately.

[0120] The light 361 emitted from the irradiation unit 301 is reflected by the half mirror 306 to reach the scanning mirror 303 , further reflected by the scanning mirror 303 to reach the light guiding unit 302 , and further reflected by the light guiding unit 302 to reach the eyeball.

[0121] For example, in the case where the information detection device 300 is a glasses-like device, the irradiation unit 301 may be attached to any position of the temple of the glasses-like device. Alternatively, the irradiation unit 301 may be provided to be included in the temple. In addition, the irradiation unit 301 may be connected to the controller 305 so as to be controllable by the controller 305.

[0122] The half mirror 306 may have a characteristic of reflecting the light from the irradiation unit 301 and transmitting the reflected light from the eyeball. The detection unit 304 detects the reflected light 362 reflected by the scanning mirror 303 and transmitted through the half mirror 306.

[0123] The light guide unit 302 may have a characteristic of reflecting the light 361 emitted from the irradiation unit 301 and reflecting the reflected light 362 from the eyeball. The light guide unit 302 reflects the reflected light 362 from the eyeball toward the scanning mirror 303. Examples of the element having the above characteristics may include a holographic optical element.

[0124] The light guiding unit 302 may be, for example, a grating or a grating lens. In the case where the light guiding unit 302 is a grating, the light guiding unit 302 may selectively reflect only light having a predetermined wavelength. In the case where the light guiding unit 302 is a grating lens, the light guiding unit 302 may selectively reflect only light having a predetermined wavelength and focus the light toward the eyeball.

[0125] In addition, the information detection device 300 may further include other optical elements, such as a collimator lens, between the scanning mirror 303 and the light guiding unit 302 .

[0126] The scanning mirror 303 may be, for example, a MEMS mirror. As described above, the scanning mirror 303 scans the light 361 emitted by the irradiation unit 301, and also scans the reflected light 362 reflected on the eyeball. That is, in the information detection device 300 in this example, the reflected light from the eyeball is scanned by the scanning mirror 303 that scans the illumination light.

[0127] For example, if the surface of the scanning mirror 303 is oriented as shown in FIG. Figure 3, then the reflected light (e.g., surface reflected light or corneal reflected light) passing through position 371 on the eyeball is reflected by scanning mirror 303 and detected by detector 304. If the orientation of the surface of scanning mirror 303 is changed to Figure 1 , then the reflected light passing through the position 372 on the eyeball (for example, scattered light reflected on the iris) is reflected by the scanning mirror 303 and detected by the detector 304. The intensity of the reflected light passing through the position 371 and the intensity of the reflected light passing through the position 372 are different from each other. In this way, the reflected position on the eyeball of the reflected light reaching the detection unit 304 is different depending on the orientation of the surface of the scanning mirror 303. Therefore, if the scanning mirror 303 is driven, information about the reflected light reflected at various positions on the eyeball can be obtained.

[0128] The obtained information about light corresponds to, for example, the orientation or scanning oscillation angle of the surface of the scanning mirror 303. Therefore, various information about the eyeball can be obtained based on the obtained information about light and the orientation or scanning oscillation angle of the surface of the scanning mirror 303.

[0129] The information detection device 300 includes a common optical system (e.g., a scanning mirror) on the path of the light emitted toward the eyeball and the reflected light. Therefore, the information detection device 300 can be made smaller than the information detection device 100 described above in "(2) First example of the first embodiment (information detection device)".

[0130] In addition, light from the irradiation unit 301 of the information detection device 300 is emitted toward the eyeball via the half mirror 306 and the scanning mirror 303. Therefore, the light utilization efficiency may be lower than that of the information detection device 100 described above in "(2) First example of the first embodiment (information detection device)". However, if the light transmittance or reflectance of each of the half mirror 306 and the scanning mirror 303 is increased, the light utilization efficiency can be improved.

[0131] 2. Second Embodiment (Video Projection Device)

[0132] (1) Description of the Second Embodiment

[0133] The video projection device according to the present technology includes, in addition to the components described above in “1. First embodiment (information detection device)”, a video display light irradiation unit that irradiates a pupil position estimated by a controller with video display light so that the video display light passes through the pupil position.

[0134] The video projection device according to the present technology exerts the effects described above in “1. First embodiment (information detection device)”. Furthermore, the video projection device according to the present technology exerts the effect of being able to emit video display light toward an appropriate position.

[0135] (2) First Example of Second Embodiment (Video Projection Device)

[0136] Below, refer to Figure 4 An example of a video projection device according to the present technology is described. Figure 4 is a schematic diagram of a video projection device according to the present technology. In this schematic diagram, the traveling direction of light used for information detection by the video projection device and the direction of video display light are indicated by dotted arrows.

[0137] like Figure 4 As shown, the video projection device 400 includes an irradiation unit 401, a light guide unit 402, a scanning mirror 403, a detection unit 404, and a controller 405. The video projection device 400 also includes a video display light irradiation unit 420. Among these components, the irradiation unit 401, the scanning mirror 403, the detection unit 404, and the controller 405 are the same as the irradiation unit 101, the scanning mirror 103, the detection unit 104, and the controller 105 described above in "(2) First example of the first embodiment (information detection device)" of Part 1. Therefore, the information (e.g., pupil position) described in "(2) First example of the first embodiment (information detection device)" of Part 1 can be detected.

[0138] The video projection device 400 is a device in which a video display light irradiation unit 420 is added to the information detection device 100 described above in "(2) First Example of First Embodiment (Information Detection Device)" of Section 1. Hereinafter, the light guide unit 402 and the video display light irradiation unit 420 are mainly described.

[0139] The light guide unit 402 may have a property of transmitting the illumination light emitted from the irradiation unit 401 and reflecting the reflected light from the eyeball. In the case where the light emitted from the irradiation unit 401 is not parallel light, the light guide unit 402 may advantageously have an optical property of collimating the light.

[0140] In addition, the light guiding unit 402 may have a property of reflecting the video display light emitted by the video display light irradiation unit 420. Advantageously, the light guiding unit 402 reflects the video display light so that the video display light emitted from the video display light irradiation unit 420 is gathered near the pupil and emitted toward the retina. That is, the light guiding unit 402 may diffract the video display light so that the video display light travels straight through the pupil. This makes it possible to present a video to the user through a so-called Maxwellian view. Therefore, a clear video can be presented to the user.

[0141] In the present technology, the video display light can be gathered near the pupil (for example, on the pupil), or can be deviated from the pupil by several mm to several tens of mm (for example, 1 mm to 20 mm, in particular, 2 mm to 15 mm) in the optical axis direction. Even if the focus is not on the pupil as in the latter case, the Maxwell view can be achieved. The shift of the focus in the optical axis direction makes it possible for the user to not easily lose the video even if the video is shifted. More specifically, the video display light can be gathered on the pupil, in the lens, or between the corneal surface and the pupil.

[0142] For example, when the video projection device 400 is a glasses-like device, the light guiding unit 102 may be, for example, a lens of the glasses-like device itself. Alternatively, the light guiding unit 102 may be configured as a part of the lens.

[0143] The video display light irradiation unit 420 emits video display light toward the light guide unit 402. The video display light to be emitted may be emitted radially. The video display light irradiation unit 420 may be controlled by the controller 405. For example, the controller 405 may control the video display light irradiation unit 420 to emit the video display light so that the video display light is gathered at the pupil position estimated by the controller 405. This makes it possible to present the video to the user more reliably.

[0144] The video display light may be, for example, light that may be used to present a video to a user through a Maxwell view. The video display light may be, for example, light emitted by a light emitting diode (LED) or a cathode ray tube (CRT).

[0145] For example, in the case where the video projection device 400 is a glasses-like device, the video display light irradiation unit 420 can be attached to the temple portion of the glasses-like device, for example. Alternatively, the video display light irradiation unit 420 can be included in the temple portion. The video is presented to the user through the video display light irradiation unit 420, whereby the video is superimposed on the external scene that the user sees through the lens of the glasses-like device.

[0146] (3) Second Example of the Second Embodiment (Video Projection Device)

[0147] Will refer to Figure 5 Another example of the video projection device according to the present technology is described. Figure 5 2 is a schematic diagram of a video projection device according to the present technology. In this schematic diagram, the traveling direction of the light used for information detection according to the present technology and the traveling direction of the video display light are indicated by dashed arrows.

[0148] like Figure 5 As shown, the video projection device 500 includes an irradiation unit 501, a light guide unit 502, a scanning mirror 503, a detection unit 504, and a controller 505. The video projection device 500 also includes a half mirror 506 and a video display light irradiation unit 520.

[0149] Among these components, the irradiation unit 501, the light guide unit 502, the scanning mirror 503, the detection unit 504, the controller 505, and the half-reflection mirror 506 correspond to the irradiation unit 301, the light guide unit 302, the scanning mirror 303, the detection unit 304, the controller 305, and the half-reflection mirror 306 described above in “(3) Second example of the first embodiment (information detection device)” of Section 1. Therefore, the information (e.g., pupil position) described above in “(3) Second example of the first embodiment (information detection device)” of Section 1 can be detected.

[0150] The video projection device 500 may also be a device in which a video display light irradiation unit 520 is added to the information detection device 300 described above in "(3) Second example of the first embodiment (information detection device)" of Section 1. In the following, the light guide unit 502 and the video display light irradiation unit 520 are mainly described.

[0151] The light guide unit 502 may have a property of reflecting the illumination light emitted from the irradiation unit 501 and reflecting the reflected light from the eyeball.

[0152] In addition, the light guiding unit 502 may have a characteristic of reflecting the video display light emitted by the video display light irradiation unit 520. Advantageously, the light guiding unit 502 reflects the video display light so that the video display light emitted from the video display light irradiation unit 520 is gathered near the pupil and emitted toward the retina. That is, the light guiding unit 502 may diffract the video display light so that the video display light travels straight through the pupil. This makes it possible to present a video to the user through a so-called Maxwell view. Therefore, a clear video can be presented to the user.

[0153] The video display light irradiation unit 520 emits video display light toward the light guide unit 402. The video display light to be emitted can be emitted radially. The video display light irradiation unit 520 can be controlled by the controller 505. For example, the controller 505 can control, for example, the video display light irradiation unit 520 to emit video display light so that the video display light is gathered at the pupil position estimated by the controller 505. This makes it possible to present the video to the user more reliably. The video display light can be, for example, light that can be used to present the video to the user through the Maxwell view. The video display light can be, for example, light emitted by an LED or a CRT.

[0154] For example, in the case where the video projection device 500 is a glasses-like device, the video display light irradiation unit 520 can be attached to the temple portion of the glasses-like device, for example. Alternatively, the video display light irradiation unit 520 can be included in the temple portion. The video is presented to the user through the video display light irradiation unit 520, whereby the video is superimposed on the external scene that the user sees through the lens of the glasses-like device.

[0155] (4) Third Example of Second Embodiment (Video Projection Device)

[0156] Will refer to Figure 6 Another example of the video projection device according to the present technology is described. Figure 6 2 is a schematic diagram of a video projection device according to the present technology. In this schematic diagram, the traveling direction of light used for information detection by the video projection device and the traveling direction of video display light are indicated by dashed arrows.

[0157] like Figure 6 As shown, the video projection device 600 includes an irradiation unit 601 , a light guiding unit 602 , a scanning mirror 603 , a detection unit 604 , and a controller 605 . The video projection device 600 also includes a half mirror 606 .

[0158] The irradiation unit 601 is configured to irradiate the eyeball 650 with the illumination light 661 via the scanning mirror 603. That is, the illumination light 661 is scanned and emitted toward the eyeball.

[0159] Advantageously, the illumination light 661 may be emitted as a beam of light from the irradiation unit 601. More advantageously, the irradiation unit 601 emits a beam of infrared light, in particular, an infrared laser beam.

[0160] The illumination light 661 emitted from the irradiation unit 601 is reflected by the half mirror 606 and reaches the scanning mirror 603 , is further reflected by the scanning mirror 603 and reaches the light guiding unit 602 , and is further reflected by the light guiding unit 602 and reaches the eyeball 650 .

[0161] The illumination unit 601 is configured to emit video display light 663 in addition to the illumination light 661. For example, the illumination light 661 and the video display light 663 may be output in a multiplexed state by the illumination unit 601. The video is presented to the user through the video display light 663.

[0162] The irradiation unit 601 may output, for example, laser light in which video display light and illumination light are multiplexed, particularly laser light in which red, green, and blue laser light and infrared laser light are multiplexed.

[0163] For example, in the case where the video projection device 600 is a glasses-like device, the irradiation unit 601 can be attached to any position of the temples of the glasses-like device. Alternatively, the irradiation unit 601 can be configured to be included in the temples. The video is presented to the user through the irradiation unit 601, whereby the video is superimposed on the external scene that the user sees through the lens of the glasses-like device.

[0164] The light guide unit 602 may have the characteristics of reflecting the illumination light 661 and the video display light 663 emitted from the irradiation unit 601 and reflecting the reflected light 662 from the eyeball. Advantageously, the light guide unit 602 may have the characteristics of reflecting the illumination light 661 to reach the position to be scanned on the eyeball, and reflecting the video display light 663 to be concentrated at the pupil position to illuminate the retina (particularly, through the center of the pupil). An optical element known in the art may be used as a light guide unit having these characteristics. Examples of the optical element include a holographic optical element.

[0165] For example, Figure 6 As shown on the left side of FIG. 6 , when the illumination light 661 and the video display light 663 reach the position 673 of the light guide unit 602, both the illumination light 661 and the video display light 663 are reflected to pass through the center 671 of the pupil. Figure 6 As shown on the right side of , when the illumination light 661 and the video display light 663 reach the position 674 of the light guide unit 602, the illumination light 661 is reflected to be emitted toward a position 672 deviated from the center of the pupil, and the video display light 663 is reflected to pass through the center 671 of the pupil.

[0166] The scanning mirror 603 may be, for example, a MEMS mirror. As described above, the scanning mirror 603 scans the illumination light 661 and the video display light 663 (or a combination thereof) emitted by the irradiation unit 601, and also scans the reflected light 662 reflected on the eyeball 650. That is, in the video projection device 600 according to the present example, by scanning the illumination light with the scanning mirror, the reflected light from the eyeball and the video display light are also scanned.

[0167] When the eyeball is illuminated with illumination light, reflected light is generated. When this reflected light is scanned, information about the eyeball can be obtained.

[0168] In addition, the video display light is scanned on the retina, thereby presenting the video to the user. The video display light is gathered, for example, near the pupil by this scanning, and is emitted toward the retina. That is, the video display light travels straight through the pupil. This makes it possible to present the video to the user through the so-called Maxwell view. Therefore, a clear video can be presented to the user.

[0169] For example, if the surface of the scanning mirror 603 is oriented as shown in FIG. Figure 6 , then the reflected light (e.g., surface reflected light or cornea reflected light) passing through the center 671 of the eyeball 650 is reflected by the light guide unit 602 and the scanning mirror 603, passes through the half mirror 606, and is detected by the detector 604. If the orientation of the surface of the scanning mirror 603 is changed to Figure 6 , then the reflected light (for example, including scattered light reflected on the iris) passing through the position 672 of the eyeball 650 is reflected by the light guide unit 602 and the scanning mirror 603, passes through the half mirror 606, and is detected by the detector 604. In this way, the position of the reflected light reflected on the eyeball 650 and reaching the detection unit 604 varies depending on the orientation of the surface of the scanning mirror 603, and the intensity of the reflected light varies depending on the position of the reflected light on the eyeball. Therefore, if the scanning mirror 603 is driven, information about the reflected light reflected at various positions on the eyeball 650 can be obtained.

[0170] The detection unit 604 detects the reflected light 662 which is reflected by the scanning mirror 603 and passes through the half mirror 606 .

[0171] The controller 605 may process information related to the reflected light detected by the detector 604 (e.g., the intensity of the reflected light). For example, the controller 605 may obtain information about the eyeball (e.g., the rotation angle of the eyeball, the pupil position, and the sight line direction) based on the information about the reflected light. Advantageously, the controller 605 may perform an estimation process of the pupil position of the eyeball based on the reflected light detected by the detection unit 604.

[0172] In addition, the controller 605 can be configured to control the scanning mirror 603. For example, the controller 605 can drive the scanning mirror 603 within a predetermined scanning oscillation angle. The controller 605 can obtain information related to the scanning mirror 603, for example, information related to the orientation of the surface of the scanning mirror, the scanning oscillation angle, etc.

[0173] Advantageously, the controller 605 can obtain information about the eyeball based on the information about the scanning mirror 603 and the information about the reflected light detected by the detection unit 604. For example, the controller 605 can estimate the pupil position, the sight direction, or the rotation angle of the eyeball based on the scanning oscillation angle of the scanning mirror 603 and the reflected light detected by the detection unit 604 (e.g., the intensity of the reflected light).

[0174] In addition, the controller 605 can control the illumination unit 601 to adjust the video display light to be emitted based on the acquired information about the eyeball. In this way, the video can be displayed at an appropriate position in the user's field of view.

[0175] The controller 605 may include a processor such as a CPU and a memory such as a RAM and / or a ROM. The memory may store a program for causing the device to perform the information detection method or the video projection method according to the present technology, etc. The processor may implement the functions of the controller 605.

[0176] The controller 605 may control the irradiation of the illumination light and / or the video display light of the irradiation unit 601. For example, the controller 605 may turn on or off the irradiation of the illumination light and / or the video display light of the irradiation unit 601. Alternatively, the controller 605 may change the intensity or type of the illumination light and / or the video display light to be emitted. In addition, the controller 605 may control the driving of the scanning mirror 603. For example, the controller 605 may change the scanning oscillation angle of the scanning mirror 603. In addition, the controller 605 may control the detection of the detection unit 604. For example, the controller 605 may turn on or off the detection operation performed by the detection unit 604.

[0177] The half mirror 606 may have a property of reflecting the illumination light 661 and the video display light 663 (or a combination thereof) and transmitting the reflected light 662. This allows only the reflected light 662 to selectively reach the detection unit 604.

[0178] In the video projection device 600, as described above, the irradiation unit 601 is configured to emit illumination light and video display light, so the device can be miniaturized. In addition, since the optical system (e.g., scanning mirror) on the path of the illumination light, video display light, and reflected light is shared, the device can be further miniaturized.

[0179] 3. Third embodiment (information detection method)

[0180] (1) Description of the Third Embodiment

[0181] The present technology also provides an information detection method, which includes: irradiating an eyeball with light; scanning reflected light from the eyeball through a scanning mirror; and detecting the reflected light scanned by the scanning mirror.

[0182] The information detection method according to the present technology can detect the information of the eyeball as described above in Part 1.

[0183] (2) Example of the third embodiment (information detection method)

[0184] In the following, reference will be made to Figure 1 and Figure 7 An example of an information detection method according to the present technology is described. Figure 7 : is a diagram showing an example of the flow of the information detection method according to the present technology.

[0185] In step S101 , the information detection device 100 starts the information detection process according to the present technology.

[0186] In step S102, the controller 105 causes the irradiation unit 101 to irradiate the eyeball with illuminating light. Advantageously, the emitted light is non-visible light, and more advantageously, it is infrared light. For example, the illuminating light may be emitted only when the pupil position needs to be detected. Alternatively, the illuminating light may be emitted at predetermined time intervals.

[0187] In step S103, the controller 105 drives the scanning mirror 103 to scan the reflected light generated by irradiating the illumination light on the eyeball in step S102. As a result of the scanning, the reflected light reflected at each of the various positions of the eyeball proceeds to the detection unit 104.

[0188] In step S104, the controller 105 causes the detection unit 104 to detect the reflected light scanned in step S103. As a result of the detection, information on the reflected light, for example, the intensity of the reflected light can be obtained.

[0189] In step S105 , the controller 105 obtains information about the eyeball based on the information about the reflected light obtained in step S104 and the information about the scanning in step S103 .

[0190] In step S106 , the information detection device 100 ends the information detection process according to the present technology.

[0191] For example, the above processing can be performed by an information detection device or a video projection device according to the present technology. For more detailed operations of the components of these devices in the above steps, please refer to the above "1. First embodiment (information detection device)" and "2. Second embodiment (video projection device)".

[0192] 4. Fourth Embodiment (Video Projection Method)

[0193] (1) Description of the Fourth Embodiment

[0194] The present technology also provides a video projection method, which includes: irradiating an eyeball with light; scanning reflected light from the eyeball with a scanning mirror; detecting the reflected light scanned by the scanning mirror; estimating the pupil position of the eyeball based on the reflected light detected in the detection step; and irradiating the pupil position estimated in the estimation step with video display light so that the video display light passes through the pupil position.

[0195] The video projection method according to the present technology can detect the information of the eyeball as described above in Section 1. Furthermore, the video projection method according to the present technology can emit the video display light toward an accurate position based on the detected information of the eyeball.

[0196] (2) Example of the fourth embodiment (video projection method)

[0197] Below, refer to Figure 6 and Figure 8 An example of a video projection method according to the present technology is described. Figure 8 : is a diagram showing an example of the flow of a video projection method according to the present technology.

[0198] In step S201 , the video projection device 600 starts the video projection process according to the present technology.

[0199] In step S202, the controller 605 causes the irradiation unit 601 to irradiate the eyeball with illuminating light. Advantageously, the light to be emitted is non-visible light, more advantageously infrared light. For example, the illuminating light may be emitted only when the pupil position needs to be detected. Alternatively, the illuminating light may be emitted at predetermined time intervals.

[0200] In step S203, the controller 605 drives the scanning mirror 603 to scan the reflected light generated by irradiating the illumination light onto the eyeball in step S202. As a result of the scanning, the reflected light reflected at each of the various positions of the eyeball proceeds to the detection unit 604.

[0201] In step S204, the controller 605 causes the detection unit 604 to detect the reflected light scanned in step S203. As a result of the detection, information on the reflected light, for example, the intensity of the reflected light can be obtained.

[0202] In step S205 , the controller 605 obtains information about the eyeball based on the information about the reflected light obtained in step S204 and the information about the scan in step S203 .

[0203] In step S206, the controller 605 causes the irradiation unit 601 to emit video display light adjusted based on the information about the eyeball obtained in step S205 (eg, pupil position). Thus, the eyeball is irradiated with the video display light, so that the user can recognize the video.

[0204] In step S207 , the video projection device 600 ends the video projection process according to the present technology.

[0205] The above processing can be performed by, for example, a video projection device according to the present technology. For more detailed operations of each component of the device in each of the above steps, please refer to the above "2. Second embodiment (video projection device)".

[0206] 5. Device configuration example

[0207] The following reference Fig. 9 and Fig.10 A specific example of the video projection device according to the present technology is described.

[0208] Fig. 9 A head mounted display (hereinafter referred to as HMD) 900 as an example of a video projection device according to the present technology is shown. The HMD 900 is a glasses-like device, that is, a glasses display.

[0209] The main constituent elements for performing information detection according to the present technology are provided in the nose pad 951 of the HMD 900. That is, in the nose pad 951 of the HMD 900, the irradiation unit 901, the half mirror 906, the scanning mirror 903, the detection unit 904, and the controller 905 are provided. Note that the controller 905 may be provided not in the nose pad 951 but in, for example, the temple 953.

[0210] In the temple 953 of the HMD 900, a main component for presenting a video to the user based on the information detected according to the present technology is provided. That is, a video display light irradiation unit 920 is provided in the temple 953 of the HMD 900. The video display light irradiation unit 920 includes an output unit 921, a scanning mirror 922, a lens 923, and an optical system 924. The video display light irradiation unit 920 can be connected to the controller 905.

[0211] In addition, the light guide unit 902 is provided to the lens 952 of the HMD 900 .

[0212] The illumination light emitted from the irradiation unit 901 is reflected by the half mirror 906 and the scanning mirror 903, and reaches the light guide unit 902. The illumination light is further reflected by the light guide unit 902 and reaches the eyeball. The reflected light from the eyeball is reflected by the light guide unit 902, scanned by the scanning mirror 903, and transmitted through the half mirror 906. The reflected light transmitted through the half mirror 906 is detected by the detection unit 904. Based on the information about the detected reflected light and, for example, information about the scanning mirror 903, information about the eyeball is detected. Based on the information about the eyeball, the video display light irradiation unit 920 emits video display light so that the user can accurately recognize the video.

[0213] Fig.10 Another example of an HMD as a video projection device according to the present technology is shown. The HMD 1000 shown in FIG. 100 has a glasses-like shape, that is, it can also be called a glasses display.

[0214] The main components for performing information detection according to the present technology and the main components for presenting a video to the user based on the information detected according to the present technology are provided in the temple 1053 of the HMD 1000. In addition, the HMD 1000 has a common optical system on the path of the illumination light to the eyeball, the reflected light from the eyeball, and the video display light. In other words, the irradiation unit 1001, the scanning mirror 1003, the detection unit 1004, and the controller 1005 are provided in the temple 1053 of the HMD 1000. In addition, the half mirror 1006, the lens 1007, and the optical system (for example, a reflective mirror, etc.) 1008 are provided in the temple 1053 of the HMD 1000. In addition, the light guide unit 1002 is provided in the lens 1052 of the HMD 1000.

[0215] The illumination light emitted from the irradiation unit 1001 reaches the light guide unit 1002 via the half mirror 1006, the optical system 1008, and the scanning mirror 1003. The illumination light is further reflected by the light guide unit 1002 and reaches the eyeball. The reflected light from the eyeball is reflected by the light guide unit 1002, scanned by the scanning mirror 1003, passes through the optical system 1008, and passes through the half mirror 1006. The reflected light passing through the half mirror 1006 is detected by the detection unit 1004. Based on the information related to the detected reflected light and, for example, the information related to the scanning mirror 1003, information about the eyeball is detected. Based on the information related to the eyeball, the irradiation unit 1001 emits video display light so that the user can accurately recognize the video.

[0216] 6. Examples

[0217] (1) Example 1 (Simulation of the first example of the first embodiment)

[0218] The information detection of the information detection device described above in "(2) First Example of First Embodiment (Information Detection Device)" of Section 1 was simulated using OpticStudio (trademark) (manufactured by Zemax LLC.). Fig.11 The configuration of the simulation device is shown. Fig.11 The device 1100 shown includes a parallel light source 1101 as an irradiation unit, a holographic element 1102 as a light guiding unit, a collimating lens 1110 , a scanning mirror 1103 , and a detection unit 1104 .

[0219] The light intensity of the reflected light from the eyeball detected by the detection unit 1104 was acquired through simulation when the eyeball was facing forward relative to the pupil portion and the scanning oscillation angle of the scanning mirror 1103 was between -10 degrees and 10 degrees. Fig.15 The relationship between the scanning oscillation angle and the light intensity is shown.

[0220] In addition, assuming that the eyeball is facing forward at 0 degrees, when the eyeball rotates 5 degrees or 10 degrees, the light intensity of the reflected light detected when the scanning oscillation angle is -10 degrees to 10 degrees is similarly acquired. Fig.12 Also shown is the relationship between the light intensity acquired when the eyeball rotates 5 degrees or 10 degrees and the scanning oscillation angle.

[0221] like Fig.12 As shown, when the eyeball is rotated 0 degrees, 5 degrees, and 10 degrees, the boundary between the scanning oscillation angle when the light intensity exceeds 0 and the scanning oscillation angle when the light intensity is 0 (hereinafter referred to as the edge; Fig.12 The edges of the scanning oscillation angle (indicated by a, b and c) are different, and the edges move with the rotation angle of the eyeball. Therefore, the rotation angle of the eyeball, the pupil position or the direction of sight can be estimated based on the relationship between the scanning oscillation angle and the light intensity.

[0222] In addition, comparing the cases where the eyeball rotates 0, 5, and 10 degrees, the distribution of light intensity moves with the rotation angle of the eyeball. Therefore, the rotation angle of the eyeball, the pupil position, or the line of sight direction can also be estimated based on the distribution of light intensity relative to the scanning oscillation angle.

[0223] The above simulation is the result obtained when the scanning oscillation angle of the scanning mirror is changed to a one-dimensional direction. Therefore, by changing the scanning oscillation angle of the scanning mirror to a two-dimensional direction, information about the eyeball (for example, the rotation angle of the eyeball, the pupil position, and the line of sight) can be estimated more accurately.

[0224] (2) Example 2 (Simulation of the second example of the first embodiment)

[0225] The information detection of the information detection device described above in "(3) Second example of the first embodiment (information detection device)" of Section 1 was simulated using OpticStudio (trademark) (manufactured by Zemax LLC.). Fig.13 The configuration of the simulation device is shown. Fig.13 The device 1300 shown includes an irradiation unit 1301, a hologram element (grating) 1302 as a light guiding unit, a collimating lens 1310, a scanning mirror 1303, and a detection unit 1304. In addition, the device 1300 includes a half mirror 1305.

[0226] The light intensity of the reflected light from the eyeball detected by the detection unit 1304 was acquired through simulation when the eyeball was facing forward relative to the pupil portion and the scanning oscillation angle of the scanning mirror 1303 was between -10 degrees and 10 degrees. Fig.14 The relationship between the scanning oscillation angle and the light intensity is shown.

[0227] In addition, assuming that the eyeball is facing forward at 0 degrees, when the eyeball rotates 5 degrees or 10 degrees, the light intensity detected when the scanning oscillation angle is -10 degrees to 10 degrees is similarly acquired. Fig.14 Also shown is the relationship between the light intensity acquired when the eyeball rotates 5 degrees or 10 degrees and the scanning oscillation angle.

[0228] like Fig.14 As shown, when the eyeball rotates 0 degrees, 5 degrees, and 10 degrees, the edge ( Fig.14 a, b and c) in are different, and the edge moves with the rotation angle of the eyeball. Therefore, the rotation angle of the eyeball, the pupil position or the line of sight direction can be estimated based on the relationship between the scanning oscillation angle and the light intensity.

[0229] Comparing the cases where the eyeball rotates 0, 5, and 10 degrees, the distribution of light intensity moves with the rotation angle of the eyeball. Therefore, the rotation angle of the eyeball, the pupil position, or the line of sight direction can also be estimated based on the distribution of light intensity relative to the scanning oscillation angle.

[0230] In addition, when the eyeballs rotate 0 degrees, 5 degrees, and 10 degrees, the peak values ​​of the protrusions can be confirmed ( Fig.14 The peak is caused by both the surface reflected light on the cornea and the scattered light on the retina. In addition, the area around the peak ( Fig.14 e) in FIG. 1 is caused by scattered light on the retina. Therefore, based on the peak value and / or area, information about the eyeball (eg, pupil position, sight direction, or rotation angle of the eyeball) can be estimated more accurately.

[0231] In the case of using the device 1300, unlike the case of using the device 1100 of Example 1, it is possible to observe the peak and / or area. This is mainly due to the use of a beam of light (particularly a laser) as the illumination light to be emitted toward the eyeball. Therefore, as an irradiation unit for irradiating light to the eyeball, by using an irradiation unit for irradiating a beam of light to the eyeball, information related to the eyeball can be obtained more accurately.

[0232] (3) Example 3 (Simulation of the Second Example of the First Embodiment)

[0233] The information detection of the information detection device described above in "(3) Second example of the first embodiment (information detection device)" of Section 1 was simulated using OpticStudio (trademark) (manufactured by Zemax LLC.). Fig.15 The configuration of the simulation device is shown. Fig.15 The illustrated device 1500 includes an irradiation unit 1501 , a hologram element (grating lens) 1502 as a light guiding unit, a collimator lens 1510 , a scanning mirror 1503 , and a detection unit 1504 . Furthermore, the device 1500 includes a half mirror 1505 .

[0234] Unlike Example 2, hologram element 1502 is a grating lens, that is, has a light-condensing property. Due to the light-condensing property, the illumination light from the irradiation unit is concentrated toward the pupil.

[0235] The light intensity of the reflected light from the eyeball detected by the detection unit 1504 was acquired through simulation when the eyeball was facing forward relative to the pupil portion and the scanning oscillation angle of the scanning mirror 1503 was between -10 degrees and 10 degrees. Fig.16 The relationship between the scanning oscillation angle and the light intensity is shown.

[0236] In addition, assuming that the eyeball is facing forward at 0 degrees, when the eyeball rotates 5 degrees or 10 degrees, the light intensity detected when the scanning oscillation angle is -10 degrees to 10 degrees is similarly acquired. Fig.16 Also shown is the relationship between the light intensity acquired when the eyeball rotates 5 degrees or 10 degrees and the scanning oscillation angle.

[0237] like Fig.16 As shown, when the eyeball rotates 0 degrees, 5 degrees, and 10 degrees, the edge ( Fig.16 a, b and c) in are different, and the edge moves with the rotation angle of the eyeball. Therefore, the rotation angle of the eyeball, the pupil position or the line of sight direction can be estimated based on the relationship between the scanning oscillation angle and the light intensity.

[0238] In addition, comparing the cases where the eyeball rotates 0 degrees, 5 degrees, and 10 degrees, the distribution of light intensity moves with the rotation angle of the eyeball. Therefore, the rotation angle of the eyeball, the pupil position, or the line of sight direction can also be estimated based on the distribution of light intensity.

[0239] In each case where the eyeball is rotated 0 degrees, 5 degrees, and 10 degrees, a peak of protrusion can be confirmed ( Fig.16 The peak is caused by both the surface reflected light on the cornea and the scattered light on the retina. In addition, the area around the peak ( Fig.16 e) in FIG. 1 is caused by scattered light on the retina. Therefore, based on the peak value and / or area, information about the eyeball (eg, pupil position, sight direction, or rotation angle of the eyeball) can be estimated more accurately.

[0240] In the case of using the device 1500, unlike the case of using the device 1100 of Example 1, it is possible to observe the peak and / or area. This is mainly due to the use of a beam of light (particularly a laser) as the illumination light to be emitted toward the eyeball. Therefore, as an irradiation unit for irradiating light to the eyeball, by using an irradiation unit for irradiating a beam of light to the eyeball, information related to the eyeball can be obtained more accurately.

[0241] Although the rotation angle of the eyeball in Examples 2 and 3 is the same, the intervals of the three peaks and the intervals of the three edges observed when the device 1500 is used are wider than those when the device 1300 is used in Example 2. That is, even at the same rotation angle, the resolution is higher when the device 1500 is used. This difference is due to the fact that since the device 1500 uses a grating lens, the illumination light is focused on the eyeball, while since the device 1300 uses a grating, the illumination light is not focused on the eyeball. Therefore, by focusing the illumination light on the eyeball with a grating lens, it is believed that information about the eyeball can be obtained with higher accuracy.

[0242] Furthermore, the three edges observed when using device 1300 are sharper than the edges observed when using device 1500. Therefore, in order to obtain information about the eyeball based on the edges, it is considered better to use an irradiation unit that allows illumination light to pass straightly relative to the eyeball without concentrating the illumination light.

[0243] The intensity in the region "e" observed when the device 1300 is used (scattered light on the retina) is higher than the intensity acquired when the device 1500 is used. This difference can be attributed to the fact that the intensity of the scattered light on the retina detected by the detection unit is low because the illumination light does not go straight toward the eyeball when the device 1500 is used. Therefore, in order to obtain information related to the eyeball based on the intensity of the scattered light on the retina, it is best to consider using an illumination unit that illuminates the eyeball with illumination light as parallel light without focusing the illumination light on the pupil.

[0244] (4) Example 4 (Simulation of the first example of the second embodiment)

[0245] The information detection of the video projection device described above in "(2) First example of the second embodiment (video projection device)" of Section 2 was simulated using OpticStudio (trademark) (manufactured by Zemax LLC.). Fig.17 The structure of the simulation device is shown in FIG. Fig.17 As shown, the video projection device 1700 includes an irradiation unit 1701 , a light guiding unit 1702 , a scanning mirror 1703 , and a detection unit 1704 . The video projection device 1700 further includes a video display light irradiation unit 1720 .

[0246] The video projection device 1700 is a device that is a video display light irradiation unit that is a specific embodiment of the video projection device 400 described above in "(2) First example of the second embodiment (video projection device)". That is, the video display light irradiation unit 1720 includes an output unit 1721, a scanning mirror 1722, and a lens 1723. The output unit 1721 outputs video display light. The direction, intensity, etc. of the output video display light are adjusted by the optical system 1724. The output video display light is scanned by the scanning mirror 1722. The scanned video display light is collimated by the lens 1723 and reaches the light guide unit 1702. In this way, the video display light irradiation unit 1720 collimates the scanned video display light and irradiates the light guide unit 1702 with the video display light.

[0247] The light guide unit 1702 reflects the video display light so that the video display light is gathered near the pupil. That is, the light guide unit 1702 is a reflective grating lens for the video display light. The video display light reflected by the light guide unit 1702 passes straight through the pupil (particularly, the center of the pupil) and then reaches the retina. As a result, the user can recognize the video through the video display light.

[0248] In the case where the eyeball is irradiated with video display light through the video display light irradiation unit 1720, the eyeball is facing forward relative to the light guide unit, and the scanning oscillation angle of the scanning mirror 1703 is -10 degrees to 10 degrees, the light intensity of the reflected light from the eyeball detected by the detection unit 1704 is acquired through simulation.

[0249] In addition, assuming that the eyeball is facing the front at 0 degrees, when the eyeball is rotated 5 degrees or 10 degrees, the light intensity of the reflected light detected when the scanning oscillation angle is -10 degrees to 10 degrees is also obtained similarly. The simulation results are similar to the results obtained in the above-mentioned Example 1. Therefore, it can be understood that in the case where the video display light is emitted by the video display light irradiation unit, information related to the eyeball can also be detected.

[0250] (5) Example 5 (Simulation of the Second Example of the Second Embodiment)

[0251] The information detection of the video projection device described above in "(3) Second Example of Second Embodiment (Video Projection Device)" of Section 2 was simulated using OpticStudio (trademark) (manufactured by Zemax LLC.). Fig.18 The structure of the simulation device is shown in FIG. Fig.18 As shown, the video projection device 1800 includes an irradiation unit 1801 , a light guiding unit 1802 , a scanning mirror 1803 , and a detection unit 1804 . The video projection device 1800 further includes a half mirror 1806 and a video display light irradiation unit 1820 .

[0252] The video projection device 1800 is a device that is a video display light irradiation unit that is a specific embodiment of the video projection device 500 described in "(3) Second example of the second embodiment (video projection device)". That is, the video display light irradiation unit 1820 includes an output unit 1821, a scanning mirror 1822, and a lens 1823. The output unit 1821 outputs video display light. The direction, intensity, etc. of the output video display light are adjusted by the optical system 1824. The output video display light is scanned by the scanning mirror 1822. The scanned video display light is collimated by the lens 1823 and reaches the light guide unit 1802. In this way, the video display light irradiation unit 1820 collimates the scanned video display light and irradiates the light guide unit 1802 with the video display light.

[0253] The light guide unit 1802 reflects the video display light so that the video display light is gathered near the pupil. That is, the light guide unit 1802 is a reflective grating lens for the video display light. The video display light reflected by the light guide unit 1802 passes straight through the pupil (particularly, the center of the pupil) and then reaches the retina. As a result, the user can recognize the video through the video display light.

[0254] In addition, the video projection device 1800 includes a lens 1825 between the scanning mirror 1803 and the light guide unit 1802. The illumination light scanned by the scanning mirror 1803 is collimated by the lens 1825 to reach the light guide unit 1802. Then, the light guide unit 1802 reflects the collimated illumination light, and the illumination light reaches the eyeball. That is, the light guide unit 1802 is a reflection grating for the illumination light.

[0255] In the case where the eyeball is irradiated with video display light through the video display light irradiation unit 1820, the eyeball is facing forward relative to the light guide unit, and the scanning oscillation angle of the scanning mirror 1803 is between -10 degrees and 10 degrees, the light intensity of the reflected light from the eyeball detected by the detection unit 1804 is acquired through simulation.

[0256] In addition, assuming that the eyeball is facing forward at 0 degrees, when the eyeball rotates 5 degrees or 10 degrees, the light intensity of the reflected light detected when the scanning oscillation angle is -10 degrees to 10 degrees is similarly acquired.

[0257] The simulation results are similar to those obtained in the above-mentioned Example 2. Therefore, it can be understood that in the case where the video display light is emitted by the video display light irradiation unit, it is possible to detect information related to the eyeball.

[0258] (6) Example 6 (Simulation of the third example of the second embodiment)

[0259] The information detection of the video projection device described above in "(4) Third example of the second embodiment (video projection device)" of Section 2 was simulated using OpticStudio (trademark) (manufactured by Zemax LLC.). Fig.19 The structure of the simulation device is shown in FIG. Fig.19 As shown, the video projection device 1900 includes an irradiation unit 1901, a light guiding unit 1902, a scanning mirror 1903, and a detection unit 1904. The video projection device 1900 also includes a half mirror 1906 and a lens 1907.

[0260] The video projection device 1900 has a configuration similar to that of the video projection device 600 described above in “(4) Third example of the second embodiment (video projection device)”.

[0261] Note that the video projection device 1900 and the video projection device 600 are different from each other in that the configurations of the irradiation unit and the detection unit are exchanged, and in the former, the half mirror 1906 transmits the illumination light and the video display light and reflects the reflected light. In addition, the video projection device 1900 is also different in that a lens 1907 is provided between the scanning mirror 1903 and the light guide unit 1902. The illumination light scanned by the scanning mirror 1903 is collimated by the lens 1907 to reach the light guide unit 902. Then, the light guide unit 902 reflects the collimated illumination light, and the illumination light reaches the eyeball. That is, the light guide unit 1902 is a reflection grating for the illumination light.

[0262] In the case where the eyeball 1950 is irradiated with video display light via the scanning mirror 1903 through the irradiation unit 1901, the eyeball 1950 is facing forward relative to the light guide unit, and the scanning oscillation angle of the scanning mirror 1903 is between -10 degrees and 10 degrees, the light intensity of the reflected light from the eyeball 1950 detected by the detection unit 1904 is acquired through simulation.

[0263] In addition, assuming that the eyeball 1950 is facing the front at 0 degrees, when the eyeball 1950 rotates 5 degrees or 10 degrees, the light intensity of the reflected light detected when the scanning oscillation angle is -10 degrees to 10 degrees is similarly acquired.

[0264] The simulation results are similar to those obtained in the above-described Example 2. Therefore, it can be understood that information related to the eyeball can be detected even when the eyeball is irradiated with the video display light on the same path as the illumination light by the video display light irradiation unit.

[0265] In addition, the present technology may also have the following configurations.

[0266] [1] An information detection device, comprising:

[0267] an irradiation unit, the irradiation unit irradiating the eyeball with light;

[0268] a scanning mirror that scans the reflected light from the eyeball; and

[0269] A detection unit detects the reflected light scanned by the scanning mirror.

[0270] [2] The information detection device according to [1] further includes:

[0271] A controller estimates the pupil position or the sight line direction of the eyeball based on the reflected light detected by the detection unit.

[0272] [3] The information detection device according to [2], wherein

[0273] The controller estimates the pupil position or the sight line direction of the eyeball based on the scanning oscillation angle of the scanning mirror and the reflected light detected by the detection unit.

[0274] [4] The information detection device according to [2], wherein

[0275] The controller estimates a pupil position or a sight line direction of the eyeball based on a scanning oscillation angle of the scanning mirror and an intensity of the reflected light detected by the detection unit.

[0276] [5] The information detection device according to any one of [1] to [4], wherein

[0277] The irradiation unit is configured to irradiate the eyeball with the light without passing through the scanning mirror.

[0278] [6] The information detection device according to any one of [1] to [5], wherein

[0279] The irradiation unit is configured to irradiate the eyeball with the light via the scanning mirror.

[0280] [7] The information detection device according to any one of [1] to [6], wherein

[0281] The light used to illuminate the eyeball is non-visible light.

[0282] [8] The information detection device according to any one of [1] to [7], wherein

[0283] The light used to illuminate the eyeball is infrared light.

[0284] [9] The information detection device according to any one of [1] to [8], wherein

[0285] The light used to illuminate the eyeball is a beam of light.

[0286]

[10] A video projection device, comprising:

[0287] an irradiation unit, the irradiation unit irradiating the eyeball with light;

[0288] a scanning mirror, the scanning mirror scanning the reflected light from the eyeball;

[0289] a detection unit, the detection unit detecting the reflected light scanned by the scanning mirror;

[0290] a controller that estimates the pupil position of the eyeball based on the reflected light detected by the detection unit; and

[0291] A video display light irradiation unit irradiates the pupil position estimated by the controller with video display light so that the video display light passes through the pupil position.

[0292]

[11] The video projection device according to

[10] , wherein

[0293] The video display light is focused near the pupil, and the retina is illuminated with the video display light.

[0294]

[12] The video projection device according to

[10] or

[11] , wherein

[0295] The eyeball is illuminated with the video display light via the scanning mirror.

[0296]

[13] The video projection device according to any one of

[10] to

[12] , wherein

[0297] The video projection device is a glasses display.

[0298]

[14] An information detection method, comprising:

[0299] Shine a light on the eyeball;

[0300] scanning the reflected light from the eyeball by a scanning mirror; and

[0301] The reflected light scanned by the scanning mirror is detected.

[0302]

[15] A video projection method, comprising:

[0303] Shine a light on the eyeball;

[0304] scanning the reflected light from the eyeball by a scanning mirror;

[0305] detecting reflected light scanned by the scanning mirror;

[0306] estimating the pupil position of the eyeball based on the reflected light detected in the detecting step; and

[0307] The pupil position estimated in the estimating step is illuminated with video display light so that the video display light passes through the pupil position.

[0308] Reference Designator List

[0309] 100,300 Information detection device

[0310] 101,301 Irradiation Unit

[0311] 102,302 Light guide unit

[0312] 103,303 Scanning mirror

[0313] 104,304 Detection Units

[0314] 105,305 Controller

Claims

1. An information detection device, comprising: an irradiation unit, the irradiation unit irradiating the eyeball with light; a scanning mirror, the scanning mirror scanning the reflected light from the eyeball; a detection unit that detects reflected light scanned by the scanning mirror; and Light guide unit, wherein the irradiation unit is configured to irradiate the eyeball with the light without passing through the scanning mirror, Wherein, in a case where the irradiation unit is arranged so that light passes through the light guide unit and reaches the eyeball, the irradiation unit is arranged on a side of the light guide unit opposite to the eyeball side, In the case where the irradiation unit is disposed so that light reaches the eyeball without passing through the light guide unit, the irradiation unit is disposed on the eyeball side of the light guide unit.

2. The information detection device according to claim 1, further comprising: A controller estimates the pupil position or the sight line direction of the eyeball based on the reflected light detected by the detection unit.

3. The information detection device according to claim 2, wherein The controller estimates the pupil position or the sight line direction of the eyeball based on the scanning oscillation angle of the scanning mirror and the reflected light detected by the detection unit.

4. The information detection device according to claim 2, wherein The controller estimates a pupil position or a sight line direction of the eyeball based on a scanning oscillation angle of the scanning mirror and an intensity of the reflected light detected by the detection unit.

5. The information detection device according to claim 1, wherein The irradiation unit is configured to irradiate the eyeball with the light via the scanning mirror.

6. The information detection device according to claim 1, wherein The light used to illuminate the eyeball is non-visible light.

7. The information detection device according to claim 1, wherein The light used to illuminate the eyeball is infrared light.

8. The information detection device according to claim 1, wherein The light used to illuminate the eyeball is a beam of light.

9. A video projection device, comprising: an irradiation unit, the irradiation unit irradiating the eyeball with light; a scanning mirror, the scanning mirror scanning the reflected light from the eyeball; a detection unit, the detection unit detecting the reflected light scanned by the scanning mirror; a controller that estimates the pupil position of the eyeball based on the reflected light detected by the detection unit; as well as a video display light irradiation unit that irradiates the pupil position estimated by the controller with video display light so that the video display light passes through the pupil position, The irradiation unit is configured to irradiate the eyeball with the light without passing through the scanning mirror.

10. The video projection device according to claim 9, wherein The video display light is focused near the pupil, and the retina is illuminated with the video display light.

11. The video projection device according to claim 9, wherein The eyeball is illuminated with the video display light via the scanning mirror.

12. The video projection device according to claim 9, wherein The video projection device is a glasses display.

13. An information detection method, comprising: Shine a light on the eyeball; scanning the reflected light from the eyeball by a scanning mirror; as well as detecting the reflected light scanned by the scanning mirror, The eyeball is illuminated by the light without passing through the scanning mirror.

14. A video projection method, comprising: Shine a light on the eyeball; scanning the reflected light from the eyeball by a scanning mirror; detecting reflected light scanned by the scanning mirror; estimating the pupil position of the eyeball based on the reflected light detected in the detecting step; as well as irradiating the pupil position estimated in the estimation step with video display light so that the video display light passes through the pupil position, The eyeball is illuminated by the light without passing through the scanning mirror.

Images