Electronic device, electronic device control method, and program
The electronic device simplifies gaze input by authenticating users through iris or fingerprint detection and recording line-of-sight characteristics, enabling efficient and hassle-free switching between users.
Patent Information
- Application Number
- JP2020080331
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-04-30
- Publication Date
- 2024-12-16
- Estimated Expiration
- 2040-04-30
AI Technical Summary
Existing gaze input technologies face challenges in accurately detecting multiple users' line-of-sight inputs due to individual variations in eyeball rotation and pupil deviation, requiring complex calibration data registration and selection, which is cumbersome and inefficient.
An electronic device with an eyepiece finder and imaging system that authenticates users via iris patterns or fingerprint detection, records line-of-sight characteristics, and uses notification to guide user gaze, allowing seamless switching between users without manual calibration selection.
Simplifies the process of using gaze input across multiple users by automating user authentication and line-of-sight detection, reducing complexity and hassle.
Smart Images

Figure 0007599839000001 
Figure 0007599839000002 
Figure 0007599839000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program. [Background technology]
[0002] Electronic devices have eye gaze input technology that accepts eye gaze input. Patent Document 1 describes a video camera that detects the viewpoint (the position where the user is looking). Biometric authentication also includes technology in which an electronic device identifies (authenticates) an individual user, and Patent Document 2 describes iris authentication technology that uses the iris to identify an individual user. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 5-091394 [Patent Document 2] Special Publication No. 8-504979 Summary of the Invention [Problem to be solved by the invention]
[0004] Here, in the technology of gaze input, because the radius of rotation of the eyeball and the deviation of the gaze when the pupil opens and closes differ for each user, gaze characteristic data called calibration data, which is data for correcting these deviations, is required for each user. However, when multiple people use an electronic device, it is necessary to register (obtain) the calibration data of multiple people in advance, and there are cases where the gaze input cannot be detected correctly when the user of the electronic device changes.
[0005] Even if calibration data for multiple users is registered in advance, the user must select his / her own registered data when using a function that responds to eye gaze input, which is troublesome for the user. Furthermore, unless the user remembers which of the multiple registered calibration data is his / her own data, the user must acquire the calibration data again, which is troublesome.
[0006] Therefore, an object of the present invention is to reduce the complexity when multiple people use eye-gaze input. [Means for solving the problem]
[0007] One aspect of the present invention is a method for producing a composition comprising the steps of: An electronic device, Eyepiece and A control means for controlling so as to record the line of sight characteristic data of the user in a recording means; an imaging means for acquiring a first image of a user's eye by receiving a first light irradiated from a light source and reflected by the user's eye; a notification means for notifying a user to place an eyepiece on the viewfinder when the brightness of the ambient light around the electronic device is lower than a predetermined brightness; When the user's eye is placed on the eyepiece, an authentication means for authenticating a user by detecting an iris pattern of the user based on the first image; a detection means for detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded in the recording means; having The electronic device is characterized in that One aspect of the present invention is a method for producing a composition comprising the steps of: Eyepiece and A control means for controlling so as to record the line of sight characteristic data of the user in a recording means; If the user's eye is not focused on the eyepiece, Authenticates a user by detecting the user's fingerprint pattern When the user's eye is placed in the eyepiece, the user is authenticated by a method other than detecting the fingerprint pattern. and an authentication means for a detection means for detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded in the recording means; having The electronic device is characterized by 。
[0008] One aspect of the present invention is a method for producing a composition comprising the steps of: A method for controlling an electronic device, comprising: A control step of controlling so as to record the user's line of sight characteristic data in a recording means; an authentication step of authenticating a user by detecting an iris pattern of the user based on a first image of the user's eye obtained by receiving a first light beam emitted from a light source and reflected by the user's eye; a notification step of notifying a user to place his / her eye on an eyepiece viewfinder when the brightness of the ambient light around the electronic device is lower than a predetermined brightness; When the user's eye is placed on the eyepiece, A detection step of detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded. The present invention relates to a method for controlling an electronic device. One aspect of the present invention is a method for producing a composition comprising the steps of: A control step of controlling so as to record the user's line of sight characteristic data in a recording means; If the user's eyes are not focused on the eyepiece, Authenticates a user by detecting the user's fingerprint pattern When the user's eye is placed in the eyepiece, the user is authenticated by a method other than detecting the fingerprint pattern. an authentication process for a detection step of detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded in the recording means; having A method for controlling an electronic device, comprising: 。 Effect of the Invention
[0009] According to the present invention, it is possible to reduce the complexity when a plurality of people use eye-gaze input. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram showing the configuration of an imaging device according to a first embodiment. [Diagram 2]FIG. 1 is a diagram for explaining recording of calibration data according to the first embodiment; [Diagram 3] FIG. 1 is a diagram for explaining how to read calibration data according to the first embodiment; [Figure 4] Flowchart of setting calibration data according to the first embodiment [Diagram 5] FIG. 11 is a diagram for explaining how to read calibration data according to the second embodiment. [Figure 6] FIG. 13 is a diagram for explaining recording of calibration data according to the third embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0012] <Embodiment 1> [Configuration of imaging device] The configuration of an imaging device 100 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a configuration diagram of the imaging device 100 according to embodiment 1. Here, the imaging device 100 is not limited to a camera such as a digital camera, but may be another electronic device such as a smartphone or a personal computer, as long as it is capable of receiving gaze input from a user.
[0013] The imaging device 100 includes a lens unit 101, an imaging element 102, a light source unit 103, an image processing circuit 109, a recording unit 110, a memory circuit 111, a control circuit 112, a display unit 113, a detection unit 114, and an iris authentication unit 115. The imaging device 100 also includes an operation unit 116, a display unit 117, a line-of-sight imaging element 118, and a bus 120.
[0014] The lens unit 101 collects incident light from a subject onto the image sensor 102. The lens unit 101 includes, for example, a plurality of lenses, an aperture, and the like.
[0015] The image sensor 102 acquires an image (image data) of a subject based on the light collected by the lens unit 101. The light source unit 103 has a light source that irradiates the subject with light.
[0016] The image processing circuit 109 (development processing unit) performs development processing such as color matrix processing and gamma processing on the image acquired from the image sensor 102. In addition, in these processes, the image processing circuit 109 records the image in a memory circuit 111 as necessary. Then, the image processing circuit 109 outputs the processed image to the display unit 113, the display unit 117, or the recording unit 110.
[0017] The recording unit 110 records (stores) images, programs, and the like. The recording unit 110 also records, for each user, iris data indicating iris characteristics and calibration data linked to the iris data. In this embodiment, the calibration data is line of sight characteristic data used to specify the position of the viewpoint (viewpoint position) by correcting the rotation radius of the eyeball and the shift in the line of sight when the pupil opens and closes for each user. In other words, the calibration data is information that links the direction of the user's eyes with the position (viewpoint position) where the user is actually looking.
[0018] The control circuit 112 executes image processing by the image processing circuit 109 and partial control of driving the image sensor 102. The control circuit 112 also executes control of display of the display unit 113 and the display unit 117, control of receiving instructions from the operation unit 116, and control of data transfer to the memory circuit 111 and the recording unit 110. The control circuit 112 is not limited to controlling the image sensor 102 and the image processing circuit 109, and the image sensor 102 and the image processing circuit 109 may themselves have a control unit.
[0019] Display unit 113 and display unit 117 display the processed image. In this embodiment, display unit 117 is an EVF (electrical viewfinder). The user can view the image displayed on display unit 117 inside imaging device 100 via an eyepiece finder (not shown). In other words, display unit 113 is a display unit that the user views when the user does not place his / her eye on the eyepiece finder, and display unit 117 is a display unit that the user views when the user places his / her eye on the eyepiece finder.
[0020] The detection unit 114 detects the user's line of sight (point of view; looking position; gaze position) based on an image capturing the user's eyes (eye movement). In this embodiment, the user's line of sight (point of view) is detected when the user is looking into the display unit 117 through an eyepiece finder. The detection unit 114 also acquires calibration data for each user. In this embodiment, the user can operate each functional unit of the imaging device 100 according to the viewpoint position. For example, when the viewpoint position on the display unit 117 is detected, the imaging device 100 can perform AF (autofocus) for the detected position. The detection unit 114 detects the user's gaze position based on an image capturing the user's eyes acquired from the gaze image sensor 118.
[0021] The iris authentication unit 115 acquires iris data, which is information unique to a user (biometric authentication data), authenticates the user (performs iris authentication), and associates the calibration data with the iris data (personal user).
[0022] The operation unit 116 generates an operation signal in response to a user operation, and includes a touch panel, a dial, a four-way key, a shutter button, a power switch, a menu button, a playback button, and the like.
[0023] The line-of-sight image sensor 118 is an image for use in detecting the line of sight of a user, and acquires an image of the user's eyes. In this embodiment, the line-of-sight image sensor 118 includes IR pixels that are sensitive to infrared light. The bus 120 is a common path for each functional unit in the imaging device 100 to exchange data with each other.
[0024] [Calibration data acquisition and recording flow] Hereinafter, with reference to FIG. 2, a process flow from when the imaging device 100 is started up to when the calibration data is acquired and further when the calibration data is recorded in the recording unit 110 will be described. FIG. 2 shows a functional unit that executes a process related to the flow of acquiring and recording the calibration data in the imaging device 100. The light source unit 103 has a light source 201, a light source control unit 202, and a prism 205. The light source 201 irradiates infrared light (IR light). The light source control unit 202 controls the light source 201 to irradiate the light to the user's eye 200. The prism 205 is disposed in front of the display unit 117, and refracts the light irradiated from the user's eye 200 to cause the light to enter the line-of-sight image sensor 118.
[0025] First, the light source control unit 202 controls the light source 201 to irradiate infrared light from the light source 201 to the user's eye 200. Then, the infrared light reflected by the user's eye 200 is refracted by the prism 205 and enters the line-of-sight image pickup element 118. The line-of-sight image pickup element 118 detects infrared light. Since it is sensitive to external light, an image of the user's eye 200 can be obtained.
[0026] When the calibration data of the user authenticated by the iris authentication unit 115 is not recorded in the recording unit 110, the data detection unit 204 of the detection unit 114 acquires the calibration data according to the image of the eye 200 acquired by the gaze image sensor 118. Note that if the calibration data is acquired in advance, the detection unit 114 can detect the position (the viewpoint position) at which the user is looking on the display unit 117 according to the image of the user's eye 200 acquired by the gaze image sensor 118.
[0027] The iris authentication unit 115 acquires iris data based on an image from the line-of-sight image sensor 118 when the imaging device 100 is started up. Since the pattern of the iris part differs from person to person, it is possible to identify an individual by treating information obtained by quantifying the feature amount of the pattern as iris data. Then, the iris authentication unit 115 associates (links) the iris data with the calibration data and records it in the recording unit 110. If the recording unit 110 does not record calibration data to be linked to the iris data, the data detection unit 204 acquires the calibration data (performs calibration) as described above. The iris authentication unit 115 may detect the iris pattern not only at the time of start-up, but also when an image is acquired from the line-of-sight image sensor 118 or when an eyepiece detection unit (not shown) detects an eyepiece (near-eye) indicating that the user is looking into the EVF that is the display unit 117. Note that eye proximity detection can be performed, for example, based on a change in the amount of infrared light received by the eye proximity detection unit when the eye proximity detection unit irradiates an object with infrared light and reflects off the object.
[0028] [Calibration data reading flow] 3 is a diagram showing a sequence of reading out calibration data over time (timings T310 to T313). It shows the processes of the light source 201 and the line-of-sight image sensor 118, as well as the processes for line-of-sight detection by the iris authentication unit 115 and the detection unit 114.
[0029] At timing T310, the light source 201 irradiates the user's eye (normal irradiation), and the gaze image sensor 118 acquires an image of the user's eye. When detecting the iris pattern, if the amount of light is insufficient with normal irradiation (irradiation for gaze detection), the light source 201 may increase the amount of light output to be irradiated. In other words, the light source 201 may irradiate different amounts of light for iris authentication and gaze detection.
[0030] At timing T311, the iris authentication unit 115 acquires (extracts) the iris pattern from the acquired eye image.
[0031] At timing T312, if iris data that matches the extracted iris pattern is recorded in recording unit 110, control circuit 112 acquires calibration data that has been associated with the iris data and recorded in recording unit 110. Control circuit 112 sets (determines) the acquired calibration data as data to be used for gaze detection.
[0032] After timing T313, detection unit 114 acquires the user's viewpoint position from the image acquired for gaze detection based on the set calibration data (detects the user's gaze).
[0033] [Calibration data setting process] In the following, using Figure 4, the calibration data is used as the data for gaze detection. The setting process for setting the calibration data will now be described. Fig. 4 is a flowchart showing the setting process for the calibration data. The process of this flowchart starts when the power switch is turned on and the imaging device 100 is started. The process of this flowchart is realized by the control circuit 112 reading and executing a program stored in the recording unit 110 (storage medium).
[0034] In S401, the control circuit 112 controls the iris authentication unit 115 to detect the iris pattern of the user.
[0035] In S402, the control circuit 112 determines whether or not iris data (iris pattern data) matching the iris pattern detected in S401 is recorded in the recording unit 110. If the matching iris pattern detected in S401 is recorded, the process proceeds to S403, and if not, the process proceeds to S404. That is, in S402, the user is identified by the iris pattern (iris authentication), and it is determined whether or not the user has previously performed calibration and had the calibration data recorded in the recording unit 110.
[0036] In S403, the control circuit 112 sets the calibration data associated with the detected iris pattern and recorded in the recording unit 110 as data to be used for gaze detection. That is, in this embodiment, in S402 and S403, the control circuit 112 performs iris authentication, and sets the calibration data associated with the iris-authenticated user and recorded in the recording unit 110 as data to be used for gaze detection.
[0037] In S404, the control circuit 112 displays a selection screen for selecting whether or not to perform calibration on the display unit 117. Thereafter, the control circuit 112 judges whether or not the user who confirmed the selection screen has requested (instructed) calibration. If the user has requested calibration, the process proceeds to S405, and if not, the process proceeds to S407. Note that the process may proceed to S405 without asking the user whether or not to perform calibration, or may proceed to S407 without asking the user.
[0038] In S405, the control circuit 112 controls the detection unit 114 (data detection unit 204) to newly obtain calibration data (perform calibration).
[0039] In S406, the control circuit 112 sets (reflects) the calibration data acquired in S405 as data to be used for gaze detection. In addition, the control circuit 112 links the iris data acquired in S401 and the calibration data acquired in S405 and records (stores) them in the recording unit 110. This allows the user to use the calibration data acquired in S405 from the next time onwards.
[0040] In S407, the control circuit 112 sets standard data, which is general calibration data previously set, as data to be used for gaze detection. Here, the standard data may be average data of calibration data for a general person (multiple people). The standard data may be set at the time of shipment of the imaging device 100 from a factory, or may be set in advance by a user. In addition, a plurality of standard data prepared according to gender, age, race, and height may be previously recorded in the recording unit 110, and in S407, the user may be able to select data to be used for gaze detection from the plurality of standard data.
[0041] As described above, in the first embodiment, the imaging device performs iris authentication (personal authentication), and if calibration data associated with a user who has performed iris authentication is recorded in the recording unit, the calibration data is used to detect the line of sight of the user. If a user has used the device before, the user can be identified by acquiring iris data at startup, and the calibration data of the user recorded in the imaging device can be used smoothly. Even if a user has never used the imaging device, the iris data acquired at startup can be used to link the user with the calibration data and easily record (register) it. Therefore, even when multiple people use the imaging device, functions corresponding to gaze input can be used smoothly.
[0042] <Embodiment 2> In the first embodiment, the light source emits infrared light for gaze detection and iris data acquisition, but in the second embodiment, infrared light is used for gaze detection and visible light (RGB) is used for iris data acquisition. The configuration of the imaging device 100 according to the second embodiment is the same as that of the imaging device 100 according to the first embodiment as shown in Figs. 1 and 2. Only the parts different from the first embodiment will be described below, and the same parts will not be described. Visible light is light with a wavelength visible to the human eye, for example, light with a wavelength of 0.3 μm to 0.7 μm. Infrared light is light with a longer wavelength than the red color of visible light and cannot be seen by the human eye, for example, light with a wavelength of 0.7 μm to 1 mm.
[0043] In this embodiment, the line-of-sight image capture element 118 includes RGB pixels having sensitivity to visible light (RGB) in addition to IR pixels having sensitivity to infrared light. Here, in this embodiment, the display unit 117 also operates as a light source of visible light. As a specific process, the line-of-sight image capture element 118 receives infrared light reflected from the light source 201 with the IR pixels, and outputs the image to the detection unit 114. Also, the line-of-sight image capture element 118 receives visible light reflected from the display unit 117, which is an EVF, with the RGB pixels, and outputs the image to the iris authentication unit 115.
[0044] The reading of the calibration data will be described below with reference to Fig. 5. Fig. 5 is a diagram showing a sequence of reading the calibration data in the second embodiment. In this embodiment, instead of the process at timing T310 of the sequence shown in Fig. 3 according to the first embodiment, a process at timing T510 is executed. In this embodiment, at timing T510, the display unit 117 irradiates visible light and acquires reflected light of the visible light from the user's eye, so that the line-of-sight image sensor 118 acquires an RGB image as an image of the user's eye. The subsequent processes from timing T311 onwards are the same as those according to the first embodiment.
[0045] In this embodiment, the image for gaze detection and the image for iris authentication are both acquired by the image sensor for gaze detection. However, the present invention is not limited to this, and may be configured such that the first image sensor acquires an image for gaze detection (receives infrared light), and the second image sensor different from the first image sensor acquires an image for iris authentication (receives visible light). In addition, in this embodiment, a configuration is described in which two light sources are provided, one for gaze detection and the other for iris authentication, but gaze detection and iris authentication may be performed by one light source. In addition, a light source capable of emitting both infrared light and visible light may be employed, and light may be emitted by switching the irradiation timing between iris authentication and gaze detection.
[0046] As described above, in the second embodiment, when acquiring iris data, light of a different wavelength from the light for detecting the gaze is used. By using different light for imaging in this way, it is possible to easily change the resolution and exposure conditions during imaging for gaze detection and iris authentication, so that optimal conditions can be set according to each application. In addition, since it is easy to separate the functional unit for detecting the gaze and the functional unit for iris authentication, this embodiment can be applied to a variety of devices.
[0047] <Embodiment 3> In the third embodiment, the imaging device 100 identifies a user (personal authentication; identification) by fingerprint authentication instead of iris authentication. In the following, a description of the same parts as in the first embodiment will be omitted, and only the different parts will be described in detail.
[0048] The imaging device 100 according to this embodiment has a fingerprint authentication unit 600 instead of the iris authentication unit 115 in the configuration of the imaging device 100 according to embodiment 1. In addition, in Fig. 6, the light source unit 103, the gaze image sensor 118, and the display unit 117 shown in Fig. 2 are collectively shown as a gaze detection block 610.
[0049] Instead of the process in which the iris authentication unit 115 performs iris authentication (personal authentication) using an image captured by the line-of-sight image sensor 118, the fingerprint detection unit 601 detects the fingerprint pattern of the user, and the fingerprint authentication unit 600 acquires fingerprint data and performs fingerprint authentication. In addition, the recording unit 110 records the fingerprint data in association with the calibration data.
[0050] That is, in this embodiment, when the imaging device 100 is started up, the control circuit 112 controls the fingerprint detection unit 601 to detect the fingerprint pattern of the user, and controls the fingerprint authentication unit 600 to acquire fingerprint data. Then, when fingerprint data matching the acquired fingerprint data is recorded in the recording unit 110, the control circuit 112 sets the calibration data recorded in association with the acquired fingerprint data as data to be used for gaze detection. By performing such processing, the same effect as in the first embodiment can be obtained even when personal authentication is performed using a fingerprint.
[0051] In this embodiment, it is also possible to incorporate fingerprint authentication into other electronic devices such as smartphones or personal computers that do not have an iris authentication function, and to link the calibration data with the fingerprint data.
[0052] Any personal authentication may be used instead of iris authentication or fingerprint authentication. For example, the user's face may be detected to obtain face data, and face authentication may be performed. Personal authentication may also be performed by biometric authentication such as vein patterns, and any authentication method may be used as long as it is possible to link data for authentication (biometric authentication data) with calibration data.
[0053] As described above, in this embodiment, an example has been described in which a user is identified by personal authentication other than iris authentication, and calibration data corresponding to the user is read out. This makes it possible to associate calibration data with a user without relying on a specific personal authentication. For example, in the case of the imaging device according to the first embodiment, iris authentication is not possible unless the user's eyes are in close contact with the camera, but fingerprint authentication (personal authentication) is possible if the user's fingers are gripping the grip. In this way, by changing the method of personal authentication, an effect is obtained in which the range of acquisition timing can be widened.
[0054] In addition, although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.
[0055] For example, face authentication may be used when the brightness of the environmental light around the image capture device 100 is equal to or greater than a predetermined brightness, and iris authentication (or fingerprint authentication) may be performed when the brightness of the environmental light around the image capture device 100 is less than the predetermined brightness (darker than the predetermined brightness). Note that when the brightness of the environmental light around the image capture device 100 is less than the predetermined brightness, a notification unit may notify the user to place their eye on the eyepiece finder. In this way, using multiple authentication methods makes it possible to authenticate a user in many cases.
[0056] Each functional unit in each of the above embodiments may or may not be an individual piece of hardware. The functions of two or more functional units may be realized by common hardware. Each of a plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, or DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.
[0057] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions. [Explanation of symbols]
[0058] 100: imaging device, 110: recording unit, 112: control circuit, 114: detection unit, 115: iris authentication unit
Claims
1. An electronic device, Eyepiece and A control means for controlling so as to record the line of sight characteristic data of the user in a recording means; an imaging means for acquiring a first image of a user's eye by receiving a first light irradiated from a light source and reflected by the user's eye; a notification means for notifying a user to place an eyepiece on the viewfinder when the brightness of the ambient light around the electronic device is lower than a predetermined brightness; an authentication means for authenticating a user by detecting an iris pattern of the user based on the first image when the user's eye is placed in contact with the eyepiece; a detection means for detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded in the recording means; having 1. An electronic device comprising:
2. the imaging means acquires a second image of the user's eye by receiving second light irradiated from a light source and reflected by the user's eye; The detection means detects a line of sight of the user based on the second image.
2. The electronic device according to claim 1 .
3. a first light source that irradiates the first light to an eye of a user; a second light source for irradiating the second light to an eye of a user; 3. The electronic device according to claim 2, further comprising:
4. the first light source is an EVF (electrical viewfinder), The first light is visible light.
4. The electronic device according to claim 3.
5. The first light and the second light have different wavelengths.
5. The electronic device according to claim 2, wherein the first and second electrodes are electrically connected to the first and second electrodes.
6. The first light and the second light have different light intensities.
6. The electronic device according to claim 2, wherein the first and second electrodes are electrically connected to the first and second electrodes.
7. The first light has a greater amount of light than the second light.
7. The electronic device according to claim 6.
8. The second light is infrared light.
8. The electronic device according to claim 2, wherein the first and second electrodes are electrically connected to the first and second electrodes.
9. When the gaze characteristic data of the authenticated user is not recorded in the recording means, the control means allows the user to select whether or not to register the gaze characteristic data.
9. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.
10. An eyepiece viewfinder; A control means for controlling so as to record the line of sight characteristic data of the user in a recording means; an authentication means for authenticating a user by detecting a fingerprint pattern of the user when the user's eyes are not in contact with the eyepiece, and for authenticating a user by a method other than detecting the fingerprint pattern when the user's eyes are in contact with the eyepiece; a detection means for detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded in the recording means; having 1. An electronic device comprising:
11. When the user's eyes are not in contact with the eyepiece and the user's fingers are gripping the grip of the electronic device, the authentication means authenticates the user by detecting the user's fingerprint pattern.
11. The electronic device according to claim 10.
12. The authentication means authenticates the user by detecting a facial pattern of the user when the brightness of the ambient light around the electronic device is equal to or greater than a predetermined brightness.
12. The electronic device according to claim 1, wherein the first and second electrodes are electrically connected to the first and second electrodes.
13. When gaze characteristic data about the authenticated user is recorded in the recording means, the detection means detects the gaze of the user using the recorded gaze characteristic data, and when gaze characteristic data about the authenticated user is not recorded in the recording means, newly acquires gaze characteristic data about the user and detects the gaze of the user using the characteristic data, The control means controls the detection means to record newly acquired line of sight characteristic data in the recording means.
13. The electronic device according to claim 1, wherein the first and second electrodes are arranged in a first direction.
14. When the gaze characteristic data of the authenticated user is not recorded in the recording means, the detection means detects the gaze of the authenticated user by using preset gaze characteristic data.
13. The electronic device according to claim 1, wherein the first and second electrodes are arranged in a first direction.
15. The authentication means authenticates a user when the electronic device is started.
15. The electronic device according to claim 1,
16. The line of sight characteristic data is calibration data for correcting line of sight deviation.
16. The electronic device according to claim 1 .
17. A method for controlling an electronic device, comprising: A control step of controlling so as to record the line of sight characteristic data of the user in a recording means; an authentication step of authenticating a user by detecting an iris pattern of the user based on a first image of the user's eye obtained by receiving a first light beam emitted from a light source and reflected by the user's eye; a notification step of notifying a user to place his / her eye on an eyepiece viewfinder when the brightness of the ambient light around the electronic device is lower than a predetermined brightness; a detection step of detecting a line of sight of the authenticated user by using line of sight characteristic data recorded in association with the authenticated user when the user's eye is placed in contact with the eyepiece finder; 23. A method for controlling an electronic device comprising:
18. A control step of controlling so as to record the line of sight characteristic data of the user in a recording means; an authentication step of authenticating a user by detecting a fingerprint pattern of the user when the user's eyes are not in contact with the eyepiece, and authenticating the user by a method other than detecting the fingerprint pattern when the user's eyes are in contact with the eyepiece; a detection step of detecting a gaze of the authenticated user by using gaze feature data associated with the authenticated user and recorded in the recording means; having 23. A method for controlling an electronic device comprising:
19. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 16.
Citation Information
Patent Citations
Video camera
JP1993091394A
A biometric human identification system based on iris analysis.
JP1996504979A
Information input apparatus and camera
JP2006157154A
Visual line detection device
JP2014211795A
Visual line detection device and visual line detection method
JP2015013031A
