Authentication device

Abstract

A terminal 1 (authentication device) comprises: an eye detection unit 11 that detects an eye E1 of a user; an eye gaze detection unit 12 that detects an eye gaze E of the user on the basis of the detection result of the eye detection unit 11; a state detection unit 13 that detects a state of the eye E1 of the user on the basis of the detection result of the eye detection unit 11; a display unit 14 that displays an authentication pattern M including a mark M1 for guiding the eye gaze E for authentication; and an authentication unit 15 that performs authentication on the basis of the state of the eye E1 at a time when the mark M1 is ahead in the direction of the eye gaze E. Thus, the safety of authentication can be improved.

Description

Authentication Device

[0001] The present disclosure relates to an authentication device.

[0002] An information processing device described in Patent Literature 1 is known as a technology for user authentication. This device acquires the user's electrooculogram (EOG) and unlocks the information processing device if it determines that the acquired EOG satisfies a predetermined condition. This device identifies the numbers the user is looking at on a passcode entry screen based on a change in gaze direction based on the detected EOG. If the sequence of numbers the user is looking at matches a preset authentication passcode, this device unlocks the lock.

[0003] Japanese Patent Application Laid-Open No. 2015-203957

[0004] The device described in Patent Document 1 unlocks the lock state based on the sequence of numbers the user sees on the passcode entry screen. However, if a preset authentication passcode is known by someone other than the user, authentication may be performed by someone other than the user. Therefore, there is a need to improve the security of authentication.

[0005] In order to solve the above problems, an object of the present disclosure is to provide an authentication device that can improve the security of authentication.

[0006] The information processing device according to the present disclosure includes an eye detection unit that detects the user's eyes, a gaze detection unit that detects the user's gaze based on the detection result of the eye detection unit, a state detection unit that detects the state of the user's eyes based on the detection result of the eye detection unit, a display unit that displays an authentication pattern including a mark for guiding the gaze for authentication, and an authentication unit that performs authentication based on the state of the eye when the mark is in the line of sight.

[0007] According to the present disclosure, the security of authentication can be improved.

[0008] 4 is a diagram for explaining the problem of the present disclosure. (a) is a diagram showing an example of an input pattern and an authentication pattern. (b) is a diagram showing another example of an input pattern and an authentication pattern. It is a block diagram showing a terminal according to an embodiment. It is a flowchart showing the operation of a terminal according to an embodiment. It is a flowchart showing a process of setting authentication information shown in FIG. 4. It is a flowchart showing a process of performing authentication shown in FIG. 4. It is a diagram showing a hardware configuration of a terminal according to an embodiment.

[0009] The present disclosure will be described with reference to the accompanying drawings. Whenever possible, the same parts are designated by the same reference numerals and redundant description will be omitted.

[0010] 1 is a diagram illustrating a problem with a terminal 1 (authentication device) according to this embodiment. In this embodiment, the terminal 1 is a mobile terminal such as a smartphone or a tablet terminal. A mobile terminal is a terminal that can be carried by a user. The terminal 1 may also be a non-portable terminal such as a desktop computer.

[0011] The terminal 1 performs authentication. "Performing authentication" means determining whether or not the user operating the terminal 1 is a pre-set user (hereinafter, sometimes referred to as "authenticated user"). If it is determined that the user operating the terminal 1 is an authenticated user, the terminal 1 unlocks the terminal 1 itself. If it is determined that the user operating the terminal 1 is not an authenticated user, the terminal 1 does not unlock the terminal 1 itself.

[0012] The terminal 1 is equipped with a display unit 14 (described below) that displays an authentication pattern M. The display unit 14 displays a preset authentication pattern M. In this embodiment, the display unit 14 displays the authentication pattern M on the display of the terminal 1. The authentication pattern M is an image for authenticating the terminal 1. The authentication pattern M includes a mark M1 for guiding the user's line of sight for authenticating the terminal 1. In this embodiment, the mark M1 is a single dot. The type of mark M1 can be changed as appropriate.

[0013] In this embodiment, the authentication pattern M includes a plurality of marks M1. In the authentication pattern M, three marks M1 are arranged in three rows, each with three marks M1 per column. That is, the authentication pattern M includes nine marks M1. The positions of the marks M1 are set in advance, for example. The content of the authentication pattern M can be changed as appropriate.

[0014] An authentication pattern for performing authentication is set in advance in the terminal 1. In this embodiment, the authentication pattern is the order of marks M1 that are moved ahead of the user's line of sight E. The authentication pattern is set, for example, by the user. The number of marks M1 that are moved ahead of the line of sight E in the authentication pattern (hereinafter, sometimes referred to as the "prescribed number") is set in advance. "Line of sight" means the direction in which the user is looking. "Ahead of line of sight" means the position in the authentication pattern M at which the user is looking.

[0015] When a user authenticates the terminal 1, the user moves his / her line of sight E in accordance with, for example, a preset authentication pattern. In other words, the user moves the end of his / her line of sight E in the order of the preset marks M1 that move the end of the line of sight E.

[0016] For example, the user positions the gaze E on one mark M1 and gazes at that one mark M1, and then moves the gaze E away from that one mark M1. The user moves the gaze E away from the one mark M1, moves the gaze E toward another mark M1, and then positions the gaze E on that other mark M1 and gazes at that other mark M1. The user repeats these actions to authenticate the terminal 1.

[0017] The terminal 1 detects the user's eye E1. The eye E1 includes the user's eyeball and the area surrounding the eyeball. For example, the eye E1 includes the user's eyelid. The terminal 1 detects the user's gaze E based on the detection result of the eye E1. The terminal 1 acquires the order of marks M1 along which the user moves their gaze E (hereinafter, sometimes referred to as "input pattern") based on the detected gaze E. The terminal 1 determines whether the acquired input pattern matches a preset authentication pattern. In other words, the terminal 1 determines whether the order of marks M1 along which the user moves their gaze E matches the preset order of marks M1 along which the gaze E moves.

[0018] Fig. 2(a) is a diagram showing an example of an input pattern P1 and an authentication pattern P2. Fig. 2(b) is a diagram showing another example of an input pattern P1 and an authentication pattern P2. In Fig. 2(a) and Fig. 2(b), the input pattern P1 is indicated by a solid arrow, and the authentication pattern P2 is indicated by a dashed arrow.

[0019] 2(a) shows an example in which input pattern P1 does not match authentication pattern P2. If the user operating terminal 1 is not an authenticated user, there is a high possibility that input pattern P1 input by the user operating terminal 1 does not match authentication pattern P2. If it is determined that input pattern P1 does not match authentication pattern P2, terminal 1 determines that the user operating terminal 1 is not an authenticated user. In this case, terminal 1 does not unlock itself.

[0020] 2(b) shows an example in which input pattern P1 matches authentication pattern P2. If the user operating terminal 1 is an authenticated user, the user operating terminal 1 can input input pattern P1 that is the same as authentication pattern P2. If it is determined that input pattern P1 matches authentication pattern P2, terminal 1 determines that the user operating terminal 1 is an authenticated user. In this case, terminal 1 unlocks itself.

[0021] As described above, when authentication is performed by determining whether the input pattern P1 matches the authentication pattern P2, there is room for improvement in the security of authentication. For example, if the preset authentication pattern P2 becomes known to someone other than the authenticated user, the terminal 1 may be unlocked by someone other than the authenticated user. To solve the above problem, the terminal 1 performs authentication based on the state of the eye E1 when the user is looking at the authentication pattern M. As a result, even if the authentication pattern P2 becomes known to someone other than the authenticated user, authentication of the terminal 1 by someone other than the authenticated user can be prevented based on the state of the eye E1. The configuration and operation of the terminal 1 will be described in detail below.

[0022] 3 is a block diagram showing a terminal 1 according to an embodiment. The terminal 1 includes an eye detection unit 11, a gaze detection unit 12, a state detection unit 13, a display unit 14, and an authentication unit 15.

[0023] The eye detection unit 11 detects the user's eye E1. The eye detection unit 11 detects the user's eye E1, for example, via a camera mounted on the terminal 1. The eye detection unit 11 acquires an image via the camera, for example. The eye detection unit 11 may detect the eye E1 by analyzing the acquired image using AI, for example. The eye detection unit 11 may detect the user's eye E1 using known means.

[0024] The gaze detection unit 12 detects the gaze E of the user based on the detection result of the eye detection unit 11. The gaze detection unit 12, for example, acquires the position of the pupil of the eye E1 from the eye E1 detected by the eye detection unit 11. The gaze detection unit 12 may detect the direction in which the pupil is facing based on the acquired position of the pupil of the eye E1. The gaze detection unit 12 may detect the direction in which the detected pupil is facing as the gaze E. The gaze detection unit 12 may detect the gaze E of the user using a known means.

[0025] The state detection unit 13 detects the state of the user's eye E1 based on the detection result of the eye detection unit 11. The state of the eye E1 is a characteristic of the eye E1 that is unique to each person. The "unique characteristic" mentioned here does not necessarily mean a characteristic that is strictly different for each person, but also includes a characteristic that is similarly possessed by a certain number of people. The state detection unit 13 detects at least one of blinking and characteristics related to the eye E1 as the state of the eye E1. In this embodiment, both blinking and characteristics related to the eye E1 are detected as the state of the eye E1.

[0026] The state detection unit 13 detects the position of the eyelid from the eye E1 detected by the eye detection unit 11. The state detection unit 13 determines whether the detected eyelid position has moved by a predetermined distance or more. If it is determined that the eyelid position has moved by a predetermined distance or more, the state detection unit 13 determines that the user has blinked and detects the user's blink. The state detection unit 13 may detect the user's blink using known means.

[0027] The features related to the eye E1 refer to, for example, the features of the eye E1 itself. The state detection unit 13 detects at least one of the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs as the features related to the eye E1. In this embodiment, the state detection unit 13 detects all of the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs.

[0028] The state detection unit 13 detects the position of the eyeball from the eye E1 detected by the eye detection unit 11. The eyeball here refers to a real eyeball and does not include, for example, a prosthetic eye. The state detection unit 13, for example, detects an area within a predetermined distance from the detected eyeball position as the eye. The state detection unit 13 detects, for example, the length, position, and thickness of wrinkles formed around the detected eye as the state of wrinkles around the eye. The state detection unit 13 may detect the state of wrinkles around the eye using known means.

[0029] The state detection unit 13 detects the focal depth of the eye E1 from the eye E1 detected by the eye detection unit 11. Specifically, the state detection unit 13 first acquires, for example, the distance from the terminal 1 to the user's eye E1. The state detection unit 13 may analyze, for example, an image acquired via a camera mounted on the terminal 1 and acquire the distance from the analyzed image to the eye E1 included in the image. Then, the state detection unit 13 detects the focal depth of the eye E1 based on the acquired distance. The state detection unit 13 may detect the focal depth of the eye E1 using a known means.

[0030] It is also conceivable that some users focus their eyes E1 by squinting their eyes E1. The state detection unit 13 may detect the focal depth of the eye E1 based on the size of the eye E1. The size of the eye E1 is, for example, the distance from the user's upper eyelid to their lower eyelid. The state detection unit 13 may acquire the size of the eye E1 based on, for example, the acquired distance from the terminal 1 to the eye E1 and an image acquired via a camera mounted on the terminal 1.

[0031] The state detection unit 13 detects the number of eyeballs from the eyes E1 detected by the eye detection unit 11. For example, if the user has one eye E1 and an artificial eye, the state detection unit 13 detects the number of eyeballs as one.

[0032] The authentication unit 15 performs authentication based on the state of the eye E1 detected by the state detection unit 13 when the mark M1 is ahead of the line of sight E detected by the line of sight detection unit 12. The processing of the authentication unit 15 when the mark M1 is ahead of the line of sight E will be described below.

[0033] The authentication unit 15 acquires at least one of the number of blinks and the timing of blinks based on the blinks detected by the state detection unit 13. In this embodiment, the authentication unit 15 acquires both the number of blinks and the timing of blinks based on the blinks detected by the state detection unit 13.

[0034] The authentication unit 15 detects a gaze timing, which is a timing when mark M1 is ahead of the gaze E, based on the gaze E detected by the gaze detection unit 12. The authentication unit 15 detects a non-gaze timing, which is a timing when the gaze E moves away from mark M1, based on the gaze E detected by the gaze detection unit 12. The authentication unit 15 acquires, as the number of blinks, a first number, which is the number of times the user blinked between the detected gaze timing and the non-gaze timing.

[0035] Based on the blinks detected by the state detection unit 13, the authentication unit 15 acquires a first blink time, which is the time from the gaze timing to the time when the user blinks, during the period from the detected gaze timing to the non-gazing timing. The blink timing means, for example, the time when the user goes from an open eyelid to a closed eyelid. If the user blinks multiple times during the period from the gaze timing to the non-gazing timing, the authentication unit 15 acquires the first blink time for each of the multiple blinks. The authentication unit 15 acquires the acquired first blink time as the blink timing.

[0036] The frequency and timing of blinking may reflect, for example, a person's constitution and habits. Therefore, the number and timing of blinking can be said to be characteristics of the eye E1 that are unique to each person.

[0037] In this embodiment, the authentication unit 15 performs authentication based on the state of the eye E1 when the gaze E moves from one mark M1 to another mark M1. The process of the authentication unit 15 when the gaze E moves from one mark M1 to another mark M1 will be described below.

[0038] The authentication unit 15 acquires, as the number of blinks, a second number, which is the number of times the user blinks between the detected timing of not gazing at one mark M1 and the timing of gazing at another mark M1. The authentication unit 15 acquires, as the blink timing, a second blink time, which is the time from the detected timing of not gazing at one mark M1 to the timing at which the user blinks, between the detected timing of not gazing at one mark M1 and the timing at which the user gazes at the other mark M1. If the user blinks multiple times between the detected timing of not gazing at one mark M1 and the timing at which the user gazes at the other mark M1, the authentication unit 15 acquires a second blink time for each of the multiple blinks. The authentication unit 15 acquires the acquired second blink time as the blink timing.

[0039] Next, the operation of the terminal 1 will be described. Fig. 4 is a flowchart showing the operation of the terminal 1 according to one embodiment. First, the terminal 1 sets authentication information (step S1). The authentication information is information used to authenticate the terminal 1 in step S5, which will be described later. For example, when the terminal 1 functions as an authentication device for the first time, the terminal 1 executes step S1. After the terminal 1 executes step S1, the next time the terminal 1 executes the function as an authentication device, the terminal 1 may omit executing step S1.

[0040] In step S1, the terminal 1 executes the process shown in Fig. 5. Fig. 5 is a flowchart showing the process of setting the authentication information shown in Fig. 4. First, the display unit 14 displays the authentication pattern M (step S11). The authentication pattern M is, for example, set in advance. In step S11, the display unit 14 displays the authentication pattern M on the display of the terminal 1, for example.

[0041] Next, the eye detection unit 11 detects the user's eye E1 (step S12). In step S12, the eye detection unit 11 detects the user's eye E1 via a camera mounted on the terminal 1, for example.

[0042] Next, the gaze detection unit 12 detects the user's gaze E based on the detection result in step S12 (step S13). In step S13, the gaze detection unit 12 detects the position of the pupil of the eye E1, for example, based on the eye E1 detected in step S12. Then, the gaze detection unit 12 detects the direction in which the pupil is facing based on the detected pupil position. Then, the gaze detection unit 12 detects the direction in which the detected pupil is facing as the user's gaze E.

[0043] Next, the authentication unit 15 determines whether or not the mark M1 is located at the end of the line of sight E detected in step S13 (step S14). Specifically, the authentication unit 15 first acquires, for example, the distance from the terminal 1 to the user's eye E1. The authentication unit 15 may analyze an image acquired via, for example, a camera mounted on the terminal 1, and acquire the distance from the analyzed image to the eye E1 included in the image. The authentication unit 15 may acquire the distance from the terminal 1 to the user's eye E1 using a known means. Next, the authentication unit 15 calculates the position of the line of sight E based on the acquired distance and the line of sight E detected in step S13. Thereafter, the terminal 1 determines whether or not the calculated position of the line of sight E is separated by a predetermined distance or more from the position of the preset mark M1. If it is determined that the position of the line of sight E is not separated by the predetermined distance or more from the position of the mark M1, the authentication unit 15 determines that the mark M1 is located at the end of the line of sight E (step S14: YES). If it is determined that the position ahead of the line of sight E is a predetermined distance or more away from the position of the mark M1, the authentication unit 15 determines that the mark M1 is not ahead of the line of sight E (step S14: NO).

[0044] If it is determined that mark M1 is in the line of sight E (step S14: YES), terminal 1 executes step S15. If it is determined that mark M1 is not in the line of sight E (step S14: NO), terminal 1 executes step S14 again. Terminal 1 repeatedly executes step S14 for a predetermined time until it is determined that mark M1 is in the line of sight E. Authentication unit 15 detects the timing at which it is determined in step S14 that mark M1 is in the line of sight E as the gaze timing.

[0045] In step S15, the state detection unit 13 detects the state of the eye E1 when the mark M1 is at the end of the line of sight E. In this embodiment, in step S15, the state detection unit 13 detects blinking and features related to the eye E1 as the state of the eye E1. The state detection unit 13 detects the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs as the features related to the eye E1.

[0046] In step S15, the authentication unit 15 detects a non-gazing timing in step S16 described later, and then acquires the number of blinks and the timing of the blinks based on the detected blinks. More specifically, the authentication unit 15 first acquires a first number of times, which is the number of times the user blinked between the gaze timing detected in step S14 or step S18 (described later) and the non-gazing timing detected in step S16. Before executing step S18, the authentication unit 15 acquires the first number of times between the gaze timing detected in step S14 and the non-gazing timing detected in step S16. After executing step S18 once, the authentication unit 15 acquires the first number of times between the gaze timing detected in step S18 and the non-gazing timing detected in step S16. The authentication unit 15 acquires the acquired first number of times as the number of blinks.

[0047] In step S15, the authentication unit 15 acquires a first blink duration between the gaze timing detected in step S14 or step S18 and the non-gazing timing detected in step S16. Before executing step S18, the authentication unit 15 acquires a first blink duration between the gaze timing detected in step S14 and the non-gazing timing detected in step S16. After executing step S18 once, the authentication unit 15 acquires a first blink duration between the gaze timing detected in step S18 and the non-gazing timing detected in step S16. The authentication unit 15 acquires the acquired first blink duration as the blink timing.

[0048] Next, the authentication unit 15 determines whether the end of the gaze E detected in step S13 has moved away from the mark M1 (step S16). In step S16, the authentication unit 15 calculates the position of the end of the gaze E by performing the same process as in step S14. Then, the authentication unit 15 determines whether the calculated position of the end of the gaze E is a predetermined distance or more away from the position of the preset mark M1. If it is determined that the position of the end of the gaze E is not a predetermined distance or more away from the position of the mark M1, the authentication unit 15 determines that the end of the gaze E has moved away from the mark M1 (step S16: NO). If it is determined that the position of the end of the gaze E is a predetermined distance or more away from the position of the mark M1, the authentication unit 15 determines that the end of the gaze E has moved away from the mark M1 (step S16: YES).

[0049] If it is determined that the gaze E has not deviated from mark M1 (step S16: NO), the terminal 1 executes step S15 again. The terminal 1 repeatedly executes steps S15 and S16 for a predetermined time until it is determined that the gaze E has deviated from mark M1. If it is determined that the gaze E has deviated from mark M1 (step S16: YES), the terminal 1 executes step S17. The authentication unit 15 detects the timing at which it is determined in step S16 that the gaze E has deviated from mark M1 as a non-gazing timing.

[0050] When it is determined in step S16 that the gaze E has moved away from the mark M1, it is considered that the user is moving the gaze E from one mark M1 to another mark M1. For example, the user gazes at one mark M1 and then selects another mark M1 to which the gaze E will move. The user moves the gaze E to the other mark M1 that they have selected.

[0051] In step S17, the state detection unit 13 detects the state of the eye E1 when the gaze E moves from one mark M1 to another mark M1. In this embodiment, in step S17, the state detection unit 13 executes the same process as in step S15 to detect blinking and characteristics related to the eye E1 as the state of the eye E1.

[0052] In step S17, the authentication unit 15 detects the gaze timing in step S18 described below, and then acquires the number of blinks and the blink timing based on the detected blinks. More specifically, the authentication unit 15 first acquires a second number of times, which is the number of times the user blinked between the non-gaze timing detected in step S16 and the gaze timing detected in step S18. The authentication unit 15 acquires the acquired second number of times as the number of blinks.

[0053] In step S17, the authentication unit 15 acquires a second blinking time between the non-gazing timing detected in step S16 and the gazing timing detected in step S18. The authentication unit 15 acquires the acquired second blinking time as the blinking timing.

[0054] Next, the authentication unit 15 determines whether or not the mark M1 is located at the end of the line of sight E detected in step S13 (step S18). In step S18, the authentication unit 15 executes the same process as in step S14 to determine whether or not the mark M1 is located at the end of the line of sight E.

[0055] If it is determined that mark M1 is not present in the line of sight E (step S18: NO), the terminal 1 executes step S17 again. The terminal 1 repeatedly executes steps S17 and S18 for a predetermined time until it is determined that mark M1 is present in the line of sight E. If it is determined that mark M1 is present in the line of sight E (step S18: YES), the terminal 1 executes step S19. The authentication unit 15 detects the timing at which it is determined in step S18 that mark M1 is present in the line of sight E as the gaze timing.

[0056] In step S19, the terminal 1 determines whether or not a termination condition has been met. In this embodiment, the termination condition is that the number of times that gaze timings have been detected in steps S14 and S18 reaches the above-mentioned predetermined number. The termination condition is, for example, set in advance. The content of the termination condition can be changed as appropriate. If it is determined that the termination condition has not been met (step S19: NO), the terminal 1 executes step S15 again. If it is determined that the termination condition has been met (step S19: YES), the terminal 1 executes step S20.

[0057] In step S20, the terminal 1 stores authentication information. In step S20, the terminal 1 stores authentication pattern P2 (see FIG. 2) as authentication information. The terminal 1 acquires the order of marks M1 determined to be in the line of sight E in steps S14 and S18. The terminal 1 stores the acquired order of marks M1 as authentication pattern P2.

[0058] In step S20, the terminal 1 stores first authentication information as authentication information. The first authentication information indicates characteristics related to the eye E1 when the mark M1 is located at the end of the line of sight E. The terminal 1 acquires characteristics related to the eye E1 detected in step S15 for each mark M1 at which the user's line of sight E is located. Then, the terminal 1 stores the acquired characteristics related to the eye E1 as first authentication information.

[0059] In step S20, the terminal 1 stores second authentication information as authentication information. The second authentication information indicates the number of blinks and the timing of blinks when the mark M1 is in the line of sight E. The terminal 1 stores the number of blinks and the timing of blinks acquired in step S15 as second authentication information.

[0060] In step S20, the terminal 1 stores third authentication information as authentication information. The third authentication information indicates characteristics of the eye E1 when the gaze E moves from one mark M1 to another mark M1. The terminal 1 stores the characteristics of the eye E1 detected in step S17 as the third authentication information.

[0061] In step S20, the terminal 1 stores fourth authentication information as authentication information. The fourth authentication information indicates the number of blinks and the timing of the blinks when the gaze E moves from one mark M1 to another mark M1. The terminal 1 stores the number of blinks and the timing of the blinks acquired in step S17 as the fourth authentication information. After the above processing, the terminal 1 ends step S1.

[0062] When the terminal 1 performs authentication, the terminal 1 executes steps S2 to S7. In step S2, the display unit 14 displays the authentication pattern M. The display unit 14 executes the same process as in step S11 to display the authentication pattern M.

[0063] Next, the eye detection unit 11 detects the user's eye E1 (step S3). In step S3, the eye detection unit 11 detects the user's eye E1 by executing the same process as in step S12. Next, the gaze detection unit 12 detects the user's gaze E based on the detection result in step S3 (step S4). In step S4, the gaze detection unit 12 detects the user's gaze E by executing the same process as in step S13.

[0064] Next, the terminal 1 performs authentication (step S5). In step S5, the terminal 1 executes the process shown in Fig. 6. Fig. 6 is a flowchart showing the process of performing authentication shown in Fig. 4.

[0065] First, the authentication unit 15 determines whether or not the first mark M1 is located at the end of the line of sight E detected in step S4 (step S51). The first mark M1 is the mark M1 that is determined to be located at the end of the line of sight E in step S14, among the multiple marks M1 included in the authentication pattern P2 set in step S1. In step S51, the authentication unit 15 determines whether or not the first mark M1 is located at the end of the line of sight E by executing the same process as in step S14.

[0066] If it is determined that the first mark M1 is in the line of sight E (step S51: YES), the terminal 1 executes step S52. If it is determined that the first mark M1 is not in the line of sight E (step S51: NO), the terminal 1 executes step S51 again. The terminal 1 repeatedly executes step S51 for a predetermined time until it is determined that the first mark M1 is in the line of sight E. The authentication unit 15 detects the timing at which it is determined in step S51 that the first mark M1 is in the line of sight E as the gaze timing.

[0067] In step S52, the state detection unit 13 detects the state of the eye E1 when the mark M1 is ahead of the line of sight E. The state detection unit 13 executes the same process as in step S15 to detect the state of the mark M1 when the mark M1 is ahead of the line of sight E.

[0068] In step S52, the authentication unit 15 detects a non-gazing timing in step S53 (described later), and then acquires the number of blinks and the timing of the blinks based on the detected blinks. More specifically, the authentication unit 15 first acquires a first number of times between the gaze timing detected in step S51 or step S55 (described later) and the non-gazing timing detected in step S53. Before executing step S55, the authentication unit 15 acquires the first number of times between the gaze timing detected in step S51 and the non-gazing timing detected in step S53. After executing step S55 once, the authentication unit 15 acquires the first number of times between the gaze timing detected in step S55 and the non-gazing timing detected in step S53. The authentication unit 15 acquires the acquired first number of times as the number of blinks.

[0069] In step S52, the authentication unit 15 acquires a first blink duration between the gaze timing detected in step S51 or step S55 and the non-gazing timing detected in step S53. Before executing step S55, the authentication unit 15 acquires a first blink duration between the gaze timing detected in step S51 and the non-gazing timing detected in step S53. After executing step S55 once, the authentication unit 15 acquires a first blink duration between the gaze timing detected in step S55 and the non-gazing timing detected in step S53. The authentication unit 15 acquires the acquired first blink duration as the blink timing.

[0070] Next, the authentication unit 15 determines whether the gaze E detected in step S4 has moved away from the mark M1 (step S53). In step S53, the authentication unit 15 executes the same process as in step S16 to determine whether the gaze E has moved away from the mark M1.

[0071] If it is determined that the gaze E has not deviated from mark M1 (step S53: NO), the terminal 1 executes step S52 again. The terminal 1 repeatedly executes steps S52 and S53 for a predetermined time until it is determined that the gaze E has deviated from mark M1. If it is determined that the gaze E has deviated from mark M1 (step S53: YES), the terminal 1 executes step S54. The authentication unit 15 detects the timing at which it is determined in step S53 that the gaze E has deviated from mark M1 as a non-gazing timing.

[0072] When it is determined in step S53 that the gaze E has moved away from mark M1, it is considered that the user is moving the gaze E from one mark M1 to another mark M1. If the user operating terminal 1 is an authenticated user, the authenticated user moves the gaze E from one mark M1 to another mark M1 in accordance with the authentication pattern P2 set in step S1.

[0073] In step S54, the state detection unit 13 detects the state of the eye E1 when the point of the gaze E moves from one mark M1 to another mark M1. In step S54, the state detection unit 13 executes the same process as in step S17 to detect the state of the eye E1 when the point of the gaze E moves from one mark M1 to another mark M1.

[0074] In step S54, the authentication unit 15 detects the gaze timing in step S55 described below, and then acquires the number of blinks and the blink timing based on the detected blinks. More specifically, the authentication unit 15 first acquires a second number of times, which is the number of times the user blinked between the non-gazing timing detected in step S53 and the gaze timing detected in step S55. The authentication unit 15 acquires the acquired second number of times as the number of blinks.

[0075] In step S54, the authentication unit 15 acquires a second blinking time between the non-gazing timing detected in step S53 and the gazing timing detected in step S55. The authentication unit 15 acquires the acquired second blinking time as the blinking timing.

[0076] Next, the authentication unit 15 determines whether or not the mark M1 is located at the end of the line of sight E detected in step S4 (step S55). In step S55, the authentication unit 15 executes the same process as in step S18 to determine whether or not the mark M1 is located at the end of the line of sight E.

[0077] If it is determined that mark M1 is not present in the line of sight E (step S55: NO), terminal 1 executes step S54 again. Terminal 1 repeatedly executes steps S54 and S55 for a predetermined time until it is determined that mark M1 is present in the line of sight E. If it is determined that mark M1 is present in the line of sight E (step S55: YES), terminal 1 executes step S56. The authentication unit 15 detects the timing at which it is determined in step S55 that mark M1 is present in the line of sight E as the gaze timing.

[0078] In step S56, the terminal 1 determines whether or not a termination condition has been satisfied. In this embodiment, the termination condition is that the number of times that gaze timings have been detected in steps S51 and S55 reaches the above-mentioned predetermined number. The termination condition is, for example, set in advance. The content of the termination condition can be changed as appropriate. If it is determined that the termination condition has not been satisfied (step S56: NO), the terminal 1 executes step S52 again. If it is determined that the termination condition has been satisfied (step S56: YES), the terminal 1 acquires the order of the marks M1 that have been determined to be in the line of sight E in steps S51 and S55. The terminal 1 acquires the acquired order of the marks M1 as the input pattern P1. Thereafter, the terminal 1 executes step S57.

[0079] In step S57, the authentication unit 15 determines whether the user operating the terminal 1 is an authenticated user. In this embodiment, the authentication unit 15 determines whether each of the first, second, third, fourth, and fifth conditions described below is met. If it is determined that all of the first to fifth conditions are met, the authentication unit 15 determines that the user operating the terminal 1 is an authenticated user. In other cases, the authentication unit 15 determines that the user operating the terminal 1 is not an authenticated user.

[0080] The first condition is a condition related to the input pattern P1 input by the user. The authentication unit 15 determines whether the input pattern P1 acquired in step S56 matches the authentication pattern P2 set in step S1. More specifically, the authentication unit 15 determines whether the order of the marks M1 determined to be in the line of sight E in steps S51 and S55 matches the order of the marks M1 indicated by the authentication pattern P2 stored in step S20. If it is determined that the input pattern P1 matches the authentication pattern P2, the authentication unit 15 determines that the first condition is satisfied. If it is determined that the input pattern P1 does not match the authentication pattern P2, the authentication unit 15 determines that the first condition is not satisfied.

[0081] The second condition is a condition related to the features of the eye E1 when the mark M1 is located at the end of the line of sight E. The authentication unit 15 calculates a match rate between the features of the eye E1 detected in step S52 and the features of the eye E1 indicated by the first authentication information stored in step S20. The authentication unit 15 calculates, as the match rate of the features of the eye E1, for example, an average value of the match rates of the wrinkle conditions around the eyes, the match rate of the focal depth of the eye E1, and the match rate of the number of eyeballs, which will be described below.

[0082] The authentication unit 15 calculates the degree of agreement between the state of wrinkles around the eyes detected in step S52 and the state of wrinkles around the eyes indicated by the first authentication information. The authentication unit 15 calculates the degree of agreement between the length, position, and thickness of the wrinkles detected in step S52 and the length, position, and thickness of the wrinkles indicated by the first authentication information. The authentication unit 15 may calculate the degree of agreement between the state of wrinkles around the eyes using known means.

[0083] The authentication unit 15 calculates a match rate between the focal depth of the eye E1 detected in step S52 and the focal depth of the eye E1 indicated by the first authentication information. For example, the authentication unit 15 may calculate the match rate by normalizing the reciprocal of the difference between the focal depth of the eye E1 detected in step S52 and the focal depth of the eye E1 indicated by the first authentication information by multiplying the reciprocal of the difference by a predetermined value.

[0084] The authentication unit 15 calculates a match rate between the number of eyeballs detected in step S52 and the number of eyeballs indicated by the first authentication information. For example, if the number of eyeballs detected in step S52 matches the number of eyeballs indicated by the first authentication information, the authentication unit 15 may calculate the match rate as a predetermined first value (for example, 100%). For example, if the number of eyeballs detected in step S52 does not match the number of eyeballs indicated by the first authentication information, the authentication unit 15 may calculate the match rate as a predetermined second value (for example, 0%) that is smaller than the first value.

[0085] The authentication unit 15 determines whether the calculated matching rate of the features related to the eye E1 is equal to or greater than a predetermined value. If it is determined that the matching rate of the features related to the eye E1 is equal to or greater than the predetermined value, the authentication unit 15 determines that the second condition is satisfied. If it is determined that the matching rate of the features related to the eye E1 is less than the predetermined value, the authentication unit 15 determines that the second condition is not satisfied.

[0086] The third condition is a condition related to the number of blinks and the timing of blinks when mark M1 is in the line of sight E. The authentication unit 15 calculates the match rate between the number of blinks acquired in step S52 and the number of blinks indicated by the second authentication information stored in step S20. For example, the authentication unit 15 calculates the match rate of the number of blinks by normalizing the reciprocal of the difference between the first number of blinks acquired in step S52 and the first number of blinks indicated by the second authentication information by multiplying the reciprocal by a predetermined value.

[0087] The authentication unit 15 calculates the coincidence rate between the blink timing acquired in step S52 and the blink timing indicated by the second authentication information stored in step S20. For example, the authentication unit 15 calculates the coincidence rate of the blink timing by normalizing the reciprocal of the difference between the first blink time acquired in step S52 and the first blink time indicated by the second authentication information by multiplying the reciprocal by a predetermined value.

[0088] The authentication unit 15 calculates the average value of the calculated match rate of the number of blinks and the calculated match rate of the blink timing. The authentication unit 15 determines whether the calculated average value is equal to or greater than a predetermined value. If it is determined that the average value is equal to or greater than the predetermined value, the authentication unit 15 determines that the third condition is satisfied. If it is determined that the average value is less than the predetermined value, the authentication unit 15 determines that the third condition is not satisfied.

[0089] The fourth condition is a condition related to the features of the eye E1 when the gaze E moves from one mark M1 to another mark M1. The authentication unit 15 calculates a match rate between the features of the eye E1 detected in step S54 and the features of the eye E1 indicated by the third authentication information stored in step S20. The method by which the authentication unit 15 calculates the match rate is the same as the method used to determine whether the second condition is satisfied.

[0090] The authentication unit 15 determines whether the calculated matching rate is equal to or greater than a predetermined value. If it is determined that the matching rate is equal to or greater than the predetermined value, the authentication unit 15 determines that the fourth condition is satisfied. If it is determined that the matching rate is less than the predetermined value, the authentication unit 15 determines that the fourth condition is not satisfied.

[0091] The fifth condition is a condition related to the number of blinks and the timing of the blinks when the gaze E moves from one mark M1 to another mark M1. The authentication unit 15 calculates a match rate between the number of blinks acquired in step S54 and the number of blinks indicated by the fourth authentication information stored in step S20. The authentication unit 15 calculates, as the match rate of the number of blinks, a normalized value obtained by multiplying the reciprocal of the difference between the second number of blinks acquired in step S54 and the second number of blinks indicated by the fourth authentication information by a predetermined value, for example.

[0092] The authentication unit 15 calculates the coincidence rate between the blink timing acquired in step S54 and the blink timing indicated by the fourth authentication information stored in step S20. For example, the authentication unit 15 calculates the coincidence rate of the blink timing by normalizing the reciprocal of the difference between the second blink time acquired in step S54 and the second blink time indicated by the fourth authentication information by multiplying the reciprocal by a predetermined value.

[0093] The authentication unit 15 calculates the average value of the calculated match rate of the number of blinks and the match rate of the blink timing. The authentication unit 15 determines whether the calculated average value is equal to or greater than a predetermined value. If it is determined that the average value is equal to or greater than the predetermined value, the authentication unit 15 determines that the fifth condition is satisfied. If it is determined that the average value is less than the predetermined value, the authentication unit 15 determines that the fifth condition is not satisfied.

[0094] Although examples of the contents of the first to fifth conditions have been described above, the contents of the first to fifth conditions can be changed as appropriate. The criteria for determining that a user operating terminal 1 is an authenticated user can also be changed as appropriate. For example, if it is determined that at least one of the first, second, third, fourth, and fifth conditions is satisfied, the authentication unit 15 may determine that the user operating terminal 1 is an authenticated user.

[0095] If it is determined that the user operating terminal 1 is an authenticated user (step S57: YES), the authentication unit 15 unlocks terminal 1 (step S58). If it is determined that the user operating terminal 1 is not an authenticated user (step S57: NO), the authentication unit 15 does not unlock terminal 1 (step S59). In step S59, the display unit 14 may display a message requesting that authentication be performed again. After the above processing, the terminal 1 ends step S5.

[0096] Next, the terminal 1 determines whether the lock of the terminal 1 has been released (step S6). If it is determined that the lock of the terminal 1 has been released by executing step S58 (step S6: YES), the terminal 1 executes step S7. If it is determined that the lock of the terminal 1 has not been released by executing step S59 (step S6: NO), the terminal 1 ends the series of operations. In step S7, the terminal 1 performs learning. In step S7, the terminal 1 updates, for example, the criteria for determining whether the user operating the terminal 1 is an authenticated user.

[0097] In step S7, terminal 1 replaces the state of wrinkles around the eyes indicated by the first authentication information with the state of wrinkles around the eyes detected in step S52 and stores the result. In step S7, terminal 1 calculates the average value of the focal depth of eye E1 indicated by the first authentication information and the focal depth of eye E1 detected in step S52. Next, terminal 1 replaces the focal depth of eye E1 indicated by the first authentication information with the calculated average value and stores the result. In step S7, terminal 1 replaces the number of eyeballs indicated by the first authentication information with the number of eyeballs detected in step S52 and stores the result.

[0098] In step S7, terminal 1 calculates the average value of the number of blinks indicated by the second authentication information and the number of blinks acquired in step S52. Terminal 1 replaces the number of blinks indicated by the second authentication information with the calculated average value of the number of blinks, and stores the result. In step S7, terminal 1 calculates the average value of the blink timings indicated by the second authentication information and the blink timings acquired in step S52. Terminal 1 replaces the blink timings indicated by the second authentication information with the calculated average value of the blink timings, and stores the result.

[0099] In step S7, terminal 1 replaces the state of wrinkles around the eyes indicated by the third authentication information with the state of wrinkles around the eyes detected in step S54 and stores the result. In step S7, terminal 1 calculates the average value of the focal depth of eye E1 indicated by the third authentication information and the focal depth of eye E1 detected in step S54. Next, terminal 1 replaces the focal depth of eye E1 indicated by the third authentication information with the calculated average value and stores the result. In step S7, terminal 1 replaces the number of eyeballs indicated by the third authentication information with the number of eyeballs detected in step S54 and stores the result.

[0100] In step S7, terminal 1 calculates the average value of the number of blinks indicated by the fourth authentication information and the number of blinks acquired in step S54. Terminal 1 replaces the number of blinks indicated by the fourth authentication information with the calculated average value of the number of blinks and stores the result. In step S7, terminal 1 calculates the average value of the blink timings indicated by the fourth authentication information and the blink timings acquired in step S54. Terminal 1 replaces the blink timings indicated by the fourth authentication information with the calculated average value of the blink timings and stores the result.

[0101] The condition of the user's eye E1 may change due to, for example, aging of the user. When it is determined that the terminal 1 has been unlocked, the terminal 1 updates the criteria for determining whether the user operating the terminal 1 is an authenticated user. Since the authentication criteria are changed according to the condition of the eye E1 of the authenticated user who unlocked the terminal 1, the accuracy of authentication can be maintained even if the condition of the user's eye E1 changes as authentication is repeated.

[0102] Next, we will explain the effects of the terminal 1. The terminal 1 includes an eye detection unit 11 that detects the user's eye E1, a gaze detection unit 12 that detects the user's gaze E based on the detection result of the eye detection unit 11, a state detection unit 13 that detects the state of the user's eye E1 based on the detection result of the eye detection unit 11, a display unit 14 that displays an authentication pattern M including a mark M1 for guiding the gaze E for authentication, and an authentication unit 15 that performs authentication based on the state of the eye E1 when the mark M1 is at the end of the gaze E.

[0103] In this terminal 1, authentication is performed based on the state of the user's eye E1 when the user is looking at the mark M1. The state of the eye E1 is a characteristic of the eye E1 that is unique to each person. Therefore, even if the preset authentication pattern P2 is known to someone other than the authenticated user, authentication of the terminal 1 by someone other than the authenticated user can be prevented based on the state of the eye E1. As a result, the security of authentication can be improved.

[0104] The authentication pattern M may include multiple marks M1, and the authentication unit 15 may perform authentication based on the state of the eye E1 when the gaze E moves from one mark M1 to another mark M1. In this case, for example, authentication is performed based on the state of the eye E1 when the user averts their gaze E from the mark M1 and moves their gaze E toward another mark M1. Since authentication is performed taking into account not only the state of the eye E1 when the user is looking at the mark M1, but also the state of the eye E1 when the user is moving their gaze E, the accuracy of authentication can be improved. Therefore, the security of authentication can be further improved.

[0105] The state detection unit 13 may detect blinking as the state of the eye E1. For example, the frequency and timing of blinking may reflect a person's constitution and habits. Since blinking is detected as the state of the eye E1 and authentication can be performed based on the detected blinking, the accuracy of authentication can be further improved. Therefore, the security of authentication can be further improved.

[0106] The authentication unit 15 may acquire at least one of the number of blinks and the timing of blinks based on the detected blinks, and perform authentication based on at least one of the acquired number of blinks and the timing of blinks. The number of blinks and the timing of blinks may reflect a person's constitution and habits. Since authentication can be performed based on at least one of the number of blinks and the timing of blinks, the accuracy of authentication can be further improved. Therefore, the security of authentication can be further improved.

[0107] The state detection unit 13 may detect characteristics of the eye E1 as the state of the eye E1. In this case, authentication can be performed based on the characteristics of the eye E1, which are the characteristics of the eye E1 itself, thereby further improving the security of authentication.

[0108] The state detection unit 13 may detect at least one of the following characteristics related to the eye E1: the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs. Each of the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs is a characteristic unique to each person. Therefore, authentication can be performed based on these characteristics, which further improves the security of authentication.

[0109] The authentication unit 15 may perform authentication based on a predetermined authentication pattern P2, which is the order of marks M1 that move along the line of sight E. In this case, authentication can be performed using the predetermined authentication pattern P2 in addition to the state of the user's eye E1. For example, it can determine whether the input pattern P1 entered by the user matches the authentication pattern P2, and perform authentication based on the determination result. Therefore, even if a person with a similar eye E1 state to that of the authenticated user attempts to authenticate the terminal 1, the terminal 1 can be prevented from being unlocked if the input pattern P1 does not match the authentication pattern P2. This further improves the security of authentication.

[0110] Next, a terminal 1 according to a modification will be described. Below, differences from the above embodiment will be mainly described, and overlapping descriptions will be omitted as appropriate.

[0111] The content of the processing executed by the terminal 1 in step S7 can be changed as appropriate. In step S7, the terminal 1 may, for example, replace the focal depth of the eye E1 indicated by the first authentication information with the focal depth of the eye E1 detected in step S52 and store the result. The terminal 1 may also execute a similar process for the third authentication information. In step S7, the terminal 1 may, for example, replace the number of blinks indicated by the second authentication information with the number of blinks acquired in step S52 and store the result. The terminal 1 may, for example, replace the timing of blinks indicated by the second authentication information with the timing of blinks acquired in step S52 and store the result. The terminal 1 may also execute a similar process for the fourth authentication information.

[0112] In the above embodiment, an example has been described in which the state detection unit 13 detects blinking and characteristics related to the eye E1 as the state of the eye E1. However, the state detection unit 13 only needs to detect characteristics of the eye E1 that are unique to each person as the state of the eye E1, and may detect characteristics other than blinking and characteristics related to the eye E1 as the state of the eye E1.

[0113] In the above embodiment, an example has been described in which the state detection unit 13 detects the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs as features related to the eye E1. However, the state detection unit 13 only needs to detect the features of the eye E1 itself as features related to the eye E1, and may detect features other than the state of wrinkles around the eyes, the focal depth of the eye E1, and the number of eyeballs as features related to the eye E1. For example, the state detection unit 13 may detect the size or color of the iris of the eye E1 as features related to the eye E1.

[0114] The authentication device of the present disclosure has the following configuration.

[0115] [1] An authentication device comprising: an eye detection unit that detects the eyes of a user; a gaze detection unit that detects the user's gaze based on the detection result of the eye detection unit; a state detection unit that detects the state of the user's eyes based on the detection result of the eye detection unit; a display unit that displays an authentication pattern including a mark for guiding the gaze for authentication; and an authentication unit that performs authentication based on the state of the eye when the mark is in the line of sight.

[0116] [2] The authentication device according to [1], wherein the authentication pattern includes a plurality of the marks, and the authentication unit performs authentication based on the state of the eyes when the line of sight moves from one of the marks to another of the marks.

[0117] [3] The authentication device according to [1] or [2], wherein the state detection unit detects blinking as the eye state.

[0118] [4] The authentication device according to [3], wherein the authentication unit acquires at least one of the number of blinks and the timing of the blinks based on the detected blinks, and performs the authentication based on the acquired at least one of the number of blinks and the timing of the blinks.

[0119] [5] The authentication device according to any one of [1] to [4], wherein the state detection unit detects a feature related to the eye as the state of the eye.

[0120] [6] The authentication device according to [5], wherein the state detection unit detects at least one of the state of wrinkles around the eyes, the focal depth of the eyes, and the number of eyeballs as the eye-related features.

[0121] [7] The authentication device according to any one of [2] to [6], wherein the authentication unit performs authentication based on an authentication pattern that is set in advance and is the order of the marks that the line of sight moves through.

[0122] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices. The functional block may also be realized by combining software with the single device or multiple devices.

[0123] Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0124] For example, the terminal 1 according to an embodiment of the present disclosure may function as a computer that performs information processing according to the present disclosure. Fig. 7 is a diagram illustrating an example of the hardware configuration of the terminal 1 according to an embodiment of the present disclosure. The terminal 1 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like. The hardware configuration of the terminal 20 may also be as described here.

[0125] In the following description, the term "device" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the terminal 1 may be configured to include one or more of the devices shown in the figure, or may be configured to exclude some of the devices.

[0126] Each function in terminal 1 is realized by loading specified software (programs) onto hardware such as processor 1001 and memory 1002, causing processor 1001 to perform calculations, control communication via communication device 1004, and control at least one of reading and writing data in memory 1002 and storage 1003.

[0127] The processor 1001, for example, runs an operating system to control the entire computer. The processor 1001 may be configured as a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, each function of the terminal 1 described above may be realized by the processor 1001.

[0128] Furthermore, the processor 1001 reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, each function of the terminal 1 may be implemented by a control program stored in the memory 1002 and running on the processor 1001. While the above-described various processes have been described as being executed by one processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.

[0129] The memory 1002 is a computer-readable recording medium and may be configured, for example, by at least one of a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for performing information processing according to an embodiment of the present disclosure.

[0130] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The storage medium provided in terminal 1 may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0131] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also called, for example, a network device, a network controller, a network card, or a communication module.

[0132] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that outputs to the outside. The input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0133] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0134] The terminal 1 may also be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0135] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0136] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0137] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0138] The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0139] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0140] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0141] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0142] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0143] Furthermore, the information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information.

[0144] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0145] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0146] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0147] As used in this disclosure, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0148] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this disclosure, it is not intended to be an exclusive or.

[0149] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0150] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."

[0151] 1...terminal (authentication device), 11...eye detection unit, 12...gaze detection unit, 13...status detection unit, 14...display unit, 15...authentication unit, E...gaze, E1...eye, M...authentication pattern, M1...mark.

Claims

1. An authentication device comprising: an eye detection unit that detects a user's eyes; a gaze detection unit that detects the user's gaze based on a detection result of the eye detection unit; a state detection unit that detects a state of the user's eyes based on the detection result of the eye detection unit; a display unit that displays an authentication pattern including a mark for guiding the gaze for authentication; and an authentication unit that performs authentication based on the state of the eyes when the mark is at the tip of the gaze.

2. The authentication device according to claim 1, wherein the authentication pattern includes a plurality of the marks, and the authentication unit performs authentication based on the state of the eyes when the tip of the gaze moves from one mark to another mark.

3. The authentication device according to claim 1, wherein the state detection unit detects a blink as the state of the eyes.

4. The authentication unit according to claim 3, wherein the authentication unit: obtains at least one of the number of blinks and the timing of the blinks based on the detected blink; and performs the authentication based on at least one of the obtained number of blinks and the timing of the blinks.

5. The authentication device according to claim 1, wherein the state detection unit detects a feature related to the eyes as the state of the eyes.

6. The authentication device according to claim 5, wherein the state detection unit detects at least one of the state of wrinkles around the eyes, the depth of focus of the eyes, and the number of eyeballs as the feature related to the eyes.

7. The authentication device according to claim 2, wherein the authentication unit performs authentication based on an authentication pattern that is preset and is the order of the marks for moving the tip of the gaze.

Images