Authentication method, eye-tracking device, and information processing apparatus

The dual authentication method using eye-tracking smart glasses for biometric and gaze-based one-time pattern authentication addresses hardware limitations and network vulnerabilities, providing robust security and convenience in login processes.

JP2024176370APending Publication Date: 2024-12-19KK TOSHIBA +1
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2023094859
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-08
Publication Date
2024-12-19

AI Technical Summary

Technical Problem

Biometric authentication methods like fingerprint and iris scanning are limited by hardware requirements and have accuracy issues, while one-time password authentication is vulnerable to token loss and network dependency, compromising security and convenience.

Method used

A dual authentication method combining biometric authentication using eye-tracking smart glasses for fingerprint and iris recognition, followed by one-time pattern authentication via gaze tracking, where a unique pattern is displayed and traced by the user's gaze, ensuring secure and convenient login without hardware modifications.

Benefits of technology

Enhances security by reducing false acceptance/rejection rates and eliminating token loss risks, allowing secure login on devices without biometric modules and network reliance, while maintaining user convenience and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024176370000001_ABST
    Figure 2024176370000001_ABST
Patent Text Reader

Abstract

To enhance security without compromising convenience.SOLUTION: An eye-tracking device is capable of communicating with an information processing apparatus. The eye-tracking device includes a biometric sensor, a storage unit, a comparison unit, a request unit, a display unit and a transmission unit. The biometric sensor acquires biometric information of a wearer. The storage unit stores previously registered biometric information. The comparison unit compares the stored biometric information with the biometric information acquired by the biometric sensor. The request unit requests a one-time authentication pattern from the information processing apparatus. The display unit receives the authentication pattern and visually displays it within a field of view of the wearer. The transmission unit transmits gaze trajectory information obtained by tracking the gaze of the wearer to the information processing apparatus.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] An embodiment of the present invention relates to an authentication method, an eye tracking device, and an information processing apparatus. [Background technology]

[0002] For example, a login procedure is performed when a multi-user OS (Operating System) starts up, or when a business application installed on a computer is launched. Password authentication has been the most common login authentication method. However, due to the risk of passwords being stolen or reused, more secure authentication methods are beginning to be used. Authentication methods that are more secure than passwords include biometric authentication and one-time password authentication.

[0003] Biometric authentication is a method of authentication using biometric information such as fingerprints and irises. By using information unique to each person, it has the advantage of reducing the risk of spoofing and allowing for easy authentication through touch operations.

[0004] One-time password authentication is a method in which a password that is valid only for a certain period of time is issued each time authentication is performed via a token, a dedicated app, SMS, etc. Since the password changes each time and has an expiration date, the risk of password leakage can be reduced, and there is also the advantage of convenience in that users do not need to remember and manage passwords. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-34646 A [Patent Document 2] JP 2016-197412 A [Patent Document 3] JP 2022-44281 A [Non-patent literature]

[0006] [Non-Patent Document 1] Magose, Miyaji (2019). "Research on authentication interface using eye tracking". 2nd Visualization Workshop (http: / / itolab.is.ocha.ac.jp / visws2019 / poster / visws2019-p11.pdf) Summary of the Invention [Problem to be solved by the invention]

[0007] Biometric authentication requires a fingerprint authentication module or a camera compatible with iris authentication, and cannot be used for authentication on information devices that do not have these. In addition, the identification accuracy of biometric information is not 100%, and there is a risk of false acceptance. If the false acceptance rate is lowered, the trade-off is that the false rejection rate increases, and security is strengthened but convenience is reduced.

[0008] When one-time password authentication uses a token to issue the one-time password, there is a risk of losing the token. In addition, a communication environment is required to use a dedicated app or SMS, limiting the situations in which it can be used. These are the disadvantages of one-time password authentication.

[0009] Therefore, an object is to provide an authentication method, an eye tracking device, and an information processing device that improve security without compromising convenience. [Means for solving the problem]

[0010] According to the embodiment, the authentication method includes a first authentication process and a second authentication process. The first authentication process is a process of performing biometric authentication of the wearer using an eye tracking device equipped with a biometric sensor. The second authentication process is a process of performing one-time authentication based on visual information using an information processing device capable of communicating with the eye tracking device. The first authentication process includes a process in which the eye tracking device compares biometric information of the wearer acquired by the biometric sensor with pre-registered biometric information. The second authentication process includes a process in which the information processing device issues a one-time authentication pattern in response to a request from the eye tracking device. The second authentication process also includes a process in which the eye tracking device receives the authentication pattern and visually displays it in the field of view of the wearer. The second authentication process also includes a process in which the eye tracking device transmits gaze trajectory information obtained by tracking the gaze of the wearer to the information processing device. The second authentication process also includes a process in which the information processing device compares the gaze trajectory information with the authentication pattern. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of a system in which an authentication method according to an embodiment is implemented. [Diagram 2] FIG. 2 is a functional block diagram illustrating an example of the smart glasses 10 shown in FIG. [Diagram 3] FIG. 3 is a functional block diagram showing an example of information device 20 shown in FIG. [Figure 4] FIG. 4 is a schematic diagram showing an example of a procedure of an authentication method according to an embodiment. [Diagram 5] FIG. 5 is a sequence diagram showing an example of an authentication method according to the embodiment. [Figure 6] FIG. 6 is a diagram showing a one-time pattern displayed in the field of vision of the wearer. [Figure 7] FIG. 7 is a diagram showing an example of a one-time pattern displayed on the smart glasses 10. [Figure 8] FIG. 8 is a diagram showing an example of a user's line of sight. [Figure 9] FIG. 9 is a diagram showing another example of the one-time pattern. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Next, an embodiment will be described with reference to the drawings. In the embodiment, multi-factor authentication is realized using biometric authentication using an eye tracking device (such as smart glasses) and one-time pattern authentication. In the following description, one-time means different each time. One-time pattern authentication is a method of performing authentication using a pattern that connects dots instead of a password used in password authentication. In this method, a different pattern is used each time authentication is performed.

[0013] <Configuration> 1 is a diagram showing an example of a system that implements an authentication method according to an embodiment. This system includes an information device 20 that is a target of login, and smart glasses 10 worn by a user. The smart glasses 10 include a communication module such as Bluetooth (registered trademark) and can locally communicate with the information device 20. Alternatively, local communication may be performed via a wireless link such as Wi-Fi (registered trademark), and a wired connection can be used to prevent radio wave leakage.

[0014] The smart glasses 10 have multiple authentication functions, namely, a fingerprint authentication function and an iris authentication function. Furthermore, the smart glasses 10 of the embodiment have an eye tracking function.

[0015] The information device 20 as an information processing device has a one-time pattern authentication function. That is, the information device 20 issues a different pattern each time authentication is requested. The pattern is created by, for example, geometrically arranging a plurality of attention points (icon buttons).

[0016] In the embodiment, first, biometric authentication of the wearer (user) is performed by the smart glasses 10, and then gaze pattern authentication is performed by the information device 20. In the gaze pattern authentication, a one-time pattern issued by the information device 20 is displayed on the smart glasses 10.

[0017] Fig. 2 is a functional block diagram showing an example of the smart glasses 10 shown in Fig. 1. The smart glasses 10 include a communication unit 18, a processor 12, a biosensor 13, a flash ROM 15, a RAM 19, and a display unit 17.

[0018] The communication unit 18 is a communication interface for wireless communication with the information device 20 . The processor 12 is a semiconductor device such as a System on Chip (SoC), and controls the information processing functions implemented in the smart glasses 10. The processor 12 also includes a transmission unit 11, a comparison unit 14, and a request unit 16 as its processing functions. These functions can be realized as processing functions written in advance as programs in an internal ROM (not shown) of the processor 12. Furthermore, the processor 12, the biosensor 13, the flash ROM 15, the RAM 19, and the display unit 17 can also be implemented on an IC chip. The introduction of a highly tamper-resistant IC chip can reduce the risk of information leakage.

[0019] The biosensor 13 is, for example, a fingerprint sensor attached to the vine of the smart glasses 10. The biosensor 13 is also an iris sensor that captures the pupils of the person (wearer) wearing the smart glasses 10 to acquire a unique pattern of the iris. That is, the smart glasses 10 are equipped with a fingerprint sensor and an iris sensor, and acquire the fingerprint pattern and iris pattern of the wearer. The smart glasses 10 also track (trace) the line of sight of the wearer using the iris sensor, and store the acquired line of sight trajectory information in the flash ROM 15.

[0020] The flash ROM 15 stores the user's fingerprint pattern and iris pattern as pre-registered biometric information 15a. The user, as a wearer, registers his / her own fingerprint pattern and iris pattern when using the smart glasses 10 for the first time. The RAM 19 is used as a temporary storage area during processing by the processor 12. The flash ROM 15 and the RAM 19 are storage units.

[0021] The comparison unit 14 compares the stored biometric information 15a with the biometric information acquired by the biometric sensor 13. If the comparison results in a match between the two, the biometric authentication is successful (authentication OK). If the authentication is OK, the comparison unit 14 notifies the request unit 16 of the result and starts a login sequence to the information device 20.

[0022] When a login sequence to the information device 20 is started, the request unit 16 requests the information device 20 to issue a one-time pattern. The display unit 17 receives the one-time pattern transmitted from the information device 20, projects it into the field of vision of the wearer, and visually displays it so that only the wearer can see it. The transmitter 11 transmits to the information device 20 line of sight trace information generated when the wearer traces the one-time pattern with his / her line of sight.

[0023] Fig. 3 is a functional block diagram showing an example of the information device 20 shown in Fig. 1. The information device 20 includes a communication unit 21, a storage unit 22, and a processor 23. The communication unit 21 communicates with the smart glasses 10 as an eye tracking device, receives a request to issue a one-time pattern, and transmits data of the one-time pattern. The storage unit 22 stores a program 22 a for implementing the functions of the information device 20 . The processor 23 is an arithmetic element such as a central processing unit (CPU) or a micro processing unit (MPU), and executes instructions written in the program 22a to realize various functions.

[0024] The processor 23 includes an authentication pattern issuing unit 23a, a receiving unit 23b, and a comparing unit 23c as processing functions according to the embodiment.

[0025] The authentication pattern issuing unit 23a creates a one-time pattern in response to a request from the smart glasses 10, and issues the one-time pattern to the smart glasses 10 that have made the request. The receiver 23b receives the line of sight trajectory information transmitted from the smart glasses 10. The comparison unit 23c compares the received line of sight information with the one-time pattern issued by the authentication pattern issuing unit 23a, and determines the degree of matching. Next, the operation of the above configuration will be described.

[0026] <effect> FIG. 4 is a schematic diagram showing an example of a procedure of an authentication method according to an embodiment.

[0027] (1) A user pre-registers his / her fingerprint and iris in the smart glasses 10, and registers the smart glasses 10 in the information device 20 to which the user is to log in. When the user puts on the smart glasses 10, biometric authentication is performed based on the fingerprint pattern and iris pattern.

[0028] (2) If the authentication is successful, the smart glasses 10 request a one-time pattern from the information device 20 that is the login target via Bluetooth (registered trademark) communication.

[0029] (3) The information device 20 confirms that the request is from a pair of smart glasses registered in advance and issues a one-time pattern. The smart glasses 10 receive the issued one-time pattern and project it into the user's field of vision.

[0030] (4) The user moves his / her gaze so as to trace the projected pattern. This gaze locus information is transmitted to the information device 20, which performs gaze pattern authentication processing.

[0031] Fig. 5 is a sequence diagram showing an example of an authentication method according to an embodiment. As shown in Fig. 5, when a user logs in to an information device 20, a first authentication process is first performed by the smart glasses 10. That is, the smart glasses 10 compare the wearer's fingerprint acquired by the fingerprint sensor with the biometric information 15a (fingerprint pattern) and perform fingerprint authentication (step S1). If the fingerprint is OK, the smart glasses 10 compare the wearer's iris pattern acquired by the iris sensor with the biometric information 15a (iris pattern) and perform iris authentication (step S2).

[0032] If both the fingerprint authentication (step S1) and the iris authentication (step S2) are OK, the smart glasses 10 request the information device 20 to issue a one-time pattern (step S4). Then, a second authentication process is started by both the smart glasses 10 and the information device 20. If at least either step S1 or step S2 is NG, the authentication is NG (step S3), and the user cannot proceed to the subsequent login procedure.

[0033] Now, the information device 20 that has received the request to issue a one-time pattern creates a one-time pattern and issues it to the smart glasses 10 that made the request (step S5). The smart glasses 10 that have received this visually display a pattern as shown in FIG. 6 in the field of vision of the wearer (step S6). In the example of FIG. 6, a pattern having four icon buttons within a square frame is displayed. When the line of sight of the user detected by the iris sensor remains in the same position for a predetermined time or more (for example, one second), a click event occurs. When a click event occurs at a position overlapping with an icon button, the time of occurrence, etc. are recorded.

[0034] 7 is a diagram showing an example of a one-time pattern displayed on the smart glasses 10. For example, a one-time pattern in which random numbers are arranged on icon buttons is displayed together with a message such as "Trace the pattern." The numbers correspond to the order of tracking by gaze, and the order changes randomly each time they are issued.

[0035] When a user sees the one-time pattern, the user moves his / her gaze according to the order of the numbers, stops his / her gaze on the icon button, and clicks it. The smart glasses 10 detect the position of the gaze one by one, and transmits the gaze trajectory information (including the time of occurrence of the click event) obtained along with the movement of the gaze to the information device 20 (step S7). The information device 20 receives this information, compares the received gaze trajectory information with the issued one-time pattern, and determines the degree of matching between the two (step S8). For example, whether the time of occurrence of the click event matches the order of the numbers in the one-time pattern is scored, and this is taken as the match rate. If the match rate is equal to or higher than a preset threshold (step S9), the information device 20 determines that the authentication is OK (step S11). Conversely, if the match rate is less than the preset threshold (step S10), the authentication is NG (step S10).

[0036] Fig. 8 is a diagram showing an example of the user's line of sight. In Fig. 8, the line of sight follows the correct trajectory in the order of the numbers, so it is determined that the authentication is OK. If the authentication in information device 20 is OK, the user's login state to information device 20 is established.

[0037] <Effects> As described above, in order to log in to the information device 20 in the embodiment, both the first authentication process and the second authentication process must be successful. In other words, the two-step authentication strengthens security, and even if the false rejection rate in the first biometric authentication is kept low to a certain extent, the risk of spoofing can be reduced. This increases the success rate of fingerprint authentication and improves convenience.

[0038] Furthermore, the one-time pattern used in the one-time pattern authentication is changed each time, so there is no risk of it being leaked. Also, the one-time pattern is projected onto the smart glasses 10, so there is no risk of it being intercepted. This also promotes further strengthening of security.

[0039] In addition, a user wearing the smart glasses 10 touches a fingerprint sensor on the vine to perform fingerprint authentication, and subsequent operations are performed by moving the line of sight, eliminating the need for keyboard input. In addition, by performing biometric authentication using the smart glasses 10, it can also be applied to login procedures for existing information devices that do not have a biometric authentication module. Furthermore, since communication between the smart glasses 10 and the information device 20 to be logged in is performed using Bluetooth (registered trademark), it can be used even when a network environment is not in place.

[0040] Fingerprint and iris information can be used even without the person's awareness, and it is possible that a malicious third party could make the person unconscious and use their biometric information to bypass authentication. In other words, biometric authentication alone is vulnerable to this type of abuse.

[0041] On the other hand, when one-time password authentication uses a token to issue the one-time password, there is a risk of losing the token. In addition, it requires a communication environment to use a dedicated app or SMS (Social Messaging Service), so the usage scenarios are limited. One-time password authentication also has such vulnerabilities.

[0042] In contrast, in the embodiment, the gaze pattern is tracked by eye tracking technology using an iris sensor or the like, and one-time pattern authentication is realized by comparing it with a one-time pattern that changes each time it is generated. Furthermore, a biometric authentication function is implemented in the smart glasses that track the gaze, so that only users who have passed the biometric authentication can move on to one-time pattern authentication. In this way, it is possible to strengthen the security of login authentication without compromising convenience.

[0043] For example, when login authentication is to be made stricter to strengthen the security of an existing system, even if the existing device does not have a fingerprint sensor or a camera, it can be implemented without modifying the hardware by using the biometric authentication function of smart glasses. Even devices that do not have Bluetooth (registered trademark) communication functions can communicate with smart glasses by using a Bluetooth (registered trademark) USB adapter, so the technology of the embodiment can be realized as long as the information device has a USB port. Furthermore, since it is sufficient to implement peer-to-peer communication between smart glasses and information devices, there is no need to rely on a backbone such as a public network or the Internet, and stable login authentication without delay is possible even when the network environment is unstable.

[0044] As a result, according to the embodiments, it is possible to provide an authentication method, an eye tracking device, and an information processing device that improve security without compromising convenience.

[0045] It should be noted that the present invention is not limited to the above embodiment. For example, a more complicated one-time pattern as shown in FIG.

[0046] In addition, a procedure may be provided in which the information device 20 authenticates the smart glasses 10 themselves. In other words, a process in which the information device 20 determines whether the smart glasses 10 that have requested the one-time pattern are a pre-registered eye tracking device or not may be further provided. For example, unique address information and ID are given to the smart glasses 10, and these information are notified to the information device 20 together with the request to issue the one-time pattern. Based on these pieces of information, the information device 20 can determine whether the smart glasses 10 are a legitimate request source. In this way, it is possible to further improve security.

[0047] Although the embodiment has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0048] 10...smart glasses, 11...transmission unit, 12...processor, 13...biometric sensor, 14...comparison unit, 15...flash ROM, 15a...biometric information, 16...request unit, 17...display unit, 18...communication unit, 19...RAM, 20...information device, 21...communication unit, 22...memory unit, 22a...program, 23...processor, 23a...authentication pattern issuing unit, 23b...receiving unit, 23c...comparison unit.

Claims

1. A first authentication step of performing biometric authentication of a wearer using an eye tracking device having a biometric sensor; A second authentication process for performing one-time authentication based on visual information using an information processing device capable of communicating with the eye tracking device, The first authentication process includes: The eye tracking device includes a step of comparing pre-registered biometric information with the biometric information of the wearer acquired by the biometric sensor, The second authentication process includes: The information processing device issues a one-time authentication pattern in response to a request from the eye tracking device; the eye tracking device receiving and visually displaying the authentication pattern in the wearer's field of view; a step of transmitting gaze trajectory information obtained by tracking the gaze of the wearer by the eye tracking device to the information processing device; The authentication method further comprises a step in which the information processing device compares the line of sight trajectory information with the authentication pattern.

2. The authentication method according to claim 1 , wherein the biometric information is a fingerprint pattern of the wearer.

3. The authentication method according to claim 1 , wherein the biometric information is an iris pattern of the wearer.

4. The authentication method according to claim 1 , wherein the authentication pattern includes a plurality of icon buttons whose tracking order changes each time the authentication pattern is issued.

5. The authentication method according to claim 1 , further comprising a step of determining, by the information processing device, whether or not the eye tracking device that has requested the authentication pattern is a preregistered eye tracking device.

6. An eye tracking device capable of communicating with an information processing device, A biosensor for acquiring biometric information of a wearer; A storage unit that stores pre-registered biometric information; a comparison unit that compares the stored biometric information with the biometric information acquired by the biometric sensor; a request unit that requests the information processing device to issue a one-time authentication pattern; a display unit that receives the authentication pattern and visually displays it in the wearer's field of vision; A transmission unit that transmits gaze trajectory information obtained by tracking the gaze of the wearer to the information processing device.

7. A communication unit that communicates with an eye tracking device having a biosensor; an authentication pattern issuing unit that issues a one-time authentication pattern in response to a request from the eye tracking device; A receiving unit that receives gaze trajectory information obtained by the eye tracking device tracking the gaze of the wearer from the eye tracking device; and a comparison unit that compares the line of sight trajectory information with the authentication pattern.

Citation Information

Patent Citations

  • Image display device and image display method and computer program

    JP2014092940A

  • Authentication system and input device

    JP2016081508A

  • Authentication device and authentication system

    JP2022169043A

  • Information display device, information display system, and information display method

    JP7160393B1

  • Eyewear with biometrics to protect displayed data

    US20060115130A1