Authentication system for electronic appliance
The authentication system for electronic devices uses biometric and behavioral data analysis to ensure high security, user-friendliness, and accuracy in preventing unauthorized access while managing user data effectively.
Patent Information
- Application Number
- JP2024152007
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-06-21
- Filing Date
- 2024-09-04
- Publication Date
- 2024-11-21
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing authentication systems for electronic devices face challenges in providing high security, user-friendliness, accuracy, and preventing personal information leakage.
An authentication system for electronic devices that includes an authentication means, data acquisition means, and data retention means, utilizing biometric authentication methods and data analysis to verify user identity based on usage patterns and behavior, with a mechanism to update and manage user data for enhanced security.
The system provides a highly secure, user-friendly, and accurate authentication method that minimizes personal information leakage by continuously verifying user behavior and locking unauthorized access.
Smart Images

Figure 2024163243000001_ABST
Abstract
Description
[Technical field]
[0001] An aspect of the present invention relates to an electronic device, an information terminal device, and an authentication system.
[0002] Note that one embodiment of the present invention is not limited to the above technical field. Examples of the technical field of one embodiment of the present invention disclosed in this specification and the like include a semiconductor device, a display device, a light-emitting device, a power storage device, a memory device, an electronic device, a lighting device, an input device, an input / output device, a driving method thereof, or a manufacturing method thereof. A semiconductor device refers to any device that can function by utilizing semiconductor characteristics. [Background technology]
[0003] In recent years, information terminal devices such as mobile phones such as smartphones, tablet information terminals, and notebook PCs (personal computers) have become widespread. Such information terminal devices often contain personal information, and various authentication technologies have been developed to prevent unauthorized use.
[0004] For example, Patent Document 1 discloses an electronic device that includes a fingerprint sensor in a push button switch section. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] US Patent Application Publication No. 2014 / 0056493 Summary of the Invention [Problem to be solved by the invention]
[0006] An object of one embodiment of the present invention is to provide an authentication system for an electronic device with a high level of security.Another object is to provide a user-friendly authentication system for an electronic device.Another object is to provide an authentication system for an electronic device that is less bothersome to a user.Another object is to provide an authentication system for an electronic device with high accuracy.Another object is to provide an authentication system for an electronic device in which a risk of leakage of personal information is suppressed.
[0007] Note that the description of these problems does not preclude the existence of other problems. Note that one embodiment of the present invention does not necessarily solve all of these problems. Note that problems other than these can be extracted from the description of the specification, drawings, claims, etc. [Means for solving the problem]
[0008] One aspect of the present invention is an authentication system for an electronic device having an authentication means, a data acquisition means, and a data storage means. The data storage means has a function of accumulating first data related to a usage state of a first user registered in advance and generating a first data group including a plurality of first data. The data acquisition means has a function of acquiring second data related to a usage state of a second user operating the electronic device. The authentication means has a function of authenticating that the second user is the first user based on the first data group and the second data, and a function of locking the electronic device when the second user is not authenticated. The data storage means has a function of deleting the first data included in the first data group.
[0009] In the above, it is preferable that the authentication means has a function of updating the first data group by using the second data.
[0010] One aspect of the present invention is an authentication system for an electronic device, the authentication system having a first authentication means, a second authentication means, a data acquisition means, and a data storage means. The data storage means has a function of accumulating first data related to a usage state of a first user registered in advance, and generating a first data group including a plurality of first data. The first authentication means has a function of authenticating that a second user operating the electronic device is the first user, and a function of unlocking the electronic device when the second user is authenticated. The data acquisition means has a function of acquiring second data related to a usage state of the second user when the electronic device is unlocked. The second authentication means has a function of authenticating that the second user is the first user based on the first data group and the second data, and a function of locking the electronic device when the second user is not authenticated. The data storage means has a function of deleting the oldest first data from the plurality of first data included in the first data group.
[0011] In the above, it is preferable that the second authentication means has a function of outputting the second data to the data holding means as one of the first data when the second user is authenticated.
[0012] In the above, it is preferable that the first data and the second data include one or more of posture information of the electronic device, information on the position of a hand touching the electronic device, and position information.
[0013] In the above, it is preferable that the first data group includes one or more of a start history, start time, usage time, setting information, and operation history of the application software, and a start sequence of the plurality of application software.
[0014] In the above, the second authentication means preferably has a function of authenticating the second user using anomaly detection. In this case, the second authentication means preferably has a function of authenticating the second user based on inference using machine learning.
[0015] In the above, it is preferable that the first authentication means includes one or more of face authentication, fingerprint authentication, vein authentication, voiceprint authentication, iris authentication, code input authentication, and pattern input authentication. Effect of the Invention
[0016] According to one aspect of the present invention, it is possible to provide an electronic device authentication system with a high level of security. Or, it is possible to provide a user-friendly electronic device authentication system. Or, it is possible to provide an electronic device authentication system that is less bothersome to the user. Or, it is possible to provide an electronic device authentication system with high accuracy. Or, it is possible to provide an electronic device authentication system in which the risk of personal information leaking is reduced.
[0017] Note that the description of these effects does not preclude the existence of other effects. Note that one embodiment of the present invention does not necessarily have all of these effects. Note that effects other than these can be extracted from the description in the specification, drawings, claims, etc. [Brief description of the drawings]
[0018] [Figure 1] FIG. 1 is a diagram illustrating an example of a system configuration. [Diagram 2] 2A to 2C are diagrams illustrating a method for measuring the tilt angle. [Diagram 3] 3A to 3D are diagrams showing configuration examples of the data holding means. [Figure 4] FIG. 4 is a flowchart illustrating the operation of the system. [Diagram 5] FIG. 5 is a flowchart illustrating the operation of the system. [Figure 6] 6A to 6E are diagrams showing examples of how the electronic device is used. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of an information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] Hereinafter, the embodiments will be described with reference to the drawings. However, it will be easily understood by those skilled in the art that the embodiments can be implemented in many different ways, and that the modes and details can be changed in various ways without departing from the spirit and scope of the present invention. Therefore, the present invention should not be interpreted as being limited to the description of the following embodiments.
[0020] In the configuration of the invention described below, the same parts or parts having similar functions are denoted by the same reference numerals in different drawings, and the repeated explanations are omitted. In addition, when referring to similar functions, the same hatch pattern may be used and no particular reference numeral may be used.
[0021] In addition, in each figure described in this specification, the size of each component, the thickness of a layer, or an area may be exaggerated for clarity, and therefore, the drawings are not necessarily limited to the scale.
[0022] In addition, ordinal numbers such as "first" and "second" in this specification are used to avoid confusion of components and do not limit the numbers.
[0023] (Embodiment 1) In this embodiment, an electronic device and an authentication system for the electronic device according to one embodiment of the present invention will be described.
[0024] In the drawings attached to this specification, the components are classified by function and shown in block diagrams as independent blocks. However, in reality, it is difficult to completely separate the components by function, and one component may be involved in multiple functions, or one function may be realized by multiple components.
[0025] [System configuration example] 1 shows a block diagram of a system 10 according to an embodiment of the present invention. The system 10 includes a first authentication means 11, a second authentication means 12, a data acquisition means 13, and a data storage means 14. The system 10 can be incorporated into an electronic device such as an information terminal device.
[0026] The first authentication means 11 judges (also called authentication) whether or not a user (also called second user) operating the electronic device is a user (also called first user or true user) registered in advance. The first authentication means 11 has a function of releasing the locked state of the electronic device when it judges that the second user is the first user, that is, when it has been authenticated.
[0027] Examples of authentication methods that can be applied to the first authentication means 11 include authentication methods that use user input, such as password input or pattern input, and authentication methods that use the user's biometric information, such as fingerprint authentication, vein authentication, voiceprint authentication, face authentication, and iris authentication (also called biometric authentication).
[0028] The second authentication means 12 judges whether or not the second user using the electronic device is a first user registered in advance, based on the data group 20 stored in the data storage means 14 and the data 22 acquired by the data acquisition means 13. Furthermore, the second authentication means 12 can lock the electronic device when it is determined that the second user is not the first user.
[0029] The data acquisition means 13 has a function of acquiring data 22 relating to the usage status of the electronic device of the second user authenticated by the first authentication means 11, and a function of outputting the data 22 to the second authentication means 12.
[0030] The data 22 acquired by the data acquisition means 13 includes various information such as information on the posture of the electronic device, information on the position of the hand or finger touching the electronic device, and position information of the electronic device.
[0031] A representative example of the attitude information of an electronic device is information on the tilt angle of the electronic device. In this case, by configuring the data acquisition means 13 to have an acceleration sensor, the tilt angle of the electronic device can be measured.
[0032] 2A and 2B, a method for measuring the tilt angle using an acceleration sensor will be described. For simplicity, the tilt in one axis direction will be described.
[0033] 2A and 2B are schematic diagrams showing electronic device 10A having acceleration sensor 13A as viewed from the side. Also, Fig. 2A and Fig. 2B show a state in which gravitational acceleration G is applied to electronic device 10A in the vertical direction. Fig. 2A shows a state in which electronic device 10A is held horizontally, and Fig. 2B shows a state in which electronic device 10A is tilted by angle θ from the state of Fig. 2A. It is assumed here that no acceleration other than gravitational acceleration G is applied to electronic device 10A.
[0034] Here, the acceleration sensor 13A is assumed to be capable of outputting an output value A[a] proportional to the magnitude of the acceleration a applied in the extension direction (X direction) of the electronic device 10A. In the state shown in Fig. 2A, since no acceleration is applied in the horizontal direction, the output value is A[0].
[0035] 2B, a schematic diagram is shown in which the gravitational acceleration G is resolved into the extension direction (X direction) and thickness direction (Y direction) of the electronic device 10A. The acceleration G applied in the X direction X and the acceleration G applied in the Y direction Y is given by the following formula using the gravitational acceleration G:
[0036]
number
[0037] Therefore, the output value A[G X ] is determined by the angle θ. In addition, by using the above formula, the output value A[GX ], the tilt angle θ of the electronic device 10A can be calculated.
[0038] The above is a description of the method for measuring the tilt angle using an acceleration sensor.
[0039] When using information on the position of the user's hand or fingers touching the electronic device as the data 22 acquired by the data acquisition means 13, the data acquisition means 13 can be configured to have a sensor that detects contact of the hand or fingers on the housing of the electronic device, etc.
[0040] Furthermore, when location information of an electronic device is used as data 22, a receiving device capable of receiving a GPS (Global Positioning System) signal can be used as data acquiring means 13. Alternatively, as a method for acquiring location information of an electronic device, a method using location information of an access point of a wireless LAN (Local Area Network) or a method estimating location information from the distance between a mobile phone base station and the electronic device can be used.
[0041] The moving speed of the electronic device can also be used as data 22. For example, the moving speed can be estimated from the change over time in the position information. The moving speed can also be estimated using the acceleration sensor. Furthermore, the user's means of transportation can be estimated from the moving speed. For example, if the estimated moving speed is about 5 km / h, it can be estimated that the user is walking, if it is about 10 km / h, it can be estimated that the user is running or riding a bicycle, etc., and if it is more than 30 km / h, it can be estimated that the user is traveling by car, motorcycle, train, etc.
[0042] As information that can be used as the data 22, various information related to the usage state of the electronic device by the user can be used. For example, the start time of the electronic device, the start history of application software, the order in which multiple application software are started, the time from starting a specific application software to closing it, the frequency of starting a specific application software, etc. can be mentioned. In addition, information that can identify an individual can be used as the data 22, such as volume setting information when playing music or videos, browsing history information in an Internet browser, search words entered when using search software, items purchased when shopping through the Internet, transaction information through Internet banking, etc. The data 22 exemplified here can be acquired without using a special sensor device or the like as the data acquisition means 13.
[0043] Furthermore, as information that can be used as data 22, information related to information input operations by a user can be used. For example, the speed of character input operation using a touch panel, the speed of typing operation using a keyboard, or the trajectory of input using a pointing device such as a mouse, a touch pad, a touch panel, or a stylus can be used. Such information input operations are unique to a user, and can therefore be suitably used as data for identifying an individual. In this case, the various input means described above can be configured to also function as data acquisition means 13.
[0044] The data holding means 14 has a function of holding a data group 20 consisting of a plurality of data, and a function of deleting old data included in the data group 20. It can also be said that the data holding means 14 has a function of generating, managing, or updating the data group 20.
[0045] 1, the data group 20 includes a plurality of data (data 21(1), data 21(2), etc.). In the following, when there is no need to distinguish between the data included in the data group 20, they will be described as data 21.
[0046] Each piece of data 21 includes data 22 acquired by the data acquiring means 13, and is data output from the second authentication means 12 to the data holding means 14. Time information is also added to each piece of data 22. A representative example of the time information is information on the time when the data is acquired by the data acquiring means 13.
[0047] When time-series data is used as the data 22 acquired by the data acquiring means 13, that is, when a plurality of data elements acquired within a predetermined period are included and the acquisition times of each data element are different, it is preferable to have one piece of time information associated with the data 22. In this case, it is preferable to configure the data 22 to include information on the acquisition time of each data element.
[0048] 1, data 21(1) in data group 20 means data to which time t1 is added as time information. Similarly, data 21(2) means data to which time t2 is added as time information. Here, time t1 is a time earlier than time t2, and the larger the number, the newer the data.
[0049] The data 21 input from the second authentication means 12 is newly added and stored in the data storage means 14. Here, the data storage means 14 preferably has a function of deleting the oldest data among the plurality of data 21 included in the data group 20.
[0050] 3A is a schematic diagram showing the data holding means 14 and the data group 20. Here, as the data group 20, n pieces of data 21, data 21(1) to data 21(n), are held in the data holding means 14. Here, of the n pieces of data 21, data 21(1) is the oldest data and data 21(n) is the newest data.
[0051] The data holding means 14 has a function of deleting data 21 that has passed a certain period of time from the data group 20. Fig. 3B shows a schematic diagram of data 21(1) being deleted from the data group 20. In this process, it is sufficient that at least data 21(1) is removed from the data group 20, and the removed data 21 itself may be erased from the storage device of the data holding means 14, or the removed data itself may be retained without being erased.
[0052] Moreover, the data holding means 14 has a function of adding the data 21 input from the second authentication means 12 to the data group 20. Fig. 3C shows a schematic diagram of how the data input from the second authentication means 12 is added to the data group 20 as the newest data 21(n+1).
[0053] The data 21 constituting the data group 20 may be, for example, data 21 from within the past year, within the past six months, or within the past three months. Although data 21 older than the past year may be used, it is preferable to compose the data group 20 with data 21 from within one year in order to respond to changes in the first user's use of the electronic device, behavioral patterns, etc. In particular, when the user is a child, the speed of the above-mentioned changes is fast as the child grows, so it is preferable to use very recent data (for example, from within three months) as the data 21 constituting the data group 20.
[0054] The number of data 21 contained in the data group 20 affects the accuracy of the judgment by the second authentication means 12, and therefore may be determined in consideration of the accuracy and processing speed according to the method used for the judgment by the second authentication means 12. For example, when the second authentication means 12 performs anomaly detection based on the k-nearest neighbor method, it is preferable that the number of data 21 contained in the data group 20 is 100 or more, preferably 500 or more, and more preferably 1000 or more, since this enables highly accurate anomaly detection.
[0055] Here, the frequency of data 21 deletion by the data holding means 14 may be, for example, data 21 older than a predetermined period (for example, one year) can be deleted at any time. If the frequency of deletion is higher than the frequency of addition of data 21, the number of data 21 in the data group 20 decreases, so the frequency of deletion may be lowered. On the other hand, if the frequency of addition of data 21 is higher than the frequency of deletion, the number of data 21 in the data group 20 increases, so the frequency of deletion can be increased. Here, if all of the data 21 in the data group 20 is recent data (for example, within the past week), there is a risk of a decrease in the accuracy of authentication by the second authentication means 12. Therefore, when the frequency of addition of data 21 is high, it is preferable to adjust the number of data 21 in the data group 20 so as to thin out the data, rather than deleting the data in order from the oldest. The frequency of addition of data 21 can be controlled by the second authentication means 12.
[0056] 3D, the data storage means 14 may be operated to delete the oldest data 21(1) when data 21(n+1) is added from the second authentication means 12. This allows the data storage means 14 to always store a data group 20 having the same number of data 21 (here, n pieces), making it unnecessary to adjust the number of pieces of data, and thus simplifying the process.
[0057] Next, the operation of the second authentication means 12 will be described.
[0058] The second authentication means 12 performs a process (hereinafter also referred to as an authentication process) for authenticating a user (a second user) who has been authenticated by the first authentication means 11 and is operating the electronic device. The authentication process is performed using a data group 20 held in the data holding means 14 and data 22 acquired by the data acquisition means 13.
[0059] First, the authentication process by the second authentication means 12 will be described. The authentication process by the second authentication means 12 preferably uses an anomaly detection method (also called outlier detection). Representative anomaly detection methods include a detection method based on the distance between data, a detection method based on data density, a detection method based on the statistical distribution of data, and a detection method based on the angle between data. Detection methods based on distance include the nearest neighbor method, the k-nearest neighbor method, and the subspace method. Detection methods based on density include the Local Outlier Factor (LOF) method and the iForest (Isolation Forest) method. Detection methods based on statistical distribution include Hotelling's T 2 Examples of methods include the Gaussian mixture distribution method, the kernel density estimation method, etc. Detection methods based on the angle between data include the Angle Based Outlier Detection (ABOD) method. Another method is the method using a support vector machine (SVM). As a support vector machine, it is particularly preferable to use One Class SVM.
[0060] The anomaly detection executed in the authentication process by the second authentication means 12 may be performed by inference using machine learning. In particular, it is preferable that the detection be performed by inference using a neural network. When machine learning is used, the second authentication means 12 may be configured to have a learning model trained using the data group 20. The second authentication means 12 can infer whether the data 22 is a normal value or an abnormal value based on the output value when the data 22 is input to the learning model.
[0061] In the case of using machine learning, when the data group 20 is updated, it is preferable to generate or update a new learning model using the updated data group 20. Alternatively, the learning model may be updated by performing reinforcement learning on the learning model using the newly added data 22.
[0062] As an example, the case where anomaly detection is performed using the k-nearest neighbor method will be described below. The multiple data 21 and data 22 included in the data group 20 are each treated as a vector. Here, the dimension of the vector is determined according to the data 21 and data 22. For example, the data on the inclination of the electronic device in one axis direction as described above will be a one-dimensional vector, and the data on the inclination in two axes directions will be a two-dimensional vector.
[0063] Next, when a sphere is considered that is centered on the data 22 and includes k pieces of data 21 (k is an integer equal to or greater than 1), the radius of the sphere can be taken as the degree of anomaly R1 of the data 22. Here, the degree of anomaly R1 may be taken as the distance from the data 22 to the kth closest piece of data 21. In this case, the distance can be typically taken as the Euclidean distance, but an optimal distance can be used depending on the type of data 22, such as the standardized Euclidean distance, the Mahalanobis distance, the Manhattan distance, the Chebyshev distance, or the Minkowski distance.
[0064] When the degree of abnormality R1 of the data 22 calculated as described above exceeds a preset threshold value, it can be determined that the data 22 is an abnormal value. In other words, the second authentication means 12 can determine that the second user operating the electronic device is not the first user registered in advance.
[0065] On the other hand, if the degree of abnormality R1 does not exceed the threshold value, the data 22 cannot be determined to be an abnormal value and can be determined to be a normal value. In this case, the second authentication means 12 can determine that the second user is the first user.
[0066] This concludes the explanation of the k-nearest neighbor algorithm.
[0067] This concludes the description of the authentication process.
[0068] When the second authentication means 12 determines that the second user is not the first user through the above authentication process, it can transition the electronic device to a locked state. On the other hand, when the second authentication means 12 determines that the second user is the first user, the electronic device maintains its logged-in state.
[0069] When the logged-in state of the electronic device is maintained, the second authentication means 12 may be in a standby state until the data 22 is next output from the data acquisition means 13. Alternatively, the second authentication means 12 may request the data acquisition means 13 to acquire the data 22 after a predetermined time has elapsed.
[0070] Furthermore, when the second authentication means 12 determines that the second user is the first user through the above authentication process, it can output the data 22 used in the authentication process to the data holding means 14 as the latest data 21. As a result, the data group 20 held in the data holding means 14 always contains only the data 21 related to the user authenticated by both the first authentication means 11 and the second authentication means 12, and there is no risk of information related to other users being mixed in, so that the accuracy of authentication can be maintained at a high level.
[0071] The above is the explanation of the operation of the second authentication means 12.
[0072] Here, some of the functions of the first authentication means 11, the second authentication means 12, the data acquisition means 13, and the data storage means 14 of the system 10 may be realized by a server or the like provided separately from the electronic device. In particular, when the calculation scale of the first authentication means or the second authentication means is large, the scale of calculation of the first authentication means or the second authentication means can be reduced by transmitting data to an external server via a network and having the server execute part of the calculation.
[0073] Here, it is particularly preferable that the first authentication means 11, the second authentication means 12, the data acquisition means 13, and the data storage means 14 shown in FIG. 1 are configured to complete processing within one electronic device. Since the data 22 and the data group 20 include information for identifying and identifying an individual, transmitting the information to the outside via a network increases the risk of the data being misused. Therefore, by completing the processing within one electronic device, an authentication system with an extremely high level of security can be realized. Note that the processing is not limited to one electronic device, and data may be transmitted and received between multiple electronic devices connected to an individual's home area network, or between electronic devices within a local network such as a company.
[0074] [System 10 operation example] The following describes an example of the operation of the system 10. Figure 4 is a flowchart relating to the operation of the system 10. The flowchart shown in Figure 4 has steps S0 to S6.
[0075] In step S0, the operation is started. For example, the operation is started when it is detected that the electronic device is turned on, the display unit is touched, or the attitude of the electronic device has changed significantly. At this time, the electronic device is in a locked state.
[0076] In step S1, authentication processing is performed by the first authentication means 11 (first authentication). If authentication is successful, the process proceeds to step S2. If authentication is not successful, the electronic device remains in the locked state and the process returns to step S1 again.
[0077] In step S2, the electronic device is unlocked and the user logs into the system.
[0078] In step S3, the data acquiring means 13 acquires the data 22. The data acquiring means 13 can output the acquired data 22 to the second authentication means 12 in response to a request from the second authentication means 12.
[0079] In step S4, authentication processing is performed by the second authentication means 12 (second authentication). If authenticated, the process proceeds to step S5. If not authenticated, the process proceeds to step S6.
[0080] In step S5, the second authentication means 12 outputs the data 22 used for authentication to the data holding means 14 as one piece of data 21. The data holding means 14 updates the data group 20 based on the new data 21 that has been input.
[0081] Furthermore, in step S5, the data holding means 14 may update the data group 20 by deleting old data 21 from the data group 20. Note that the timing of deleting the old data 21 is not limited to step S5, and the old data 21 may be deleted periodically at a predetermined timing (for example, once a day or once a week), or the data 21 may be deleted when a predetermined period has elapsed based on the time information of the data 21.
[0082] In step S5, it is preferable that the second authentication means 12 controls whether or not to update the data group 20. That is, the data 22 used for authentication may not be stored in the data storage means 14, and the data group 20 may not be updated. For example, when the data acquisition means 13 acquires the data 22 frequently, if the data group 20 in the data storage means 14 is updated every time the data 22 is acquired, the proportion of new data among the multiple data 21 in the data group 20 may become high. Therefore, it is preferable that the second authentication means 12 adjusts the frequency of updating the data group 20 based on the time information of each data 21 included in the data group 20.
[0083] In step S5, after updating of the data group 20 is completed, the process proceeds to step S3. This allows the authentication process by the second authentication means 12 to be repeated while the electronic device is in use. This allows the user to be authenticated with extremely high accuracy. In addition, since the data acquisition means 13 repeatedly acquires the data 22, the amount of data 21 stored in the data group 20 can be increased, and the accuracy of the authentication process by the second authentication means 12 can be further improved.
[0084] If the user is not authenticated in step S4, the electronic device is put into a locked state in step S6, and the system is logged off. This prevents the second user operating the electronic device from using the electronic device. Then, the process returns to step S1.
[0085] This concludes the description of the flowchart shown in FIG.
[0086] Here, as shown in Fig. 5, after step S6, the process may proceed to step S7. In step S7, a first user who has been registered in advance is notified that the electronic device may be being used illegally (alarm notification).
[0087] For example, various methods of alarm notification can be used, such as displaying a notification on another electronic device owned by the first user, sending a text, audio, or video message to a preregistered email address, SNS account, etc. Also, it is preferable that the alarm notification can be set in advance to notify not only the first user, but also the seller of the electronic device, a communication carrier, the police, etc.
[0088] It is also preferable to notify the location information of the electronic device at the same time as the alarm notification, and to notify information on the usage history of the electronic device (for example, transaction status when a product is purchased or a financial transaction is made over the Internet).
[0089] The above is a description of an example of the operation of the system.
[0090] [Specific example] A specific example of using an electronic device to which an authentication system according to an aspect of the present invention is applied will be described below.
[0091] 6A shows a state in which a user 50 is operating an electronic device 55. An authentication system according to an embodiment of the present invention is applied to the electronic device 55. The user 50 is the owner of the electronic device 55, and is registered in advance in the authentication system.
[0092] FIG. 6B shows the tilt θ of electronic device 55 when user 50 is using it. 1 , and the position of the eyes 51 of the user 50 are shown diagrammatically.
[0093] 6C shows a malicious user 50X operating electronic device 55. User 50X is different from user 50 in appearance (appearance), such as height and build.
[0094] FIG. 6D shows the tilt θ of electronic device 55 when user 50X is using it. 2 , and the position of the eye 51X of the user 50X are shown. 2 is the inclination θ 1 , and it can be seen that user 50X uses electronic device 55 in a posture closer to horizontal than user 50. It can also be seen that the distance between the eyes and electronic device 55 differs between user 50 and user 50X. The distance can be measured, for example, by a distance measuring method using infrared light.
[0095] Since the authentication system according to one embodiment of the present invention is applied to the electronic device 55, even if the user 50X breaks through the first authentication of the electronic device 55 by fraudulent means, the inclination θ 2By detecting the distance between electronic device 55 and eye 51X, it can be determined that user 50X is different from user 50 and can immediately transition to a locked state. Since user 50X is immediately locked no matter how many times he or she breaks through the first authentication, the authentication system can make user 50X give up unauthorized use.
[0096] 6E, user 50 can learn from the notification on wearable device 56 that someone may have attempted to illegally use electronic device 55. User 50 can check the location information of electronic device 55 on wearable device 56 and can quickly take action such as contacting the communication carrier to disable the electronic device or reporting the incident to the police.
[0097] Here, an example is shown in which unauthorized use is detected based on the inclination of the electronic device 55 and the distance between the electronic device 55 and the eyes, but this is not limiting and various information as described above can be used. For example, it is possible to obtain location information of the electronic device 55, and determine that there is a possibility of unauthorized use when the electronic device 55 is used for a certain period of time in a place outside the range where the user 50 usually moves.
[0098] It is also preferable to configure the system to perform a composite authentication of the user using two or more pieces of information (for example, two pieces of information, information on the inclination of the electronic device and information on the location of the electronic device). The more types of information used to identify the user, the more accurate the user identification can be, which is preferable. For example, even when the owner of the electronic device is traveling and using the electronic device in a place different from the owner's usual range of activities, false positives can be prevented by authenticating the user using other information, and a high level of security can be maintained without causing stress to the user.
[0099] The above is an explanation of a specific example.
[0100] The authentication system according to one aspect of the present invention is an authentication system with an extremely high level of security, since it is difficult for a true user to use an electronic device illegally, because the authentication process can be performed using the habits, quirks, and behavioral patterns of the true user when using the electronic device. Even if a malicious user breaks through the first authentication by a fraudulent means and releases the locked state, the electronic device can be immediately locked without giving the malicious user time to use the electronic device illegally. In addition, the true user can be immediately notified that a malicious user has attempted to use the electronic device, so the true user can take a prompt action. In addition, when the second authentication process is performed, the system does not request the user to perform an operation related to authentication, so the true user can continue to use the electronic device without being aware of it, and the true user hardly feels stressed.
[0101] This embodiment mode can be implemented by appropriately combining at least a part of it with other embodiment modes described in this specification.
[0102] (Embodiment 2) In this embodiment, an example of a hardware configuration of an information processing device capable of realizing an authentication system according to one embodiment of the present invention will be described. The electronic device exemplified in the first embodiment is one embodiment of the information processing device exemplified below.
[0103] 7 shows a block diagram of an information processing device 100 exemplified below. The information processing device 100 includes a calculation unit 101, a memory module 102, a communication module 103, a display module 104, a fingerprint sensor module 111, an acceleration sensor module 112, a camera module 113, a GPS module 114, a physical button 115, a sensor module 116, a sound module 121, a vibration module 122, a fragrance module 123, a lighting module 124, a battery module 105, an external interface 106, and the like.
[0104] The information processing device 100 can display images using the display module 104, and therefore can also be called an image display device.
[0105] In the following, for ease of explanation, when there is no need to distinguish between components other than the calculation unit 101 included in the information processing device 100, each component may be referred to as a component or a module.
[0106] It is not necessary for the information processing device 100 to have all the components shown in Fig. 7. Moreover, the information processing device 100 may have components other than the components shown in Fig. 7.
[0107] Each component is connected to the calculation unit 101 via a bus line 110 .
[0108] In the first embodiment, the function of the first authentication means 11 can be realized by one or more of the calculation unit 101, the memory module 102, the fingerprint sensor module 111, the camera module 113, the physical button 115, the sensor module 116, etc. The function of the second authentication means 12 can be realized by the calculation unit 101, the memory module 102, etc. The function of the data acquisition means 13 can be realized by one or more of the acceleration sensor module 112, the camera module 113, the GPS module 114, the physical button 115, the sensor module 116, the sound module 121, etc. The function of the data holding means 14 can be realized by the calculation unit 101, the memory module 102, etc.
[0109] The calculation unit 101 can function as, for example, a central processing unit (CPU) The calculation unit 101 has a function of controlling each component.
[0110] Signals are transmitted between the calculation unit 101 and each component via a bus line 110. The calculation unit 101 has a function of processing signals input from each component connected via the bus line 110, a function of generating signals to be output to each component, and the like, and can comprehensively control each component connected to the bus line 110.
[0111] Note that a transistor in which an oxide semiconductor is used in a channel formation region and which has an extremely low off-state current can be used in the ICs or the like included in the computing unit 101 or other components. Since the off-state current of the transistor is extremely low, the transistor can be used as a switch for holding charge (data) flowing into a capacitor functioning as a memory element, thereby ensuring a long data holding period. By using this characteristic in a register or cache memory of the computing unit 101, the computing unit 101 is operated only when necessary, and information from the immediately preceding process is saved in the memory element in other cases, thereby enabling normally-off computing and enabling low power consumption of the information processing device 100.
[0112] The computing unit 101 performs various data processing and program control by interpreting and executing commands from various programs using a processor. The programs that can be executed by the processor may be stored in a memory area of the processor or may be stored in the memory module 102.
[0113] As the calculation unit 101, in addition to a CPU, other microprocessors such as a DSP (Digital Signal Processor) and a GPU (Graphics Processing Unit) can be used alone or in combination. Furthermore, these microprocessors may be realized by a PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array) or an FPA (Field Programmable Analog Array).
[0114] The calculation unit 101 may have a main memory. The main memory may include a volatile memory such as a random access memory (RAM) or a non-volatile memory such as a read only memory (ROM).
[0115] The RAM provided in the main memory may be, for example, a dynamic random access memory (DRAM), and a memory space is virtually allocated and used as a working space for the calculation unit 101. The operating system, application programs, program modules, program data, etc. stored in the memory module 102 are loaded into the RAM for execution. The data, programs, and program modules loaded into the RAM are directly accessed and operated by the calculation unit 101.
[0116] On the other hand, ROM can store BIOS (Basic Input / Output System) and firmware that do not require rewriting. As ROM, mask ROM, OTPROM (One Time Programmable Read Only Memory), EPROM (Erasable Programmable Read Only Memory), etc. can be used. As EPROM, UV-EPROM (Ultra-Violet Erasable Programmable Read Only Memory), which allows the stored data to be erased by exposure to ultraviolet light, EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory, etc. can be used.
[0117] Moreover, it is preferable that the calculation unit 101 has a processor specialized for parallel calculation rather than a CPU. For example, it is preferable that the calculation unit 101 has a processor having a large number (several tens to several hundreds) of processor cores capable of parallel processing, such as a GPU, a TPU (Tensor Processing Unit), or an NPU (Neural Processing Unit). This enables the calculation unit 101 to perform calculations particularly related to neural networks at high speed.
[0118] The memory module 102 may be, for example, a storage device using a nonvolatile storage element such as a flash memory, MRAM (Magnetoresistive Random Access Memory), PRAM (Phase change RAM), ReRAM (Resistive RAM), or FeRAM (Ferroelectric RAM), or a storage device using a volatile storage element such as DRAM (Dynamic RAM) or SRAM (Static RAM). Also, a recording media drive such as a hard disk drive (HDD) or a solid state drive (SSD) may be used.
[0119] Also, a storage device such as an HDD or SSD that is detachable via a connector to the external interface 106, or a media drive for a recording medium such as a flash memory, a Blu-ray disc, or a DVD can be used as the memory module 102. Note that the memory module 102 may not be built into the information processing device 100, and an external storage device may be used as the memory module 102. In that case, the memory module 102 may be connected via the external interface 106, or may exchange data wirelessly via the communication module 103.
[0120] The communication module 103 can perform communication via an antenna. For example, the communication module 103 controls a control signal for connecting the information processing device 100 to a computer network in response to an instruction from the calculation unit 101, and transmits the control signal to the computer network. This allows the information processing device 100 to be connected to a computer network such as the Internet, an intranet, an extranet, a personal area network (PAN), a LAN, a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), or a global area network (GAN) to perform communication. When multiple communication methods are used, the communication module 103 may have multiple antennas according to the communication methods.
[0121] The communication module 103 may be provided with, for example, a high-frequency circuit (RF circuit) for transmitting and receiving an RF signal. The high-frequency circuit is a circuit for converting between an electromagnetic signal and an electric signal in a frequency band defined by the laws of each country and for wirelessly communicating with other communication devices using the electromagnetic signal. A frequency band of several tens of kHz to several tens of GHz is generally used as a practical frequency band. The high-frequency circuit connected to the antenna has a high-frequency circuit section corresponding to a plurality of frequency bands, and the high-frequency circuit section may have an amplifier, a mixer, a filter, a DSP, an RF transceiver, and the like. When performing wireless communication, the communication protocol or technology may be a communication standard defined by 3GPP (Third Generation Partnership Project) (registered trademark), such as LTE (Long Term Evolution) (registered trademark), LTE-Advanced corresponding to the fourth generation mobile communication system, or a standard corresponding to the fifth generation mobile communication system (5G), or a communication standard defined by IEEE (Institute of Electrical and Electronics Engineers) (registered trademark), such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).
[0122] The communication module 103 may also have a function of connecting the information processing device 100 to a telephone line. The communication module 103 may also have a tuner that generates a video signal to be output to the display module 104 from a broadcast wave received by an antenna.
[0123] The display module 104 includes a display panel, a display controller, a source driver, a gate driver, and the like. An image can be displayed on the display surface of the display panel. The display module 104 may further include a projection unit (screen) and project the image displayed on the display surface of the display panel onto the screen. In this case, if a material that transmits visible light is used as the screen, an AR device that displays an image superimposed on a background image can be realized.
[0124] Display elements that can be used in the display panel include liquid crystal elements, organic EL elements, inorganic EL elements, LED elements, microcapsules, electrophoretic elements, electrowetting elements, electrofluidic elements, electrochromic elements, MEMS elements, and the like.
[0125] Also, a touch panel having a touch sensor function can be used as the display panel. In that case, the display module 104 may be configured to have a touch sensor controller, a sensor driver, and the like. The touch panel is preferably an on-cell type touch panel in which the display panel and the touch sensor are integrated, or an in-cell type touch panel. The on-cell type or in-cell type touch panel can be made thin and lightweight. Furthermore, the on-cell type or in-cell type touch panel can reduce the number of parts, thereby reducing costs.
[0126] The fingerprint sensor module 111 has a function of acquiring information on a user's fingerprint. The fingerprint sensor module 111 may include a sensor and a sensor controller. The fingerprint sensor module 111 may use various sensors as the sensor, such as an optical fingerprint sensor that uses visible light or infrared light, a capacitance type fingerprint sensor, a surface acoustic wave type fingerprint sensor, or the like.
[0127] The acceleration sensor module 112 has a function of measuring acceleration and can detect the attitude of the device. The acceleration sensor module 112 can be configured to have an acceleration sensor of, for example, a capacitance type, a piezoresistance type, a thermal detection type, or the like, and a sensor controller. Also, instead of the acceleration sensor, a gyro sensor may be configured to have a gyro sensor.
[0128] The camera module 113 may have an imaging element and a controller. For example, a still image or a video can be captured by pressing the physical button 115 or by operating the touch panel of the display module 104. The captured image or video data can be stored in the memory module 102. The image or video data can be processed by the calculation unit 101. The camera module 113 may use the lighting module 124 as a light source for capturing images. The lighting module 124 may be, for example, a lamp such as a xenon lamp, or a light-emitting element such as an LED or an organic EL. Alternatively, light emitted by a display panel of the display module 104 may be used as a light source for capturing images. In this case, light of various colors, not just white, may be used for capturing images.
[0129] The GPS module 114 may have an antenna and a receiving circuit for receiving GPS signals. The GPS module 114 can obtain current location information with high accuracy. The communication module 103 can obtain location information using a wireless LAN access point, or estimate location information from the distance between the device and a mobile phone base station.
[0130] The physical button 115 may be a button associated with functions such as power on, power off, volume adjustment, input of numbers and characters, selection, confirmation, etc. In addition, the physical button 115 may have a function of waking the device from a sleep state or transitioning to a sleep state by operating the physical button 115.
[0131] The sensor module 116 includes a sensor unit and a sensor controller. The sensor controller receives an input from the sensor unit, converts it into a control signal, and outputs it to the calculation unit 101 via the bus line 110. The sensor controller may perform error management of the sensor unit, or may perform calibration processing of the sensor unit. The sensor controller may be configured to include a plurality of controllers for controlling the sensor units.
[0132] The sensor unit of the sensor module 116 preferably includes a photoelectric conversion element that detects visible light, infrared light, ultraviolet light, or the like and outputs the detection intensity. In this case, the sensor unit can be called an image sensor unit.
[0133] In addition to the sensor unit, the sensor module 116 preferably has a light source that emits visible light, infrared light, or ultraviolet light. In particular, when the sensor module 116 is used to detect a part of the user's face, having a light source that emits infrared light allows imaging with high sensitivity without making the user feel dazzled.
[0134] In addition, the sensor module 116 may be configured to include various sensors having the function of measuring, for example, force, displacement, position, velocity, acceleration, angular velocity, rotation speed, distance, light, liquid, magnetism, temperature, chemicals, sound, time, hardness, electric field, current, voltage, power, radiation, flow rate, humidity, gradient, vibration, odor, or infrared light.
[0135] The sound module 121 has an audio input unit, an audio output unit, a sound controller, and the like. The audio input unit has, for example, a microphone and an audio input connector. The audio output unit has, for example, a speaker and an audio output connector. The audio input unit and the audio output unit are each connected to the sound controller, and are connected to the calculation unit 101 via a bus line 110. The audio data input to the audio input unit is converted into a digital signal in the sound controller, and is processed in the sound controller and the calculation unit 101. Meanwhile, the sound controller generates an analog audio signal audible to the user in response to a command from the calculation unit 101, and outputs the signal to the audio output unit. An audio output device such as an earphone, a headphone, or a headset can be connected to the audio output connector of the audio output unit, and the audio generated by the sound controller is output to the device.
[0136] The vibration module 122 can be configured to include a vibration element and a vibration controller that controls the vibration element. As the vibration element, an element capable of converting an electric signal or a magnetic signal into vibration, such as a vibration motor (eccentric motor), a resonant actuator, a magnetostrictive element, or a piezoelectric element, can be used.
[0137] The vibration module 122 can vibrate the vibration elements in various vibration patterns by controlling the frequency, amplitude, and period of vibration of the vibration elements in response to commands from the calculation unit 101.
[0138] The fragrance module 123 may be configured to include a fragrance, a heating device for applying heat to the fragrance or a vibration device for applying vibration to the fragrance, and a controller for controlling these devices. It is preferable that the fragrance is replaceable so that the user can freely select the fragrance according to their preference. The fragrance may be in a liquid, gel, or solid form.
[0139] Fragrance module 123 can control the amount of fragrance from the fragrance in response to commands from calculation unit 101. Also, by configuring the device to be able to accommodate two or more types of fragrance, it becomes possible to select different fragrances or to diffuse a fragrance that is a combination of two or more fragrances.
[0140] The lighting module 124 may have a configuration including a lighting device and a lighting controller. As the lighting device, various lighting devices such as a lighting panel in which organic EL elements or LED elements are arranged in a planar or strip shape, a light bulb, a fluorescent lamp, etc. are usable. In particular, it is preferable to use a lighting device that can change the chromaticity and illuminance.
[0141] The lighting module 124 can control the illuminance and color tone of the lighting by a lighting controller in response to a command from the calculation unit 101.
[0142] The battery module 105 may have a configuration including a secondary battery and a battery controller. Representative examples of the secondary battery include a lithium ion secondary battery and a lithium ion polymer secondary battery. The battery controller may have a function of supplying the power stored in the battery to each component, a function of receiving power supplied from an external source and charging the battery, a function of controlling the charging operation according to the battery charging state, and the like. For example, the battery controller may have a configuration including a BMU (Battery Management Unit) and the like. The BMU collects data on the cell voltage and cell temperature of the battery, monitors overcharging and overdischarging, controls the cell balancer, manages the battery degradation state, calculates the remaining battery capacity (State Of Charge: SOC), controls fault detection, and the like.
[0143] The external interface 106 may be, for example, an external port that is provided in the information processing device 100 and that can connect an external device via a connector.
[0144] The external port of the external interface 106 can be configured to be connectable via a cable to devices such as input means, such as a keyboard or a mouse, output means, such as a printer, or storage means, such as a HDD. A representative example is a USB terminal. The external port may also have a terminal for connecting to a LAN, a terminal for receiving digital broadcasts, a terminal for connecting an AC adapter, etc. Also, a configuration may be adopted in which a transmitter / receiver for optical communication using infrared light, visible light, ultraviolet light, or the like is provided in addition to wired communication.
[0145] The above is a description of the hardware configuration of the information processing device 100.
[0146] This embodiment mode can be implemented by appropriately combining at least a part of it with other embodiment modes described in this specification. [Explanation of symbols]
[0147] 10: system, 10A: electronic device, 11: authentication means, 12: authentication means, 13: data acquisition means, 13A: acceleration sensor, 14: data storage means, 20: data group, 21: data, 22: data, 50: user, 50X: user, 51: eye, 51X: eye, 55: electronic device, 56: wearable device, 100: information processing device, 101: calculation unit, 102: memory module, 103: communication module, 104: display module, 105: battery module, 106: external interface, 110: bus line, 111: fingerprint sensor module, 112: acceleration sensor module, 113: camera module, 114: GPS module, 115: physical button, 116: sensor module, 121: sound module, 122: vibration module, 123: fragrance module, 124: lighting module
Claims
[Claim 1] An authentication system for an electronic device having an authentication means, a data acquisition means, and a data storage means, the data storage means has a function of storing first data relating to a usage state of a first user registered in advance and generating a first data group including a plurality of the first data; the data acquisition means has a function of acquiring second data relating to a usage state of a second user who is operating the electronic device, the authentication means has a function of authenticating that the second user is the first user based on the first data group and the second data, and a function of locking the electronic device when the second user is not authenticated; The data holding means has a function of deleting the first data included in the first data group.
Citation Information
Patent Citations
Personal identification device
JP2010044639A
A less cumbersome, more secure mobile device
JP2013541076A
Electronic device performing finger biometric pre-matching and related methods
US20140056493A1
