Information processing device and control method

The dual-processor system in information processing devices controls face image registration based on authorized user detection and HID inputs, addressing unnecessary registrations and maintaining memory capacity by registering only authorized users, ensuring secure face authentication.

JP7583144B1Active Publication Date: 2024-11-13LENOVO IRELAND INTERNATIONAL LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023211983
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-12-15
Publication Date
2024-11-13
Estimated Expiration
2043-12-15

AI Technical Summary

Technical Problem

Existing face detection-based activation methods in information processing devices can inadvertently activate when unauthorized users approach, leading to unnecessary registration of facial images, quickly filling up memory capacity due to multiple similar faces of authorized users.

Method used

The information processing device employs a dual-processor system to perform face detection and authentication, where a first processor detects and authenticates faces, and a second processor controls user registration based on the activation factor, ensuring only authorized users' images are registered by considering inputs from Human Interface Devices (HID) and successful authentication results.

Benefits of technology

This approach prevents unnecessary registration of facial images, maintaining memory capacity by registering only authorized users' faces appropriately, thereby preventing memory overflow and ensuring secure face authentication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583144000001_ABST
    Figure 0007583144000001_ABST
Patent Text Reader

Abstract

Appropriately register facial images of authorized users for use in face authentication. [Solution] The information processing device executes a face detection process for detecting a face image area in which a face is captured from an image captured by an imaging unit, and a face authentication process for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user, and starts the system from a standby state by executing a system program based on the face image area being detected by the face detection process and face authentication by the face authentication process being successful. Furthermore, when the information processing device starts the system, it controls whether or not to execute a user registration process for registering information based on the face image detected by the face detection process after the system is started as information based on the face image of a legitimate user, depending on whether the cause of the start-up is an input to an HID.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There is an information processing device that transitions to a usable state when a person approaches, and transitions to a standby state in which all functions except for some functions are stopped when the person leaves. For example, in Patent Document 1, an infrared sensor is used to detect whether a person is approaching or moving away.

[0003] In recent years, the accuracy of detecting a face from an image has improved due to the development of computer vision and the like. Therefore, face detection has begun to be used instead of detecting a person using an infrared sensor. Furthermore, when starting up an information processing device, user authentication (e.g., login authentication) is performed to determine whether the user is a legitimate user, and face authentication is becoming more common as this authentication method. For example, when a person approaches, the information processing device starts up by detecting the face of the person, and then performs login authentication such as face authentication to permit login to the system if the user is a legitimate user, transitioning to a usable state. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-148895 A Summary of the Invention [Problem to be solved by the invention]

[0005] The above-mentioned method of starting up by face detection has a problem that it starts up unnecessarily when a person other than a legitimate user approaches. To solve this problem, for example, a method of performing face detection when authentication is successful in OS login authentication, registering the detected face image as the face image of the legitimate user, and performing face detection and face authentication at the time of startup can be considered. However, from the viewpoint of safety, it is desirable to keep the registration information of the face image in the processor for face detection, and in that case, the OS side cannot determine whether the detected face image has been registered. Therefore, if a face image is registered every time authentication is successful in OS login authentication, a large number of face images of legitimate users (face images of similar faces of the same person) will be registered, and there is a concern that the registration frame (memory capacity) will be filled up quickly.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and has as its object to provide an information processing device and a control method that appropriately register face images of authorized users to be used for face authentication. [Means for solving the problem]

[0007] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a memory for temporarily storing a system program, a first processor for executing a face detection process for detecting an area of ​​a facial image in which a face is captured from an image captured by an imaging unit, and a face authentication process for performing face authentication based on information based on the detected facial image and information based on a facial image of a legitimate user, and a second processor for starting up the system from a standby state by executing the system program based on the area of ​​the facial image being detected by the face detection process and face authentication by the face authentication process being successful, and when the system is started up, the second processor controls whether or not to cause the first processor to execute a user registration process for registering information based on the facial image detected by the face detection process after the system is started as information based on the facial image of the legitimate user, depending on whether the cause of the start-up is due to input to an HID (Human Interface Device).

[0008] In the above information processing device, when the system is started up as a result of input to the HID, the second processor may cause the first processor to execute the user registration process, and when the start-up is not caused by input to the HID, the second processor may not cause the first processor to execute the user registration process.

[0009] In the above information processing device, the second processor may determine that the cause of starting the system is the input to the HID if the difference between the timing when the input to the HID is detected and the timing when the display unit is turned on in response to startup of the system is within a predetermined time.

[0010] In addition, an information processing device according to a second aspect of the present invention includes a memory for temporarily storing a system program, a first processor for executing a face detection process for detecting an area of ​​a face image in which a face is captured from an image captured by an imaging unit, and a face authentication process for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user, and a second processor for starting up the system from a standby state by executing the system program based on the area of ​​the face image being detected by the face detection process and the face authentication by the face authentication process being successful, wherein when the system is started up, the second processor determines whether or not a difference between a timing at which an input to an HID (Human Interface Device) is detected and a timing at which the display of a display unit is turned on in response to the start-up of the system is within a predetermined time, and if the determination result is true, causes the first processor to execute a user registration process for registering information based on the face image detected by the face detection process after the start-up of the system as information based on the face image of the legitimate user, and if the determination result is false, does not cause the first processor to execute the user registration process.

[0011] In addition, an information processing device according to a third aspect of the present invention includes a memory for temporarily storing a system program, a first processor for executing a face detection process for detecting an area of ​​a face image in which a face is captured from an image captured by an imaging unit, and a face authentication process for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user, and a second processor for starting up the system from a standby state by executing the system program, and when the system is started up, the second processor controls whether or not to cause the first processor to execute a user registration process for registering information based on the face image detected by the face detection process after the system is started up as information based on the face image of the legitimate user, depending on whether or not the cause of the start-up is due to the area of ​​the face image being detected by the face detection process and face authentication by the face authentication process being successful.

[0012] In the above information processing device, the second processor may cause the first processor to execute the user registration process when the system is started due to a factor other than successful face authentication by the face recognition process, and may not cause the first processor to execute the user registration process when the system is started based on the successful authentication result of the face recognition process.

[0013] In the above information processing device, after starting up the system, the second processor executes a system authentication process to authenticate whether or not the user is a legitimate user through system processing, and the first processor may, as the user registration process, register information based on a face image detected by the face detection process as information based on the face image of the legitimate user within a predetermined time after authentication by the system authentication process is successful.

[0014] In the above information processing device, the first processor may, as the user registration process, register information based on a face image detected by the face detection process within a predetermined time after successful authentication by the system authentication process, when the face is oriented in a specific direction, as information based on the face image of the legitimate user.

[0015] In the above information processing device, when information based on a facial image of the legitimate user has not been registered, the second processor may cause the first processor to execute the user registration process regardless of the factor that started up the system.

[0016] In addition, according to a fourth aspect of the present invention, a control method in an information processing device having a memory for temporarily storing a system program, a first processor, and a second processor includes the steps of: the first processor performing a face detection process for detecting an area of ​​a facial image in which a face is captured from an image captured by an imaging unit; the first processor performing a face authentication process for performing face authentication based on information based on the detected facial image and information based on a facial image of a legitimate user; the second processor starting up the system from a standby state by executing a program of the system based on the detection of the area of ​​the facial image by the face detection process and the success of the facial authentication by the face authentication process; and when the second processor starts up the system, controlling whether or not to cause the first processor to execute a user registration process for registering information based on the facial image detected by the face detection process after the system is started as information based on the facial image of the legitimate user, depending on whether the cause of the start-up is due to input to a HID (Human Interface Device).

[0017] According to a fifth aspect of the present invention, there is provided a control method for an information processing device including a memory for temporarily storing a system program, a first processor, and a second processor, the control method including a step of the first processor performing a face detection process for detecting a face image area in which a face is captured from an image captured by an imaging unit, a step of the first processor performing a face authentication process for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user, a step of the second processor starting up the system from a standby state by executing a program of the system based on the detection of the face image area by the face detection process and the success of face authentication by the face authentication process, and a step of the second processor starting up the system from a standby state by executing a program of the system. and a step of causing the first processor to execute a user registration process for registering information based on a face image detected by the face detection process after the system is started as information based on the face image of the authorized user, if the determination result is false, and the second processor does not cause the first processor to execute the user registration process.

[0018] In addition, according to a sixth aspect of the present invention, a control method in an information processing device having a memory for temporarily storing a system program, a first processor, and a second processor includes the steps of: the first processor performing a face detection process for detecting an area of ​​a facial image in which a face is captured from an image captured by an imaging unit; the first processor performing a face authentication process for performing face authentication based on information based on the detected facial image and information based on a facial image of a legitimate user; the second processor starting up the system from a standby state by executing a program of the system; and, when the second processor starts up the system, controlling whether or not to cause the first processor to execute a user registration process for registering information based on the facial image detected by the face detection process after starting up the system as information based on the facial image of the legitimate user, depending on whether or not the cause of the startup is due to the area of ​​the facial image being detected by the face detection process and facial authentication by the face authentication process being successful. Effect of the Invention

[0019] According to the above-described aspects of the present invention, it is possible to appropriately register a face image of a legitimate user to be used for face authentication. [Brief description of the drawings]

[0020] [Figure 1] 4 is a view for explaining an overview of HPD processing of the information processing device according to the embodiment. [Diagram 2] 5 is a diagram showing an example of a person detection range of the information processing device according to the embodiment. [Diagram 3] 4 is a diagram showing an overview of HPD processing using an HPD user ID of the information processing device according to the embodiment. [Figure 4] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to an embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 6] FIG. 2 is a block diagram showing an example of a functional configuration of an information processing apparatus according to an embodiment. [Figure 7]11 is a flowchart showing an example of an HPD process in a standby state according to the embodiment. [Figure 8] 10 is a flowchart showing an example of login authentication processing by face authentication according to the embodiment. [Figure 9] 11 is a flowchart showing an example of a user registration control process according to the embodiment. [Figure 10] 11 is a flowchart showing an example of a user registration process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First, an overview of the information processing device according to the present embodiment will be described. The information processing device 1 according to the present embodiment is, for example, a notebook type (clamshell type) PC (Personal Computer). The information processing device 1 may be any type of information processing device, such as a desktop type PC, a tablet type PC, or a smartphone.

[0022] The information processing device 1 can transition between at least a normal operation state (power-on state) and a standby state as the system operation state. The normal operation state is an operation state in which processing can be executed without particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface). The standby state is a state in which at least a part of the system processing is restricted. For example, the standby state may be a standby state, a sleep state, or the like, and may be a state equivalent to modern standby in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI. For example, the standby state is an operation state in which power consumption is lower than that of the normal operation state.

[0023] In the following, the transition of the system's operating state from the standby state to the normal operating state may be referred to as "activation." In the standby state, the activity of the operation is generally lower than in the normal operating state, so activating the system of the information processing device 1 activates the operation of the system in the information processing device 1.

[0024] FIG. 1 is a diagram for explaining an outline of the HPD process of the information processing device 1 according to the present embodiment. The information processing device 1 detects a person (i.e., a user) existing in the vicinity of the information processing device 1. This process of detecting the presence of a person is called HPD (Human Presence Detection) process. The information processing device 1 detects the presence or absence of a person by the HPD process, and controls the operation state of the system of the information processing device 1 based on the detection result. For example, as shown in FIG. 1(A), when the information processing device 1 detects a change from a state in which no person is present in front of the information processing device 1 (Absence) to a state in which a person is present (Presence), that is, when it detects that a person has approached the information processing device 1 (Approach), it determines that a user has approached, automatically starts the system, and transitions to a normal operation state. Also, as shown in FIG. 1(B), when a person is present in front of the information processing device 1 (Presence), it determines that a user is present, and continues the normal operation state. Then, when the information processing device 1 detects a change from a state in which a person is present (Presence) in front of the information processing device 1 (front) to a state in which a person is not present (Absence), that is, when the information processing device 1 detects that the person has left the information processing device 1 (Leave), as shown in FIG. 1(C), it determines that the user has left and transitions the system to a standby state.

[0025] The information processing device 1 detects the presence of a person within a predetermined range ahead (on the front side). FIG. 2 is a diagram showing an example of a detection range of a person of the information processing device 1 according to the present embodiment. In the illustrated example, a detection range FoV (Field of View: detection viewing angle) in front (front side) of the information processing device 1 is a range in which a person can be detected. For example, the information processing device 1 detects a face image area (hereinafter referred to as a "face area") in which a face is captured from a captured image capturing the front (front side) to determine whether or not a person (user) is present in front (front) of the information processing device 1. The detection range FoV corresponds to an imaging angle of view captured by the information processing device 1. When a face area is detected from the captured image, the information processing device 1 determines that a user is present. On the other hand, when a face area is not detected from the captured image, the information processing device 1 determines that a user is not present.

[0026] For example, when the information processing device 1 detects a face area from a captured image in a standby state and determines that a user is present, the information processing device 1 starts the system from the standby state. After the system is started, the information processing device 1 executes a system authentication process for authenticating whether or not the user is a legitimate user through system processing. A legitimate user is a user who is registered in advance as a user who uses the information processing device 1. When the information processing device 1 determines that the user is a legitimate user, it permits use (permits login) and transitions to a normal operation state. On the other hand, when the information processing device 1 determines that the user is not a legitimate user, it does not permit use (permits login) and continues the state waiting for authentication. This user authentication by the system authentication process at the time of startup is hereinafter referred to as "login authentication".

[0027] Login authentication methods include password authentication in which a user inputs a password from a keyboard, PIN authentication in which a user inputs a PIN (Personal Identification Number), face authentication in which a user is authenticated by his / her face, fingerprint authentication in which a user is authenticated by his / her fingerprint, etc. When login authentication using face authentication is enabled, the information processing device 1 performs face authentication by comparing feature information based on a face image of a face area detected from a captured image with feature information based on a face image of a preregistered authorized user.

[0028] Here, in the case where the information processing device 1 starts up the system from a standby state only by face detection that detects a face area from a captured image in the HPD processing, the information processing device 1 also starts up when a person other than a legitimate user approaches. Therefore, the information processing device 1 registers a user ID (hereinafter referred to as "HPD user ID") for authenticating whether or not the user is a legitimate user in the HPD processing based on the authentication result at the time of login authentication.

[0029] For example, when login authentication after system startup is successful, it is assumed that a legitimate user is present in front of the information processing device 1. Therefore, the information processing device 1 detects a face area from a captured image captured when login authentication is successful, regards the detected face image as a face image of the legitimate user, and registers feature information based on the face image as an HPD user ID. When the information processing device 1 detects a face area from a captured image in HPD processing, it performs face authentication using the registered HPD user ID. Then, the information processing device 1 performs control such that if authentication is successful (i.e., if a legitimate user is detected), it starts up the system, and if authentication is unsuccessful (i.e., if a person other than the legitimate user is detected), it does not start up the system and keeps it in a standby state.

[0030] However, when face authentication is performed during login authentication, high power consumption is permitted so that highly accurate face authentication is possible, but when HPD processing is performed in standby mode, it is desirable to keep power consumption as low as possible. For example, in the case of face authentication during login authentication, an image captured by an IR (Infrared Rays) camera is used, but in face authentication during HPD processing in standby mode, an image captured by an RGB camera is used. In addition, the frame rate at which images are captured during HPD processing in standby mode is set lower than the frame rate at which images are captured for use in face authentication during login authentication.

[0031] Due to the difference between the face authentication during login authentication and the face authentication in HPD processing, for example, face authentication during login authentication is possible even if the face is tilted about ±20° from the front, but face authentication in HPD processing can only recognize the same face when the face is tilted about ±15° from the front. Therefore, it is desirable to register feature information based on a face image of the front face as much as possible as an HPD user ID. Note that the face facing forward means that the face faces the direction of the imaging unit such as the IR camera or RGB camera, and the captured image shows the front face.

[0032] For example, the information processing device 1 registers, as an HPD user ID, feature information based on a face image taken with the face facing forward within a predetermined time (e.g., within 5 seconds) after successful login authentication. The reason for limiting the time to within the predetermined time (e.g., within 5 seconds) is to reduce the possibility of a user other than the authorized user being replaced.

[0033] In addition, if a face image is registered as the HPD user ID every time authentication is successful in system login authentication, a large number of similar face images of the same person (legitimate user) will be registered, raising concerns that the registration frame (memory capacity) will quickly fill up. From a safety perspective, it is desirable to keep the face image registration information within the face detection processor, so the system cannot determine whether a detected face image has already been registered.

[0034] Therefore, when the login authentication of the system is successful, the information processing device 1 judges whether to register an HPD user ID depending on a trigger when the system is started from a standby state. For example, when the information processing device 1 is started from a standby state in response to an input to a HID (Human Interface Device), the HPD process does not detect the approach of a legitimate user, so it can be assumed that the HPD user ID of the person who input to the HID (hereinafter simply referred to as "HID input") is not registered. Therefore, when the information processing device 1 starts the system due to an HID input, the information processing device 1 executes a user registration process for registering feature information based on a face image when the face is facing forward as an HPD user ID within a predetermined time (for example, within 5 seconds) after the login authentication is successful.

[0035] On the other hand, if the cause of starting the system is not HID input, the information processing device 1 considers that the system was started because, for example, the HPD process detected the approach of a legitimate user whose HPD user ID has already been registered, and therefore does not execute the user registration process to avoid registering an HPD user ID of the same person as an already registered HPD user ID. Note that in an unregistered state where no HPD user ID is registered, if login authentication to the system is successful, the information processing device 1 executes the user registration process and registers an HPD user ID regardless of the cause of starting the system.

[0036] This enables the information processing device 1 to prevent a large number of similar facial images of the same person (legitimate user) from being registered and filling up the registration space (memory capacity), thereby enabling proper registration of facial images of legitimate users to be used for facial authentication.

[0037] Fig. 3 is a diagram showing an overview of the HPD process using the HPD user ID according to this embodiment. With reference to Fig. 3, an overview of the HPD process according to this embodiment will be described in the order of (1) to (12). Hereinafter, a captured image of the front (front side) captured by an RGB camera when the information processing device 1 is in a standby state will be referred to as an "RGB image". On the other hand, a captured image of the front (front side) captured by an IR camera when the information processing device 1 performs login authentication after system startup will be referred to as an "IR image". (1) First, assume that the HPD user ID is not registered at this time. The information processing device 1 starts up the system by detecting a face area from an RGB image captured by an RGB camera in a standby state. The information processing device 1 also starts up the system when there is an HID input in the standby state.

[0038] (2) After startup, the information processing device 1 performs login authentication to allow only authorized users to use the system. For example, the information processing device 1 detects a face area from an IR image captured by an IR camera during a login authentication event of the system after startup, and performs face authentication processing based on the face image of the detected face area. Note that the authentication method for login authentication may be an authentication method other than face authentication.

[0039] (3) If the login authentication is successful, the information processing device 1 determines whether the HPD user ID is registered and the cause of starting the system (start-up cause).

[0040] (4) If the HPD user ID is not registered or if the activation factor is HID input, the information processing device 1 executes a user registration process to register the HPD user ID. In the user registration process, the information processing device 1 first detects a face area from an RGB image captured by an RGB camera within a predetermined time (e.g., within 5 seconds) after login authentication is successful.

[0041] (5) The information processing device 1 registers, within a predetermined time (e.g., within 5 seconds), feature information based on a facial image of the face facing forward based on a facial area detected from an RGB image captured by an RGB camera as an HPD user ID.

[0042] (6) Next, when the information processing device 1 detects a face area from the RGB image captured by the RGB camera in the standby state, the information processing device 1 performs face authentication to determine whether or not the user is a legitimate user using the HPD user ID registered in (5) above. For example, when the information processing device 1 detects a face area from the RGB image in the standby state, the information processing device 1 performs face authentication by comparing feature information based on the face image of the detected face area with the HPD user ID.

[0043] (7) If the face authentication in the above (6) fails, the information processing device 1 determines that the user is not a legitimate user, and continues the standby state without starting the system.

[0044] (8) On the other hand, if the face authentication in (6) above is successful, the information processing device 1 determines that the user is a legitimate user and starts up the system. Also, the information processing device 1 starts up the system when there is an HID input in the standby state.

[0045] (9) After startup, the information processing device 1 performs a login authentication process in the same manner as described in (2) above.

[0046] (10) If the login authentication is successful, the information processing device 1 determines whether the HPD user ID is registered and the cause that started the system (start-up cause) in the same manner as described in (3) above. Here, the information processing device 1 determines that the HPD user ID is registered. If the information processing device 1 determines that the start-up cause is not HID input, it determines that the system was started up due to the approach of a legitimate user whose HPD user ID is already registered, and does not execute user registration processing.

[0047] (11), (12) On the other hand, if the activation factor is HID input, the information processing device 1 determines that the HPD user ID of the person who performed the HID input is not registered, and executes the user registration process as in (4) and (5) above.

[0048] Thereafter, the above steps (6) to (12) are repeated. In this manner, the information processing device 1 registers, as an HPD user ID, feature information based on a facial image of the face facing forward within a predetermined time (e.g., within 5 seconds) after the login authentication is successful, and performs facial authentication using the HPD user ID in the HPD processing, so that the face of a legitimate user can be appropriately authenticated.

[0049] Next, the configuration of the information processing device 1 according to this embodiment will be described in detail. [External configuration of information processing device] FIG. 4 is a perspective view showing an example of the external configuration of the information processing device 1 according to the present embodiment. The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis defined by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0050] The first housing 10 is also called the A cover or the display housing. The second housing 20 is also called the C cover or the system housing. In the following description, the sides of the first housing 10 and the second housing 20 on which the hinge mechanism 15 is provided are called the sides 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite the sides 10c and 20c are called the sides 10a and 20a, respectively. In the drawings, the direction from the side 20a to the side 20c is called the "rear", and the direction from the side 20c to the side 20a is called the "front". The right and left sides of the rear are called the "right" and "left", respectively. The left sides of the first housing 10 and the second housing 20 are called the sides 10b and 20b, respectively, and the right sides are called the sides 10d and 20d, respectively. Moreover, a state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as a "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Moreover, a state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as an "open state."

[0051] The external appearance of the information processing device 1 shown in FIG. 4 shows an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0052] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is only an example, and the imaging unit 120 may be disposed in another position as long as it is possible to capture an image in the direction facing the inner surface of the first housing 10 (forward).

[0053] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in a direction (forward) facing the inner surface of the first housing 10. The predetermined imaging range is a range of an angle of view determined by an imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element, and corresponds to the person (face) detection range FoV shown in Fig. 2. For example, the imaging unit 120 can capture an image including a person (e.g., a user) present in front of (on the front side of) the information processing device 1.

[0054] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct turning the power on or off, transitioning from a standby state to a normal operation state, transitioning from a normal operation state to a standby state, and the like. A keyboard 151 and a touch pad 153 are provided on the inner surface of the second housing 20 as input devices for accepting user operation inputs. Note that, as the input devices, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided, or a mouse or an external keyboard may be connected. In the case of a configuration in which a touch sensor is provided, an area corresponding to the display surface of the display unit 110 may be configured as a touch panel for accepting operations. The input device may also include a microphone into which voice is input.

[0055] [Hardware configuration of information processing device] 5 is a schematic block diagram showing an example of a hardware configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400. The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0056] The imaging unit 120 captures an image of an object within a predetermined angle of view (for example, the detection range FoV shown in FIG. 2) in the direction facing the inner surface of the first housing 10 (forward), and outputs the captured image to the face detection unit 210 and the main processing unit 300. For example, the imaging unit 120 includes an RGB camera and an IR (Infrared Rays) camera. The RGB camera is a normal camera that captures images based on visible light. The IR camera is a camera that captures images based on infrared rays emitted from an object. For example, the IR camera irradiates an object with infrared rays and captures images based on the infrared rays reflected from the object when capturing an image.

[0057] An IR camera, for example, irradiates infrared rays when capturing an image, and therefore consumes more power when capturing an image than an RGB camera. Therefore, when detecting a face area from an RGB image and performing face authentication in a standby state, an RGB camera, for example, is used instead of an IR camera in order to minimize standby power consumption. On the other hand, when detecting a face area from an IR image and performing face authentication in login authentication using face authentication, an IR camera, for example, is used to improve authentication accuracy. Note that both an IR camera and an RGB camera may be used in login authentication using face authentication.

[0058] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0059] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0060] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), a random access memory (RAM), a read only memory (ROM), etc. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0061] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into a voltage required by each unit. The power whose voltage has been converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0062] The EC200 is a microcomputer including a CPU (Central Processing Unit), RAM, ROM, and an I / O (Input / Output) logic circuit. The CPU of the EC200 reads a control program (firmware) prestored in its own ROM, and executes the read control program to fulfill its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to a power button 140, an input device 150, a power supply unit 400, and the like.

[0063] For example, the EC 200 communicates with the power supply unit 400 to obtain information on the battery state (such as remaining capacity) from the power supply unit 400 and outputs control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1 to the power supply unit 400. The EC 200 also obtains operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to the processing of the main processing unit 300 among the obtained operation signals.

[0064] The face detection unit 210 includes a processor that processes image data of a captured image captured by the imaging unit 120. The face detection unit 210 acquires image data of a captured image captured by the imaging unit 120, and temporarily stores the acquired image data in a memory. The memory that stores the image data may be the system memory 304, or may be a memory (not shown) in the face detection unit 210.

[0065] For example, the face detection unit 210 performs face detection processing to detect a face area from the captured image and face authentication processing to authenticate a face image in the detected face area by processing image data of the captured image acquired from the imaging unit 120. The face detection unit 210 transmits the detection result of the face detection processing, the authentication result of the face authentication processing, and the like to the chipset 303 of the main processing unit 300.

[0066] The face detection unit 210 operates not only in a normal operating state but also in a standby state. In the standby state, the face detection unit 210 obtains image data of an RGB image captured by, for example, the RGB camera of the imaging unit 120, and detects a face area. By capturing an image using the RGB camera instead of using an IR camera, it is possible to reduce power consumption in the standby state (standby power). On the other hand, in the login authentication process after startup, the face detection unit 210 obtains image data of an IR image captured by the IR camera of the imaging unit 120 (or an image captured by both the RGB camera and the IR camera), and performs face area detection and face authentication, thereby improving the accuracy of face authentication.

[0067] For example, the face detection unit 210 performs face authentication using the HPD user ID registered when authentication by the login authentication process is successful in the HPD process described with reference to Fig. 3. The functional configuration of this HPD process will be described in detail later.

[0068] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0069] The CPU 301 executes processes by the BIOS, processes by the OS, processes by application programs running on the OS, etc. The CPU 301 controls the operating state of the system based on instructions from the chipset 303, etc. For example, the CPU 301 executes a startup process to start the system from a standby state. After starting from the standby state, the CPU 301 also executes a login authentication process to authenticate whether or not the user is a legitimate user, and transitions to a normal operating state if the authentication is successful.

[0070] For example, the CPU 301 executes authentication processing by face authentication in login authentication. Note that the CPU 301 may execute authentication processing other than face authentication (for example, password authentication, PIN authentication, fingerprint authentication, etc.) in login authentication.

[0071] When CPU 301 determines that the user is a legitimate user (authentication successful) in the login authentication, it permits use (permits login) and transitions to a normal operation state. On the other hand, when CPU 301 determines that the user is not a legitimate user (authentication failed) in the login authentication, it does not permit use (permits login) and continues the state waiting for login authentication.

[0072] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing and generates display data under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110.

[0073] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. The chipset 303 also has a function as a sensor hub. For example, in the HPD process, the chipset 303 obtains a face detection result from the face detection unit 210, detects the presence of a person (user) based on the detection result, and controls the operating state of the system.

[0074] The system memory 304 is used as a reading area for the programs executed by the CPU 301, a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0075] The CPU 301, GPU 302, and chipset 303 may be configured as a single integrated processor, or some or each may be configured as individual processors. For example, in a normal operation state, the CPU 301, GPU 302, and chipset 303 are all in operation, but in a standby state, at least a part of the chipset 303 is in operation. In the standby state, at least the functions necessary for the HPD processing at the time of startup are in operation.

[0076] [Functional configuration of information processing device] Next, a functional configuration in which the information processing device 1 controls the operating state of the system through HPD processing will be described.

[0077] FIG. 6 is a block diagram showing an example of a functional configuration of the information processing device 1 according to the present embodiment. The information processing device 1 includes a face detection unit 210 and a main processing unit 300. The main processing unit 300 includes a system processing unit 310 and an HPD control processing unit 330. The face detection unit 210 corresponds to the face detection unit 210 shown in FIG. 5, and is a functional configuration realized by executing a program in the face detection unit 210. The system processing unit 310 and the HPD control processing unit 330 are functional configurations realized by the main processing unit 300 executing an OS and a program running on the OS. For example, the system processing unit 310 is a functional configuration realized by the CPU 301 executing a program of the OS. Also, the HPD control processing unit 330 is a functional configuration realized by the CPU 301 or the chipset 303 executing a program running on the OS.

[0078] The face detection unit 210 includes a face detection processing unit 211, a face authentication processing unit 212, an HPD user ID registration unit 213, and an HPD processing unit 214. The system processing unit 310 includes an operation control unit 311 and an authentication processing unit 312. The HPD control processing unit 330 includes an operation instruction unit 331, an HID input detection unit 332, and a user registration control unit 333.

[0079] The face detection processing unit 211 reads out image data of captured images captured by the imaging unit 120 from the system memory 304 at a predetermined frame rate (predetermined frequency), and detects a face area from each captured image. Any detection method can be applied as a face detection method, such as a face detection algorithm that detects a face based on facial feature information, or face detection using learning data (trained model) machine-learned based on facial feature information or a face detection library. The frame rate at which the imaging unit 120 captures an image is controlled to, for example, 4 FPS (Frames Per Second) when performing HPD processing in a standby state, 15 FPS when performing login authentication using face authentication, 15 FPS within a predetermined time (for example, within 5 seconds) after login authentication is successful, and 1 FPS when performing HPD processing in a normal operating state.

[0080] For example, in a standby state, the face detection processing unit 211 detects a face area from an RGB image captured at 4 FPS using the RGB camera of the imaging unit 120, and outputs coordinate information of the face area, etc., as a detection result. Also, for example, during login authentication, the face detection processing unit 211 detects a face area from an IR image captured at 15 FPS using the IR camera of the imaging unit 120, and outputs coordinate information of the face area, etc., as a detection result. Note that, during login authentication, the face detection processing unit 211 may detect a face area from an IR image captured using the IR camera and RGB camera of the imaging unit 120.

[0081] Furthermore, for example, within a predetermined time (for example, within 5 seconds) after login authentication is successful, the face detection processing unit 211 detects a face area from an RGB image captured at 15 FPS using the RGB camera of the imaging unit 120, and outputs the coordinate information of the face area and information on the face direction as the detection result. The information on the face direction is the face angle of the face image in the detected face area. For example, the face angle is an angle corresponding to the face direction with the direction of the imaging unit 120 (the direction in which the face faces forward) as the reference angle (for example, 0°).

[0082] Also, for example, in a normal operating state, the face detection processing unit 211 detects a face area from an RGB image captured at 1 FPS using the RGB camera of the imaging unit 120, and outputs coordinate information of the face area as the detection result.

[0083] The face authentication processing unit 212 executes face authentication processing to determine whether or not a face image in the detected face area is a face image of a legitimate user. For example, during login authentication of the system, the face authentication processing unit 212 performs face authentication by comparing a face image detected from an IR image captured at 15 FPS using the IR camera of the imaging unit 120 with a face image of a legitimate user registered in advance as user information (account information) for logging in to the system. Specifically, for example, during login authentication, the face authentication processing unit 212 performs face authentication by comparing feature information based on the face image detected from the IR image with feature information based on the face image of a legitimate user registered in advance.

[0084] The facial image of a legitimate user registered as user information (account information) is, for example, a facial image detected from IR images captured at 15 FPS using the IR camera of the imaging unit 120 in the facial recognition image registration menu of the system settings.

[0085] During HPD processing, the face authentication processing unit 212 performs face authentication based on feature information based on a face image detected from an RGB image captured using the RGB camera of the imaging unit 120 and feature information based on a face image of a legitimate user registered as an HPD user ID. For example, the face authentication processing unit 212 performs face authentication by comparing feature information based on a face image detected from an RGB image captured at 4 FPS using the RGB camera of the imaging unit 120 during HPD processing with feature information based on a face image of a legitimate user registered as an HPD user ID.

[0086] The HPD user ID registration unit 213 registers, within a predetermined time (for example, within 5 seconds) after authentication by the login authentication process is successful, feature information based on a face image when the face is facing forward among face images detected from an RGB image by the face detection processing unit 211, as an HPD user ID (feature information based on a face image of a legitimate user). For example, the HPD user ID registration unit 213 stores and registers the HPD user ID in the system memory 304 or a memory (not shown) in the face detection unit 210.

[0087] For example, the HPD user ID registration unit 213 determines that the face is facing forward if the face angle of the face image detected from the RGB image by the face detection processing unit 211 is within a predetermined angle range (e.g., ±15°) based on the direction of the imaging unit 120 (the direction in which the face is facing forward) within a predetermined time (e.g., within 5 seconds) after successful authentication by the login authentication process.

[0088] The HPD processing unit 214 outputs information indicating the detection result of the HPD processing, based on the detection result of the face detection processing by the face detection processing unit 211 and the authentication result of the face authentication processing by the face authentication processing unit 212. For example, if an HPD user ID has been registered, and if a face area is detected from an RGB image by the face detection processing unit 211 and face authentication by the face authentication processing unit 212 is successful, the HPD processing unit 214 outputs presence information indicating that a legitimate user is present in front of the information processing device 1.

[0089] When the HPD user ID is not registered, the HPD processing unit 214 outputs presence information based on the detection of a face area from an RGB image by the face detection processing unit 211 in standby state, determining that a user is present in front of the information processing device 1, although it cannot determine whether the user is a legitimate user.

[0090] On the other hand, when the face detection processing unit 211 no longer detects a face area in the RGB image after the system is started, the HPD processing unit 214 outputs absence information indicating that a user is not present in front of the information processing device 1. Furthermore, when the face authentication processing unit 212 fails to perform face authentication even if the face detection processing unit 211 detects a face area in the RGB image after the system is started, the HPD processing unit 214 outputs absence information because the user present in front of the information processing device 1 is not a legitimate user.

[0091] In the standby state, when operation instruction unit 331 acquires presence information output from HPD processing unit 214, it issues an instruction to start the system from the standby state. For example, operation instruction unit 331 outputs start-up instruction information indicating an instruction to start the system from the standby state to operation control unit 311. Furthermore, in the standby state, while operation instruction unit 331 acquires absence information from HPD processing unit 214, it does not issue an instruction to start the system.

[0092] In addition, in the normal operation state, the operation instruction unit 331 issues an instruction to transition the system to a standby state when it acquires absence information from the HPD processing unit 214. For example, the operation instruction unit 331 outputs, to the operation control unit 311, standby instruction information indicating an instruction to transition the system to the standby state.

[0093] When the operation control unit 311 acquires the start-up instruction information output from the operation instruction unit 331, it executes a system program and starts the system from a standby state. After starting the system from the standby state, the operation control unit 311 generates a login authentication event. Then, the operation control unit 311 waits without permitting login until authentication is successful. If authentication is successful, the operation control unit 311 permits login and transitions to a normal operation state.

[0094] In addition, in the normal operation state, when the operation control section 311 receives standby instruction information output from the operation instruction section 331, it transitions the system from the normal operation state to the standby state.

[0095] When a login authentication event occurs, the authentication processing unit 312 executes login authentication processing to authenticate whether or not the user is a legitimate user. For example, the authentication processing unit 312 executes login authentication processing by any one of face authentication, password authentication, PIN authentication, and fingerprint authentication. For example, when executing authentication processing by face authentication, the authentication processing unit 312 acquires the authentication result of face authentication from the face detection unit 210, and executes login authentication processing based on the acquired authentication result. If authentication is successful, the authentication processing unit 312 determines that the user is a legitimate user, and if authentication is unsuccessful, determines that the user is not a legitimate user.

[0096] In the case of password authentication or PIN authentication, the authentication processing unit 312 acquires an operation signal based on a user's operation on the keyboard 151 via the EC 200. Then, based on the acquired operation signal, the authentication processing unit 312 executes the authentication process by comparing the password or PIN entered by the user's operation with a password or PIN registered in advance. In the case of fingerprint authentication, the authentication processing unit 312 executes the authentication process by comparing a fingerprint acquired using a fingerprint sensor (not shown) with a fingerprint registered in advance.

[0097] The HID input detection unit 332 detects an HID input. For example, the HID input detection unit 332 detects the HID input by acquiring an input signal (operation signal) corresponding to an input (operation, etc.) by a user to the input device 150 or the like via the EC 200.

[0098] When the system is started, the user registration control unit 333 controls whether or not to have the face detection unit 210 execute user registration processing for registering an HPD user ID after the system is started, depending on whether or not the start-up factor is HID input. For example, when the system is started up due to an HID input, the user registration control unit 333 causes the face detection unit 210 to execute the user registration processing. On the other hand, when the start-up factor is not HID input, the user registration control unit 333 does not cause the face detection unit 210 to execute the user registration processing.

[0099] For example, if the difference between the timing when the HID input is detected and the timing when the display of the display unit 110 is turned on in response to system startup is within a predetermined time (e.g., within 0.5 seconds), the user registration control unit 333 determines that the system startup was caused by the HID input.

[0100] That is, the user registration control unit 333 judges whether the difference between the timing when the HID input is detected and the timing when the display of the display unit 110 is turned on in response to the start of the system is within a predetermined time. If the judgment result is true, the user registration control unit 333 causes the face detection unit 210 to execute the user registration process after the start of the system, and if the judgment result is false, the face detection unit 210 does not execute the user registration process.

[0101] In this embodiment, when the system startup factor is not HID input, it is assumed that the startup factor is the success of face authentication in HPD processing when the HPD user ID is registered. In other words, when the system is started, the user registration control unit 333 can control whether or not to execute user registration processing after the system is started, depending on whether or not the startup factor is the detection of a face area by face detection processing and the success of face authentication by face authentication processing.

[0102] For example, the user registration control unit 333 may control the face detection unit 210 to execute the user registration process when the system is started up due to a factor other than successful face authentication by the face authentication process, and may not control the face detection unit 210 to execute the user registration process when the system is started up based on the successful authentication result of the face authentication process.

[0103] When the HPD user ID is not registered and the user is in an unregistered state, the user registration control unit 333 causes the face detection unit 210 to execute the user registration process regardless of the system startup trigger.

[0104] After the system is started, if the authentication processing unit 312 performs login authentication successfully, the user registration control unit 333 determines whether or not to cause the face detection unit 210 to execute the above-mentioned user registration process, and notifies the face detection unit 210 if it determines that the user registration process should be executed by the face detection unit 210.

[0105] For example, when it is determined that user registration processing is to be performed, the user registration control unit 333 notifies the face detection unit 210 of a user registration instruction for instructing execution of the user registration processing at the timing when the login authentication is successful. The HPD user ID registration unit 213 of the face detection unit 210 is triggered by the notification of the user registration instruction to register, as an HPD user ID, feature information based on a detected face image (for example, a face image when the face is facing forward) within a predetermined time (for example, within 5 seconds) after authentication by the login authentication processing is successful.

[0106] [HPD processing operation] Next, the operation of the process of authenticating a legitimate user in the HPD process and controlling the operating state of the system will be described. First, the operation of the HPD process in the standby state will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the HPD process in the standby state according to this embodiment.

[0107] (Step S101) The face detection unit 210 acquires an RGB image captured by the imaging unit 120 in a standby state. In the standby state, the RGB image is captured by the imaging unit 120 at a frame rate of, for example, 4 FPS. Then, the process proceeds to step S103.

[0108] (Step S103) The face detection unit 210 detects a face area (area of ​​a face image) from the RGB image acquired in step S101. If the face detection unit 210 does not detect a face area (NO), the process proceeds to step S111. On the other hand, if the face detection unit 210 detects a face area (YES), the process proceeds to step S105.

[0109] (Step S105) The face detection unit 210 determines whether or not the HPD user ID has been registered. If the face detection unit 210 determines that the HPD user ID has not been registered (NO), the process proceeds to step S111. On the other hand, if the face detection unit 210 determines that the HPD user ID has been registered (YES), the process proceeds to step S107.

[0110] (Step S107) The face detection unit 210 performs face authentication based on feature information based on the face image detected in step S103 and feature information based on the face image of the authorized user registered as the HPD user ID. Then, the process proceeds to step S109.

[0111] (Step S109) The face detection unit 210 determines whether or not the face authentication was successful in step S107. If the face detection unit 210 determines that the face authentication was successful (YES), it outputs the presence information and proceeds to processing in step S113. On the other hand, if the face detection unit 210 determines that the face authentication was unsuccessful (NO), it proceeds to processing in step S111.

[0112] (Step S111) The HPD control processing unit 330 determines whether or not an HID input has been detected. If the HPD control processing unit 330 has not detected an HID input (NO), the process returns to step S101. On the other hand, if the HPD control processing unit 330 determines that an HID input has been detected (YES), the process proceeds to step S113.

[0113] (Step S113) Upon acquiring the presence information output from face detection unit 210, HPD control processing unit 330 outputs start-up instruction information indicating an instruction to start the system from a standby state to system processing unit 310 as a start-up instruction by HPD processing. Furthermore, HPD control processing unit 330 also outputs start-up instruction information to system processing unit 310 when it detects an HID input. Upon acquiring the start-up instruction information output from HPD control processing unit 330, system processing unit 310 executes a system program to start the system from a standby state. Then, the process proceeds to step S115.

[0114] (Step S115) After starting up from a standby state, the system processing unit 310 generates a login authentication event and executes authentication processing to authenticate whether or not the user is a valid user. For example, the system processing unit 310 executes authentication processing by any one of face authentication, password authentication, PIN authentication, and fingerprint authentication.

[0115] Here, as an example of the login authentication process in step S115, the operation of the login authentication process using face authentication will be described with reference to FIG. FIG. 8 is a flowchart showing an example of login authentication processing by face authentication according to this embodiment.

[0116] (Step S151) When the system processing unit 310 generates a login authentication event, the face detection unit 210 executes face detection processing and face authentication processing in the login authentication. First, the face detection unit 210 acquires an IR image (IR image, or IR image and RGB image) captured by the imaging unit 120. In the login authentication processing, the IR image (IR image, or IR image and RGB image) is captured by the imaging unit 120 at a frame rate of, for example, 15 FPS. Then, the process proceeds to step S153.

[0117] (Step S153) The face detection unit 210 detects a face area from the IR image (IR image, or IR image and RGB image) acquired in step S151. If the face detection unit 210 does not detect a face area (NO), the process returns to step S151. On the other hand, if the face detection unit 210 detects a face area (YES), the process proceeds to step S155.

[0118] (Step S155) Face detection unit 210 performs face recognition processing based on the face image of the face region detected in step S153. For example, face detection unit 210 performs face recognition processing based on feature information of the face image of the detected face region and feature information of the face image of a regular user registered in advance as user information (account information) for logging in to the system, and outputs the recognition result to system processing unit 310.

[0119] (Step S157) The system processing unit 310 determines whether or not the login authentication is successful based on the authentication result of the face authentication processing output from the face detection unit 210. For example, if the authentication result of the face authentication processing is failure (face authentication is unsuccessful), the system processing unit 310 determines that the login authentication is unsuccessful (NO), does not permit the login, and returns to step S151. On the other hand, if the authentication result of the face authentication processing is success (face authentication is successful), the system processing unit 310 determines that the login authentication is successful (YES), permits the login, and ends the login authentication processing. Then, the system processing unit 310 proceeds to the processing of steps S117 and S119 in FIG. 7.

[0120] Although an example of login authentication processing using face authentication has been described here, in the case of login authentication processing using password authentication, PIN authentication, fingerprint authentication, or the like, if the login authentication is successful, the login is permitted, the login authentication processing is terminated, and the process proceeds to steps S117 and S119 in Fig. 7. Furthermore, if the login authentication is successful, the system processing unit 310 notifies the HPD control processing unit 330 of that effect.

[0121] The processes in steps S117 and S119 are performed in parallel, with no particular order.

[0122] (Step S117) If the login authentication by the system processing unit 310 is successful in step S115 (step S157), the HPD control processing unit 330 executes a user registration control process for controlling registration of an HPD user ID.

[0123] (Step S119) The system processing unit 310 executes login processing with the account of the authorized user whose login authentication has been successful, and transitions to a normal operation state. In the normal operation state, the face detection unit 210 executes face detection processing (HPD processing) that detects a face area from an RGB image captured by the imaging unit 120 at a frame rate of, for example, 1 FPS.

[0124] Here, a specific operation of the user registration control process in step S115 will be described with reference to FIGS. FIG. 9 is a flowchart showing an example of a user registration control process according to the present embodiment.

[0125] (Step S201) The HPD control processing unit 330 judges whether or not the HPD user ID has been registered in the face detection unit 210. If the HPD control processing unit 330 judges that the HPD user ID has been registered (YES), the process proceeds to step S203. On the other hand, if the HPD control processing unit 330 judges that the HPD user ID has not been registered (NO), the process proceeds to step S205.

[0126] (Step S203) The HPD control processing unit 330 determines whether or not the startup cause when the system was started in step S107 in Fig. 7 was an HID input. For example, the HPD control processing unit 330 determines whether or not the difference between the timing when the HID input was detected and the timing when the display of the display unit 110 was turned on in response to system startup is within a predetermined time. If the determination result in step S203 is false (NO), the HPD control processing unit 330 does not execute the user registration process and ends the user registration control process. On the other hand, if the determination result in step S203 is true (YES), the HPD control processing unit 330 proceeds to the process of step S205.

[0127] (Step S205) The HPD control processing unit 330 notifies the face detection unit 210 of a user registration instruction for instructing execution of a user registration process. Then, the process proceeds to step S207.

[0128] (Step S207) Upon receiving a user registration instruction from the HPD control processing unit 330, the face detection unit 210 executes a user registration process for registering an HPD user ID.

[0129] Next, the user registration process in step S207 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the user registration process according to this embodiment. In a normal operation state, the face detection unit 210 detects a face area from an RGB image captured by the imaging unit 120 at a frame rate of, for example, 1 FPS, and executes HPD processing, but when executing the user registration process, the frame rate is increased.

[0130] (Step S211) The face detection unit 210 increases the frame rate to, for example, 15 FPS, and proceeds to the process of step S213.

[0131] (Step S213) The face detection unit 210 acquires an RGB image captured by the imaging unit 120 at a frame rate of, for example, 15 FPS, and proceeds to the process of step S103.

[0132] (Step S215) The face detection unit 210 detects a face area (area of ​​a face image) from the RGB image acquired in step S213. If the face detection unit 210 does not detect a face area (NO), the process proceeds to step S223. On the other hand, if the face detection unit 210 detects a face area (YES), the process proceeds to step S217.

[0133] (Step S217) The face detection unit 210 detects the face direction (face angle) of the face image in the face area detected in step S215, and then proceeds to the process of step S219.

[0134] (Step S219) Face detection unit 210 determines whether the face detected in step S217 faces forward. For example, if the face angle detected in step S217 is within a predetermined angle range (for example, within ±5°) with respect to the direction of imaging unit 120 (forward, face angle=0°), face detection unit 210 determines that the face faces forward. If face detection unit 210 determines that the face does not face forward (NO), it proceeds to processing of step S223. On the other hand, if face detection unit 210 determines that the face faces forward (YES), it proceeds to processing of step S221A.

[0135] (Step S221A) The face detection unit 210 registers the feature information based on the face image in which the face direction is determined to be the front as an HPD user ID (feature information based on the face image of a legitimate user). Then, the process proceeds to step S225.

[0136] (Step S223) The face detection unit 210 determines whether or not a predetermined time (e.g., 5 seconds) has elapsed since the login authentication was successful. If the face detection unit 210 determines that the predetermined time (e.g., 5 seconds) has not elapsed (NO), the process returns to step S213. On the other hand, if the face detection unit 210 determines that the predetermined time (e.g., 5 seconds) has elapsed (YES), the process proceeds to step S225.

[0137] (Step S225) The face detection unit 210 lowers the frame rate to, for example, 1 FPS, and ends the user registration process.

[0138] [Summary of the embodiment] As described above, the information processing device 1 according to the present embodiment includes a system memory 304 (an example of a memory) that temporarily stores a system program, a face detection unit 210 (an example of a first processor), and a main processing unit 300 (an example of a second processor). The face detection unit 210 executes a face detection process for detecting a region (face region) of a face image in which a face is captured from an image (for example, an RGB image) captured by the imaging unit 120, and a face authentication process for performing face authentication based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on a face image of a legitimate user). The main processing unit 300 starts the system from a standby state by executing the program of the system based on the detection of a face region by the face detection process and success of face authentication by the face authentication process. In addition, when the main processing unit 300 starts the system, it controls whether or not to cause the face detection unit 210 to execute a user registration process for registering feature information based on a face image detected by the face detection process as an HPD user ID after the system is started, depending on whether or not the cause of the start is an HID input (input to an HID).

[0139] As a result, in a configuration in which the system can be started by face authentication of a legitimate user, the information processing device 1 controls whether to register an HPD user ID for face authentication of a legitimate user based on a face image detected after system startup depending on whether the system startup factor is HID input, thereby preventing unnecessary registration of an HPD user ID after system startup. Therefore, the information processing device 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of a legitimate user to be used for face authentication.

[0140] For example, if the main processing unit 300 starts up the system due to an HID input, it causes the face detection unit 210 to execute the user registration process, but if the startup cause is not an HID input, it does not cause the face detection unit 210 to execute the user registration process.

[0141] As a result, when the system startup factor is HID input, the information processing device 1 can assume that the HPD user ID of the person who performed the HID input is not registered, and therefore registers the HPD user ID, and when the system startup factor is not HID input, it can assume that the system was started due to the approach of a legitimate user whose HPD user ID is already registered, and therefore does not register the HPD user ID. Thus, the information processing device 1 can prevent duplicate registration of HPD user IDs of the same person (legitimate user), and can properly register the facial image of the legitimate user to be used for facial authentication.

[0142] As an example, if the difference between the timing when the HID input is detected and the timing when the display unit 110 is turned on in response to system startup is within a predetermined time (e.g., within 0.5 seconds), the main processing unit 300 determines that the cause of system startup is the HID input.

[0143] This allows the information processing device 1 to appropriately determine whether or not the system startup trigger is an HID input.

[0144] In other words, when the system is started up, the main processing unit 300 determines whether the difference between the timing when the HID input is detected and the timing when the display unit 110 is turned on in response to system startup is within a predetermined time (for example, within 0.5 seconds), and if the determination result is true, it causes the face detection unit 210 to execute user registration processing after the system is started up, and if the determination result is false, it does not cause the face detection unit 210 to execute user registration processing.

[0145] This allows the information processing device 1 to appropriately determine whether the system startup factor is HID input or not, and only when the startup factor is HID input, it can appropriately register the HPD user ID of the authorized user based on the face image detected after the system startup, thereby preventing unnecessary registration of the HPD user ID after the system startup. Therefore, the information processing device 1 can prevent a large number of face images of similar faces of the same person (authorized user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of the authorized user to be used for face authentication.

[0146] In addition, when the main processing unit 300 starts up the system, it controls whether or not to execute a user registration process after the system is started up, depending on whether or not the cause of the startup is that a face image area has been detected by face detection processing and face authentication by face authentication processing has been successful.

[0147] As a result, the information processing device 1 controls whether to register an HPD user ID for face authentication of a legitimate user based on a face image detected after startup depending on whether the system was started due to the approach of a legitimate user whose HPD user ID has already been registered, and therefore can prevent unnecessary registration of an HPD user ID after system startup. Therefore, the information processing device 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of the legitimate user to be used for face authentication.

[0148] For example, if the system is started due to a factor other than the success of face authentication by the above-mentioned face authentication process, the main processing unit 300 causes the face detection unit 210 to execute the user registration process, and if the system is started based on the successful authentication result of the face authentication process, the main processing unit 300 does not cause the face detection unit 210 to execute the user registration process.

[0149] This allows the information processing device 1 to prevent duplicate registration of HPD user IDs of the same person (authorized user) since the information processing device 1 does not register the HPD user ID when the system is started due to the approach of a legitimate user whose HPD user ID has already been registered, but registers the HPD user ID when the system is started due to another startup factor. Therefore, the information processing device 1 can appropriately register the face image of the legitimate user to be used for face authentication.

[0150] After the system is started, the main processing unit 300 executes a login authentication process (an example of a system authentication process) for authenticating whether or not the user is a legitimate user through system processing. Then, as the above-mentioned user registration process, the face detection unit 210 registers, within a predetermined time (for example, within 5 seconds) after the authentication through the login authentication process is successful, characteristic information (an example of information) based on a face image detected through the face detection process as an HPD user ID (an example of information based on a face image of a legitimate user).

[0151] As a result, the information processing device 1 uses the face image detected when the login authentication is successful as the face image of the authorized user for face authentication, and can therefore properly authenticate the face of the authorized user.

[0152] For example, as part of the above-mentioned user registration process, the face detection unit 210 registers, as an HPD user ID, feature information based on a face image detected by the face detection process within a predetermined time (e.g., within 5 seconds) after successful authentication by the login authentication process, when the face is facing forward (an example of a specific orientation).

[0153] As a result, when the information processing device 1 uses the face image detected when login authentication is successful as the face image of the legitimate user for face authentication, the face image takes into consideration the direction of the face for face authentication, so that the face of the legitimate user can be properly authenticated.

[0154] Furthermore, if the HPD user ID has not been registered, the main processing section 300 causes the face detection section 210 to execute the above-mentioned user registration process, regardless of the cause of starting up the system.

[0155] As a result, when the HPD user ID is not registered, the information processing device 1 can register a face image of a legitimate user to be used for face authentication in response to starting up the system.

[0156] Furthermore, the control method in the information processing device 1 according to this embodiment includes the steps of: performing face detection processing by the face detection unit 210 (an example of a first processor) to detect an area (face area) of a face image in which a face is captured from an image (e.g., an RGB image) captured by the imaging unit 120; performing face authentication processing by the face detection unit 210 to perform face authentication based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on a face image of a legitimate user); and, when the system is started, the main processing unit 300 controls whether or not to cause the face detection unit 210 to execute a user registration process for registering feature information based on the face image detected by the face detection processing as an HPD user ID after the system is started, depending on whether or not the cause of the start-up is an HID input (input to an HID).

[0157] Thus, in a configuration in which the system can be started by face authentication of a legitimate user, the control method in the information processing device 1 controls whether to register an HPD user ID for face authentication of a legitimate user based on a face image detected after the system is started depending on whether the system startup factor is HID input, and therefore can prevent unnecessary registration of an HPD user ID after the system is started. Therefore, the information processing device 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of the legitimate user to be used for face authentication.

[0158] Moreover, the control method in the information processing device 1 according to this embodiment includes a step in which the face detection unit 210 (an example of a first processor) performs face detection processing to detect a region (face region) of a face image in which a face is captured from a captured image (e.g., an RGB image) captured by the imaging unit 120, a step in which the face detection unit 210 performs face authentication processing based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on a face image of a legitimate user), and a step in which the main processing unit 300 (an example of a second processor) executes a system program based on the fact that the face region has been detected by the face detection processing and that face authentication by the face authentication processing has been successful. the step of starting the system from a standby state by detecting the HID input and judging, when the system is started, whether or not the difference between the timing at which the HID input is detected and the timing at which the display of the display unit 110 is turned on in response to the start-up of the system is within a predetermined time period (e.g., within 0.5 seconds); and the step of the main processing unit 300 causing the face detection unit 210 to execute user registration processing for registering feature information based on a face image detected by face detection processing after the start-up of the system as an HPD user ID if the judgment result is true, and the main processing unit 300 does not cause the face detection unit 210 to execute the user registration processing if the judgment result is false.

[0159] As a result, the control method in the information processing device 1 appropriately determines whether the system startup factor is HID input, and can appropriately register the HPD user ID of a legitimate user based on a face image detected after system startup only if the startup factor is HID input, thereby preventing unnecessary registration of an HPD user ID after system startup. Therefore, the information processing device 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of a legitimate user to be used for face authentication.

[0160] Furthermore, the control method in the information processing device 1 according to this embodiment includes the steps of: performing face detection processing by the face detection unit 210 (an example of a first processor) to detect a region (face region) of a face image in which a face is captured from an image (e.g., an RGB image) captured by the imaging unit 120; performing face authentication processing by the face detection unit 210 to perform face authentication based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on a face image of a legitimate user); starting up the system from a standby state by the main processing unit 300 (an example of a second processor) by executing a system program; and controlling, when the main processing unit 300 has started up the system, whether or not to cause the face detection unit 210 to execute a user registration process to register feature information based on the face image detected by the face detection processing as an HPD user ID after the system has been started up, depending on whether or not the cause of the start-up is that a region of a face image has been detected by the face detection processing and face authentication by the face authentication processing has been successful.

[0161] Thus, the control method in the information processing device 1 controls whether to register an HPD user ID for face authentication of a legitimate user based on a face image detected after startup depending on whether the system was started due to the approach of a legitimate user whose HPD user ID has already been registered, and therefore can prevent unnecessary registration of an HPD user ID after the system is started. Therefore, the information processing device 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of the legitimate user to be used for face authentication.

[0162] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiment can be combined in any combination.

[0163] The imaging unit 120 may include either an IR camera or an RGB camera. For example, an IR camera may be used in both the HPD process and the login authentication process, or an RGB camera may be used in both the HPD process and the login authentication process.

[0164] Moreover, the frame rates of the imaging unit 120 in each operation state and process are merely examples, and are not limited to the above-mentioned frame rate examples.

[0165] In the above embodiment, the configuration example in which the imaging unit 120 is built into the information processing device 1 has been described, but the present invention is not limited to this. For example, the imaging unit 120 does not have to be built into the information processing device 1, and may be configured to be attachable to the information processing device 1 (for example, any one of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or via a wire.

[0166] Furthermore, the CPU 301 (an example of a third processor) and the chipset 303 (an example of a second processor) may be configured as separate processors, or may be integrated into a single processor.

[0167] In the above embodiment, an example has been shown in which the face detection unit 210 (an example of a first processor) is provided separately from the chipset 303, but a part or all of the face detection unit 210 may be provided in the chipset 303, or in a processor integrated with the chipset 303. The face detection unit 210, the chipset 303, and the CPU 301 may be integrated into one processor. The face detection unit 210 may be provided in part or all of the EC 200.

[0168] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, power-off state, etc. are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0169] The information processing device 1 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0170] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0171] In addition, some or all of the functions of the information processing device 1 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]

[0172] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Face detection unit, 211 Face detection processing unit, 212 Face authentication processing unit, 213 HPD user ID registration unit, 214 HPD processing unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Operation control unit, 312 Authentication processing unit, 330 HPD control processing unit, 331 Operation instruction unit, 332 HID input detection unit, 333 User registration control unit, 400 Power supply unit

Claims

1. A memory for temporarily storing system programs; a first processor that executes a face detection process for detecting a region of a face image in which a face is captured from an image captured by an imaging unit, and a face authentication process for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user; a second processor that starts up the system from a standby state by executing a program of the system based on the fact that the area of ​​the face image is detected by the face detection processing and the face authentication by the face authentication processing is successful; Equipped with The second processor when the system is started, whether or not to cause the first processor to execute a user registration process for registering information based on a face image detected by the face detection process after the system is started as information based on a face image of the authorized user is controlled depending on whether or not the cause of the start-up is an input to a HID (Human Interface Device); When the difference between the timing at which the input to the HID is detected and the timing at which the display of the display unit is turned on in response to the startup of the system is within a predetermined time, it is determined that the cause of the startup of the system is the input to the HID. Information processing device.

2. The second processor When the system is started due to an input to the HID, the first processor is caused to execute the user registration process, and when the system is started due to no input to the HID, the first processor is not caused to execute the user registration process. The information processing device according to claim 1 .

3. A memory for temporarily storing system programs; a first processor that executes a face detection process for detecting a region of a face image in which a face is captured from an image captured by an imaging unit, and a face authentication process for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user; a second processor for activating the system from a standby state by executing a program of the system; Equipped with The second processor when the system is started, depending on whether the cause of the start-up is that the area of ​​the face image is detected by the face detection processing and face authentication by the face authentication processing is successful, control whether to cause the first processor to execute a user registration process for registering information based on the face image detected by the face detection processing after the start-up of the system as information based on the face image of the authorized user; After the system is started, a system authentication process is executed to authenticate whether the user is a regular user or not by the processing of the system; The first processor, as the user registration process, within a predetermined time after the authentication by the system authentication process is successful, information based on a face image detected by the face detection process is registered as information based on a face image of the authorized user. Information processing device.

4. The second processor When the system is started due to a factor other than the success of face authentication by the face authentication process, the first processor is caused to execute the user registration process, and when the system is started based on the success of the authentication result of the face authentication process, the first processor is not caused to execute the user registration process. The information processing device according to claim 3 .

5. The first processor, As the user registration process, within a predetermined time after the authentication by the system authentication process is successful, information based on a face image detected by the face detection process when the face is oriented in a specific direction is registered as information based on the face image of the authorized user. The information processing device according to claim 3 .

6. The second processor When the information based on the face image of the authorized user has not been registered, the first processor executes the user registration process regardless of the cause of starting the system.

4. The information processing device according to claim 1.

7. A control method for an information processing device including a memory for temporarily storing a system program, a first processor, and a second processor, comprising: a step of performing face detection processing by the first processor to detect a face image area in which a face is captured from a captured image captured by an imaging unit; A step in which the first processor performs a face recognition process for performing face recognition based on information based on the detected face image and information based on a face image of a legitimate user; a step in which the second processor starts up the system from a standby state by executing a program of the system based on the fact that the area of ​​the face image has been detected by the face detection processing and the face authentication by the face authentication processing has been successful; a step of controlling whether or not to cause the first processor to execute a user registration process for registering information based on a face image detected by the face detection process after the system is started as information based on a face image of the authorized user, depending on whether or not the cause of the start-up of the system is an input to a HID (Human Interface Device); Including, When the difference between the timing at which the input to the HID is detected and the timing at which the display of the display unit is turned on in response to the startup of the system is within a predetermined time, it is determined that the cause of the startup of the system is the input to the HID. Control methods.

8. A control method for an information processing device including a memory for temporarily storing a system program, a first processor, and a second processor, comprising: a step of performing face detection processing by the first processor to detect a face image area in which a face is captured from a captured image captured by an imaging unit; A step in which the first processor performs a face recognition process for performing face recognition based on information based on the detected face image and information based on a face image of a legitimate user; a step in which the second processor starts up the system from a standby state by executing a program of the system based on the fact that the area of ​​the face image has been detected by the face detection processing and the face authentication by the face authentication processing has been successful; When the second processor starts up the system, it determines whether or not a difference between a timing at which an input to a HID (Human Interface Device) is detected and a timing at which a display of a display unit is turned on in response to the start-up of the system is within a predetermined time period; a step in which the second processor causes the first processor to execute a user registration process for registering information based on a face image detected by the face detection process after the system is started as information based on a face image of the authorized user when the determination result is true; Including, The second processor does not cause the first processor to execute the user registration process when the determination result is false. Control methods.

9. A control method for an information processing device including a memory for temporarily storing a system program, a first processor, and a second processor, comprising: a step of performing face detection processing by the first processor to detect a face image area in which a face is captured from a captured image captured by an imaging unit; A step in which the first processor performs a face recognition process for performing face recognition based on information based on the detected face image and information based on a face image of a legitimate user; activating the system from a standby state by executing a program of the system by the second processor; a step of controlling whether or not to cause the first processor to execute a user registration process for registering information based on a face image detected by the face detection process after the system is started as information based on a face image of the authorized user, depending on whether or not the cause of the start-up of the system is that an area of ​​the face image has been detected by the face detection process and face authentication by the face authentication process has been successful, when the second processor starts up the system; a step of executing a system authentication process by the second processor after starting up the system, for authenticating whether or not the user is a legitimate user through processing of the system; a step of registering, by the first processor, as the user registration process, information based on a face image detected by the face detection process within a predetermined time after authentication by the system authentication process is successful, as information based on a face image of the authorized user; A control method comprising:

Citation Information

Patent Citations

  • Face recognition method and device, terminal and readable storage medium

    CN111756921A

  • Face image collating device, face image collating system, and face image collating method

    JP2008071366A

  • Instrument with face authentication function

    JP2016148895A

  • Information processing apparatus and information processing method

    JP2019174855A

  • Face recognition method and device

    JP2021535503A