Information processing apparatus and control method

Abstract

To properly register a face image of an authorized user used for face authentication.SOLUTION: An information processing apparatus executes: face detection processing to detect an area of a face image of a face from a captured image captured by an imaging unit; and face authentication processing to authenticate the face on the basis of information based on the detected face image and information based on a face image of an authorized user. The information processing apparatus executes a program of a system to boot the system from a standby state, on the basis of the area of the face image being detected by the face detection processing and face authentication by the face authentication processing being successful. When booting the system, the information processing apparatus controls whether or not to execute user registration processing to register information based on the face image detected by the face detection processing after booting the system as information based on the face image of the authorized user, depending on whether or not the system has been booted by input to an HID.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and a control method.

Background Art

[0002] There is an information processing apparatus that transitions to an available state when a person approaches and transitions to a standby state where it stops except for some functions when the person leaves. For example, in Patent Document 1, an infrared sensor is used to detect whether a person is approaching or moving away.

[0003] In recent years, with the development of computer vision and the like, the detection accuracy when detecting a face from an image has been increasing. Therefore, face detection has begun to be used instead of detecting a person using an infrared sensor. Also, when the information processing apparatus is started up, user authentication (for example, login authentication) as to whether the user is a legitimate user is performed, and face authentication has come to be used as this authentication method. For example, when a person approaches, the information processing apparatus starts up by detecting the face of the person, and then, if the person is a legitimate user by performing login authentication such as face authentication, permission to log in to the system is granted and it transitions to an available state.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the method of activation by face detection as described above, there is a problem that it may be activated unnecessarily even when a person other than the authorized user approaches. To solve this problem, for example, face detection is performed when authentication is successful in the OS login authentication, and the detected face image is registered as the face image of the authorized user, and face authentication is performed in addition to face detection at the time of activation. However, from the viewpoint of security, it is desirable to keep the registration information of the face image in the processor for face detection. In that case, the OS side cannot determine whether the detected face image has already been registered. Therefore, if a face image is registered every time authentication is successful in the OS login authentication, there is a concern that a large number of face images of the authorized user (face images of similar faces of the same person) will be registered, and the registration frame (memory capacity) will be filled up immediately.

[0006] The present invention has been made in view of the above circumstances, and one of the objects is to provide an information processing apparatus and a control method for appropriately registering a face image of an authorized user used for face authentication.

Means for Solving the Problems

[0007] The present invention has been made to solve the above problems. An information processing apparatus according to a first aspect of the present invention includes a memory that temporarily stores a program of a system, a face detection process that detects a region of a face image in which a face is imaged from among captured images captured by an imaging unit, and a face authentication process that performs face authentication based on information based on the detected face image and information based on a face image of an authorized user. A first processor that executes the process, and a second processor that activates the system from a standby state by executing the program of the system based on the fact that the region of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful. The second processor, when activating the system, controls whether to cause the first processor to execute a user registration process of registering information based on the face image detected by the face detection process after the system is activated as information based on the face image of the authorized user depending on whether the cause of activation is due to an input to a Human Interface Device (HID).

[0008] In the above information processing apparatus, when the system is started due to an input to the HID, the second processor causes the first processor to execute the user registration process; when the cause of the startup is not an input to the HID, it is not necessary to cause the first processor to execute the user registration process.

[0009] In the above information processing apparatus, when the difference between the timing at which an input to the HID is detected and the timing at which the display of the display unit is turned on in response to the startup of the system is within a predetermined time, the second processor may determine that the cause of starting the system is due to an input to the HID.

[0010] Further, an information processing apparatus according to a second aspect of the present invention includes a memory that temporarily stores a program of a system, a face detection process that detects a region of a face image in which a face is imaged from among captured images captured by an imaging unit, and a face authentication process that performs face authentication based on information based on the detected face image and information based on a face image of a legitimate user. The information processing apparatus further includes a first processor that executes the face detection process and the face authentication process, and a second processor that starts the system from a standby state by executing the program of the system based on the fact that the region of the face image is detected by the face detection process and the face authentication by the face authentication process is successful. When starting the system, the second processor determines whether the difference between the timing at which an input to a Human Interface Device (HID) is detected and the timing at which the display of the display unit is turned on in response to the startup of the system is within a predetermined time. When the determination result is true, the second processor causes the first processor to execute a user registration process of registering information based on the face image detected by the face detection process after starting the system as information based on the face image of the legitimate user. When the determination result is false, the second processor does not cause the first processor to execute the user registration process.

[0011] In addition, the information processing apparatus according to the third aspect of the present invention includes a memory that temporarily stores a program of the system, a face detection process that detects a region of a face image in which a face is imaged from among the captured images captured by the imaging unit, and a face authentication process that performs face authentication based on information based on the detected face image and information based on a face image of a legitimate user. The information processing apparatus further includes a first processor that executes the face detection process and the face authentication process, and a second processor that activates the system from a standby state by executing the program of the system. When the second processor activates the system, the second processor controls whether or not to cause the first processor to execute user registration processing for registering information based on the face image detected by the face detection process as information based on the face image of the legitimate user after the system is activated, depending on whether or not the cause of activation is that the region of the face image is detected by the face detection process and the face authentication by the face authentication process is successful.

[0012] In the above information processing apparatus, when the second processor activates the system due to a factor other than the success of face authentication by the face authentication process, the second processor causes the first processor to execute the user registration process. When the system is activated based on the fact that the authentication result of the face authentication process is successful, the second processor may not cause the first processor to execute the user registration process.

[0013] In the above information processing apparatus, after the system is activated, the second processor executes a system authentication process for authenticating whether or not the user is a legitimate user by the processing of the system. As the user registration process, the first processor may register information based on the face image detected by the face detection process as information based on the face image of the legitimate user within a predetermined time after the authentication by the system authentication process is successful.

[0014] In the above information processing apparatus, as the user registration process, within a predetermined time after successful authentication by the system authentication process, information based on a face image in which the face orientation of the face images detected by the face detection process is a specific orientation may be registered as information based on the face image of the regular user.

[0015] In the above information processing apparatus, when information based on the face image of the regular user is not registered, regardless of the factor that caused the system to start up, the first processor may be made to execute the user registration process.

[0016] Also, a control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor according to a fourth aspect of the present invention includes: a step in which the first processor performs a face detection process of detecting a region of a face image in which a face is imaged from among captured images captured by an imaging unit; a step in which the first processor performs a face authentication process of performing face authentication based on information based on the detected face image and information based on a face image of a regular user; a step in which the second processor starts up the system from a standby state by executing the program of the system based on the fact that the region of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful; and a step in which the second processor controls whether to cause the first processor to execute a user registration process of registering information based on the face image detected by the face detection process after the system is started up as information based on the face image of the regular user depending on whether the factor that caused the system to start up is due to an input to a HID (Human Interface Device).

[0017] Also, a control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor according to a fifth aspect of the present invention includes: a step in which the first processor performs face detection processing for detecting a region of a face image in which a face is imaged from among captured images captured by an imaging unit; a step in which the first processor performs face authentication processing for face authentication based on information based on the detected face image and information based on a face image of a legitimate user; a step in which the second processor starts up the system from a standby state by executing the program of the system based on the fact that the region of the face image is detected by the face detection processing and the face authentication by the face authentication processing is successful; a step in which the second processor determines whether a difference between a timing at which an input to a HID (Human Interface Device) is detected and a timing at which the display of a display unit is turned on in response to the startup of the system is within a predetermined time when the system is started up; a step in which the second processor causes the first processor to execute user registration processing for registering information based on the face image detected by the face detection processing after the startup of the system as information based on the face image of the legitimate user when the determination result is true; and the second processor does not cause the first processor to execute the user registration processing when the determination result is false.

[0018] In addition, a control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor according to a sixth aspect of the present invention includes: a step in which the first processor performs face detection processing for detecting a region of a face image in which a face is imaged from among captured images captured by an imaging unit; a step in which the first processor performs face authentication processing for performing face authentication based on information based on the detected face image and information based on a face image of a legitimate user; a step in which the second processor starts the system from a standby state by executing the program of the system; and a step in which, when the second processor starts the system, the second processor controls whether or not to cause the first processor to execute user registration processing for registering information based on the face image detected by the face detection processing as information based on the face image of the legitimate user after the system is started, depending on whether or not the cause of the startup is that the region of the face image has been detected by the face detection processing and the face authentication by the face authentication processing has been successful.

Advantages of the Invention

[0019] According to the above aspect of the present invention, it is possible to appropriately register a face image of a legitimate user used for face authentication.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Modes for Carrying Out the Invention

[0021] Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, an overview of the information processing apparatus according to the present embodiment will be described. The information processing apparatus 1 according to the present embodiment is, for example, a notebook (clamshell type) PC (Personal Computer). Note that the information processing apparatus 1 may be any form of information processing apparatus such as a desktop PC, a tablet PC, or a smartphone.

[0022] The information processing apparatus 1 can transition between at least a normal operation state (power-on state) and a standby state as the operation state of the system. The normal operation state is an operation state in which processing can be executed without particular limitation, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface). The standby state is a state in which at least a part of the system processing is restricted. For example, the standby state may be a standby state, a sleep state, etc., and may also be a state corresponding to modern standby in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI. For example, the standby state is an operation state with a lower power consumption than the normal operation state.

[0023] Hereinafter, the transition of the operating state of the system from the standby state to the normal operating state may be referred to as startup. In the standby state, since the activity of the operation is generally lower than that in the normal operating state, starting up the system of the information processing apparatus 1 activates the operation of the system in the information processing apparatus 1.

[0024] FIG. 1 is a diagram for explaining the outline of the HPD process of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 detects a person (i.e., a user) existing in the vicinity of the information processing apparatus 1. The process of detecting the presence of this person is referred to as HPD (Human Presence Detection) processing. The information processing apparatus 1 detects the presence or absence of a person by HPD processing, and controls the operating state of the system of the information processing apparatus 1 based on the detection result. For example, as shown in FIG. 1(A), when the information processing apparatus 1 detects a change from a state where no person exists (Absence) to a state where a person exists (Presence) in front (front side) of the information processing apparatus 1, that is, when it detects that a person has approached the information processing apparatus 1 (Approach), it determines that the user has approached, and automatically starts up the system and transitions to the normal operating state. Further, as shown in FIG. 1(B), when a person exists in front of the information processing apparatus 1 (Presence), the information processing apparatus 1 determines that the user exists and continues the normal operating state. Then, as shown in FIG. 1(C), when the information processing apparatus 1 detects a change from a state where a person exists (Presence) to a state where no person exists (Absence) in front (front side) of the information processing apparatus 1, that is, when it detects that a person has left the information processing apparatus 1 (Leave), it determines that the user has left, and transitions the system to the standby state.

[0025] The information processing apparatus 1 detects the presence of a person in a predetermined range in the front (front side). FIG. 2 is a diagram showing an example of the detection range of a person by the information processing apparatus 1 according to the present embodiment. In the illustrated example, the detection range FoV (Field of View) in front (front side) of the information processing apparatus 1 is the range in which a person can be detected. For example, the information processing apparatus 1 determines whether a person (user) exists in front (front) of the information processing apparatus 1 by detecting an area of a face image (hereinafter referred to as "face area") in which a face is imaged from a captured image of the front (front side). The detection range FoV corresponds to the captured image angle that the information processing apparatus 1 captures. When a face area is detected from the captured image, the information processing apparatus 1 determines that a user exists. On the other hand, when no face area is detected from the captured image, the information processing apparatus 1 determines that no user exists.

[0026] For example, when the information processing apparatus 1 determines that a user exists by detecting a face area from a captured image in a standby state, the system is activated from the standby state. Further, after the system is activated, the information processing apparatus 1 executes a system authentication process for authenticating whether the user is a legitimate user by the system process. A legitimate user is a user who is registered in advance as a user who uses the information processing apparatus 1. When the information processing apparatus 1 determines that the user is a legitimate user, it permits the use (permits login) and transitions to the normal operation state. On the other hand, when the information processing apparatus 1 determines that the user is not a legitimate user, it does not permit the use (permits login) and continues the authentication waiting state. The user authentication by the system authentication process at the time of this activation is hereinafter referred to as "login authentication".

[0027] Examples of the login authentication method include password authentication in which a user authenticates by inputting a password from a keyboard, PIN authentication in which a user authenticates by inputting a PIN (Personal Identification Number), face authentication in which a user is authenticated by a face, and fingerprint authentication in which a user is authenticated by a fingerprint. When face authentication for login authentication is enabled, the information processing apparatus 1 performs face authentication by comparing the feature information based on the face image of the face area detected from the captured image with the feature information based on the face image of the legitimate user registered in advance.

[0028] Here, when the information processing apparatus 1 starts the system from the standby state only by face detection that detects the face region from the captured image in the HPD process, it will start even when a person other than the regular user approaches. Therefore, the information processing apparatus 1 registers a user ID (hereinafter referred to as "HPD user ID") for authenticating whether the user is a regular user in the HPD process based on the authentication result at the time of login authentication.

[0029] For example, when the login authentication after the system startup is successful, it is assumed that the regular user is present in front of the information processing apparatus 1. Therefore, the information processing apparatus 1 detects the face region from the captured image captured when the login authentication is successful, sets the detected face image as the face image of the regular user, and registers the feature information based on the face image as the HPD user ID. When the information processing apparatus 1 detects the face region from the captured image in the HPD process, it performs face authentication using the registered HPD user ID. Then, the information processing apparatus 1 starts the system in the case of successful authentication (that is, when the regular user is detected), and performs control such as keeping the system in the standby state without starting it in the case of failed authentication (that is, when a person other than the regular user is detected).

[0030] However, when performing face authentication at the time of login authentication, it allows high power consumption so that high-precision face authentication is possible. However, when performing the HPD process in the standby state, it is desirable to minimize the power consumption. For example, in the case of face authentication in login authentication, the captured image captured by an IR (Infrared Rays) camera is used, but in the face authentication in the HPD process in the standby state, the captured image captured by an RGB camera is used. Also, the frame rate at which the captured image is captured in the HPD process in the standby state is set lower than the frame rate at which the captured image for face authentication is captured in login authentication.

[0031] Due to the differences between the face authentication during the above-mentioned login authentication and the face authentication in the HPD process, for example, even when the face is tilted by about ±20° from the front, face authentication in the login authentication is possible. However, in the face authentication in the HPD process, the face can only be authenticated as the same face within a range of about ±15° from the front. Therefore, it is desirable to register the feature information based on the face image of the frontal face as much as possible as the HPD user ID. Note that the face being in the front means the direction in which the face faces the imaging unit such as the above-mentioned IR camera or RGB camera, and it is a state in which a frontal face is imaged in the captured image.

[0032] For example, within a predetermined time (e.g., within 5 seconds) after successful authentication in the login authentication, the information processing apparatus 1 registers the feature information based on the face image when the face is facing the front as the HPD user ID. The limitation within a predetermined time (e.g., within 5 seconds) is to reduce the possibility of being replaced by a user other than the legitimate user.

[0033] Also, if the face image is registered as the HPD user ID every time the system login authentication is successful, there is a concern that a large number of face images of similar faces of the same person (legitimate user) will be registered, and the registration frame (memory capacity) will be filled up immediately. Since it is desirable to keep the registered information of the face image in the face detection processor from the perspective of security, the system side cannot determine whether the detected face image has been registered or not.

[0034] Therefore, when the login authentication of the system is successfully authenticated, the information processing apparatus 1 determines whether to register the HPD user ID based on the factor (trigger) when the system starts up from the standby state. For example, when the information processing apparatus 1 starts up from the standby state in response to an input to the HID (Human Interface Device), since the approach of a legitimate user is not detected in the HPD process, it can be assumed that the HPD user ID of the person who made this input to the HID (hereinafter simply referred to as "HID input") is not registered. Therefore, when the information processing apparatus 1 starts up the system with the HID input as a factor, within a predetermined time (for example, within 5 seconds) after successful authentication in the login authentication, it executes a user registration process of registering the feature information based on the face image when the face is facing forward as the HPD user ID.

[0035] On the other hand, when the factor for starting up the system is not the HID input, for example, it is considered that the system is started up because the approach of a legitimate user whose HPD user ID has already been registered is detected by the HPD process. Therefore, the information processing apparatus 1 does not execute the user registration process so as not to duplicate the registration of the HPD user ID of the same person as the registered HPD user ID. In the unregistered state where no HPD user ID is registered, when the information processing apparatus 1 is successfully authenticated in the login authentication of the system, it executes the user registration process and registers the HPD user ID regardless of the factor for starting up the system.

[0036] As a result, the information processing apparatus 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), so that the registration of the face image of the legitimate user used for face authentication can be appropriately performed.

[0037] Figure 3 is a diagram showing an overview of the HPD process using the HPD user ID according to the present embodiment. With reference to this Figure 3, the overview of the HPD process according to the present embodiment will be described in the order of (1) to (12). Hereinafter, the captured image obtained by imaging the front (front side) with the RGB camera in the standby state of the information processing apparatus 1 will be referred to as an "RGB image". On the other hand, the captured image obtained by imaging the front (front side) with the IR camera at the time of login authentication after the system startup of the information processing apparatus 1 will be referred to as an "IR image". (1) First of all, at this point, it is assumed that the HPD user ID is not registered. The information processing apparatus 1 starts the system by detecting a face region from the RGB image captured by the RGB camera in the standby state. Also, the information processing apparatus 1 starts the system when there is an HID input in the standby state as well.

[0038] (2) After starting up, the information processing apparatus 1 performs login authentication to permit only regular users to use the system. For example, in the event of login authentication of the system after startup, the information processing apparatus 1 detects a face region from the IR image captured by the IR camera and executes face authentication processing based on the face image of the detected face region. Note that the authentication method for login authentication may be an authentication method other than face authentication.

[0039] (3) When the login authentication is successful, the information processing apparatus 1 determines whether the HPD user ID is registered and the factor (startup factor) that started the system.

[0040] (4) When the HPD user ID is not registered or the startup factor is an HID input, the information processing apparatus 1 executes user registration processing for registering the HPD user ID. In the user registration processing, the information processing apparatus 1 first detects a face region from the RGB image captured by the RGB camera within a predetermined time (for example, within 5 seconds) after the login authentication is successful.

[0041] (5) The information processing device 1 registers, as the HPD user ID, the feature information based on the face image when the face is facing forward, based on the face area detected from the RGB image captured by the RGB camera within a predetermined time (for example, within 5 seconds).

[0042] (6) Next, when the information processing device 1 detects a face area from the RGB image captured by the RGB camera in the standby state, it performs face authentication to determine whether it is a legitimate user using the HPD user ID registered in (5) above. For example, when the information processing device 1 detects a face area from the RGB image in the standby state, it performs face authentication by comparing the feature information based on the face image of the detected face area with the HPD user ID.

[0043] (7) If the face authentication in (6) above fails, the information processing device 1 determines that it is not a legitimate user and continues to wait without starting the system.

[0044] (8) On the other hand, if the face authentication in (6) above is successful, the information processing device 1 determines that it is a legitimate user and starts the system. Also, when there is an HID input in the standby state, the information processing device 1 starts the system.

[0045] (9) After startup, similar to the content described in (2) above, the information processing device 1 performs login authentication processing.

[0046] (10) When the login authentication is successful, the information processing device 1 determines whether the HPD user ID is registered and the factor (startup factor) that started the system, similar to the content described in (3) above. Here, the information processing device 1 determines that the HPD user ID is registered. If the information processing device 1 determines that the startup factor is not an HID input, it determines that it was started by the approach of a legitimate user with the HPD user ID already registered and does not execute the user registration process.

[0047] (11)、(12) On one hand, when the startup factor is HID input, the information processing device 1 determines that the HPD user ID of the person who performed the HID input is not registered, and executes user registration processing in the same manner as in (4) and (5) above.

[0048] Thereafter, (6) to (12) above are repeated. In this way, within a predetermined time (for example, within 5 seconds) after the login authentication is successful, the information processing device 1 registers the feature information based on the face image when the face is facing forward as the HPD user ID, and performs face authentication using the HPD user ID in the HPD process, so that the face of a regular user can be appropriately authenticated.

[0049] Next, the configuration of the information processing device 1 according to this embodiment will be described in detail. [External Configuration of Information Processing Device] FIG. 4 is a perspective view showing a configuration example of the external appearance of the information processing device 1 according to this embodiment. The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are coupled using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around the rotation axis formed by the hinge mechanism 15. The opening angle formed by the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0050] The first housing 10 is also called an A cover and a display housing. The second housing 20 is also called a C cover and a system housing. In the following description, among the side surfaces of the first housing 10 and the second housing 20, the surfaces provided with the hinge mechanism 15 are respectively referred to as side surfaces 10c and 20c. Among the side surfaces of the first housing 10 and the second housing 20, the surfaces opposite to the side surfaces 10c and 20c are respectively referred to as side surfaces 10a and 20a. In the drawing, the direction from the side surface 20a to the side surface 20c is called "rear", and the direction from the side surface 20c to the side surface 20a is called "front". The right side and the left side with respect to the rear are respectively called "right" and "left". The left side surfaces of the first housing 10 and the second housing 20 are respectively referred to as side surfaces 10b and 20b, and the right side surfaces are respectively referred to as side surfaces 10d and 20d. Also, the state where the first housing 10 and the second housing 20 overlap and are completely closed (the state where the opening angle θ = 0°) is called the "closed state". In the closed state, the surfaces of the first housing 10 and the second housing 20 facing each other are respectively called their "inner surfaces", and the surfaces opposite to the inner surfaces are called "outer surfaces". Also, the state where the first housing 10 and the second housing 20 are opened with respect to the closed state is called the "open state".

[0051] The appearance of the information processing apparatus 1 shown in FIG. 4 shows an example of the open state. The open state is a state where the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing apparatus 1, and typically, it is often used in a state where the opening angle θ is about 100 to 130°. Note that the range of the opening angle θ in the open state can be arbitrarily determined according to the range of the angle that can be rotated by the hinge mechanism 15 and the like.

[0052] On the inner surface of the first housing 10, a display unit 110 is provided. The display unit 110 includes a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. Also, an imaging unit 120 is provided in a region on the inner surface of the first housing 10 around the periphery of the display unit 110. For example, the imaging unit 120 is arranged on the side surface 20a side in the region around the periphery of the display unit 110. Note that the position where the imaging unit 120 is arranged is an example, and it may be arranged at other positions as long as it can image the direction (front) facing the inner surface of the first housing 10.

[0053] In the open state, the imaging unit 120 images a predetermined imaging range in the direction (front) facing the inner surface of the first housing 10. The predetermined imaging range is the range of the angle of view determined by the imaging element of the imaging unit 120 and the optical lens provided in front of the imaging surface of the imaging element, and corresponds to the detection range FoV of the person (face) shown in FIG. 2. For example, the imaging unit 120 can image an image including a person (e.g., a user) existing in front (front side) of the information processing apparatus 1.

[0054] Also, a power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct turning on or off the power, transitioning from the standby state to the normal operation state, and transitioning from the normal operation state to the standby state. Also, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices for receiving user operation inputs. Note that as input devices, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided, or a mouse or an external keyboard may be connected. In the case of a configuration where a touch sensor is provided, a region corresponding to the display surface of the display unit 110 may be configured as a touch panel that receives operations. Also, the input device may include a microphone for inputting sound.

[0055] [Hardware Configuration of Information Processing Apparatus] FIG. 5 is a schematic block diagram showing an example of the hardware configuration of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400. The display unit 110 displays display data (image) generated based on system processing executed by the main processing unit 300 and processing of an application program operating on the system processing.

[0056] The imaging unit 120 captures an image of an object within a predetermined angle of view (for example, the detection range FoV shown in FIG. 2) in the direction (front) facing the inner surface of the first housing 10, and outputs the captured image to the face detection unit 210 and the main processing unit 300. For example, the imaging unit 120 includes an RGB camera and an IR (Infrared Rays) camera. The RGB camera is a normal camera that captures an image based on visible light. The IR camera is a camera that captures an image based on infrared rays emitted from an object. For example, the IR camera irradiates infrared rays during imaging and captures an image based on the infrared rays reflected by the object.

[0057] Since the IR camera irradiates infrared rays during imaging, for example, the power consumption during imaging is higher than that of the RGB camera. Therefore, when detecting a face region and performing face authentication from an RGB image in the standby state, in order to suppress the standby power as much as possible, for example, an RGB camera is used instead of the IR camera. On the other hand, when detecting a face region from an IR image and performing face authentication in login authentication by face authentication, for example, an IR camera is used to improve the authentication accuracy. Note that both the IR camera and the RGB camera may be used during login authentication by face authentication.

[0058] The power button 140 outputs an operation signal to the EC 200 according to the user's operation. The input device 150 is an input unit that receives user input, and is configured to include, for example, a keyboard 151 and a touch pad 153. The input device 150 outputs an operation signal indicating the operation content to the EC 200 in response to receiving an operation on the keyboard 151 and the touch pad 153.

[0059] The communication unit 160 is communicably connected to other devices via a wired or wireless communication network, and transmits and receives various data. For example, the communication unit 160 is configured to include a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0060] The storage unit 170 is configured to include storage media such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), a RAM (Random Access Memory), and a ROM (Read Only Memory). The storage unit 170 stores various programs such as an OS, a device driver, and an application, and other various data acquired by the operation of the programs.

[0061] The power supply unit 400 supplies power to each part according to the operation state of each part of the information processing apparatus 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into the voltage required by each part. The power whose voltage has been converted by the DC / DC converter is supplied to each part via each power supply system. For example, the power supply unit 400 supplies power to each part via each power supply system based on a control signal input from the EC 200.

[0062] The EC200 is a microcomputer composed of a CPU (Central Processing Unit), RAM, ROM, and I / O (Input / Output) logic circuits, etc. The CPU of the EC200 reads out a control program (firmware) pre-stored in its own ROM and executes the read control program to exhibit its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. Also, the EC200 is connected to a power button 140, an input device 150, a power supply unit 400, etc.

[0063] For example, by communicating with the power supply unit 400, the EC200 acquires information on the state of the battery (remaining capacity, etc.) from the power supply unit 400, and outputs control signals, etc. for controlling the supply of power according to the operating states of the respective parts of the information processing apparatus 1 to the power supply unit 400. Also, the EC200 acquires operation signals from the power button 140 and the input device 150, and outputs the operation signals related to the processing of the main processing unit 300 among the acquired operation signals to the main processing unit 300.

[0064] The face detection unit 210 is composed of a processor that processes the image data of the captured image captured by the imaging unit 120. The face detection unit 210 acquires the image data of the captured image captured by the imaging unit 120 and temporarily stores the acquired image data in a memory. The memory for storing the image data may be the system memory 304 or a memory (not shown) within the face detection unit 210.

[0065] For example, the face detection unit 210 performs face detection processing for detecting a face region from the captured image and face authentication processing for authenticating the face image of the detected face region, etc. by processing the image data of the captured image acquired from the imaging unit 120. The face detection unit 210 transmits the detection result of the face detection processing, the authentication result of the face authentication processing, etc. to the chipset 303 of the main processing unit 300.

[0066] Note that the face detection unit 210 operates not only in the normal operation state but also in the standby state. In the standby state, the face detection unit 210 acquires, for example, the image data of the RGB image captured by the RGB camera of the imaging unit 120 and detects the face region. By imaging using the RGB camera without using the IR camera, the power consumption (standby power) in the standby state can be suppressed. On the other hand, in the login authentication process after startup, the face detection unit 210 acquires the image data of the IR image (or the captured image captured by both the RGB camera and the IR camera) captured by the IR camera of the imaging unit 120 and performs face region detection and face authentication, thereby improving the accuracy of face authentication.

[0067] For example, in the HPD process described with reference to FIG. 3, the face detection unit 210 performs face authentication using the HPD user ID registered when the authentication by the login authentication process is successful. The functional configuration in this HPD process will be described in detail later.

[0068] The main processing unit 300 includes a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and various application programs can be executed on the OS by system processing based on the OS (Operating System).

[0069] The CPU 301 executes processing by the BIOS, processing by the OS, processing by application programs operating on the OS, etc. The CPU 301 controls the operating state of the system based on instructions from the chipset 303 or the like. For example, the CPU 301 executes a startup process for starting the system from the standby state. In addition, after startup from the standby state, the CPU 301 executes a login authentication process for authenticating whether the user is a legitimate user, and when the authentication is successful, it transitions to the normal operation state.

[0070] For example, the CPU 301 executes authentication processing by face authentication in login authentication. Note that the CPU 301 may execute authentication processing other than face authentication (for example, password authentication, PIN authentication, fingerprint authentication, etc.) in login authentication.

[0071] When the CPU 301 determines that it is a legitimate user (authentication successful) in login authentication, it permits use (permits login) and causes a transition to the normal operating state. On the other hand, when the CPU 301 determines that it is not a legitimate user (authentication failed) in login authentication, it does not permit use (permits login) and continues the state of waiting for login authentication.

[0072] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing based on the control of the CPU 301 to generate display data. The GPU 302 outputs the generated display data to the display unit 110.

[0073] The chipset 303 has functions such as a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. Also, the chipset 303 controls the input / output of data from the communication unit 160, the display unit 110, and the EC 200. Further, the chipset 303 has a function as a sensor hub. For example, in the HPD process, the chipset 303 acquires the detection result of face detection from the face detection unit 210, detects the presence of a person (user) based on the detection result, and controls the operating state of the system.

[0074] The system memory 304 is used as a reading area for programs executed by the CPU 301 and a working area for writing processing data. Also, the system memory 304 temporarily stores the image data of the captured image captured by the imaging unit 120.

[0075] Note that the CPU 301, GPU 302, and chipset 303 may be configured as one integrated processor, or some or each of them may be configured as individual processors. For example, in the normal operating state, all of the CPU 301, GPU 302, and chipset 303 are operating, but in the standby state, only at least a part of the chipset 303 is operating. In the standby state, at least the functions necessary for the HPD process at startup are operating.

[0076] [Functional Configuration of Information Processing Apparatus] Next, the functional configuration in which the information processing apparatus 1 controls the operating state of the system by the HPD process will be described.

[0077] FIG. 6 is a block diagram showing an example of the functional configuration of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 includes a face detection unit 210 and a main processing unit 300. The main processing unit 300 includes a system processing unit 310 and an HPD control processing unit 330. The face detection unit 210 corresponds to the face detection unit 210 shown in FIG. 5 and is a functional configuration realized by executing a program in the face detection unit 210. The system processing unit 310 and the HPD control processing unit 330 are functional configurations realized by the main processing unit 300 executing an OS and a program operating on the OS. For example, the system processing unit 310 is a functional configuration realized by the CPU 301 executing a program of the OS. Further, the HPD control processing unit 330 is a functional configuration realized by the CPU 301 or the chipset 303 executing a program operating on the OS.

[0078] The face detection unit 210 includes a face detection processing unit 211, a face authentication processing unit 212, an HPD user ID registration unit 213, and an HPD processing unit 214. The system processing unit 310 includes an operation control unit 311 and an authentication processing unit 312. The HPD control processing unit 330 includes an operation instruction unit 331, an HID input detection unit 332, and a user registration control unit 333.

[0079] The face detection processing unit 211 reads the image data of the captured images captured by the imaging unit 120 at a predetermined frame rate (predetermined frequency) from the system memory 304, and detects the face area from each of the captured images. As a face detection method, any detection method can be applied, such as a face detection algorithm that detects a face based on face feature information, face detection using learned data (trained model) or a face detection library that is machine-learned based on face feature information. Also, the frame rate when the imaging unit 120 captures images is controlled, for example, at 4 FPS (Frames Per Second) when performing HPD processing in the standby state, at 15 FPS during login authentication using face recognition, at 15 FPS within a predetermined time (for example, within 5 seconds) after successful login authentication, and at 1 FPS when performing HPD processing in the normal operation state.

[0080] For example, in the standby state, the face detection processing unit 211 detects the face area from the RGB images captured at 4 FPS using the RGB camera of the imaging unit 120, and outputs coordinate information of the face area etc. as the detection result. Also, for example, during login authentication, the face detection processing unit 211 detects the face area from the IR images captured at 15 FPS using the IR camera of the imaging unit 120, and outputs coordinate information of the face area etc. as the detection result. Note that the face detection processing unit 211 may detect the face area from the IR images captured using the IR camera and the RGB camera of the imaging unit 120 during login authentication.

[0081] Also, for example, within a predetermined time (for example, within 5 seconds) after successful login authentication, the face detection processing unit 211 detects the face area from the RGB images captured at 15 FPS using the RGB camera of the imaging unit 120, and outputs coordinate information of the face area and information on the orientation of the face etc. as the detection result. The information on the orientation of the face is the face angle of the face image within the detected face area. For example, the face angle is an angle corresponding to the orientation of the face with the direction of the imaging unit 120 (the direction in which the face is facing forward) as the reference angle (for example, 0°).

[0082] Further, for example, in the normal operation state, the face detection processing unit 211 detects a face region from the RGB images captured at 1 FPS using the RGB camera of the imaging unit 120, and outputs coordinate information of the face region and the like as the detection result.

[0083] The face authentication processing unit 212 executes a face authentication process to authenticate whether the face image within the detected face region is the face image of a registered user. For example, during system login authentication, the face authentication processing unit 212 collates the face image detected from the IR images captured at 15 FPS using the IR camera of the imaging unit 120 with the face image of the registered user previously registered as user information (account information) for logging in to the system, thereby performing face authentication. Specifically, for example, during login authentication, the face authentication processing unit 212 performs face authentication by collating the feature information based on the face image detected from the IR images with the feature information based on the face image of the registered user previously registered.

[0084] Note that the face image of the registered user as user information (account information) is, for example, the face image detected from the IR images captured at 15 FPS using the IR camera of the imaging unit 120 in the registration menu for face authentication images in system settings.

[0085] Also, during HPD processing, the face authentication processing unit 212 performs face authentication based on the feature information based on the face image detected from the RGB images captured using the RGB camera of the imaging unit 120 and the feature information based on the face image of the registered user registered as the HPD user ID. For example, during HPD processing, the face authentication processing unit 212 performs face authentication by collating the feature information based on the face image detected from the RGB images captured at 4 FPS using the RGB camera of the imaging unit 120 with the feature information based on the face image of the registered user registered as the HPD user ID.

[0086] The HPD user ID registration unit 213 registers, as the HPD user ID (feature information based on the face image of a regular user), the feature information based on the face image when the face orientation is frontal among the face images detected from the RGB image by the face detection processing unit 211 within a predetermined time (for example, within 5 seconds) after the authentication by the login authentication processing is successful. For example, the HPD user ID registration unit 213 stores and registers the HPD user ID in the system memory 304 or a memory (not shown) within the face detection unit 210 etc.

[0087] For example, within a predetermined time (for example, within 5 seconds) after the authentication by the login authentication processing is successful, the HPD user ID registration unit 213 determines that the face orientation is frontal when the face angle of the face image detected from the RGB image by the face detection processing unit 211 is within a predetermined angle range (for example, ±15°) with respect to the direction of the imaging unit 120 (the direction in which the face is facing forward).

[0088] The HPD processing unit 214 outputs information indicating the detection result of the HPD processing based on the detection result of the face detection processing by the face detection processing unit 211 and the authentication result of the face authentication processing by the face authentication processing unit 212. For example, when the HPD user ID is already registered, the HPD processing unit 214 outputs presence information indicating that a regular user exists in front of the information processing apparatus 1 when a face area is detected from the RGB image by the face detection processing unit 211 and the face authentication by the face authentication processing unit 212 is successful.

[0089] Note that when the HPD user ID is not registered, the HPD processing unit 214 outputs presence information assuming that a user exists in front of the information processing apparatus 1, although it cannot determine whether the user is a regular user, based on the fact that a face area is detected from the RGB image by the face detection processing unit 211 in the standby state.

[0090] On the other hand, after the system is started up, when the face detection unit 211 fails to detect a face region from the RGB image, the HPD processing unit 214 outputs absence information indicating that there is no user in front of the information processing apparatus 1. Further, after the system is started up, even if the face detection unit 211 has detected a face region from the RGB image, if the face authentication by the face authentication unit 212 fails, the HPD processing unit 214 outputs absence information because the user present in front of the information processing apparatus 1 is not an authorized user.

[0091] When the operation instruction unit 331 acquires the presence information output from the HPD processing unit 214 in the standby state, it issues an instruction to start up the system from the standby state. For example, the operation instruction unit 331 outputs startup instruction information indicating an instruction to start up the system to the operation control unit 311. Further, while the operation instruction unit 331 is acquiring absence information from the HPD processing unit 214 in the standby state, it does not issue an instruction to start up the system.

[0092] Note that when the operation instruction unit 331 acquires absence information from the HPD processing unit 214 in the normal operation state, it issues an instruction to transition the system to the standby state. For example, the operation instruction unit 331 outputs standby instruction information indicating an instruction to transition the system to the standby state to the operation control unit 311.

[0093] When the operation control unit 311 acquires the startup instruction information output from the operation instruction unit 331, it executes the program of the system and starts up from the standby state. Further, after starting up from the standby state, the operation control unit 311 generates a login authentication event. Then, the operation control unit 311 waits without permitting login until authentication is successful. When authentication is successful, the operation control unit 311 permits login and transitions to the normal operation state.

[0094] Note that in the normal operation state, when the operation control unit 311 acquires the standby instruction information output from the operation instruction unit 331, it transitions the system from the normal operation state to the standby state.

[0095] When an event of login authentication occurs, the authentication processing unit 312 executes a login authentication process to authenticate whether the user is a legitimate user. For example, the authentication processing unit 312 executes a login authentication process by any one of face authentication, password authentication, PIN authentication, or fingerprint authentication. For example, when the authentication processing unit 312 executes an authentication process by face authentication, it acquires the authentication result of face authentication from the face detection unit 210 and executes a login authentication process based on the acquired authentication result. The authentication processing unit 312 determines that the user is a legitimate user when the authentication is successful, and determines that the user is not a legitimate user when the authentication fails.

[0096] In addition, in the case of password authentication or PIN authentication, the authentication processing unit 312 acquires an operation signal based on the user's operation on the keyboard 151 via the EC200. Then, the authentication processing unit 312 executes an authentication process by comparing the password or PIN input by the user's operation with the pre-registered password or PIN based on the acquired operation signal. Also, in the case of fingerprint authentication, the authentication processing unit 312 executes an authentication process by comparing the fingerprint acquired using a fingerprint sensor (not shown) with the pre-registered fingerprint.

[0097] The HID input detection unit 332 detects HID input. For example, the HID input detection unit 332 detects HID input by acquiring an input signal (operation signal) corresponding to the user's input (such as an operation) on the input device 150 via the EC200.

[0098] When the system is started, the user registration control unit 333 controls whether to cause the face detection unit 210 to execute a user registration process for registering the HPD user ID after the system is started depending on whether the start factor is HID input. For example, when the system is started due to HID input, the user registration control unit 333 causes the face detection unit 210 to execute the user registration process. On the other hand, when the start factor is not HID input, the user registration control unit 333 does not cause the face detection unit 210 to execute the user registration process.

[0099] For example, when the difference between the timing at which HID input is detected and the timing at which the display of the display unit 110 is turned on in response to the startup of the system is within a predetermined time (for example, within 0.5 seconds), the user registration control unit 333 determines that the startup factor of the system is due to the HID input.

[0100] That is, the user registration control unit 333 determines whether the difference between the timing at which HID input is detected and the timing at which the display of the display unit 110 is turned on in response to the startup of the system is within a predetermined time. Then, when the determination result is true, the user registration control unit 333 causes the face detection unit 210 to execute the user registration process after the system is started, and when the determination result is false, the user registration control unit 333 does not cause the face detection unit 210 to execute the user registration process.

[0101] Here, in the present embodiment, when the startup factor of the system is not HID input, in the state where the HPD user ID is registered, it is assumed that the successful face authentication in the HPD process is the startup factor. Therefore, in other words, when the system is started, the user registration control unit 333 controls whether to execute the user registration process after the system is started depending on whether the startup factor is due to the face area being detected by the face detection process and the face authentication being successful by the face authentication process.

[0102] For example, the user registration control unit 333 may perform control such that when the system is started due to a factor other than the success of face authentication by the face authentication process, the user registration process is executed by the face detection unit 210, and when the system is started based on the authentication result of the face authentication process being successful, the user registration process is not executed by the face detection unit 210.

[0103] Note that when the user registration control unit 333 is in an unregistered state where the HPD user ID is not registered, regardless of the startup factor of the system, the user registration control unit 333 causes the face detection unit 210 to execute the user registration process.

[0104] After the system starts up, when the authentication result of the login authentication by the authentication processing unit 312 is successful, the user registration control unit 333 determines whether to cause the face detection unit 210 to execute the above-described user registration process, and if it is determined to cause the face detection unit 210 to execute the user registration process, notifies the face detection unit 210.

[0105] For example, when the user registration control unit 333 determines to perform the user registration process, it notifies the face detection unit 210 of a user registration instruction that instructs the execution of the user registration process at the timing when the login authentication is successful. The HPD user ID registration unit 213 of the face detection unit 210 uses the notification of this user registration instruction as a trigger to register, within a predetermined time (for example, within 5 seconds) after the authentication by the login authentication process, the feature information based on the detected face image (for example, the face image when the face orientation is the front orientation) as the HPD user ID.

[0106] [Operations by HPD Processing] Next, the operations of the process for authenticating a regular user and controlling the operating state of the system in the HPD process will be described. First, with reference to FIG. 7, the operations of the HPD process in the standby state will be described. FIG. 7 is a flowchart showing an example of the HPD process in the standby state according to the present embodiment.

[0107] (Step S101) The face detection unit 210 acquires the RGB image captured by the imaging unit 120 in the standby state. In the standby state, for example, the RGB image is captured by the imaging unit 120 at a frame rate of 4 FPS. Then, the process proceeds to the process of step S103.

[0108] (Step S103) The face detection unit 210 detects a face area (area of the face image) from the RGB image acquired in step S101. When the face detection unit 210 does not detect a face area (NO), the process proceeds to the process of step S111. On the other hand, when the face detection unit 210 detects a face area (YES), the process proceeds to the process of step S105.

[0109] (Step S105) The face detection unit 210 determines whether the HPD user ID is registered. If the face detection unit 210 determines that the HPD user ID is not registered (NO), it proceeds to the process of step S111. On the other hand, if the face detection unit 210 determines that the HPD user ID is registered (YES), it proceeds to the process of step S107.

[0110] (Step S107) The face detection unit 210 performs face authentication based on the feature information based on the face image detected in step S103 and the feature information based on the face image of the regular user registered as the HPD user ID. Then, it proceeds to the process of step S109.

[0111] (Step S109) The face detection unit 210 determines whether the face authentication in step S107 was successful. If the face detection unit 210 determines that the face authentication was successful (YES), it outputs presence information and proceeds to the process of step S113. On the other hand, if the face detection unit 210 determines that the face authentication failed (NO), it proceeds to the process of step S111.

[0112] (Step S111) The HPD control processing unit 330 determines whether an HID input was detected. If the HPD control processing unit 330 has not detected an HID input (NO), it returns to the process of step S101. On the other hand, if the HPD control processing unit 330 determines that an HID input was detected (YES), it proceeds to the process of step S113.

[0113] (Step S113) When the HPD control processing unit 330 acquires the presence information output from the face detection unit 210, it outputs activation instruction information indicating an instruction to activate the system from the standby state as an activation instruction by HPD processing to the system processing unit 310. Also, the HPD control processing unit 330 outputs activation instruction information to the system processing unit 310 even when an HID input is detected. When the system processing unit 310 acquires the activation instruction information output from the HPD control processing unit 330, it executes the system program to activate the system from the standby state. Then, it proceeds to the process of step S115.

[0114] (Step S115) After the system processing unit 310 is activated from the standby state, it generates an event for login authentication and executes an authentication process to authenticate whether the user is a legitimate user. For example, the system processing unit 310 executes an authentication process by any one of face authentication, password authentication, PIN authentication, fingerprint authentication, etc.

[0115] Here, as an example of the login authentication process in step S115, the operation of the login authentication process by face authentication will be described with reference to FIG. 8. FIG. 8 is a flowchart showing an example of the login authentication process by face authentication according to the present embodiment.

[0116] (Step S151) When the system processing unit 310 generates an event for login authentication, the face detection unit 210 executes face detection processing and face authentication processing in the login authentication. First, the face detection unit 210 acquires an IR image (IR image, or IR image and RGB image) captured by the imaging unit 120. In the login authentication process, for example, the imaging unit 120 captures an IR image (IR image, or IR image and RGB image) at a frame rate of 15 FPS. Then, the process proceeds to the process of step S153.

[0117] (Step S153) The face detection unit 210 detects a face area from the IR image (IR image, or IR image and RGB image) acquired in step S151. If the face detection unit 210 does not detect a face area (NO), the process returns to the process of step S151. On the other hand, if the face detection unit 210 detects a face area (YES), the process proceeds to the process of step S155.

[0118] (Step S155) The face detection unit 210 performs a face authentication process based on the face image of the face area detected in step S153. For example, the face detection unit 210 performs a face authentication process based on the feature information of the face image of the detected face area and the feature information of the face image of the legitimate user registered in advance as user information (account information) for logging in to the system, and outputs the authentication result to the system processing unit 310.

[0119] (Step S157) The system processing unit 310 determines whether the login authentication is successful based on the authentication result of the face authentication process output from the face detection unit 210. For example, when the authentication result of the face authentication process is a failure (face authentication fails), the system processing unit 310 determines that the login authentication fails (NO), does not permit login, and returns to Step S151. On the other hand, when the authentication result of the face authentication process is a success (face authentication is successful), the system processing unit 310 determines that the login authentication is successful (YES), permits login, and ends the login authentication process. Then, it proceeds to the processes of Steps S117 and S119 in FIG. 7.

[0120] Here, an example of the login authentication process by face authentication has been described. However, in the case of a login authentication process by password authentication, PIN authentication, fingerprint authentication, etc., similarly, when the login authentication is successful, login is permitted, the login authentication process is ended, and it proceeds to the processes of Steps S117 and S119 in FIG. 7. Also, when the login authentication is successful, the system processing unit 310 notifies the HPD control processing unit 330 to that effect.

[0121] Note that there is no particular order for the processes of Steps S117 and S119, and they are performed in parallel respectively.

[0122] (Step S117) When the login authentication by the system processing unit 310 in Step S115 (Step S157) is successful, the HPD control processing unit 330 executes user registration control processing for controlling the registration of the HPD user ID.

[0123] (Step S119) The system processing unit 310 executes a login process with the account of a legitimate user for whom the login authentication is successful and transitions to the normal operation state. Note that in the normal operation state, the face detection unit 210 executes face detection processing (HPD processing) for detecting a face region from the RGB image captured by the imaging unit 120 at a frame rate of, for example, 1 FPS.

[0124] Here, the specific operation of the user registration control process in step S115 will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart showing an example of the user registration control process according to the present embodiment.

[0125] (Step S201) The HPD control processing unit 330 determines whether the HPD user ID has been registered in the face detection unit 210. If the HPD control processing unit 330 determines that it is in the registered state (YES), the process proceeds to the process of step S203. On the other hand, if the HPD control processing unit 330 determines that the HPD user ID is in the unregistered state (NO), the process proceeds to the process of step S205.

[0126] (Step S203) The HPD control processing unit 330 determines whether the activation factor when the system is activated in step S107 of FIG. 7 is an HID input. For example, the HPD control processing unit 330 determines whether the difference between the timing when the HID input is detected and the timing when the display of the display unit 110 is turned on in response to the activation of the system is within a predetermined time. If the determination result in step S203 is false (NO), the HPD control processing unit 330 ends the user registration control process without executing the user registration process. On the other hand, if the determination result in step S203 is true (YES), the process proceeds to the process of step S205.

[0127] (Step S205) The HPD control processing unit 330 notifies the face detection unit 210 of a user registration instruction for instructing the execution of the user registration process. Then, the process proceeds to the process of step S207.

[0128] (Step S207) When the face detection unit 210 receives the user registration instruction from the HPD control processing unit 330, the face detection unit 210 executes a user registration process for registering the HPD user ID.

[0129] Next, the user registration process in step S207 will be described with reference to FIG. 10. FIG. 10 is a flowchart showing an example of the user registration process according to the present embodiment. The face detection unit 210 detects a face region from an RGB image captured by the imaging unit 120 at a frame rate of, for example, 1 FPS in the normal operation state and executes the HPD process. However, when executing the user registration process, the frame rate is increased.

[0130] (Step S211) The face detection unit 210 increases the frame rate to, for example, 15 FPS and proceeds to the process of step S213.

[0131] (Step S213) The face detection unit 210 acquires an RGB image captured by the imaging unit 120 at a frame rate of, for example, 15 FPS and proceeds to the process of step S103.

[0132] (Step S215) The face detection unit 210 detects a face region (region of the face image) from the RGB image acquired in step S213. If the face detection unit 210 does not detect a face region (NO), it proceeds to the process of step S223. On the other hand, if the face detection unit 210 detects a face region (YES), it proceeds to the process of step S217.

[0133] (Step S217) The face detection unit 210 detects the orientation (face angle) of the face in the face region detected in step S215. Then, it proceeds to the process of step S219.

[0134] (Step S219) The face detection unit 210 determines whether the orientation of the face detected in step S217 is frontal. For example, if the face angle detected in step S217 is within a predetermined angle range (for example, within ±5°) with respect to the direction of the imaging unit 120 (front, face angle = 0°), the face detection unit 210 determines that the orientation of the face is frontal. If the face detection unit 210 determines that the orientation of the face is not frontal (NO), it proceeds to the process of step S223. On the other hand, if the face detection unit 210 determines that the orientation of the face is frontal (YES), it proceeds to the process of step S221A.

[0135] (Step S221A) The face detection unit 210 registers the feature information based on the face image determined to have a frontal face orientation as the HPD user ID (feature information based on the face image of a regular user). Then, the process proceeds to step S225.

[0136] (Step S223) The face detection unit 210 determines whether or not a predetermined time (for example, 5 seconds) has elapsed since the login authentication was successful. If the face detection unit 210 determines that the predetermined time (for example, 5 seconds) has not elapsed (NO), the process returns to step S213. On the other hand, if the face detection unit 210 determines that the predetermined time (for example, 5 seconds) has elapsed (YES), the process proceeds to step S225.

[0137] (Step S225) The face detection unit 210 lowers the frame rate to, for example, 1 FPS and ends the user registration process.

[0138] [Summary of Embodiment] As described above, the information processing apparatus 1 according to the present embodiment includes a system memory 304 (an example of a memory) that temporarily stores the program of the system, a face detection unit 210 (an example of a first processor), and a main processing unit 300 (an example of a second processor). The face detection unit 210 performs face detection processing for detecting a face region (face area) of a face image in which a face is imaged from among the captured images (for example, RGB images) captured by the imaging unit 120, and face authentication processing for authenticating a face based on the feature information (an example of information) based on the detected face image and the HPD user ID (an example of information based on the face image of a regular user). The main processing unit 300 activates the system from the standby state by executing the program of the above system based on the fact that the face region is detected by the face detection processing and the face authentication by the face authentication processing is successful. Further, when the main processing unit 300 activates the system, it controls whether or not to cause the face detection unit 210 to execute user registration processing for registering the feature information based on the face image detected by the face detection processing after the system is activated as the HPD user ID depending on whether or not the cause of activation is due to HID input (input to the HID).

[0139] As a result, in a configuration where the information processing apparatus 1 can start the system by performing face authentication on a legitimate user, whether to register the HPD user ID for face authentication of the legitimate user based on the face image detected after the system starts is controlled by whether the cause of the system startup is HID input. Thus, it is possible to prevent the information processing apparatus 1 from registering the HPD user ID unnecessarily after the system starts. Therefore, the information processing apparatus 1 can prevent a large number of face images of a similar face of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face image of the legitimate user used for face authentication.

[0140] For example, when the main processing unit 300 starts the system due to an HID input, the main processing unit 300 causes the face detection unit 210 to execute user registration processing. When the cause of the startup is not an HID input, the main processing unit 300 does not cause the face detection unit 210 to execute user registration processing.

[0141] As a result, when the cause of the system startup of the information processing apparatus 1 is an HID input, it can be assumed that the HPD user ID of the person who performed the HID input is not registered, so the HPD user ID is registered. When the cause of the system startup is not an HID input, it can be assumed that the system was started by the approach of a legitimate user for whom the HPD user ID has already been registered, so the registration of the HPD user ID is not performed. Therefore, the information processing apparatus 1 can prevent duplicate registration of the HPD user ID of the same person (legitimate user) and can appropriately register the face image of the legitimate user used for face authentication.

[0142] As an example, when the difference between the timing at which an HID input is detected and the timing at which the display of the display unit 110 is turned on in response to the startup of the system is within a predetermined time (for example, within 0.5 seconds), the main processing unit 300 determines that the cause of starting the system is due to an HID input.

[0143] As a result, the information processing apparatus 1 can appropriately determine whether the cause of the system startup is an HID input.

[0144] That is, when the main processing unit 300 activates the system, it determines whether the difference between the timing when HID input is detected and the timing when the display of the display unit 110 is turned on in response to the activation of the system is within a predetermined time (for example, within 0.5 seconds). If the determination result is true, after the system is activated, the face detection unit 210 is made to execute user registration processing. If the determination result is false, the face detection unit 210 is not made to execute user registration processing.

[0145] Thereby, the information processing apparatus 1 can appropriately determine whether the activation factor of the system is HID input, and can appropriately register the HPD user ID as a legitimate user based on the face image detected after the system is activated only when the activation factor is HID input. Therefore, it is possible to suppress the unnecessary registration of the HPD user ID after the system is activated. Thus, the information processing apparatus 1 can suppress the situation where a large number of face images of similar faces of the same person (legitimate user) are registered and the registration frame (memory capacity) is filled, and can appropriately register the face image of the legitimate user used for face authentication.

[0146] Also, when the main processing unit 300 activates the system, it controls whether to execute user registration processing after the system is activated depending on whether the activation factor is due to the detection of the face image area by face detection processing and the successful face authentication by face authentication processing.

[0147] Thereby, the information processing apparatus 1 controls whether to register the HPD user ID for face authentication of the legitimate user based on the face image detected after activation depending on whether the system is activated by the approach of a legitimate user for whom the HPD user ID has already been registered. Therefore, it is possible to suppress the unnecessary registration of the HPD user ID after the system is activated. Thus, the information processing apparatus 1 can suppress the situation where a large number of face images of similar faces of the same person (legitimate user) are registered and the registration frame (memory capacity) is filled, and can appropriately register the face image of the legitimate user used for face authentication.

[0148] For example, when the main processing unit 300 activates the system due to a factor other than the success of face authentication by the above face authentication process, it causes the face detection unit 210 to execute user registration processing, and when the system is activated based on the fact that the authentication result of the face authentication process is successful, it does not cause the face detection unit 210 to execute user registration processing.

[0149] As a result, when the system is activated by the approach of a legitimate user whose HPD user ID has already been registered, the information processing apparatus 1 does not register the HPD user ID, and when the system is activated by other activation factors, it registers the HPD user ID, thereby suppressing the duplication of registration of the HPD user ID of the same person (legitimate user). Therefore, the information processing apparatus 1 can appropriately register the face image of the legitimate user used for face authentication.

[0150] Also, after the system is activated, the main processing unit 300 executes login authentication processing (an example of system authentication processing) for authenticating whether the user is a legitimate user by the processing of the system. Then, as the above user registration processing, the face detection unit 210 registers, within a predetermined time (for example, within 5 seconds) after the authentication by the login authentication processing is successful, the feature information (an example of information) based on the face image detected by the face detection processing as the HPD user ID (an example of information based on the face image of the legitimate user).

[0151] As a result, since the information processing apparatus 1 uses the face image detected when the authentication is successful in the login authentication as the face image of the legitimate user for face authentication, it can appropriately authenticate the face of the legitimate user.

[0152] For example, as the above user registration processing, the face detection unit 210 registers, within a predetermined time (for example, within 5 seconds) after the authentication by the login authentication processing is successful, the feature information based on the face image when the face orientation of the face image detected by the face detection processing is frontal (an example of a specific orientation) as the HPD user ID.

[0153] As a result, when the information processing apparatus 1 uses the face image detected when the login authentication is successful as the face image of the regular user for face authentication, it can appropriately authenticate the face of the regular user because it uses the face image considering the face orientation for face authentication.

[0154] Further, when the HPD user ID is not registered, the main processing unit 300 causes the face detection unit 210 to execute the above user registration process regardless of the factor that caused the system to start up.

[0155] As a result, when the HPD user ID is not registered, the information processing apparatus 1 can register the face image of the regular user used for face authentication in response to the system starting up.

[0156] Moreover, the control method in the information processing apparatus 1 according to the present embodiment includes a step in which a face detection unit 210 (an example of a first processor) performs a face detection process of detecting a face image area (face area) in which a face is imaged from among captured images (for example, RGB images) captured by the imaging unit 120; a step in which the face detection unit 210 performs a face authentication process of performing face authentication based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on the face image of the regular user); a step in which the main processing unit 300 (an example of a second processor) starts up the system from the standby state by executing the program of the system based on the fact that the face area has been detected by the face detection process and the face authentication by the face authentication process has been successful; and a step in which the main processing unit 300 controls whether to cause the face detection unit 210 to execute a user registration process of registering the feature information based on the face image detected by the face detection process after the system starts up as the HPD user ID depending on whether the factor that caused the system to start up is due to an HID input (input to the HID) or not.

[0157] As a result, in the control method of the information processing apparatus 1, in a configuration where the system can be started by face-authenticating a legitimate user, whether to register the HPD user ID for face-authenticating the legitimate user based on the face image detected after the system is started is controlled according to whether the cause of the system startup is HID input, thereby suppressing the unnecessary registration of the HPD user ID after the system is started. Therefore, the information processing apparatus 1 can suppress the situation where a large number of face images of similar faces of the same person (legitimate user) are registered and the registration frame (memory capacity) is filled up, and can appropriately perform the registration of the face image of the legitimate user used for face authentication.

[0158] Also, the control method in the information processing apparatus 1 according to the present embodiment includes a step in which a face detection unit 210 (an example of a first processor) performs a face detection process of detecting a region (face region) of a face image in which a face is imaged from an imaged image (e.g., an RGB image) captured by the imaging unit 120, a step in which the face detection unit 210 performs a face authentication process of face-authenticating based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on a face image of a legitimate user), a step in which a main processing unit 300 (an example of a second processor) starts the system from a standby state by executing a system program based on the fact that the face region is detected by the face detection process and the face authentication by the face authentication process is successful, a step in which the main processing unit 300 determines whether a difference between the timing when an HID input is detected and the timing when the display of the display unit 110 is turned on in response to the startup of the system is within a predetermined time (e.g., within 0.5 seconds) when the system is started, and a step in which the main processing unit 300 causes the face detection unit 210 to execute a user registration process of registering the feature information based on the face image detected by the face detection process after the system is started as the HPD user ID when the determination result is true. The main processing unit 300 does not cause the face detection unit 210 to execute the user registration process when the determination result is false.

[0159] As a result, the control method in the information processing apparatus 1 can appropriately determine whether the startup factor of the system is an HID input, and can appropriately register the HPD user ID as a legitimate user based on the face image detected after the system startup only when the startup factor is an HID input. Therefore, it is possible to suppress the unnecessary registration of the HPD user ID after the system startup. Thus, the information processing apparatus 1 can suppress the situation where a large number of face images of similar faces of the same person (legitimate user) are registered and the registration frame (memory capacity) is filled up, and can appropriately register the face image of the legitimate user used for face authentication.

[0160] Also, the control method in the information processing apparatus 1 according to the present embodiment includes a step in which a face detection unit 210 (an example of a first processor) performs face detection processing to detect a region (face region) of a face image in which a face is imaged from an imaged image (for example, an RGB image) captured by an imaging unit 120, a step in which the face detection unit 210 performs face authentication processing for face authentication based on feature information (an example of information) based on the detected face image and an HPD user ID (an example of information based on a face image of a legitimate user), a step in which a main processing unit 300 (an example of a second processor) starts the system from a standby state by executing a system program, and a step in which when the main processing unit 300 starts the system, depending on whether the startup factor is due to the detection of the face image region by the face detection processing and the success of the face authentication by the face authentication processing, controls whether to cause the face detection unit 210 to execute user registration processing for registering the feature information based on the face image detected by the face detection processing after the system startup as the HPD user ID.

[0161] As a result, the control method in the information processing apparatus 1 controls whether to register the HPD user ID for face-authenticating a legitimate user based on the face image detected after startup, depending on whether the system has started up due to the approach of a legitimate user whose HPD user ID has already been registered. This can prevent the unnecessary registration of the HPD user ID after the system starts up. Therefore, the information processing apparatus 1 can prevent a large number of face images of similar faces of the same person (legitimate user) from being registered and filling up the registration frame (memory capacity), and can appropriately register the face images of the legitimate users used for face authentication.

[0162] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiments, and designs and the like within the scope not departing from the gist of the present invention are also included. For example, the respective configurations described in the above embodiments can be arbitrarily combined.

[0163] Note that the imaging unit 120 may include either an IR camera or an RGB camera. For example, a configuration may be adopted in which an IR camera is used in both the HPD process and the login authentication process, or a configuration may be adopted in which an RGB camera is used in both the HPD process and the login authentication process.

[0164] Also, the frame rate of the imaging unit 120 in each operating state and process is an example and is not limited to the examples of the frame rate described above.

[0165] In the above embodiment, a configuration example in which the imaging unit 120 is built into the information processing apparatus 1 has been described. However, the present invention is not limited to this. For example, the imaging unit 120 may not be built into the information processing apparatus 1, and may be configured to be attachable to the information processing apparatus 1 (for example, any of the sides 10a, 10b, 10c, etc.) as an external accessory of the information processing apparatus 1, and may be communicatively connected to the information processing apparatus 1 wirelessly or by wire.

[0166] Further, the CPU 301 (an example of the third processor) and the chipset 303 (an example of the second processor) may be configured as individual processors or may be integrated as one processor.

[0167] In the above embodiment, an example in which the face detection unit 210 (an example of the first processor) is provided separately from the chipset 303 has been shown. However, part or all of the face detection unit 210 may be provided in the chipset 303 or may be provided in a processor integrated with the chipset 303. Further, the face detection unit 210, the chipset 303, and the CPU 301 may be integrated as one processor. Also, part or all of the face detection unit 210 may be provided in the EC 200.

[0168] Further, the above-described standby state may include a hibernation state, a power-off state, or the like. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Note that the standby state, such as the standby state, the sleep state, the hibernation state, and the power-off state, is a state in which the power consumption is lower than that in the normal operation state (a state in which power consumption is suppressed).

[0169] Note that the above-described information processing apparatus 1 has a computer system inside. Then, a program for realizing the functions of each component included in the above-described information processing apparatus 1 is recorded on a computer-readable recording medium, and the program recorded on this recording medium is read into the computer system and executed, so that the processing in each component included in the above-described information processing apparatus 1 may be performed. Here, "reading the program recorded on the recording medium into the computer system and executing it" includes installing the program in the computer system. The "computer system" as used herein is assumed to include hardware such as an OS and peripheral devices. Further, the "computer system" may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, or dedicated line. Also, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, magneto-optical disk, ROM, CD-ROM, or a storage device such as a hard disk built into the computer system. Thus, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

[0170] Further, the recording medium also includes an internal or external recording medium provided so as to be accessible from a distribution server for distributing the program. Note that the program may be divided into a plurality of parts, downloaded at different timings, and then combined in each component included in the information processing apparatus 1, or the distribution servers for distributing the respective divided programs may be different. Furthermore, the "computer-readable recording medium" also includes a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network and holds the program for a certain period of time. Also, the above program may be for realizing a part of the above-described functions. Further, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

[0171] Further, some or all of the functions provided in the information processing apparatus 1 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be made into an individual processor, or some or all of them may be integrated and made into a processor. Further, the method of integrating into an integrated circuit is not limited to an LSI, and may be realized by a dedicated circuit or a general-purpose processor. Further, when a technology for integrating into an integrated circuit that replaces an LSI appears due to the progress of semiconductor technology, an integrated circuit using such technology may be used.

Description of Reference Numerals

[0172] 1 Information processing apparatus, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Storage unit, 200 EC, 210 Face detection unit, 211 Face detection processing unit, 212 Face authentication processing unit, 213 HPD user ID registration unit, 214 HPD processing unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Operation control unit, 312 Authentication processing unit, 330 HPD control processing unit, 331 Operation instruction unit, 332 HID input detection unit, 333 User registration control unit, 400 Power supply unit

Claims

1. A memory for temporarily storing a program of the system, a first processor that executes a face detection process for detecting a region of a face image in which a face is imaged from among captured images captured by an imaging unit, and a face authentication process for authenticating a face based on information based on the detected face image and information based on a face image of a regular user; a second processor that activates the system from a standby state by executing the program of the system based on the fact that the region of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful; comprising: wherein the second processor controls whether or not to cause the first processor to execute a user registration process of registering, as information based on the face image of the regular user, information based on the face image detected by the face detection process after activation of the system, depending on whether or not the cause of activation is an input to a HID (Human Interface Device) when the system is activated; an information processing apparatus.

2. wherein the second processor causes the first processor to execute the user registration process when the system is activated due to an input to the HID, and does not cause the first processor to execute the user registration process when the cause of activation is not an input to the HID; The information processing apparatus according to claim 1.

3. wherein the second processor determines that the cause of activating the system is an input to the HID when the difference between the timing at which an input to the HID is detected and the timing at which the display of the display unit is turned on in response to activation of the system is within a predetermined time; The information processing apparatus according to claim 1 or claim 2.

4. A memory for temporarily storing a program of the system, a first processor that executes a face detection process for detecting a region of a face image in which a face is imaged from among captured images captured by an imaging unit, and a face authentication process for authenticating a face based on information based on the detected face image and information based on a face image of a regular user; a second processor that activates the system from a standby state by executing the program of the system based on the fact that the region of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful; comprising: wherein the second processor When the system is started, it is determined whether the difference between the timing at which an input to a HID (Human Interface Device) is detected and the timing at which the display of the display unit is turned on in response to the startup of the system is within a predetermined time. If the determination result is true, the first processor is caused to execute user registration processing for registering information based on the face image detected by the face detection process after the startup of the system as information based on the face image of the legitimate user. If the determination result is false, the first processor is not caused to execute the user registration processing. Information processing apparatus.

5. A memory that temporarily stores a program of the system, A first processor that executes face detection processing for detecting a region of a face image in which a face is imaged from among the captured images captured by the imaging unit, and face authentication processing for performing face authentication based on information based on the detected face image and information based on the face image of the legitimate user, A second processor that starts the system from a standby state by executing the program of the system, Comprising: The second processor, When the system is started, depending on whether the cause of the startup is that the region of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful, it controls whether to cause the first processor to execute user registration processing for registering information based on the face image detected by the face detection process after the startup of the system as information based on the face image of the legitimate user. Information processing apparatus.

6. The second processor, When the system is started due to a cause other than the success of the face authentication by the face authentication process, the first processor is caused to execute the user registration processing. When the system is started based on the fact that the authentication result of the face authentication process has been successful, the first processor is not caused to execute the user registration processing. The information processing apparatus according to claim 5.

7. The second processor, After the startup of the system, it executes system authentication processing for authenticating whether it is a legitimate user by the processing of the system, The first processor, As the user registration processing, within a predetermined time after the authentication by the system authentication processing has been successful, it registers information based on the face image detected by the face detection process as information based on the face image of the legitimate user. The information processing apparatus according to claim 1, claim 4, or claim 5.

8. The first processor As the user registration process, within a predetermined time after the authentication by the system authentication process is successful, information based on a face image in which the face orientation in the face images detected by the face detection process is a specific orientation is registered as information based on the face image of the regular user. The information processing apparatus according to claim 7.

9. The second processor When the information based on the face image of the regular user is not registered, regardless of the factor that caused the system to start up, the first processor is made to execute the user registration process. The information processing apparatus according to claim 1, claim 4, or claim 5.

10. A control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor, a step in which the first processor performs a face detection process of detecting a region of a face image in which a face is imaged from among the captured images captured by an imaging unit; a step in which the first processor performs a face authentication process of performing face authentication based on information based on the detected face image and information based on a face image of a regular user; a step in which the second processor starts up the system from a standby state by executing the program of the system based on the fact that the region of the face image is detected by the face detection process and the face authentication by the face authentication process is successful; a step in which the second processor controls whether to cause the first processor to execute a user registration process of registering information based on a face image detected by the face detection process after the system is started up as information based on a face image of a regular user depending on whether the factor that caused the system to start up is due to an input to a HID (Human Interface Device); A control method including the above.

11. A control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor, a step in which the first processor performs a face detection process of detecting a region of a face image in which a face is imaged from among the captured images captured by an imaging unit; The step in which the first processor performs a face authentication process for face authentication based on information based on the detected face image and information based on the face image of the legitimate user; The step in which the second processor starts the system from the standby state by executing the program of the system based on the fact that the area of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful; The step in which the second processor determines whether or not the difference between the timing at which an input to the HID (Human Interface Device) is detected and the timing at which the display of the display unit is turned on in response to the startup of the system is within a predetermined time when the system is started; The step in which, when the determination result is true, the second processor causes the first processor to execute a user registration process of registering information based on the face image detected by the face detection process after the startup of the system as information based on the face image of the legitimate user; including; When the determination result is false, the second processor does not cause the first processor to execute the user registration process. Control method.

12. A control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor, The step in which the first processor performs a face detection process of detecting an area of a face image in which a face is imaged from the captured image captured by the imaging unit; The step in which the first processor performs a face authentication process for face authentication based on information based on the detected face image and information based on the face image of the legitimate user; The step in which the second processor starts the system from the standby state by executing the program of the system; The step in which, when the system is started, the second processor controls whether or not to cause the first processor to execute a user registration process of registering information based on the face image detected by the face detection process after the startup of the system as information based on the face image of the legitimate user depending on whether or not the cause of the startup is that the area of the face image has been detected by the face detection process and the face authentication by the face authentication process has been successful; A control method including.

Images