Information processing apparatus and control method

Abstract

To properly boot a system when a registered user approaches.SOLUTION: An information processing apparatus includes: a memory which temporarily stores a program of a system; a first processor which executes face authentication processing to detect an area of a face image of a face from a captured image captured by an imaging unit and to authenticate whether or not a person of the detected face image is a registered user, on the basis of information based on the detected face image and information based on a face image of the registered user; and a second processor which executes the program of the system to boot the system from a standby state, on the basis of authentication by the face authentication processing being successful. When the authentication by the face authentication processing is unsuccessful, the first processor executes the face authentication processing again, and when executing the face authentication processing repeatedly due to failures of the authentication by the face authentication processing, the first processor stops the face authentication processing on the basis of the number of times that the face authentication processing has been executed.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and a control method.

Background Art

[0002] There is an information processing apparatus that transitions to a usable state when a person approaches and transitions to a standby state in which some functions are stopped except when the person leaves. For example, in Patent Document 1, an infrared sensor is used to detect whether a person is approaching or moving away.

[0003] In recent years, with the development of computer vision and the like, the detection accuracy when detecting a face from an image has been increasing. Therefore, instead of detecting a person using an infrared sensor, detecting a person by face detection is becoming common. In addition, after the information processing apparatus is activated, login authentication for verifying whether the user is a registered user is performed, and face authentication is being used as this authentication method. For example, when a person approaches, the information processing apparatus activates by detecting the face of the person, and then, if the person is a registered user by performing login authentication such as face authentication, the system permits login and transitions to a usable state.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the method of activation by face detection as described above, there is a problem that it will be activated even when a person other than a registered user approaches. In order to solve this problem, when a person is detected by face detection, it is possible to further determine whether the person is a registered user by face authentication, and to activate only when it is determined that the person is a registered user. However, in the standby state before activation, it is necessary to keep the power consumption low, so the recognition rate at the time of face authentication decreases. When the recognition rate decreases, even if there is a low probability that an unregistered person will be erroneously determined to be a registered user, there is a possibility that this will occur. Therefore, when an unregistered person stays in front of the information processing apparatus for a long time, there has been a concern that an erroneous determination will occur during that time and the apparatus will be activated.

[0006] The present invention has been made in view of the above circumstances, and one of its objects is to provide an information processing apparatus and a control method capable of appropriately activating the system when a registered user approaches.

Means for Solving the Problems

[0007] The present invention has been made to solve the above problems, and an information processing apparatus according to a first aspect of the present invention includes a memory that temporarily stores a program of the system, and detects a region of a face image in which a face is imaged from the captured image captured by an imaging unit, and based on information based on the detected face image and information based on a face image of a registered user, a first processor that executes a face authentication process for authenticating whether the person in the detected face image is a registered user, and a second processor that activates the system from a standby state by executing the program of the system based on the fact that the authentication by the face authentication process has succeeded, and the first processor executes the face authentication process again when the authentication by the face authentication process fails, and stops based on the number of times the face authentication process has been executed when the face authentication process is repeatedly executed due to the failure of the authentication by the face authentication process.

[0008] In the above information processing apparatus, the first processor executes a person detection process for detecting the presence of a person by detecting a region of a face image in which a face is imaged from the captured image. When the presence of a person is detected by the person detection process, the process proceeds from the person detection process to the face authentication process. Based on the fact that the number of times the face authentication process has been executed since the presence of a person was detected by the person detection process has reached a preset number of times, the face authentication process may be stopped.

[0009] In the above information processing apparatus, when the first processor stops the face authentication process due to a failure in authentication by the face authentication process, the process may proceed to the person detection process.

[0010] In the above information processing apparatus, after the face authentication process is stopped, the first processor determines whether the number of persons present has changed when the presence of a person is detected by the person detection process. If it is determined that the number of persons present has changed, the process may proceed from the person detection process to the face authentication process again.

[0011] In the above information processing apparatus, when the presence of a person is no longer detected by the person detection process after the face authentication process is stopped, the first processor continues the person detection process without proceeding to the face authentication process, and when the presence of a person is detected, the process may proceed from the person detection process to the face authentication process.

[0012] In the above information processing apparatus, the person detection process may be a process that consumes less power than the face authentication process.

[0013] In the above information processing apparatus, the frame rate when detecting the region of the face image in which the face is imaged from the captured image in the person detection process is lower than that in the face authentication process, and the first processor may switch the frame rate when proceeding from the person detection process to the face authentication process and when proceeding from the face authentication process to the person detection process.

[0014] In the information processing apparatus, after the system is started up, the second processor executes a login authentication process for authenticating whether to permit login to the system based on a face image detected from among captured images captured by the imaging unit, and the face authentication process executed in the standby state before the system is started up may be a process with lower power consumption than the login authentication process.

[0015] In the information processing apparatus, the frame rate when detecting a region of a face image in which a face is imaged from among the captured images in the face authentication process executed in the standby state before the system is started up may be lower than that in the login authentication process.

[0016] In the information processing apparatus, the first processor may execute a user registration process for registering information based on a face image of a user who uses the information processing apparatus.

[0017] Also, a control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor according to a second aspect of the present invention includes: a step in which the first processor detects a region of a face image in which a face is imaged from among captured images captured by an imaging unit, and authenticates whether a person of the detected face image is a registered user based on information based on the detected face image and information based on a face image of a registered user; a step in which the second processor starts up the system from the standby state by executing the program of the system based on the fact that authentication by the face authentication process has succeeded; a step in which the first processor executes the face authentication process again when authentication by the face authentication process has failed; and a step in which the first processor stops based on the number of times the face authentication process has been executed when the face authentication process is repeatedly executed due to failure of authentication by the face authentication process.

Effects of the Invention

[0018] According to the above aspect of the present invention, the system can be appropriately activated when a registered user approaches.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0020] Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, the outline of the information processing apparatus according to the present embodiment will be described. The information processing apparatus 1 according to the present embodiment is, for example, a notebook (clamshell type) PC (Personal Computer). Note that the information processing apparatus 1 may be any form of information processing apparatus such as a desktop PC, a tablet PC, or a smartphone.

[0021] The information processing apparatus 1 can transition between at least a normal operation state (power-on state) and a standby state as the operation state of the system. The normal operation state is an operation state in which processing can be executed without particular limitation, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface). The standby state is a state in which at least a part of the system processing is restricted. For example, the standby state may be a standby state, a sleep state, etc., and may be a state corresponding to modern standby in Windows (registered trademark), the S3 state (sleep state) defined by ACPI, etc. For example, the standby state is an operation state with a lower power consumption than the normal operation state.

[0022] Hereinafter, the transition of the operation state of the system from the standby state to the normal operation state may be referred to as activation. In the standby state, since the degree of operation activity is generally lower than that in the normal operation state, activating the system of the information processing apparatus 1 means activating the operation of the system in the information processing apparatus 1.

[0023] FIG. 1 is a diagram for explaining the outline of the HPD process of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 detects a person (i.e., a user) existing in the vicinity of the information processing apparatus 1. The process of detecting the presence of this person is referred to as HPD (Human Presence Detection) process. The information processing apparatus 1 detects the presence or absence of a person by the HPD process, and controls the operation state of the system of the information processing apparatus 1 based on the detection result. For example, as shown in FIG. 1(A), when the information processing apparatus 1 detects a change from a state (Absence) where no person exists in front (front side) of the information processing apparatus 1 to a state (Presence) where a person exists, that is, when it detects that a person has approached the information processing apparatus 1 (Approach), it determines that the user has approached, and automatically starts the system and transitions to the normal operation state. Further, as shown in FIG. 1(B), when a person exists in front of the information processing apparatus 1 (Presence), the information processing apparatus 1 determines that the user exists and continues the normal operation state. Then, as shown in FIG. 1(C), when the information processing apparatus 1 detects a change from a state (Presence) where a person exists in front (front side) of the information processing apparatus 1 to a state (Absence) where no person exists, that is, when it detects that a person has left the information processing apparatus 1 (Leave), it determines that the user has left, and transitions the system to the standby state.

[0024] The information processing apparatus 1 detects the presence of a person in a predetermined range in the front (front side). FIG. 2 is a diagram showing an example of the detection range of a person by the information processing apparatus 1 according to the present embodiment. In the illustrated example, the detection range FoV (Field of View: detection visual field angle) on the front (front side) of the information processing apparatus 1 is the range where a person can be detected. For example, the information processing apparatus 1 detects a person existing in front (front side) of the information processing apparatus 1 by detecting an area of a face image (hereinafter referred to as "face area") in which a face is imaged from a captured image of the front (front side). The detection range FoV corresponds to the imaging angle of the captured image captured by the information processing apparatus 1. When the information processing apparatus 1 detects a face area from the captured image, it determines that a person exists. On the other hand, when the information processing apparatus 1 does not detect a face area from the captured image, it determines that no person exists.

[0025] Here, when the information processing apparatus 1 starts the system from the standby state only by detecting the face area from the captured image in the HPD process, the system will be started even when a person other than the legitimate user who uses the information processing apparatus 1 approaches. Therefore, when the information processing apparatus 1 determines that a person exists by detecting the face area from the captured image in the standby state, it further determines (authenticates) whether the person is a registered user (the legitimate user who uses the information processing apparatus 1). When the information processing apparatus 1 determines that the person is a registered user, it starts the system from the standby state. On the other hand, when the information processing apparatus 1 determines that the person is not a registered user, it remains in the standby state without starting the system.

[0026] A registered user is a user (legitimate user) who has been registered in advance as a user who uses the information processing apparatus 1. In order to authenticate whether the person detected in the HPD process is a registered user, the information processing apparatus 1 registers the feature information based on the face image of this legitimate user as the user ID of the legitimate user. The user ID used for authentication in this HPD process is hereinafter referred to as the "HPD user ID". Also, the authentication of whether the person detected in the HPD process is a registered user using the HPD user ID is hereinafter referred to as "HPD user authentication".

[0027] The registration of the HPD user ID may be performed in the information processing apparatus 1 using an application (application program) for user registration. For example, the information processing apparatus 1 may execute an application for user registration, capture a face image of the user himself / herself by the operation of the user with the executed application, and register (store) the feature information based on the captured face image as the HPD user ID. Also, the registration of this HPD user ID may be performed by the information processing apparatus 1 at a predetermined timing without the user's operation. For example, the information processing apparatus 1 may register (store) the feature information based on a face image (for example, a face image when facing forward) detected within a predetermined time (for example, within 5 seconds) after successful authentication in the login authentication for permitting login to the system at the time of system startup as the HPD user ID.

[0028] As methods for the system's login authentication, there are password authentication in which the user inputs a password from the keyboard for authentication, PIN authentication in which the user inputs a PIN (Personal Identification Number) for authentication, face authentication in which the user's face is authenticated, fingerprint authentication in which the user's fingerprint is authenticated, and the like.

[0029] Here, when face authentication is used for the system's login authentication, since the system is operating and high-precision face authentication is required, it allows for increased power consumption. On the other hand, when performing HPD user authentication, since the system is in a standby state, it is desirable to minimize power consumption. For example, in the case of face authentication in login authentication, an imaging image (IR image) captured by an IR (Infrared Rays) camera is used, but in HPD user authentication in the standby state, an imaging image (RGB image) captured by an RGB camera (ordinary visible light camera) with lower power consumption than the IR camera is used. Also, the frame rate for capturing an imaging image in HPD user authentication is set lower than the frame rate for capturing an imaging image in login authentication.

[0030] Thus, since the HPD user authentication in the standby state needs to suppress power consumption lower than that of face authentication in login authentication, the recognition rate of face authentication decreases. When the recognition rate decreases, even if it is correctly determined that the user is a registered user with a probability of about 80% for example among the registered persons, there is a possibility that an unregistered person may be misjudged as a registered user with a probability of about 0 to 40% for example. If an unregistered person exists for a long time, if even one misjudgment occurs during that time, the system will start up, so there is a concern that an unregistered person may accidentally start up.

[0031] Therefore, when the authentication by the HPD user authentication succeeds, the information processing apparatus 1 according to the present embodiment starts up the system from the standby state. However, when the authentication by the HPD user authentication fails, although the HPD user authentication is continued, when the authentication failures continue, the number of times of repeatedly executing the HPD user authentication is limited.

[0032] With reference to FIG. 3, the outline of the HPD process for starting up the system when a registered user is detected using the HPD user authentication by the information processing apparatus 1 will be described. FIG. 3 is a flowchart showing the outline of the HPD process according to the present embodiment.

[0033] The information processing apparatus 1 executes a person detection process for detecting the presence of a person by detecting a face area (face detection) from a captured image obtained by capturing the detection range FoV (see FIG. 2) in the standby state (step S11). When the information processing apparatus 1 detects the presence of a person in step S11, it proceeds to step S13.

[0034] In step S13, the information processing apparatus 1 transitions from the person detection process to the HPD user authentication process. In the HPD user authentication process, the information processing apparatus 1 detects a face region (face detection) from a captured image obtained by imaging the detection range FoV (see FIG. 2), and determines (authenticates) whether the detected person is a registered user based on the feature information based on the detected face image and the registered HPD user ID (feature information based on the face image of the registered user). If the information processing apparatus 1 authenticates successfully in step S13 (determines that the detected person is a registered user), it activates the system (step S15).

[0035] On the other hand, if the information processing apparatus 1 fails authentication in step S13 (determines that the detected person is not a registered user), it proceeds to step S17.

[0036] In step S17, the information processing apparatus 1 determines whether the number of times the HPD user authentication process has been executed due to authentication failure has reached the upper limit. If the information processing apparatus 1 determines that the upper limit has not been reached (NO), it returns to step S13 and executes the HPD user authentication process again. On the other hand, if the information processing apparatus 1 determines that the number of times the HPD user authentication process has been executed due to authentication failure has reached the upper limit (YES), it stops the HPD user authentication process (step S19). The upper limit number of times for stopping the HPD user authentication process is set in advance, and as an example, it is "10 times" or the like. Note that after stopping the HPD user authentication process, the information processing apparatus 1 executes the person detection process.

[0037] In this way, when the authentication by the HPD user authentication process fails, the information processing apparatus 1 executes the HPD user authentication process again, and when the HPD user authentication process is repeatedly executed due to authentication failure, the HPD user authentication process is stopped based on the fact that the number of executions has reached the upper limit (predetermined number of times).

[0038] As a result, the information processing apparatus 1 can prevent itself from misjudging an unregistered person as a registered user and starting up unintentionally. Therefore, when a registered user approaches, the information processing apparatus 1 can appropriately start up the system.

[0039] Next, the configuration of the information processing apparatus 1 according to the present embodiment will be described in detail. [External Configuration of Information Processing Apparatus] FIG. 4 is a perspective view showing a configuration example of the external appearance of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are coupled using the hinge mechanism 15. The first housing 10 is relatively rotatable about the rotation axis formed by the hinge mechanism 15 with respect to the second housing 20. The opening angle formed by the rotation of the first housing 10 and the second housing 20 is illustrated as “θ”.

[0040] The first housing 10 is also referred to as an A cover or a display housing. The second housing 20 is also referred to as a C cover or a system housing. In the following description, among the side surfaces of the first housing 10 and the second housing 20, the surfaces provided with the hinge mechanism 15 are respectively referred to as side surfaces 10c and 20c. Among the side surfaces of the first housing 10 and the second housing 20, the surfaces opposite to the side surfaces 10c and 20c are respectively referred to as side surfaces 10a and 20a. In the drawing, the direction from the side surface 20a to the side surface 20c is referred to as “rear”, and the direction from the side surface 20c to the side surface 20a is referred to as “front”. The right side and the left side with respect to the rear are respectively referred to as “right” and “left”. The left side surfaces of the first housing 10 and the second housing 20 are respectively referred to as side surfaces 10b and 20b, and the right side surfaces are respectively referred to as side surfaces 10d and 20d. Also, the state in which the first housing 10 and the second housing 20 overlap and are completely closed (the state where the opening angle θ = 0°) is referred to as the “closed state”. In the closed state, the surfaces of the first housing 10 and the second housing 20 facing each other are respectively referred to as their “inner surfaces”, and the surfaces opposite to the inner surfaces are referred to as “outer surfaces”. Also, the state in which the first housing 10 and the second housing 20 are open with respect to the closed state is referred to as the “open state”.

[0041] The appearance of the information processing apparatus 1 shown in FIG. 4 shows an example of the open state. The open state is a state in which the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing apparatus 1, and typically it is often used in a state where the opening angle θ is about 100 to 130°. Note that the range of the opening angle θ in the open state can be arbitrarily determined according to the range of the angle that can be rotated by the hinge mechanism 15 and the like.

[0042] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. Further, an imaging unit 120 is provided in a region at the periphery of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed in a region at the periphery of the display unit 110 on the side surface 20a side. Note that the position where the imaging unit 120 is disposed is an example, and it may be disposed at other positions as long as it is possible to image the direction (front) facing the inner surface of the first housing 10.

[0043] The imaging unit 120 images a predetermined imaging range in the direction (front) facing the inner surface of the first housing 10 in the open state. The predetermined imaging range is a range of the angle of view determined by the imaging element included in the imaging unit 120 and the optical lens provided in front of the imaging surface of the imaging element, and corresponds to the detection range FoV of the person (face) shown in FIG. 2. For example, the imaging unit 120 can image an image including a person (for example, a user) existing in front (front side) of the information processing apparatus 1.

[0044] On the side surface 20b of the second housing 20, a power button 140 is provided. The power button 140 is an operator for the user to instruct operations such as turning the power on or off, transitioning from the standby state to the normal operation state, and transitioning from the normal operation state to the standby state. Also, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices for receiving user operation inputs. Note that, as input devices, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided, or a mouse or an external keyboard may be connected. In the case of a configuration with a touch sensor, a region corresponding to the display surface of the display unit 110 may be configured as a touch panel that receives operations. Also, the input device may include a microphone for inputting sound.

[0045] [Hardware Configuration of Information Processing Apparatus] FIG. 5 is a schematic block diagram showing an example of the hardware configuration of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400. The display unit 110 displays display data (image) generated based on system processing executed by the main processing unit 300 and processing of application programs operating on the system processing.

[0046] The imaging unit 120 captures an image of an object within a predetermined angle of view (for example, the detection range FoV shown in FIG. 2) in the direction (front) facing the inner surface of the first housing 10, and outputs the captured image to the face detection unit 210 and the main processing unit 300. For example, the imaging unit 120 includes an RGB camera and an IR (Infrared Rays) camera. The RGB camera is a normal camera that captures images based on visible light. The IR camera is a camera that captures images using infrared rays, and captures images based on the infrared rays irradiated and reflected by an object when capturing images.

[0047] Since an IR camera irradiates infrared rays when imaging, for example, the power consumption during imaging is higher than that of an RGB camera. Therefore, when detecting a face region from a captured image and performing face authentication in the standby state, an RGB camera, for example, is used instead of an IR camera in order to minimize the standby power. On the other hand, when detecting a face region from a captured image and performing face authentication in login authentication, an IR camera, for example, is used to enhance the authentication accuracy. Note that both an IR camera and an RGB camera may be used during login authentication by face authentication.

[0048] The power button 140 outputs an operation signal to the EC 200 according to the user's operation. The input device 150 is an input unit that receives user input, and includes, for example, a keyboard 151 and a touch pad 153. The input device 150 outputs an operation signal indicating the operation content to the EC 200 in response to receiving an operation on the keyboard 151 and the touch pad 153.

[0049] The communication unit 160 is communicably connected to other devices via a communication network, either wirelessly or wired, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0050] The storage unit 170 includes storage media such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), a RAM (Random Access Memory), and a ROM (Read Only Memory). The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0051] The power supply unit 400 supplies power to each part of the information processing apparatus 1 according to the operating state of each part. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into the voltage required by each part. The power whose voltage has been converted by the DC / DC converter is supplied to each part via each power supply system. For example, the power supply unit 400 supplies power to each part via each power supply system based on the control signal input from the EC 200.

[0052] The EC 200 is a microcomputer configured to include a CPU (Central Processing Unit), a RAM, a ROM, and an I / O (Input / Output) logic circuit, etc. The CPU of the EC 200 reads out the control program (firmware) prestored in its own ROM and executes the read control program to exhibit its functions. The EC 200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. Further, the EC 200 is connected to the power button 140, the input device 150, the power supply unit 400, etc.

[0053] For example, the EC 200 communicates with the power supply unit 400 to acquire information on the state of the battery (remaining capacity, etc.) from the power supply unit 400, and outputs control signals, etc. for controlling the supply of power according to the operating state of each part of the information processing apparatus 1 to the power supply unit 400. Further, the EC 200 acquires operation signals from the power button 140 and the input device 150, and outputs the operation signals related to the processing of the main processing unit 300 among the acquired operation signals to the main processing unit 300.

[0054] The face detection unit 210 includes a processor that processes the image data of the captured image captured by the imaging unit 120. The face detection unit 210 acquires the image data of the captured image captured by the imaging unit 120, and temporarily stores the acquired image data in a memory. The memory for storing the image data may be the system memory 304 or a memory (not shown) within the face detection unit 210.

[0055] The face detection unit 210 performs an HPD process for detecting the presence of a person and authenticating whether the person is a registered user by performing a face detection process for detecting a face region from the captured image by processing the image data of the captured image acquired from the imaging unit 120, a face authentication process for authenticating the face image of the detected face region, and the like. For example, in the HPD process in the standby state, the face detection unit 210 performs a person detection process for detecting the presence of a person by detecting a face region from the captured image captured by the RGB camera of the imaging unit 120. Also, in the HPD process in the standby state, when the presence of a person is detected by the person detection process, the face detection unit 210 detects a face region from the captured image captured by the RGB camera of the imaging unit 120, and performs an HPD user authentication process for authenticating whether the detected person is a registered user by the face authentication process.

[0056] Also, when the system is started from the standby state, the face detection unit 210 performs a face detection process and a face authentication process for detecting a face region from the captured image captured by the IR camera of the imaging unit 120 for system login authentication. Also, in the normal operation state, the face detection unit 210 may perform processing using the captured image captured by the IR camera of the imaging unit 120 even when performing the HPD process.

[0057] The face detection unit 210 transmits the detection result by the HPD process, the authentication result of the face authentication process for login, etc. to the chipset 303 of the main processing unit 300. The functional configuration regarding the HPD process will be described in detail later.

[0058] The main processing unit 300 is configured to include a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304. Through system processing based on the OS (Operating System), various application programs can be executed on the OS.

[0059] The CPU 301 executes processing by the BIOS, processing by the OS, processing by application programs operating on the OS, etc. The CPU 301 controls the operating state of the system based on instructions from the chipset 303, etc. For example, the CPU 301 executes a startup process to start the system from the standby state. Also, after startup from the standby state, the CPU 301 executes a login authentication process to perform user authentication on whether to permit login to the system, and when the authentication is successful, it transitions to the normal operating state. For example, the CPU 301 executes an authentication process by face authentication in the login authentication. Note that the CPU 301 may execute an authentication process other than face authentication (e.g., password authentication, PIN authentication, fingerprint authentication, etc.) in the login authentication.

[0060] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing based on the control of the CPU 301 to generate display data. The GPU 302 outputs the generated display data to the display unit 110.

[0061] The chipset 303 has functions such as a memory controller function and an I / O controller function. For example, the chipset 303 controls the reading and writing of data from the system memory 304 by the CPU 301 and GPU 302, the storage unit 170, etc. Also, the chipset 303 controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. Further, the chipset 303 has a function as a sensor hub. For example, in the HPD process, the chipset 303 acquires the detection results of the person detection process, the authentication results of the HPD user authentication process, the authentication results of the face authentication process for login, etc. from the face detection unit 210, and gives instructions on the operating state of the system based on the detection results.

[0062] The system memory 304 is used as a loading area for programs executed by the CPU 301 and a working area for writing processing data. Also, the system memory 304 temporarily stores the image data of the captured image captured by the imaging unit 120.

[0063] Note that the CPU 301, GPU 302, and chipset 303 may be configured as one integrated processor, or some or each of them may be configured as individual processors. For example, in the normal operating state, all of the CPU 301, GPU 302, and chipset 303 are operating, but in the standby state, only at least a part of the chipset 303 is operating. In the standby state, at least the functions necessary for the HPD process at startup are operating.

[0064] [Functional Configuration of Information Processing Apparatus] Next, the functional configuration in which the information processing apparatus 1 controls the operating state of the system by the HPD process will be described.

[0065] FIG. 6 is a block diagram showing an example of the functional configuration of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 includes a face detection unit 210, a system processing unit 310, and an HPD control processing unit 330. The face detection unit 210 corresponds to the face detection unit 210 shown in FIG. 5 and is a functional configuration realized by executing a program in the face detection unit 210. The system processing unit 310 and the HPD control processing unit 330 are functional configurations realized by the main processing unit 300 shown in FIG. 5 executing an OS and a program operating on the OS. For example, the system processing unit 310 is a functional configuration realized by the CPU 301 executing a program of the OS. Further, the HPD control processing unit 330 is a functional configuration realized by the chipset 303 executing a program operating on the OS.

[0066] The face detection unit 210 includes a face detection processing unit 211, a face authentication processing unit 212, an HPD user ID registration unit 213, and an HPD processing unit 214. The system processing unit 310 includes an operation control unit 311 and an authentication processing unit 312. The HPD control processing unit 330 includes an operation instruction unit 331 and an authentication result notification unit 332.

[0067] The face detection processing unit 211 reads out the image data of the captured image captured by the imaging unit 120 at a predetermined frame rate (predetermined frequency) from the system memory 304, and detects a face region from each of the captured images. As a face detection method, any detection method can be applied, such as a face detection algorithm that detects a face based on face feature information, face detection using learning data (trained model) or a face detection library that is machine-learned based on face feature information.

[0068] Also, the frame rate when the imaging unit 120 performs imaging is controlled, for example, to 1 fps when performing face detection processing for detecting the presence of a person in the standby state, and to 4 fps when performing HPD user authentication processing for authenticating whether the detected person is a registered user. Also, the frame rate when the imaging unit 120 performs imaging is controlled, for example, to 15 fps when starting up from the standby state and performing login authentication processing, and to 1 fps in the normal operation state after the login authentication processing.

[0069] For example, when performing face detection processing for detecting the presence of a person in the standby state, the face detection processing unit 211 detects a face region from the captured image (RGB image) captured at 1 fps using the RGB camera of the imaging unit 120. Also, for example, when performing HPD user authentication processing, the face detection processing unit 211 detects a face region from the captured image (RGB image) captured at 4 fps using the RGB camera of the imaging unit 120. Also, for example, when performing login authentication after startup, the face detection processing unit 211 detects a face region from the captured image (IR image) captured at 15 fps using the IR camera of the imaging unit 120. Note that the face detection processing unit 211 may detect a face region from the captured images (IR image and RGB image) captured using the IR camera and the RGB camera of the imaging unit 120 during login authentication.

[0070] The face authentication processing unit 212 executes face authentication processing for performing face authentication based on the face image within the detected face region. For example, when performing HPD user authentication processing, the face authentication processing unit 212 performs face authentication processing based on the feature information based on the face image of the face region detected by the face detection processing unit 211 from the captured image (RGB image) captured at 4 fps using the RGB camera of the imaging unit 120, and the feature information based on the face image of the registered user registered as the HPD user ID.

[0071] Also, during the login authentication after startup, the face authentication processing unit 212 performs face authentication by comparing the face image detected from the captured images (IR images) captured at 15 fps using the IR camera of the imaging unit 120 with the face images of users registered in advance as user information (account information) for logging in to the system. Specifically, for example, during login authentication, the face authentication processing unit 212 performs face authentication by comparing the feature information based on the face image detected from the captured image (IR image) with the feature information based on the face images of users registered in advance.

[0072] Note that the face images of users registered as user information (account information) for logging in are, for example, face images detected from the captured images (IR images) captured at 15 fps using the IR camera of the imaging unit 120 in the registration menu for face authentication images in the system settings.

[0073] The HPD user ID registration unit 213 registers the HPD user ID used for HPD user authentication. For example, the HPD user ID registration unit 213 stores and registers the HPD user ID in the system memory 304 or a memory (not shown) within the face detection unit 210. As described above, the registration of the HPD user ID may be performed in the information processing apparatus 1 using an application (application program) for user registration, or may be performed by the information processing apparatus 1 at a predetermined timing without the user's operation.

[0074] For example, the HPD user ID registration unit 213 registers, as the HPD user ID, the feature information based on the face image of the user himself / herself captured by the user's operation in the user registration application. Also, for example, the HPD user ID registration unit 213 may register, as the HPD user ID, the feature information based on the face image (e.g., the face image when facing forward) detected by the face detection processing unit 211 within a predetermined time (e.g., within 5 seconds) after the authentication by the login authentication processing is successful. When registering the HPD user ID, the HPD user ID registration unit 213 newly registers it if the HPD user ID has not been registered, and updates the registered HPD user ID if the HPD user ID has already been registered.

[0075] The HPD processing unit 214 outputs information indicating the detection result of the HPD processing based on the detection result of the face detection processing by the face detection processing unit 211 and the authentication result of the face authentication processing by the face authentication processing unit 212. For example, in the standby state, the HPD processing unit 214 executes a person detection process for detecting the presence of a person based on the detection result of the face detection processing by the face detection processing unit 211. When a face area is detected from the captured image (RGB image) by the face detection processing unit 211, the HPD processing unit 214 detects the presence of a person, that is, determines that a person is present (Presence = true). On the other hand, when no face area is detected from the captured image (RGB image) by the face detection processing unit 211, the HPD processing unit 214 determines that no person is present (Presence = false).

[0076] Also, when the presence of a person is detected by the person detection process, the HPD processing unit 214 shifts from the person detection process to the HPD user authentication process. For example, the HPD processing unit 214 determines whether the person in the detected face image is a registered user based on the authentication result of the HPD user authentication in which the face authentication processing unit 212 performs the face authentication process based on the feature information based on the face image of the face area detected from the captured image (RGB image) by the face detection processing unit 211 and the HPD user ID.

[0077] When the authentication result of the HPD user authentication is successful authentication, the HPD processing unit 214 outputs presence information indicating that a registered user exists in front of the information processing apparatus 1 to the HPD control processing unit 330.

[0078] On the other hand, when the authentication result of the HPD user authentication is authentication failure, the HPD processing unit 214 executes the HPD user authentication process again, and when the authentication failure continues, the HPD user authentication process is repeatedly executed. However, when the HPD processing unit 214 repeatedly executes the HPD user authentication process due to authentication failure, the HPD user authentication process is stopped based on the fact that the number of times the HPD user authentication process has been executed has reached a preset number of times (for example, 10 times). When the HPD processing unit 214 stops the HPD user authentication process, it proceeds to the person detection process.

[0079] Here, when the HPD processing unit 214 stops the HPD user authentication process and proceeds to the person detection process, although it is a person other than the registered user, it detects the presence of a person, that is, determines that a person exists (Presence = true). When the presence of a person is detected by the person detection process after the HPD processing unit 214 stops the HPD user authentication process, the HPD processing unit 214 determines whether the number of existing persons has changed. When the HPD processing unit 214 determines that the number of existing persons has changed, since there may be a registered user present, it proceeds from the person detection process to the HPD user authentication process again.

[0080] Note that even when the number of existing persons has changed, if the presence of a person is no longer detected, the HPD processing unit 214 determines that no person exists (Presence = false), and continues the person detection process without proceeding to the HPD user authentication process. Again, when the presence of a person is detected by the person detection process, the HPD processing unit 214 determines that a person exists (Presence = true), and proceeds from the person detection process to the HPD user authentication process.

[0081] Note that when the HPD processing unit 214 detects that a registered user exists within the detection range FoV, it outputs presence information to the HPD control processing unit 330. However, when it does not detect the presence of a person within the detection range FoV, it outputs absence information indicating that no user exists in front of the information processing apparatus 1 to the HPD control processing unit 330. Further, the HPD processing unit 214 also outputs absence information to the HPD control processing unit 330 when it determines that the person detected within the detection range FoV is not a registered user even though the presence of the person has been detected.

[0082] When the operation instruction unit 331 acquires the presence information output from the HPD processing unit 214 in the standby state, it issues an instruction to start the system from the standby state. For example, the operation instruction unit 331 outputs startup instruction information indicating an instruction to start the system from the standby state to the operation control unit 311. Also, while the operation instruction unit 331 is acquiring absence information from the HPD processing unit 214 in the standby state, it does not issue an instruction to start the system.

[0083] Note that when the operation instruction unit 331 acquires absence information from the HPD processing unit 214 in the normal operation state, it issues an instruction to transition the system to the standby state. For example, the operation instruction unit 331 outputs standby instruction information indicating an instruction to transition the system to the standby state to the operation control unit 311.

[0084] When the operation control unit 311 acquires the startup instruction information output from the operation instruction unit 331, it executes the system program to start the system from the standby state. Also, after starting from the standby state, the operation control unit 311 generates a login authentication event. Then, the operation control unit 311 waits without permitting login until authentication is successful. When authentication is successful, the operation control unit 311 permits login and transitions to the normal operation state.

[0085] In the normal operation state, when the operation control unit 311 acquires the standby instruction information output from the operation instruction unit 331, it transitions the system from the normal operation state to the standby state.

[0086] When an event of login authentication occurs, the authentication processing unit 312 executes the login authentication process of the system. For example, the authentication processing unit 312 executes the login authentication process by any one of face authentication, password authentication, PIN authentication, or fingerprint authentication. For example, when the authentication processing unit 312 executes the authentication process by face authentication, it acquires the authentication result of face authentication from the face detection unit 210 and executes the login authentication process based on the acquired authentication result. The authentication processing unit 312 determines that the user is a legitimate user when the authentication result of the login authentication process is authentication success, and determines that the user is not a legitimate user when the authentication fails.

[0087] In addition, in the case of password authentication or PIN authentication, the authentication processing unit 312 acquires an operation signal based on the user's operation on the keyboard 151 via the EC200. Then, the authentication processing unit 312 executes the authentication process by collating the password or PIN input by the user's operation with the pre-registered password or PIN based on the acquired operation signal. Also, in the case of fingerprint authentication, the authentication processing unit 312 executes the authentication process by collating the fingerprint acquired using a fingerprint sensor (not shown) with the pre-registered fingerprint.

[0088] The authentication result notification unit 332 may notify the face detection unit 210 of the authentication result of the login authentication by the authentication processing unit 312. Then, the HPD user ID registration unit 213 of the face detection unit 210 may register the feature information based on the face image when facing forward within a predetermined time (for example, within 5 seconds) after the authentication by the login authentication process is successful, triggered by the notification of the authentication result of this login authentication.

[0089] [Operations by HPD Processing] Next, with reference to FIG. 7, the operation of the HPD process in the standby state will be described. FIG. 7 is a flowchart showing an example of the HPD process in the standby state according to the present embodiment.

[0090] (Step S101) The face detection unit 210 acquires a captured image (RGB image) captured using the RGB camera of the imaging unit 120 in the standby state. For example, the face detection unit 210 acquires a captured image (RGB image) captured by the imaging unit 120 at a frame rate of 1 fps. Then, the face detection unit 210 executes a person detection process for detecting the presence of a person by detecting a face region from the captured image (RGB image) for each frame. Here, it is assumed that initially, no person is present (Presence = false) in the standby state. Then, the process proceeds to the process of step S103.

[0091] (Step S103) The face detection unit 210 determines whether the presence of a person has been detected by the person detection process in step S101. When the face detection unit 210 does not detect a face region from the captured image (RGB image), it determines that no person is present (Presence = false) (NO), and returns to the process of step S101. On the other hand, when the face detection unit 210 detects a face region from the captured image (RGB image), it determines that a person is present (Presence = true) (YES), and the process proceeds to the process of step S105.

[0092] (Step S105) The face detection unit 210 sets a counter for counting the number of executions n of the HPD user authentication process to "n = 0" and starts counting. Then, the process proceeds to the process of step S107.

[0093] (Step S107) The face detection unit 210 switches the frame rate of the imaging unit 120 to 4 fps and shifts from the person detection process to the HPD user authentication process. The face detection unit 210 acquires the captured image (RGB image) captured by the imaging unit 120 at a frame rate of 4 fps. The face detection unit 210 detects a face area from the captured image (RGB image) for each frame, and based on the feature information based on the detected face image and the HPD user ID (feature information based on the face image of a registered user), it authenticates whether the person in the detected face image is a registered user. Then, it proceeds to the process of step S109.

[0094] (Step S109) The face detection unit 210 determines whether the authentication result by the HPD user authentication process in step S107 is a successful authentication. If the face detection unit 210 determines that the authentication is successful (YES), it proceeds to the process of step S111. On the other hand, if the face detection unit 210 determines that the authentication has failed (NO), it proceeds to the process of step S115.

[0095] (Step S111) When it is determined in step S109 that the authentication is successful, the face detection unit 210 outputs the presence information to the HPD control processing unit 330. When the HPD control processing unit 330 acquires the presence information output from the face detection unit 210, as a startup instruction by the HPD process, it outputs startup instruction information indicating an instruction to start the system from the standby state to the system processing unit 310. When the system processing unit 310 acquires the startup instruction information output from the HPD control processing unit 330, it executes the system program and starts the system from the standby state.

[0096] Note that when there is a startup instruction other than the startup instruction by the HPD process, the system processing unit 310 interrupts the HPD process in this standby state and starts the system. A startup instruction other than the startup instruction by the HPD process is, for example, an input (operation) to an HID (Human Interface Device) such as the input device 150 or the power button 140.

[0097] (Step S113) After the system processing unit 310 starts the system from the standby state in step S111, it executes login authentication processing. For example, the system processing unit 310 executes authentication processing by any one of face authentication, password authentication, PIN authentication, or fingerprint authentication. When the system processing unit 310 succeeds in authentication by the login authentication processing, it permits login and makes a transition to the normal operation state.

[0098] (Step S115) When it is determined in step S109 that the authentication has failed, the face detection unit 210 adds 1 to a counter that counts the number of executions n of the HPD user authentication processing (n = n + 1), and proceeds to the processing of step S117.

[0099] (Step S117) The face detection unit 210 determines whether the number of executions n of the HPD user authentication processing is less than 10 (n < 10). When the face detection unit 210 determines that the number of executions n of the HPD user authentication processing is less than 10 (YES), it returns to the processing of step S107 and executes the HPD user authentication processing again. On the other hand, when the face detection unit 210 determines that the number of executions n of the HPD user authentication processing has reached 10 (NO), it proceeds to the processing of step S119.

[0100] (Step S119) The face detection unit 210 stops the HPD user authentication processing, switches the frame rate of the imaging unit 120 to 1 fps, and shifts to person detection processing. The face detection unit 210 acquires a captured image (RGB image) captured by the imaging unit 120 at a frame rate of 1 fps. Then, the face detection unit 210 executes person detection processing for detecting the presence of a person by detecting a face region from the captured image (RGB image) for each frame. Here, it is in a state where a person other than a registered user exists (Presence = true). Then, it proceeds to the processing of step S121.

[0101] (Step S121) The face detection unit 210 determines whether the number of persons detected in step S119 has changed. If the face detection unit 210 determines that the detected number of persons has not changed (NO), it returns to the process of step S119 and executes the person detection process again. On the other hand, if the face detection unit 210 determines that the detected number of persons has changed (YES), it proceeds to the process of step S123.

[0102] (Step S123) The face detection unit 210 determines whether the number of persons detected in step S119 is 1 or more. If the face detection unit 210 determines that the detected number of persons is 1 or more (YES), assuming that there may be registered users, it returns to the process of step S105, sets the execution count n of the HPD user authentication process to "n = 0", resumes counting, proceeds to the process of step S107, and executes the HPD user authentication process again. On the other hand, if the face detection unit 210 determines that the detected number of persons has become 0 (i.e., no person exists) (NO), it returns to the process of step S101 and continues to execute the person detection process in a state where no person exists (Presence = false).

[0103] In the example of the HPD process shown in FIG. 7, an example in which the HPD user authentication process is stopped based on the fact that the number of times the HPD user authentication process has been executed has reached 10 times after the presence of a person has been detected by the person detection process has been described. However, the number of times the HPD user authentication process is stopped is not limited to 10 times and can be set to any number.

[0104] [Summary of the Embodiment] As described above, the information processing apparatus 1 according to the present embodiment includes a system memory 304 (an example of a memory) that temporarily stores a program of the system, a face detection unit 210 (an example of a first processor), and a main processing unit 300 (for example, a CPU 301, an example of a second processor). The face detection unit 210 detects a region (face region) of a face image in which a face is imaged from the captured image captured by the imaging unit 120, and based on the feature information (an example of information) based on the detected face image and the HPD user ID (feature information (an example of information) based on the face image of a registered user), it executes an HPD user authentication process (an example of a face authentication process) for authenticating whether the person in the detected face image is a registered user. The main processing unit 300 activates the system from the standby state by executing the program of the system based on the success of the authentication by the HPD user authentication process. Also, when the authentication by the HPD user authentication process fails, the face detection unit 210 executes the HPD user authentication process again, and when the HPD user authentication process is repeatedly executed due to the failure of the authentication by the HPD user authentication process, the face detection unit 210 stops the HPD user authentication process based on the number of times the HPD user authentication process has been executed.

[0105] Thereby, when the authentication by the HPD user authentication process fails, the information processing apparatus 1 does not continue to execute the HPD user authentication process even if the authentication failure continues, but stops based on the number of times it has been executed. Therefore, even if an unregistered person stays in front of the information processing apparatus 1 for a long time, it is possible to suppress the unintentional activation due to a misjudgment as a registered user. Thus, the information processing apparatus 1 can appropriately activate the system when a registered user approaches.

[0106] For example, the face detection unit 210 executes a person detection process for detecting the presence of a person by detecting a region (face region) of a face image in which a face is captured from the captured image, and when the presence of a person is detected by the person detection process, it shifts from the person detection process to the HPD user authentication process. Further, the face detection unit 210 stops the HPD user authentication process based on the fact that the number of times the HPD user authentication process has been executed since the presence of a person was detected by the person detection process has reached a preset number of times (for example, 10 times).

[0107] Thereby, when a person exists in front of the information processing apparatus 1, the information processing apparatus 1 executes the HPD user authentication process, and instead of continuously executing the HPD user authentication process even if authentication failures continue, it stops based on the number of times it has been executed. Therefore, even if an unregistered person stays in front of the information processing apparatus 1 for a long time, it is possible to suppress the misjudgment as a registered user and unintentional activation. Thus, the information processing apparatus 1 can appropriately activate the system when a registered user approaches.

[0108] Also, when the face detection unit 210 stops the HPD user authentication process due to a failure in the HPD user authentication process, it shifts to the person detection process.

[0109] Thereby, after an unregistered person is in front of the information processing apparatus 1 and the HPD user authentication process is stopped, the information processing apparatus 1 can detect the situation of the person present in front of the information processing apparatus 1.

[0110] Also, when the presence of a person is detected by the person detection process after the HPD user authentication process is stopped, the face detection unit 210 determines whether or not the number of persons present has changed. If it is determined that the number of persons present has changed, it shifts again from the person detection process to the HPD user authentication process.

[0111] As a result, after the information processing apparatus 1 stops the HPD user authentication process, if the number of people in front of the information processing apparatus 1 changes, since there may be registered users, it is possible to determine again whether there are registered users through the HPD user authentication process.

[0112] In addition, when the face detection unit 210 no longer detects the presence of a person through the person detection process after the HPD user authentication process is stopped, it continues the person detection process without shifting to the HPD user authentication process, and when the presence of a person is detected, it shifts from the person detection process to the HPD user authentication process.

[0113] As a result, after the information processing apparatus 1 stops the HPD user authentication process, even if the number of people in front of the information processing apparatus 1 changes or the presence of a person is no longer detected, it is possible to continue the person detection process without unnecessarily performing the HPD user authentication process.

[0114] In addition, the person detection process consumes less power than the HPD user authentication process.

[0115] As a result, the information processing apparatus 1 not only suppresses the misjudgment of being a registered user and thus does not unnecessarily execute the HPD user authentication process in the standby state, but also can suppress the power consumption.

[0116] For example, in the person detection process, the frame rate when detecting the area of the face image (face area) in which a face is captured from the captured image is lower than that in the HPD user authentication process. The face detection unit 210 switches the frame rate when shifting from the person detection process to the HPD user authentication process and when shifting from the HPD user authentication process to the person detection process.

[0117] As a result, when the information processing apparatus 1 stops the HPD user authentication process and shifts to the person detection process, it can reduce power consumption by lowering the frame rate. Also, when the information processing apparatus 1 executes the HPD user authentication process, it can perform face authentication processing by raising the frame rate higher than that during the person detection process.

[0118] Further, the main processing unit 300 may execute a login authentication process for authenticating whether to permit login to the system based on a face image detected from the captured images captured by the imaging unit 120 after the system is started. In that case, the HPD user authentication process executed in the standby state before the system is started is a process with lower power consumption than the login authentication process.

[0119] As a result, the information processing apparatus 1 can perform the HPD user authentication process (face authentication process) while suppressing power consumption as much as possible in the standby state, and can perform highly accurate face authentication in the login authentication process after the system is started.

[0120] For example, in the HPD user authentication process executed in the standby state before the system is started, the frame rate when detecting the area of the face image in which a face is captured from the captured images is lower than that in the login authentication process.

[0121] As a result, the information processing apparatus 1 can perform the HPD user authentication process (face authentication process) while suppressing power consumption as much as possible at a low frame rate in the standby state, and can perform highly accurate face authentication at a high frame rate in the login authentication process after the system is started.

[0122] Also, the face detection unit 210 executes a user registration process for registering feature information (an example of information) based on the face image of the user who uses the information processing apparatus 1 (for example, registering as an HPD user ID).

[0123] As a result, the information processing apparatus 1 can determine whether the person existing in front of the information processing apparatus 1 is a legitimate user who uses the information processing apparatus 1.

[0124] Also, in the information processing apparatus 1 including a system memory 304 (an example of a memory) that temporarily stores a program of the system, a face detection unit 210 (an example of a first processor), and a main processing unit 300 (e.g., a CPU 301, an example of a second processor), a control method includes: a step in which the face detection unit 210 detects a region (a face region) of a face image in which a face is imaged from among the captured images captured by the imaging unit 120, and based on feature information (an example of information) based on the detected face image and HPD user ID (feature information (an example of information) based on a face image of a registered user), executes an HPD user authentication process (an example of a face authentication process) for authenticating whether the person in the detected face image is a registered user; a step in which the main processing unit 300 starts the system from a standby state by executing a program of the system based on the fact that the authentication by the HPD user authentication process has succeeded; a step in which the face detection unit 210 executes the HPD user authentication process again when the authentication by the HPD user authentication process fails; and a step in which the face detection unit 210 stops the HPD user authentication process based on the number of times the HPD user authentication process has been executed when the HPD user authentication process is repeatedly executed due to a failure of the authentication by the HPD user authentication process.

[0125] Thereby, in the control method in the information processing apparatus 1, when the authentication by the HPD user authentication process fails, instead of continuously executing the HPD user authentication process even if the authentication failure continues, it stops based on the number of times it has been executed. Therefore, even when an unregistered person is in front of the information processing apparatus 1 for a long time, it is possible to suppress the system from being inadvertently started by being erroneously determined as a registered user. Thus, the control method in the information processing apparatus 1 can appropriately start the system when a registered user approaches.

[0126] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiments, and designs and the like within the scope not departing from the gist of the present invention are also included. For example, the respective configurations described in the above embodiments can be arbitrarily combined.

[0127] Note that the imaging unit 120 may include either an IR camera or an RGB camera. For example, it may be configured to use an IR camera in both the HPD process and the login authentication process, or it may be configured to use an RGB camera in both the HPD process and the login authentication process.

[0128] Also, the frame rate of the imaging unit 120 in each operation state and process is an example and is not limited to the example of the frame rate described above. For example, it is preferable that the frame rate when executing the person detection process and the HPD user authentication process in the standby state is set lower than the frame rate when executing the login process after startup. However, the values of the frame rate described above are examples and are not limited to this example.

[0129] Also, in the above embodiment, a configuration example in which the imaging unit 120 is built in the information processing apparatus 1 has been described, but the present invention is not limited to this. For example, the imaging unit 120 may not be built in the information processing apparatus 1, and may be configured to be attachable to the information processing apparatus 1 (for example, any of the sides 10a, 10b, 10c, etc.) as an external accessory of the information processing apparatus 1, and may be communicatively connected to the information processing apparatus 1 wirelessly or by wire.

[0130] Also, the CPU 301 and the chipset 303 (an example of the second processor) may be configured as individual processors, or may be integrated as one processor.

[0131] Also, in the above embodiment, an example in which the face detection unit 210 is provided separately from the chipset 303 has been shown. However, part or all of the face detection unit 210 may be provided in the chipset 303, or may be provided in a processor integrated with the chipset 303. Also, the face detection unit 210, the chipset 303, and the CPU 301 may be integrated as one processor. Also, part or all of the face detection unit 210 may be provided in the EC 200.

[0132] In addition, the above-described standby state may include a hibernation state, a power-off state, and the like. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Note that among the standby states, the standby state, the sleep state, the hibernation state, the power-off state, etc. are states in which the power consumption is lower than that in the normal operation state (a state in which power consumption is suppressed).

[0133] Note that the above-described information processing apparatus 1 has a computer system inside. Then, a program for realizing the functions of each configuration included in the above-described information processing apparatus 1 is recorded on a computer-readable recording medium, and the program recorded on this recording medium is read into the computer system and executed, so that the processing in each configuration included in the above-described information processing apparatus 1 may be performed. Here, "reading and executing the program recorded on the recording medium into the computer system" includes installing the program in the computer system. The "computer system" here is assumed to include hardware such as an OS and peripheral devices. Also, the "computer system" may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, or dedicated line. Also, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built into the computer system. Thus, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

[0134] In addition, the recording medium includes an internal or external recording medium that can be accessed from a distribution server for distributing the program. Note that the program may be divided into multiple parts, downloaded at different timings, and then combined by each component included in the information processing apparatus 1, or the distribution servers that distribute each of the divided programs may be different. Further, the "computer-readable recording medium" includes those that hold a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or a client when the program is transmitted via a network. Also, the above program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the above functions in combination with a program already recorded in the computer system.

[0135] In addition, a part or all of each function included in the information processing apparatus 1 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be processorized individually, or a part or all of them may be integrated and processorized. Also, the method of integration is not limited to LSI, and it may be realized by a dedicated circuit or a general-purpose processor. Further, when a technology for integration that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit using such technology may be used.

Explanation of Signs

[0136] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touchpad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Face detection unit, 211 Face detection processing unit, 212 Face authentication processing unit, 213 HPD user ID registration unit, 214 HPD processing unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Operation control unit, 312 Authentication processing unit, 330 HPD control processing unit, 331 Operation instruction unit, 332 Authentication result notification unit, 400 Power supply unit

Claims

1. A memory for temporarily storing the programs of the system, a first processor that detects a region of a face image in which a face is imaged from among the captured images captured by the imaging unit, and performs face authentication processing for authenticating whether the person in the detected face image is a registered user based on the information based on the detected face image and the information based on the face image of the registered user, a second processor that activates the system from the standby state by executing the programs of the system based on the fact that the authentication by the face authentication processing has succeeded, comprising: wherein the first processor when the authentication by the face authentication processing fails, executes the face authentication processing again, and when the face authentication processing is repeatedly executed due to the failure of the authentication by the face authentication processing, stops based on the number of times the face authentication processing has been executed, an information processing apparatus.

2. wherein the first processor executes person detection processing for detecting the presence of a person by detecting a region of a face image in which a face is imaged from among the captured images, and when the presence of a person is detected by the person detection processing, shifts from the person detection processing to the face authentication processing, and stops the face authentication processing based on the fact that the number of times the face authentication processing has been executed since the presence of a person was detected by the person detection processing has reached a preset number of times, the information processing apparatus according to Claim 1.

3. wherein the first processor when the face authentication processing is stopped due to the failure of the authentication by the face authentication processing, shifts to the person detection processing, the information processing apparatus according to Claim 2.

4. wherein the first processor after the face authentication processing is stopped, determines whether the number of persons present has changed when the presence of a person is detected by the person detection processing, and when it is determined that the number of persons present has changed, shifts from the person detection processing to the face authentication processing again, the information processing apparatus according to Claim 3.

5. wherein the first processor when the presence of a person is no longer detected by the person detection processing after the face authentication processing is stopped, continues the person detection processing without shifting to the face authentication processing, and when the presence of a person is detected, shifts from the person detection processing to the face authentication processing, the information processing apparatus according to Claim 4.

6. the person detection processing is a process with lower power consumption than the face authentication processing, the information processing apparatus according to Claim 2.

7. The person detection process has a lower frame rate than the face authentication process when detecting the region of a face image in which a face is captured from the captured image, The first processor, switches the frame rate when transitioning from the person detection process to the face authentication process and when transitioning from the face authentication process to the person detection process, The information processing apparatus according to claim 2.

8. The second processor, after the system is started, executes a login authentication process for authenticating whether to permit login to the system based on a face image detected from the captured image captured by the imaging unit, The face authentication process executed in the standby state before the system is started is a process with lower power consumption than the login authentication process, The information processing apparatus according to claim 1.

9. The face authentication process executed in the standby state before the system is started has a lower frame rate than the login authentication process when detecting the region of a face image in which a face is captured from the captured image, The information processing apparatus according to claim 8.

10. The first processor, executes a user registration process for registering information based on a face image of a user who uses the information processing apparatus, The information processing apparatus according to claim 1.

11. A control method in an information processing apparatus including a memory that temporarily stores a program of a system, a first processor, and a second processor, a step in which the first processor detects a region of a face image in which a face is captured from a captured image captured by an imaging unit, and based on information based on the detected face image and information based on a registered user's face image, executes a face authentication process for authenticating whether the person in the detected face image is a registered user; a step in which the second processor starts the system from the standby state by executing the program of the system based on the fact that the authentication by the face authentication process has succeeded; a step in which the first processor executes the face authentication process again when the authentication by the face authentication process fails; a step in which the first processor stops based on the number of times the face authentication process is executed when the face authentication process is repeatedly executed due to a failure of the authentication by the face authentication process; A control method including the above.

Images