Electronic device and control method

Abstract

The present application relates to an electronic device and a control method. Unnecessary activation is suppressed. The electronic device includes a memory that temporarily stores image data of an image captured by a camera, and a processor that processes the image data stored in the memory, and performs activation processing that activates from a standby state. The processor detects a face region in which a face satisfying a condition in which face authentication is possible is captured from the image by processing the image data of the image captured by the camera and stored in the memory in the standby state, and performs activation instruction to execute the activation processing when the face region satisfying the condition in which face authentication is possible is detected from the image.

Description

Technical Field

[0001] This invention relates to electronic devices and control methods. Background Technology

[0002] There exists an electronic device that transitions to an active state when a person approaches, and to a standby state where all functions are disabled when the person moves away. For example, in Patent Document 1, an infrared sensor is used to detect whether a person is approaching or moving away.

[0003] In recent years, advancements in computer vision and other technologies have led to increased accuracy in facial detection within images. Consequently, facial detection has begun to replace infrared sensors for detecting people. Furthermore, facial authentication is now used as a method for verifying user legitimacy when electronic devices are activated (e.g., login authentication). For instance, if a person approaches, the electronic device detects their face and activates, then performs facial authentication on the detected face to allow login and transition to a usable state.

[0004] Patent document 1: Japanese Patent Application Publication No. 2016-148895.

[0005] However, even when electronic devices are activated by facial detection, there are situations where the person is too far away or too close, or is turned to the side, preventing facial authentication from being performed. In such cases where facial authentication cannot be performed, the device may sometimes be activated unnecessarily simply because a face has been detected. Summary of the Invention

[0006] The present invention was made in view of the above circumstances, and one of its objectives is to provide an electronic device and a control method for suppressing unnecessary activation.

[0007] The present invention was made to solve the aforementioned problems. The first aspect of the present invention relates to an electronic device that performs a startup process from a standby state based on the authentication result of facial authentication. The electronic device includes: a memory that temporarily stores image data of an image captured by a camera; and a processor that performs processing based on the image data stored in the memory. The processor performs the following processing: a face detection process, in the standby state, by processing the image data of the image captured by the camera and stored in the memory, thereby detecting a facial region in the image that meets the conditions for performing the facial authentication; and a startup indication process, in which the startup process is executed when a facial region that meets the conditions for performing the facial authentication is detected in the image by the face detection process.

[0008] In the aforementioned electronic device, the facial authentication function can be set to be enabled or disabled. When the facial authentication function is enabled, the processor performs facial detection processing to detect facial regions that meet the conditions for performing the facial authentication.

[0009] The conditions under which facial authentication can be performed in the aforementioned electronic device include the size of the face in the captured image relative to the area of ​​the image.

[0010] The conditions under which facial authentication can be performed in the aforementioned electronic device include the condition that the face captured in the image is located within the area of ​​the image.

[0011] The conditions under which facial authentication can be performed in the aforementioned electronic device include the orientation of the face in the captured image.

[0012] The conditions under which facial authentication can be performed in the aforementioned electronic devices include the brightness of the environment in which the electronic devices are used.

[0013] In the aforementioned electronic device, when the facial authentication function is set to be disabled, the processor, during the facial detection process, detects a facial region with a face captured in the image regardless of whether the conditions for performing the facial authentication are met. If a facial region is detected in the image through the facial detection process, the processor executes the startup process during the startup instruction process.

[0014] Furthermore, the control method in the electronic device according to the second aspect of the present invention includes: an image data memory that temporarily stores images captured by a shooting device, and a processor that performs processing based on the image data stored in the memory. The electronic device performs a startup process that starts from a standby state based on the authentication result of facial authentication. The control method includes: in the standby state, the processor processes the image data of the image captured by the shooting device and stored in the memory to detect a facial region in the image that meets the conditions for performing the facial authentication; and when a facial region that meets the conditions for performing the facial authentication is detected in the image, the processor performs the startup process.

[0015] According to the above-described method of the present invention, unnecessary activation can be suppressed. Attached Figure Description

[0016] Figure 1 This is a diagram illustrating the outline of HPD processing of the electronic device according to the first embodiment.

[0017] Figure 2 This is a diagram illustrating an example of the detection range of a person by the electronic device according to the first embodiment.

[0018] Figure 3 This is a diagram showing an outline of the HPD processing of the electronic device according to the first embodiment.

[0019] Figure 4 This is a perspective view showing an example of the configuration of the electronic device according to the first embodiment.

[0020] Figure 5 This is a diagram illustrating an example of the hardware configuration of the electronic device according to the first embodiment.

[0021] Figure 6 This is a diagram illustrating an example of the functional configuration of the electronic device according to the first embodiment.

[0022] Figure 7 This is a flowchart illustrating an example of HPD processing in standby mode according to the first embodiment.

[0023] Figure 8 This is a flowchart illustrating an example of the startup process involved in the first embodiment.

[0024] Figure 9 This is a flowchart illustrating an example of HPD processing in standby mode according to the second embodiment.

[0025] Explanation of reference numerals in the attached figures

[0026] 1…electronic device, 10…first frame, 20…second frame, 15…hinge mechanism, 110…display unit, 120…camera unit, 140…power button, 150…input device, 151…keyboard, 153…touchpad, 200…EC, 300…main processing unit, 301…CPU, 302…GPU, 303…chipset, 304…system memory, 310…communication unit, 320…storage unit, 311…system processing unit, 313…HPD processing unit, 330…face detection unit, 331…detection mode switching unit, 332…face detection processing unit, 333…detection mode information storage unit, 400…power supply unit. Detailed Implementation

[0027] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0028] <First Implementation>

[0029] [summary]

[0030] First, an overview of the electronic device 1 according to the first embodiment will be described. The electronic device 1 according to this embodiment is, for example, a notebook PC (Personal Computer). In addition, the electronic device 1 may also be any type of electronic device such as a desktop PC, a tablet terminal device, or a smartphone.

[0031] Electronic device 1 is capable of transitioning between at least a normal operating state (power-on state) and a standby state as the system's operating state. A normal operating state refers to an operating state in which processing can be performed without particular restrictions, for example, equivalent to the S0 state as defined in ACPI (Advanced Configuration and Power Interface). A standby state refers to a state in which at least a portion of the system is restricted. For example, a standby state includes standby mode, sleep mode, etc., and can also be a state like modern standby in Windows (registered trademark), equivalent to the S3 state (sleep state) as defined in ACPI, etc. For example, a standby state is an operating state with lower power consumption compared to a normal operating state.

[0032] Hereinafter, the transition of a system's operating state from standby state to normal operating state is sometimes referred to as startup. In standby state, the activity level is generally lower compared to normal operating state, so starting up the system of electronic device 1 is the action of activating the system in electronic device 1.

[0033] Figure 1 This diagram illustrates the general outline of the HPD (Human Presence Detection) processing of the electronic device 1 according to this embodiment. The electronic device 1 detects a person (i.e., a user) present in its vicinity. The process of detecting the presence of this person is called HPD (Human Presence Detection) processing. The electronic device 1 detects the presence or absence of a person through HPD processing and controls the system's operational state based on the detection result. For example, as... Figure 1 As shown in (A), when electronic device 1 detects a change from a state where no person is in front of it (Absence) to a state where a person is present (Presence), i.e., when a person approaches electronic device 1 (Approach), it determines that a user is approaching, automatically activates the system, and transitions it to its normal operating state. Furthermore, as... Figure 1 As shown in (B), when a person is present in front of electronic device 1, electronic device 1 determines that a user is present and continues its normal operation. Furthermore, as... Figure 1As shown in (C), when electronic device 1 detects a change from a state where a person is present in front of electronic device 1 to a state where no person is present, i.e., when the person leaves electronic device 1, it determines that the user has left and causes the system to switch to standby mode.

[0034] Electronic device 1 detects the presence of a person within a specified range in front (front side).

[0035] Figure 2 This diagram illustrates an example of the detection range of a person by the electronic device 1 according to this embodiment. In the illustrated example, the detection range FoV (Field of View) in front of the electronic device 1 (front side) is the detectable range of a person. For example, the electronic device 1 determines whether a person (user) is present in front of it by detecting the facial region of the captured face in the captured image obtained from the front (front side). The detection range FoV corresponds to the shooting angle of the electronic device 1. If the electronic device 1 detects a facial region from the captured image, it determines that a user is present. On the other hand, if the electronic device 1 does not detect a facial region from the captured image, it determines that no user is present.

[0036] Furthermore, when electronic device 1 determines the presence of a user by detecting a facial region in the captured image, it starts the system and transitions to its normal operating state, but during this process, it performs authentication processing to verify whether the user is a legitimate user. If electronic device 1 determines that the user is a legitimate user, it allows access (allows login), continues the startup process, and transitions to the normal operating state. On the other hand, if electronic device 1 determines that the user is not a legitimate user, it disallows access (disallows login), and the authentication waiting state continues. Hereinafter, the authentication of the user at startup will be referred to as "login authentication."

[0037] Methods of login authentication include password authentication where the user enters a password from a keyboard, facial authentication where the user's face is verified, and fingerprint authentication where the user's fingerprint is verified. When facial authentication-based login authentication is valid, electronic device 1 performs facial authentication by comparing the features of the face detected in the captured image with the features of a pre-registered legitimate user's face.

[0038] Here, there are situations where facial recognition cannot be performed even if a face can be detected from the captured image. Therefore, it is possible to unnecessarily initiate facial recognition when it cannot be performed. Situations where facial recognition cannot be performed even if a face can be detected include situations where the distance between the electronic device 1 and the person is too far or too close, or where there is no face near the center of the captured image. Additionally, facial recognition may fail if the face is not a frontal view, such as a side profile. Furthermore, when performing facial recognition by detecting the facial area in an image captured by an IR camera (infrared camera), facial recognition may fail in excessively bright environments such as sunlight. Therefore, the electronic device 1... Figure 3 HPD processing as shown.

[0039] Figure 3 This diagram illustrates the general outline of the HPD processing of the electronic device 1 according to this embodiment. The electronic device 1 acquires a frontal (front view) image, and instead of detecting only facial regions from the image, it detects facial regions that meet the conditions for facial authentication. Furthermore, the electronic device 1 activates when it detects facial regions that meet the conditions for facial authentication, and then performs login authentication based on facial authentication. This prevents unnecessary activation when facial authentication is not possible.

[0040] For example, when the face-based login authentication function is active, electronic device 1 activates when it detects a facial region in the captured image that meets the conditions for face authentication. Conversely, electronic device 1 can also activate when the face-based login authentication function is inactive, regardless of whether the conditions for face authentication are met, by detecting a facial region in the captured image. In the following description, the face detection mode that detects a facial region that meets the conditions for face authentication is referred to as the "face authentication assistance mode." Conversely, the face detection mode that detects a facial region in the captured image regardless of whether the conditions for face authentication are met is referred to as the "normal face detection mode."

[0041] Next, the structure of the electronic device 1 involved in this embodiment will be described in detail.

[0042] [Appearance Composition of Electronic Devices]

[0043] Figure 4 This is a perspective view showing an example of the appearance configuration of the electronic device 1 according to this embodiment.

[0044] Electronic device 1 includes a first frame 10, a second frame 20, and a hinge mechanism 15. The first frame 10 and the second frame 20 are connected by the hinge mechanism 15. The first frame 10 is capable of rotating relative to the second frame 20 about a rotation axis formed by the hinge mechanism 15. The opening angle formed by the rotation of the first frame 10 and the second frame 20 is illustrated as "θ".

[0045] The first frame 10 is also referred to as the A cover or the display frame. The second frame 20 is also referred to as the C cover or the system frame. In the following description, the side surfaces of the first frame 10 and the second frame 20 that have the hinge mechanism 15 are referred to as side surfaces 10c and 20c, respectively. The side surfaces of the first frame 10 and the second frame 20 opposite to side surfaces 10c and 20c are referred to as side surfaces 10a and 20a, respectively. In the illustration, the direction from side surface 20a toward side surface 20c is referred to as "rear," and the direction from side surface 20c toward side surface 20a is referred to as "front." The right and left sides relative to the rear are referred to as "right" and "left," respectively. The left side surfaces of the first frame 10 and the second frame 20 are referred to as side surfaces 10b and 20b, respectively, and the right side surfaces are referred to as side surfaces 10d and 20d, respectively. In addition, the state in which the first frame 10 and the second frame 20 overlap and are completely closed (the state with an opening angle θ = 0°) is referred to as the "closed state." The faces of the first frame 10 and the second frame 20 facing each other in the closed state are called their "inner faces," and the faces opposite to their inner faces are called their "outer faces." Furthermore, the state in which the first frame 10 and the second frame 20 are open relative to the closed state is called the "open state."

[0046] Figure 4 The electronic device 1 shown is an example of an open state. The open state is the state where the side 10a of the first frame 10 is separated from the side 20a of the second frame 20. In the open state, the inner surfaces of both the first frame 10 and the second frame 20 are visible. The open state is one of the states in which the user uses the electronic device 1, typically mostly used with an opening angle θ of approximately 100 to 130°. Furthermore, the range of the opening angle θ for the open state can be arbitrarily determined based on factors such as the range of angles through which the hinge mechanism 15 can rotate.

[0047] A display unit 110 is provided on the inner surface of the first frame 10. The display unit 110 is configured to include a liquid crystal display (LCD), an organic EL (electroluminescence) display, or the like. Furthermore, a camera unit 120 is provided in the area surrounding the display unit 110 on the inner surface of the first frame 10. For example, the camera unit 120 is disposed on the side 10a side of the area surrounding the display unit 110. Moreover, the position of the camera unit 120 is just one example; it can be placed in any other location as long as it faces the inner surface of the first frame 10 (front).

[0048] In the open state, the imaging unit 120 captures images of a predetermined shooting range facing the inner surface of the first frame 10 (front side). The predetermined shooting range is the range of viewing angles determined by the imaging element of the imaging unit 120 and the optical lens disposed in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture images including people present in front of the electronic device 1 (front side).

[0049] Additionally, a power button 140 is provided on the side 20b of the second frame 20. The power button 140 is an operating element used by the user to indicate whether the power is on or off, to transition from standby mode to normal operation mode, and vice versa. Furthermore, a keyboard 151 and a touchpad 153 are provided on the inner surface of the second frame 20 as input devices for receiving user input. Moreover, the keyboard 151 and touchpad 153 can be replaced by other input devices, or a touch sensor can be provided on top of the keyboard 151 and touchpad 153; a mouse or an external keyboard can also be connected. In the case of a structure with a touch sensor, the area of ​​the display unit 110 corresponding to the display surface can also be configured as a touch panel for receiving operations. Additionally, a microphone for inputting sound can also be included in the input device.

[0050] Furthermore, in the closed state where the first frame 10 and the second frame 20 are closed, the display unit 110 and the camera unit 120 disposed on the inner surface of the first frame 10, and the keyboard 151 and the touchpad 153 disposed on the inner surface of the second frame 20 are covered by the other frame surface and cannot function.

[0051] [Hardware Components of Electronic Devices]

[0052] Figure 5This is a schematic block diagram illustrating an example of the hardware configuration of the electronic device 1 according to this embodiment. The electronic device 1 is configured to include: a display unit 110, a camera unit 120, a power button 140, an input device 150, an EC (Embedded Controller) 200, a main processing unit 300, a communication unit 310, a storage unit 320, a face detection unit 330, and a power supply unit 400. The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and the processing of application programs operating on the system processing.

[0053] The imaging unit 120 captures an image of an object within a predetermined viewing angle facing (front) the inner surface of the first frame 10, and outputs the captured image to the main processing unit 300 and the face detection unit 330. For example, the imaging unit 120 includes an RGB camera and an IR camera. The RGB camera is a conventional camera that captures images using visible light. The IR camera is a camera that captures infrared light emitted from an object.

[0054] Because IR cameras emit infrared light during shooting, for example, they consume more power than RGB cameras. Therefore, an RGB camera is used when detecting facial regions from captured images in standby mode, while an IR camera is used for login authentication based on facial recognition. Furthermore, the imaging unit 120 can also be equipped with either an IR camera or an RGB camera; the IR camera can be used in standby mode, while the RGB camera can be used during authentication processing at startup.

[0055] The power button 140 outputs an operation signal to the EC200 based on the user's operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to receiving operations on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC200.

[0056] The power supply unit 400 supplies power to each component according to the operating state of each component of the electronic device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the DC power supplied from the AC (Alternate Current) / DC adapter or battery (battery pack) to the voltage required by each component. The power after voltage conversion by the DC / DC converter is supplied to each component via each power supply system. For example, the power supply unit 400 supplies power to each component via each power supply system based on control signals input from EC200.

[0057] The EC200 is a microcomputer configured with a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and I / O (Input / Output) logic circuits. The EC200's CPU reads the control program (firmware) pre-stored in its ROM and executes it to perform its functions. The EC200 operates independently of the main processing unit 300, controlling its operation and managing its operating state. Furthermore, the EC200 is connected to a power button 140, an input device 150, and a power supply unit 400.

[0058] For example, EC200 communicates with power supply unit 400 to obtain information about the battery status (remaining capacity, etc.) from power supply unit 400, and outputs control signals, such as control signals for controlling the power supply corresponding to the operating status of each part of electronic device 1, to power supply unit 400. In addition, EC200 obtains operation signals from power button 140 and input device 150, and outputs operation signals related to the processing of main processing unit 300 from the obtained operation signals to main processing unit 300.

[0059] The main processing unit 300 is configured to include a CPU (Central Processing Unit) 301, a GPU (Graphics Processing Unit) 302, a chipset 303, and a system memory 304. Through system processing based on an OS (Operating System), it is able to execute various applications on the OS.

[0060] CPU 301 performs BIOS-based processing, OS-based processing, and processing based on applications running on the OS. CPU 301 controls the system's operating state based on control from chipset 303. For example, CPU 301 performs startup processing to transition the system's operating state from standby to normal operation. Additionally, CPU 301 performs authentication processing (login authentication) during startup processing to verify the user's legitimacy. If facial recognition login authentication is enabled, CPU 301 performs facial recognition authentication during startup. Conversely, if facial recognition login authentication is disabled, CPU 301 performs authentication processing other than facial recognition (e.g., password authentication) during startup.

[0061] If the user is determined to be legitimate during the authentication process, CPU301 allows access (login allowed), continues the startup process, and transitions to the normal operating state. Conversely, if the user is determined to be illegitimate during the authentication process, CPU301 disallows access (login not allowed) and keeps the user in the authentication waiting state.

[0062] GPU 302 is connected to display unit 110. GPU 302 performs image processing based on the control of CPU 301 to generate display data. GPU 302 outputs the generated display data to display unit 110.

[0063] The chipset 303 functions as a memory controller and an I / O controller. For example, the chipset 303 controls the CPU 301 and GPU 302 to read and write data from the system memory 304, storage unit 320, etc. Additionally, the chipset 303 controls the input and output of data from the communication unit 310, display unit 110, and EC200. Furthermore, the chipset 303 functions as a sensor hub. For example, in HPD processing, the chipset 303 acquires the detection results of face detection from the face detection unit 330, detects the presence of a person (user) based on these results, and controls the system's operational state.

[0064] The system memory 304 is used as a reading area for programs executed by the CPU 301 and a writing area for processing data. In addition, the system memory 304 temporarily stores image data of images captured by the imaging unit 120.

[0065] Furthermore, CPU 301, GPU 302, and chipset 303 can be configured as a single integrated processor, or they can be configured as separate processors, either individually or in part. For example, in normal operation, CPU 301, GPU 302, and chipset 303 are all operating, but in standby mode, only at least a portion of chipset 303 is operating. In standby mode, at least the functions required for HPD processing during startup are performed.

[0066] The communication unit 310 connects to other devices via a wireless or wired communication network to transmit and receive various types of data. For example, the communication unit 310 is configured to include a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0067] The storage unit 320 is configured to include storage media such as HDD (Hard Disk Drive), SDD (Solid State Drive), RAM, and ROM. In addition to various programs such as the OS, device drivers, and applications, the storage unit 320 also stores various data acquired through program actions.

[0068] The face detection unit 330 is configured to include a processor that processes image data of images captured by the imaging unit 120. The face detection unit 330 acquires image data of images captured by the imaging unit 120 and temporarily stores the acquired image data in a memory. The memory for storing the image data may be the system memory 304 or a memory connected to the processor included in the face detection unit 330.

[0069] For example, the face detection unit 330 processes image data from the captured image obtained from the imaging unit 120 to detect facial regions from the captured image in either a face authentication assistance mode or a normal face detection mode. The face detection unit 330 then sends the detection results based on the face detection in either the face authentication assistance mode or the normal face detection mode to the chipset 303 of the main processing unit 300.

[0070] Furthermore, the face detection unit 330 also operates in standby mode. In standby mode, the face detection unit 330 acquires image data from the RGB camera captured by the imaging unit 120 to detect facial regions, as described above. By using an RGB camera instead of an IR camera, power consumption in standby mode can be reduced.

[0071] [Functional Composition of Electronic Device 1]

[0072] Next, the functional configuration of electronic device 1 that enables the system to start by detecting the facial region from the captured image in either the facial authentication assistance mode or the normal facial detection mode will be explained in detail.

[0073] Figure 6 This is a schematic block diagram illustrating an example of the functional configuration of the electronic device 1 according to this embodiment.

[0074] The electronic device 1 includes: a system processing unit 311, an HPD processing unit 313, and a face detection unit 330.

[0075] The system processing unit 311 is configured by the CPU 11 to perform BIOS and OS-based processing. The system processing unit 311 controls the system's operating state based on control from the HPD processing unit 313. For example, if the system processing unit 311 receives a startup instruction from the HPD processing unit 313, it executes startup processing to transition the system's operating state from standby to normal operation. Additionally, the system processing unit 311 performs authentication processing (login authentication) during the startup process to verify if the user is legitimate. If facial recognition-based login authentication is enabled, the system processing unit 311 performs facial recognition-based authentication during startup. Conversely, if facial recognition-based login authentication is disabled, the system processing unit 311 performs authentication processing other than facial recognition (e.g., password authentication) during startup.

[0076] Furthermore, if the system processing unit 311 receives an instruction from the HPD processing unit 313 to transfer the system's operating state to a standby state, then the system's operating state is transferred from the normal operating state to the standby state.

[0077] The HPD processing unit 313 is a configuration in the chipset 303 that performs HPD processing based on the detection results of the face detection unit 330. When the face-based login authentication function is enabled, the HPD processing unit 313 instructs the face detection unit 330 to set it to face authentication assistance mode. Furthermore, in standby mode, if the face detection unit 330 detects a facial area in the captured image that meets the conditions for face authentication, the HPD processing unit 313 determines that a user is approaching the electronic device 1 and instructs the system processing unit 311 to perform startup processing.

[0078] On the other hand, when the login authentication function based on facial recognition is set to invalid, the HPD processing unit 313 instructs the face detection unit 330 to set it to the normal face detection mode. Moreover, in standby mode, when the face detection unit 330 detects a facial area from the captured image, the HPD processing unit 313 determines that a user is approaching the electronic device 1 and instructs the system processing unit 311 to perform startup processing.

[0079] Furthermore, in normal operation, the HPD processing unit 313, for example, instructs the face detection unit 330 to set to normal face detection mode. Moreover, in normal operation, if the face detection unit 330 detects a face region in the captured image but no face region is detected, the HPD processing unit 313 determines that the user has moved away from the electronic device 1 and instructs the system processing unit 311 to transition the system's operation from normal operation to standby mode.

[0080] The face detection unit 330 includes a detection mode switching unit 331, a face detection processing unit 332, and a detection mode information storage unit 333. For example, the detection mode switching unit 331 and the face detection processing unit 332 are configured based on the functions of the processor included in the face detection unit 330, and the detection mode information storage unit 333 is included in a memory connected to the processor.

[0081] The detection mode switching unit 331 switches between the face authentication assistance mode and the normal face detection mode according to the instruction from the HPD processing unit 313. The detection mode information storage unit 333 stores the face detection processing program executed in the face authentication assistance mode and the face detection processing program executed in the normal face detection mode. When the detection mode switching unit 331 receives an instruction from the HPD processing unit 313 to set to the face authentication assistance mode, it reads the face detection processing program executed in the face authentication assistance mode from the detection mode information storage unit 333 and sets it to the face authentication assistance mode. On the other hand, when the detection mode switching unit 331 receives an instruction from the HPD processing unit 313 to set to the normal face detection mode, it reads the face detection processing program executed in the normal face detection mode from the detection mode information storage unit 333 and sets it to the normal face detection mode.

[0082] When set to face authentication assistance mode, the face detection processing unit 332 detects facial regions from the captured image that meet the conditions for face authentication. Conversely, when set to normal face detection mode, the face detection processing unit 332 detects facial regions from the captured image regardless of whether the conditions for face authentication are met. Furthermore, the face detection processing unit 332 sends the detection results to the HPD processing unit 313.

[0083] (Conditions for enabling facial recognition)

[0084] Here, examples of conditions under which facial authentication can be performed will be explained. As mentioned above, situations in which facial detection can be performed but facial authentication cannot be performed include situations where the distance between the electronic device 1 and the person is too far or too close, where there is no face near the center of the captured image, where the face is not frontal, and where the environment is too bright. Therefore, the following (1) to (4) can be cited as conditions under which facial authentication can be performed.

[0085] (1) A condition for enabling facial authentication is defined as the size of the face in the captured image relative to the area of ​​the captured image. When the distance between the electronic device 1 and the person is far, the facial area detected in the captured image becomes smaller. Conversely, when the distance between the electronic device 1 and the person is close, the facial area detected in the captured image becomes larger. Therefore, as a threshold for the size of the facial area detected in the captured image, a first threshold on the smaller side and a second threshold on the larger side are preset, and a facial area size that is greater than or equal to the first threshold and less than the second threshold is defined as a condition for enabling facial authentication. Thus, when the distance between the electronic device 1 and the person is too far or too close, the condition for enabling facial authentication is not met, and the facial area is not detected. When the distance between the electronic device 1 and the person is suitable for facial authentication, the facial area that meets the condition for enabling facial authentication can be detected. The first threshold and the second threshold can be arbitrarily determined based on the shooting angle of the shooting unit 120, etc.

[0086] (2) The condition that the position of the face captured in the captured image is exemplified within the area of ​​the captured image is used as the condition for enabling face authentication. For example, by setting the detection range for detecting the face region from the captured image as a range that includes the center of the captured image but is smaller than the area of ​​the captured image, the condition that a face is captured within this detection range is set as the condition for enabling face authentication. Thus, since the end of the captured image does not meet the condition for enabling face authentication, the electronic device 1 can not detect the face region, but only detect the face region captured near the center of the captured image, as the face region that meets the condition for enabling face authentication. The detection range for detecting the face region can be arbitrarily determined based on the shooting angle of the shooting unit 120, etc.

[0087] (3) The condition that the orientation of the face captured in the captured image can be used as a condition for facial authentication. For example, by only setting the frontal face in the captured image as the detection object, the frontal face is set as a condition for facial authentication. Therefore, if the orientation of the captured face is not a side view or other frontal face, the condition for facial authentication is not met, so the electronic device 1 can not detect it as a facial region, but only the frontal face, as a facial region that meets the condition for facial authentication.

[0088] (4) The brightness of the environment in which the use is performed can be used as a condition for facial authentication.

[0089] For example, an upper limit for the brightness of the environment is set as a third threshold, and the average brightness of the environment of the subject, calculated from the image data of the captured image, being less than the third threshold is set as a condition for facial authentication. The brightness of the environment of the subject can be calculated based on the shooting conditions of the shooting unit 120 and the brightness value of the image data of the captured image. Therefore, since the condition for facial authentication is not met in an excessively bright environment, the electronic device 1 can not detect a face region, but only detect faces captured in an environment with appropriate brightness, and regard them as face regions that meet the condition for facial authentication. Furthermore, as a brightness condition, an upper limit for brightness can be used instead of an upper limit for brightness, or a lower limit for brightness can be set based on the upper limit for brightness, as a condition for facial authentication.

[0090] All of the conditions (1) to (4) above can be set as conditions for enabling facial authentication, or only a portion of them can be set as conditions for enabling facial authentication. When the facial authentication assistance mode is set, the facial detection processing unit 332 detects facial regions in the captured image that meet the conditions for enabling facial authentication.

[0091] On the other hand, when set to the normal face detection mode, the face detection processing unit 332 detects facial regions from the captured image regardless of whether the conditions for face authentication are met. In other words, the face detection processing unit 332 also detects facial regions that do not meet the conditions for face authentication. For example, the face detection processing unit 332 detects facial regions from the captured image without setting any one or all of the following conditions: the size of the face in the captured image relative to the area of ​​the captured image, the position of the face, the orientation of the face, and the brightness of the surrounding environment. The face detection processing unit 332 may also detect facial regions by using the entire area of ​​the captured image as the detection range, regardless of the size and orientation of the face.

[0092] Furthermore, when set to the normal face detection mode, the face detection processing unit 332 may also use a range that is wider than the detection range when set to the face authentication assistance mode but narrower than the entire captured image area as the detection range to detect the face region.

[0093] [HPD processing actions]

[0094] Next, refer to Figure 7 The HPD processing actions performed by electronic device 1 in standby mode are explained.

[0095] Figure 7This is a flowchart illustrating an example of HPD processing in standby mode according to this embodiment.

[0096] (Step S101) The HPD processing unit 313 determines whether the system's operating state is a standby state. If the HPD processing unit 313 determines that it is in a standby state (yes), it proceeds to step S103. On the other hand, if the HPD processing unit 313 determines that it is not in a standby state (no), it does not perform this process.

[0097] (Step S103) The HPD processing unit 313 determines whether the face-based login authentication function is valid. If the HPD processing unit 313 determines that the face-based login authentication function is valid (Yes), it instructs the face detection unit 330 to be set to face authentication assistance mode and proceeds to step S105. On the other hand, if the HPD processing unit 313 determines that the face-based login authentication function is invalid (No), it instructs the face detection unit 330 to be set to normal face detection mode and proceeds to step S109.

[0098] (Step S105) In face authentication assistance mode, the face detection unit 330 detects facial regions from the captured image that meet the conditions for face authentication and sends the detection results to the HPD processing unit 313. Then, the process proceeds to step S107.

[0099] (Step S107) The HPD processing unit 313 determines whether a facial region that meets the conditions for facial authentication has been detected based on the detection result of the facial detection unit 330. If the HPD processing unit 313 determines that a facial region that meets the conditions for facial authentication has been detected (Yes), it sends a start instruction to the system processing unit 311 to perform start processing (Step S113). On the other hand, if the HPD processing unit 313 determines that no facial region that meets the conditions for facial authentication has been detected (No), it returns to the processing in step S105 and continues the standby state.

[0100] (Step S109) The face detection unit 330 detects the face region from the captured image in normal face detection mode and sends the detection result to the HPD processing unit 313. Then, the process proceeds to step S111.

[0101] (Step S111) The HPD processing unit 313 determines whether a facial region has been detected regardless of whether the conditions for facial authentication are met, based on the detection results of the face detection unit 330. If the HPD processing unit 313 determines that a facial region has been detected (Yes), it sends a start instruction to the system processing unit 311 to perform start processing (Step S113). On the other hand, if the HPD processing unit 313 determines that no facial region has been detected (No), it returns to the processing in step S109, and the standby state continues.

[0102] [Action to initiate processing]

[0103] Next, the operation of the startup process performed by the system processing unit 311 upon receiving the startup instruction through the above-described HPD process will be explained.

[0104] Figure 8 This is a flowchart illustrating an example of the startup process involved in this embodiment. Here, it is assumed that electronic device 1 is placed on a table or similar surface in an on state and is in standby mode.

[0105] (Step S201) The system processing unit 311 starts the system startup process according to the startup instruction from the HPD processing unit 313. For example, after performing the BIOS-based startup process, the OS startup process is started, and the process proceeds to step S203.

[0106] (Step S203) The system processing unit 311 performs authentication processing for logging into the OS. For example, if the facial recognition login authentication function is enabled, the system processing unit 311 performs facial recognition authentication processing. On the other hand, if the facial recognition login authentication function is disabled, the system processing unit 311 performs authentication processing other than facial recognition (e.g., password authentication). Then, the process proceeds to step S205.

[0107] (Step S205) The system processing unit 311 determines whether the authentication result is successful. If the system processing unit 311 determines that the authentication result is successful (Yes), it proceeds to step S207. On the other hand, if the system processing unit 311 determines that the authentication result is unsuccessful (No), it proceeds to step S211.

[0108] (Step S207) If the authentication result is successful, the system processing unit 311 notifies that the login was successful (for example, displayed on the display unit 110) and continues the OS startup process. Then, the process proceeds to step S209.

[0109] (Step S209) The system processing unit 311 completes the authentication process and transfers the system's operating state to the normal operating state.

[0110] (Step S211) If the authentication result fails, the system processing unit 311 notifies that login has failed (for example, displayed on the display unit 110) and returns to step S203. Alternatively, if the authentication process fails a predetermined number of times consecutively, the system processing unit 311 may suspend the authentication process and transition to a state where login is not possible.

[0111] [Summary of the First Implementation]

[0112] As explained above, the electronic device 1 according to this embodiment performs a startup process from a standby state based on the authentication result of facial recognition. For example, the electronic device 1 includes: a memory (e.g., system memory 304) that temporarily stores image data of images (captured images) captured by the imaging unit 120 (an example of an imaging device), and a processor (e.g., chipset 303 and face detection unit 330) that performs processing based on the image data stored in the memory. The face detection unit 330 performs face detection processing; in the standby state, it processes the image data of the captured images captured by the imaging unit 120 and stored in the memory to detect facial regions from the captured images that contain faces that meet the conditions for facial recognition. Furthermore, when the chipset 303 detects facial regions from the captured images that meet the conditions for facial recognition through the aforementioned face detection processing, it performs a startup instruction process to execute the startup process.

[0113] Therefore, since electronic device 1 only activates when it detects a facial region in an image that is capable of facial authentication from the captured image while in standby mode, unnecessary activation can be suppressed. For example, it can be prevented that electronic device 1 will not activate unintentionally when the user or someone other than the user is merely passing by and using electronic device 1.

[0114] In addition, the facial authentication function (e.g., login authentication function) can be set to be enabled or disabled. When the facial authentication function is set to be enabled, the facial detection unit 330 (an example of a processor) performs facial detection processing to detect facial regions that meet the conditions for facial authentication.

[0115] Therefore, since electronic device 1 only activates when the facial region of a face capable of facial authentication is detected from the captured image in the standby state, when the facial authentication function is effective, unnecessary activation can be suppressed.

[0116] For example, conditions that enable facial authentication include the size of the face in the captured image relative to the area of ​​the captured image.

[0117] Therefore, electronic device 1 will not activate if facial authentication cannot be performed due to the person being too far or too close to electronic device 1, thus preventing unnecessary activation.

[0118] In addition, the conditions for enabling facial authentication include the location of the face in the captured image within the area of ​​the captured image.

[0119] Therefore, electronic device 1 will not activate if there is a person at a laterally offset position relative to electronic device 1, preventing facial authentication, thus suppressing unnecessary activation.

[0120] In addition, the conditions for enabling facial authentication include the orientation of the face in the captured image.

[0121] Therefore, electronic device 1 does not activate when the person is facing to the side or not facing forward, thus preventing unnecessary activation.

[0122] In addition, the conditions for enabling facial authentication include the brightness of the environment in which the electronic device 1 is used.

[0123] Therefore, electronic device 1 will not start when the operating environment is too bright due to sunlight or other reasons, making facial authentication impossible, thus preventing unnecessary startup.

[0124] Furthermore, when the facial authentication function is disabled, the face detection unit 330 (an example of a processor) detects facial regions containing faces from the captured image during face detection processing, regardless of whether the conditions for facial authentication are met. Additionally, when the chipset 303 detects a facial region from the captured image through the aforementioned face detection processing, it performs a startup instruction process to execute startup processing.

[0125] Therefore, even when facial authentication is disabled, electronic device 1 can detect facial regions containing faces in the captured images within a wider range and under more favorable conditions than when facial authentication is enabled, regardless of whether the conditions for facial authentication are met, thereby enabling activation. Thus, electronic device 1 can be easily activated even when facial authentication is disabled.

[0126] Furthermore, the control method in the electronic device 1 that performs startup processing from standby state based on the authentication result of facial authentication according to this embodiment includes the following steps: the face detection unit 330 (an example of a processor) processes image data of an image (captured image) captured by the imaging unit 120 (an example of an imaging device) and stored in a memory (e.g., system memory 304) in standby state to detect a facial region in the captured image that captures a face that meets the conditions for facial authentication; and the chipset (an example of a processor) performs startup processing when a facial region that meets the conditions for facial authentication is detected from the captured image.

[0127] Therefore, electronic device 1 only activates when it detects a facial region in an image that is suitable for facial authentication from the captured image while in standby mode, thus suppressing unnecessary activation. For example, it prevents electronic device 1 from activating unintentionally when the user or someone other than the user is simply passing by and using the electronic device 1 without their knowledge.

[0128] <Second Implementation>

[0129] Next, the second embodiment of the present invention will be described.

[0130] In the first embodiment, when the login authentication function based on facial authentication is effective, facial regions that meet the conditions for facial authentication are detected from the captured image. However, it is also possible to determine whether a facial region meets the conditions for facial authentication after detecting a facial region from the captured image regardless of whether the conditions for facial authentication are met.

[0131] Figure 9 This is a flowchart illustrating an example of HPD processing in standby mode according to this embodiment.

[0132] (Step S301) The HPD processing unit 313 determines whether the system's operating state is a standby state. If the HPD processing unit 313 determines that it is in a standby state (yes), it proceeds to step S303. On the other hand, if the HPD processing unit 313 determines that it is not in a standby state (no), it does not perform this process.

[0133] (Step S303) The HPD processing unit 313 determines whether the face-based login authentication function is valid. If the HPD processing unit 313 determines that the face-based login authentication function is valid (Yes), it instructs the face detection unit 330 to be set to normal face detection mode and proceeds to step S305. On the other hand, if the HPD processing unit 313 determines that the face-based login authentication function is invalid (No), it instructs the face detection unit 330 to be set to normal face detection mode and proceeds to step S311.

[0134] (Step S305) In normal face detection mode, the face detection unit 330 detects the face region from the captured image and proceeds to the processing step S307.

[0135] (Step S307) The face detection unit 330 determines whether a facial region has been detected. If the face detection unit 330 determines that a facial region has been detected (Yes), it proceeds to step S309. On the other hand, if the face detection unit 330 determines that no facial region has been detected (No), it returns to step S305.

[0136] (Step S309) The face detection unit 330 determines whether the detected face region meets the conditions for face authentication. If the face detection unit 330 determines that the face region meets the conditions for face authentication (Yes), it sends the detection result indicating that a face region meeting the conditions for face authentication has been detected to the HPD processing unit 313 and proceeds to step S315. On the other hand, if the face detection unit 330 determines that the face region does not meet the conditions for face authentication (No), since no face region meeting the conditions for face authentication has been detected, it returns to step S305.

[0137] (Step S311) The face detection unit 330 detects the face region from the captured image in the normal face detection mode and sends the detection result to the HPD processing unit 313. Then, the process proceeds to step S313.

[0138] (Step S313) The face detection unit 330 determines whether a face region has been detected. If the face detection unit 330 determines that a face region has been detected (Yes), it sends the detection result indicating that a face region has been detected to the HPD processing unit 313 and proceeds to the processing in step S315. On the other hand, if the face detection unit 330 determines that no face region has been detected (No), it returns to the processing in step S311.

[0139] (Step S315) Based on the detection results of the face detection unit 330, the HPD processing unit 313 issues a start instruction to the system processing unit 311 to perform start processing.

[0140] The first and second embodiments of the invention have been described in detail above with reference to the accompanying drawings. However, the specific structure is not limited to the embodiments described above, and may include designs that do not depart from the spirit of the invention. For example, the structures described in the above embodiments can be combined arbitrarily.

[0141] Furthermore, in the above embodiments, a structural example in which the camera unit 120 is built into the electronic device 1 has been described, but it is not limited to this. For example, the camera unit 120 may not be built into the electronic device 1, or it may be configured to be able to be installed on the electronic device 1 as an external accessory (e.g., any side of side 10a, 10b, 10c, etc.) and communicate with the electronic device 1 wirelessly or via wired connection.

[0142] Furthermore, in the above embodiment, the electronic device 1 detects the presence of a user by detecting the facial region containing the face in the captured image. However, the presence of a user can also be detected using a distance sensor (e.g., a proximity sensor) that detects the distance to an object. For example, a distance sensor is provided on the inner surface of the first frame 10 to detect objects (e.g., people) present in a detection range facing (forward) to the inner surface of the first frame 10. As an example, the distance sensor can be an infrared distance sensor configured to include a light-emitting part that emits infrared light and a light-receiving part that receives reflected light from the surface of the object. In addition, the distance sensor can also be a sensor that uses infrared light emitted by a light-emitting diode, or a sensor that uses an infrared laser, the infrared laser emitting light with a narrower wavelength than the infrared light emitted by the light-emitting diode. Furthermore, the distance sensor is not limited to an infrared distance sensor; any sensor that detects the distance to an object can be an ultrasonic sensor or a sensor using UWB (Ultra Wideband) radar, or other types of sensors. Alternatively, the distance sensor may not be built into the electronic device 1, or it may be configured to be mounted on the electronic device 1 as an external accessory (e.g., any of the sides 10a, 10b, 10c, etc.), and communicate with the electronic device 1 wirelessly or via a wired connection. Furthermore, the imaging unit 120 and the distance sensor may be integrated. Additionally, even when the facial authentication function is disabled, the electronic device 1 may detect the presence of a user not limited to the face, but by detecting an area where at least a part of the body is being photographed.

[0143] Furthermore, in the above embodiment, an example is shown where the face detection unit 330 is provided separately from the chipset 303. However, the face detection unit 330 may be partly or entirely provided in the chipset 303, or it may be partly or entirely provided in a processor integrated with the chipset 303. Additionally, the face detection unit 330 may be partly or entirely provided in the EC200. Furthermore, in the above embodiment, an example is shown where the chipset 303 includes an HPD processing unit 313. However, the EC200 may also include partly or entirely of the HPD processing unit 313.

[0144] Furthermore, the aforementioned standby state can include a dormant state, a power-off state, etc. A dormant state is, for example, equivalent to state S4 as defined in ACPI. A power-off state is, for example, equivalent to state S5 (power off) as defined in ACPI. Additionally, the standby state can include at least a state where the display on the screen is off (screen off), or a screen-locked state. A screen-locked state refers to a state where a preset image (e.g., a screen-locking image) is displayed on the display, making it impossible to visually confirm the content being processed, and the device cannot be used until the lock is released.

[0145] Furthermore, the aforementioned electronic device 1 has an internal computer system. Moreover, programs for implementing the functions of each structure of the electronic device 1 can be recorded on a computer-readable recording medium, and the processing within each structure of the electronic device 1 is performed by having the computer system read and execute the program recorded on the recording medium. Here, "having the computer system read and execute the program recorded on the recording medium" includes the computer system installation program. The term "computer system" here includes hardware such as an operating system and peripheral devices. Additionally, the "computer system" may also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Furthermore, "computer-readable recording medium" refers to portable media such as floppy disks, optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium storing the program can also be a non-transitory recording medium such as a CD-ROM.

[0146] Furthermore, the recording medium also includes internal or external recording media that can be accessed from a distribution server for distributing the program. Additionally, the program can be divided into multiple parts, each downloaded at different time intervals, and then assembled from various components of electronic device 1, with each part distributed via a different distribution server. Moreover, the term "computer-readable recording medium" also includes structures that retain the program for a certain period, such as a server in the case of sending the program via a network, or volatile memory (RAM) within a computer system acting as a client. Furthermore, the program described above can also be a structure used to implement the aforementioned functions. Further, it can also be a so-called differential file (differential program) that can be implemented by combining the aforementioned functions with a program already recorded in the computer system.

[0147] Alternatively, some or all of the functions of the electronic device 1 in the above embodiments can be implemented as integrated circuits such as LSI (Large Scale Integration). Each function can be processed individually, or some or all can be integrated for processing. Furthermore, the method of integrated circuit implementation is not limited to LSI; it can also be implemented using dedicated circuits or general-purpose processors. Additionally, if advancements in semiconductor technology lead to integrated circuit technologies that replace LSI, integrated circuits based on such technologies can also be used.

[0148] Furthermore, the electronic device 1 described in the above embodiments is not limited to PCs, tablet terminals, smartphones, etc., and can also be applied to home appliances and commercial appliances. As a home appliance, it can be applied to televisions, refrigerators with displays, microwave ovens, etc. For example, it can control the opening / closing of the television screen, or the opening / closing of the display screen of a refrigerator, microwave oven, etc., based on the approach or departure of a person. As a commercial appliance, it can be applied to vending machines, multimedia terminals, etc. For example, it can control the operation state based on the approach or departure of a person, such as turning the lights on / off of a vending machine, or turning the display screen on / off of a multimedia terminal.

Claims

1. An electronic device that performs startup processing from a standby state based on the authentication result of facial recognition, comprising: Memory, which temporarily stores image data of images captured by the imaging device; and The processor performs processing based on the image data stored in the aforementioned memory. The above processor performs: In the aforementioned standby state, the face detection processing involves processing image data from an image captured by the aforementioned imaging device and stored in the aforementioned memory, thereby detecting facial regions from the image that contain faces that meet the conditions for performing the aforementioned face authentication; and The activation instruction process involves executing the activation process if a facial region meeting the conditions for facial authentication is detected from the image through the aforementioned facial detection process. The aforementioned facial recognition function can be set to be enabled or disabled. When the facial authentication function is enabled, the processor detects facial regions that meet the conditions for facial authentication through the facial detection process. If the aforementioned facial authentication function is disabled, the processor, during the aforementioned facial detection process, will detect facial regions containing faces from the aforementioned image regardless of whether the conditions for performing the aforementioned facial authentication are met. If a facial region is detected from the image through the aforementioned facial detection process, the processor executes the aforementioned startup process in the aforementioned startup instruction process.

2. The electronic device according to claim 1, wherein, The conditions for performing the above-mentioned facial authentication include the size of the face in the above-mentioned image relative to the area of ​​the above-mentioned image.

3. The electronic device according to claim 1 or claim 2, wherein, The conditions for performing the above-mentioned facial authentication include the condition that the face captured in the above-mentioned image is located within the area of ​​the above-mentioned image.

4. The electronic device according to claim 1 or claim 2, wherein, The conditions for performing the above-mentioned facial authentication include the orientation of the face in the captured image.

5. The electronic device according to claim 1 or claim 2, wherein, The conditions for enabling the above-mentioned facial authentication include the brightness of the environment in which the electronic device is used.

6. A control method for an electronic device, the electronic device comprising: an image data memory for temporarily storing images captured by an imaging device, and a processor for processing the image data stored in the memory, wherein the electronic device performs a startup process from a standby state based on a facial authentication result, the control method comprising: In the standby state, the processor processes image data of an image captured by the imaging device and stored in the memory, thereby performing a face detection step to detect a facial region in the image that meets the conditions for facial authentication; and If a facial region that meets the conditions for performing the facial authentication is detected from the image, the processor executes the startup instruction processing step of the startup process. The aforementioned facial recognition function can be set to be enabled or disabled. When the aforementioned facial authentication function is enabled, the facial detection step involves detecting facial regions that meet the conditions for performing the aforementioned facial authentication. If the facial authentication function is set to be invalid, in the above steps of performing facial detection, facial regions with faces captured in the above images are detected from the above images regardless of whether the conditions for performing the above facial authentication are met. If facial regions are detected from the above images, the above-mentioned startup processing is performed in the above-mentioned startup instruction processing steps.

Images