Information processing device, and control method

Abstract

To appropriately perform screen luminance control and system operation control by using face detection.SOLUTION: An information processing device performs person detection processing for detecting the presence of a person and face authentication processing by detecting a face region where a face is photographed from a photographed image, instructs transition of a system operation state and change of screen luminance on the basis of a detection result of the person detection processing, and executes unlock processing for unlocking the system on the basis of the authentication result of the face authentication processing. Further, when the state transitions from a state in which the presence of a person has been detected to a state in which the presence of a person is no longer detected by the person detection processing, the information processing device lowers the screen luminance, starts unlock processing by using face authentication processing by locking the system before a first time period has elapsed, and after the first time period has elapsed, transits the system to a waiting state. Further in an image luminance lowered state, the information processing device continues the image luminance lowered state regardless of the person detection processing in response to locking of the system.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] For example, Patent Document 1 discloses a device that uses an infrared sensor to detect the approach or departure of a person, transitions to a usable state when it detects that a person has approached, and transitions to a state in which power consumption is reduced when it detects that a person has left. In recent years, the accuracy of detecting a face from an image has improved due to developments in computer vision and the like. Therefore, instead of detecting a person using an infrared sensor, a person is also detected by detecting a face from a captured image using an image sensor such as a camera. Detecting a person using face detection can more accurately detect that the person is a person.

[0003] In recent years, due to expectations for ESG (Environment, Social, Governance), attention has been focused on the function of reducing power consumption by reducing the luminance (brightness) of the display unit. For example, some information processing devices such as personal computers are controlled to reduce the brightness of the display screen when a person moves away or when a person is present but turns their face to the side. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-148895 A Summary of the Invention [Problem to be solved by the invention]

[0005] For example, in an information processing device such as a personal computer, when a person is no longer detected (i.e., the person leaves) after a certain period of time has elapsed, the screen brightness is reduced to reduce power consumption, and then the device is controlled to transition to a standby state (standby, etc.). However, depending on the system, there is a problem in that the music being played or the audio being distributed in a podcast may stop when the device transitions to the standby state.

[0006] As a countermeasure, it is possible to keep the system locked without transitioning to a standby state, but when the system is locked, face recognition processing may be executed at the system request as an authentication process to unlock the system. Here, depending on the system, the camera cannot be used simultaneously for face recognition processing at the system request and person detection processing by face detection. In that case, the right to use the camera is given priority to face recognition processing at the system request, so person detection processing by face detection cannot be performed. If the control by the person detection processing is disabled because the camera cannot be used in the person detection processing, a problem occurs in that the reduced screen brightness returns to the screen brightness before reduction.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device and a control method that can appropriately control screen brightness and system operation using face detection. [Means for solving the problem]

[0008] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention includes a memory that temporarily stores image data of an image captured by an imaging unit, a first processor that executes a person detection process for detecting a face area in which a face is captured from the image and detecting the presence of a person by processing the image data stored in the memory, and a face authentication process for detecting the face area from the image in response to a request from a system, a second processor that instructs a transition of an operating state of the system and a change in screen brightness of a display unit based on a detection result of the person detection process, and a third processor that executes an unlock process for unlocking the system based on an authentication result of the face authentication process, wherein the first processor is capable of exclusively using image data of the image captured by the imaging unit for the person detection process and the face authentication process, and the second processor is capable of exclusively using image data of the image captured by the imaging unit for the person detection process and the face authentication process. a brightness reduction process for reducing the screen brightness when the presence of a person is no longer detected from a state in which the presence of the person is detected by the person detection process; a system lock instruction process for issuing an instruction to lock the system before a first time has elapsed when the presence of a person is no longer detected from a state in which the presence of the person is detected by the person detection process; and a standby state instruction process for issuing an instruction to transition the system to a standby state after the first time has elapsed when the presence of a person is no longer detected from a state in which the presence of the person is detected by the person detection process, wherein the third processor locks the system in response to an instruction by the system lock instruction process and starts the unlocking process using the face authentication process in response to the system being locked, and the second processor, when the unlocking process using the face authentication process is started in response to the system being locked in a state in which the screen brightness has been reduced by the brightness reduction process, maintains the state in which the screen brightness has been reduced regardless of the person detection process.

[0009] In the information processing device, the first time period may be set as a threshold value for a period of time during which neither the use of a specific application running on a system nor user activity due to a user input continues.

[0010] In the above information processing device, when the unlocking process using the face recognition process is started in response to the system being locked while the screen brightness has been reduced by the brightness reduction process, the second processor may ignore the detection result by the person detection process and continue the screen brightness in the reduced state.

[0011] In the above information processing device, if a user input is detected before the first time has elapsed after reducing the screen brightness, the second processor may stop the brightness reduction process and return the screen brightness to the state before the reduction.

[0012] In the above information processing device, when the presence of the person is no longer detected from a state in which it was detected by the person detection process, the second processor may reduce the screen brightness in response to the lapse of a second time shorter than the first time, and may issue an instruction to lock the system by the system lock instruction process before the first time has elapsed and after a third time has elapsed since the screen brightness was reduced.

[0013] In the information processing device, when the system is unlocked by the unlocking process, the second processor may stop the brightness reducing process and return the screen brightness to the state before the reduction.

[0014] Also, according to a second aspect of the present invention, there is provided a control method for an information processing device including a memory for temporarily storing image data of an image captured by an imaging unit, a first processor for executing a person detection process for detecting a face area in which a face is captured from the image and detecting the presence of a person by processing the image data stored in the memory, and a face authentication process for detecting the face area from the image in response to a request from a system, a second processor for instructing a transition of an operating state of the system and a change in screen brightness of a display unit based on a detection result of the person detection process, and a third processor for executing an unlock process for unlocking the system based on an authentication result of the face authentication process, wherein the first processor is able to exclusively use image data of the image captured by the imaging unit for the person detection process and the face authentication process, and the second processor is operable to execute an unlock process for unlocking the system based on an authentication result of the face authentication process when the presence of a person is no longer detected from a state in which the presence of a person is detected by the person detection process. the system lock instruction step of instructing the system to transition to a standby state after the first time has elapsed when the presence of the person is no longer detected from a state in which the presence of the person is detected by the person detection process; a step of the third processor locking the system in response to an instruction from the system lock instruction step and starting the unlocking process using the face recognition process in response to the system being locked; and a step of the second processor continuing the reduced state of the screen luminance regardless of the person detection process when the unlocking process using the face recognition process is started in response to the system being locked with the screen luminance reduced by the luminance reduction step. Effect of the Invention

[0015] According to the above aspects of the present invention, it is possible to appropriately control the screen brightness and the system operation using face detection. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to an embodiment. [Diagram 2] 5 is a diagram showing an example of a person detection range of the information processing device according to the embodiment. [Diagram 3] 4 is a view for explaining an overview of HPD processing of the information processing device according to the embodiment. [Figure 4] 11A and 11B are diagrams showing an example of control when "Leave" is detected according to the embodiment. [Diagram 5] FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 6] FIG. 1 is a schematic block diagram showing an example of a functional configuration of an information processing apparatus according to an embodiment. [Figure 7] 11 is a flowchart showing an example of a screen luminance reduction process when "Leave" is detected according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view showing an example of the external configuration of an information processing device 1 according to the present embodiment.

[0018] The information processing device 1 is, for example, a notebook (clamshell) type PC (Personal Computer). The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis formed by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0019] The first housing 10 is also called the A cover or the display housing. The second housing 20 is also called the C cover or the system housing. In the following description, the sides of the first housing 10 and the second housing 20 on which the hinge mechanism 15 is provided are called the sides 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite the sides 10c and 20c are called the sides 10a and 20a, respectively. In the drawings, the direction from the side 20a to the side 20c is called the "rear", and the direction from the side 20c to the side 20a is called the "front". The right and left sides of the rear are called the "right" and "left", respectively. The left sides of the first housing 10 and the second housing 20 are called the sides 10b and 20b, respectively, and the right sides are called the sides 10d and 20d, respectively. Moreover, a state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as a "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Moreover, a state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as an "open state."

[0020] The external appearance of the information processing device 1 shown in FIG. 1 shows an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0021] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 10a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is merely an example, and the imaging unit 120 may be disposed in another location as long as it can face in a direction facing the display screen of the display unit 110.

[0022] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in a direction facing the display screen of the display unit 110 (i.e., in front of the information processing device 1). The predetermined imaging range is a range of an angle of view determined by an imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture an image including a person (user) present in front of the information processing device 1 (on the front side).

[0023] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct power on or off, transition from a standby state to a normal operation state, transition from the normal operation state to a standby state, etc. The normal operation state is an operation state of the system in which processing can be executed without particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0024] The standby state is a state in which at least a part of the system processing is restricted, and the power consumption is lower than that of the normal operation state. For example, the standby state may be a standby state, a sleep state, etc., and may be a state equivalent to the modern standby state in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI.

[0025] Further, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices that accept operation inputs from the user. Note that, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided as the input device, or a mouse or an external keyboard may be connected. In the case where a touch sensor is provided, an area corresponding to the display screen of the display unit 110 may be configured as a touch panel that accepts operations. Furthermore, the input device may include a microphone into which voice is input.

[0026] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first housing 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing, and are unable to function.

[0027] The information processing device 1 executes a human presence detection (HPD) process to detect a person present in front of the information processing device 1, based on a captured image captured by the imaging unit 120.

[0028] 2 is a diagram showing an example of a person detection range of the information processing device 1 according to this embodiment. In the example shown in the figure, a detection range FoV (Field of View: detection viewing angle) in front of the information processing device 1 is a range in which a person can be detected.

[0029] For example, the information processing device 1 detects a face area in which a face is captured from a captured image captured by the imaging unit 120, thereby determining whether or not a person (user) is present in front of the information processing device 1. The detection range FoV corresponds to the imaging angle of view captured by the information processing device 1. When a face area is detected from the captured image, the information processing device 1 determines that a person is present. On the other hand, when a face area is not detected from the captured image, the information processing device 1 determines that a person is not present.

[0030] The information processing device 1 controls the operation state of the system of the information processing device 1 according to the presence or absence of a person through HPD processing. For example, the information processing device 1 is controlled to a normal operation state when a person is present in front of the information processing device 1, and is controlled to a standby state when no person is present in front of the information processing device 1.

[0031] FIG. 3 is a diagram for explaining an outline of the HPD process of the information processing device 1 according to the present embodiment. The information processing device 1 detects a person in front of the information processing device 1 by the HPD process, and controls the operation state of the system of the information processing device 1 based on the presence or absence of the person. For example, as shown in (A) of FIG. 3, when the information processing device 1 detects a change from a state in which no person is present in front of the information processing device 1 (Absence) to a state in which a person is present (Presence), that is, when the information processing device 1 detects an approach of a person to the information processing device 1 (Approach), in the standby state, the system is automatically started and transitioned to a normal operation state. Also, as shown in (B) of FIG. 3, when the information processing device 1 detects a state in which a person is present in front of the information processing device 1 (Presence), in the normal operation state, the information processing device 1 continues the normal operation state. Also, as shown in (C) of FIG. 3, when the information processing device 1 detects a change from a state in which a person is present in front of the information processing device 1 (Presence) to a state in which a person is not present (Absence), that is, when the information processing device 1 detects a departure of the person from the information processing device 1 (Leave), the system is transitioned to the standby state.

[0032] For example, when the information processing device 1 changes from "Presence" to "Absence" (i.e., when "Leave" is detected), it reduces the screen brightness of the display unit 110, and then turns off the display after a certain period of time has elapsed, causing the device to transition to a standby state. This process of reducing the screen brightness in the HPD process is referred to as a "screen brightness reduction process."

[0033] Here, the original screen luminance before the screen luminance is reduced is, for example, the screen luminance in the "Presence" state, and is the screen luminance based on the luminance setting value initially set by the system, or the luminance setting value changed by the user. Hereinafter, the screen luminance based on the initially set luminance setting value, or the luminance setting value changed by the user, is referred to as "standard luminance." In contrast, the luminance reduced from the standard luminance is referred to as "low luminance." The luminance setting value of low luminance is preset, and is set to, for example, a value that results in a screen luminance of about 0 to 10% of the standard luminance.

[0034] Depending on the system, transitioning to a standby state may cause music being played or audio being distributed via a podcast to stop, so the information processing device 1 reduces the screen brightness and then temporarily locks the system without transitioning to a standby state. This allows the information processing device 1 to continue playing music or audio being distributed via a podcast without stopping it.

[0035] Furthermore, when the information processing device 1 locks the system, it starts an authentication process (unlock process) for unlocking the system. This authentication process is an authentication process (for example, a login authentication process) using face authentication, fingerprint authentication, password authentication, or the like. Since the information processing device 1 uses the camera for the face authentication process, it is unable to perform a person detection process using face detection. Therefore, the information processing device 1 keeps the screen brightness of the display unit 110 in a reduced state regardless of the person detection process.

[0036] Furthermore, if there is no user activity (such as use of a music playback application, use of a podcast, or user input) for a certain period of time after the information processing device 1 has locked the system, the information processing device 1 transitions the system to a standby state.

[0037] 4 is a timing chart showing an example of control when "Leave" is detected according to this embodiment. The screen brightness reduction process and the system operation state control process when "Leave" is detected will be described with reference to this diagram.

[0038] At time t1, the information processing device 1 is in a normal operating state, and the screen brightness of the display unit 110 is controlled to standard brightness (e.g., 80% brightness). At this time t1, the detection result of the HPD process is True (Presence), but when the detection result of the HPD process becomes False (Absence) at time t2, the detection result at time t1 becomes the last detected True (Presence), and the sleep timer starts to count the time T1. The time T1 is set as a threshold (e.g., 3 minutes) for the duration of a state in which there is no user activity.

[0039] Furthermore, when the detection result of the HPD process becomes False (Absence) at time t2, the leave timer starts to measure time T2. Time T2 is the time from when the detection result of the HPD process becomes False (Absence) to when it is determined to be "Leave," and is set to a predetermined time (for example, 18 seconds). Note that time T1 and time T2 may be set by the user.

[0040] When the detection result of the HPD process remains False (Absence) for a time T2, the information processing device 1 determines to "Leave" at time t3. When the information processing device 1 determines to "Leave", it starts a screen brightness reduction process (Start Dim) that reduces the screen brightness from standard brightness to low brightness (for example, 0% brightness).

[0041] Furthermore, when the information processing device 1 judges "Leave" at time t3, it starts counting time T3 (for example, 5 seconds) using a lock timer, and if the detection result of the HPD process remains False (Absence) for the time T3, it locks the system once at time t4 without transitioning to a standby state. This allows the information processing device 1 to continue playing music or audio distributed by Podcast without stopping it.

[0042] Furthermore, when the information processing device 1 locks the system at time t4, it starts a login authentication process for unlocking the system and keeps the screen brightness of the display unit 110 in a reduced state regardless of the HPD process.

[0043] When time T1 has elapsed with no user activity (music playback, podcast use, user input, etc.), information processing device 1 turns off the display of display unit 110 at time t5 and transitions to a standby state. In other words, since information processing device 1 does not transition to a standby state while user activity continues, music being played or audio being distributed in a podcast can continue without stopping.

[0044] 4, if there is an input to a HID (Human Interface Device) by the user (hereinafter referred to as "HID input") before the time T1 has elapsed, the information processing device 1 determines that a person is present (Presence) and returns the screen brightness of the display unit 110 to the standard brightness before reduction. The HID input is an input to the HID by the user, such as an operation input to the input device 150 (for example, the keyboard 151, the touch pad 153, etc.).

[0045] The configuration of the information processing device 1 according to this embodiment will be described in detail below. [Hardware configuration of information processing device] Fig. 5 is a schematic block diagram showing an example of a hardware configuration of an information processing device 1 according to this embodiment. In Fig. 5, components corresponding to those in Fig. 1 are given the same reference numerals. The information processing device 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400.

[0046] The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0047] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in a direction (forward) facing the inner surface of the first housing 10, and outputs the captured image to the main processing unit 300 and the face detection unit 210. For example, the imaging unit 120 includes a visible light camera (RGB camera) that captures images using visible light, and an infrared camera (IR camera) that captures images using infrared light.

[0048] The imaging section 120 may be configured to include either a visible light camera or an infrared camera, or may be configured to include both.

[0049] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0050] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0051] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), a random access memory (RAM), a read only memory (ROM), and a flash ROM. The storage unit 170 stores various programs such as an OS, a device driver, and an application, as well as various data acquired by the operation of the programs. For example, the storage unit 170 may store a luminance setting value for the above-mentioned screen luminance.

[0052] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into a voltage required by each unit. The power whose voltage has been converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0053] The EC200 is a microcomputer including a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and an input / output (I / O) logic circuit. The CPU of the EC200 reads a control program (firmware) prestored in its own ROM, and executes the read control program to fulfill its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to a power button 140, an input device 150, a power supply unit 400, and the like.

[0054] For example, the EC 200 communicates with the power supply unit 400 to obtain information on the battery state (such as remaining capacity) from the power supply unit 400 and outputs control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1 to the power supply unit 400. The EC 200 also obtains operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to the processing of the main processing unit 300 among the obtained operation signals.

[0055] The face detection unit 210 includes a processor that executes HPD processing and face authentication processing based on image data of a captured image captured by the imaging unit 120. The face detection unit 210 acquires image data of a captured image captured by the imaging unit 120, and temporarily stores the acquired image data in a memory. The memory that stores the image data may be the system memory 304, or may be a memory (not shown) in the face detection unit 210.

[0056] For example, the face detection unit 210 executes HPD processing (person detection processing) for detecting the presence of a person by detecting a face area in the captured image where a face is captured, by processing image data of the captured image acquired from the imaging unit 120. The face detection unit 210 also executes face authentication processing for detecting a face area in the captured image where a face is captured, and performing face authentication. As a face detection method, any detection method can be applied, such as a face detection algorithm for detecting a face based on facial feature information, or face detection using learning data (trained model) or a face detection library machine-learned based on facial feature information. The face detection unit 210 also executes face authentication processing in response to a request from an OS (Operating System), for example, as one of user authentication processes during login authentication.

[0057] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0058] The CPU 301 is a processor that executes processes based on BIOS programs, processes based on OS programs, processes based on application programs that run on the OS, etc. For example, the CPU 301 executes a startup process that starts the system from a standby state and transitions it to a normal operating state, a sleep process that transitions it from the normal operating state to a standby state, etc.

[0059] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing and generates display data under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110.

[0060] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires the detection result of the HPD processing, the authentication result of the face authentication processing, etc. from the face detection unit 210.

[0061] The system memory 304 is used as a reading area for the programs executed by the CPU 301, a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0062] The CPU 301, the GPU 302, and the chipset 303 may be configured as a single integrated processor, or some or each of them may be configured as individual processors. For example, in a normal operation state, the CPU 301, the GPU 302, and the chipset 303 are all in operation, but in a standby state, only at least a part of the chipset 303 is in operation.

[0063] [Functional configuration of information processing device] Next, a detailed description will be given of the functional configuration of the information processing device 1 that performs the screen luminance reduction process by the HPD process and the system operation state control process.

[0064] 6 is a schematic block diagram showing an example of a functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a face detection unit 210, a system processing unit 310, and an HPD processing unit 320. The face detection unit 210 corresponds to the face detection unit 210 in FIG. 5, and executes HPD processing and face authentication processing by face detection by processing image data of a captured image captured by the imaging unit 120. For example, the face detection unit 210 includes a face detection processing unit 211, a face authentication processing unit 212, and a priority determination unit 213.

[0065] The face detection processing unit 211 executes face detection processing to detect a face area in which a face is captured from the captured image by processing image data of the captured image acquired from the imaging unit 120. When the face detection processing unit 211 detects a face area from the captured image, it outputs "Presence" information indicating that a person is present in front of the information processing device 1 to the HPD processing unit 330. On the other hand, when the face detection processing unit 211 does not detect a face area from the captured image, it outputs "Absence" information indicating that no person is present in front of the information processing device 1 to the HPD processing unit 330.

[0066] The face authentication processing unit 212 executes face authentication processing to detect a face area from the image and perform face authentication by processing image data of the captured image acquired from the imaging unit 120. For example, the face authentication processing unit 212 executes face authentication processing in response to a request from the OS as one of user authentication processes during login authentication of the OS. The face authentication processing unit 212 outputs the authentication result to the system processing unit 310.

[0067] Here, the image data of the captured image captured by the imaging unit 120 can be exclusively used by the HPD process and the face authentication process in response to a request from the OS. Therefore, the priority determination unit 213 determines the priority of the use of the image data of the captured image captured by the imaging unit 120. For example, the priority is set higher for the use in response to a request from the OS. The priority determination unit 213 normally (when there is no request from the OS) gives the priority to the HPD process side, and the face detection processing unit 211 outputs the "Presence" information or the "Absence" information as a detection result to the HPD processing unit 330. On the other hand, when the face authentication processing unit 212 executes the face authentication process in response to a request from the OS, the priority determination unit 213 gives the priority to the use in response to the request from the OS, and the authentication result is output from the face authentication processing unit 212 to the system processing unit 310. At this time, the face detection processing unit 211 outputs invalid data as a detection result to the HPD processing unit 330.

[0068] The HPD processing unit 320 has a functional configuration realized when the CPU 301 executes a program that runs on the OS, or when the chipset 303 (e.g., a sensor hub) executes a program, and includes an HPD information acquisition unit 331, a leave timer 332, a lock timer 333, an HID input determination unit 334, a screen brightness change unit 335, and an HPD information output unit 336.

[0069] The HPD information acquisition unit 331 acquires "Presence" information, "Absence" information, and the like output from the face detection unit 210 as detection results of the HPD processing (human detection processing).

[0070] The leave timer 332 is a timer (Leave timer) that measures the time T2 (see FIG. 4) from when the HPD information acquisition unit 331 acquires the "Absence" information until it determines to "Leave."

[0071] The lock timer 333 is a timer (lock timer) that measures the time T3 (see FIG. 4) from when "Leave" is determined to when the system is locked.

[0072] The HID input determination unit 334 determines whether or not there is an HID input. For example, the HID input determination unit 334 determines whether or not there is an operation input by a user to the input device 150 (for example, the keyboard 151, the touchpad 153, etc.). As an example, when the EC 200 acquires an operation signal output from the input device 150 (for example, the keyboard 151, the touchpad 153, etc.), the HID input determination unit 334 determines that there is an HID input.

[0073] The screen luminance change unit 335 changes the screen luminance of the display unit 110 by HPD processing. When changing the screen luminance, the screen luminance change unit 335 changes the value of the luminance setting value stored in the storage unit 170. For example, when the HPD information acquisition unit 331 acquires "Absence" information from the face detection unit 210 in a state in which the screen luminance of the display unit 110 is controlled to standard luminance (i.e., when the presence of a person is no longer detected from a state in which it was detected), the screen luminance change unit 335 executes a screen luminance reduction process to reduce the screen luminance from standard luminance to low luminance. For example, when the HPD information acquisition unit 331 acquires "Absence" information from the face detection unit 210, the screen luminance change unit 335 reduces the screen luminance from standard luminance to low luminance in response to the passage of time T2.

[0074] Furthermore, when login authentication processing using face authentication processing is started in response to the system being locked in a state in which the screen brightness has been reduced to low brightness by the brightness reduction processing, the screen brightness change unit 335 maintains the state in which the screen brightness has been reduced regardless of the HPD processing. For example, when priority is given in the face detection unit 210 to the use at the request of the OS (use in login authentication processing using face authentication processing) of the image data of the captured image captured by the imaging unit 120, the screen brightness change unit 335 starts an "HPD disabled mode" that ignores the detection result by the HPD processing, and maintains the state in which the screen brightness has been reduced. In other words, the HPD disabled mode is a mode in which the detection result output from the face detection unit 210 is ignored and the state in which the screen brightness has been reduced is maintained.

[0075] When the system is unlocked by the login authentication process, the screen luminance change unit 335 ends the HPD disabled mode. Then, the screen luminance change unit 335 stops the luminance reduction process based on the detection result output from the face detection unit 210, and returns the screen luminance to the standard luminance before reduction.

[0076] Furthermore, if it is determined that there is an HID input before time T1 (see FIG. 4) has elapsed after reducing the screen luminance to low luminance, the screen luminance change unit 335 stops the luminance reduction process and returns the screen luminance to the standard luminance before reduction, regardless of whether the mode is HPD disabled or not. At this time, if the mode is HPD disabled, the screen luminance change unit 335 ends the HPD disabled mode and returns the screen luminance to the standard luminance before reduction.

[0077] Furthermore, after reducing the screen brightness to low brightness, if the screen brightness change unit 335 acquires "Presence" information from the face detection unit 210 (i.e., if a person is detected) before time T3 (see FIG. 4) has elapsed (before the system is locked, before the HPD disabled mode begins), the screen brightness change unit 335 also returns the screen brightness to the standard brightness before the reduction.

[0078] In addition, if the system transitions to a standby state after time T1 (see FIG. 4) has elapsed after reducing the screen brightness to low brightness, the screen brightness change unit 335 ends the HPD disabled mode so that startup by HPD processing is possible.

[0079] HPD information output section 336 outputs information instructing the operating state of the system to system processing section 310 based on the “Presence” information, “Absence” information, and the like acquired by HPD information acquisition section 331 .

[0080] For example, the HPD information output section 336 outputs the "Presence" information and the "Absence" information acquired by the HPD information acquisition section 331 to the system processing section 310 each time the information is acquired.

[0081] Furthermore, when the HPD information output section 336 acquires “Presence” information while the HPD information acquisition section 331 is acquiring “Absence” information, the HPD information output section 336 outputs “Approch” information to the system processing section 310 .

[0082] Furthermore, if the HPD information output unit 336 acquires "Absence" information while the HPD information acquisition unit 331 is acquiring "Presence" information, it outputs "Leave" information to the system processing unit 310 when time T2 (see FIG. 4) has elapsed since the HPD information acquisition unit 331 acquired the "Absence" information.

[0083] Furthermore, when the HPD information output unit 336 acquires "Absence" information while the HPD information acquisition unit 331 is acquiring "Presence" information, the HPD information output unit 336 executes a system lock instruction process to instruct to lock the system before time T1 (see FIG. 4) has elapsed. For example, the HPD information output unit 336 outputs "Leave" information to the system processing unit 310 as time T2 (see FIG. 4) has elapsed, and then outputs "Lock" information to the system processing unit 310 after time T3 (see FIG. 4) has elapsed, instructing to lock the system by the system lock instruction process.

[0084] The system processing unit 310 is a functional configuration realized by the CPU 11 executing the BIOS and OS programs or the programs executed on the OS. For example, the system processing unit 310 includes an operation control unit 311, a display control unit 312, a sleep timer 313, and an authentication processing unit 314 as functional configurations realized by executing the OS program.

[0085] The operation control unit 311 controls the operation state of the system. For example, when the power button 140 is operated in the standby state, the operation control unit 311 starts the system from the standby state based on an operation signal acquired from the power button 140 via the EC 200. In addition, the operation control unit 311 performs processes such as shutting down the system, transitioning to a standby state, and restarting the system based on an operation on a power menu (shutdown, sleep, restart, etc.) of the OS displayed on the display unit 110 in the normal operation state.

[0086] Furthermore, the operation control unit 311 controls the operation state of the system by HPD processing. For example, when the operation control unit 311 stops acquiring "Presence" information from the HPD processing unit 320 in the normal operation state (i.e., when "Absence" information is acquired), the operation control unit 311 uses the sleep timer 313 to measure the elapsed time since the last acquisition of "Presence" information, and transitions to a standby state after the elapse of time T1 (see FIG. 4).

[0087] The sleep timer 313 may start counting the time T1 when the last "Presence" information is obtained from the HPD processing unit 320, or when the first "Absence" information is obtained from the HPD processing unit 320. The sleep timer 313 may also start counting the time T1 when the "Leave" information is obtained from the HPD processing unit 320.

[0088] Furthermore, the operation control unit 311 locks the system in response to an instruction by a system lock instruction process of the HPD processing unit 320. For example, the operation control unit 311 locks the system in response to acquiring “Lock” information from the HPD processing unit 320.

[0089] Furthermore, when the operation control unit 311 locks the system, it starts a login authentication process for unlocking the system based on the authentication result of the user authentication. As the authentication process for performing the user authentication, authentication processes such as face authentication, fingerprint authentication, and password authentication can be applied. When performing the login authentication process using face authentication, the operation control unit 311 requests the face detection unit 210 to perform face authentication process using image data of the captured image captured by the imaging unit 120.

[0090] Furthermore, the operation control unit 311 unlocks the system based on the authentication result of user authentication in the login authentication process. For example, the operation control unit 311 unlocks the system based on the authentication result of face authentication process.

[0091] If the operation control unit 311 acquires "Presence" information from the HPD processing unit 320 before time T1 has elapsed (actually, before time T2 has elapsed and before time T3 has elapsed), it ends the timekeeping by the sleep timer 313 and continues the normal operation state. Also, if the operation control unit 311 determines that there has been an HID input in the HPD processing unit 320 before time T1 has elapsed (i.e., when an input by the user is detected), it ends the timekeeping by the sleep timer 313 and continues the normal operation state.

[0092] The display control unit 312 controls the display on and off of the display unit 110. The display control unit 312 also controls the screen luminance of the display unit 110 when the display is on. Specifically, the display control unit 312 controls the screen luminance of the display unit 110 based on a luminance setting value stored in the storage unit 170. This luminance setting value is initially set by the system, and can be changed from the initial setting by the user according to the usage environment or preferences. The luminance setting value is also changed by the HPD processing unit 320 (screen luminance change unit 335).

[0093] [Screen brightness reduction processing operation] Next, the operation of the screen luminance reduction process when "Leave" is detected by HPD processing will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the screen luminance reduction process when "Leave" is detected according to this embodiment. Here, it is assumed that the information processing device 1 is in the "Presence" state in a normal operating state, and the screen luminance of the display unit 110 is controlled to standard luminance. The HPD processing unit 320 outputs the "Presence" information to the system processing unit 310 every time it acquires "Presence" information from the face detection unit 210.

[0094] (Step S101) The HPD processing unit 320 determines whether or not "Presence" information has been acquired from the face detection unit 210. If the HPD processing unit 320 determines that "Presence" information has been acquired (YES), it performs the process of step S101 again. On the other hand, if the HPD processing unit 320 has acquired "Absence" information from the face detection unit 210, it determines that "Presence" information has not been acquired (NO), and proceeds to the process of step S103. Furthermore, if the HPD processing unit 320 acquires "Absence" information, it outputs the "Absence" information to the system processing unit 310 each time it acquires it.

[0095] (Step S103) When system processing unit 310 acquires "Absence" information from HPD processing unit 320 in step S101, it starts measuring the elapsed time (time T1) since the last acquisition of "Presence" information using sleep timer 313 (start sleep timer). In response to acquiring "Absence" information in step S101, HPD processing unit 320 also starts measuring time T2 (see FIG. 4) from acquisition of "Absence" information to the determination of "Leave" using leave timer 332 (start leave timer). Then, the process proceeds to step S105.

[0096] (Step S105) The HPD processing unit 320 determines whether or not "Presence" information has been acquired from the face detection unit 210. The HPD processing unit 320 also determines whether or not there has been an HID input. If the HPD processing unit 320 determines that "Presence" information has been acquired (YES) or that there has been an HID input (YES), it returns to the process of step S101, and otherwise (NO), it proceeds to the process of step S107.

[0097] (Step S107) The HPD processing unit 320 judges whether or not the timing of the time T2 has ended (Leave timer has ended). If the HPD processing unit 320 judges that the timing of the time T2 has not ended (Leave timer has ended) (NO), the process returns to step S105. On the other hand, if the HPD processing unit 320 judges that the timing of the time T2 has ended (Leave timer has ended) (YES), the process proceeds to step S109.

[0098] (Step S109) The HPD processing unit 320 starts a screen brightness reduction process, and reduces the brightness setting value of the screen brightness from standard brightness to low brightness. Furthermore, the HPD processing unit 320 judges "Leave" because time T2 has elapsed, and outputs "Leave" information to the system processing unit 310. Furthermore, the HPD processing unit 320 uses the lock timer 333 to start measuring time T3 (see FIG. 4) from the judgment of "Leave" to the locking of the system (Lock timer start). Then, the process proceeds to step S111.

[0099] (Step S111) The HPD processing unit 320 determines whether or not "Presence" information has been acquired from the face detection unit 210. The HPD processing unit 320 also determines whether or not there has been an HID input. If the HPD processing unit 320 determines that "Presence" information has been acquired (YES) or that there has been an HID input (YES), it proceeds to processing of step S113, and otherwise (NO), it proceeds to processing of step S115.

[0100] (Step S113) The HPD processing unit 320 judges whether or not the timing of the time T3 has ended (Lock timer has ended). If the HPD processing unit 320 judges that the timing of the time T3 has not ended (Lock timer has ended) (NO), the process returns to step S111. On the other hand, if the HPD processing unit 320 judges that the timing of the time T3 has ended (Lock timer has ended) (YES), the process proceeds to step S117.

[0101] (Step S115) The HPD processing unit 320 stops the screen luminance reduction process, returns the luminance setting value of the screen luminance to the standard luminance, and returns to the process of step S101.

[0102] (Step S117) The HPD processing unit 320 outputs the "Lock" information to the system processing unit 310. The system processing unit 310 locks the system in response to acquiring the "Lock" information from the HPD processing unit 320. Then, the process proceeds to step S119.

[0103] (Step S119) The HPD processing unit 320 starts an HPD disabled mode that ignores the detection result by the HPD processing, and continues the state in which the screen luminance is reduced to low luminance regardless of the HPD processing. For example, the HPD processing unit 320 fixes the luminance setting value of the screen luminance to low luminance. Then, the process proceeds to step S121.

[0104] (Step S121) In response to locking the system, the system processing unit 310 starts login authentication processing. For example, the system processing unit 310 executes login authentication processing using face authentication, fingerprint authentication, password authentication, or the like. When performing login authentication processing using face authentication, the system processing unit 310 requests the face detection unit 210 to perform face authentication processing using image data of an image captured by the imaging unit 120. The face detection unit 210 changes the priority of use of image data of an image captured by the imaging unit 120 from the HPD processing side to the login authentication processing side. Then, the process proceeds to step S123.

[0105] (Step S123) The HPD processing unit 320 determines whether or not there has been an HID input. If the HPD processing unit 320 determines that there has been an HID input (YES), the process proceeds to step S125. On the other hand, if the HPD processing unit 320 determines that there has been no HID input (NO), the process proceeds to step S127.

[0106] (Step S125) The HPD processing unit 320 returns the luminance setting value of the screen luminance to the standard luminance and fixes it, and returns to the processing of step S123. In other words, when the login authentication processing is started in step S121, the login authentication processing is performed with the screen luminance reduced to low luminance while there is no HID input, and when there is an HID input, the login authentication processing is performed with the screen luminance returned to standard luminance. Note that after returning the luminance setting value of the screen luminance to standard luminance, if a state in which there is no HID input continues for a certain period of time or more, the HPD processing unit 320 may change the luminance setting value of the screen luminance to low luminance again.

[0107] (Step S127) The system processing unit 310 judges whether or not the measurement of the time T1 has ended (sleep timer has ended). If the system processing unit 310 judges that the measurement of the time T1 has not ended (NO), the process returns to step S123. On the other hand, if the system processing unit 310 judges that the measurement of the time T1 has ended (YES), the process proceeds to step S129.

[0108] If the system processing unit 310 determines that there is an HID input before determining that the clocking of time T1 has ended in step S127 (step S123: YES) and authentication by the login authentication process is successful, it unlocks the system, transitions to the normal operation state (transitions to step S101), and cancels the HPD disabled mode. On the other hand, if the system processing unit 310 determines that there is no HID input before determining that the clocking of time T1 has ended in step S127 (step S123: NO), it continues clocking time T1 with the screen brightness reduced to low brightness and the system locked, even if authentication by the login authentication process is successful.

[0109] That is, in a state where there is no HID input, the system processing unit 310 continues to measure the time T1 with the screen brightness reduced to low brightness and the system locked, regardless of whether authentication by the login authentication process is successful or not, and proceeds to the process of step S129 when the measurement of the time T1 ends (sleep timer ends). In addition, in a state where there is an HID input, the system processing unit 310 continues to measure the time T1 with the screen brightness returned to standard brightness and the system locked, and proceeds to the process of step S129 when the measurement of the time T1 ends (sleep timer ends) without authentication by the login authentication process being successful. Note that the measurement of the time T1 started by using the sleep timer 313 in step S103 may be reset and measured again when it is determined in step S123 that there is an HID input.

[0110] (Step S129) System processing unit 310 controls display unit 110 to turn off the display, and transitions the system to a standby state. Also, HPD processing unit 320 ends the HPD disabled mode.

[0111] If the login authentication process started in step S121 is successful, the system processing unit 310 releases the lock. The HPD processing unit 320 returns the brightness setting value of the screen brightness to the standard brightness and ends the HPD disabled mode. Then, the process returns to step S101.

[0112] [Summary of the first embodiment] As described above, the information processing device 1 according to the present embodiment includes a memory (for example, a system memory 304) that temporarily stores image data of an image captured by the imaging unit 120. The information processing device 1 also includes a face detection unit 210 (an example of a first processor) that executes an HPD process (an example of a person detection process) for detecting a face area in which a face is captured from the captured image and detecting the presence of a person by processing the image data stored in the memory, and a face authentication process for detecting a face area from the captured image and performing face authentication in response to a request from a system (for example, an OS). The information processing device 1 also includes an HPD processing unit 330 (an example of a second processor, for example, a chipset 303) that instructs a transition of the operating state of the system and a change in the screen brightness of the display unit 110 based on the detection result of the HPD process, and a system processing unit 310 (an example of a third processor, for example, an OS 301) that executes a login authentication process (an example of an unlock process) for unlocking the system based on the authentication result of the face authentication process. Here, the face detection unit 210 can exclusively use the image data of the image captured by the imaging unit 120 for the HPD processing and the face authentication processing.

[0113] For example, the HPD processing unit 330 executes a brightness reduction process for reducing the screen brightness when the presence of a person is no longer detected from a state where it was detected by the HPD processing, a system lock instruction process for issuing an instruction to lock the system before a time T1 (an example of a first time) has elapsed when the presence of a person is no longer detected from a state where it was detected by the HPD processing, and a standby state instruction process for issuing an instruction to transition the system to a standby state after the time T1 has elapsed when the presence of a person is no longer detected from a state where it was detected by the HPD processing. The system processing unit 310 also locks the system in response to an instruction from the system lock instruction process, and starts a login authentication process using face authentication process in response to the system being locked. Then, when the login authentication process using face authentication process is started in response to the system being locked in a state where the screen brightness has been reduced by the brightness reduction process, the HPD processing unit 330 maintains the state where the screen brightness has been reduced regardless of the HPD processing.

[0114] As a result, when a person is no longer detected after being detected (i.e., when the person leaves), the information processing device 1 can reduce power consumption by reducing the screen brightness, and since the system is temporarily locked without transitioning to a standby state, music being played or audio being distributed in a podcast can be prevented from being stopped, and the reduced screen brightness can be maintained even after the system is locked. Therefore, the information processing device 1 can appropriately control the screen brightness and the system operation using face detection.

[0115] For example, the above-mentioned time T1 is set as a threshold value for the time during which a state in which there is no use of a particular application (eg, a music playback application, a podcast, etc.) running on the system or no user activity through an HID input continues.

[0116] This allows the information processing device 1 to reduce the screen brightness when the person leaves so that the user activity is not stopped while the user activity is continuing.

[0117] Furthermore, if login authentication processing using face recognition processing is started in response to the system being locked while the screen brightness has been reduced by the brightness reduction processing, the HPD processing unit 330 ignores the detection result by the HPD processing and maintains the reduced screen brightness state.

[0118] This allows the information processing device 1 to maintain the screen brightness at a reduced level even when the system is executing login authentication processing.

[0119] Furthermore, if an HID input is detected before the time T1 has elapsed after the HPD processing unit 330 has reduced the screen luminance, the HPD processing unit 330 stops the luminance reduction process and returns the screen luminance to the level before reduction.

[0120] As a result, the information processing device 1 can reduce the screen luminance when a person leaves and then, when the person returns, return the screen luminance to the level before reduction.

[0121] Furthermore, when the presence of a person is no longer detected after being detected by HPD processing, the HPD processing unit 330 reduces the screen brightness in response to the passage of time T2 (an example of a second time) that is shorter than time T1, and issues an instruction to lock the system using the above-mentioned system lock instruction processing before time T1 has elapsed and after time T3 (an example of a third time) has elapsed since the screen brightness was reduced.

[0122] This enables the information processing device 1 to prevent the screen brightness from being unnecessarily reduced just because a person moves away for an instant, and to prevent an unnecessarily transition to a lock screen.

[0123] Furthermore, when the system is unlocked by the login authentication process, the HPD processing unit 330 stops the brightness reduction process and returns the screen brightness to the state before reduction.

[0124] As a result, the information processing device 1 can reduce the screen luminance when a person leaves and then, when the person returns, return the screen luminance to the level before reduction.

[0125] Moreover, according to the present embodiment, a control method in an information processing device 1 including a memory (e.g., the system memory 304) for temporarily storing image data of an image captured by the imaging unit 120, a face detection unit 210 (an example of a first processor), an HPD processing unit 330 (an example of a second processor, e.g., the chipset 303), and a system processing unit 310 (an example of a third processor, e.g., the OS 301) includes the steps of: executing an HPD process (an example of a person detection process) in which the face detection unit 210 processes the image data stored in the memory to detect a face area in which a face is captured from the captured image and detect the presence of a person; executing a face authentication process in which the face area is detected from the captured image in response to a request from the system (e.g., the OS) and performs face authentication; instructing the HPD processing unit 330 to change the operating state of the system and the screen brightness of the display unit 110 based on the detection result of the HPD processing; and executing a login authentication process (an example of an unlocking process) in which the system processing unit 310 unlocks the system based on the authentication result of the face authentication processing. Here, the face detection unit 210 can exclusively use the image data of the image captured by the imaging unit 120 for the HPD process and the face authentication process.

[0126] For example, the control method in the information processing device 1 further includes a brightness reduction step of reducing screen brightness by the HPD processing unit 330 when the presence of a person is no longer detected from a state in which it was detected by the HPD processing; a system lock instruction step of issuing an instruction to lock the system before time T1 (an example of a first time) has elapsed from a state in which the presence of a person is no longer detected from a state in which it was detected by the HPD processing; a standby state instruction step of issuing an instruction to transition the system to a standby state after time T1 has elapsed from a state in which the presence of a person is no longer detected from a state in which it was detected by the HPD processing; a step of the system processing unit 310 locking the system in response to an instruction from the system lock instruction processing and starting login authentication processing using face authentication processing in response to the system being locked; and a step of the HPD processing unit 330 continuing the state in which the screen brightness has been reduced by the brightness reduction step, regardless of HPD processing, when login authentication processing using face authentication processing has been started in response to the system being locked.

[0127] As a result, the control method in the information processing device 1 can reduce power consumption by reducing the screen brightness when a person is no longer detected from a state in which a person was detected (i.e., when the person leaves), and since the system is temporarily locked without transitioning to a standby state, it is possible to prevent the music being played or the audio being distributed in a podcast from being stopped, and the reduced screen brightness state can be continued even after the system is locked. Therefore, the control method in the information processing device 1 can appropriately control the screen brightness and the operation of the system using face detection.

[0128] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiment can be combined in any combination.

[0129] Also, although a configuration example in which the imaging unit 120 is built into the information processing device 1 has been described, the present invention is not limited to this. For example, the imaging unit 120 does not have to be built into the information processing device 1, and may be configured to be attachable to the information processing device 1 (for example, any one of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or via a wire.

[0130] In the above embodiment, an example has been shown in which the face detection unit 210 is provided separately from the CPU 301 and the chipset 303, but a part or all of the face detection unit 210 may be provided in the chipset 303, or may be provided in a processor integrated with the CPU 301 or the chipset 303. For example, the CPU 301, the chipset 303, and the face detection unit 210 may be configured as separate processors, or may be integrated into a single processor. In addition, a part or all of the face detection unit 210 may be provided in the EC 200.

[0131] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, power-off state, etc. are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0132] The information processing device 1 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0133] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0134] In addition, some or all of the functions of the information processing device 1 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used.

[0135] Furthermore, the information processing device 1 of the above embodiment is not limited to a notebook PC, but may be, for example, a desktop PC. [Explanation of symbols]

[0136] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Face detection unit, Face detection processing unit 211, Face authentication processing unit 212, Priority determination unit 213, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Operation control unit, 312 Display control unit, 313 Sleep timer, 314 Authentication processing unit, 320 HPD processing unit, 331 HPD information acquisition unit, 332 Leave timer, 333 Lock timer, 334 HID input determination unit, 335 Screen brightness change unit, 336 HPD information output unit, 400 Power supply unit

Claims

1. A memory that temporarily stores image data of an image captured by the imaging unit; a first processor that processes image data stored in the memory to execute a person detection process for detecting a face area in the image where a face is captured and detecting the presence of a person, and a face authentication process for detecting the face area in the image and performing face authentication in response to a request from a system; a second processor that instructs a transition of an operating state of the system and a change in screen luminance of a display unit based on a detection result of the person detection process; a third processor that executes an unlocking process to unlock the system based on an authentication result of the face authentication process; Equipped with The first processor, Image data of the image captured by the imaging unit can be exclusively used in the person detection process and the face authentication process, The second processor, a brightness reduction process of reducing the screen brightness when the presence of the person is no longer detected from a state in which the presence of the person is detected by the person detection process; a system lock instruction process for issuing an instruction to lock the system before a first time period elapses when the presence of the person is no longer detected by the person detection process; a standby state instruction process for instructing the system to transition to a standby state after the first time has elapsed when the presence of the person is no longer detected by the person detection process; Run The third processor, locking the system in response to an instruction by the system lock instruction process, and starting the unlock process using the face authentication process in response to the system being locked; The second processor, When the unlock process using the face authentication process is started in response to the system being locked in a state in which the screen brightness has been reduced by the brightness reduction process, the state in which the screen brightness has been reduced is continued regardless of the person detection process. Information processing device.

2. The first time period is set as a threshold value for a period of time during which no user activity occurs due to the use of a specific application running on the system or due to user input. The information processing device according to claim 1 .

3. The second processor, When the unlock process using the face authentication process is started in response to the system being locked in a state in which the screen brightness has been reduced by the brightness reduction process, the detection result by the person detection process is ignored, and the state in which the screen brightness has been reduced is continued. The information processing device according to claim 1 .

4. The second processor, if a user input is detected before the first time period has elapsed after the screen luminance has been reduced, the luminance reduction process is stopped and the screen luminance is returned to the state before the reduction. The information processing device according to claim 1 .

5. The second processor, when the presence of the person is no longer detected from a state in which the presence of the person has been detected by the person detection process, the screen luminance is reduced in response to the lapse of a second time period shorter than the first time period, and an instruction to lock the system is given by the system lock instruction process before the lapse of the first time period and after a third time period has elapsed since the screen luminance was reduced. The information processing device according to claim 1 .

6. The second processor, When the system is unlocked by the unlocking process, the brightness reduction process is stopped and the screen brightness is returned to the state before the reduction. The information processing device according to claim 1 .

7. A control method for an information processing device comprising: a memory for temporarily storing image data of an image captured by an imaging unit; a first processor for executing a person detection process for detecting a face area in which a face is captured from the image and detecting the presence of a person by processing the image data stored in the memory; and a face authentication process for detecting the face area from the image and performing face authentication in response to a request from a system; a second processor for instructing a transition of an operating state of the system and a change in screen brightness of a display unit based on a detection result from the person detection process; and a third processor for executing an unlock process for unlocking the system based on an authentication result from the face authentication process, The first processor, Image data of the image captured by the imaging unit can be exclusively used in the person detection process and the face authentication process, The second processor: a brightness reducing step of reducing the screen brightness when the presence of the person is no longer detected from a state in which the presence of the person is detected by the person detection process; a system lock instruction step of issuing an instruction to lock the system before a first time period elapses when the presence of the person is no longer detected by the person detection process; a standby state instruction step of instructing the system to transition to a standby state after the first time has elapsed when the presence of the person is no longer detected by the person detection process; The third processor: a step of locking the system in response to an instruction in the system lock instruction step, and starting the unlocking process using the face authentication process in response to the system being locked; The second processor: a step of, when the unlocking process using the face authentication process is started in response to the system being locked in a state in which the screen brightness has been reduced by the brightness reducing step, continuing the state in which the screen brightness has been reduced regardless of the person detection process; A control method comprising:

Images