Information processing apparatus and control method

Through the combination of facial detection technology and system request, the problem that the information processing device cannot effectively reduce brightness and transfer to standby state when a person leaves, realizes brightness control and system action management, ensuring power consumption suppression and user experience At the same time, unnecessary state transfer is avoided.

CN119027994APending Publication Date: 2024-11-26LENOVO (SINGAPORE) PTE LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410602848.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-26
Filing Date
2024-05-15
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

After detecting that the person leaves, the existing information processing device cannot effectively reduce the brightness of the display screen and transfer to the standby state, resulting in poor power consumption suppression effect, and at the same time, the reproduction of music and podcast sounds may stop.

Method used

Facial detection technology is adopted to detect the presence of the human body by shooting image data, and facial authentication is carried out in combination with system requests to realize dynamic control of picture brightness and management of system actions, ensuring that the brightness is reduced when the person leaves and temporarily locks the system, avoiding transfer to standby state.

Benefits of technology

It realizes the effective reduction of the display brightness when a person leaves, suppresses power consumption, and continues to play music and podcast sound after the system is locked, ensuring the user experience, and at the same time returning to the original brightness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119027994A_ABST
    Figure CN119027994A_ABST
Patent Text Reader

Abstract

The invention relates to an information processing apparatus and a control method. The information processing device executes a person detection process for detecting the presence of a person by detecting a face region in which a face is captured from a captured image, and a face authentication process, and instructs a transition in the operating state of the system and a change in screen brightness on the basis of the detection result of the person detection process. A lock release process for releasing the lock of the system is executed on the basis of the authentication result of the face authentication process. Furthermore, when the information processing apparatus changes from a state in which the presence of a person is detected by the person detection process to a state in which the presence of a person is not detected, the information processing apparatus lowers the screen brightness, locks the system before a first time has elapsed, and starts a lock release process using the face authentication process. And after the first time, the system is transferred to the standby state. In addition, the information processing apparatus, in a state in which the screen luminance has been reduced, continues the state in which the screen luminance has been reduced in accordance with the system being locked regardless of the human detection process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing device and a control method. Background Art

[0002] For example, Patent Document 1 discloses a device that uses an infrared sensor to detect a person approaching or leaving. If a person is detected approaching, the device is switched to a usable state, and if a person is detected leaving, the device is switched to a state where power consumption is suppressed. In addition, in recent years, due to the development of computer vision and the like, the detection accuracy when detecting a face from an image has increased. Therefore, instead of detecting a person based on an infrared sensor, a person is detected by detecting a face from a captured image using a camera or other capturing sensor. Detection of a person based on face detection can more accurately detect a person.

[0003] In recent years, due to the expectation of ESG (Environment, Social, Governance), the function of reducing the brightness (brightness) of the display unit (display) to reduce power consumption has attracted attention. For example, in information processing devices such as personal computers, when a person leaves or when a person is present but faces to the side, the screen brightness of the display is controlled to be reduced.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2016-148895

[0005] For example, in an information processing device such as a personal computer, if the state of detecting a person changes to not detecting a person (i.e., if the person leaves), the screen brightness is reduced to suppress power consumption, and control is performed to shift to a standby state (such as standby) after a certain period of time has passed from the time when the specified measurement starts. However, depending on the system, if the state shifts to the standby state, there is a problem that the music being played, the sound distributed by the podcast, etc., will stop.

[0006] As a countermeasure, it is considered to lock the system instead of switching to the standby state. However, as an authentication process for unlocking the system when the system is locked, a facial authentication process may be executed by a system request. Here, depending on the system, the camera cannot be used simultaneously in the facial authentication process based on the system request and the human detection process based on face detection. In this case, the facial authentication process based on the system request is given priority to use the camera, so the human detection process based on face detection cannot be performed. If the camera cannot be used in the human detection process and the control based on the human detection process is invalidated, there is a problem that the screen brightness after reduction returns to the screen brightness before reduction. Summary of the invention

[0007] The present invention has been made in view of the above-mentioned circumstances, and one object of the present invention is to provide an information processing device and a control method capable of appropriately controlling screen brightness and system operation using face detection.

[0008] The present invention is completed to solve the above-mentioned problems. The information processing device involved in the first mode of the present invention comprises: a memory that temporarily stores image data of an image captured by the imaging unit; a first processor that performs human detection processing and facial recognition processing by processing the image data stored in the memory, wherein in the human detection processing, a facial area in which a face is captured is detected from the image to detect the presence of a person, and in the facial recognition processing, the facial area is detected from the image according to a request of the system to perform facial recognition; a second processor that indicates the transition of the system's action state and the change of the screen brightness of the display unit based on the detection result of the human detection processing; and a third processor that performs a lock release processing for releasing the lock of the system based on the authentication result of the facial recognition processing, wherein the first processor can exclusively use the image data of the image captured by the imaging unit in the human detection processing and the facial recognition processing, and the second processor performs a brightness reduction processing, a system lock indication processing and a standby state indication processing, and in the brightness reduction processing, When the state in which the presence of the person is detected by the person detection processing becomes that in which the presence of the person is not detected, the brightness of the screen is lowered; in the system lock instruction processing, when the state in which the presence of the person is detected by the person detection processing becomes that in which the presence of the person is not detected, an instruction to lock the system is performed before a first time has passed; in the standby state instruction processing, when the state in which the presence of the person is detected by the person detection processing becomes that in which the presence of the person is not detected, an instruction to transfer the system to the standby state is performed after the first time has passed; the third processor locks the system according to the instruction based on the system lock instruction processing, and starts the lock release processing using the facial recognition processing according to the system being locked; when the second processor starts the lock release processing using the facial recognition processing according to the system being locked in the state in which the brightness of the screen is lowered by the brightness reduction processing, the state in which the brightness of the screen is lowered is continued regardless of the person detection processing.

[0009] In the information processing device, the first time period may be set as a threshold value of a time period during which no user activity based on user input or use of a specific application running on the system continues.

[0010] The above-mentioned information processing device can also be configured so that when the above-mentioned second processor, in a state where the above-mentioned screen brightness is reduced by the above-mentioned brightness reduction processing, starts the above-mentioned lock release processing using the above-mentioned facial recognition processing based on the above-mentioned system being locked, the detection result of the above-mentioned human detection processing is ignored and the state of reducing the above-mentioned screen brightness continues.

[0011] The information processing device may be configured such that, when the second processor detects a user input before the first time has elapsed after reducing the screen brightness, the second processor stops the brightness reduction process and returns the screen brightness to the level before reduction.

[0012] The above-mentioned information processing device can also be configured such that, when the state in which the presence of the above-mentioned person is detected through the above-mentioned person detection processing becomes that in which the presence of the above-mentioned person is not detected, the above-mentioned second processor reduces the brightness of the above-mentioned screen according to the lapse of a second time shorter than the above-mentioned first time, and before the lapse of the above-mentioned first time and after a third time has passed after the brightness of the above-mentioned screen has been reduced, an instruction to lock the above-mentioned system is issued through the above-mentioned system lock instruction processing.

[0013] In the information processing device, the second processor may be configured to stop the brightness reduction process and return the screen brightness to a level before the reduction when the system is locked by the lock release process.

[0014] In addition, a second embodiment of the present invention relates to a control method, which is a control method in an information processing device, the information processing device comprising: a memory for temporarily storing image data of an image captured by a capturing unit; a first processor for performing a person detection process and a face recognition process by processing the image data stored in the memory, wherein in the person detection process, a facial area in which a face is captured is detected from the image to detect the presence of a person, and in the face recognition process, the face recognition is performed by detecting the facial area from the image in response to a request from the system; a second processor for instructing a transition of an action state of the system and a change of screen brightness of a display unit based on a detection result of the person detection process; and a third processor for performing a lock release process for releasing the lock of the system based on an authentication result of the face recognition process, the first processor being able to exclusively use the image data of the image captured by the capturing unit in the person detection process and the face recognition process, the control method comprising: a brightness reduction step, the second processor performing a brightness reduction step after the second processor detects the person through the person detection process. a step of lowering the screen brightness when the state in which the presence of the person is detected changes to the state in which the presence of the person cannot be detected; a system lock indication step, in which the second processor indicates to lock the system before a first time has passed when the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person cannot be detected; a standby state indication step, in which the second processor indicates to transfer the system to a standby state after the first time has passed when the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person cannot be detected; a step in which the third processor locks the system according to an indication based on the system lock indication step, and starts the lock release processing using the facial recognition processing according to the system being locked; and a step in which the second processor continues the state in which the screen brightness is lowered by the brightness lowering step, regardless of the person detection processing, in which the lock release processing using the facial recognition processing is started according to the system being locked.

[0015] According to the above aspect of the present invention, it is possible to appropriately control screen brightness and control system operation using face detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a perspective view showing a configuration example of the appearance of an information processing device according to an embodiment.

[0017] Figure 2 This is a diagram showing an example of a detection range of a person by the information processing device according to the embodiment.

[0018] Figure 3This is a diagram for explaining an overview of HPD processing by the information processing device according to the embodiment.

[0019] Figure 4 It is a diagram showing a control example when “Leave” is detected according to the embodiment.

[0020] Figure 5 This is a schematic block diagram showing an example of the hardware configuration of the information processing device according to the embodiment.

[0021] Figure 6 This is a schematic block diagram showing an example of a functional structure of an information processing device according to an embodiment.

[0022] Figure 7 This is a flowchart showing an example of a screen brightness reduction process when “Leave” is detected according to the embodiment.

[0023] Description of Reference Numerals

[0024] 1…information processing device; 10…first housing; 20…second housing; 15…hinge mechanism; 110…display unit; 120…photographing unit; 140…power button; 150…input device; 151…keyboard; 153…touch pad; 160…communication unit; 170…storage unit; 200…EC; 210…face detection unit; 211…face detection processing unit; 212…face authentication processing unit; 213…priority determination unit; 300…main processing unit; 30 1…CPU; 302…GPU; 303…chip set; 304…system memory; 310…system processing unit; 311…action control unit; 312…display control unit; 313…sleep timer; 330…HPD processing unit; 331…HPD information acquisition unit; 332…leave timer; 333…lock timer; 334…HID input determination unit; 335…screen brightness change unit; 336…HPD information output unit; 400…power supply unit. DETAILED DESCRIPTION

[0025] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0026] Figure 1 It is a perspective view showing a configuration example of the appearance of the information processing device 1 according to the present embodiment.

[0027] The information processing device 1 is, for example, a notebook (clamshell) PC (Personal Computer). The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 can rotate relative to the second housing 20 around a rotation axis formed by the hinge mechanism 15. The opening angle generated by the rotation of the first housing 10 and the second housing 20 is shown as "θ".

[0028] The first frame 10 is also referred to as A cover or display frame. The second frame 20 is also referred to as C cover or system frame. In the following description, the surfaces of the first frame 10 and the second frame 20 that are provided with the hinge mechanism 15 are referred to as side surfaces 10c and 20c, respectively. The surfaces of the first frame 10 and the second frame 20 that are opposite to the side surfaces 10c and 20c are referred to as side surfaces 10a and 20a, respectively. In the figure, the direction from the side surface 20a toward the side surface 20c is referred to as "rear", and the direction from the side surface 20c toward the side surface 20a is referred to as "front". With respect to the rear, the right and the left are referred to as "right" and "left", respectively. The left sides of the first frame 10 and the second frame 20 are referred to as side surfaces 10b and 20b, respectively, and the right sides are referred to as side surfaces 10d and 20d, respectively. In addition, the state in which the first frame 10 and the second frame 20 overlap and are completely closed (the state in which the opening angle θ=0°) is referred to as the "closed state". The surfaces of the first frame body 10 and the second frame body 20 facing each other in the closed state are referred to as the "inner surfaces" of each other, and the surfaces opposite to the inner surfaces are referred to as the "outer surfaces". In addition, the state in which the first frame body 10 and the second frame body 20 are opened relative to the closed state is referred to as the "open state".

[0029] Figure 1 The appearance of the information processing device 1 shown shows an example of an open state. The open state is a state in which the side surface 10a of the first frame body 10 and the side surface 20a of the second frame body 20 are separated. In the open state, the inner surfaces of the first frame body 10 and the second frame body 20 are respectively revealed. The open state is one of the states when the user uses the information processing device 1, and typically it is mostly used in a state where the open angle θ=100 to 130°. In addition, the range of the open angle θ that becomes the open state can be arbitrarily determined according to the range of angles that can be rotated by the hinge mechanism 15, etc.

[0030] A display unit 110 is provided on the inner surface of the first frame body 10. The display unit 110 is configured to include a liquid crystal display (LCD: Liquid Crystal Display), an organic EL (Electro Luminescence: Electroluminescence) display, etc. In addition, a shooting unit 120 is provided in an area around the display unit 110 on the inner surface of the first frame body 10. For example, the shooting unit 120 is arranged on the side of the side 10a in the area around the display unit 110. In addition, the position where the shooting unit 120 is arranged is an example, and other places can also be used as long as it can face the direction facing the display screen of the display unit 110.

[0031] In the open state, the camera unit 120 captures a predetermined shooting range in the direction facing the display screen of the display unit 110 (i.e., in front of the information processing device 1). The predetermined shooting range refers to the range of the viewing angle determined by the camera element of the camera unit 120 and the optical lens provided in front of the shooting surface of the camera element. For example, the camera unit 120 can capture an image including a person (user) existing in front of the information processing device 1 (front side).

[0032] In addition, a power button 140 is provided on the side surface 20b of the second frame body 20. The power button 140 is an operator for the user to instruct the power on or off, the transition from the standby state to the normal operation state, the transition from the normal operation state to the standby state, etc. The normal operation state refers to the operation state of the system that can execute processing without special restrictions, for example, it is equivalent to the S0 state specified in ACPI (Advanced Configuration and Power Interface).

[0033] The standby state refers to a state in which at least a part of the system processing is restricted, and the power consumption is lower than the normal operation state. For example, the standby state can be a standby state, a sleep state, etc., or a state equivalent to the modern standby in Windows (registered trademark) or the S3 state (sleep state) specified in ACPI.

[0034] In addition, a keyboard 151 and a touch pad 153 are provided on the inner surface of the second frame 20 as input devices for accepting user operation input. In addition, as an input device, a touch sensor can be provided on the basis of the keyboard 151 and the touch pad 153, or a mouse or an external keyboard can be connected. In the case of a structure with a touch sensor, the area corresponding to the display screen of the display unit 110 can also be configured as a touch panel for accepting operation. In addition, the input device can also include a microphone for inputting sound.

[0035] In addition, when the first frame 10 and the second frame 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first frame 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second frame 20 are covered by the other frame surface and cannot function.

[0036] The information processing device 1 executes a HPD (Human Presence Detection) process for detecting a person existing in front of the information processing device 1 based on the image captured by the imaging unit 120 .

[0037] Figure 2 1 is a diagram showing an example of a detection range of a person by the information processing device 1 according to the present embodiment. In the example shown in the figure, the detection range FoV (Field of View) in front of the information processing device 1 is a range in which a person can be detected.

[0038] For example, the information processing device 1 determines whether a person (user) exists in front of the information processing device 1 by detecting a facial region in which a face is captured from a captured image captured by the capturing unit 120. The detection range FoV corresponds to the shooting angle of view captured by the information processing device 1. When the information processing device 1 detects a facial region from the captured image, it determines that a person exists. On the other hand, when the information processing device 1 does not detect a facial region from the captured image, it determines that a person does not exist.

[0039] The information processing device 1 controls the operating state of the system of the information processing device 1 according to the presence or absence of a person through HPD processing. For example, when a person is in front of the information processing device 1, the information processing device 1 is controlled to a normal operating state, and when no person is in front of the information processing device 1, the information processing device 1 is controlled to a standby state.

[0040] Figure 3 1 is a diagram for explaining an overview of the HPD processing of the information processing device 1 according to the present embodiment. The information processing device 1 detects a person existing in front of the information processing device 1 through the HPD processing, and controls the operating state of the system of the information processing device 1 based on the presence or absence of the person. For example, Figure 3 As shown in (A), in the standby state, when a change is detected from a state where there is no person (Absence) in front of the information processing device 1 to a state where there is a person (Presence), that is, when a person approaches the information processing device 1 (Approach), the information processing device 1 automatically starts the system and shifts to the normal operation state. Figure 3As shown in (B), in the normal operation state, when there is a person in front of the information processing device 1 (Presence), the information processing device 1 continues the normal operation state. Figure 3 As shown in (C), when the information processing device 1 detects a change from a state where a person exists in front of the information processing device 1 (Presence) to a state where no person exists (Absence), that is, when a person leaves the information processing device 1 (Leave), the system shifts to a standby state.

[0041] For example, when the information processing device 1 changes from "Presence" to "Absence" (i.e., when "Leave" is detected), the screen brightness of the display unit 110 is reduced. Furthermore, after a certain time has passed from the time when the predetermined measurement starts, the display is turned off and the state is transferred to the standby state. The process of reducing the screen brightness in the HPD process is called "screen brightness reduction process".

[0042] Here, the original screen brightness before reducing the screen brightness is, for example, the screen brightness in the "Presence" state, and is based on the brightness setting value initially set in the system, or the brightness setting value after the user changes the brightness setting value. In the following, the screen brightness based on the brightness setting value initially set, or the brightness setting value after the user changes the brightness setting value, is referred to as "standard brightness". In contrast, the brightness reduced from the standard brightness is referred to as "low brightness". The brightness setting value of the low brightness is preset, for example, to a screen brightness value of about 0 to 10% of the standard brightness.

[0043] Here, according to the system, if the system is switched to the standby state, the music being played, the sound distributed by the podcast, etc. will stop, so the information processing device 1 does not switch to the standby state but temporarily locks the system after reducing the screen brightness. As a result, the information processing device 1 can continue to play the music being played, the sound distributed by the podcast, etc. without stopping.

[0044] In addition, when the information processing device 1 locks the system, it starts an authentication process (lock release process) for unlocking the system. This authentication process is an authentication process based on face authentication, fingerprint authentication, password authentication, etc. (for example, a login authentication process). Since the information processing device 1 uses a camera in the face authentication process, it cannot perform a human detection process based on face detection. Therefore, regardless of the human detection process, the information processing device 1 continues the state of reducing the screen brightness of the display unit 110.

[0045] Furthermore, after locking the system, information processing device 1 shifts the system to a standby state when there is no user activity (such as use of a music playback application, use of a podcast, or input by the user) for a certain period of time.

[0046] Figure 4 1 is a timing chart showing a control example when "Leave" is detected according to the present embodiment. Referring to this chart, the screen brightness reduction process and the system operation state control process when "Leave" is detected will be described.

[0047] At time t1, the information processing device 1 is in a normal operating state, and the screen brightness of the display unit 110 is controlled to a standard brightness (e.g., 80% brightness). At this time t1, the detection result of the HPD process is True (Presence), but if the detection result of the HPD process becomes False (Absence) at time t2, the detection result at time t1 becomes the last detected True (Presence), and the sleep timer (Sleep timer) starts timing time T1. Time T1 is set to a threshold value (e.g., 3 minutes) of the duration of the state without user activity.

[0048] In addition, if the detection result of the HPD process becomes False (Absence) at time t2, the time T2 is started using the Leave timer. Time T2 is the time from when the detection result of the HPD process becomes False (Absence) to when it is judged as "Leave", and is set to a predetermined time (for example, 18 seconds). In addition, time T1 and time T2 can also be set by the user.

[0049] If the detection result of the HPD process remains in the False (Absence) state for a period of time T2, the information processing device 1 determines "Leave" at time t3. If the information processing device 1 determines "Leave", it starts (Start Dim) a screen brightness reduction process to reduce the screen brightness from the standard brightness to a low brightness (e.g., 0% brightness).

[0050] In addition, if the information processing device 1 determines that it is "Leave" at time t3, it starts timing T3 (for example, 5 seconds) using a lock timer (Locktimer). If the detection result of the HPD process remains in the False (Absence) state for a period of time T3, the system is temporarily locked without switching to the standby state at time t4. In this way, the information processing device 1 can continue to play music being played, sounds distributed through podcasts, etc. without stopping.

[0051] Furthermore, when the information processing device 1 locks the system at time t4 , the login authentication process for unlocking the system is started, and the process is continued while the screen brightness of the display unit 110 is kept reduced regardless of the HPD process.

[0052] If the state without user activity (music playback, podcast use, or user input, etc.) lasts for a period of time T1, the information processing device 1 turns off the display of the display unit 110 at time t5 and switches to the standby state. In other words, the information processing device 1 does not switch to the standby state while the user activity continues, so the music being played, the sound distributed by the podcast, etc. can continue without stopping.

[0053] In addition, although Figure 4 Although not shown, during the period until time T1 has passed, when there is a user input to HID (Human Interface Device) (hereinafter referred to as "HID input"), information processing device 1 determines that a person is present (Presence) and returns the screen brightness of display unit 110 to the standard brightness before reduction. HID input is a user input to HID, such as an operation input to input device 150 (e.g., keyboard 151, touchpad 153, etc.).

[0054] Hereinafter, the configuration of the information processing device 1 according to the present embodiment will be described in detail.

[0055] [Hardware structure of information processing device]

[0056] Figure 5 1 is a schematic block diagram showing an example of the hardware configuration of the information processing device 1 according to the present embodiment. Figure 5 In, with Figure 1 The information processing device 1 includes a display unit 110, a camera unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400.

[0057] The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0058] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in a direction facing the inner surface of the first frame body 10 (front), and outputs the captured image to the main processing unit 300 and the face detection unit 210. For example, the imaging unit 120 includes a visible light camera (RGB camera) for capturing images using visible light and an infrared camera (IR camera) for capturing images using infrared light.

[0059] In addition, the imaging unit 120 may be configured to include either a visible light camera or an infrared camera, or may be configured to include both.

[0060] The power button 140 outputs an operation signal to the EC 200 according to the user's operation. The input device 150 is an input unit that receives user input, and is configured to include, for example, a keyboard 151 and a touch pad 153. In response to receiving an operation on the keyboard 151 and the touch pad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0061] The communication unit 160 is connected to other devices in a communicative manner via a wireless or wired communication network to transmit and receive various data. For example, the communication unit 160 is configured to include a wired LAN interface such as Ethernet (registered trademark) or a wireless LAN interface such as Wi-Fi (registered trademark).

[0062] The storage unit 170 is configured to include storage media such as HDD (Hard Disk Drive), SSD (Solid State Drive), RAM (Random Access Memory), ROM (Read Only Memory), and flash ROM. In addition to various programs such as OS, device drivers, and applications, the storage unit 170 also stores various data obtained through the operation of the program. For example, the brightness setting value of the above-mentioned screen brightness can also be stored in the storage unit 170.

[0063] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the DC power supplied from the AC (Alternate Current) / DC adapter or the battery (battery pack) into the voltage required by each unit. The power after the voltage conversion by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on the control signal input from the EC200.

[0064] EC200 is a microcomputer including a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and an I / O (Input / Output) logic circuit. The CPU of EC200 reads out a control program (firmware) pre-stored in the ROM of the main unit, and executes the read control program to exert its function. EC200 operates independently from the main processing unit 300, controls the operation of the main processing unit 300, and manages its operation state. In addition, EC200 is connected to the power button 140, the input device 150, the power supply unit 400, and the like.

[0065] For example, the EC200 communicates with the power supply unit 400 to obtain information on the state of the battery (remaining capacity, etc.) from the power supply unit 400, and outputs control signals for controlling the supply of power corresponding to the operating state of each unit of the information processing device 1 to the power supply unit 400. In addition, the EC200 obtains operation signals from the power button 140 and the input device 150, and outputs operation signals related to the processing of the main processing unit 300 among the obtained operation signals to the main processing unit 300.

[0066] The face detection unit 210 is configured to include a processor that performs HPD processing and face authentication processing based on the image data of the captured image captured by the camera unit 120. The face detection unit 210 acquires the image data of the captured image captured by the camera unit 120 and temporarily stores the acquired image data in a memory. The memory that stores the image data may be the system memory 304 or a memory (not shown) in the face detection unit 210.

[0067] For example, the face detection unit 210 performs HPD processing (human detection processing) for detecting a facial area in which a face is photographed from the photographed image and detecting the presence of a person by processing image data of the captured image acquired from the imaging unit 120. In addition, the face detection unit 210 performs a facial authentication processing for detecting a facial area in which a face is photographed from the photographed image and performing facial authentication. As a face detection method, any detection method such as a face detection algorithm for detecting a face based on feature information of the face, learning data (learned model) obtained by machine learning based on feature information of the face, face detection using a face detection library, etc. can be applied. In addition, for example, as one of the user authentication processes during login authentication, the face detection unit 210 performs a facial authentication process in response to a request from an OS (Operating System).

[0068] The main processing unit 300 includes a CPU (Central Processing Unit) 301 , a GPU (Graphic Processing Unit) 302 , a chipset 303 , and a system memory 304 , and can execute various application programs on an OS (Operating System) through system processing based on the OS.

[0069] The CPU 301 is a processor that executes processing based on BIOS programs, processing based on OS programs, processing based on application programs running on the OS, etc. For example, the CPU 301 executes a startup process that starts the system from a standby state and transitions it to a normal operating state, a sleep process that transitions it from a normal operating state to a standby state, etc.

[0070] The GPU 302 is connected to the display unit 110 . The GPU 302 performs image processing and generates display data based on the control of the CPU 301 . The GPU 302 outputs the generated display data to the display unit 110 .

[0071] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the CPU 301 and the GPU 302 to read and write data from the system memory 304, the storage unit 170, etc. In addition, the chipset 303 controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. In addition, the chipset 303 has a function as a sensor hub. For example, the chipset 303 obtains the detection result of the HPD process and the authentication result of the face authentication process from the face detection unit 210.

[0072] The system memory 304 is used as a read area for programs executed by the CPU 301 , a work area for writing processing data, etc. The system memory 304 temporarily stores image data of an image captured by the imaging unit 120 .

[0073] In addition, the CPU 301, GPU 302, and chipset 303 may be configured as an integrated processor, or may be configured as individual processors in part or in whole. For example, in a normal operation state, the CPU 301, GPU 302, and chipset 303 are all in operation, but in a standby state, only at least a part of the chipset 303 is in operation.

[0074] [Functional structure of information processing device]

[0075] Next, the functional configuration of the information processing device 1 that performs the screen brightness reduction process and the system operation state control process based on the HPD process will be described in detail.

[0076] Figure 6 1 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to the present embodiment. The information processing device 1 includes a face detection unit 210, a system processing unit 310, and an HPD processing unit 330. The face detection unit 210 and the system processing unit 310 are connected to each other. Figure 5 The face detection unit 210 corresponds to the face detection unit 210, and performs HPD processing and face authentication processing based on face detection by processing image data of the image captured by the imaging unit 120. For example, the face detection unit 210 includes a face detection processing unit 211, a face authentication processing unit 212, and a priority determination unit 213.

[0077] The face detection processing unit 211 performs face detection processing for detecting a face region in which a face is captured from the captured image by processing image data of the captured image acquired from the capturing unit 120. When the face detection processing unit 211 detects a face region from the captured image, it outputs “Presence” information indicating that a person exists in front of the information processing device 1 to the HPD processing unit 330. On the other hand, when the face detection processing unit 211 does not detect a face region from the captured image, it outputs “Absence” information indicating that a person does not exist in front of the information processing device 1 to the HPD processing unit 330.

[0078] The facial authentication processing unit 212 performs facial authentication processing for detecting a facial area from an image and performing facial authentication by processing image data of a captured image acquired from the imaging unit 120. For example, the facial authentication processing unit 212 performs facial authentication processing as one of user authentication processing at the time of login authentication of the OS in response to a request from the OS. The facial authentication processing unit 212 outputs the authentication result to the system processing unit 310.

[0079] Here, the image data of the captured image captured by the image capturing unit 120 can be exclusively used in the HPD process and the face authentication process in response to the request of the OS. Therefore, the priority determination unit 213 determines the priority of the use of the image data of the captured image captured by the image capturing unit 120. For example, the priority of the use based on the request of the OS is set higher. The priority determination unit 213 usually gives priority to the HPD process side (when there is no request from the OS), and outputs "Presence" information or "Absence" information from the face detection process unit 211 to the HPD process unit 330 as the detection result. On the other hand, in the case where the face authentication process unit 212 performs the face authentication process in response to the request of the OS, the priority determination unit 213 gives priority to the use based on the request of the OS, and outputs the authentication result from the face authentication process unit 212 to the system process unit 310. At this time, invalid data is output from the face detection process unit 211 to the HPD process unit 330 as the detection result.

[0080] The HPD processing unit 330 includes an HPD information acquisition unit 331, a departure timer 332, a lock timer 333, an HID input determination unit 334, a screen brightness change unit 335, and an HPD information output unit 336, which is a functional structure implemented by the CPU 301 executing a program executed on the OS, or the chipset 303 (for example, a sensor hub) executing a program.

[0081] The HPD information acquisition section 331 acquires “Presence” information, “Absence” information, and the like output from the face detection section 210 as a detection result of the HPD process (human detection process).

[0082] The leave timer 332 is the time T2 (see Figure 4 ) is used to count the time (Leave timer).

[0083] The lock timer 333 is a time T3 (see Figure 4 ) is used to time the time (Lock timer).

[0084] The HID input determination unit 334 determines whether there is an HID input. For example, the HID input determination unit 334 determines whether there is an operation input by the user to the input device 150 (e.g., keyboard 151, touch pad 153, etc.). As an example, when the EC 200 obtains an operation signal output from the input device 150 (e.g., keyboard 151, touch pad 153, etc.), the HID input determination unit 334 determines that there is an HID input.

[0085] The screen brightness changing unit 335 changes the screen brightness of the display unit 110 through the HPD process. When changing the screen brightness, the screen brightness changing unit 335 changes the value of the brightness setting value stored in the storage unit 170. For example, when the screen brightness of the display unit 110 is controlled to the standard brightness, the screen brightness changing unit 335 performs a screen brightness reduction process of reducing the screen brightness from the standard brightness to the low brightness when the HPD information acquiring unit 331 acquires the "Absence" information from the face detection unit 210 (that is, the state changes from the state of detecting the presence of a person to the state of not detecting the presence of a person). For example, when the HPD information acquiring unit 331 acquires the "Absence" information from the face detection unit 210, the screen brightness changing unit 335 reduces the screen brightness from the standard brightness to the low brightness according to the elapse of time T2.

[0086] In addition, when the screen brightness is lowered to a low brightness by the brightness reduction process, the screen brightness change unit 335 continues the state of lowering the screen brightness regardless of the HPD process when the login authentication process using the face authentication process is started due to the system being locked. For example, when the use of the image data of the captured image captured by the camera unit 120 in the face detection unit 210 is given priority to the use based on the request of the OS (use in the login authentication process using the face authentication process), the screen brightness change unit 335 starts the "HPD invalid mode" that ignores the detection result based on the HPD process and continues the state of lowering the screen brightness. That is, the HPD invalid mode is a mode that ignores the detection result output from the face detection unit 210 and continues the state of lowering the screen brightness.

[0087] When the system is unlocked by the login authentication process, the screen brightness changing unit 335 ends the HPD invalid mode. The screen brightness changing unit 335 stops the brightness reduction process based on the detection result output from the face detection unit 210 and returns the screen brightness to the standard brightness before reduction.

[0088] In addition, the screen brightness changing unit 335 lowers the screen brightness to a low brightness and then, after a time T1 (see Figure 4 ) before determining that there is HID input, regardless of whether it is the HPD invalid mode, the brightness reduction process is terminated and the screen brightness is returned to the standard brightness before reduction. In addition, at this time, in the case of the HPD invalid mode, the screen brightness change unit 335 ends the HPD invalid mode and returns the screen brightness to the standard brightness before reduction.

[0089] In addition, after the screen brightness changing unit 335 reduces the screen brightness to a low brightness, after a time T3 (see Figure 4 ) before (before locking the system and before starting the HPD invalid mode), when the "Presence" information is obtained from the face detection unit 210 (i.e., when a person is detected), the screen brightness is also returned to the standard brightness before the reduction.

[0090] In addition, after the screen brightness changing unit 335 reduces the screen brightness to a low brightness, the screen brightness is changed to a low brightness by a time T1 (see Figure 4 ) When the system is transferred to the standby state, the HPD invalid mode is ended so that startup based on HPD processing can be performed.

[0091] The HPD information output section 336 outputs information indicating the operating state of the system to the system processing section 310 based on the “Presence” information, the “Absence” information, and the like acquired by the HPD information acquisition section 331 .

[0092] For example, the HPD information output unit 336 outputs the “Presence” information and the “Absence” information acquired by the HPD information acquisition unit 331 to the system processing unit 310 each time the HPD information output unit 336 acquires the “Presence” information and the “Absence” information acquired by the HPD information acquisition unit 331 .

[0093] Furthermore, when the HPD information acquisition unit 331 acquires “Presence” information from the state in which the “Absence” information is acquired, the HPD information output unit 336 outputs “Approach” information to the system processing unit 310 .

[0094] In addition, when the HPD information acquisition unit 331 acquires the "Absence" information from the state of acquiring the "Presence" information, if the time T2 (refer to Figure 4 ), the HPD information output unit 336 outputs the “Leave” information to the system processing unit 310.

[0095] In addition, when the HPD information acquisition unit 331 acquires the "Absence" information from the state of acquiring the "Presence" information, the HPD information output unit 336 outputs the "Absence" information after the elapse of time T1 (see Figure 4 ), the system lock instruction processing for instructing to lock the system is executed before the time T2 (refer to Figure 4 ) and outputs the "Leave" information to the system processing unit 310. If time T3 (refer to Figure 4 ), then the "Lock" information indicating the locking of the system is output to the system processing unit 310 through the system locking instruction processing.

[0096] The system processing unit 310 is a functional structure realized by the CPU 301 executing the BIOS and OS programs or the programs executed on the OS. For example, the system processing unit 310 includes an action control unit 311, a display control unit 312, and a sleep timer 313 as functional structures realized by executing the OS programs.

[0097] The action control unit 311 controls the action state of the system. For example, if the power button 140 is operated in the standby state, the action control unit 311 starts the system from the standby state based on the operation signal obtained from the power button 140 via the EC 200. In addition, the action control unit 311 shuts down the system, transfers to the standby state, restarts the system, etc. based on the operation of the power menu (shutdown, sleep, restart, etc.) of the OS displayed on the display unit 110 in the normal action state.

[0098] In addition, the action control unit 311 controls the action state of the system through the HPD processing. For example, when the action control unit 311 does not obtain the "Presence" information from the HPD processing unit 330 in the normal action state (that is, when the "Absence" information is obtained), the sleep timer 313 is used to count the elapsed time after the last "Presence" information is obtained, and after the time T1 (refer to Figure 4 ) and then switches to standby mode.

[0099] In addition, the sleep timer 313 may start counting time T1 when the last "Presence" information is obtained from the HPD processing unit 330, or when the "Absence" information is first obtained from the HPD processing unit 330. In addition, the sleep timer 313 may start counting time T1 when the "Leave" information is obtained from the HPD processing unit 330. The counting of time T1 may also start from the moment when the HID input is last confirmed.

[0100] Furthermore, the operation control unit 311 locks the system in accordance with the instruction of the system lock instruction process of the HPD processing unit 330. For example, the operation control unit 311 locks the system in accordance with the “Lock” information acquired from the HPD processing unit 330.

[0101] Furthermore, when the system is locked, the action control unit 311 starts a login authentication process for unlocking the system based on the authentication result of the user authentication. As the authentication process for performing user authentication, an authentication process based on face authentication, fingerprint authentication, password authentication, etc. can be applied. When performing the login authentication process using the face authentication process, the action control unit 311 requests the face detection unit 210 to perform the face authentication process using the image data of the captured image captured by the imaging unit 120.

[0102] In addition, the operation control unit 311 releases the system lock based on the authentication result of the user authentication in the login authentication process. For example, the operation control unit 311 releases the system lock based on the authentication result of the face authentication process.

[0103] In addition, when the action control unit 311 obtains the "Presence" information from the HPD processing unit 330 before the time T1 has passed (actually before the time T2 has passed and before the time T3 has passed), the timing based on the sleep timer 313 is terminated, and the normal action state is continued. In addition, when the action control unit 311 determines that there is an HID input in the HPD processing unit 330 before the time T1 has passed (that is, when the user's input is detected), the timing based on the sleep timer 313 is terminated, and the normal action state is continued.

[0104] The display control unit 312 controls the display on and off of the display unit 110. In addition, the display control unit 312 controls the screen brightness of the display unit 110 when the display is on. Specifically, the display control unit 312 controls the screen brightness of the display unit 110 based on the brightness setting value stored in the storage unit 170. The brightness setting value is initially set in the system, and can also be changed from the initial setting by the user according to the usage environment or preference. In addition, the brightness setting value is changed by the HPD processing unit 330 (screen brightness change unit 335).

[0105] [Screen brightness reduction operation]

[0106] Next, refer to Figure 7 , the operation of the screen brightness reduction process when “Leave” is detected based on the HPD process is described. Figure 7 1 is a flowchart showing an example of the screen brightness reduction process when "Leave" is detected according to the present embodiment. Here, the information processing device 1 is in the "Presence" state in the normal operation state, and the screen brightness of the display unit 110 is controlled to the standard brightness. The HPD processing unit 330 outputs the "Presence" information to the system processing unit 310 each time it obtains the "Presence" information from the face detection unit 210.

[0107] (Step S101) The HPD processing unit 330 determines whether the "Presence" information is acquired from the face detection unit 210. When the HPD processing unit 330 determines that the "Presence" information is acquired (Yes), the processing of step S101 is performed again. On the other hand, when the HPD processing unit 330 acquires the "Absence" information from the face detection unit 210, it determines that the "Presence" information is not acquired (No), and the processing proceeds to step S103. In addition, when the HPD processing unit 330 acquires the "Absence" information, it outputs the "Absence" information to the system processing unit 310 each time the "Absence" information is acquired.

[0108] (Step S103) When the system processing unit 310 obtains the "Absence" information from the HPD processing unit 330 in step S101, the system processing unit 310 uses the sleep timer 313 to start counting the time (time T1) elapsed after the last "Presence" information is obtained (Sleep timer starts). In addition, based on the "Absence" information obtained in step S101, the HPD processing unit 330 uses the leave timer 332 to start counting the time T2 from the acquisition of the "Absence" information to the determination of "Leave" (see Figure 4) (Leave timer starts). Then, the process proceeds to step S105.

[0109] (Step S105) The HPD processing unit 330 determines whether the "Presence" information is acquired from the face detection unit 210. In addition, the HPD processing unit 330 determines whether there is an HID input. Then, if the HPD processing unit 330 determines that the "Presence" information is acquired (Yes) or that there is an HID input (Yes), it returns to the process of step S101, and if it is determined otherwise (No), it proceeds to the process of step S107.

[0110] (Step S107) The HPD processing unit 330 determines whether the timing of the time T2 has ended (Leave timer has ended). If the HPD processing unit 330 determines that the timing of the time T2 has not ended (Leave timer has ended) (No), the process returns to step S105. On the other hand, if the HPD processing unit 330 determines that the timing of the time T2 has ended (Leave timer has ended) (Yes), the process proceeds to step S109.

[0111] (Step S109) The HPD processing unit 330 starts the screen brightness reduction process to reduce the screen brightness setting value from the standard brightness to the low brightness. In addition, the HPD processing unit 330 determines that the screen brightness is "Leave" because the time T2 has passed, and outputs the "Leave" information to the system processing unit 310. In addition, the HPD processing unit 330 uses the lock timer 333 to start the time T3 from the determination of "Leave" to the locking of the system (refer to Figure 4 ) (Lock timer starts). Then, the process proceeds to step S111.

[0112] (Step S111) The HPD processing unit 330 determines whether the "Presence" information is acquired from the face detection unit 210. In addition, the HPD processing unit 330 determines whether there is an HID input. Then, if the HPD processing unit 330 determines that the "Presence" information is acquired (Yes) or that there is an HID input (Yes), the processing proceeds to step S115, and if it is otherwise determined (No), the processing proceeds to step S113.

[0113] (Step S113) The HPD processing unit 330 determines whether the timing of the time T3 has ended (Lock timer has ended). If the HPD processing unit 330 determines that the timing of the time T3 has not ended (Lock timer has ended) (No), the process returns to step S111. On the other hand, if the HPD processing unit 330 determines that the timing of the time T3 has ended (Lock timer has ended) (Yes), the process proceeds to step S117.

[0114] (Step S115 ) The HPD processing unit 330 stops the screen brightness reduction process, returns the brightness setting value of the screen brightness to the standard brightness, and returns to the process of step S101 .

[0115] (Step S117) The HPD processing unit 330 outputs "Lock" information to the system processing unit 310. The system processing unit 310 locks the system according to the "Lock" information obtained from the HPD processing unit 330. Then, the process proceeds to step S119.

[0116] (Step S119) The HPD processing unit 330 starts to ignore the HPD invalid mode based on the detection result of the HPD processing, and continues to reduce the screen brightness to a low brightness state regardless of the HPD processing. For example, the HPD processing unit 330 fixes the brightness setting value of the screen brightness to a low brightness. Then, the process proceeds to step S121.

[0117] (Step S121) The system processing unit 310 starts the login authentication process in response to the system being locked. For example, the system processing unit 310 performs the login authentication process based on face authentication, fingerprint authentication, password authentication, etc. In addition, when performing the login authentication process using face authentication, the system processing unit 310 requests the face detection unit 210 to perform the face authentication process using the image data of the captured image captured by the imaging unit 120. The face detection unit 210 changes the priority of using the image data of the captured image captured by the imaging unit 120 from the HPD processing side to the login authentication processing side. Then, the process proceeds to step S123.

[0118] (Step S123) The HPD processing unit 330 determines whether there is an HID input. If the HPD processing unit 330 determines that there is an HID input (Yes), the process proceeds to step S125. On the other hand, if the HPD processing unit 330 determines that there is no HID input (No), the process proceeds to step S127.

[0119] (Step S125) The HPD processing unit 330 returns the brightness setting value of the screen brightness to the standard brightness and fixes it, and returns to the process of step S123. That is, if the login authentication process is started in step S121, the login authentication process is performed in a state where the screen brightness is reduced to a low brightness during the period when there is no HID input, and the login authentication process is performed in a state where the screen brightness is returned to the standard brightness if there is an HID input. In addition, after the HPD processing unit 330 returns the brightness setting value of the screen brightness to the standard brightness, if the state of no HID input (HID input) continues for more than a certain period of time, it can change the brightness setting value of the screen brightness to a low brightness again.

[0120] (Step S127) The system processing unit 310 determines whether the timing of time T1 has ended (Sleep timer ends). If the system processing unit 310 determines that the timing of time T1 has not ended (No), the system processing unit 310 returns to the process of step S123. On the other hand, if the system processing unit 310 determines that the timing of time T1 has ended (Yes), the system processing unit 310 proceeds to the process of step S129.

[0121] Furthermore, if the system processing unit 310 determines in step S127 that there is an HID input before the timer of time T1 ends (step S123: Yes) and the authentication based on the login authentication process is successful, the system lock is released and the system is transferred to the normal operation state (transferred to step S101), and the HPD invalid mode is released. On the other hand, if the system processing unit 310 determines in step S127 that there is no HID input before the timer of time T1 ends (step S123: No), even if the authentication based on the login authentication process is successful, the screen brightness is reduced to a low brightness and the system is locked, and the time T1 is continued.

[0122] That is, the system processing unit 310, when there is no HID input, keeps the screen brightness reduced to a low brightness and the system locked, regardless of whether the authentication based on the login authentication process is successful, and continues to count time T1. When the timing of time T1 ends (Sleep timer ends), the process proceeds to step S129. In addition, when there is HID input, the system processing unit 310 continues to count time T1 when the screen brightness returns to the standard brightness and the system is locked. When the authentication based on the login authentication process is unsuccessful and the timing of time T1 ends (Sleep timer ends), the process proceeds to step S129. In addition, for the timing of time T1 started by the sleep timer 313 in step S103, when it is determined in step S123 that there is HID input, the timing value can be reset and the timing can be restarted.

[0123] (Step S129 ) The system processing unit 310 controls the display of the display unit 110 to turn off, and shifts the system to the standby state. In addition, the HPD processing unit 330 ends the HPD invalid mode.

[0124] In the login authentication process started in step S121, if the authentication is successful, the system processing unit 310 releases the lock. In addition, the HPD processing unit 330 returns the brightness setting value of the screen brightness to the standard brightness, and ends the HPD invalid mode. Then, the process returns to step S101.

[0125] [Summary of the First Embodiment]

[0126] As described above, the information processing device 1 according to the present embodiment includes a memory (e.g., the system memory 304) that temporarily stores the image data of the captured image captured by the image capturing unit 120. In addition, the information processing device 1 includes a face detection unit 210 (an example of a first processor) that processes the image data stored in the memory to perform an HPD process (an example of a human detection process) and a face authentication process that detects a face region in which a face is captured from the captured image and detects the presence of a person, and detects a face region from the captured image and performs face authentication in response to a request from the system (e.g., OS). In addition, the information processing device 1 includes an HPD processing unit 330 (an example of a second processor, e.g., the chipset 303) that instructs the transition of the operating state of the system and the change of the screen brightness of the display unit 110 based on the detection result of the HPD process, and a system processing unit 310 (an example of a third processor, e.g., the CPU 301) that performs a login authentication process (an example of a lock release process) for unlocking the system based on the authentication result of the face authentication process. Here, the face detection unit 210 can exclusively use the image data of the image captured by the imaging unit 120 in the HPD process and the face authentication process.

[0127] For example, the HPD processing unit 330 performs a brightness reduction process, a system lock instruction process, and a standby state instruction process. In the brightness reduction process, when the state where the presence of a person is detected changes to the state where the presence of a person is not detected by the HPD process, the screen brightness is reduced; in the system lock instruction process, when the state where the presence of a person is detected changes to the state where the presence of a person is not detected by the HPD process, an instruction to lock the system is performed before the time T1 (an example of the first time) has passed; in the standby state instruction process, when the state where the presence of a person is detected changes to the state where the presence of a person is not detected by the HPD process, an instruction to transfer the system to the standby state is performed after the time T1 has passed. In addition, the system processing unit 310 locks the system according to the instruction based on the above-mentioned system lock instruction process, and starts the login authentication process using the face authentication process in response to the system being locked. Moreover, when the HPD processing unit 330 starts the login authentication process using the face authentication process in response to the system being locked while the screen brightness is reduced by the above-mentioned brightness reduction process, the screen brightness is continued regardless of the HPD process.

[0128] Thus, when the information processing device 1 changes from a state where a person is detected to a state where the person's presence is not detected (i.e., when the person leaves), the power consumption can be suppressed by reducing the screen brightness, and the system is temporarily locked without switching to a standby state, so that the music being played, the sound distributed through the podcast, etc. can be kept alive, and the state of reducing the screen brightness can be continued even after the system is locked. Therefore, the information processing device 1 can appropriately control the screen brightness and the operation of the system using face detection.

[0129] For example, the time T1 described above is set as a threshold value of the time during which a state in which no specific application (eg, music playback application, podcast, etc.) running on the system is used or no user activity based on HID input continues.

[0130] Thus, when a person leaves, the information processing device 1 can reduce the screen brightness so that the user activity does not stop while the user activity is continuing.

[0131] When the HPD processing unit 330 starts the login authentication process using the face authentication process because the system is locked while the screen brightness is lowered by the brightness lowering process, it ignores the detection result based on the HPD process and continues the state of lowering the screen brightness.

[0132] Thus, the information processing device 1 can continue the state where the screen brightness is reduced even when executing the login authentication process by the system.

[0133] Furthermore, when the HPD processing unit 330 detects an HID input before the time T1 elapses after reducing the screen brightness, the HPD processing unit 330 stops the brightness reduction process and returns the screen brightness to the level before reduction.

[0134] Thus, after the screen brightness is reduced due to a person leaving, the information processing device 1 can return the screen brightness to the level before the reduction when the person returns.

[0135] In addition, when the HPD processing unit 330 changes from a state in which the presence of a person is detected to a state in which the presence of a person is not detected through the HPD processing, the screen brightness is reduced according to the elapse of time T2 (an example of a second time) which is shorter than time T1, and after a time T3 (an example of a third time) has passed before time T1 has passed and after the screen brightness has been reduced, an instruction to lock the system is issued through the above-mentioned system lock instruction processing.

[0136] Thus, information processing device 1 can prevent screen brightness from being unnecessarily reduced or the screen from being unnecessarily switched to a lock screen when a person leaves the screen for only a moment.

[0137] Furthermore, when the system lock is released by the login authentication process, the HPD processing unit 330 stops the brightness reduction process and returns the screen brightness to the state before the reduction.

[0138] Thus, after the screen brightness is reduced due to a person leaving, the information processing device 1 can return the screen brightness to the level before the reduction when the person returns.

[0139] In addition, the present embodiment relates to a control method, which is a control method in an information processing device 1, the above-mentioned information processing device 1 includes: a memory (for example, a system memory 304) that temporarily stores image data of a captured image captured by a capturing unit 120, a face detection unit 210 (an example of a first processor), an HPD processing unit 330 (an example of a second processor, for example, a chipset 303) and a system processing unit 310 (an example of a third processor, for example, a CPU 301), the above-mentioned control method including: the face detection unit 210 performs an HPD processing (an example of a person detection processing) of detecting a face area in which a face is captured from a captured image to detect the presence of a person by processing the image data stored in the memory; the step of performing a face authentication processing of detecting a face area from a captured image to perform face authentication based on a request of a system (for example, an OS); the step of the HPD processing unit 330 instructing a transition of an action state of the system and a change of the screen brightness of the display unit 110 based on a detection result of the HPD processing; and the step of the system processing unit 310 performing a login authentication processing (an example of a lock release processing) of unlocking the system based on an authentication result of the face authentication processing. Here, the face detection unit 210 can exclusively use the image data of the image captured by the imaging unit 120 in the HPD process and the face authentication process.

[0140] For example, the control method in the information processing device 1 also includes: a brightness reducing step in which the HPD processing unit 330 reduces the screen brightness when the state in which the presence of a person is detected through the HPD processing changes to the state in which the presence of a person is not detected; a system lock indication step in which an instruction to lock the system is performed before a time T1 (an example of a first time) has passed when the state in which the presence of a person is detected through the HPD processing changes to the state in which the presence of a person is not detected; a standby state indication step in which an instruction to transfer the system to a standby state is performed after a time T1 has passed when the state in which the presence of a person is detected through the HPD processing changes to the state in which the presence of a person is not detected; a step in which the system processing unit 310 locks the system according to the instruction of the above-mentioned system lock indication processing, and starts a login authentication processing using a facial authentication processing in accordance with the system being locked; a step in which the HPD processing unit 330, in a state in which the screen brightness is reduced through the above-mentioned brightness reducing step, starts a login authentication processing using a facial authentication processing in accordance with the system being locked, and continues the state in which the screen brightness is reduced regardless of the HPD processing.

[0141] Thus, the control method in the information processing device 1 can suppress power consumption by reducing the screen brightness when the state where a person is detected changes to the state where no person is detected (i.e., when a person leaves), and temporarily lock the system without switching to the standby state, so that the music being played, the sound distributed through the podcast, etc. will not stop, and the state where the screen brightness is reduced can be continued even after the system is locked. Therefore, the control method in the information processing device 1 can appropriately control the screen brightness and control the operation of the system using face detection.

[0142] The embodiments of the present invention are described in detail above with reference to the drawings, but the specific configuration is not limited to the above embodiments and includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiments can be arbitrarily combined.

[0143] In addition, the configuration example in which the image capturing unit 120 is built into the information processing device 1 is described, but the present invention is not limited thereto. For example, the image capturing unit 120 may not be built into the information processing device 1, but may be configured to be installed on the information processing device 1 (for example, any one of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and be connected to the information processing device 1 by wireless or wired communication.

[0144] In addition, in the above embodiment, an example is shown in which the face detection unit 210 is provided separately from the CPU 301 and the chipset 303, but part or all of the face detection unit 210 may be provided in the chipset 303, or in a processor integrated with the CPU 301 or the chipset 303. For example, the CPU 301, the chipset 303, and the face detection unit 210 may be configured as independent processors, or may be integrated into one processor. In addition, part or all of the face detection unit 210 may be provided in the EC 200.

[0145] In addition, the above-mentioned standby state may also include a sleep state, a power-off state, etc. The sleep state is equivalent to, for example, the S4 state specified by ACPI. The power-off state is equivalent to, for example, the S5 state (power-off state) specified by ACPI. In addition, the standby state, the sleep state, the sleep state, the power-off state, etc. in the standby state are states in which the power consumption is lower than that in the normal operation state (a state in which the power consumption is suppressed).

[0146] In addition, the above-mentioned information processing device 1 has a computer system inside. Moreover, a program for realizing the functions of each structure possessed by the above-mentioned information processing device 1 can also be recorded in a computer-readable recording medium, and the processing in each structure possessed by the above-mentioned information processing device 1 can be performed by making the computer system read and execute the program recorded in the recording medium. Here, "making the computer system read and execute the program recorded in the recording medium" is included in the computer system installation program. The "computer system" mentioned here includes hardware such as OS and peripheral devices. In addition, the "computer system" can also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. In addition, "computer-readable recording medium" refers to portable media such as floppy disks, optical magnetic disks, ROMs, CD-ROMs, and storage devices such as hard disks built into computer systems. In this way, the recording medium on which the program is recorded can also be a non-temporary recording medium such as a CD-ROM.

[0147] In addition, the recording medium also includes an internal or external recording medium that can be accessed from a distribution server in order to distribute the program. In addition, the program can also be divided into multiple parts, and the structure formed by combining the various structures possessed by the information processing device 1 after being downloaded at different time intervals, and the distribution server for distributing each divided program is different. Moreover, the so-called "computer-readable recording medium" also includes a structure that keeps the program for a certain period of time, such as a server in the case of sending a program via a network, and a volatile memory (RAM) inside a computer system as a client. In addition, the above-mentioned program may also be a structure for realizing a part of the above-mentioned functions. Furthermore, it may also be a so-called differential file (differential program) that can be realized by combining the above-mentioned functions with programs already recorded in the computer system.

[0148] In addition, part or all of the functions of the information processing device 1 in the above-mentioned embodiment may be implemented as an integrated circuit such as LSI (Large Scale Integration). Each function may be processed individually, or part or all of it may be integrated for processing. In addition, the method of integrated circuitization is not limited to LSI, and it may also be implemented by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI emerges with the advancement of semiconductor technology, an integrated circuit based on the technology may also be used.

[0149] Furthermore, the information processing device 1 of the above-described embodiment is not limited to a notebook PC, and may be, for example, a desktop PC or the like.

Claims

1. An information processing device comprising: a memory for temporarily storing image data of an image captured by the imaging unit; The first processor performs human detection processing and facial authentication processing by processing the image data stored in the memory, wherein: In the above-mentioned person detection processing, the presence of a person is detected by detecting a facial area in which a face is photographed from the above-mentioned image, and in the above-mentioned face authentication processing, the above-mentioned facial area is detected from the above-mentioned image to perform face authentication according to a request of the system; a second processor for instructing a transition of an operation state of the system and a change of screen brightness of a display unit based on a detection result of the human detection process; as well as a third processor that executes a lock release process for releasing the lock of the system based on the authentication result of the facial authentication process; The first processor is capable of exclusively using the image data of the image captured by the image capturing unit in the human detection process and the face authentication process. The second processor executes brightness reduction processing, system lock indication processing and standby state indication processing, In the brightness reduction process, when the state where the presence of the person is detected by the person detection process changes to the state where the presence of the person is not detected, the screen brightness is reduced. In the system lock instruction processing, when the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person is not detected, an instruction to lock the system is issued before a first time has passed, In the standby state instruction processing, when the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person is not detected, an instruction is given to shift the system to the standby state after the first time has passed, the third processor locks the system according to an instruction based on the system lock instruction processing, and starts the lock release processing using the facial authentication processing according to the system being locked, When the screen brightness is reduced by the brightness reduction processing, the second processor continues the state of reducing the screen brightness regardless of the human detection processing when the lock release processing using the facial recognition processing is started according to the system being locked.

2. The information processing device according to claim 1, wherein: The first time is set as a threshold value of the time during which a state in which there is no use of a specific application running on the system or no user activity based on user input continues.

3. The information processing device according to claim 1, wherein: When the screen brightness is reduced by the brightness reduction processing, the second processor ignores the detection result of the human detection processing and continues the state of reducing the screen brightness in the case where the lock release processing using the facial recognition processing is started according to the system being locked.

4. The information processing device according to claim 1, wherein: After reducing the screen brightness, if the second processor detects a user input before the first time period has elapsed, the second processor stops the brightness reduction process to return the screen brightness to the level before reduction.

5. The information processing device according to claim 1, wherein: When the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person is not detected, the second processor reduces the brightness of the screen according to the lapse of a second time shorter than the first time, and before the lapse of the first time and after a third time has passed after the brightness of the screen has been reduced, an instruction to lock the system is given through the system lock instruction processing.

6. The information processing device according to claim 1, wherein: The second processor stops the brightness reduction process and returns the screen brightness to a level before the reduction when the system is locked by the lock release process.

7. A control method, which is a control method in an information processing device, the information processing device comprising: a memory for temporarily storing image data of an image captured by a camera unit; a first processor for performing a human detection process and a face authentication process by processing the image data stored in the memory, wherein: In the above-mentioned person detection processing, the presence of a person is detected by detecting a facial area in which a face is photographed from the above-mentioned image, and in the above-mentioned face authentication processing, the above-mentioned facial area is detected from the above-mentioned image to perform face authentication according to a request of the system; a second processor for instructing a transition of an operation state of the system and a change of screen brightness of a display unit based on a detection result of the human detection process; and a third processor that executes a lock release process for releasing the lock of the system based on the authentication result of the facial authentication process, The first processor is capable of exclusively using the image data of the image captured by the image capturing unit in the human detection process and the face authentication process. The above control method includes: a brightness reduction step, wherein the second processor reduces the brightness of the screen when the state where the presence of the person is detected by the person detection processing changes to the state where the presence of the person is not detected; a system lock instruction step, wherein the second processor instructs the system to be locked before a first time has passed when the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person is not detected; a standby state instructing step, in which the second processor instructs the system to shift to the standby state after the first time has passed when the state in which the presence of the person is detected by the person detection processing changes to the state in which the presence of the person is not detected; a step in which the third processor locks the system according to the instruction based on the system lock instruction step, and starts the lock release process using the face authentication process according to the system being locked; and The second processor, in a state where the screen brightness has been lowered by the brightness lowering step, starts the lock release process using the facial recognition process based on the system being locked, and continues the state where the screen brightness has been lowered regardless of the human detection process.