Information processing apparatus and control method

The information processing device uses face detection to adjust screen brightness based on user orientation and display usage, addressing inefficient power usage by optimizing brightness reduction processes for internal and external displays.

JP2024156393AInactive Publication Date: 2024-11-06LENOVO (SINGAPORE) PTE LTD

Patent Information

Application Number
JP2023070811
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-24
Publication Date
2024-11-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing information processing devices fail to appropriately adjust screen brightness based on the orientation of a user's face when an external display is connected, leading to inefficient power usage and potential brightness reduction errors.

Method used

The device includes a face detection system to determine the orientation of a user's face and adjusts screen brightness of both internal and external displays based on the presence or absence of active windows and cursors, enabling or disabling brightness reduction processes accordingly.

Benefits of technology

This approach enhances power savings by accurately adjusting screen brightness according to user interaction with internal or external displays, preventing unnecessary brightness reductions and optimizing power consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024156393000001_ABST
    Figure 2024156393000001_ABST
Patent Text Reader

Abstract

To reduce screen brightness of a display properly depending on an orientation of a face even when an external display is connected.SOLUTION: An information processing apparatus performs: face detection processing for detecting a face area in which a face is captured and an orientation of the face from an image captured by an imaging part; brightness reduction processing for reducing screen brightness of an internal display on the basis of the orientation of the face toward the internal display detected by the face detection processing; and brightness reduction control processing for, in a state where an external display is connected, enabling the brightness reduction processing when both of an active window and a cursor are not displayed on a screen of the internal display, and disabling the brightness reduction processing when either one or both of the active window and the cursor are displayed on the screen of the internal display.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There is a device that transitions to a usable state when a person approaches, and transitions to a standby state in which all functions except for some functions are stopped when the person leaves. For example, in Patent Document 1, an infrared sensor is used to detect whether a person is approaching or moving away.

[0003] In recent years, advances in computer vision and the like have led to improved accuracy in detecting faces from images. Therefore, instead of detecting people using infrared sensors, people are now being detected using face detection. In detecting people using face detection, it is possible to detect not only the person but also the direction of the face, making it possible to perform control according to the direction of the face (whether the face is facing forward, facing sideways, etc.). For example, some information processing devices (e.g., PCs: Personal Computers) can determine that the user is not using the device when the face is not facing forward (toward the device), and therefore reduce the brightness of the display screen to save power. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-148895 A Summary of the Invention [Problem to be solved by the invention]

[0005] For example, notebook (clamshell) PCs are sometimes used connected to an external display. Conventionally, when an external display is connected, the brightness reduction process that reduces the screen brightness according to the face direction described above is not performed, but if it becomes possible to detect the face direction in detail, it is desirable to apply the brightness reduction process even when an external display is connected.

[0006] Conventionally, when an external display is not connected, if there is user input (HID input) to a HID (Human Interface Device) such as a keyboard, even if the user is not facing forward (towards the PC), it can be determined that the user is using the device, so the brightness reduction process according to the face direction described above is disabled. However, when an external display is connected, if the user is using (looking at) the external display even if there is HID input, it does not mean that the user is using (looking at) the PC's internal display, so it is desirable to enable the brightness reduction process for the PC's internal display from the perspective of power saving, etc.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that appropriately reduces the screen brightness of a display in accordance with the direction of the face, even when an external display is connected. [Means for solving the problem]

[0008] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a memory that temporarily stores image data of an image captured by an imaging unit, a processor that processes the image data stored in the memory, an internal display, and a connection unit that connects to an external display, and the processor performs a face detection process that detects a face area in which a face is captured from the image and the orientation of the face by processing the image data of the image stored in the memory, a brightness reduction process that reduces the screen brightness of the internal display based on the orientation of the face relative to the internal display detected by the face detection process, and a brightness reduction control process that enables the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the internal display when connected to the external display, and disables the brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the internal display.

[0009] In the above-mentioned information processing device, the processor may, in the brightness reduction control process, disable the brightness reduction process in response to user input when the brightness reduction process is enabled in a state where the external display is not connected, and enable the brightness reduction process regardless of whether user input is present when the external display is connected and neither an active window nor a cursor is displayed on the screen of the internal display.

[0010] In the above-mentioned information processing device, in the brightness reduction control process, when connected to the external display, the processor may enable the brightness reduction process if there is no user input even if either an active window or a cursor or both are displayed on the screen of the internal display, and may disable the brightness reduction process in response to user input.

[0011] In the above information processing device, the processor may further perform, in the brightness reduction process, an external brightness reduction process that reduces the screen brightness of the external display based on the orientation of the face relative to the external display detected by the face detection process, and in the brightness reduction control process, when connected to the external display, if neither an active window nor a cursor is displayed on the screen of the external display, enable the external brightness reduction process, and disable the external brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the external display.

[0012] In the above-mentioned information processing device, in the brightness reduction control process, the processor may enable the external brightness reduction process regardless of whether or not there is user input when neither the active window nor the cursor is displayed on the screen of the external display while connected to the external display.

[0013] In the above-mentioned information processing device, in the brightness reduction control process, when connected to the external display, the processor may enable the external brightness reduction process if there is no user input even when both the active window and the cursor are displayed on the screen of the external display, and may disable the external brightness reduction process in response to user input.

[0014] Moreover, an information processing device according to a second aspect of the present invention includes a memory that temporarily stores image data of an image captured by an imaging unit, a processor that processes the image data stored in the memory, an internal display, and a connection unit that connects to an external display, and the processor performs a face detection process that detects a face area in which a face is captured from the image and the direction of the face by processing the image data of the image stored in the memory, a brightness reduction process that reduces the screen brightness of the internal display or the external display based on the direction of the face detected by the face detection process, and a brightness reduction control process that, when connected to the external display, enables the brightness reduction process for a target display among the internal display and the external display that is to be subject to the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the target display, and disables the brightness reduction process for the target display when either or both of the active window and the cursor are displayed on the screen of the target display.

[0015] In the above-mentioned information processing device, in the brightness reduction control process, the processor may enable the brightness reduction process regardless of whether or not there is user input when neither an active window nor a cursor is displayed on the screen of the target display while connected to the external display.

[0016] In the above-mentioned information processing device, in the brightness reduction control process, when connected to the external display, the processor may enable the brightness reduction process if there is no user input even if either an active window or a cursor or both are displayed on the screen of the target display, and may disable the brightness reduction process in response to user input.

[0017] Furthermore, according to a third aspect of the present invention, a control method in an information processing device having a memory for temporarily storing image data of an image captured by an imaging unit, a processor for processing the image data stored in the memory, an internal display, and a connection unit for connecting to an external display includes the steps of: performing a face detection process by the processor for detecting a face area in which a face is captured from the image and the orientation of the face by processing the image data of the image stored in the memory; performing a brightness reduction process for reducing the screen brightness of the internal display based on the orientation of the face relative to the internal display detected by the face detection process; and performing a brightness reduction control process for enabling the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the internal display when connected to the external display, and disabling the brightness reduction process when either the active window or the cursor or both are displayed on the screen of the internal display.

[0018] Furthermore, according to a fourth aspect of the present invention, a control method in an information processing device having a memory for temporarily storing image data of an image captured by an imaging unit, a processor for processing the image data stored in the memory, an internal display, and a connection unit for connecting to an external display includes the steps of: performing a face detection process by the processor to detect a face area in which a face is captured from the image and the direction of the face by processing the image data of the image stored in the memory; performing a brightness reduction process to reduce the screen brightness of the internal display or the external display based on the direction of the face detected by the face detection process; and performing a brightness reduction control process to enable the brightness reduction process for a target display that is to be subject to the brightness reduction process, of the internal display and the external display, when neither an active window nor a cursor is displayed on the screen of the target display, and to disable the brightness reduction process for the target display, when either one or both of the active window and the cursor are displayed on the screen of the target display, when the target display is connected to the external display. Effect of the Invention

[0019] According to the above-described aspects of the present invention, it is possible to improve the responsiveness when detecting the direction of the face and controlling the screen brightness of the display unit. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to a first embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of a person detection range of the information processing device according to the first embodiment. [Diagram 3] 5A and 5B are schematic diagrams illustrating the control of screen luminance according to the face direction according to the first embodiment. [Figure 4] FIG. 2 is a schematic diagram showing a first example of a state in which the information processing apparatus according to the first embodiment is connected to an external display and used. [Diagram 5]FIG. 4 is a schematic diagram showing a second example of a state in which the information processing device according to the first embodiment is connected to an external display and used. [Figure 6] FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to a first embodiment. [Figure 7] FIG. 1 is a schematic block diagram showing an example of a functional configuration of an information processing device according to a first embodiment. [Figure 8] 5 is a flowchart showing an example of a luminance reduction process according to the first embodiment. [Figure 9] 5 is a flowchart showing an example of a luminance reduction control process according to the first embodiment. [Figure 10] FIG. 11 is a schematic diagram showing a first example of a state in which an information processing device according to a second embodiment is connected to an external display and used. [Figure 11] FIG. 11 is a schematic diagram showing a second example of a state in which the information processing device according to the second embodiment is connected to an external display and is being used. [Figure 12] 10 is a flowchart showing an example of a luminance reduction control process according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First embodiment> [overview] First, an overview of the information processing device according to the first embodiment will be described. FIG. 1 is a perspective view showing an example of the external configuration of an information processing device 1 according to the present embodiment.

[0022] The information processing device 1 is, for example, a notebook (clamshell) type PC (Personal Computer). The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis formed by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0023] The first housing 10 is also called the A cover or the display housing. The second housing 20 is also called the C cover or the system housing. In the following description, the sides of the first housing 10 and the second housing 20 on which the hinge mechanism 15 is provided are called the sides 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite the sides 10c and 20c are called the sides 10a and 20a, respectively. In the drawings, the direction from the side 20a to the side 20c is called the "rear", and the direction from the side 20c to the side 20a is called the "front". The right and left sides of the rear are called the "right" and "left", respectively. The left sides of the first housing 10 and the second housing 20 are called the sides 10b and 20b, respectively, and the right sides are called the sides 10d and 20d, respectively. Moreover, a state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as a "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Moreover, a state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as an "open state."

[0024] The external appearance of the information processing device 1 shown in FIG. 1 shows an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0025] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is merely an example, and the imaging unit 120 may be disposed in another location as long as it can face in a direction facing the display screen of the display unit 110.

[0026] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in a direction facing the display screen of the display unit 110 (i.e., in front of the information processing device 1). The predetermined imaging range is a range of an angle of view determined by an imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture an image including a person (user) present in front of the information processing device 1 (on the front side).

[0027] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct power on or off, transition from a standby state to a normal operation state, transition from the normal operation state to a standby state, etc. The normal operation state is an operation state of the system in which processing can be executed without particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0028] The standby state is a state in which at least a part of the system processing is restricted, and the power consumption is lower than that of the normal operation state. For example, the standby state may be a standby state, a sleep state, or the like, and may be a state equivalent to the modern standby state in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI. The standby state may also include a state in which at least the display of the display unit is turned off (screen OFF) or a state in which the screen is locked. The screen lock is a state in which a preset image (for example, an image for screen lock) is displayed on the display unit so that the contents being processed cannot be seen, and the device cannot be used until the lock is released (for example, user authentication).

[0029] Further, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices that accept operation inputs from the user. Note that, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided as the input device, or a mouse or an external keyboard may be connected. In the case where a touch sensor is provided, an area corresponding to the display screen of the display unit 110 may be configured as a touch panel that accepts operations. Furthermore, the input device may include a microphone into which voice is input.

[0030] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first housing 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing, and are unable to function.

[0031] The information processing device 1 executes a human presence detection (HPD) process to detect a person present in front of the information processing device 1, based on a captured image captured by the imaging unit 120.

[0032] 2 is a diagram showing an example of a person detection range of the information processing device 1 according to this embodiment. In the example shown in the figure, a detection range FoV (Field of View: detection viewing angle) in front of the information processing device 1 is a range in which a person can be detected.

[0033] For example, the information processing device 1 detects a face area in which a face is captured from a captured image captured by the imaging unit 120, thereby determining whether or not a person (user) is present in front of the information processing device 1. The detection range FoV corresponds to the imaging field angle captured by the information processing device 1. If a face area is detected from the captured image, the information processing device 1 determines that a person (user) is present. On the other hand, if a face area is not detected from the captured image, the information processing device 1 determines that a person (user) is not present.

[0034] The information processing device 1 controls the operation state of the system of the information processing device 1 according to the presence or absence of a person (user) through HPD processing. For example, the information processing device 1 is controlled to a normal operation state when a person (user) is present in front of the information processing device 1, and is controlled to a standby state when no person (user) is present in front of the information processing device 1.

[0035] Furthermore, when a person (user) is present in front of the information processing device 1, the information processing device 1 detects the direction of the person's (user's) face. For example, the information processing device 1 determines whether the person's (user's) face is facing the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120). The face direction here is a direction corresponding to the rotation angle of the face in the left-right direction. In the following, a state in which the face is facing the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120) is defined as a state in which the face is facing forward. Also, a state in which the face is facing rightward or leftward with respect to the front is defined as a state in which the face is facing sideways.

[0036] 3 is a schematic diagram for explaining the control of screen luminance according to the face direction according to the present embodiment. As shown in this figure, the information processing device 1 executes a luminance reduction process for reducing the screen luminance of the display unit 110 according to the face direction of a person (user). Specifically, when the face is not facing forward (for example, when facing sideways), the information processing device 1 aims to save power by reducing the screen luminance of the display unit 110. Furthermore, when the face faces forward again, the information processing device 1 returns the screen luminance to the original level before reduction.

[0037] In the following, the original screen luminance before being lowered is referred to as "standard luminance". Also, the screen luminance lowered from the standard luminance when the face is not facing forward (for example, when facing sideways) is referred to as "low luminance". Low luminance is at least luminance lower than the standard luminance, and the lower the luminance, the greater the effect of power saving. For example, low luminance may be luminance of about 0 to 10% of the standard luminance. Note that when the face is not facing forward, this also includes when the face is facing up or down.

[0038] Here, the information processing device 1 can be connected to an external display. For example, when an external display is not connected, even if the user is not facing forward (toward the PC), if there is a user input (hereinafter referred to as "HID input") to an HID (Human Interface Device) such as the keyboard 151 or the touchpad 153, it can be determined that the user is using the device. Therefore, when there is an HID input, the information processing device 1 disables (Disables) the brightness reduction process according to the face direction described above so as not to perform the process.

[0039] On the other hand, when an external display is connected, even if there is an HID input, there is a possibility that the user is looking at (paying attention to) the external display, so in some cases it may be preferable to leave the brightness reduction process enabled rather than disabled from the viewpoint of power saving, etc. Therefore, when an external display is connected, the information processing device 1 controls whether to enable or disable the brightness reduction process differently depending on whether the active window and cursor are displayed on the screen of the external or internal display.

[0040] The active window refers to the window being worked on or selected. The cursor refers to an icon (picture, mark, etc.) or symbol that indicates the operation or input position indicated by a pointing device such as a mouse or touchpad. In other words, when the active window and cursor are displayed, it can be assumed that the user is looking at them (paying attention to them).

[0041] 4 is a schematic diagram showing a first example of a state in which the information processing device 1 according to this embodiment is connected to an external display and used. The information processing device 1 is connected to an external display device 5 (display device) including a display unit 510 as an external display. As a connection method, any connection method using HDMI (registered trademark), USB Type-C, DisplayPort, etc. can be applied. Note that the information processing device 1 may be connected to the external display device 5 wirelessly.

[0042] In the following description, the display unit 110 as an internal display provided in the information processing device 1 will be simply referred to as an "internal display." On the other hand, the display unit 510 as an external display provided in the external display device 5 will be simply referred to as an "external display."

[0043] In the example shown in Fig. 4, the active window and cursor are displayed on the screen of the external display, and neither the active window nor the cursor is displayed on the screen of the internal display. In this case, it can be assumed that the user is looking at (paying attention to) the external display. Therefore, when neither the active window nor the cursor is displayed on the screen of the internal display, the information processing device 1 enables the brightness reduction process for the internal display regardless of the presence or absence of HID input (i.e., even if there is HID input).

[0044] Next, a case where an active window and a cursor are displayed on the screen of the internal display will be described with reference to Fig. 5. Fig. 5 is a schematic diagram showing a second example of a state in which the information processing device 1 according to the present embodiment is connected to an external display and is being used.

[0045] In the example shown in Fig. 5, the active window and cursor are displayed on the screen of the internal display, and neither the active window nor the cursor is displayed on the screen of the external display. In this case, it can be assumed that the user is looking at (paying attention to) the internal display. Therefore, when either or both of the active window and the cursor are displayed on the screen of the internal display, the information processing device 1 disables (Disables) the brightness reduction process for the internal display in response to the presence of an HID input.

[0046] The configuration of the information processing device 1 according to this embodiment will be described in detail below. [Hardware configuration of information processing device] Fig. 6 is a schematic block diagram showing an example of a hardware configuration of an information processing device 1 according to this embodiment. In Fig. 6, the same reference numerals are used for components corresponding to those in Fig. 1. The information processing device 1 includes a display unit 110, an imaging unit 120, an external connection terminal 130, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400.

[0047] The display unit 110 (internal display) displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0048] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in a direction (forward) facing the inner surface of the first housing 10, and outputs the captured image to the main processing unit 300 and the face detection unit 210. For example, the imaging unit 120 includes a visible light camera (RGB camera) that captures images using visible light, and an infrared camera (IR camera) that captures images using infrared light.

[0049] The imaging section 120 may be configured to include either a visible light camera or an infrared camera, or may be configured to include both.

[0050] The external connection terminal 130 is a connection terminal for connecting to an external display device (display device) 5. For example, the external connection terminal 130 is an HDMI (registered trademark) terminal, a USB Type-C terminal, a display port, or the like.

[0051] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an HPD (input unit) that accepts input by a user, and is configured to include, for example, a keyboard 151 and a touch pad 153. In response to accepting an operation on the keyboard 151 and the touch pad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0052] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0053] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), a RAM, a ROM, etc. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0054] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into a voltage required by each unit. The power whose voltage has been converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0055] The EC200 is a microcomputer including a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and an input / output (I / O) logic circuit. The CPU of the EC200 reads a control program (firmware) prestored in its own ROM, and executes the read control program to fulfill its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to a power button 140, an input device 150, a power supply unit 400, and the like.

[0056] For example, the EC 200 communicates with the power supply unit 400 to obtain information on the battery state (such as remaining capacity) from the power supply unit 400 and outputs control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1 to the power supply unit 400. The EC 200 also obtains operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to the processing of the main processing unit 300 among the obtained operation signals.

[0057] The face detection unit 210 includes a processor that processes image data of a captured image captured by the imaging unit 120. The face detection unit 210 acquires image data of a captured image captured by the imaging unit 120, and temporarily stores the acquired image data in a memory. The memory that stores the image data may be the system memory 304, or may be a memory (not shown) in the face detection unit 210.

[0058] For example, the face detection unit 210 performs face detection processing to detect a face area (area of ​​a face image) from the captured image and detect the face orientation of the face image of the detected face area by processing image data of the captured image acquired from the imaging unit 120. Any detection method can be applied as a face detection method, such as a face detection algorithm that detects a face based on facial feature information, or face detection using learning data (trained model) machine-learned based on facial feature information or a face detection library. In addition, the orientation of the face is detected as an angle from a reference direction, for example, with the reference direction being 0°. The reference direction is, for example, the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120). When the face faces the reference direction, it is detected as a state in which the face faces the front with respect to the information processing device 1 (the display unit 110 and the imaging unit 120).

[0059] In addition, in the face detection process, the face detection unit 210 performs a face direction determination process to determine whether or not the face faces forward. The face detection unit 210 determines whether or not the face faces forward based on the face direction detected from the captured image, and transmits the determination result to the main processing unit 300. In addition, the face detection unit 210 controls the detection frame rate when performing the face detection process.

[0060] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0061] The CPU 301 is a processor that executes processes based on BIOS programs, processes based on OS programs, processes based on application programs that run on the OS, etc. For example, the CPU 301 executes a startup process that starts the system from a standby state and transitions it to a normal operating state, a sleep process that transitions it from the normal operating state to a standby state, etc. The CPU 301 also executes a brightness reduction process that reduces the screen brightness of the display unit 110 (internal display) based on the result of the face detection process by the face detection unit 210 described above, etc.

[0062] The GPU 302 is connected to the display unit 110 (internal display). The GPU 302 executes image processing to generate display data under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110 (internal display).

[0063] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110 (internal display), and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires detection results by face detection processing acquired from the face detection unit 210, and outputs the results to the CPU 301.

[0064] The system memory 304 is used as a reading area for the programs executed by the CPU 301, a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0065] The CPU 301, the GPU 302, and the chipset 303 may be configured as a single integrated processor, or some or each of them may be configured as individual processors. For example, in a normal operation state, the CPU 301, the GPU 302, and the chipset 303 are all in operation, but in a standby state, only at least a part of the chipset 303 is in operation.

[0066] [Functional configuration of information processing device] Next, a detailed description will be given of the functional configuration of the information processing device 1 that controls the screen luminance according to the face direction.

[0067] Fig. 7 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a face detection unit 210 and a system processing unit 310. The face detection unit 210 corresponds to the face detection unit 210 in Fig. 6, and includes a face area detection unit 211, a face direction detection unit 212, and a detection result output unit 213 as functional components for performing face detection processing.

[0068] The face area detection section 211 processes image data of a captured image acquired from the imaging section 120 to detect a face area (area of ​​a face image) in which a face is captured from the captured image.

[0069] The face direction detection unit 212 detects the direction (face angle) of the face captured in the face area detected from the captured image by the face area detection unit 211. For example, the face direction detection unit 212 detects the face angle in the range of ±90°, with the face angle being 0° when the face faces forward.

[0070] The detection result output unit 213 outputs information based on the detection result, based on the face angle detected by the face direction detection unit 212. For example, when the detection result output unit 213 determines that the face is facing forward (facing forward) based on the face angle detected by the face direction detection unit 212, it outputs "Attention" information to the system processing unit 310 as information indicating that the user is looking at (paying attention to) the information processing device 1.

[0071] On the other hand, when the detection result output unit 213 determines that the face is not facing forward based on the face angle detected by the face direction detection unit 212, it outputs “No Attention” information to the system processing unit 310 as information indicating that the user is not looking at (not paying attention to) the information processing device 1.

[0072] The detection result output unit 213 may determine whether or not the user is facing the direction of the external display device 5 based on the face angle detected by the face direction detection unit 212.

[0073] The system processing unit 310 is a functional configuration realized by the CPU 301 or the chipset 303 executing a system program or a program for HPD processing. For example, the system processing unit 310 includes a brightness reduction processing unit 311, a connection detection unit 312, an HID input detection unit 313, a display state determination unit 314, and a brightness reduction control unit 315 as functional configurations realized by the CPU 301 or the chipset 303 executing an OS program.

[0074] The luminance reduction processing unit 311 executes a luminance reduction process for reducing the screen luminance of the display unit 110 (internal display) based on the direction of the face detected by the face detection unit 210. For example, when the luminance reduction processing unit 311 acquires "No Attention" information from the face detection unit 210 in a normal operating state, it controls the screen luminance to low luminance. That is, when the direction of the face detected by the face detection unit 210 changes from facing forward to not facing forward (for example, facing sideways), the luminance reduction processing unit 311 reduces the screen luminance.

[0075] Furthermore, when the luminance reduction processing unit 311 acquires "Attention" information from the face detection unit 210 while the screen luminance is controlled to a low luminance, the luminance reduction processing unit 311 returns the screen luminance to the standard luminance. That is, when the luminance reduction processing unit 311 determines that the orientation of the face detected by the face detection unit 210 faces forward after reducing the screen luminance, the luminance reduction processing unit 311 returns the screen luminance to the standard luminance before being reduced.

[0076] The luminance reduction processing unit 311 also includes a timer for measuring time, and measures the waiting time from when the "No Attention" information is acquired from the face detection unit 210 in a normal operating state until the screen luminance is controlled to low luminance. For example, if the luminance reduction processing unit 311 acquires "Attention" information before a predetermined waiting time has elapsed even after acquiring "No Attention" information, the luminance reduction processing unit 311 does not control the screen luminance to low luminance but keeps it at standard luminance. On the other hand, if the luminance reduction processing unit 311 does not acquire "Attention" information before a predetermined waiting time has elapsed after acquiring "No Attention" information, it controls the screen luminance to low luminance. This makes it possible to prevent the screen luminance from becoming low luminance even if the user looks away for a moment while using the information processing device 1. The predetermined waiting time is preset to, for example, 10 seconds. Note that this predetermined waiting time may be configured to be set by the user.

[0077] The connection detection unit 312 detects whether or not there is a connection to the external display device 5 connected via the external connection terminal 130. The connection detection unit 312 outputs the detection result of whether or not there is a connection to the external display device 5 to the display state determination unit 314 and the brightness reduction control unit 315.

[0078] The HID input detection unit 313 detects an HID input to the keyboard 151 or the touchpad 153. For example, the HID input detection unit 313 detects an HID input via the EC 200 to which operation signals are input from the keyboard 151 and the touchpad 153. Note that the HID input is not limited to an input to the keyboard 151 or the touchpad 153, but may be an input using an external keyboard or mouse, or may be an audio input to a microphone (not shown). When the HID input detection unit 313 detects an HID input, it outputs information indicating that an HID input has been detected to the luminance reduction control unit 315.

[0079] Display state determination unit 314 determines whether the active window and the cursor are displayed on the screen of the internal display or the screen of the external display in a state in which connection detection unit 312 has determined that external display device 5 is connected via external connection terminal 130. Display state determination unit 314 outputs the determination result to brightness reduction control unit 315.

[0080] The brightness reduction control unit 315 controls the brightness reduction processing by the brightness reduction processing unit 311 to enable or disable based on the detection results of the connection detection unit 312, the detection results of the HID input detection unit 313, the judgment results of the display state judgment unit 314, etc.

[0081] For example, when the brightness reduction process is enabled in a state where no external display is connected, the brightness reduction control unit 315 disables the brightness reduction process in response to an HPD input. This processing mode in which the brightness reduction process is disabled in response to an HPD input in a state where no external display is connected is referred to as a "first brightness reduction processing mode" (normal brightness reduction processing mode).

[0082] On the other hand, the brightness reduction control unit 315 enables the brightness reduction process when neither the active window nor the cursor is displayed on the screen of the internal display (display unit 110) in a state where an external display is connected. For example, the brightness reduction control unit 315 enables the brightness reduction process regardless of the presence or absence of an HPD input in a state where an external display is connected, when neither the active window nor the cursor is displayed on the screen of the internal display (display unit 110). This processing mode in which the brightness reduction process is enabled regardless of the presence or absence of an HPD input in a state where an external display is connected is referred to as a "second brightness reduction processing mode."

[0083] Furthermore, in a state where an external display is connected, if either or both of an active window and a cursor are displayed on the screen of the internal display (display unit 110), the luminance reduction control unit 315 enables the luminance reduction process when there is no HPD input, and disables the luminance reduction process in response to the presence of an HPD input. That is, in a state where an external display is connected, if either or both of an active window and a cursor are displayed on the screen of the internal display (display unit 110), the luminance reduction control unit 315 executes the luminance reduction process in the first luminance reduction process mode, similarly to a state where an external display is not connected.

[0084] When either or both of the active window and the cursor are displayed on the screen of the internal display (display unit 110), the luminance reduction control unit 315 may disable the luminance reduction process regardless of the presence or absence of an HPD input.

[0085] [Processing behavior] Next, the operation of the brightness reduction process executed by the brightness reduction processing unit 311 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the brightness reduction process according to the present embodiment. Here, it is assumed that the information processing device 1 is in a normal operating state, the user's face is facing forward, and the screen brightness is set to standard brightness.

[0086] (Step S101) The luminance reduction processing unit 311 judges whether or not "No Attention" information has been acquired from the face detection unit 210. If the luminance reduction processing unit 311 judges that "No Attention" information has not been acquired (NO), it performs the process of step S101 again. On the other hand, if the luminance reduction processing unit 311 judges that "No Attention" information has been acquired (YES), it starts counting the waiting time using a timer (step S103). Then, it proceeds to the process of step S105.

[0087] (Step S105) The luminance reduction processing unit 311 determines whether or not "Attention" information has been acquired from the face detection unit 210. When the luminance reduction processing unit 311 determines that "Attention" information has not been acquired (NO), the process proceeds to step S107.

[0088] (Step S107) The luminance reduction processing unit 311 determines whether or not the waiting time (e.g., 10 seconds) has elapsed (i.e., whether or not the timer has expired) based on the value of the timer. If the luminance reduction processing unit 311 determines that the waiting time (e.g., 10 seconds) has not elapsed (i.e., the timer has not expired) (Step S107: NO), the process returns to step S105. If the luminance reduction processing unit 311 determines that the "Attention" information has been acquired before the waiting time (e.g., 10 seconds) has elapsed (Step S105: YES), the process returns to step S101. At this time, the timer is reset.

[0089] On the other hand, if the luminance reduction processing unit 311 determines in step S107 that the waiting time (for example, 10 seconds) has elapsed (step S107: YES), the process proceeds to step S109.

[0090] (Step S109) The luminance reduction processing unit 311 changes the screen luminance from standard luminance to low luminance, and then proceeds to the process of step S111.

[0091] (Step S111) The luminance reduction processing unit 311 determines whether or not "Attention" information has been acquired from the face detection unit 210. If the luminance reduction processing unit 311 determines that "Attention" information has not been acquired (NO), it performs the process of step S111 again. On the other hand, if the luminance reduction processing unit 311 determines that "Attention" information has been acquired (YES), it returns the screen luminance to standard luminance (step S113).

[0092] Next, the operation of the luminance reduction control process executed by the luminance reduction control unit 315 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the luminance reduction control process according to the present embodiment.

[0093] (Step S201) The brightness reduction control unit 315 determines whether or not an external display is connected based on the detection result of the connection detection unit 312. If the brightness reduction control unit 315 determines that an external display is not connected (NO), the process proceeds to step S207. On the other hand, if the brightness reduction control unit 315 determines that an external display is connected (YES), the process proceeds to step S203.

[0094] (Step S203) Brightness reduction control unit 315 determines the display position of the active window based on the determination result of display state determination unit 314. If brightness reduction control unit 315 determines that the display position of the active window is on the internal display, the process proceeds to step S207. On the other hand, if brightness reduction control unit 315 determines that the display position of the active window is on the external display, the process proceeds to step S205.

[0095] (Step S205) The luminance reduction control unit 315 determines the display position of the cursor based on the determination result of the display state determination unit 314. If the luminance reduction control unit 315 determines that the display position of the cursor is on the internal display, the process proceeds to step S207. On the other hand, if the luminance reduction control unit 315 determines that the display position of the cursor is on the external display, the process proceeds to step S209.

[0096] (Step S207) The luminance reduction control unit 315 controls enabling or disabling of the luminance reduction process for the internal display in the "first luminance reduction process mode" (normal luminance reduction process mode). For example, the luminance reduction control unit 315 disables the luminance reduction process for the internal display in response to the HPD input.

[0097] (Step S209) The luminance reduction control unit 315 controls enabling or disabling of the luminance reduction process for the internal display in the “second luminance reduction process mode.” For example, the luminance reduction control unit 315 enables the luminance reduction process for the internal display regardless of the presence or absence of an HPD input.

[0098] [Summary of the first embodiment] As described above, the information processing device 1 according to this embodiment includes a memory (for example, a system memory 304) that temporarily stores image data of a captured image captured by the imaging unit 120. The information processing device 1 also includes a face detection unit 210, a CPU 301, and a chip set 303 as an example of a processor. The face detection unit 210 processes the image data of the captured image stored in the memory to execute face detection processing for detecting a face area in which a face is captured and the orientation of the face from within the captured image. The information processing device 1 also includes a display unit 110 as an internal display, and an external connection terminal 130 (an example of a connection unit) that connects to an external display device 5 as an external display.

[0099] The information processing device 1 executes a brightness reduction process to reduce the screen brightness of the internal display based on the orientation of the face relative to the internal display detected by the face detection process. Furthermore, the information processing device 1 enables the brightness reduction process when neither the active window nor the cursor is displayed on the screen of the internal display while connected to an external display. On the other hand, the information processing device 1 disables the brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the internal display while connected to an external display.

[0100] As a result, when it is assumed that the user is looking at (paying attention to) the external display, the information processing device 1 enables the brightness reduction process for the internal display even if there is an HID input (user input), thereby enabling power saving. On the other hand, when there is a possibility that the user is looking at (paying attention to) the internal display, the information processing device 1 disables the brightness reduction process, thereby preventing the screen brightness from being reduced even when the user is looking at (paying attention to) the internal display. Thus, the information processing device 1 can appropriately reduce the screen brightness of the internal display in accordance with the direction of the face even when an external display is connected.

[0101] For example, when the information processing device 1 is not connected to an external display and the brightness reduction process is enabled, the information processing device 1 disables the brightness reduction process in response to the presence of an HID input. On the other hand, when the information processing device 1 is connected to an external display and neither the active window nor the cursor is displayed on the screen of the internal display, the information processing device 1 enables the brightness reduction process regardless of the presence or absence of an HID input (user input).

[0102] As a result, when there is an HID input while the information processing device 1 is not connected to an external display, it is assumed that the user is looking at (paying attention to) the internal display, and therefore it is possible to prevent the screen brightness from being reduced. On the other hand, when the information processing device 1 is connected to an external display, if it is assumed that the user is looking at (paying attention to) the external display, it enables the brightness reduction process for the internal display even if there is an HID input (user input), thereby enabling power saving. Therefore, the information processing device 1 can appropriately reduce the screen brightness of the internal display in accordance with the face direction whether or not an external display is connected.

[0103] Furthermore, when the information processing device 1 is connected to an external display, even if either or both of an active window and a cursor are displayed on the screen of the internal display, if there is no HID input, the information processing device 1 enables the brightness reduction process, and disables the brightness reduction process if there is an HID input.

[0104] As a result, even if either the active window or the cursor or both are displayed on the internal display screen, if there is no HID input and the face is not facing forward, the information processing device 1 can assume that the user is not looking at (attention is not paid to) the internal display, and therefore can achieve power savings by enabling brightness reduction processing for the internal display.

[0105] Note that, when connected to an external display, the information processing device 1 may disable the brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the internal display, regardless of the presence or absence of HID input. In this case, the information processing device 1 cannot achieve power saving when there is no HID input and the face is not facing forward, but it can prevent the screen brightness from being reduced even when the user is looking at (paying attention to) the internal display.

[0106] Furthermore, the control method in the information processing device 1 according to this embodiment includes the steps of: performing face detection processing to detect a face area in which a face is captured and the orientation of the face from within the captured image by processing image data of the captured image stored in a memory (e.g., system memory 304); performing brightness reduction processing to reduce the screen brightness of the internal display based on the orientation of the face relative to the internal display detected by the face detection processing; and performing brightness reduction control processing to enable the brightness reduction processing when neither the active window nor the cursor is displayed on the screen of the internal display in a state where an external display is connected, and disable the brightness reduction processing when either the active window or the cursor or both are displayed on the screen of the internal display.

[0107] As a result, the control method in the information processing device 1 enables the brightness reduction process for the internal display when it is assumed that the user is looking at (attention is being paid to) the external display, even if there is an HID input (user input), thereby enabling power saving. On the other hand, the information processing device 1 disables the brightness reduction process when there is a possibility that the user is looking at (attention is being paid to) the internal display, thereby preventing the screen brightness from being reduced even when the user is looking at (attention is being paid to) the internal display. Thus, the control method in the information processing device 1 can appropriately reduce the screen brightness of the internal display in accordance with the direction of the face even when an external display is connected.

[0108] <Second embodiment> Next, a second embodiment of the present invention will be described. In the first embodiment, the luminance reduction process for the internal display has been described, but the luminance reduction process may also be performed on the external display. The present embodiment can be applied to an external display having a function for changing the screen luminance under control of the information processing device 1. The basic configuration of the information processing device 1 according to the present embodiment is similar to the configuration described in the first embodiment with reference to Figs. 1, 2, 6, and 7, and therefore the description thereof will be omitted. The luminance reduction process described with reference to Fig. 8 can also be applied to the external display in the same manner.

[0109] An overview of the brightness reduction process according to this embodiment will be described with reference to Fig. 10 and Fig. 11. Note that Fig. 10 and Fig. 11 add a description of the brightness reduction process for the external display to Fig. 4 and Fig. 5, and the brightness reduction process for the internal display is the same as in the first embodiment, so the description will be omitted.

[0110] Fig. 10 is a schematic diagram showing a first example of a state in which the information processing device 1 according to the present embodiment is connected to an external display and is being used. In the example shown in Fig. 10, the active window and cursor are displayed on the screen of the external display, and neither the active window nor the cursor is displayed on the screen of the internal display. In this case, it can be assumed that the user is looking at (paying attention to) the external display. Therefore, when either or both of the active window and the cursor are displayed on the screen of the external display, the information processing device 1 disables (Disables) the brightness reduction process for the internal display in response to the presence of an HID input.

[0111] FIG. 11 is a schematic diagram showing a second example of a state in which the information processing device 1 according to the present embodiment is connected to an external display and used. In the example shown in Fig. 11, the active window and cursor are displayed on the screen of the internal display, and neither the active window nor the cursor is displayed on the screen of the external display. In this case, it can be assumed that the user is looking at (paying attention to) the internal display. Therefore, when neither the active window nor the cursor is displayed on the screen of the external display, the information processing device 1 enables the brightness reduction process for the external display regardless of the presence or absence of HID input (i.e., even if there is HID input).

[0112] In this way, the information processing device 1 executes a brightness reduction process (external brightness reduction process) that reduces the screen brightness of the external display based on the orientation of the face relative to the external display detected by the face detection process. For example, when the information processing device 1 is connected to the external display and neither the active window nor the cursor is displayed on the screen of the external display, the information processing device 1 enables the brightness reduction process for the external display. On the other hand, when the information processing device 1 is connected to the external display and either or both of the active window and the cursor are displayed on the screen of the external display, the information processing device 1 disables the brightness reduction process for the external display.

[0113] As a result, when it is assumed that the user is looking at (paying attention to) the internal display, the information processing device 1 enables the brightness reduction process for the external display even if there is an HID input (user input), thereby enabling power saving. On the other hand, when there is a possibility that the user is looking at (paying attention to) the external display, the information processing device 1 disables the brightness reduction process, thereby preventing the screen brightness from being reduced even when the user is looking at (paying attention to) the external display. Therefore, the information processing device 1 can appropriately reduce the screen brightness of the external display in accordance with the direction of the face even when the external display is connected.

[0114] For example, when the information processing device 1 is connected to an external display and neither the active window nor the cursor is displayed on the screen of the external display, the information processing device 1 enables brightness reduction processing for the external display regardless of whether or not there is HID input (user input).

[0115] As a result, when it is assumed that the user is looking at (paying attention to) the internal display, the information processing device 1 enables brightness reduction processing on the external display even if there is HID input (user input), thereby enabling power saving.

[0116] Furthermore, when the information processing device 1 is connected to an external display, even if either or both of an active window and a cursor are displayed on the screen of the external display, if there is no HID input, the information processing device 1 enables brightness reduction processing for the external display, and disables brightness reduction processing for the external display in response to the presence of HID input.

[0117] As a result, even if either or both of the active window and the cursor are displayed on the external display screen, if there is no HID input and the face is not facing the external display, the information processing device 1 can assume that the user is not looking at (paying attention to) the external display, and can therefore achieve power savings by enabling brightness reduction processing for the external display.

[0118] Next, the operation of the brightness reduction control process executed by the brightness reduction control unit 315 will be described with reference to Fig. 12. Fig. 12 is a flowchart showing an example of the brightness reduction control process according to this embodiment. In this embodiment, both the internal display and the external display can be subject to the brightness reduction process. In the following description, the internal display and the external display that are subject to the brightness reduction process will be referred to as the "target display" and the display that is not the "target display" will be referred to as the "non-target display".

[0119] (Step S301) The brightness reduction control unit 315 determines whether or not an external display is connected based on the detection result of the connection detection unit 312. If the brightness reduction control unit 315 determines that an external display is not connected (NO), the process proceeds to step S307. On the other hand, if the brightness reduction control unit 315 determines that an external display is connected (YES), the process proceeds to step S303.

[0120] (Step S303) Brightness reduction control unit 315 determines the display position of the active window based on the determination result of display state determination unit 314. If brightness reduction control unit 315 determines that the display position of the active window is on the target display, the process proceeds to step S307. On the other hand, if brightness reduction control unit 315 determines that the display position of the active window is on the non-target display, the process proceeds to step S305.

[0121] (Step S305) The luminance reduction control unit 315 determines the display position of the cursor based on the determination result of the display state determination unit 314. If the luminance reduction control unit 315 determines that the display position of the cursor is on the target display, the process proceeds to step S307. On the other hand, if the luminance reduction control unit 315 determines that the display position of the cursor is on the non-target display, the process proceeds to step S309.

[0122] (Step S307) The luminance reduction control unit 315 controls enabling or disabling of the luminance reduction process for the target display in the "first luminance reduction process mode" (normal luminance reduction process mode). For example, the luminance reduction control unit 315 disables the luminance reduction process for the target display in response to the HPD input.

[0123] (Step S309) The luminance reduction control unit 315 controls whether the luminance reduction process for the target display is enabled or disabled in the “second luminance reduction process mode”. For example, the luminance reduction control unit 315 enables the luminance reduction process for the target display regardless of the presence or absence of an HPD input.

[0124] [Summary of the second embodiment] As described above, the information processing device 1 according to this embodiment includes a memory (for example, a system memory 304) that temporarily stores image data of a captured image captured by the imaging unit 120. The information processing device 1 also includes a face detection unit 210, a CPU 301, and a chip set 303 as an example of a processor. The face detection unit 210 processes the image data of the captured image stored in the memory to execute face detection processing for detecting a face area in which a face is captured and the orientation of the face from within the captured image. The information processing device 1 also includes a display unit 110 as an internal display, and an external connection terminal 130 (an example of a connection unit) that connects to an external display device 5 as an external display.

[0125] The information processing device 1 executes a brightness reduction process for reducing the screen brightness of the internal display or the external display based on the orientation of the face detected by the face detection process. Furthermore, when the information processing device 1 is connected to an external display, if neither the active window nor the cursor is displayed on the screen of a target display among the internal display and the external display that is to be subjected to the brightness reduction process, the information processing device 1 enables the brightness reduction process for the target display. On the other hand, when the information processing device 1 is connected to an external display, if either or both of the active window and the cursor are displayed on the screen of the target display, the information processing device 1 disables the brightness reduction process for the target display.

[0126] As a result, when it is assumed that the user is looking at (paying attention to) a non-target display, the information processing device 1 enables the brightness reduction process for the target display even if there is an HID input (user input), thereby enabling power saving. On the other hand, when there is a possibility that the user is looking at (paying attention to) the target display, the information processing device 1 disables the brightness reduction process, thereby preventing the screen brightness from being reduced even when the user is looking at (paying attention to) the target display. Thus, the information processing device 1 can appropriately reduce the screen brightness of the external display in accordance with the face direction even when an external display is connected.

[0127] For example, when the information processing device 1 is connected to an external display and neither the active window nor the cursor is displayed on the screen of the target display, the information processing device 1 enables brightness reduction processing for the target display regardless of whether or not there is HID input (user input).

[0128] As a result, when the information processing device 1 is connected to an external display, if it is assumed that the user is looking at (attention is focused on) a non-target display, the information processing device 1 enables brightness reduction processing for the target display even if there is HID input (user input), thereby achieving power savings.

[0129] Furthermore, when the information processing device 1 is connected to an external display, even if either or both of an active window and a cursor are displayed on the screen of the target display, if there is no HID input, the information processing device 1 enables brightness reduction processing for the target display, and disables brightness reduction processing for the target display in response to the presence of HID input.

[0130] As a result, even if either or both of the active window and the cursor are displayed on the screen of the target display, if there is no HID input and the face is not facing the target display, the information processing device 1 can assume that the user is not looking at (not paying attention to) the target display, and can therefore achieve power savings by enabling brightness reduction processing for the target display.

[0131] Furthermore, the control method in the information processing device according to this embodiment includes the steps of: performing face detection processing to detect a face area in which a face is captured from the captured image and the direction of the face by processing image data of the captured image stored in a memory (e.g., system memory 304); performing brightness reduction processing to reduce the screen brightness of the internal display or the external display based on the direction of the face detected by the face detection processing; and performing brightness reduction control processing to enable the brightness reduction processing for the target display that is to be subjected to the brightness reduction processing, when neither the active window nor the cursor is displayed on the screen of the target display out of the internal display and the external display, in a state where the external display is connected, and to disable the brightness reduction processing for the target display, when either the active window or the cursor or both are displayed on the screen of the target display.

[0132] As a result, the control method in the information processing device 1 enables the brightness reduction process for the target display when it is assumed that the user is looking at (attention is being paid to) a non-target display, thereby enabling power saving even if there is an HID input (user input). On the other hand, the information processing device 1 disables the brightness reduction process when there is a possibility that the user is looking at (attention is being paid to) the target display, thereby preventing the screen brightness from being reduced even when the user is looking at (attention is being paid to) the target display. Thus, the control method in the information processing device 1 can appropriately reduce the screen brightness of the external display in accordance with the face direction even when an external display is connected.

[0133] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiment can be combined in any combination.

[0134] In the above embodiment, a configuration example in which one external display (external display device 5) is connected to the information processing device 1 has been described, but two or more external displays may be connected.

[0135] Furthermore, the CPU 301 and the chipset 303 may be configured as separate processors, or may be integrated into a single processor.

[0136] In the above embodiment, an example has been described in which the face detection unit 210 is provided separately from the CPU 301 and the chipset 303, but a part or all of the face detection unit 210 may be provided in the chipset 303, or may be provided in a processor integrated with the CPU 301 or the chipset 303. For example, the CPU 301, the chipset 303, and the face detection unit 210 may be configured as separate processors, or may be integrated into one processor. A part or all of the face detection unit 210 may be provided in the EC 200. A part of the system processing unit 310 may be provided in the EC 200.

[0137] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, power-off state, etc. are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0138] The information processing device 1 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0139] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0140] In addition, some or all of the functions of the information processing device 1 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used.

[0141] Furthermore, the information processing device 1 of the above embodiment is not limited to a notebook PC, but may be, for example, a desktop PC. [Explanation of symbols]

[0142] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 130 External connection terminal, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Face detection unit, 211 Face area detection unit, 212 Face direction detection unit, 213 Detection result output unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chip set, 304 System memory, 310 System processing unit, 311 Brightness reduction processing unit, 312 Connection detection unit, 313 HID input detection unit, 314 Display state determination unit, 315 Brightness reduction control unit, 400 Power supply unit

Claims

1. A memory that temporarily stores image data of an image captured by the imaging unit; a processor for processing image data stored in said memory; The internal display and A connector for connecting to an external display; Equipped with The processor, a face detection process for detecting a face area in the image and a direction of the face by processing image data of the image stored in the memory; a brightness reduction process of reducing a screen brightness of the internal display based on a direction of the face with respect to the internal display detected by the face detection process; a brightness reduction control process for enabling the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the internal display while the external display is connected, and disabling the brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the internal display; An information processing device that performs the above.

2. In the luminance reduction control process, the processor When the external display is not connected and the brightness reduction process is enabled, the brightness reduction process is disabled in response to a user input; When neither an active window nor a cursor is displayed on the screen of the internal display in a state where the external display is connected, the brightness reduction process is enabled regardless of the presence or absence of a user input. The information processing device according to claim 1 .

3. In the luminance reduction control process, the processor in a state where the external display is connected, when either one or both of an active window and a cursor are displayed on a screen of the internal display, if there is no user input, the brightness reduction process is enabled, and when there is a user input, the brightness reduction process is disabled. The information processing device according to claim 1 .

4. The processor, an external brightness reduction process is further performed in the brightness reduction process to reduce a screen brightness of the external display based on a direction of the face with respect to the external display detected by the face detection process; In the luminance reduction control process, in a state where the external display is connected, when neither an active window nor a cursor is displayed on a screen of the external display, the external brightness reduction process is enabled, and when either or both of the active window and the cursor are displayed on the screen of the external display, the external brightness reduction process is disabled. The information processing device according to claim 1 .

5. In the luminance reduction control process, the processor When neither an active window nor a cursor is displayed on a screen of the external display in a state where the external display is connected, the external brightness reduction process is enabled regardless of the presence or absence of a user input. The information processing device according to claim 4.

6. In the luminance reduction control process, the processor In a state where the external display is connected, when both an active window and a cursor are displayed on a screen of the external display and there is no user input, the external brightness reduction process is enabled, and when there is a user input, the external brightness reduction process is disabled. The information processing device according to claim 4.

7. A memory that temporarily stores image data of an image captured by the imaging unit; a processor for processing image data stored in said memory; The internal display and A connector for connecting to an external display; Equipped with The processor, a face detection process for detecting a face area in the image and a direction of the face by processing image data of the image stored in the memory; a brightness reduction process of reducing a screen brightness of the internal display or the external display based on a direction of the face detected by the face detection process; a brightness reduction control process for enabling the brightness reduction process for a target display among the internal display and the external display that is to be subjected to the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the target display while the external display is connected, and disabling the brightness reduction process for the target display when either or both of the active window and the cursor are displayed on the screen of the target display; An information processing device that performs the above.

8. In the luminance reduction control process, the processor When neither an active window nor a cursor is displayed on the screen of the target display in a state where the target display is connected to the external display, the brightness reduction process is enabled regardless of the presence or absence of a user input. The information processing device according to claim 7.

9. In the luminance reduction control process, the processor In a state where the external display is connected, even if either one or both of an active window and a cursor are displayed on a screen of the target display, when there is no user input, the brightness reduction process is enabled, and when there is a user input, the brightness reduction process is disabled. The information processing device according to claim 7.

10. A control method for an information processing device including a memory that temporarily stores image data of an image captured by an imaging unit, a processor that processes the image data stored in the memory, an internal display, and a connection unit that connects to an external display, comprising: The processor, performing face detection processing for detecting a face area in which a face is captured and a direction of the face from within the image by processing image data of the image stored in the memory; performing a brightness reduction process of reducing screen brightness of the internal display based on a direction of the face with respect to the internal display detected by the face detection process; performing a brightness reduction control process for enabling the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the internal display while the external display is connected, and for disabling the brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the internal display; A control method comprising:

11. A control method for an information processing device including a memory that temporarily stores image data of an image captured by an imaging unit, a processor that processes the image data stored in the memory, an internal display, and a connection unit that connects to an external display, comprising: The processor, performing face detection processing for detecting a face area in which a face is captured and a direction of the face from within the image by processing image data of the image stored in the memory; performing a brightness reduction process of reducing screen brightness of the internal display or the external display based on the orientation of the face detected by the face detection process; performing a brightness reduction control process for enabling the brightness reduction process for a target display among the internal display and the external display that is to be subjected to the brightness reduction process when neither an active window nor a cursor is displayed on the screen of the target display while the external display is connected, and for disabling the brightness reduction process for the target display when either or both of the active window and the cursor are displayed on the screen of the target display; A control method comprising:

Citation Information

Patent Citations

  • Method and device for power saving control

    JP1999288259A

  • Display system, display monitor, display network system, and program

    JP2009258865A

  • Electronic apparatus, control method for electronic apparatus, control program, and recording medium

    JP2013182526A

  • Electronic apparatus and control method

    JP2022183484A

  • Image display apparatus

    KR1020180123907A

Cited By

  • Information processing device and control method

    JP7818125B1