Information processing device and control method

Abstract

To appropriately perform brightness reduction processing for reducing the screen brightness of an internal display even when an external display is connected. [Solution] An information processing device includes an imaging unit, an internal display, and a connection unit for connecting to an external display, and performs a face detection process to detect a facial area in the image where a face is captured and the orientation of the face by processing image data of an image captured by the imaging unit, and a brightness reduction process to reduce the screen brightness of the internal display based on whether a facial area is detected by the face detection process and the orientation of the face relative to the internal display.When the information processing device is connected to an external display and neither an active window nor a cursor is displayed on the screen of the internal display, the brightness reduction process does not perform the brightness reduction process based on whether a facial area is detected by the face detection process, but performs the brightness reduction process based on the orientation of the face relative to the internal display.

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There is a device that transitions to a usable state when a person approaches, and transitions to a standby state in which all functions are stopped except for some functions when the person leaves. For example, Patent Document 1 uses an infrared sensor to detect whether a person is approaching or whether the person has moved away.

[0003] In recent years, advances in computer vision and the like have led to improved accuracy in detecting faces from images. Therefore, instead of detecting people using infrared sensors, people are now being detected using face detection. Face detection not only detects people but also detects the orientation of their faces, making it possible to perform control based on the orientation of the face (whether the person is facing forward, facing sideways, etc.). For example, some information processing devices (e.g., PCs: Personal Computers) reduce the brightness of the display screen to save power when it is determined that the user is not using the device based on the presence or absence of a person and the orientation of the face detected by face detection. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-148895 Summary of the Invention [Problem to be solved by the invention]

[0005] For example, notebook (clamshell) PCs are sometimes used connected to an external display. Conventionally, when an external display is connected, the user looks at the external display while using the PC, so it was not possible to apply the brightness reduction process described above, which reduces screen brightness based on the presence or absence of a person and the orientation of their face using face detection. However, as the accuracy of face detection improves, it is desirable to apply brightness reduction process even when an external display is connected.

[0006] Conventionally, when an external display is not connected, even if the user is not facing forward (toward the PC), it is possible to determine that the user is using the device if there is user input (HID input) to a HID (Human Interface Device) such as a keyboard, so the brightness reduction process described above according to the face direction is disabled so that it is not performed. However, when an external display is connected, even if there is HID input, if the user is using (looking at) the external display, it does not mean that they are using (looking at) the PC's internal display, so it is desirable to enable brightness reduction process for the PC's internal display from the perspective of power saving, etc.

[0007] Therefore, when an external display is connected, if it is considered that the user is using (looking at) the external display, it is possible to control the brightness reduction process to be enabled so that the screen brightness of the PC's internal display can be reduced even if there is HID input. However, if this control is implemented, for example, if the user leaves the screen and the screen brightness is reduced, the screen brightness cannot be restored even if the user returns and operates the keyboard. In order to restore the screen brightness, the user must move to a position where a face is detected, which raises concerns that the brightness reduction process may not be performed appropriately.

[0008] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device and a control method that appropriately performs brightness reduction processing to reduce the screen brightness of an internal display even when an external display is connected. [Means for solving the problem]

[0009] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises an imaging unit, a memory for temporarily storing image data of an image captured by the imaging unit, a processor for processing the image data stored in the memory, an internal display, and a connection unit for connecting to an external display, wherein the processor processes the image data of the image stored in the memory to perform a face detection process for detecting a face area in the image in which a face is captured and the orientation of the face, and a brightness reduction process for reducing the screen brightness of the internal display based on whether the face area has been detected by the face detection process and the orientation of the face relative to the internal display, and when connected to the external display, if neither the active window nor the cursor is displayed on the screen of the internal display, the brightness reduction process based on whether the face area has been detected by the face detection process is not performed, and the brightness reduction process based on the orientation of the face relative to the internal display is performed.

[0010] In the above information processing device, in the brightness reduction process, when neither the active window nor the cursor is displayed on the screen of the internal display while connected to the external display, the processor may not perform the brightness reduction process even if the face area changes from a state in which it has been detected by the face detection process to a state in which it is no longer detected, and may perform the brightness reduction process based on the change in the orientation of the face from a state in which it is in a specific direction corresponding to the direction toward the internal display to a state in which it is not in the specific direction while the face area has been detected by the face detection process.

[0011] In the above information processing device, in the brightness reduction process, when neither the active window nor the cursor is displayed on the screen of the internal display while connected to the external display, the processor may start counting a predetermined time in response to the face direction changing from the state in which the face area is detected by the face detection process to a state in which the face direction is not in the specific direction, reduce the screen brightness of the internal display by the brightness reduction process in response to the elapse of the predetermined time, and stop counting the predetermined time if the face direction changes to the specific direction before the elapse of the predetermined time.

[0012] In the information processing device, the processor may, in the brightness reduction process, if the face area changes from being detected by the face detection process to not being detected before the predetermined time has elapsed, temporarily suspend measurement of the predetermined time, and if the face area is detected by the face detection process and the orientation of the face changes from being in the specific direction after temporarily suspending measurement of the predetermined time, resume measurement of the predetermined time and reduce the screen brightness of the internal display by the brightness reduction process in response to the elapse of the predetermined time.

[0013] In the information processing device, the processor may stop timing the predetermined time in the brightness reduction process if, after temporarily suspending the timing of the predetermined time, the face area is detected by the face detection process and the orientation of the face is in the specific direction.

[0014] In the above-described information processing device, the processor may perform brightness reduction control processing to disable the brightness reduction processing in response to user input when the brightness reduction processing is enabled and when the processor is not connected to the external display and neither the active window nor the cursor is displayed on the screen of the internal display, to enable the brightness reduction processing based on the orientation of the face relative to the internal display regardless of whether user input is present or not when the processor is connected to the external display.

[0015] In the above-mentioned information processing device, in the brightness reduction control process, when either an active window or a cursor or both are displayed on the screen of the internal display while connected to the external display, the processor may enable the brightness reduction process if there is no user input, and disable the brightness reduction process in response to user input.

[0016] Furthermore, according to a second aspect of the present invention, a control method for an information processing device comprising an imaging unit, a memory for temporarily storing image data of an image captured by the imaging unit, a processor for processing the image data stored in the memory, an internal display, and a connection unit for connecting to an external display includes the steps of: performing a face detection process by the processor to detect a face area in which a face is captured from the image and the orientation of the face by processing the image data of the image stored in the memory; and performing a brightness reduction process to reduce the screen brightness of the internal display based on whether the face area has been detected by the face detection process and the orientation of the face relative to the internal display; and when neither the active window nor the cursor is displayed on the screen of the internal display while connected to the external display, the brightness reduction process based on whether the face area has been detected by the face detection process is not performed, and the brightness reduction process is performed based on the orientation of the face relative to the internal display. [Effects of the Invention]

[0017] According to the above aspect of the present invention, it is possible to appropriately perform brightness reduction processing for reducing the screen brightness of the internal display even when an external display is connected. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to a first embodiment. [Figure 2]FIG. 2 is a diagram showing an example of a person detection range of the information processing device according to the first embodiment. [Figure 3] 5A and 5B are schematic diagrams illustrating control of screen brightness according to the direction of the face according to the first embodiment. [Figure 4] FIG. 2 is a schematic diagram showing a first example of a state in which the information processing apparatus according to the first embodiment is connected to an external display and used. [Figure 5] FIG. 4 is a schematic diagram showing a second example of a state in which the information processing apparatus according to the first embodiment is connected to an external display and used. [Figure 6] FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to a first embodiment. [Figure 7] FIG. 1 is a schematic block diagram showing an example of the functional configuration of an information processing apparatus according to a first embodiment. [Figure 8] 6 is a flowchart showing an example of a brightness reduction control process according to the first embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a captured image in which a face area is not detected according to the first embodiment. [Figure 10] 10 is a flowchart showing an example of a luminance reduction process in a second luminance reduction process mode according to the first embodiment. [Figure 11] 10A to 10C are diagrams showing examples of changes in face direction according to the second embodiment. [Figure 12] 10A to 10C are diagrams showing examples of detection according to a change in face direction according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First Embodiment [overview] First, an overview of an information processing device according to a first embodiment of the present invention will be described. FIG. 1 is a perspective view showing an example of the external configuration of an information processing device 1 according to this embodiment.

[0020] The information processing device 1 is, for example, a notebook (clamshell) type PC (Personal Computer). The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis defined by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is shown as "θ".

[0021] The first housing 10 is also referred to as the A cover or display housing. The second housing 20 is also referred to as the C cover or system housing. In the following description, the sides of the first housing 10 and the second housing 20 that are provided with the hinge mechanism 15 are referred to as side 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite side 10c and 20c are referred to as side 10a and 20a, respectively. In the illustration, the direction from side 20a toward side 20c is referred to as the "rear," and the direction from side 20c toward side 20a is referred to as the "front." The right and left sides of the rear are referred to as the "right" and "left," respectively. The left sides of the first housing 10 and the second housing 20 are referred to as side 10b and 20b, respectively, and the right sides are referred to as side 10d and 20d, respectively. Furthermore, the state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as the "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Furthermore, the state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as the "open state."

[0022] The external appearance of the information processing device 1 shown in FIG. 1 is an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states in which a user uses the information processing device 1, and it is typically used with an opening angle θ of approximately 100 to 130°. The range of the opening angle θ that results in the open state can be determined arbitrarily depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0023] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD), an organic electroluminescence (EL) display, or the like. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is an example, and the imaging unit 120 may be disposed in another location as long as it can face in a direction facing the display screen of the display unit 110.

[0024] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in the direction facing the display screen of the display unit 110 (i.e., in front of the information processing device 1). The predetermined imaging range is the range of the angle of view determined by the imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture an image including a person (user) present in front of (on the front side of) the information processing device 1.

[0025] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator that allows the user to instruct turning the power on or off, transitioning from a standby state to a normal operating state, transitioning from the normal operating state to a standby state, etc. The normal operating state is an operating state of the system in which processing can be executed without any particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0026] The standby state is a state in which at least a portion of system processing is restricted and in which power consumption is lower than in the normal operating state. For example, the standby state may be a standby state, a sleep state, or the like, and may be a state equivalent to Modern Standby in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI. The standby state may also include a state in which at least the display of the display unit is turned off (screen off) or a state in which the screen is locked. The screen lock is a state in which a preset image (e.g., a screen lock image) is displayed on the display unit so that the contents of processing cannot be seen, and the device cannot be used until the lock is released (e.g., user authentication is performed).

[0027] Furthermore, a keyboard 151 and a touchpad 153 are provided on the inner surface of the second housing 20 as input devices that accept user operation inputs. Note that, instead of or in addition to the keyboard 151 and the touchpad 153, a touch sensor may be provided as the input device, or a mouse or an external keyboard may be connected. In the case where a touch sensor is provided, an area corresponding to the display screen of the display unit 110 may be configured as a touch panel that accepts operations. The input device may also include a microphone that inputs voice.

[0028] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first housing 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing, and are unable to function.

[0029] The information processing device 1 executes HPD (Human Presence Detection) processing to detect a person present in front of the information processing device 1 based on the captured image captured by the imaging unit 120.

[0030] 2 is a diagram showing an example of a person detection range of the information processing device 1 according to this embodiment. In the example shown, a detection range FoV (Field of View: detection field of view angle) in front of the information processing device 1 is a range in which a person can be detected.

[0031] For example, the information processing device 1 determines whether or not a person (user) is present in front of the information processing device 1 by detecting a face area in which a face is captured from a captured image captured by the imaging unit 120. The detection range FoV corresponds to the imaging field angle at which the information processing device 1 captures an image. If a face area is detected from the captured image, the information processing device 1 determines that a person (user) is present. On the other hand, if a face area is not detected from the captured image, the information processing device 1 determines that a person (user) is not present.

[0032] The information processing device 1 uses HPD processing to control the system operation state of the information processing device 1 depending on whether or not a person (user) is present. For example, the information processing device 1 is controlled to a normal operation state when a person (user) is present in front of the information processing device 1, and is controlled to a standby state when no person (user) is present in front of the information processing device 1.

[0033] Furthermore, when a person (user) is present in front of the information processing device 1, the information processing device 1 detects the face orientation of the person (user). For example, the information processing device 1 determines whether the face of the person (user) is facing the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120). The face orientation here refers to the orientation corresponding to the rotation angle of the face in the left-right direction. Hereinafter, a state in which the face is facing the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120) is referred to as a state in which the face is facing forward. Furthermore, a state in which the face is facing right or left with respect to the front is referred to as a state in which the face is facing sideways.

[0034] 3 is a schematic diagram illustrating control of screen brightness according to the face orientation according to this embodiment. As shown in this diagram, the information processing device 1 executes brightness reduction processing to reduce the screen brightness of the display unit 110 according to the face orientation of a person (user). Specifically, when the face is not facing forward (for example, when facing sideways), the information processing device 1 aims to save power by reducing the screen brightness of the display unit 110. Furthermore, when the face is facing forward again, the information processing device 1 restores the original screen brightness before reduction.

[0035] Furthermore, when the information processing device 1 changes from a state in which a person (user) is present in front of the information processing device 1 (a state in which a face area is detected from a captured image) to a state in which a person (user) is not present in front of the information processing device 1 (a state in which a face area is not detected), the information processing device 1 also executes a brightness reduction process to reduce the screen brightness of the display unit 110. In this case, when the information processing device 1 returns to a state in which a person (user) is present and the person's face faces forward, the information processing device 1 returns the screen brightness to the original level before reduction.

[0036] Hereinafter, the original screen brightness before being reduced will be referred to as "standard brightness." Furthermore, the screen brightness reduced from the standard brightness when the face is not facing forward (for example, when facing sideways) will be referred to as "low brightness." Low brightness is at least a brightness lower than the standard brightness, and the lower the brightness, the greater the power saving effect. For example, low brightness may be a brightness of about 0 to 10% of the standard brightness. Note that when the face is not facing forward, this also includes when the face is facing up or down.

[0037] Here, the information processing device 1 can be connected to an external display. For example, when an external display is not connected, even if the user is not facing forward (toward the PC), if there is a user input (hereinafter referred to as "HID input") to an HID (Human Interface Device) such as the keyboard 151 or the touchpad 153, it can be determined that the user is using the device. Therefore, when there is an HID input, the information processing device 1 disables the brightness reduction process according to the face direction described above so as not to perform it.

[0038] On the other hand, when an external display is connected, there is a possibility that the user is looking at (paying attention to) the external display even if there is an HID input, so it may be preferable to leave the brightness reduction process enabled rather than disabled from the perspective of power saving, etc. Therefore, when an external display is connected, the information processing device 1 controls whether to enable or disable the brightness reduction process differently depending on whether the active window and cursor are displayed on the screen of the external or internal display.

[0039] The active window refers to the window that is being worked on or selected. The cursor refers to an icon (picture, mark, etc.) or symbol that indicates the operation or input position indicated by a pointing device such as a mouse or touchpad. In other words, when the active window and cursor are displayed, it can be assumed that the user is looking at them (paying attention to them).

[0040] 4 is a schematic diagram showing a first example of a state in which the information processing device 1 according to this embodiment is connected to an external display and used. The information processing device 1 is connected to an external display device 5 (display device) that includes a display unit 510 as an external display. Any connection method using HDMI (registered trademark), USB Type-C, DisplayPort, or the like can be applied as the connection method. Note that the information processing device 1 may also be connected to the external display device 5 wirelessly.

[0041] In the following description, the display unit 110 as an internal display provided in the information processing device 1 will be simply referred to as an "internal display." On the other hand, the display unit 510 as an external display provided in the external display device 5 will be simply referred to as an "external display."

[0042] 4, the active window and cursor are displayed on the screen of the external display, and neither the active window nor the cursor is displayed on the screen of the internal display. In this case, it can be assumed that the user is looking at (paying attention to) the external display. Therefore, when neither the active window nor the cursor is displayed on the screen of the internal display, the information processing device 1 enables brightness reduction processing for the internal display regardless of whether or not there is an HID input (i.e., even if there is an HID input).

[0043] Next, a case where the active window and cursor are displayed on the screen of the internal display will be described with reference to Fig. 5. Fig. 5 is a schematic diagram showing a second example of a state in which information processing device 1 according to this embodiment is connected to an external display and being used.

[0044] 5, the active window and cursor are displayed on the screen of the internal display, and neither the active window nor the cursor is displayed on the screen of the external display. In this case, it can be assumed that the user is looking at (paying attention to) the internal display. Therefore, when either the active window or the cursor, or both, are displayed on the screen of the internal display, the information processing device 1 disables the brightness reduction process for the internal display in response to an HID input.

[0045] The configuration of the information processing device 1 according to this embodiment will be described in detail below. [Hardware configuration of information processing device] Fig. 6 is a schematic block diagram showing an example of the hardware configuration of an information processing device 1 according to this embodiment. In Fig. 6, components corresponding to those in Fig. 1 are assigned the same reference numerals. The information processing device 1 includes a display unit 110, an imaging unit 120, an external connection terminal 130, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400.

[0046] The display unit 110 (internal display) displays display data (images) generated based on the system processing executed by the main processing unit 300 and the processing of application programs running on the system processing.

[0047] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in the direction facing the inner surface of the first housing 10 (forward), and outputs the captured image to the main processing unit 300 and the face detection unit 210. For example, the imaging unit 120 includes a visible light camera (RGB camera) that captures images using visible light, and an infrared camera (IR camera) that captures images using infrared light.

[0048] The imaging unit 120 may be configured to include either a visible light camera or an infrared camera, or may be configured to include both.

[0049] The external connection terminal 130 is a connection terminal for connecting to an external display device 5 (display device). For example, the external connection terminal 130 is an HDMI (registered trademark) terminal, a USB Type-C terminal, a display port, or the like.

[0050] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an HPD (input unit) that accepts input from a user, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0051] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various types of data. For example, the communication unit 160 is configured to include a wired LAN interface such as Ethernet (registered trademark), a wireless LAN interface such as Wi-Fi (registered trademark), etc.

[0052] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), RAM, and ROM. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0053] The power supply unit 400 supplies power to each unit of the information processing device 1 according to the operating state of each unit. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into the voltage required by each unit. The power whose voltage is converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0054] The EC200 is a microcomputer including a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and I / O (Input / Output) logic circuits. The CPU of the EC200 reads a control program (firmware) pre-stored in its own ROM, executes the read control program, and performs its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to the power button 140, the input device 150, the power supply unit 400, and the like.

[0055] For example, the EC 200 communicates with the power supply unit 400 to acquire information on the battery status (such as remaining capacity) from the power supply unit 400, and outputs to the power supply unit 400 control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1. The EC 200 also acquires operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to processing by the main processing unit 300 among the acquired operation signals.

[0056] The face detection unit 210 is configured to include a processor that processes image data of the captured image captured by the imaging unit 120. The face detection unit 210 acquires image data of the captured image captured by the imaging unit 120 and temporarily stores the acquired image data in memory. The memory that stores the image data may be the system memory 304 or a memory (not shown) within the face detection unit 210.

[0057] For example, the face detection unit 210 performs face detection processing to detect a face area (face image area) from the captured image and detect the face orientation of the face image in the detected face area by processing image data of the captured image acquired from the imaging unit 120. Any detection method can be applied as a face detection method, such as a face detection algorithm that detects a face based on facial feature information, or face detection using learning data (trained model) or a face detection library that is machine-learned based on the facial feature information. Furthermore, the face orientation is detected as an angle from a reference direction, for example, with the reference direction being 0°. The reference direction is, for example, the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120). When the face is facing the reference direction, it is detected as facing forward with respect to the information processing device 1 (the display unit 110 and the imaging unit 120).

[0058] Furthermore, in the face detection process, the face detection unit 210 performs a face direction determination process to determine whether or not the face is facing forward. The face detection unit 210 determines whether or not the face is facing forward based on the face direction detected from the captured image, and transmits the determination result to the main processing unit 300. Furthermore, the face detection unit 210 controls the detection frame rate when performing the face detection process.

[0059] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0060] The CPU 301 is a processor that executes processes based on BIOS programs, processes based on OS programs, and processes based on application programs that run on the OS. For example, the CPU 301 executes a startup process that starts the system from a standby state and transitions it to a normal operating state, and a sleep process that transitions it from the normal operating state to a standby state. The CPU 301 also executes a brightness reduction process that reduces the screen brightness of the display unit 110 (internal display) based on the results of the face detection process by the face detection unit 210 described above.

[0061] The GPU 302 is connected to the display unit 110 (internal display). The GPU 302 generates display data by executing image processing under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110 (internal display).

[0062] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110 (internal display), and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires detection results from the face detection process obtained from the face detection unit 210 and outputs the results to the CPU 301.

[0063] The system memory 304 is used as a reading area for programs executed by the CPU 301 and a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0064] The CPU 301, GPU 302, and chipset 303 may be configured as a single integrated processor, or some or each may be configured as individual processors. For example, in a normal operating state, the CPU 301, GPU 302, and chipset 303 are all in operation, but in a standby state, only at least a part of the chipset 303 is in operation.

[0065] [Functional configuration of information processing device] Next, the functional configuration of the information processing device 1 that controls the screen brightness according to the direction of the face will be described in detail.

[0066] 7 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a face detection unit 210 and a system processing unit 310. The face detection unit 210 corresponds to the face detection unit 210 in FIG. 6, and includes a face area detection unit 211, a face direction detection unit 212, and a detection result output unit 213 as functional components for performing face detection processing.

[0067] The face area detection unit 211 processes image data of the captured image acquired from the imaging unit 120 to detect a face area (area of ​​the face image) in which a face is captured from the captured image.

[0068] The face direction detection unit 212 detects the direction (face angle) of the face captured in the face area detected from the captured image by the face area detection unit 211. For example, the face direction detection unit 212 detects the face angle when the face is facing a specific direction as the reference angle. Specifically, as an example, the face direction detection unit 212 detects the face angle in the range of ±90°, with the face angle when the face is facing forward (towards the internal display) being the reference angle "0°."

[0069] The detection result output unit 213 outputs information based on the detection result of the face area by the face area detection unit 211. For example, when a face area is detected from the captured image by the face area detection unit 211, the detection result output unit 213 determines that a user is present in the detection range FoV, and outputs "Presence" information to the system processing unit 310 as information indicating that the user is present. On the other hand, when a face area is not detected from the captured image by the face area detection unit 211, the detection result output unit 213 determines that a user is not present, and outputs "No Presence" information to the system processing unit 310 as information indicating that the user is not present.

[0070] Furthermore, the detection result output unit 213 outputs information based on the detection result, based on the face angle detected by the face direction detection unit 212. For example, when the detection result output unit 213 determines that the face is facing forward (faced forward) based on the face angle detected by the face direction detection unit 212, it outputs "Attention" information to the system processing unit 310 as information indicating that the user is looking at (paying attention to) the information processing device 1.

[0071] On the other hand, if the detection result output unit 213 determines that the face is not facing forward based on the face angle detected by the face direction detection unit 212, it outputs "No Attention" information to the system processing unit 310 as information indicating that the user is not looking at (not paying attention to) the information processing device 1.

[0072] The detection result output unit 213 may determine whether or not the user is facing the direction of the external display device 5 based on the face angle detected by the face direction detection unit 212.

[0073] The system processing unit 310 is a functional configuration realized by the CPU 301 or the chipset 303 executing a system program or a program for HPD processing. For example, the system processing unit 310 includes a brightness reduction processing unit 311, a connection detection unit 312, an HID input detection unit 313, a display state determination unit 314, and a brightness reduction control unit 315 as functional configurations realized by the CPU 301 or the chipset 303 executing an OS program.

[0074] The brightness reduction processing unit 311 executes brightness reduction processing to reduce the screen brightness of the display unit 110 (internal display) based on whether a face area has been detected by the face detection unit 210 and the orientation of the detected face (the orientation of the face relative to the display unit 110 (internal display)). For example, when the brightness reduction processing unit 311 acquires "No Attention" information from the face detection unit 210 in a normal operating state, it controls the screen brightness to low. That is, when the orientation of the face detected by the face detection unit 210 changes from facing forward to not facing forward (for example, turns sideways), the brightness reduction processing unit 311 reduces the screen brightness.

[0075] Furthermore, when the brightness reduction processing unit 311 acquires "Attention" information from the face detection unit 210 while the screen brightness is controlled to low brightness, the brightness reduction processing unit 311 returns the screen brightness to standard brightness. That is, when the brightness reduction processing unit 311 determines that the orientation of the face detected by the face detection unit 210 is facing forward after reducing the screen brightness, the brightness reduction processing unit 311 returns the screen brightness to the standard brightness before being reduced.

[0076] The brightness reduction processing unit 311 also includes a timer for measuring time, and measures the waiting time from when "No Attention" information is acquired from the face detection unit 210 until the screen brightness is controlled to low brightness in a normal operating state. For example, if the brightness reduction processing unit 311 acquires "Attention" information before a predetermined waiting time has elapsed even after acquiring "No Attention" information, the brightness reduction processing unit 311 does not control the screen brightness to low brightness but keeps it at standard brightness. On the other hand, if the brightness reduction processing unit 311 does not acquire "Attention" information before a predetermined waiting time has elapsed after acquiring "No Attention" information, the brightness reduction processing unit 311 controls the screen brightness to low brightness. This prevents the screen brightness from being reduced even if the user looks away for a moment while using the information processing device 1. The predetermined waiting time is preset to, for example, 10 seconds. Note that this predetermined waiting time may be configured to be user-configurable.

[0077] Furthermore, the brightness reduction processing unit 311 controls the screen brightness to low when it acquires "No Presence" information, just as it does when it acquires "No Attention" information from the face detection unit 210. However, when an external display is connected as shown in FIG. 4, if neither the active window nor the cursor is displayed on the screen of the internal display (display unit 110), the brightness reduction processing unit 311 does not reduce the screen brightness but keeps it at standard brightness even when it acquires "No Presence" information. The brightness reduction processing when neither the active window nor the cursor is displayed on the screen of the internal display (display unit 110) when connected to this external display will be described in detail later.

[0078] The connection detection unit 312 detects whether or not there is a connection with the external display device 5 connected via the external connection terminal 130. The connection detection unit 312 outputs the detection result of whether or not there is a connection with the external display device 5 to the display state determination unit 314 and the brightness reduction control unit 315.

[0079] The HID input detection unit 313 detects an HID input to the keyboard 151, the touchpad 153, or the like. For example, the HID input detection unit 313 detects the HID input via the EC 200 to which operation signals are input from the keyboard 151 and the touchpad 153. Note that the HID input is not limited to input to the keyboard 151 or the touchpad 153, but may be input using an external keyboard or mouse, or may be audio input to a microphone (not shown). When the HID input detection unit 313 detects an HID input, it outputs information indicating that an HID input has been detected to the brightness reduction control unit 315.

[0080] Display state determination unit 314 determines whether the active window and cursor are displayed on the screen of the internal display or the screen of the external display when connection detection unit 312 determines that external display device 5 is connected via external connection terminal 130. Display state determination unit 314 outputs the determination result to brightness reduction control unit 315.

[0081] The brightness reduction control unit 315 controls the brightness reduction processing by the brightness reduction processing unit 311 to enable or disable based on the detection results of the connection detection unit 312, the detection results of the HID input detection unit 313, the judgment results of the display state judgment unit 314, etc.

[0082] For example, when the brightness reduction process is enabled in a state where no external display is connected, the brightness reduction control unit 315 disables the brightness reduction process in response to an HPD input. This processing mode in which the brightness reduction process is disabled in response to an HPD input in a state where no external display is connected is referred to as a "first brightness reduction process mode" (normal brightness reduction process mode).

[0083] On the other hand, when an external display is connected, brightness reduction control unit 315 enables brightness reduction processing when neither the active window nor the cursor is displayed on the screen of the internal display (display unit 110). For example, when an external display is connected, brightness reduction control unit 315 enables brightness reduction processing regardless of whether an HPD input is present or not when an external display is connected, and neither the active window nor the cursor is displayed on the screen of the internal display (display unit 110). This processing mode in which brightness reduction processing is enabled regardless of whether an HPD input is present or not when an external display is connected is referred to as a "second brightness reduction processing mode."

[0084] Furthermore, when connected to an external display, and either or both of the active window and the cursor are displayed on the screen of the internal display (display unit 110), the brightness reduction control unit 315 enables the brightness reduction process when there is no HPD input, and disables the brightness reduction process in response to the presence of an HPD input. That is, when connected to an external display, and either or both of the active window and the cursor are displayed on the screen of the internal display (display unit 110), the brightness reduction control unit 315 executes the brightness reduction process in the first brightness reduction process mode, similar to when not connected to an external display.

[0085] Note that the brightness reduction control unit 315 may disable the brightness reduction process when either or both of the active window and the cursor are displayed on the screen of the internal display (display unit 110), regardless of whether an HPD input is present or not.

[0086] [Brightness reduction control process operation] Next, the operation of the brightness reduction control process executed by the brightness reduction control unit 315 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the brightness reduction control process according to this embodiment.

[0087] (Step S101) The brightness reduction control unit 315 determines whether or not an external display is connected based on the detection result of the connection detection unit 312. If the brightness reduction control unit 315 determines that an external display is not connected (NO), the process proceeds to step S107. On the other hand, if the brightness reduction control unit 315 determines that an external display is connected (YES), the process proceeds to step S103.

[0088] (Step S103) Brightness reduction control unit 315 determines the display position of the active window based on the determination result of display state determination unit 314. If brightness reduction control unit 315 determines that the display position of the active window is on the internal display, the process proceeds to step S107. On the other hand, if brightness reduction control unit 315 determines that the display position of the active window is on the external display, the process proceeds to step S105.

[0089] (Step S105) Brightness reduction control unit 315 determines the display position of the cursor based on the determination result of display state determination unit 314. If brightness reduction control unit 315 determines that the display position of the cursor is on the internal display, the process proceeds to step S107. On the other hand, if brightness reduction control unit 315 determines that the display position of the cursor is on the external display, the process proceeds to step S109.

[0090] (Step S107) The brightness reduction control unit 315 controls the brightness reduction process for the internal display in the "first brightness reduction process mode" (normal brightness reduction process mode). For example, the brightness reduction control unit 315 normally controls the brightness reduction process for the internal display to be active, and disables the brightness reduction process for the internal display in response to an HPD input. This allows the information processing device 1 to disable the brightness reduction process when it is assumed that the user is looking at (paying attention to) the internal display, thereby preventing the screen brightness from being reduced even when the user is looking at (paying attention to) the internal display.

[0091] (Step S109) When the active window and cursor are displayed on the screen of the external display, the brightness reduction control unit 315 controls the brightness reduction process for the internal display in the "second brightness reduction process mode." For example, the brightness reduction control unit 315 enables the brightness reduction process for the internal display regardless of whether there is an HPD input. As a result, when it is assumed that the user is looking at (paying attention to) the external display, the information processing device 1 enables the brightness reduction process for the internal display even if there is an HID input (user input), thereby achieving power savings.

[0092] [Second brightness reduction processing mode] Next, the "second luminance reduction processing mode" will be described in detail. As described above, when the active window and cursor are displayed on the screen of the external display, the information processing device 1 determines that the user is looking at (paying attention to) the external display, transitions to the "second brightness reduction processing mode," and enables brightness reduction processing for the internal display regardless of whether HPD input is present or not.

[0093] However, if the screen brightness is reduced in the "second brightness reduction processing mode" because a face area is no longer detected in the captured image (the user is no longer present), it may not be possible to restore the screen brightness from low brightness to standard brightness. For example, even if the user returns and performs HID input using the information processing device 1 again, the information processing device 1 cannot restore the screen brightness from low brightness because the information processing device 1 does not use HPD input for brightness reduction processing in the "second brightness reduction processing mode." To restore the screen brightness from low brightness, the user needs to move to a position where their face is within the detection range FoV or move the cursor to the internal display.

[0094] FIG. 9 is a diagram illustrating an example of a captured image in which a face region is not detected in the captured image in this embodiment. FIG. 9 illustrates an example of a captured image in which the detection range FoV is captured by the imaging unit 120. As illustrated, if only a portion of the user's face is within the detection range FoV when the user returns, the face region may not be detected and the user's presence may not be detected. In this case, if the screen brightness is reduced due to the brightness reduction process, the display cannot be restored. To restore the display, the user must move the face position or the cursor to the internal display, which is inconvenient. Furthermore, if the user does not realize that they need to move the face position or the cursor to the internal display, the user may be unable to restore the display and may become confused.

[0095] Therefore, in the "second brightness reduction processing mode," the brightness reduction control unit 315 enables brightness reduction processing regardless of whether or not there is an HID input, but only enables brightness reduction processing based on the orientation of the face relative to the internal display.

[0096] That is, in the "second brightness reduction processing mode," the brightness reduction processing unit 311 does not perform brightness reduction processing of reducing screen brightness based on whether or not a face area has been detected by the face detection unit 210, but performs brightness reduction processing of reducing screen brightness based on the orientation of the face with respect to the internal display. For example, in the "second brightness reduction processing mode," the brightness reduction processing unit 311 does not reduce screen brightness (does not perform brightness reduction processing) even if a face area changes from a state in which it has been detected by the face detection unit 210 to a state in which it is not detected. On the other hand, in the "second brightness reduction processing mode," the brightness reduction processing unit 311 reduces screen brightness (performs brightness reduction processing) based on a change in the orientation of the face from a state facing forward to a state facing away from the front (for example, facing sideways) when a face area has been detected by the face detection unit 210.

[0097] Specifically, when the brightness reduction processing unit 311 acquires "No Attention" information from the face detection unit 210 in the normal operating state, it measures the standby time before controlling the screen brightness to low, and if it does not acquire "Attention" information until the predetermined standby time has elapsed, it controls the screen brightness to low. On the other hand, even if the brightness reduction processing unit 311 acquires "No Attention" information from the face detection unit 210 in the normal operating state, it does not measure the standby time before controlling the screen brightness to low.

[0098] Next, the operation of the brightness reduction process in the second brightness reduction process mode will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the brightness reduction process in the second brightness reduction process mode according to this embodiment. Here, it is assumed that the information processing device 1 is in a normal operating state, the user's face is facing forward, and the screen brightness is set to standard brightness. The brightness reduction processing unit 311 performs the brightness reduction process based on the face orientation ("Attention" or "No Attention") detected by the face detection unit 210.

[0099] (Step S201) The brightness reduction processing unit 311 determines whether the detection result by the face detection unit 210 is "Attention." If the brightness reduction processing unit 311 acquires "Attention" information from the face detection unit 210, it determines that the detection result by the face detection unit 210 is "Attention." If the brightness reduction processing unit 311 acquires "No Attention" information from the face detection unit 210, it determines that the detection result by the face detection unit 210 is not "Attention."

[0100] If the brightness reduction processing unit 311 determines that the detection result by the face detection unit 210 is not "Attention" (step S201: NO), the process proceeds to step S203. On the other hand, if the brightness reduction processing unit 311 determines that the detection result by the face detection unit 210 is "Attention" (step S201: YES), the process proceeds to step S207.

[0101] (Step S203) The luminance reduction processing unit 311 starts counting the waiting time using a timer, and then proceeds to the processing of step S205.

[0102] (Step S205) The brightness reduction processing unit 311 determines whether the detection result by the face detection unit 210 is "Attention." If the brightness reduction processing unit 311 has acquired "Attention" information, it determines that the detection result by the face detection unit 210 is "Attention" (step S205: YES), and proceeds to the processing of step S207. On the other hand, if the brightness reduction processing unit 311 has acquired "No Attention" information, it determines that the detection result by the face detection unit 210 is not "Attention" (step S205: NO), and proceeds to the processing of step S209.

[0103] (Step S207) The luminance reduction processing unit 311 resets the timer, and the process returns to step S201.

[0104] (Step S209) If the luminance reduction processing unit 311 has not acquired "Attention" information and has finished timing the predetermined waiting time using the timer, the process proceeds to step S211.

[0105] (Step S211) The brightness reduction processing unit 311 changes the screen brightness from standard brightness to low brightness, and then proceeds to the processing of step S213.

[0106] (Step S213) The brightness reduction processing unit 311 determines whether or not "Attention" information has been acquired from the face detection unit 210. If it is determined that "No Attention" information has been acquired, the brightness reduction processing unit 311 determines that the detection result by the face detection unit 210 is not "Attention" (step S213: NO), and performs the processing of step S213 again. On the other hand, if it is determined that "Attention" information has been acquired, the brightness reduction processing unit 311 determines that the detection result by the face detection unit 210 is "Attention" (step S213: YES), and proceeds to the processing of step S215.

[0107] (Step S215) The luminance reduction processing unit 311 returns the screen luminance from low luminance to standard luminance, and the process returns to step S201.

[0108] [Summary of the first embodiment] As described above, the information processing device 1 according to this embodiment includes the imaging unit 120 and a memory (e.g., system memory 304) that temporarily stores image data of an image captured by the imaging unit 120. The information processing device 1 also includes a face detection unit 210, a CPU 301, and a chipset 303 as an example of a processor that processes the image data stored in the memory (e.g., system memory 304). The face detection unit 210 performs face detection processing to detect a face area in which a face is captured and the orientation of the face from within the captured image by processing the image data of the captured image stored in the memory. The information processing device 1 also includes a display unit 110 as an internal display, and an external connection terminal 130 (an example of a connection unit) that connects to an external display device 5 as an external display.

[0109] The information processing device 1 performs brightness reduction processing to reduce the screen brightness of the internal display based on whether a face area has been detected by the face detection processing and the orientation of the face relative to the internal display. However, when the information processing device 1 is connected to an external display and neither the active window nor the cursor is displayed on the screen of the internal display, the information processing device 1 does not perform brightness reduction processing based on whether a face area has been detected by the face detection processing, but performs brightness reduction processing based on the orientation of the face relative to the internal display.

[0110] As a result, when an external display is connected and it is assumed that the user is looking at (paying attention to) the external display, the information processing device 1 performs the brightness reduction process based only on the orientation of the face relative to the internal display in a situation where a face area can be detected, thereby appropriately reducing and restoring the screen brightness of the internal display. For example, the information processing device 1 does not perform the brightness reduction process based on whether a face area has been detected by face detection processing, but performs the brightness reduction process based only on the orientation of the face, so it is possible not to perform the brightness reduction process when there is a possibility that the orientation of the face cannot be appropriately detected (there is a possibility of erroneous detection). Thus, the information processing device 1 can appropriately perform the brightness reduction process of reducing the screen brightness of the internal display even when an external display is connected.

[0111] For example, in the above brightness reduction process, when the information processing device 1 is connected to an external display and neither the active window nor the cursor is displayed on the screen of the internal display, the information processing device 1 does not perform the brightness reduction process even if the face area changes from being detected by the face detection process to not being detected, but performs the brightness reduction process based on the fact that the face area is detected by the face detection process and the orientation of the face changes from a specific direction (for example, facing forward) corresponding to the direction toward the internal display to a non-specific direction.

[0112] As a result, when an external display is connected, the information processing device 1 reduces the screen brightness only when the user is not facing forward relative to the internal display when it is assumed that the user is looking at (paying attention to) the external display, and therefore can correctly detect when the user's face faces forward after reducing the screen brightness, and can restore the reduced screen brightness.

[0113] Furthermore, in the brightness reduction process, when neither the active window nor the cursor is displayed on the screen of the internal display while connected to an external display, the information processing device 1 starts counting a predetermined waiting time (an example of a predetermined time) in response to the face direction changing from a specific direction (for example, facing forward) to a non-specific direction in a state where a face area has been detected by the face detection process, and reduces the screen brightness of the internal display by brightness reduction process in response to the elapse of the predetermined waiting time. Furthermore, in the brightness reduction process, if the face direction changes to a specific direction (for example, facing forward) before the elapse of the predetermined waiting time, the information processing device 1 stops counting the predetermined waiting time.

[0114] As a result, when an external display is connected, the information processing device 1 measures the waiting time until the screen brightness is reduced only when the setting is "No Attention" and it is assumed that the user is looking at (paying attention to) the external display, and does not measure the waiting time when the setting is "No Presence." Therefore, the screen brightness can be reduced only when the user's face is not facing forward toward the internal display, and when the user faces forward after the screen brightness has been reduced, the reduced screen brightness can be restored.

[0115] Furthermore, when the information processing device 1 is not connected to an external display and the brightness reduction processing is enabled, the information processing device 1 disables the brightness reduction processing in response to HID input (user input), and when connected to an external display and neither the active window nor the cursor is displayed on the screen of the internal display, the information processing device 1 performs brightness reduction control processing that enables the brightness reduction processing based on the orientation of the face relative to the internal display regardless of whether or not there is HID input (user input).

[0116] As a result, when it is assumed that the user is looking at (paying attention to) the external display, the information processing device 1 enables the brightness reduction process for the internal display even if there is an HID input (user input), thereby enabling power saving. On the other hand, when there is an HID input (user input) while the information processing device 1 is not connected to an external display, the information processing device 1 disables the brightness reduction process, thereby preventing the screen brightness from being reduced even when the user is looking at (paying attention to) the internal display. Therefore, the information processing device 1 can appropriately reduce the screen brightness of the internal display in accordance with the direction of the user's face even when an external display is connected.

[0117] Furthermore, in the above-mentioned brightness reduction control process, when the information processing device 1 is connected to an external display and either or both of the active window and the cursor are displayed on the screen of the internal display, the information processing device 1 enables the brightness reduction process if there is no HID input (user input), and disables the brightness reduction process if there is HID input (user input).

[0118] As a result, the information processing device 1 disables the brightness reduction process in response to an HID input (user input) if there is a possibility that the user is looking at (paying attention to) the internal display, thereby preventing the screen brightness from being reduced even when the user is looking at (paying attention to) the internal display. Thus, the information processing device 1 can appropriately reduce the screen brightness of the internal display in accordance with the direction of the user's face even when an external display is connected.

[0119] Furthermore, the control method in the information processing device 1 according to this embodiment is a control method in the information processing device 1 that includes an imaging unit 120, a memory (e.g., system memory 304) that temporarily stores image data of the captured image captured by the imaging unit 120, a processor that processes the image data stored in the memory (e.g., system memory 304), a display unit 110 as an internal display, and an external connection terminal 130 (an example of a connection unit) that connects to an external display device 5 as an external display, and includes the steps of: performing face detection processing by the processor (such as the face detection unit 210, CPU 301, and chipset 303) to detect a face area in which a face is captured from the captured image and the orientation of the face by processing the image data of the captured image stored in the memory; and performing brightness reduction processing to reduce the screen brightness of the internal display based on whether a face area has been detected by the face detection processing and the orientation of the face relative to the internal display. When connected to an external display, if neither the active window nor the cursor is displayed on the screen of the internal display, the processor (face detection unit 210, CPU 301, chipset 303, etc.) does not perform brightness reduction processing based on whether a face area has been detected by the face detection processing, but instead performs brightness reduction processing based on the orientation of the face relative to the internal display.

[0120] As a result, when an external display is connected, the control method in the information processing device 1 performs the brightness reduction process based only on the orientation of the face relative to the internal display when it is assumed that the user is looking at (paying attention to) the external display, thereby performing the brightness reduction process in a situation where a face area can be detected, thereby appropriately reducing and restoring the screen brightness of the internal display. For example, the control method in the information processing device 1 does not perform the brightness reduction process based on whether a face area has been detected by face detection processing, but performs the brightness reduction process based only on the orientation of the face, so it is possible to not perform the brightness reduction process when there is a possibility that the orientation of the face cannot be appropriately detected (there is a possibility of erroneous detection). Thus, the control method in the information processing device 1 can appropriately perform the brightness reduction process to reduce the screen brightness of the internal display even when an external display is connected.

[0121] <Second embodiment> Next, a second embodiment of the present invention will be described. The configuration and basic processing of the information processing device 1 according to this embodiment are the same as the configuration and basic processing of the information processing device 1 according to the first embodiment described with reference to Figures 1 to 8, and therefore a description thereof will be omitted. In this embodiment, part of the processing in the "second brightness reduction processing mode" is different from that of the first embodiment shown in Figure 10.

[0122] For example, in the brightness reduction processing in the "second brightness reduction processing mode" shown in Figure 10, if the brightness reduction processing unit 311 changes the screen brightness to low in step S211 in response to acquiring "No Attention" information, the face area may not be detected depending on the subsequent change in the direction of the face.

[0123] FIG. 11 is a diagram illustrating an example of detection according to a change in face orientation according to this embodiment. This FIG. 11 is an example of a captured image in which the detection range FoV is captured by the imaging unit 120. When an external display is connected and the user is looking at the external display, the user is not looking at the internal display. Therefore, the user's face included in the captured image in which the detection range FoV is captured by the imaging unit 120 is oriented sideways, for example, as shown in (A), and the face detection unit 210 outputs "No Attention" information. If the face angle when oriented sideways is close to the detection limit (e.g., 90°), a slight change in the face orientation will result in the face area not being detected as shown in (B), and the face detection unit 210 outputs "No Presence" information.

[0124] In the "second brightness reduction processing mode," brightness reduction processing is performed based on the direction of the face, but not based on whether a face area is detected. Therefore, when the brightness reduction processing unit 311 acquires "No Presence" information while the screen brightness is low, the brightness reduction processing unit 311 cancels the low brightness state and returns the screen brightness to standard brightness. When the face angle is close to the detection limit (for example, 90°), the output of "No Attention" information and the output of "No Presence" information alternate, and there is a concern that the brightness reduction processing unit 311 may repeatedly reduce the screen brightness and return it to standard brightness depending on the output, resulting in instability.

[0125] Therefore, in this embodiment, the brightness reduction processing unit 311 measures the timer that measures the waiting time until the screen brightness is controlled to low brightness only when "No Attention" information is acquired, and when "No Presence" information is acquired, the timer is paused and not reset (it is reset only when "Attention" information is acquired). This makes it possible to reduce the screen brightness to low brightness only in situations where the screen brightness can be restored from low brightness depending on the direction of the face (when "No Presence" information is acquired), and to prevent the screen brightness from becoming unstable due to the acquisition of "No Presence" information.

[0126] Next, the operation of the brightness reduction process in the second brightness reduction process mode according to this embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing an example of the brightness reduction process in the second brightness reduction process mode according to this embodiment. In Fig. 12, processes corresponding to those shown in Fig. 10 are assigned the same reference numerals.

[0127] The brightness reduction process shown in Fig. 12 differs from the brightness reduction process of the first embodiment shown in Fig. 10 in that steps S205A, S221, S223, S225, and S227 have been added. Here, only the added processes will be described, and descriptions of processes similar to those shown in Fig. 10 will be omitted.

[0128] 10, if the brightness reduction processing unit 311 acquires "No Attention" information, it determines that the detection result by the face detection unit 210 is not "Attention" (step S205: NO), and proceeds to the processing of step S209. In contrast to this, in step S205A of Fig. 12, even if it determines that the detection result by the face detection unit 210 is not "Attention", it proceeds to the processing of step S209 if it acquires "No Attention" information (similar to the processing of step S205 of Fig. 10), and proceeds to the processing of step S221 if it acquires "No Presence" information.

[0129] (Step S221) The luminance reduction processing unit 311 pauses the timer that started counting the waiting time in step S203, and then proceeds to the process of step S223.

[0130] (Step S223) The brightness reduction processing unit 311 determines whether the detection result by the face detection unit 210 is "Attention." If "No Attention" information is acquired, the brightness reduction processing unit 311 determines that the detection result by the face detection unit 210 is not "Attention" (step S223: NO), and proceeds to the processing of step S225. On the other hand, if "Attention" information is acquired, the brightness reduction processing unit 311 determines that the detection result by the face detection unit 210 is "Attention" (step S223: YES), and proceeds to the processing of step S227.

[0131] (Step S225) The luminance reduction processing unit 311 restarts the time measurement of the timer that was paused in step S221, and returns to the process of step S205A.

[0132] (Step S227) The luminance reduction processing unit 311 resets the timer, and the process returns to step S201.

[0133] [Summary of the second embodiment] As described above, the information processing device 1 according to this embodiment temporarily suspends timing of the predetermined waiting time in the brightness reduction process if the state in which a face area is detected by the face detection process changes to a state in which it is not detected before the predetermined waiting time has elapsed. Furthermore, if the information processing device 1 temporarily suspends timing of the predetermined waiting time and then detects a face area by the face detection process and the orientation of the face changes to a state in which the orientation is not in a specific direction (for example, facing forward), the information processing device 1 resumes timing of the predetermined waiting time and reduces the screen brightness of the internal display by the brightness reduction process in response to the elapse of the predetermined waiting time.

[0134] As a result, when an external display is connected and it is assumed that the user is looking at (paying attention to) the external display, the information processing device 1 measures the waiting time until the screen brightness is reduced only when the status is "No Attention," and pauses the measurement of the waiting time when the status is "No Presence," so that the screen brightness does not immediately return to normal when the status becomes "No Presence." Therefore, the information processing device 1 can prevent the screen brightness from repeatedly being set to low brightness and standard brightness, which can cause instability.

[0135] In addition, in the brightness reduction process, if the information processing device 1 temporarily stops timing the predetermined waiting time and then detects a face area through face detection processing and the face is facing in a specific direction (for example, facing forward), the information processing device 1 stops timing the predetermined waiting time.

[0136] This allows the information processing device 1 to control the screen brightness to standard brightness when the user returns to use it, so the information processing device 1 can appropriately perform brightness reduction processing to reduce the screen brightness of the internal display even when an external display is connected.

[0137] Although the embodiments of the present invention have been described above in detail with reference to the drawings, the specific configurations are not limited to the above-described embodiments, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above-described embodiments can be combined in any manner.

[0138] Furthermore, in the above embodiment, a configuration example has been described in which one external display (external display device 5) is connected to the information processing device 1, but two or more external displays may be connected.

[0139] Furthermore, the CPU 301 and the chipset 303 may be configured as separate processors, or may be integrated into one processor.

[0140] In addition, in the above embodiment, an example has been shown in which the face detection unit 210 is provided separately from the CPU 301 and the chipset 303. However, part or all of the face detection unit 210 may be provided in the chipset 303, or may be provided in a processor integrated with the CPU 301 or the chipset 303. For example, the CPU 301, the chipset 303, and the face detection unit 210 may be configured as separate processors, or may be integrated into a single processor. Also, part or all of the face detection unit 210 may be provided in the EC 200. Also, part of the system processing unit 310 may be provided in the EC 200.

[0141] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, and power-off state are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0142] The information processing device 1 described above includes an internal computer system. A program for implementing the functions of each component of the information processing device 1 may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing in each component of the information processing device 1. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computer devices connected via a network, including the Internet, a WAN, a LAN, a dedicated line, or other communication lines. The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built into a computer system. The recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM.

[0143] The recording medium also includes internal or external recording media accessible from a distribution server for distributing the program. The program may be divided into multiple parts, downloaded at different times, and then combined by the components of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be a medium that realizes part of the above-described functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-described functions in combination with a program already stored in the computer system.

[0144] Furthermore, some or all of the functions of the information processing device 1 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.

[0145] Furthermore, the information processing device 1 of the above embodiment is not limited to a notebook PC, but may be, for example, a desktop PC. [Explanation of symbols]

[0146] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 130 External connection terminal, 140 Power button, 150 Input device, 151 Keyboard, 153 Touchpad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Face detection unit, 211 Face area detection unit, 212 Face direction detection unit, 213 Detection result output unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Brightness reduction processing unit, 312 Connection detection unit, 313 HID input detection unit, 314 Display state determination unit, 315 Brightness reduction control unit, 400 Power supply unit

Claims

1. An internal display; a connector for connecting to an external display; an imaging unit that captures an image in a direction facing the internal display; a memory that temporarily stores image data of an image captured by the imaging unit; a processor for processing image data stored in said memory; Equipped with The processor: a face detection process for detecting a face area in the image and a direction of the face by processing image data of the image stored in the memory; a brightness reduction process of reducing the screen brightness of the internal display based on whether the face area has been detected by the face detection process and the orientation of the face with respect to the internal display; and when neither an active window nor a cursor is displayed on the screen of the internal display while the external display is connected, the brightness reduction process is not performed based on whether or not the face area has been detected by the face detection process, and the brightness reduction process is performed based on the orientation of the face with respect to the internal display; When the external display is connected and either one or both of an active window and a cursor are displayed on the screen of the internal display, the brightness reduction process is enabled if there is no user input, and disabled in response to the user input. Information processing device.

2. In the brightness reduction process, the processor When neither an active window nor a cursor is displayed on the screen of the internal display while the external display is connected, the brightness reduction process is not performed even if the face area changes from a state in which it has been detected by the face detection process to a state in which it is not detected, and the brightness reduction process is performed based on the change in the orientation of the face from a state in which it is in a specific direction corresponding to a direction toward the internal display to a state in which it is not in the specific direction while the face area has been detected by the face detection process. The information processing device according to claim 1 .

3. In the brightness reduction process, the processor When the external display is connected and neither an active window nor a cursor is displayed on the screen of the internal display, the method starts counting a predetermined time in response to the face direction changing from the specific direction to a state where the face area is detected by the face detection process, reduces the screen brightness of the internal display by the brightness reduction process in response to the elapse of the predetermined time, and if the face direction changes to the specific direction before the elapse of the predetermined time, stops counting the predetermined time. The information processing device according to claim 2 .

4. In the brightness reduction process, the processor if the face area is detected by the face detection process and then not detected before the predetermined time has elapsed, the timing of the predetermined time is temporarily stopped, and if the face area is detected by the face detection process and the orientation of the face is no longer in the specific direction after the timing of the predetermined time has been temporarily stopped, the timing of the predetermined time is resumed and the screen brightness of the internal display is reduced by the brightness reduction process in response to the elapse of the predetermined time. The information processing device according to claim 3 .

5. In the brightness reduction process, the processor If the face area is detected by the face detection process and the orientation of the face is in the specific direction after the timing of the predetermined time has been temporarily stopped, the timing of the predetermined time is stopped. The information processing device according to claim 4 .

6. The processor: When the brightness reduction process is enabled in a state where the external display is not connected, the brightness reduction process is disabled in response to a user input, and when the external display is connected and neither an active window nor a cursor is displayed on the screen of the internal display, a brightness reduction control process is performed to enable the brightness reduction process based on the orientation of the face with respect to the internal display regardless of whether a user input is present. The information processing device according to claim 1 .

7. A control method for an information processing device comprising an internal display, a connection unit for connecting to an external display, an imaging unit for capturing an image in a direction facing the internal display, a memory for temporarily storing image data of an image captured by the imaging unit, and a processor for processing the image data stored in the memory, comprising: the processor: performing a face detection process for detecting a face area in the image and a direction of the face by processing image data of the image stored in the memory; performing a brightness reduction process of reducing screen brightness of the internal display based on whether or not the face area has been detected by the face detection process and the orientation of the face with respect to the internal display; Including, when neither an active window nor a cursor is displayed on the screen of the internal display while the external display is connected, the brightness reduction process is not performed based on whether or not the face area has been detected by the face detection process, and the brightness reduction process is performed based on the orientation of the face with respect to the internal display; When the external display is connected and either one or both of an active window and a cursor are displayed on the screen of the internal display, the brightness reduction process is enabled if there is no user input, and disabled in response to the user input. Control method.

Images