Information processing device, and control method

Abstract

To more appropriately perform luminance reduction processing for reducing screen luminance in accordance with a direction of a face.SOLUTION: An information processing device comprises: a display section; a memory for temporarily storing image data of a picked-up image which is picked up by an imaging section; and a processor for performing processing based on the image data stored in the memory. The processor processes the image data stored in the memory, thereby performing face detection processing for detecting a face region, in which a face is imaged, and a direction of the face from the picked-up image, luminance reduction processing for reducing screen luminance of the display section based on the direction of the face detected by the face detection processing, and luminance reduction control processing for controlling whether the luminance reduction processing is made valid or invalid based on a relation of distances of a plurality of face regions in a case where there is a plurality of face regions detected by the face detection processing.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There is a device that transitions to a usable state when a person approaches, and transitions to a standby state in which all functions except for some functions are stopped when the person leaves. For example, in Patent Document 1, an infrared sensor is used to detect whether a person is approaching or moving away.

[0003] In recent years, advances in computer vision and the like have led to improved accuracy in detecting faces from images. Therefore, instead of detecting people using infrared sensors, people are now being detected using face detection. When detecting people using face detection, it is possible to not only detect people but also to detect the direction of the face, making it possible to perform control according to the direction of the face (whether the face is facing forward, facing sideways, etc.). For example, when the face is not facing forward (towards the device), the brightness of the display screen is reduced to save power. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-148895 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, when multiple people are discussing something while looking at a screen, they are not always looking at the screen, but sometimes they are looking at each other's faces when they talk. In this case, the screen brightness may be reduced if the person is not facing forward.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that more appropriately perform brightness reduction processing that reduces screen brightness depending on the direction of the face. [Means for solving the problem]

[0007] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a display unit, a memory for temporarily storing image data of an image captured by an imaging unit, and a processor for performing processing based on the image data stored in the memory, and the processor performs a face detection process for detecting a face area in which a face is captured from the captured image and the orientation of the face by processing the image data stored in the memory, a brightness reduction process for reducing the screen brightness of the display unit based on the orientation of the face detected by the face detection process, and a brightness reduction control process for controlling whether to enable or disable the brightness reduction process based on the relationship between the distances of the multiple face areas when the number of face areas detected by the face detection process is multiple.

[0008] In the above information processing device, in the brightness reduction control process, when the number of face areas detected by the face detection process is multiple, the processor may control whether to enable or disable the brightness reduction process based on the distance relationship between a first face area, which is the largest among the multiple face areas, and a second face area, which is the second largest.

[0009] In the information processing device, the processor may disable the brightness reduction control process when a difference in size between the first face region and the second face region is less than a predetermined threshold.

[0010] In the above information processing device, the processor may, in the face detection processing, determine the person corresponding to the first face area as the first person closest to the imaging unit, and the person corresponding to the second face area as the second person second closest to the imaging unit, and, in the brightness reduction control processing, disable the brightness reduction processing if the difference in distance from the imaging unit between the first person and the second person is less than a predetermined threshold.

[0011] In the above information processing device, the processor may disable the brightness reduction control process when a distance between the first face area and the second face area on the captured image is less than a predetermined threshold.

[0012] In the above information processing device, the processor may, in the face detection processing, determine the person corresponding to the first face area as the first person closest to the imaging unit, and the person corresponding to the second face area as the second person second closest to the imaging unit, and, in the brightness reduction control processing, disable the brightness reduction processing if the distance between the first person and the second person on the captured image is less than a predetermined threshold.

[0013] In the above-mentioned information processing device, the processor may disable the brightness reduction control process when the difference in size between the first face area and the second face area is less than a predetermined threshold and the distance between the first face area and the second face area on the captured image is less than a predetermined threshold.

[0014] In the above information processing device, the processor may, in the face detection processing, determine the person corresponding to the first face area as the first person closest to the imaging unit, and the person corresponding to the second face area as the second person second closest to the imaging unit, and, in the brightness reduction control processing, disable the brightness reduction processing if the difference in distance from the imaging unit between the first person and the second person is less than a predetermined threshold and the distance between the first person and the second person on the captured image is less than a predetermined threshold.

[0015] In the information processing device, the processor may enable the brightness reduction process in the brightness reduction control process when the number of face regions detected by the face detection process is one.

[0016] Furthermore, according to a second aspect of the present invention, a control method in an information processing device including a display unit, a memory for temporarily storing image data of an image captured by an imaging unit, and a processor for performing processing based on the image data stored in the memory includes the steps of: performing face detection processing by the processor to detect a face area in which a face is captured from the captured image and the orientation of the face by processing the image data of the image stored in the memory; performing brightness reduction processing to reduce the screen brightness of the display unit based on the orientation of the face detected by the face detection processing; and, when the number of the face areas detected by the face detection processing is multiple, performing brightness reduction control processing to control whether to enable or disable the brightness reduction processing based on the distance relationship between the multiple face areas. Effect of the Invention

[0017] According to the above-described aspect of the present invention, it is possible to more appropriately perform the brightness reduction process for reducing the screen brightness in accordance with the direction of the face. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to an embodiment. [Diagram 2] 5 is a diagram showing an example of a person detection range of the information processing device according to the embodiment. [Diagram 3] 5A and 5B are schematic diagrams illustrating control of screen luminance according to the face direction according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an example of face detection when there are two users according to the embodiment. [Diagram 5] 5A and 5B are schematic diagrams showing an example of control of brightness reduction processing and the distance of a person from the information processing device according to the embodiment. [Figure 6]FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 7] FIG. 1 is a schematic block diagram showing an example of a functional configuration of an information processing apparatus according to an embodiment. [Figure 8] 10 is a flowchart showing an example of a luminance reduction process according to the embodiment. [Figure 9] 10 is a flowchart showing an example of a luminance reduction control process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [overview] First, an overview of the information processing device according to this embodiment will be described. FIG. 1 is a perspective view showing an example of the external configuration of an information processing device 1 according to the present embodiment.

[0020] The information processing device 1 is, for example, a notebook (clamshell) type PC (Personal Computer). The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis formed by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0021] The first housing 10 is also called the A cover or the display housing. The second housing 20 is also called the C cover or the system housing. In the following description, the sides of the first housing 10 and the second housing 20 on which the hinge mechanism 15 is provided are called the sides 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite the sides 10c and 20c are called the sides 10a and 20a, respectively. In the drawings, the direction from the side 20a to the side 20c is called the "rear", and the direction from the side 20c to the side 20a is called the "front". The right and left sides of the rear are called the "right" and "left", respectively. The left sides of the first housing 10 and the second housing 20 are called the sides 10b and 20b, respectively, and the right sides are called the sides 10d and 20d, respectively. Moreover, a state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as a "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Moreover, a state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as an "open state."

[0022] The external appearance of the information processing device 1 shown in FIG. 1 shows an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0023] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is merely an example, and the imaging unit 120 may be disposed in another location as long as it can face in a direction facing the display screen of the display unit 110.

[0024] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in a direction facing the display screen of the display unit 110 (i.e., in front of the information processing device 1). The predetermined imaging range is a range of an angle of view determined by an imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture an image including a person (user) present in front of the information processing device 1 (on the front side).

[0025] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct power on or off, transition from a standby state to a normal operation state, transition from the normal operation state to a standby state, etc. The normal operation state is an operation state of the system in which processing can be executed without particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0026] The standby state is a state in which at least a part of the system processing is restricted, and the power consumption is lower than that of the normal operation state. For example, the standby state may be a standby state, a sleep state, or the like, and may be a state equivalent to the modern standby state in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI. The standby state may also include a state in which at least the display of the display unit is turned off (screen OFF) or a state in which the screen is locked. The screen lock is a state in which a preset image (for example, an image for screen lock) is displayed on the display unit so that the contents being processed cannot be seen, and the device cannot be used until the lock is released (for example, user authentication).

[0027] Further, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices that accept operation inputs from the user. Note that, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided as the input device, or a mouse or an external keyboard may be connected. In the case where a touch sensor is provided, an area corresponding to the display screen of the display unit 110 may be configured as a touch panel that accepts operations. Furthermore, the input device may include a microphone into which voice is input.

[0028] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first housing 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing, and are unable to function.

[0029] The information processing device 1 executes a human presence detection (HPD) process to detect a person present in front of the information processing device 1, based on a captured image captured by the imaging unit 120.

[0030] 2 is a diagram showing an example of a person detection range of the information processing device 1 according to this embodiment. In the example shown in the figure, a detection range FoV (Field of View: detection viewing angle) in front of the information processing device 1 is a range in which a person can be detected.

[0031] For example, the information processing device 1 detects a face area in which a face is captured from a captured image captured by the imaging unit 120, thereby determining whether or not a person (user) is present in front of the information processing device 1. The detection range FoV corresponds to the imaging field angle captured by the information processing device 1. If a face area is detected from the captured image, the information processing device 1 determines that a person (user) is present. On the other hand, if a face area is not detected from the captured image, the information processing device 1 determines that a person (user) is not present.

[0032] The information processing device 1 controls the operation state of the system of the information processing device 1 according to the presence or absence of a person (user) through HPD processing. For example, the information processing device 1 is controlled to a normal operation state when a person (user) is present in front of the information processing device 1, and is controlled to a standby state when no person (user) is present in front of the information processing device 1.

[0033] Furthermore, when a person (user) is present in front of the information processing device 1, the information processing device 1 detects the direction of the person's (user's) face. For example, the information processing device 1 determines whether the person's (user's) face is facing the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120). The face direction here is a direction corresponding to the rotation angle of the face in the left-right direction. In the following, a state in which the face is facing the direction of the information processing device 1 (the direction of the display unit 110 and the imaging unit 120) is defined as a state in which the face is facing forward. Also, a state in which the face is facing rightward or leftward with respect to the front is defined as a state in which the face is facing sideways.

[0034] 3 is a schematic diagram for explaining the control of screen luminance according to the face direction according to the present embodiment. As shown in this figure, the information processing device 1 executes a luminance reduction process for reducing the screen luminance of the display unit 110 according to the face direction of a person (user). Specifically, the information processing device 1 aims to save power by reducing the screen luminance of the display unit 110 when the face direction is not facing forward (for example, when facing sideways) as shown in FIG. 3(B) in contrast to when the face direction is facing forward as shown in FIG. 3(A). In addition, when the face direction faces forward again, the information processing device 1 returns the screen luminance to the original level before reduction.

[0035] In the following, the original screen luminance that has not been reduced is referred to as "standard luminance." Also, the screen luminance reduced from the standard luminance when the face is not facing forward (for example, when facing sideways) is referred to as "low luminance." Low luminance is at least luminance lower than the standard luminance, and the lower the luminance, the greater the effect of power saving. For example, low luminance may be luminance of about 0 to 10% of the standard luminance. 0% luminance corresponds to display off. Note that when the face is not facing forward, this also includes when the face is facing up, down, or backwards.

[0036] Here, when multiple people are discussing while looking at the screen of the information processing device 1, they do not always look at the screen, but sometimes talk while looking at each other's faces. At this time, the users temporarily do not face the direction of the information processing device 1, but it is not desirable to reduce the screen brightness because the faces are not facing forward. Therefore, the information processing device 1 according to this embodiment controls the brightness reduction process to be disabled so as not to reduce the screen brightness when it is determined that multiple users are discussing even if the faces are not facing forward.

[0037] For example, when there is more than one person detected in the detection range FoV in front of the information processing device 1 and the distance between the person closest to the information processing device 1 and the second closest person is short, the information processing device 1 determines that at least those two people are users and disables the brightness reduction process. First, the information processing device 1 detects a face area from a captured image captured by the imaging unit 120 to determine whether there is more than one person detected in the detection range FoV in front of the information processing device 1.

[0038] When multiple people are detected, if the distance between at least the closest person and the second closest person is close, it is highly likely that at least those two people are users, and it can be inferred that the users are discussing even if they turn sideways. On the other hand, when three or more people are detected, even if the distance between the second closest person and the third closest person is close, if the distance between them and the closest person is far, it can be inferred that only the closest person is the user.

[0039] Therefore, when a plurality of people are detected, the information processing device 1 controls whether to enable or disable the brightness reduction process based on the relationship of the distance between the person closest to the information processing device 1 and the second closest person. Hereinafter, the person closest to the information processing device 1 is referred to as "person A", and the second closest person is referred to as "person B". For example, the information processing device 1 uses, as the relationship of the distance between person A and person B, the distance between person A and person B on the captured image captured by the imaging unit 120 for face detection, and the difference in distance between person A and person B from the information processing device 1 (imaging unit 120). First, the distance between person A and person B on the captured image captured by the imaging unit 120 for face detection will be described with reference to FIG. 4.

[0040] 4 is a schematic diagram showing an example of face detection when there are two users according to this embodiment. In the example shown, the information processing device 1 detects face areas from a captured image captured by the imaging unit 120, and thereby detects face areas (both in profile) of person A and person B who are looking at each other and discussing in the detection range FoV in front of the information processing device 1. A bounding box B1 indicates the face area of ​​person A. Furthermore, a bounding box B2 indicates the face area of ​​person B.

[0041] For example, the information processing device 1 determines whether or not the distance DU between the center of a bounding box B1 (face region of person A) and the center of a bounding box B2 (face region of person B) on the captured image is less than a predetermined threshold value as the relationship of the distance between person A and person B. This predetermined threshold value is set in advance as a distance threshold value at which both person A and person B can be determined to be users. As an example, the predetermined threshold value is set as one-third of the distance DF between both ends (for example, both ends in the horizontal direction) of the detection range FoV. Note that this predetermined threshold value can be set to any value as appropriate depending on the specifications (for example, the angle of view) of the imaging unit 120, the size of the detection range FoV, and the like.

[0042] 4, when the distance DU between person A and person B is close to the horizontal distance (left-right direction in the detection range FoV) or the horizontal distance, a predetermined threshold is set based on the distance DF between both ends of the horizontal direction of the detection range FoV. On the other hand, when the distance DU between person A and person B is close to the vertical distance (up-down direction in the detection range FoV) or the vertical distance, a predetermined threshold may be set based on the distance between both ends of the vertical direction of the detection range FoV.

[0043] Here, the distance between person A and person B in the depth direction (far and near) from the information processing device 1 is unclear only from the distance DU between person A and person B on the captured image. Even if the distance DU between person A and person B is close (appears close), if the distance of person B in the depth direction is significantly different from that of person A, person B is not likely to be a user because he is not near person A. Therefore, the information processing device 1 further uses the difference in distance between person A and person B from the information processing device 1 (imaging unit 120) as the relationship between the distances between person A and person B. Next, the difference in distance between person A and person B from the information processing device 1 (imaging unit 120) will be described with reference to FIG. 5.

[0044] 5 is a schematic diagram showing an example of the control of brightness reduction processing and the distance of a person from the information processing device 1 according to this embodiment. The illustrated example also shows an example of the positions of person A and person B detected in the detection range FoV in front of the information processing device 1. Here, the distance from the information processing device 1 (imaging unit 120) to person A is distance LA, and the distance from the information processing device 1 (imaging unit 120) to person B is distance LB.

[0045] For example, the information processing device 1 determines whether or not the difference between the distance LA from the information processing device 1 (imaging unit 120) to person A and the distance LB from the information processing device 1 (imaging unit 120) to person B is less than a predetermined threshold as the relationship of the distance between person A and person B. This predetermined threshold is set in advance as a threshold of the difference in distance that can determine that both person A and person B are users. As an example, the predetermined threshold is set as a difference in distance of 20% from the information processing device 1 (imaging unit 120). The difference in distance of 20% is a threshold indicated as the absolute value of the difference in distance LB relative to the distance LA or the absolute value of the difference in distance LA relative to the distance LB. Note that this predetermined threshold can be set to an arbitrary value as appropriate depending on the specifications (e.g., the angle of view) of the imaging unit 120, the size of the detection range FoV, and the like.

[0046] Here, the information processing device 1 detects the distance from the information processing device 1 (imaging unit 120) to a person based on, for example, the size of a face area detected from a captured image. Therefore, the difference between the distance LA to person A and the distance LB to person B corresponds to, for example, the difference in size between the face area of ​​person A and the face area of ​​person B. That is, the information processing device 1 determines, as the relationship between the distances between person A and person B, for example, whether the difference in size between the face area of ​​person A and the face area of ​​person B is less than a predetermined threshold. That is, the predetermined threshold may be set as a threshold (for example, 20%) of the difference in size between the face area of ​​person A and the face area of ​​person B.

[0047] 5A shows an example of the positions of person A and person B when the difference in size between the face region of person A and the face region of person B (i.e., the difference between distance LA and distance LB) is less than a predetermined threshold (e.g., 20%). When the distance DU between person A and person B is less than a predetermined threshold (e.g., one-third of the distance DF) and the difference in size between the face region of person A and the face region of person B (i.e., the difference between distance LA and distance LB) is less than a predetermined threshold (e.g., 20%), the information processing device 1 disables the brightness reduction process.

[0048] On the other hand, the example shown in FIG. 5B illustrates an example of the positions of person A and person B when the difference in size between the face region of person A and the face region of person B (i.e., the difference between the distance LA and the distance LB) is equal to or greater than a predetermined threshold (e.g., 20%). Even if the distance DU between person A and person B is less than a predetermined threshold (e.g., one-third of the distance DF), the information processing device 1 enables the brightness reduction process when the difference in size between the face region of person A and the face region of person B (i.e., the difference between the distance LA and the distance LB) is equal to or greater than a predetermined threshold (e.g., 20%). Note that, when the distance DU between person A and person B is equal to or greater than a predetermined threshold (e.g., one-third of the distance DF), the information processing device 1 enables the brightness reduction process regardless of the difference in size between the face region of person A and the face region of person B (i.e., the difference between the distance LA and the distance LB).

[0049] The configuration of the information processing device 1 according to this embodiment will be described in detail below. [Hardware configuration of information processing device] Fig. 6 is a schematic block diagram showing an example of a hardware configuration of an information processing device 1 according to this embodiment. In Fig. 6, the same reference numerals are used for components corresponding to those in Fig. 1. The information processing device 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a face detection unit 210, a main processing unit 300, and a power supply unit 400.

[0050] The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0051] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in a direction (forward) facing the inner surface of the first housing 10, and outputs the captured image to the main processing unit 300 and the face detection unit 210. For example, the imaging unit 120 includes a visible light camera (RGB camera) that captures images using visible light, and an infrared camera (IR camera) that captures images using infrared light.

[0052] The imaging section 120 may be configured to include either a visible light camera or an infrared camera, or may be configured to include both.

[0053] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0054] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0055] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), a RAM, a ROM, etc. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0056] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into a voltage required by each unit. The power whose voltage has been converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0057] The EC200 is a microcomputer including a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and an input / output (I / O) logic circuit. The CPU of the EC200 reads a control program (firmware) prestored in its own ROM, and executes the read control program to fulfill its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to a power button 140, an input device 150, a power supply unit 400, and the like.

[0058] For example, the EC 200 communicates with the power supply unit 400 to obtain information on the battery state (such as remaining capacity) from the power supply unit 400 and outputs control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1 to the power supply unit 400. The EC 200 also obtains operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to the processing of the main processing unit 300 among the obtained operation signals.

[0059] The face detection unit 210 includes a processor that processes image data of a captured image captured by the imaging unit 120. The face detection unit 210 acquires image data of a captured image captured by the imaging unit 120, and temporarily stores the acquired image data in a memory. The memory that stores the image data may be the system memory 304, or may be a memory (not shown) in the face detection unit 210.

[0060] For example, the face detection unit 210 performs face detection processing to detect a face area from the captured image and detect the face orientation of the face image in the detected face area by processing image data of the captured image acquired from the imaging unit 120. As a face detection method, any detection method can be applied, such as a face detection algorithm that detects a face based on facial feature information, or face detection using learning data (trained model) or a face detection library that is machine-learned based on facial feature information.

[0061] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0062] The CPU 301 is a processor that executes processes based on a BIOS program, processes based on an OS program, processes based on an application program that runs on the OS, etc. For example, the CPU 301 executes a startup process that starts the system from a standby state and transitions it to a normal operation state, a sleep process that transitions it from the normal operation state to a standby state, etc. The CPU 301 also executes a screen brightness control process that controls the screen brightness of the display unit 110 based on the result of the face detection process by the face detection unit 210 described above, etc.

[0063] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing and generates display data under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110.

[0064] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires detection results by face detection processing acquired from the face detection unit 210, and outputs the results to the CPU 301.

[0065] The system memory 304 is used as a reading area for the programs executed by the CPU 301, a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0066] The CPU 301, the GPU 302, and the chipset 303 may be configured as a single integrated processor, or some or each of them may be configured as individual processors. For example, in a normal operation state, the CPU 301, the GPU 302, and the chipset 303 are all in operation, but in a standby state, only at least a part of the chipset 303 is in operation.

[0067] [Functional configuration of information processing device] Next, the functional configuration of the information processing device 1 regarding the luminance reduction process will be described in detail.

[0068] Fig. 7 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a face detection unit 210 and a system processing unit 310. The face detection unit 210 corresponds to the face detection unit 210 in Fig. 6, and includes a face area detection unit 211, a face direction detection unit 212, and a detection result output unit 213 as functional components for performing face detection processing.

[0069] The face area detection unit 211 detects a face area (area of ​​a face image) in which a face is captured from the captured image by processing image data of the captured image acquired from the imaging unit 120. For example, the face area detection unit 211 outputs information indicating the position and size of the detected face area as the face area detection result. The position and size of the face area correspond to the center position (coordinates) and size of the bounding boxes B1 and B2 shown in FIG. 4.

[0070] The face direction detection unit 212 detects the direction of a face captured in a face area detected from a captured image by the face area detection unit 211. For example, the face direction detection unit 212 detects the direction of a face based on the contour of a face and the positions of the eyes, nose, mouth, etc. in the face area, and outputs information indicating whether the face is facing forward as a face direction detection result.

[0071] The detection result output unit 213 acquires the face area detection result output from the face area detection unit 211 and the face direction detection result output from the face direction detection unit 212, and outputs the face detection result by the face detection process based on the acquired face area detection result and face direction detection result. For example, the detection result output unit 213 outputs information indicating the position (coordinates) and size (dimensions) of the face area for each of the detected one or more face areas based on the face area detection result output from the face area detection unit 211 to the system processing unit 310.

[0072] Furthermore, the detection result output unit 213 outputs "Attention" information or "No Attention" information to the system processing unit 310 based on the orientation of the face of the person closest to the information processing device 1 (imaging unit 120). The "Attention" information is information indicating that the user is looking at (paying attention to) the information processing device 1. On the other hand, the "No Attention" information is information indicating that the user is not looking at (not paying attention to) the information processing device 1.

[0073] For example, when one face region is detected, if the face direction of the face region (i.e., the face direction of the closest person) faces forward (facing forward), the detection result output unit 213 outputs "Attention" information to the system processing unit 310. On the other hand, if the face direction of the face region (i.e., the face direction of the closest person) is not facing forward, the detection result output unit 213 outputs "No Attention" information to the system processing unit 310.

[0074] Furthermore, when a plurality of face regions are detected, if the face orientation of the largest face region among the detected face regions (i.e., the face orientation of the closest person) faces forward (facing forward), the detection result output unit 213 outputs "Attention" information to the system processing unit 310. On the other hand, if the face orientation of the largest face region among the detected face regions (i.e., the face orientation of the closest person) is not facing forward, the detection result output unit 213 outputs "No Attention" information to the system processing unit 310.

[0075] The system processing unit 310 is a functional configuration realized by executing a system program or a program for HPD processing by the CPU 301 or the chipset 303. For example, the system processing unit 310 includes a brightness reduction processing unit 311 and a brightness reduction control unit 312.

[0076] The luminance reduction processing unit 311 executes a luminance reduction process for reducing the screen luminance of the display unit 110 based on the direction of the face detected by the face detection unit 210. For example, when the luminance reduction processing unit 311 acquires "No Attention" information from the face detection unit 210 in a normal operating state, it controls the screen luminance to low luminance. That is, when the face direction of the largest face area among the face areas detected by the face detection unit 210 (i.e., the face direction of the person closest to the information processing device 1 (imaging unit 120)) changes from a state facing forward to a state not facing forward (for example, facing sideways), the luminance reduction processing unit 311 reduces the screen luminance from standard luminance to low luminance.

[0077] Furthermore, when the luminance reduction processing unit 311 acquires "Attention" information from the face detection unit 210 while the screen luminance is controlled to a low luminance, the luminance reduction processing unit 311 returns the screen luminance to the standard luminance. That is, when the luminance reduction processing unit 311 determines that the face orientation of the largest face area among the face areas detected by the face detection unit 210 (that is, the face orientation of the person closest to the information processing device 1 (imaging unit 120)) faces forward after reducing the screen luminance, the luminance reduction processing unit 311 returns the screen luminance to the standard luminance before reduction.

[0078] The luminance reduction processing unit 311 also includes a timer for measuring time, and measures the waiting time from when the "No Attention" information is acquired from the face detection unit 210 in a normal operating state until the screen luminance is controlled to low luminance. For example, if the luminance reduction processing unit 311 acquires "Attention" information before a predetermined waiting time has elapsed even after acquiring "No Attention" information, the luminance reduction processing unit 311 does not control the screen luminance to low luminance but keeps it at standard luminance. On the other hand, if the luminance reduction processing unit 311 does not acquire "Attention" information before a predetermined waiting time has elapsed after acquiring "No Attention" information, it controls the screen luminance to low luminance. This makes it possible to prevent the screen luminance from becoming low luminance when the user looks away for a moment while using the information processing device 1. The predetermined waiting time is preset to, for example, 10 seconds. Note that this predetermined waiting time may be configured to be set by the user.

[0079] When the number of face regions detected by the face detection unit 210 is multiple (i.e., when multiple people are detected), the luminance reduction control unit 312 controls the luminance reduction processing by the luminance reduction processing unit 311 to be enabled or disabled based on the distance relationship between the multiple face regions. For example, the luminance reduction control unit 312 controls whether to enable or disable the luminance reduction processing based on the distance relationship between the largest face region and the second largest face region among the multiple face regions detected by the face detection unit 210. That is, the luminance reduction control unit 312 controls whether to enable or disable the luminance reduction processing based on the distance relationship between person A (see FIGS. 4 and 5) that is closest to the information processing device 1 (imaging unit 120) among the multiple people detected by the face detection unit 210 and person B (see FIGS. 4 and 5) that is second closest to the information processing device 1 (imaging unit 120).

[0080] As an example, the brightness reduction control unit 312 controls whether to enable or disable the brightness reduction process based on the distance between person A and person B on the captured image and the difference in distance between person A and person B and the information processing device 1 (imaging unit 120).

[0081] 4, the brightness reduction control unit 312 sets the first condition for disabling the brightness reduction process as the distance DU between person A and person B on the captured image being less than a predetermined threshold (e.g., one-third of the distance DF between both ends of the detection range FoV). For example, the brightness reduction control unit 312 sets the first condition for disabling the brightness reduction process as the distance DU between the face region of person A and the face region of person B on the captured image being less than a predetermined threshold (e.g., one-third of the distance DF between both ends of the detection range FoV).

[0082] 5, the luminance reduction control unit 312 sets the second condition for disabling the luminance reduction process as follows: the difference between the distance LA from the information processing device 1 (imaging unit 120) to person A and the distance LB from the information processing device 1 (imaging unit 120) to person B is less than a predetermined threshold (e.g., 20%). For example, the luminance reduction control unit 312 sets the second condition for disabling the luminance reduction process as follows: the difference in size between the face area of ​​person A and the face area of ​​person B is less than a predetermined threshold (e.g., 20%).

[0083] When both the first condition based on the distance between person A and person B on the captured image and the second condition based on the difference in distance between person A and person B from the information processing device 1 (imaging unit 120) are satisfied, the luminance reduction control unit 312 controls the luminance reduction process to be invalid. On the other hand, when either or both of the first condition and the second condition are not satisfied, the luminance reduction control unit 312 controls the luminance reduction process to be valid.

[0084] It should be noted that the luminance reduction control unit 312 effectively controls the luminance reduction process when the number of face regions detected by the face detection unit 210 is one (that is, when the number of detected people is one).

[0085] [Processing behavior] Next, the operation of the brightness reduction process executed by the brightness reduction processing unit 311 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the brightness reduction process according to the present embodiment. Here, it is assumed that the information processing device 1 is in a normal operating state and the screen brightness is set to standard brightness.

[0086] (Step S101) The luminance reduction processing unit 311 judges whether or not "No Attention" information has been acquired from the face detection unit 210. If the luminance reduction processing unit 311 judges that "No Attention" information has not been acquired (NO), it performs the process of step S101 again. On the other hand, if the luminance reduction processing unit 311 judges that "No Attention" information has been acquired (YES), it starts counting the waiting time using a timer (step S103). Then, it proceeds to the process of step S105.

[0087] (Step S105) The luminance reduction processing unit 311 determines whether or not "Attention" information has been acquired from the face detection unit 210. When the luminance reduction processing unit 311 determines that "Attention" information has not been acquired (NO), the process proceeds to step S107.

[0088] (Step S107) The luminance reduction processing unit 311 determines whether or not the waiting time (e.g., 10 seconds) has elapsed (i.e., whether or not the timer has expired) based on the value of the timer. If the luminance reduction processing unit 311 determines that the waiting time (e.g., 10 seconds) has not elapsed (i.e., the timer has not expired) (Step S107: NO), the process returns to step S105. If the luminance reduction processing unit 311 determines that the "Attention" information has been acquired before the waiting time (e.g., 10 seconds) has elapsed (Step S105: YES), the process returns to step S101. At this time, the timer is reset.

[0089] On the other hand, if the luminance reduction processing unit 311 determines in step S107 that the waiting time (for example, 10 seconds) has elapsed (step S107: YES), the process proceeds to step S109.

[0090] (Step S109) The luminance reduction processing unit 311 changes the screen luminance from standard luminance to low luminance, and then proceeds to the process of step S111.

[0091] (Step S111) The luminance reduction processing unit 311 determines whether or not "Attention" information has been acquired from the face detection unit 210. If the luminance reduction processing unit 311 determines that "Attention" information has not been acquired (NO), it performs the process of step S111 again. On the other hand, if the luminance reduction processing unit 311 determines that "Attention" information has been acquired (YES), it returns the screen luminance to standard luminance (step S113).

[0092] Next, the operation of the luminance reduction control process executed by the luminance reduction control unit 312 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the luminance reduction control process according to the present embodiment.

[0093] (Step S201) The luminance reduction control unit 312 acquires a face detection result from the face detection process from the face detection unit 210. Then, the process proceeds to step S203.

[0094] (Step S203) The luminance reduction control unit 312 determines the number of people detected (the number of face areas) based on the face detection result acquired from the face detection unit 210. If the number of people detected (the number of face areas) is 1, the luminance reduction control unit 312 proceeds to processing of step S209. On the other hand, if the number of people detected (the number of face areas) is 2, the luminance reduction control unit 312 proceeds to processing of step S205.

[0095] (Step S205) The brightness reduction control unit 312 determines whether the difference in size between the face area of ​​person A and the face area of ​​person B is less than a predetermined threshold (e.g., 20%). If the brightness reduction control unit 312 determines that the difference in size between the face area of ​​person A and the face area of ​​person B is equal to or greater than the predetermined threshold (NO), the process proceeds to step S209. On the other hand, if the brightness reduction control unit 312 determines that the difference in size between the face area of ​​person A and the face area of ​​person B is less than the predetermined threshold (YES), the process proceeds to step S207.

[0096] (Step S207) The brightness reduction control unit 312 determines whether or not the distance DU between the face region of person A and the face region of person B on the captured image is less than a predetermined threshold (for example, one third of the distance DF between both ends of the detection range FoV). If the brightness reduction control unit 312 determines that the distance DU between the face region of person A and the face region of person B on the captured image is equal to or greater than the predetermined threshold (NO), the brightness reduction control unit 312 proceeds to processing of step S209. On the other hand, if the brightness reduction control unit 312 determines that the distance DU between the face region of person A and the face region of person B on the captured image is less than the predetermined threshold (YES), the brightness reduction control unit 312 proceeds to processing of step S211.

[0097] (Step S209) The luminance reduction control unit 312 determines that there is only one user in front of the information processing device 1 (even if there are multiple people, there is only one user), and enables the luminance reduction process.

[0098] (Step S211) The brightness reduction control unit 312 determines that multiple users are present in front of the information processing device 1 (for example, multiple users are having a discussion while looking at the display unit 110 of the information processing device 1), and disables the brightness reduction process.

[0099] [Summary of the first embodiment] As described above, the information processing device 1 according to the present embodiment includes the display unit 110, a memory (for example, the system memory 304) that temporarily stores image data of a captured image captured by the imaging unit 120, and a processor (such as the face detection unit 210, the main processing unit 300 such as the CPU 301 and the chipset 303) that performs processing based on the image data stored in the memory. The information processing device 1 executes face detection processing to detect a face area in which a face is captured from the captured image and the direction of the face by processing the image data of the captured image stored in the memory. In addition, the information processing device 1 executes brightness reduction processing to reduce the screen brightness of the display unit 110 based on the direction of the face detected by the face detection processing. In addition, when the number of face areas detected by the face detection processing is more than one, the information processing device 1 executes brightness reduction control processing to control whether to enable or disable the brightness reduction processing based on the relationship of distances between the multiple face areas.

[0100] This allows the information processing device 1 to enable or disable the brightness reduction process that reduces the screen brightness according to the face direction depending on whether the device is being used by multiple users, and therefore allows the brightness reduction process to be performed more appropriately. For example, when multiple people are having a discussion while looking at the screen, they do not only always look at the screen but also have time to talk while looking at each other's faces. By disabling the brightness reduction process, it is possible to prevent the screen brightness from decreasing even when the device is being used by multiple users.

[0101] Specifically, in the brightness reduction control process, when the number of face areas detected by the face detection process is multiple, the information processing device 1 controls whether to enable or disable the brightness reduction process based on the distance relationship between the largest face area (first face area) and the second largest face area (second face area) among the multiple face areas.

[0102] As a result, when multiple people are detected, the information processing device 1 can correctly determine whether the device is being used by multiple users based on the distance relationship between the closest person and the second closest person, and appropriately control whether to enable or disable the brightness reduction process.

[0103] For example, in the brightness reduction control process, the information processing device 1 disables the brightness reduction process when the difference in size between the largest face area (first face area) and the second largest face area (second face area) among multiple face areas is less than a predetermined threshold and the distance between the first face area and the second face area on the captured image is less than a predetermined threshold.

[0104] As a result, the information processing device 1 determines that the device is being used by multiple users when the distance between the closest person and the second closest person is close and disables the brightness reduction process, thereby enabling the brightness reduction process to be performed appropriately.

[0105] Furthermore, in the face detection process, the information processing device 1 determines the person corresponding to the largest face area (first face area) among the multiple face areas as person A (first person) who is closest from the information processing device 1 (imaging unit 120), and the person corresponding to the second largest face area (second face area) as person B (second person) who is second closest from the information processing device 1 (imaging unit 120). In the brightness reduction control process, the information processing device 1 disables the brightness reduction process when the difference in distance between person A and person B from the information processing device 1 (imaging unit 120) is less than a predetermined threshold and the distance between person A and person B on the captured image is less than a predetermined threshold.

[0106] As a result, the information processing device 1 determines that the device is being used by multiple users when the distance between the closest person and the second closest person is close and disables the brightness reduction process, thereby enabling the brightness reduction process to be performed appropriately.

[0107] Furthermore, in the luminance reduction control process, when the number of face regions detected by the face detection process is one, the information processing device 1 enables the luminance reduction process.

[0108] As a result, when the information processing device 1 is being used by one user, the screen brightness can be reduced to save power when the user's face is not facing forward.

[0109] In addition, the control method in the information processing device 1 according to this embodiment includes the steps of: performing face detection processing by the information processing device 1 to detect a face area in which a face is captured from the captured image and the direction of the face by processing image data of the captured image stored in the memory; performing brightness reduction processing to reduce the screen brightness of the display unit 110 based on the direction of the face detected by the face detection processing; and, when the number of face areas detected by the face detection processing is multiple, performing brightness reduction control processing to control whether to enable or disable the brightness reduction processing based on the distance relationship between the multiple face areas.

[0110] This allows the information processing device 1 to enable or disable the brightness reduction process that reduces the screen brightness according to the face direction depending on whether the device is being used by multiple users, and therefore allows the brightness reduction process to be performed more appropriately. For example, when multiple people are having a discussion while looking at the screen, they do not only always look at the screen but also have time to talk while looking at each other's faces. By disabling the brightness reduction process, it is possible to prevent the screen brightness from decreasing even when the device is being used by multiple users.

[0111] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiment can be combined in any combination.

[0112] In the above embodiment, the brightness reduction process is disabled when both the first condition (see FIG. 4) based on the distance between person A and person B on the captured image and the second condition (see FIG. 5) based on the difference in distance between person A and person B from the information processing device 1 (imaging unit 120) are satisfied, but the present invention is not limited to this. For example, the information processing device 1 may disable the brightness reduction process when either the first condition or the second condition is satisfied.

[0113] For example, when the imaging angle of view is narrow due to the specifications of the imaging unit 120, the range (width of the top, bottom, left and right) of the detection range FoV is also narrow. In this case, when multiple face areas are detected from the detection range FoV, the distance between the detected multiple face areas on the captured image is inevitably close. Therefore, the information processing device 1 may control to disable the brightness reduction process on the condition that only a second condition (see FIG. 5) based on the difference in distance from the information processing device 1 (imaging unit 120) between person A and person B is satisfied.

[0114] Specifically, in the brightness reduction control process, the information processing device 1 may disable the brightness reduction process if the difference in size between the largest face area (first face area) and the second largest face area (second face area) among multiple face areas is less than a predetermined threshold.

[0115] That is, in the brightness reduction control process, the information processing device 1 may disable the brightness reduction process when the difference in distance from the information processing device 1 (imaging unit 120) between person A (first person) who is closest to the information processing device 1 (imaging unit 120) and person B (second person) who is second closest is less than a predetermined threshold.

[0116] As a result, the information processing device 1 determines that the device is being used by multiple users when the distance between the closest person and the second closest person is close and disables the brightness reduction process, thereby enabling the brightness reduction process to be performed appropriately.

[0117] Furthermore, when the depth direction distance of the detection range FoV is short due to the specifications of the imaging unit 120, when multiple face areas are detected from the detection range FoV, the difference in distance from the information processing device 1 (imaging unit 120) between the detected multiple face areas is inevitably small. Therefore, the information processing device 1 may control to disable the brightness reduction process on the condition that only the condition based on the distance between person A and person B on the captured image (see FIG. 4) is satisfied.

[0118] Specifically, in the brightness reduction control process, the information processing device 1 may disable the brightness reduction process if the distance on the captured image between the largest face area (first face area) and the second largest face area (second face area) among multiple face areas is less than a predetermined threshold.

[0119] That is, in the brightness reduction control process, the information processing device 1 may disable the brightness reduction process if the distance on the captured image between person A (first person) who is closest to the information processing device 1 (imaging unit 120) and person B (second person) who is second closest is less than a predetermined threshold.

[0120] As a result, the information processing device 1 determines that the device is being used by multiple users when the distance between the closest person and the second closest person is close and disables the brightness reduction process, thereby enabling the brightness reduction process to be performed appropriately.

[0121] Furthermore, the CPU 301 and the chipset 303 may be configured as separate processors, or may be integrated into a single processor.

[0122] In the above embodiment, an example has been described in which the face detection unit 210 is provided separately from the CPU 301 and the chipset 303, but a part or all of the face detection unit 210 may be provided in the chipset 303, or may be provided in a processor integrated with the CPU 301 or the chipset 303. For example, the CPU 301, the chipset 303, and the face detection unit 210 may be configured as separate processors, or may be integrated into one processor. A part or all of the face detection unit 210 may be provided in the EC 200. A part of the system processing unit 310 may be provided in the EC 200.

[0123] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, power-off state, etc. are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0124] The information processing device 1 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0125] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0126] In addition, some or all of the functions of the information processing device 1 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used.

[0127] Furthermore, the information processing device 1 of the above embodiment is not limited to a notebook PC, but may be, for example, a desktop PC. [Explanation of symbols]

[0128] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Face detection unit, 211 Face area detection unit, 212 Face direction detection unit, 213 Detection result output unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chip set, 304 System memory, 310 System processing unit, 311 Brightness reduction processing unit, 312 Brightness reduction control unit, 400 Power supply unit

Claims

1. A display unit; a memory that temporarily stores image data of an image captured by the imaging unit; A processor that performs processing based on the image data stored in the memory; Equipped with The processor, a face detection process for detecting a face area in the captured image and a direction of the face by processing the image data stored in the memory; a brightness reduction process for reducing a screen brightness of the display unit based on a direction of the face detected by the face detection process; a brightness reduction control process for controlling whether to enable or disable the brightness reduction process based on a distance relationship between the plurality of face regions when the number of the face regions detected by the face detection process is multiple, An information processing device that performs the above.

2. The processor, In the luminance reduction control process, when the number of the face areas detected by the face detection process is multiple, whether to enable or disable the luminance reduction process is controlled based on a distance relationship between a first face area that is the largest among the multiple face areas and a second face area that is the second largest.

2. An information processing device according to claim 1.

3. The processor, In the luminance reduction control process, when a difference in size between the first face region and the second face region is less than a predetermined threshold, the luminance reduction process is disabled. The information processing device according to claim 2 .

4. The processor, In the face detection process, a person corresponding to the first face area is determined as a first person who is closest to the imaging unit, and a person corresponding to the second face area is determined as a second person who is second closest to the imaging unit, In the luminance reduction control process, when a difference in distance between the first person and the second person and the imaging unit is less than a predetermined threshold, the luminance reduction process is disabled. The information processing device according to claim 2 .

5. The processor, In the luminance reduction control process, when a distance between the first face region and the second face region on the captured image is less than a predetermined threshold, the luminance reduction process is disabled. The information processing device according to claim 2 .

6. The processor, In the face detection process, a person corresponding to the first face area is determined as a first person who is closest to the imaging unit, and a person corresponding to the second face area is determined as a second person who is second closest to the imaging unit, In the luminance reduction control process, when a distance between the first person and the second person on the captured image is less than a predetermined threshold, the luminance reduction process is disabled. The information processing device according to claim 2 .

7. The processor, In the luminance reduction control process, when a difference in size between the first face region and the second face region is less than a predetermined threshold and a distance between the first face region and the second face region on the captured image is less than a predetermined threshold, the luminance reduction process is disabled. The information processing device according to claim 2 .

8. The processor, In the face detection process, a person corresponding to the first face area is determined as a first person who is closest to the imaging unit, and a person corresponding to the second face area is determined as a second person who is second closest to the imaging unit, In the luminance reduction control process, when a difference in distance between the first person and the second person from the imaging unit is less than a predetermined threshold and a distance between the first person and the second person on the captured image is less than a predetermined threshold, the luminance reduction process is disabled. The information processing device according to claim 2 .

9. The processor, In the luminance reduction control process, when the number of the face regions detected by the face detection process is one, the luminance reduction process is enabled. The information processing device according to claim 1 .

10. A control method for an information processing device including a display unit, a memory that temporarily stores image data of an image captured by an imaging unit, and a processor that performs processing based on the image data stored in the memory, comprising: The processor, performing face detection processing for detecting a face area in which a face is captured from the captured image and a direction of the face by processing image data of the image stored in the memory; performing a brightness reduction process for reducing screen brightness of the display unit based on the orientation of the face detected by the face detection process; performing a brightness reduction control process for controlling whether to enable or disable the brightness reduction process based on a distance relationship between the plurality of face regions when the number of the face regions detected by the face detection process is multiple; A control method comprising:

Images