Information processing apparatus and control method

Abstract

To reduce a difference between time from when a person leaves to when control is performed on a system side and setting time of the control set on the system side.SOLUTION: An information processing apparatus includes a sensor for detecting an object present within a predetermined detection range, and when it is detected using the sensor that any object with a certain movement is not present within the predetermined detection range over a first time, it is detected that no person is present within the predetermined detection range, and first information indicating that no person is present before the first time passes is set. In response to the first information being set, measurement of a second time is started by system processing, and function stop processing to stop at least some of functions by the system processing is performed on conditions that it is detected that any object with a certain movement is not present within the predetermined detection range over the first time, and the measurement of the second time ends.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] Some devices transition to an operational state where they can be used when a person approaches, and transition to a standby state where all functions are stopped except for some functions when the person leaves. For example, Patent Document 1 discloses a technology that uses an infrared sensor to detect the strength of infrared light, thereby detecting whether a person is approaching or has left, and controlling the operational state of the device. Furthermore, with the recent development of computer vision and the like, the detection accuracy when detecting faces from images has improved. Therefore, face detection has begun to be used instead of detecting people using infrared sensors.

[0003] When detecting people using an infrared sensor, a method is sometimes used to exclude non-moving objects from the detection target so as not to detect simple objects as people. On the other hand, when detecting people using face detection, a method is sometimes used to exclude non-moving objects from the detection target, as there is a possibility that a face on a poster or the like will be detected. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-148895 Summary of the Invention [Problem to be solved by the invention]

[0005] As mentioned above, adding the presence or absence of movement of the detection target to the person detection conditions reduces the possibility of falsely detecting an object that is not a person as a person, but on the other hand, it takes a considerable amount of time for detection. The time required for detection varies depending on the environment of the detection target, such as the presence or absence of moving objects other than people, or whether there is a poster with an image of a face on the wall, but in some cases it took approximately 0 to 120 seconds, and typically around 40 seconds.

[0006] In recent years, some systems, such as Windows (registered trademark), allow users to set the time from when the absence of a person is detected until the display screen is turned off, and the set time until the screen is turned off is displayed. However, because the system control starts counting the set time after the absence of a person is detected, if it takes time to detect the absence of a person, there may be a large difference between the time from when the person actually leaves until the screen is turned off and the set time.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that can reduce the difference between the time from when a person leaves until control is performed on the system side and the set time for that control set on the system side. [Means for solving the problem]

[0008] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, wherein the processor performs a person detection process for detecting the absence of a person within the detection range when the sensor detects that an object with a predetermined movement is not present within the detection range for a first time period and for setting first information indicating that no person is present before the first time period has elapsed, a timing process for starting measurement of a second time period by the system processing in response to the first information being set by the person detection process, and a function stop process for stopping at least a part of the functions of the system processing on the condition that the person detection process detects that an object with a predetermined movement is not present within the detection range for the first time period and the measurement of the second time period has ended by the timing process.

[0009] In the above information processing device, if the processor detects, in the person detection process, that an object with a predetermined movement is present within the detection range before the first time has elapsed, it may change the setting from the first information to second information indicating the presence of a person.

[0010] In the above information processing device, the processor may reset the second time measured by the timing process if, in the person detection process, it detects the presence of an object with a predetermined movement within the detection range before the first time has elapsed.

[0011] In the information processing device, the processor may control a display unit to be turned off when at least a part of the functions performed by the system processing is stopped.

[0012] In the above-mentioned information processing device, the first information set by the processor by the person detection process before the first time has elapsed may be a temporary setting for starting measurement of the second time, and when the person detection process detects that no object with a predetermined movement is present within the detection range for the first time, it may be confirmed that the person indicated by the first information is not present.

[0013] In the information processing device, the first time period may be a time period determined in the person detection process, and the second time period may be a time period that can be set by a user in the system.

[0014] Furthermore, according to a second aspect of the present invention, a control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor includes a person detection step in which, when the processor uses the sensor to detect that an object with a predetermined movement is not present within the detection range for a first time period, the processor detects that a person is not present within the detection range and sets first information indicating that a person is not present before the first time period has elapsed; a timing step in which, in response to the first information being set by the person detection step, the processor starts measuring a second time period; and a function stop step in which, on condition that the person detection step detects that an object with a predetermined movement is not present within the detection range for the first time period and the measurement of the second time period has ended by the time stop step, the processor stops at least part of the functions of the system processing. [Effects of the Invention]

[0015] According to the above aspect of the present invention, it is possible to reduce the difference between the time it takes for the system to perform control after a person leaves and the set time for that control set on the system side. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 2 is a diagram for explaining an overview of HPD processing of the information processing apparatus according to the embodiment. [Figure 2] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to an embodiment. [Figure 3] FIG. 4 is a diagram showing an example of a person detection range of the information processing apparatus according to the embodiment. [Figure 4] 10A and 10B are diagrams showing an example of a screen-off process when a person's departure is detected according to the embodiment. [Figure 5] FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 6] FIG. 1 is a schematic block diagram showing an example of the functional configuration of an information processing apparatus according to an embodiment. [Figure 7] 10 is a flowchart showing an example of processing when detecting a person leaving the image capturing apparatus according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [overview] First, an overview of an information processing device 1 according to the first embodiment will be described. The information processing device 1 according to this embodiment is, for example, a notebook PC (Personal Computer). Note that the information processing device 1 may be any type of information processing device, such as a desktop PC, a tablet terminal device, or a smartphone.

[0018] The information processing device 1 can transition between at least a normal operating state (power-on state) and a standby state as system operating states. The normal operating state is an operating state in which processing can be executed without any particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface). The standby state is a state in which at least some of the functions performed by the system processing are restricted. For example, the standby state is a state in which at least the display unit is turned off (screen off). Screen off refers to the display being stopped and the display screen being turned off (not displayed), and the brightness of the screen is at its minimum (zero). The brightness of the screen of the display unit in the normal operating state before the screen is turned off will be referred to as "standard brightness" below.

[0019] The standby state may be a standby state, a sleep state, or the like, and may be a state equivalent to modern standby in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI.

[0020] Hereinafter, the transition of the system's operating state from a standby state to a normal operating state may be referred to as "activation." In the standby state, the activity level of the system is generally lower than in the normal operating state, so activating the system of the information processing device 1 activates the system operation in the information processing device 1.

[0021] FIG. 1 is a diagram illustrating an overview of HPD processing of an information processing device 1 according to this embodiment. The information processing device 1 detects a person (i.e., a user) present near the information processing device 1. This person detection processing for detecting the presence of a person is called HPD (Human Presence Detection) processing. The information processing device 1 detects the presence or absence of a person through HPD processing and controls the operating state of the system of the information processing device 1 based on the detection result. For example, as shown in FIG. 1(A), when the information processing device 1 detects a change from a state in which no person is present in front of the information processing device 1 (Absence) to a state in which a person is present (Presence), i.e., when it detects that a person has approached the information processing device 1 (Approach), it determines that a user has approached and automatically activates the system to transition to a normal operating state. Furthermore, as shown in FIG. 1(B), when a person is present in front of the information processing device 1 (Presence), it determines that a user is present and continues the normal operating state. Then, when the information processing device 1 detects a change from a state in which a person is present (Presence) in front of (in front of) the information processing device 1 to a state in which a person is not present (Absence), that is, when the information processing device 1 detects that the person has left the information processing device 1 (Leave), as shown in Figure 1 (C), it determines that the user has left, turns off the screen, and transitions the system to a standby state.

[0022] [External configuration of information processing device] FIG. 2 is a perspective view showing an example of the external configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis defined by the hinge mechanism 15. The opening angle between the first housing 10 and the second housing 20 due to the rotation is shown as "θ".

[0023] The first housing 10 is also referred to as the A cover or display housing. The second housing 20 is also referred to as the C cover or system housing. In the following description, the sides of the first housing 10 and the second housing 20 that are provided with the hinge mechanism 15 are referred to as side 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite side 10c and 20c are referred to as side 10a and 20a, respectively. In the illustration, the direction from side 20a toward side 20c is referred to as the "rear," and the direction from side 20c toward side 20a is referred to as the "front." The right and left sides of the rear are referred to as the "right" and "left," respectively. The left sides of the first housing 10 and the second housing 20 are referred to as side 10b and 20b, respectively, and the right sides are referred to as side 10d and 20d, respectively. Furthermore, the state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as the "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Furthermore, the state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as the "open state."

[0024] The external appearance of the information processing device 1 shown in FIG. 2 is an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states in which the user uses the information processing device 1, and it is typically used with an opening angle θ of approximately 100 to 130°. The range of the opening angle θ that results in the open state can be determined arbitrarily depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0025] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD), an organic electroluminescence (EL) display, or the like. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is an example, and the imaging unit 120 may be disposed in another location as long as it can face in a direction facing the inner surface of the first housing 10 (forward).

[0026] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in the direction (forward) facing the inner surface of the first housing 10. The predetermined imaging range is the range of the angle of view determined by the imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture an image including a person present in front of (on the front side of) the information processing device 1.

[0027] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator that the user uses to instruct the device to turn the power on or off, transition from a standby state to a normal operating state, transition from the normal operating state to a standby state, etc. A keyboard 151 and a touchpad 153 are provided on the inner surface of the second housing 20 as input devices that accept user operation inputs. Note that, instead of or in addition to the keyboard 151 and the touchpad 153, a touch sensor may be provided as the input device, or a mouse or an external keyboard may be connected. In a configuration where a touch sensor is provided, an area corresponding to the display surface of the display unit 110 may be configured as a touch panel that accepts operations. The input device may also include a microphone for inputting audio.

[0028] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first housing 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing, and are unable to function.

[0029] The information processing device 1 detects the presence of a person within a predetermined range ahead (on the front side). FIG. 3 is a diagram showing an example of a person detection range of the information processing device 1 according to this embodiment. In the example shown, a detection range FoV (Field of View: detection field of view angle) in front of the information processing device 1 is a range in which a person can be detected. For example, the information processing device 1 determines whether a person (user) is present in front of (in front of) the information processing device 1 by detecting a face area in which a face is captured from a captured image of the front (front side). The detection range FoV corresponds to the image capture angle of the information processing device 1. If a face area is detected from the captured image, the information processing device 1 determines that a user is present. On the other hand, if a face area is not detected from the captured image, the information processing device 1 determines that a user is not present.

[0030] Here, when the information processing device 1 detects a face area from a captured image, it determines whether or not there is movement in the detected face area to avoid accidentally detecting a face such as a poster, and excludes motionless objects from the detection target of a person. Note that if there is movement of a magnitude or speed far exceeding the normal shaking or movement of a person (user) using the information processing device 1, the object is also excluded from the detection target of a person. In this way, the information processing device 1 detects whether or not a person exists in the detection range FoV by not only detecting a face area from a captured image but also determining whether or not there is a predetermined movement in the detected face area (face). That is, the information processing device 1 detects whether or not a person exists in the detection range FoV depending on whether or not there is an object (e.g., a face) with a predetermined movement in the detection range FoV.

[0031] Determining whether a person is present or absent by determining whether there is movement takes time depending on the situation. For example, if a poster containing an image of a face is captured within the detection range FoV, detection tends to take time. For example, if the information processing device 1 takes about 40 seconds to detect that a person has left, it will take about 40 seconds from the time the person actually leaves until the HPD processing detects that the person has left.

[0032] On the other hand, some operating systems (OSs), such as Windows (registered trademark), allow the user to set the time from when it is detected that a person is not present until the display unit 110 is turned off, and the set time until the screen is turned off is displayed. The OS starts timing the set time after it is detected that a person is not present. For example, if this set time is set to 30 seconds, and timing the set time starts after it is detected that a person has left (after it is detected that a person is not present), it will take approximately 70 seconds from when the person actually leaves until the screen is turned off. In this case, the difference from the set time (30 seconds) is large, which may cause the user to feel uncomfortable or may remind them of a malfunction, and is therefore undesirable.

[0033] Therefore, even if it takes time (for example, about 40 seconds) to detect a person's leaving, the information processing device 1 according to this embodiment notifies the OS side that the person is no longer present, assuming that the person has left during detection before that time has elapsed. This allows the OS side to start displaying the set time earlier, shortening the time from when the person actually leaves until the screen is turned off, and reducing the difference from the set time (30 seconds).

[0034] 4 is a diagram showing an example of screen-off processing when a person leaves according to this embodiment. In this diagram, the horizontal axis represents time (t), and the system operation, user status, HPD processing, and system processing (processing on the OS side) when a person leaves are detected are shown in chronological order.

[0035] At time t0, the user is present in front of the information processing device 1 (detection range FoV). The information processing device 1 is in a normal operating state, and the brightness of the screen of the display unit 110 is standard brightness. The information processing device 1 detects the presence of a person within the detection range FoV through HPD processing, and sets "Presence=True" as the detection result of the HPD processing.

[0036] When the user leaves at time t1, the information processing device 1 enters a state where no object with a predetermined movement is detected within the detection range FoV (No motion) through HPD processing, and starts counting the time that this state continues (hereinafter referred to as the "motion detection timer"). The motion detection timer is reset every time an object with a predetermined movement is detected.

[0037] When the motion detection timer finishes timing without detecting an object with a predetermined movement within the detection range FoV through the HPD process (time t3), the information processing device 1 detects that the person has left (Leave). That is, when the information processing device 1 detects that an object with a predetermined movement does not exist within the detection range FoV over the detection time (for example, 40 seconds) measured by the motion detection timer, it detects that no person exists within the detection range FoV.

[0038] Furthermore, the information processing device 1 sets the detection result of the HPD process to "Presence=False," indicating that no person is present, at time t2, before detecting that the person has left at time t3. Time t2 is set, for example, 10 seconds after the motion detection timer starts timing at time t1. In other words, if the information processing device 1 detects that no object with a predetermined movement is present within the detection range FoV for 10 seconds, it sets "Presence=False" before confirming that the person has left.

[0039] In response to "Presence=False" being set by HPD processing, the information processing device 1 starts measuring the set time until the screen is turned off by system processing (processing on the OS side). The timer that measures the set time until the screen is turned off (screen off set time) is called the "screen off timer." The screen off timer is reset without timing when "Presence=True" is set, and starts timing when "Presence=False" is set.

[0040] Then, after time t3 when the information processing device 1 confirms that the person has left (Leave) and on the condition that the measurement of the screen-off timer has ended, the information processing device 1 turns off the screen through system processing at time t4 and transitions to a standby state. In this way, when the information processing device 1 enters a state in which it has not detected an object with a predetermined movement (No motion), it starts timing the screen-off timer from time t2, before it detects (confirms) that the person has left (Leave) at time t3. This reduces the difference from the screen-off set time compared to when it starts timing the screen-off timer from time t3. For example, if the screen-off set time is set to 30 seconds, starting timing the screen-off timer from time t3 will result in 70 seconds from the time the person actually leaves until the screen is turned off. In contrast, the information processing device 1 preferably reduces the difference from the screen-off set time by 40 seconds from the time the person actually leaves until the screen is turned off, thereby reducing the difference from the screen-off set time.

[0041] Furthermore, if an object with a predetermined movement is detected within the detection range FoV by HPD processing after "Presence=False" is set at time t2 until time t3, the setting is changed to "Presence=True" and the motion detection timer is reset. As a result, even if the information processing device 1 sets "Presence=False" before detecting (confirming) that a person has left (Leave), if the person has not left (if the presence of a person is detected), the setting is returned to "Presence=True," so that the screen is not erroneously turned off even if the person has not left.

[0042] The time from time t1 to time t2 is set as the minimum time required to detect a state in which no object with a predetermined movement is detected (no motion), and although 10 seconds has been used as an example, it is not limited to 10 seconds. The time from time t1 to time t2 may be shorter than the time from time t1 to time t3. However, the shorter the time from time t1 to time t2, the greater the effect of reducing the difference between the time from when a person actually leaves until the screen is turned off and the set screen-off time. Even if the time from time t1 to time t2 is shortened, there is no problem because if an object with a predetermined movement is detected between time t2 and time t3, the setting will be returned to "Presence=True."

[0043] Furthermore, it is preferable that the time from time t1 to time t3 (detection time) is set to the same time as the screen-off setting time or to a time shorter than the screen-off setting time, so that the screen-off timer does not end before it is detected (confirmed) that a person has left.

[0044] [Hardware configuration of information processing device] Fig. 5 is a schematic block diagram showing an example of the hardware configuration of an information processing device 1 according to this embodiment. In Fig. 5, components corresponding to those in Fig. 2 are assigned the same reference numerals. The information processing device 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a main processing unit 300, a face detection unit 320, and a power supply unit 400.

[0045] The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0046] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in the direction facing (forward) the inner surface of the first housing 10, and outputs the captured image to the main processing unit 300 and the face detection unit 320. For example, the imaging unit 120 is a visible light camera (RGB camera) that captures images using visible light. Note that the imaging unit 120 may further include an infrared camera (IR camera) that captures images using infrared light.

[0047] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0048] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various types of data. For example, the communication unit 160 is configured to include a wired LAN interface such as Ethernet (registered trademark), a wireless LAN interface such as Wi-Fi (registered trademark), etc.

[0049] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), RAM, and ROM. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0050] The power supply unit 400 supplies power to each unit of the information processing device 1 according to the operating state of each unit. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into the voltage required by each unit. The power whose voltage is converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0051] The EC200 is a microcomputer including a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and I / O (Input / Output) logic circuits. The CPU of the EC200 reads a control program (firmware) pre-stored in its own ROM, executes the read control program, and performs its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to the power button 140, the input device 150, the power supply unit 400, and the like.

[0052] For example, the EC 200 communicates with the power supply unit 400 to acquire information on the battery status (such as remaining capacity) from the power supply unit 400, and outputs to the power supply unit 400 control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1. The EC 200 also acquires operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to processing by the main processing unit 300 among the acquired operation signals.

[0053] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphics Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0054] The CPU 301 executes processes based on BIOS programs, processes based on OS programs, and processes based on application programs running on the OS. The CPU 301 controls the operating state of the system under control from the chipset 303. For example, the CPU 301 executes a startup process that transitions the operating state of the system from a standby state to a normal operating state. The CPU 301 also executes a process that transitions the operating state of the system from the normal operating state to a standby state by putting the display unit 110 into sleep-off mode.

[0055] The GPU 302 is connected to the display unit 110. The GPU 302 generates display data by executing image processing under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110.

[0056] The chipset 303 has functions as a memory controller and an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires detection results from a face detection process acquired from the face detection unit 320. For example, the chipset 303 executes HPD processing to detect a person (user) based on information acquired from the face detection unit 320.

[0057] The system memory 304 is used as a reading area for programs executed by the CPU 301 and a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0058] The CPU 301, GPU 302, and chipset 303 may be configured as a single integrated processor, or some or each may be configured as individual processors. For example, in a normal operating state, the CPU 301, GPU 302, and chipset 303 are all operating, but in a standby state, only at least a part of the chipset 303 is operating. In the standby state, at least the functions necessary for HPD processing at startup are operating.

[0059] The face detection unit 320 is configured to include a processor that processes image data of the captured image captured by the imaging unit 120. The face detection unit 320 acquires image data of the captured image captured by the imaging unit 120 and temporarily stores the acquired image data in memory. The memory that stores the image data may be the system memory 304 or may be a memory that is included in the face detection unit 320 and is connected to the processor.

[0060] For example, the face detection unit 320 processes image data of a captured image acquired from the imaging unit 120 to perform face detection processing for detecting a face area from the captured image, and processing based on the detection results of the face detection processing.

[0061] [Functional configuration of information processing device] Next, the functional configuration relating to the HPD process in the information processing device 1 will be described in detail.

[0062] 6 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a system processing unit 310 and an HPD processing unit 321.

[0063] The HPD processing unit 321 is a functional configuration that executes HPD processing (human detection processing) through processing by the face detection unit 320, or processing by the face detection unit 320 and the chipset 303. For example, the HPD processing unit 321 includes a human detection unit 322, a motion detection timer 333, and a detection result output unit 334.

[0064] The person detection unit 322 detects whether or not a person is present within the detection range FoV based on a face area detected from a captured image acquired from the imaging unit 120. For example, the person detection unit 322 detects whether or not an object (here, a face area) with a predetermined movement is present within the detection range FoV using the imaging unit 120. If a face area with a predetermined movement is present, the person detection unit 322 detects that a person is present within the detection range FoV. When the person detection unit 322 detects that a person is present within the detection range FoV, it sets "Presence=True" as the detection result.

[0065] On the other hand, if the person detection unit 322 detects that a face area with a predetermined movement does not exist for a predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4), it detects that no person exists within the detection range FoV. At this time, the person detection unit 322 measures the predetermined detection time using the motion detection timer 333.

[0066] Here, when detecting that a face area does not exist within the detection range FoV, the person detection unit 322 sets "Presence=False" before a predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) has elapsed (for example, at time t2 in FIG. 4). This "Presence=False" set by the person detection unit 322 before the predetermined detection time has elapsed is a temporary setting for starting measurement of the screen-off setting time. Then, when the person detection unit 322 detects that a face area with a predetermined movement does not exist within the detection range FoV over the predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) (for example, at time t3 in FIG. 4), the detection of the absence of a person indicated by "Presence=False" is confirmed.

[0067] After setting "Presence=False," if the person detection unit 322 detects the presence of a face area with a predetermined movement within the detection range FoV before the predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) has elapsed, the person detection unit 322 changes the setting from "Presence=False" to "Presence=True." This predetermined detection time is determined in the HPD process.

[0068] Furthermore, after setting "Presence=False", if the person detection unit 322 detects the presence of a face area with a predetermined movement within the detection range FoV before the predetermined detection time (for example, the time from time t1 to time t3 in Figure 4) has elapsed, the person detection unit 322 resets the time measured by the motion detection timer 333.

[0069] As described with reference to FIG. 4, the motion detection timer 333 is a timer that measures the above-mentioned predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4).

[0070] The detection result output unit 334 outputs “Presence=True” or “Presence=False” set as the detection result of the person detection unit 322 to the system processing unit 310 .

[0071] System processing unit 310 is a functional configuration realized by executing system processing of the OS by CPU 301. For example, system processing unit 310 includes, as functional components realized by OS processing, detection result acquisition unit 311, screen-off time setting unit 312, screen-off timer 313, and operation control unit 314.

[0072] The detection result acquisition unit 311 acquires “Presence=True” or “Presence=False” output from the HPD processing unit 321 .

[0073] The screen-off time setting unit 312 sets the screen-off time setting based on a user operation, etc. For example, the screen-off time setting can be set by the user in the system settings of the OS.

[0074] When the detection result acquisition unit 311 acquires "Presence=False", the screen-off timer 313 starts measuring the screen-off set time (for example, the time from time t2 to time t4 in FIG. 4) set by the screen-off time setting unit 312. That is, in response to the setting of "Presence=False" by the person detection unit 322, the screen-off timer 313 starts measuring the screen-off set time by system processing.

[0075] The operation control unit 314 controls the system processing (operation state, etc.) based on the detection result of the HPD processing. For example, the operation control unit 314 stops at least some of the functions of the system processing on the condition that the person detection unit 322 detects that a face area with a predetermined movement does not exist within the detection range FoV for a predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) and the screen-off timer 313 has finished measuring the screen-off setting time (for example, the time from time t2 to time t4 in FIG. 4). As an example, when stopping at least some of the functions of the system processing, the operation control unit 314 controls the display unit 110 to turn off the screen and transition to a standby state.

[0076] [Processing behavior when detecting a person leaving] Next, with reference to FIG. 7, the operation of the process when the information processing device 1 detects a person leaving through the HPD control process will be described.

[0077] 7 is a flowchart showing an example of processing when detecting the departure of a person according to this embodiment. Here, it is assumed that the information processing device 1 is in a normal operating state and has "Presence=True" set.

[0078] (Step S101) The HPD processing unit 321 resets the motion detection timer 333 and starts measuring the detection time, and then proceeds to the processing of step S103.

[0079] (Step S103) The HPD processing unit 321 detects whether or not an object with a predetermined movement (here, a face region) is present within the detection range FoV. Then, the HPD processing unit 321 determines whether or not an object with a predetermined movement (here, a face region) is detected within the detection range FoV during the 10 seconds of detection measured by the motion detection timer 333. If the HPD processing unit 321 determines that an object with a predetermined movement (here, a face region) has been detected (YES), the process returns to step S101. On the other hand, if the HPD processing unit 321 determines that an object with a predetermined movement (here, a face region) has not been detected (NO), the process proceeds to step S105.

[0080] (Step S105) In order to start timing of the screen-off timer 313, the HPD processing unit 321 sets "Presence=False" (temporary setting) and outputs it to the system processing unit 310. Then, the process proceeds to step S107.

[0081] (Step S107) When the system processing unit 310 acquires "Presence=False" output from the HPD processing unit 321, it resets the screen-off timer 313 and starts counting the screen-off set time. Then, the process proceeds to step S109.

[0082] (Step S109) Following the processing of step S103, the HPD processing unit 321 determines whether or not an object with a predetermined movement (here, a face region) has been detected within the detection range FoV during the 30 seconds of detection measured by the motion detection timer 333. If the HPD processing unit 321 determines that an object with a predetermined movement (here, a face region) has been detected (YES), the process proceeds to the processing of step S111, and after changing the setting to "Presence = True," returns to the processing of step S101. On the other hand, if the HPD processing unit 321 determines that an object with a predetermined movement (here, a face region) has not been detected (NO), the HPD processing unit 321 confirms the detection that no person is present ("Presence = False"), and proceeds to the processing of step S113.

[0083] (Step S113) When the system processing unit 310 ends the counting of the screen-off set time by the screen-off timer 313, the process proceeds to step S115.

[0084] (Step S113) System processing unit 310 turns off the screen of display unit 110 and transitions to a standby state.

[0085] [Summary of the embodiment] As described above, the information processing device 1 according to this embodiment includes an image capture unit 120 (an example of a sensor) for detecting an object (e.g., a face) present within a predetermined detection range FoV, a system memory 304 (an example of a memory) for temporarily storing a system (e.g., an OS) program, and a processor (e.g., a CPU 301, a chipset 303, a face detection unit 320, etc.) for executing system processing based on the program and processing using the image capture unit 120. When the information processing device 1 detects the absence of a predetermined moving object (e.g., a face) within the detection range FoV for a predetermined detection time (an example of a first time) using the image capture unit 120, the information processing device 1 performs HPD processing (person detection processing) to detect the absence of a person within the detection range FoV and set "Presence = False" (an example of first information) indicating the absence of a person before the predetermined detection time has elapsed. Furthermore, in response to the setting of "Presence = False" by the HPD processing, the information processing device 1 performs timing processing to start measuring a screen-off setting time (an example of a second time) by system processing. Then, the information processing device 1 performs a function stop process to stop at least part of the functions of the system processing (e.g., turn off the screen) on the condition that the HPD process detects that no object (e.g., a face) with a predetermined movement is present within the detection range FoV for a predetermined detection time, and the timing process has completed measuring the screen-off setting time.

[0086] As a result, when the information processing device 1 detects that no person is present within the detection range FoV, it starts timing the screen-off setting time before the time required for detection has elapsed, thereby reducing the difference between the time from when the person leaves until control is performed on the system side and the setting time for that control set on the system (OS) side.

[0087] Furthermore, in the above-mentioned HPD processing, if the information processing device 1 detects the presence of a predetermined moving object (e.g., a face) within the detection range FoV before a predetermined detection time has elapsed, it changes the setting from "Presence=False" to "Presence=True" (an example of second information), which indicates the presence of a person.

[0088] As a result, when the information processing device 1 detects that a person is not present within the detection range FoV, if the presence of a person is detected before the time required for detection has elapsed, the information processing device 1 can correctly detect that a person is present.

[0089] In addition, if the information processing device 1 detects in the above HPD processing that an object (e.g., a face) with a predetermined movement is present within the detection range FoV before a predetermined detection time has elapsed, it resets the screen-off setting time measured by the above timing processing.

[0090] As a result, when the information processing device 1 detects that no person is present within the detection range FoV, if the presence of a person is detected before the time required for detection has elapsed, the information processing device 1 can correctly control the display unit 110 so that the screen is not turned off.

[0091] Furthermore, when the information processing device 1 stops at least a part of the functions of the system processing, it controls the display unit 110 to turn off the screen (OFF).

[0092] As a result, when a person moves away, the information processing device 1 can reduce power consumption by turning off the screen of the display unit 110. Furthermore, when a person moves away, the information processing device 1 can improve security because the content displayed on the display unit 110 becomes invisible to others.

[0093] Here, "Presence=False" set by the information processing device 1 before the predetermined detection time has elapsed by the HPD process is a temporary setting for starting measurement of the screen-off setting time. Also, when the HPD process detects that an object (e.g., a face) with a predetermined movement is not present within the detection range FoV over the predetermined detection time, the detection of the absence of a person indicated by "Presence=False" is confirmed.

[0094] As a result, when the information processing device 1 detects that no person is present within the detection range FoV, it can start timing the screen-off setting time without waiting for the detection to be confirmed by temporarily setting "Presence=False" before the time required for detection has elapsed. Therefore, the information processing device 1 can reduce the difference between the time from when a person leaves until when the system performs control and the setting time for that control set on the system (OS) side.

[0095] The predetermined detection time is determined in the above HPD process, and the screen-off setting time can be set by the user in the system.

[0096] This allows the information processing device 1 to reduce the impact on the user caused by a discrepancy between the detection time in the HPD process and the screen-off setting time set by the user on the system (OS) side.

[0097] Furthermore, according to the present embodiment, the information processing device 1 includes an image capture unit 120 (an example of a sensor) for detecting an object (e.g., a face) present within a predetermined detection range FoV, a system memory 304 (an example of a memory) for temporarily storing a system (e.g., an OS) program, and a processor (e.g., a CPU 301, a chipset 303, a face detection unit 320, etc.) for executing system processing based on the program and processing using the image capture unit 120. The control method for the information processing device 1 includes the steps of: when the processor detects, using the image capture unit 120, that a predetermined moving object (e.g., a face) does not exist within the detection range FoV for a predetermined detection time (an example of a first time), detecting that no person exists within the detection range FoV. Both methods include a person detection step of setting "Presence=False" (an example of first information) indicating that no person is present before a predetermined detection time has elapsed, a timing step of starting measurement of a screen-off setting time (an example of a second time) by system processing in response to "Presence=False" being set by the person detection step, and a function stopping step of stopping at least a part of the functions by system processing (e.g., turning off the screen) on the condition that the person detection step detects that no object with a predetermined movement (e.g., a face) is present within the detection range FoV for the predetermined detection time and the timing step has completed measurement of the screen-off setting time.

[0098] As a result, when the control method in the information processing device 1 detects that no person is present within the detection range FoV, it starts timing the screen-off setting time before the time required for detection has elapsed, thereby reducing the difference between the time from when the person leaves until control is performed on the system side and the setting time for that control set on the system (OS) side.

[0099] Although the embodiments of the present invention have been described above in detail with reference to the drawings, the specific configurations are not limited to the above-described embodiments, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above-described embodiments can be combined in any manner.

[0100] Furthermore, in the above embodiment, a configuration example in which the imaging unit 120 is built into the information processing device 1 has been described, but the present invention is not limited to this. For example, the imaging unit 120 does not have to be built into the information processing device 1, but may be configured to be attachable to the information processing device 1 (for example, any one of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or via a wire.

[0101] Furthermore, in the above embodiment, the information processing device 1 detects the presence of a person by detecting a facial region in which a face is captured in a captured image. However, the presence of a person may also be detected using a distance measurement sensor that measures the distance to an object. For example, the distance measurement sensor is provided on the inner surface of the first housing 10 and detects objects present within a detection range in the direction facing the inner surface of the first housing 10 (forward). As in the above embodiment, when a distance measurement sensor is used, an object that exhibits a predetermined movement over a predetermined detection time can be detected as a person. As an example, the distance measurement sensor may be a ToF (Time of Flight) sensor that emits infrared rays forward at a predetermined sampling period (for example, 1 Hz), receives reflected light of the emitted infrared rays, and converts the time difference between emission and reception into distance.

[0102] The distance measurement sensor may be a sensor using infrared rays emitted by a light-emitting diode, or a sensor using an infrared laser that emits light rays with a narrower wavelength band than the infrared rays emitted by a light-emitting diode. The distance measurement sensor is not limited to a distance measurement sensor using infrared rays, and any sensor that detects the distance to an object may be used, such as an ultrasonic sensor or a sensor using UWB (Ultra Wide Band) radar. The distance measurement sensor does not have to be built into the information processing device 1, but may be configured as an external accessory that can be attached to the information processing device 1 (for example, any of the side surfaces 10a, 10b, 10c, etc.) and be communicatively connected to the information processing device 1 wirelessly or via a wire. The imaging unit 120 and the distance measurement sensor may be integrated into one unit.

[0103] Furthermore, the CPU 301 (an example of a first processor) and the chipset 303 (an example of a second processor) may be configured as separate processors, or may be integrated into one processor.

[0104] Furthermore, in the above embodiment, an example has been shown in which the face detection unit 320 is provided separately from the main processing unit 300, but part or all of the face detection unit 320 may be configured as being integrated with the main processing unit 300. Part or all of the face detection unit 320 may be provided in any of the processors (CPU 301 or chipset 303) provided in the main processing unit 300, or may be configured as being integrated with any of the processors (CPU 301 or chipset 303) provided in the main processing unit 300. Part or all of the face detection unit 320 may be provided in the EC 200.

[0105] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, and power-off state are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0106] The information processing device 1 described above includes an internal computer system. A program for implementing the functions of each component of the information processing device 1 may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing in each component of the information processing device 1. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computer devices connected via a network, including the Internet, a WAN, a LAN, a dedicated line, or other communication lines. The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built into a computer system. The recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM.

[0107] The recording medium also includes internal or external recording media accessible from a distribution server for distributing the program. The program may be divided into multiple parts, downloaded at different times, and then combined by the components of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be a medium that realizes part of the above-described functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-described functions in combination with a program already stored in the computer system.

[0108] Furthermore, some or all of the functions of the information processing device 1 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.

[0109] Furthermore, the information processing device 1 of the above embodiment is not limited to a PC, a tablet terminal device, a smartphone, or the like, but may also be a game device, a multimedia terminal, or the like. [Explanation of symbols]

[0110] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touchpad, 160 Communication unit, 170 Storage unit, 200 EC, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Detection result acquisition unit, 312 Screen off time setting unit, 313 Screen off timer, 314 Operation control unit, 321 HPD processing unit, 322 Person detection unit, 333 Motion detection timer, 334 Detection result output unit, 400 Power supply unit

Claims

1. a sensor for detecting an object present within a predetermined detection range; a memory for temporarily storing system programs; a processor that executes processing of the system based on the program and processing using the sensor; Equipped with The processor: a person detection process that, when it is detected by the sensor that no object with a predetermined movement is present within the detection range for a first time period, detects that no person is present within the detection range and sets first information indicating that no person is present before the first time period has elapsed; a timing process of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection process; a function stopping process that stops at least a part of the functions of the processing of the system, on the condition that the person detection process detects that no object with a predetermined movement is present within the detection range for the first time period and the timing process has finished measuring the second time period; An information processing device that performs the above.

2. The processor: In the person detection process, if it is detected that an object with a predetermined movement exists within the detection range before the first time period has elapsed, changing the setting from the first information to second information indicating the presence of a person. The information processing device according to claim 1 .

3. The processor: In the person detection process, if it is detected that an object exhibiting a predetermined movement is present within the detection range before the first time period has elapsed, the second time period measured by the timing process is reset. The information processing device according to claim 1 .

4. The processor: When at least a part of the functions performed by the processing of the system is stopped, a display unit is controlled to be turned off. The information processing device according to claim 1 .

5. the first information set by the processor before the first time period has elapsed through the person detection process is a temporary setting for starting measurement of the second time period; When the person detection process detects that no object with a predetermined movement is present within the detection range for the first time period, the detection that the person indicated by the first information is not present is confirmed. The information processing device according to claim 1 .

6. the first time period is a time period determined in the person detection process, the second time period is user configurable in the system; The information processing device according to claim 1 .

7. A control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, comprising: the processor: a person detection step of detecting, when it is detected by the sensor that no object with a predetermined movement is present within the detection range for a first time period, that no person is present within the detection range and setting first information indicating that no person is present before the first time period has elapsed; a timing step of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection step; a function stopping step of stopping at least a part of functions of processing of the system on the condition that the person detecting step detects that no object with a predetermined movement is present within the detection range for the first time period and the timing step has finished measuring the second time period; A control method comprising:

Images