Information processing device and control method

Abstract

To reduce the difference between the time from when a person leaves until control on the system side is performed and the set time of the control set on the system side. [Solution] The information processing device has a sensor for detecting an object present within a specified detection range, and when the sensor detects that an object with a specified movement is not present within the specified detection range for a first time period, it detects that no person is present within the specified detection range and sets first information indicating that no person is present before the first time period has elapsed, and in response to the first information being set, starts measuring a second time period through system processing, and performs a function stop process to stop at least part of the functions performed by the system processing, on condition that it has been detected that no object with a specified movement is present within the specified detection range for the first time period and the measurement of the second time period has ended.

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There is a device that transitions to a usable operating state when a person approaches, and transitions to a standby state in which all functions except for some functions are stopped when the person leaves. For example, Patent Document 1 discloses a technology that uses an infrared sensor to detect the strength of infrared rays to detect whether a person is approaching or has left, and controls the operating state of the device. In addition, in recent years, the detection accuracy when detecting a face from an image has improved due to the development of computer vision and the like. Therefore, face detection has begun to be used instead of detecting a person using an infrared sensor.

[0003] When detecting people using an infrared sensor, a method may be used to exclude non-moving objects from the detection target so that simple objects are not detected as people. On the other hand, when detecting people using face detection, a method may be used to exclude non-moving objects from the detection target because faces on posters and the like may be detected. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-148895 A Summary of the Invention [Problem to be solved by the invention]

[0005] As described above, adding the presence or absence of motion of the detection target to the human detection conditions reduces the possibility of misdetecting an object that is not a human as a human, but on the other hand, it takes a fair amount of time to detect it. The time required for detection varies depending on the environment of the detection target, such as the presence or absence of moving objects other than a human, or whether a poster containing an image of a face is on the wall, but it sometimes takes about 0 to 120 seconds, typically about 40 seconds.

[0006] In recent years, some systems such as Windows (registered trademark) allow users to set the time from when the absence of a person is detected until the display screen is turned off, and the set time until the screen is turned off is displayed. However, since the system control starts timing the set time after the absence of a person is detected, if it takes time to detect the absence of a person, there may be a large difference between the time from when the person actually leaves until the screen is turned off and the set time.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that can reduce the difference between the time it takes for system control to be performed after a person leaves and the set time for that control that is set on the system side. [Means for solving the problem]

[0008] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, wherein the processor performs a person detection process for detecting the absence of a person within the detection range and setting first information indicating the absence of a person before the first time has elapsed when the processor uses the sensor to detect that an object with a predetermined movement is not present within the detection range for a first time period, a timing process for starting to measure a second time period by the system processing in response to the first information being set by the person detection process, and a function stop process for stopping at least a part of the functions of the system processing on condition that the person detection process detects that an object with a predetermined movement is not present within the detection range for the first time period and the measurement of the second time period has ended by the timing process.

[0009] In the above information processing device, the processor may change a setting from the first information to second information indicating the presence of a person when the processor detects, in the person detection process, that an object with a predetermined movement is present within the detection range before the first time has elapsed.

[0010] In the above information processing device, the processor may reset the second time measured by the timing process when it detects in the human detection process that an object with a predetermined movement is present within the detection range before the first time has elapsed.

[0011] In the information processing device, the processor may control a display unit to be turned off when at least a part of functions performed by the processing of the system is stopped.

[0012] In the above-mentioned information processing device, the first information set by the processor before the first time has elapsed by the person detection process may be a temporary setting for starting measurement of the second time, and when the person detection process detects that an object with a predetermined movement is not present within the detection range over the first time, the detection of the absence of the person indicated by the first information may be confirmed.

[0013] In the information processing device, the first time period may be a time period determined in the person detection process, and the second time period may be a time period that can be set by a user in the system.

[0014] In addition, according to a second aspect of the present invention, a control method in an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor includes a person detection step in which, when the processor detects using the sensor that an object with a predetermined movement is not present within the detection range for a first time period, the processor detects that a person is not present within the detection range and sets first information indicating that a person is not present before the first time period has elapsed, a timing step in which, in response to the first information being set by the person detection step, the processor starts measuring a second time period by the processing of the system, and, on condition that the person detection step detects that an object with a predetermined movement is not present within the detection range for the first time period and the measurement of the second time period has been completed by the timing step, the processor stops at least a part of the functions of the processing of the system. Effect of the Invention

[0015] According to the above-described aspect of the present invention, it is possible to reduce the difference between the time until control on the system side is performed after a person leaves the room and the set time for that control that is set on the system side. [Brief description of the drawings]

[0016] [Figure 1] 4 is a view for explaining an overview of HPD processing of the information processing device according to the embodiment. [Diagram 2] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to an embodiment. [Diagram 3] 5 is a diagram showing an example of a person detection range of the information processing device according to the embodiment. [Figure 4] 6A and 6B are diagrams showing an example of a screen-off process when a person's departure is detected according to the embodiment. [Diagram 5] FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 6] FIG. 1 is a schematic block diagram showing an example of a functional configuration of an information processing apparatus according to an embodiment. [Figure 7] 11 is a flowchart showing an example of a process when a person leaving the image capturing apparatus according to the embodiment is detected. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [overview] First, an overview of an information processing device 1 according to the first embodiment will be described. The information processing device 1 according to this embodiment is, for example, a notebook PC (Personal Computer). Note that the information processing device 1 may be any type of information processing device, such as a desktop PC, a tablet terminal device, or a smartphone.

[0018] The information processing device 1 can transition between at least a normal operation state (power-on state) and a standby state as the operating state of the system. The normal operation state is an operating state in which processing can be executed without any particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface). The standby state is a state in which at least a part of the functions by the processing of the system is restricted. For example, the standby state is a state in which at least the display unit is turned off (screen off). Screen off refers to the display being stopped and the display screen being turned off (not displayed), and the brightness of the screen is minimum (zero). The brightness of the screen of the display unit in the normal operation state before the screen is turned off is hereinafter referred to as "standard brightness".

[0019] The waiting state may be a standby state, a sleep state, etc., and may be a state equivalent to modern standby in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI.

[0020] In the following, the transition of the system's operating state from the standby state to the normal operating state may be referred to as "activation." In the standby state, the activity of the operation is generally lower than in the normal operating state, so activating the system of the information processing device 1 activates the operation of the system in the information processing device 1.

[0021] FIG. 1 is a diagram for explaining an outline of the HPD process of the information processing device 1 according to the present embodiment. The information processing device 1 detects a person (i.e., a user) existing in the vicinity of the information processing device 1. This person detection process for detecting the presence of a person is called HPD (Human Presence Detection) process. The information processing device 1 detects the presence or absence of a person by the HPD process, and controls the operation state of the system of the information processing device 1 based on the detection result. For example, as shown in FIG. 1(A), when the information processing device 1 detects a change from a state in which no person is present in front of the information processing device 1 (Absence) to a state in which a person is present (Presence), that is, when it detects that a person has approached the information processing device 1 (Approach), it determines that a user has approached, automatically starts the system, and transitions to a normal operation state. Also, as shown in FIG. 1(B), when a person is present in front of the information processing device 1 (Presence), it determines that a user is present, and continues the normal operation state. Then, when the information processing device 1 detects a change from a state in which a person is present (Presence) in front of the information processing device 1 (front) to a state in which a person is not present (Absence), that is, when the information processing device 1 detects that the person has left the information processing device 1 (Leave), as shown in Figure 1 (C), it determines that the user has left, turns off the screen, and transitions the system to a standby state.

[0022] [External configuration of information processing device] FIG. 2 is a perspective view showing an example of the external configuration of the information processing device 1 according to the present embodiment. The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis defined by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0023] The first housing 10 is also called the A cover or the display housing. The second housing 20 is also called the C cover or the system housing. In the following description, the sides of the first housing 10 and the second housing 20 on which the hinge mechanism 15 is provided are called the sides 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 opposite the sides 10c and 20c are called the sides 10a and 20a, respectively. In the drawings, the direction from the side 20a to the side 20c is called the "rear", and the direction from the side 20c to the side 20a is called the "front". The right and left sides of the rear are called the "right" and "left", respectively. The left sides of the first housing 10 and the second housing 20 are called the sides 10b and 20b, respectively, and the right sides are called the sides 10d and 20d, respectively. Moreover, a state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as a "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Moreover, a state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as an "open state."

[0024] The external appearance of the information processing device 1 shown in FIG. 2 shows an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0025] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. An imaging unit 120 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the imaging unit 120 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the imaging unit 120 is disposed is merely an example, and the imaging unit 120 may be disposed in another location as long as it can face in a direction (forward) facing the inner surface of the first housing 10.

[0026] In the open state, the imaging unit 120 captures an image of a predetermined imaging range in a direction (forward) facing the inner surface of the first housing 10. The predetermined imaging range is a range of an angle of view determined by an imaging element of the imaging unit 120 and an optical lens provided in front of the imaging surface of the imaging element. For example, the imaging unit 120 can capture an image including a person present in front of the information processing device 1 (on the front side).

[0027] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct the power to be turned on or off, to transition from a standby state to a normal operation state, or to transition from a normal operation state to a standby state. A keyboard 151 and a touch pad 153 are provided on the inner surface of the second housing 20 as input devices for accepting user operation inputs. Note that, as the input devices, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided, or a mouse or an external keyboard may be connected. In the case of a configuration in which a touch sensor is provided, an area corresponding to the display surface of the display unit 110 may be configured as a touch panel for accepting operations. The input device may also include a microphone into which voice is input.

[0028] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 and the imaging unit 120 provided on the inner surface of the first housing 10, and the keyboard 151 and the touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing, and are unable to function.

[0029] The information processing device 1 detects the presence of a person within a predetermined range ahead (on the front side). FIG. 3 is a diagram showing an example of a person detection range of the information processing device 1 according to this embodiment. In the illustrated example, a detection range FoV (Field of View: detection viewing angle) in front of the information processing device 1 is a range in which a person can be detected. For example, the information processing device 1 detects a face area in which a face is captured from a captured image capturing the front (front side) to determine whether or not a person (user) is present in front of (in front of) the information processing device 1. The detection range FoV corresponds to an imaging angle of view captured by the information processing device 1. When a face area is detected from the captured image, the information processing device 1 determines that a user is present. On the other hand, when a face area is not detected from the captured image, the information processing device 1 determines that a user is not present.

[0030] Here, when the information processing device 1 detects a face area from a captured image, it determines whether or not there is movement in the detected face area so as not to detect a face such as a poster, and excludes objects that do not move from the detection target of a person. Note that if there is movement of a magnitude or speed far exceeding the normal shaking or movement of a person (user) using the information processing device 1, it is also excluded from the detection target of a person. In this way, the information processing device 1 detects whether or not a person exists in the detection range FoV by not only detecting a face area from a captured image but also determining whether or not there is a predetermined movement in the detected face area (face). That is, the information processing device 1 detects whether or not a person exists in the detection range FoV depending on whether or not an object (e.g., a face) with a predetermined movement exists in the detection range FoV.

[0031] It takes time depending on the situation to determine the presence or absence of movement and detect the presence or absence of a person. For example, when a poster including an image of a face is captured within the detection range FoV, the detection tends to take time. For example, if the information processing device 1 takes about 40 seconds to detect that a person has left, it will take about 40 seconds from when the person actually leaves until it detects that the person has left by HPD processing.

[0032] On the other hand, in the settings on the OS (Operating System) side, such as Windows (registered trademark), the time from when the absence of a person is detected until the screen of the display unit 110 is turned off can be set, and the set time until the screen is turned off is displayed. The measurement of the set time on the OS side starts after the absence of a person is detected. For example, if the set time is set to 30 seconds, if the measurement of the set time starts after the person's departure is detected (after the absence of a person is detected), it will take about 70 seconds from when the person actually leaves until the screen is turned off. In that case, the difference from the set time (30 seconds) is large, which may cause the user to feel uncomfortable or recall a malfunction, and is therefore not preferable.

[0033] Therefore, even if it takes time (for example, about 40 seconds) to detect a person's leaving, the information processing device 1 according to this embodiment notifies the OS side that the person is not present before the time has elapsed, assuming that the person has left during detection. This makes it possible to speed up the start of displaying the set time on the OS side, shorten the time from when the person actually leaves until the screen is turned off, and reduce the difference from the set time (30 seconds).

[0034] 4 is a diagram showing an example of screen-off processing when a person leaves according to this embodiment. In this diagram, the horizontal axis represents time (t), and the system operation, user state, HPD processing, and system processing (processing on the OS side) when a person leaves are detected are shown in chronological order.

[0035] At time t0, the user is present in front of the information processing device 1 (detection range FoV). The information processing device 1 is in a normal operating state, and the screen brightness of the display unit 110 is standard brightness. The information processing device 1 detects the presence of a person within the detection range FoV by HPD processing, and sets "Presence=True" as the detection result of the HPD processing.

[0036] When the user leaves at time t1, the information processing device 1 goes into a state where no object with a predetermined movement is detected within the detection range FoV (No motion) through HPD processing, and starts counting the time that this state continues (hereinafter referred to as the "motion detection timer"). The motion detection timer is reset every time an object with a predetermined movement is detected.

[0037] When the motion detection timer ends its counting without detecting an object with a predetermined movement within the detection range FoV by the HPD process (time t3), the information processing device 1 detects that the person has left (Leaves). That is, when the information processing device 1 detects that an object with a predetermined movement does not exist within the detection range FoV over a detection time (e.g., 40 seconds) measured by the motion detection timer, it detects that no person exists within the detection range FoV.

[0038] Furthermore, the information processing device 1 sets the detection result of the HPD process to "Presence=False" indicating that no person is present at time t2, before detecting that the person has left at time t3. Time t2 is set, for example, 10 seconds after the motion detection timer starts timing at time t1. In other words, when the information processing device 1 detects that no object with a predetermined movement is present within the detection range FoV for 10 seconds, it sets "Presence=False" before confirming that the person has left.

[0039] In response to "Presence=False" being set by the HPD processing, the information processing device 1 starts measuring the set time until the screen is turned off by system processing (processing on the OS side). The timer that measures the set time until the screen is turned off (screen off set time) is called the "screen off timer." The screen off timer is reset without timing when "Presence=True" is set, and starts timing when "Presence=False" is set.

[0040] Then, the information processing device 1 turns off the screen by system processing at time t4 and transitions to a standby state on the condition that after time t3 when it is confirmed that the person has left (Leave) and the measurement of the screen-off timer has ended. In this way, when the information processing device 1 is in a state where it does not detect an object with a predetermined movement (No motion), it starts timing the screen-off timer from time t2 before it detects (confirms) that the person has left (Leave) at time t3, so that it is possible to reduce the difference from the screen-off set time compared to the case where it starts timing the screen-off timer from time t3. For example, when the screen-off set time is set to 30 seconds, if it starts timing the screen-off timer from time t3, the time from when the person actually leaves until the screen is turned off is 70 seconds. In contrast, the information processing device 1 turns off the screen after the person actually leaves for 40 seconds, so that it is preferable that it is possible to reduce the difference from the screen-off set time.

[0041] Furthermore, after "Presence=False" is set at time t2, if an object with a predetermined movement is detected within the detection range FoV by HPD processing until time t3, the setting is changed to "Presence=True" and the motion detection timer is reset. As a result, even if the information processing device 1 sets "Presence=False" before detecting (confirming) that a person has left (Leave), if the person has not left (if the presence of a person is detected), the setting is returned to "Presence=True", so that the screen is not erroneously turned off even if the person has not left.

[0042] The time from time t1 to time t2 is set as the minimum time for detecting a state in which no object with a predetermined movement is detected (No motion), and although 10 seconds has been described as an example, it is not limited to 10 seconds. The time from time t1 to time t2 may be shorter than the time from time t1 to time t3. However, the shorter the time from time t1 to time t2, the greater the effect of reducing the difference between the time from when a person actually leaves until the screen is turned off and the screen-off setting time. Even if the time from time t1 to time t2 is shortened, there is no problem because if an object with a predetermined movement is detected between time t2 and time t3, the setting is returned to "Presence=True."

[0043] Moreover, it is preferable that the time from time t1 to time t3 (detection time) is set to the same time as the screen-off setting time or to a time shorter than the screen-off setting time, so that the screen-off timer does not end before detecting (confirming) that a person has left.

[0044] [Hardware configuration of information processing device] Fig. 5 is a schematic block diagram showing an example of a hardware configuration of the information processing device 1 according to this embodiment. In Fig. 5, the same reference numerals are used for components corresponding to those in Fig. 2. The information processing device 1 includes a display unit 110, an imaging unit 120, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a main processing unit 300, a face detection unit 320, and a power supply unit 400.

[0045] The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0046] The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in a direction (forward) facing the inner surface of the first housing 10, and outputs the captured image to the main processing unit 300 and the face detection unit 320. For example, the imaging unit 120 is a visible light camera (RGB camera) that captures images using visible light. The imaging unit 120 may further include an infrared camera (IR camera) that captures images using infrared light.

[0047] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0048] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0049] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), a RAM, a ROM, etc. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0050] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into a voltage required by each unit. The power whose voltage has been converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0051] The EC200 is a microcomputer including a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and an input / output (I / O) logic circuit. The CPU of the EC200 reads a control program (firmware) prestored in its own ROM, and executes the read control program to fulfill its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to a power button 140, an input device 150, a power supply unit 400, and the like.

[0052] For example, the EC 200 communicates with the power supply unit 400 to obtain information on the battery state (such as remaining capacity) from the power supply unit 400 and outputs control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1 to the power supply unit 400. The EC 200 also obtains operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to the processing of the main processing unit 300 among the obtained operation signals.

[0053] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0054] The CPU 301 executes processes based on BIOS programs, processes based on OS programs, processes based on application programs running on the OS, etc. The CPU 301 controls the operating state of the system under control of the chipset 303. For example, the CPU 301 executes a startup process that transitions the operating state of the system from a standby state to a normal operating state. The CPU 301 also executes a process that transitions the operating state of the system from the normal operating state to a standby state by putting the display unit 110 into sleep-off mode.

[0055] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing and generates display data under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110.

[0056] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls input and output of data from the communication unit 160, the display unit 110, and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires detection results by face detection processing acquired from the face detection unit 320. For example, the chipset 303 executes HPD processing for detecting a person (user) based on information acquired from the face detection unit 320.

[0057] The system memory 304 is used as a reading area for the programs executed by the CPU 301, a working area for writing processing data, etc. The system memory 304 also temporarily stores image data of images captured by the imaging unit 120.

[0058] The CPU 301, GPU 302, and chipset 303 may be configured as a single integrated processor, or some or each may be configured as individual processors. For example, in a normal operation state, the CPU 301, GPU 302, and chipset 303 are all in operation, but in a standby state, at least a part of the chipset 303 is in operation. In the standby state, at least the functions necessary for the HPD processing at the time of startup are in operation.

[0059] The face detection unit 320 includes a processor that processes image data of the captured image captured by the imaging unit 120. The face detection unit 320 acquires image data of the captured image captured by the imaging unit 120, and temporarily stores the acquired image data in a memory. The memory that stores the image data may be the system memory 304, or may be a memory that is included in the face detection unit 320 and is connected to the processor.

[0060] For example, the face detection section 320 processes image data of a captured image acquired from the imaging section 120 to perform face detection processing for detecting a face area from the captured image, and processing based on the detection results of the face detection processing.

[0061] [Functional configuration of information processing device] Next, the functional configuration relating to the HPD process in the information processing device 1 will be described in detail.

[0062] 6 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a system processing unit 310 and an HPD processing unit 321.

[0063] The HPD processing unit 321 is a functional configuration that executes HPD processing (human detection processing) through processing by the face detection unit 320, or processing by the face detection unit 320 and the chipset 303. For example, the HPD processing unit 321 includes a human detection unit 322, a motion detection timer 333, and a detection result output unit 334.

[0064] The person detection unit 322 detects whether or not a person is present within the detection range FoV based on a face area detected from a captured image acquired from the imaging unit 120. For example, the person detection unit 322 detects whether or not an object (here, a face area) with a predetermined movement is present within the detection range FoV using the imaging unit 120. If a face area with a predetermined movement is present, the person detection unit 322 detects that a person is present within the detection range FoV. When the person detection unit 322 detects that a person is present within the detection range FoV, it sets "Presence=True" as the detection result.

[0065] On the other hand, when the human detection unit 322 detects that a face area with a predetermined movement does not exist for a predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4), it detects that no human exists within the detection range FoV. At this time, the human detection unit 322 measures the predetermined detection time using the motion detection timer 333.

[0066] Here, when detecting that a face area does not exist within the detection range FoV, the person detection unit 322 sets "Presence=False" before a predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) has elapsed (for example, time t2 in FIG. 4). This "Presence=False" set by the person detection unit 322 before the predetermined detection time has elapsed is a temporary setting for starting measurement of the screen-off setting time. Then, when the person detection unit 322 detects that a face area with a predetermined movement does not exist within the detection range FoV over the predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) (for example, time t3 in FIG. 4), the detection of the absence of a person indicated by "Presence=False" is confirmed.

[0067] After setting "Presence=False", if the person detection unit 322 detects the presence of a face area with a predetermined movement within the detection range FoV before the predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) has elapsed, the setting is changed from "Presence=False" to "Presence=True." This predetermined detection time is a time determined in the HPD process.

[0068] In addition, after setting "Presence=False", if the human detection unit 322 detects the presence of a face area with a predetermined movement within the detection range FoV before the predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) has elapsed, the human detection unit 322 resets the time measured by the motion detection timer 333.

[0069] As described with reference to FIG. 4, the motion detection timer 333 is a timer that measures the above-mentioned predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4).

[0070] The detection result output section 334 outputs “Presence=True” or “Presence=False” set as the detection result of the person detection section 322 to the system processing section 310 .

[0071] The system processing unit 310 is a functional configuration realized by executing system processing of the OS by the CPU 301. For example, the system processing unit 310 includes a detection result acquisition unit 311, a screen-off time setting unit 312, a screen-off timer 313, and an operation control unit 314 as functional configurations realized by the processing of the OS.

[0072] The detection result acquisition unit 311 acquires “Presence=True” or “Presence=False” output from the HPD processing unit 321 .

[0073] The screen-off time setting unit 312 sets the screen-off time based on a user's operation, etc. For example, the screen-off time can be set by the user in the system settings of the OS.

[0074] When the detection result acquisition unit 311 acquires "Presence=False", the screen-off timer 313 starts measuring the screen-off set time (for example, the time from time t2 to time t4 in FIG. 4) set by the screen-off time setting unit 312. That is, in response to "Presence=False" being set by the person detection unit 322, the screen-off timer 313 starts measuring the screen-off set time by system processing.

[0075] The operation control unit 314 controls the system processing (operation state, etc.) based on the detection result of the HPD processing. For example, the operation control unit 314 stops at least a part of the functions by the system processing on the condition that the human detection unit 322 detects that a face area with a predetermined movement does not exist within the detection range FoV for a predetermined detection time (for example, the time from time t1 to time t3 in FIG. 4) and the screen-off timer 313 finishes measuring the screen-off setting time (for example, the time from time t2 to time t4 in FIG. 4). As an example, when the operation control unit 314 stops at least a part of the functions by the system processing, the operation control unit 314 controls the display unit 110 to turn off the screen and transitions to a standby state.

[0076] [Processing behavior when detecting a person leaving the scene] Next, with reference to FIG. 7, a description will be given of the operation of the processing when the information processing device 1 detects a person's departure through the HPD control processing.

[0077] 7 is a flowchart showing an example of processing when detecting the departure of a person according to this embodiment. Here, it is assumed that the information processing device 1 is in a normal operating state and is set to "Presence=True."

[0078] (Step S101) The HPD processing unit 321 resets the motion detection timer 333 and starts measuring the detection time. Then, the process proceeds to step S103.

[0079] (Step S103) The HPD processing unit 321 detects whether or not an object with a predetermined movement (here, a face region) is present within the detection range FoV. Then, the HPD processing unit 321 judges whether or not an object with a predetermined movement (here, a face region) is detected within the detection range FoV during the 10 seconds of detection measured by the motion detection timer 333. If the HPD processing unit 321 judges that an object with a predetermined movement (here, a face region) is detected (YES), the process returns to step S101. On the other hand, if the HPD processing unit 321 judges that an object with a predetermined movement (here, a face region) is not detected (NO), the process proceeds to step S105.

[0080] (Step S105) The HPD processing unit 321 sets "Presence=False" (temporary setting) and outputs it to the system processing unit 310 in order to start timing of the screen-off timer 313. Then, the process proceeds to step S107.

[0081] (Step S107) When the system processing unit 310 acquires "Presence=False" output from the HPD processing unit 321, it resets the screen-off timer 313 and starts measuring the screen-off set time. Then, the process proceeds to step S109.

[0082] (Step S109) Following the process of step S103, the HPD processing unit 321 determines whether or not an object with a predetermined movement (here, a face region) has been detected within the detection range FoV during the 30 seconds of detection measured by the motion detection timer 333. If the HPD processing unit 321 determines that an object with a predetermined movement (here, a face region) has been detected (YES), the process proceeds to the process of step S111, and after changing the setting to "Presence=True", returns to the process of step S101. On the other hand, if the HPD processing unit 321 determines that an object with a predetermined movement (here, a face region) has not been detected (NO), the process confirms the detection that no person is present ("Presence=False"), and proceeds to the process of step S113.

[0083] (Step S113) When the system processing unit 310 ends the measurement of the screen-off set time by the screen-off timer 313, the process proceeds to step S115.

[0084] (Step S113) System processing unit 310 turns off the screen of display unit 110 and transitions to a standby state.

[0085] [Summary of the embodiment] As described above, the information processing device 1 according to the present embodiment includes an imaging unit 120 (an example of a sensor) for detecting an object (e.g., a face) present within a predetermined detection range FoV, a system memory 304 (an example of a memory) for temporarily storing a program of a system (e.g., an OS), and a processor (e.g., a CPU 301, a chipset 303, a face detection unit 320, etc.) for executing system processing based on the program and processing using the imaging unit 120. When the information processing device 1 detects that a predetermined moving object (e.g., a face) does not exist within the detection range FoV for a predetermined detection time (an example of a first time) using the imaging unit 120, the information processing device 1 detects that a person does not exist within the detection range FoV and performs HPD processing (person detection processing) for setting "Presence=False" (an example of first information) indicating that a person does not exist before the predetermined detection time has elapsed. In addition, the information processing device 1 performs a timekeeping process for starting measurement of a screen-off setting time (an example of a second time) by system processing in response to "Presence=False" being set by the HPD processing. Then, the information processing device 1 performs a function stop process to stop at least a part of the functions of the system processing (e.g., screen off) on condition that the HPD processing detects that no object (e.g., a face) with a predetermined movement is present within the detection range FoV for a predetermined detection time and the timing processing has ended measuring the screen off setting time.

[0086] As a result, when the information processing device 1 detects that no person is present within the detection range FoV, it starts timing the screen off setting time before the time required for detection has elapsed, thereby reducing the difference between the time from when the person leaves until control on the system side is performed and the setting time for that control set on the system (OS) side.

[0087] In addition, in the above-mentioned HPD processing, if the information processing device 1 detects the presence of an object (e.g., a face) with a predetermined movement within the detection range FoV before a predetermined detection time has elapsed, it changes the setting from "Presence=False" to "Presence=True" (an example of second information) indicating the presence of a person.

[0088] As a result, when the information processing device 1 detects that a person is not present within the detection range FoV, if the presence of a person is detected before the time required for detection has elapsed, the information processing device 1 can correctly detect the presence of a person.

[0089] In addition, in the above-mentioned HPD processing, if the information processing device 1 detects the presence of an object (e.g., a face) with a predetermined movement within the detection range FoV before a predetermined detection time has elapsed, it resets the screen-off setting time measured by the above-mentioned timing processing.

[0090] As a result, when the information processing device 1 detects that no person is present within the detection range FoV, if the presence of a person is detected before the time required for detection has elapsed, the information processing device 1 can correctly control the display unit 110 so as not to turn off the screen.

[0091] Furthermore, when at least a part of the functions of the system processing is stopped, the information processing device 1 controls the display unit 110 to turn off the screen.

[0092] As a result, when a person leaves the information processing device 1, the display unit 110 is turned off to reduce power consumption. Furthermore, when a person leaves the information processing device 1, the content displayed on the display unit 110 becomes invisible to others, improving security.

[0093] Here, "Presence=False" set by the information processing device 1 before the predetermined detection time has elapsed by the HPD process is a temporary setting for starting the measurement of the screen-off setting time. Also, when the HPD process detects that an object (e.g., a face) with a predetermined movement does not exist within the detection range FoV for the predetermined detection time, the detection of the absence of a person indicated by "Presence=False" is confirmed.

[0094] As a result, when the information processing device 1 detects that no person is present within the detection range FoV, it can start timing the screen-off setting time without waiting for the detection to be confirmed by provisionally setting "Presence=False" before the time required for detection has elapsed. Therefore, the information processing device 1 can reduce the difference between the time from when a person leaves until control on the system side is performed and the setting time of the control set on the system (OS) side.

[0095] The predetermined detection time is a time determined in the above-mentioned HPD processing, and the screen-off setting time can be set by the user in the system.

[0096] This enables the information processing device 1 to suppress the influence on the user caused by the discrepancy between the detection time in the HPD process and the screen-off setting time set by the user on the system (OS) side.

[0097] Further, according to the present embodiment, a control method in an information processing device 1 including an image capturing unit 120 (an example of a sensor) for detecting an object (e.g., a face) existing within a predetermined detection range FoV, a system memory 304 (an example of a memory) for temporarily storing a program of a system (e.g., an OS), and a processor (e.g., a CPU 301, a chipset 303, a face detection unit 320, etc.) for executing processing of the system based on the program and processing using the image capturing unit 120 includes the steps of: detecting that a person does not exist within the detection range FoV when the processor detects that a moving object (e.g., a face) does not exist within the detection range FoV using the image capturing unit 120 for a predetermined detection time (an example of a first time). Both methods include a person detection step of setting "Presence=False" (an example of first information) indicating that no person is present before a predetermined detection time has elapsed, a timing step of starting measurement of a screen-off set time (an example of a second time) by system processing in response to "Presence=False" being set by the person detection step, and a function stopping step of stopping at least a part of the functions by the system processing (e.g., turning off the screen) on condition that the person detection step detects that no object with a predetermined movement (e.g., a face) is present within the detection range FoV for the predetermined detection time and the timing step has ended measurement of the screen-off set time.

[0098] As a result, when the control method in the information processing device 1 detects that no person is present within the detection range FoV, it starts timing the screen off setting time before the time required for detection has elapsed, thereby reducing the difference between the time from when the person leaves until control on the system side is performed and the setting time for that control set on the system (OS) side.

[0099] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiment can be combined in any combination.

[0100] In the above embodiment, the configuration example in which the imaging unit 120 is built into the information processing device 1 has been described, but the present invention is not limited to this. For example, the imaging unit 120 does not have to be built into the information processing device 1, and may be configured to be attachable to the information processing device 1 (for example, any one of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or via a wire.

[0101] In the above embodiment, the information processing device 1 detects the presence of a person by detecting a face area in which a face is captured from a captured image, but the presence of a person may be detected using a distance measuring sensor that measures the distance to an object. For example, the distance measuring sensor is provided on the inner surface side of the first housing 10 and detects an object that exists within a detection range in a direction (forward) facing the inner surface of the first housing 10. In the case of using the distance measuring sensor, an object that has a predetermined movement over a predetermined detection time can be detected as a person, as in the above embodiment. As an example, the distance measuring sensor may be a ToF (Time of Flight) type sensor that emits infrared rays forward at a predetermined sampling period (for example, 1 Hz) and receives the reflected light of the emitted infrared rays, thereby converting the time difference from emission to reception into distance.

[0102] The distance measuring sensor may be a sensor using infrared light emitted by a light emitting diode, or a sensor using an infrared laser that emits light with a narrower wavelength band than the infrared light emitted by a light emitting diode. The distance measuring sensor is not limited to a distance measuring sensor using infrared light, and may be a sensor using other methods such as an ultrasonic sensor or a sensor using UWB (Ultra Wide Band) radar, as long as it detects the distance to an object. The distance measuring sensor does not have to be built into the information processing device 1, and may be configured to be attachable to the information processing device 1 (for example, any of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or by wire. The imaging unit 120 and the distance measuring sensor may be configured integrally.

[0103] Furthermore, the CPU 301 (an example of a first processor) and the chipset 303 (an example of a second processor) may be configured as separate processors, or may be integrated into a single processor.

[0104] In the above embodiment, an example has been shown in which the face detection unit 320 is provided separately from the main processing unit 300, but a part or all of the face detection unit 320 may be configured to be integrated with the main processing unit 300. In addition, a part or all of the face detection unit 320 may be provided in any processor (CPU 301 or chipset 303) provided in the main processing unit 300, or may be configured to be integrated with any processor (CPU 301 or chipset 303) provided in the main processing unit 300. In addition, a part or all of the face detection unit 320 may be provided in the EC 200.

[0105] The above-mentioned standby state may include a hibernation state, a power-off state, etc. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Among the standby states, the standby state, sleep state, hibernation state, power-off state, etc. are states in which power consumption is lower (states in which power consumption is reduced) than in the normal operating state.

[0106] The information processing device 1 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0107] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0108] In addition, some or all of the functions of the information processing device 1 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used.

[0109] Furthermore, the information processing device 1 of the above embodiment is not limited to a PC, a tablet terminal device, a smartphone, or the like, but may be a game device, a multimedia terminal, or the like. [Explanation of symbols]

[0110] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 120 Imaging unit, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Storage unit, 200 EC, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Detection result acquisition unit, 312 Screen off time setting unit, 313 Screen off timer, 314 Operation control unit, 321 HPD processing unit, 322 Person detection unit, 333 Motion detection timer, 334 Detection result output unit, 400 Power supply unit

Claims

1. A sensor for detecting an object present within a predetermined detection range; A memory for temporarily storing system programs; a processor that executes processing of the system based on the program and processing using the sensor; Equipped with The processor, a person detection process for detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, notifying that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a timing process of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection process; a function stopping process for stopping at least a part of the functions of the processing of the system, on condition that the human detection process detects that no object with a predetermined movement is present within the detection range for the first time period and the timing process ends the measurement of the second time period; Do the following: in the person detection process, when it is detected that an object having a predetermined movement is present within the detection range before the first time period has elapsed, changing a setting from the first information to second information indicating the presence of a person; Information processing device.

2. A sensor for detecting an object present within a predetermined detection range; A memory for temporarily storing system programs; a processor that executes processing of the system based on the program and processing using the sensor; Equipped with The processor, a person detection process for detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, notifying that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a timing process of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection process; a function stopping process for stopping at least a part of the functions of the processing of the system, on condition that the human detection process detects that no object with a predetermined movement is present within the detection range for the first time period and the timing process ends the measurement of the second time period; Do the following: resetting the second time measured by the timing process when it is detected in the human detection process that an object having a predetermined movement is present within the detection range before the first time has elapsed; Information processing device.

3. A sensor for detecting an object present within a predetermined detection range; A memory for temporarily storing system programs; a processor that executes processing of the system based on the program and processing using the sensor; Equipped with The processor, a person detection process for detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, notifying that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a timing process of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection process; a function stopping process for stopping at least a part of the functions of the processing of the system, on condition that the human detection process detects that no object with a predetermined movement is present within the detection range for the first time period and the timing process ends the measurement of the second time period; Do the following: the first information set by the processor before the first time period has elapsed through the human detection process is a provisional setting for starting measurement of the second time period; When the person detection process detects that an object having a predetermined movement is not present within the detection range for the first time period, the detection that the person indicated by the first information is not present is confirmed. Information processing device.

4. A sensor for detecting an object present within a predetermined detection range; A memory for temporarily storing system programs; a processor that executes processing of the system based on the program and processing using the sensor; Equipped with The processor, a person detection process for detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, notifying that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a timing process of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection process; a function stopping process for stopping at least a part of the functions of the processing of the system, on condition that the human detection process detects that no object with a predetermined movement is present within the detection range for the first time period and the timing process ends the measurement of the second time period; Do the following: the first time is a time determined in the person detection process, the second time period is configurable by a user in the system; Information processing device.

5. A control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, comprising: The processor, a person detection step of detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a time measurement step of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection step; a function stopping step of stopping at least a part of functions of the processing of the system, on condition that the human detection step detects that no object with a predetermined movement is present within the detection range for the first time period and the timing step ends the measurement of the second time period; Including, in the person detection step, when it is detected that an object having a predetermined movement is present within the detection range before the first time period has elapsed, changing a setting from the first information to second information indicating the presence of a person; Control methods.

6. A control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, comprising: The processor, a person detection step of detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a time measurement step of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection step; a function stopping step of stopping at least a part of functions of the processing of the system, on condition that the human detection step detects that no object with a predetermined movement is present within the detection range for the first time period and the timing step ends the measurement of the second time period; Including, resetting the second time measured in the time measuring step when it is detected in the person detecting step that an object having a predetermined movement is present within the detection range before the first time has elapsed; Control methods.

7. A control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, comprising: The processor, a person detection step of detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a time measurement step of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection step; a function stopping step of stopping at least a part of functions of the processing of the system, on condition that the human detection step detects that no object with a predetermined movement is present within the detection range for the first time period and the timing step ends the measurement of the second time period; Including, the first information set by the processor before the first time period has elapsed in the human detection step is a provisional setting for starting measurement of the second time period; When it is detected by the human detection step that an object having a predetermined movement is not present within the detection range for the first time period, the detection that the human indicated by the first information is not present is confirmed. Control methods.

8. A control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, a memory for temporarily storing a system program, and a processor for executing processing of the system based on the program and processing using the sensor, comprising: The processor, a person detection step of detecting, when it is detected by the sensor that an object having a predetermined movement is not present within the detection range for a first time period, that a person is not present within the detection range and setting first information indicating that a person is not present before the first time period has elapsed; a time measurement step of starting measurement of a second time period by processing of the system in response to the first information being set by the person detection step; a function stopping step of stopping at least a part of functions of the processing of the system, on condition that the human detection step detects that no object with a predetermined movement is present within the detection range for the first time period and the timing step ends the measurement of the second time period; Including, the first time is a time determined in the person detection step, the second time period is configurable by a user in the system; Control methods.

Images