Information processing device and control method

By introducing multi-mode detection and facial direction detection in the information processing equipment, the unnecessary standby problem caused by the non-human departure trigger event is solved, and more efficient power utilization and rapid response to the existence or departure of the human body is achieved.

JP7629136B1Active Publication Date: 2025-02-12LENOVO (SINGAPORE) PTE LTD

Patent Information

Application Number
JP2024109110
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-07-05
Publication Date
2025-02-12
Estimated Expiration
2044-07-05

AI Technical Summary

Technical Problem

In the prior art, when the device detects that a person leaves and enters the standby state, it is prone to waste time due to temporary or misdetection, and may mistakenly turn into the standby state due to triggering events of non-person leaves, resulting in unnecessary power consumption and user experience degradation.

Method used

An information processing device and control method are adopted to dynamically adjust the detection mode by detecting the presence and movement of the object, combined with facial direction detection, to reduce unnecessary standby conversion. The device includes multiple detection modes: presence detection mode, motion detection mode and low power standby mode, using ToF sensor to detect the presence of a human body and adjust the power state according to the face direction.

Benefits of technology

It effectively avoids unnecessary standby conversion caused by non-human departure triggering events, improves the power utilization efficiency and user experience of the equipment, and ensures rapid response to human existence or departure when necessary.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007629136000001_ABST
    Figure 0007629136000001_ABST
Patent Text Reader

Abstract

To suppress unnecessary activation by a person detection process when a transition to a standby state is made by a trigger other than the detection of a person's departure. [Solution] The information processing device has a detection process having a first detection mode that transitions to the second detection mode when it is determined that a person is no longer present, a second detection mode that returns to the first detection mode if movement of an object is detected within a certain period of time and transitions to the third detection mode if movement of an object is not detected within the certain period of time, and a third detection mode that detects objects with low power consumption, and when control is performed to the first operating state or a second operating state with lower power consumption than the first operating state based on a trigger of a process other than the detection process, if it is determined that a person is present in the first detection mode, the detection time in the second detection mode is changed to 0, and if it is determined that a person is no longer present in the first detection mode, the detection process transitions to the third detection mode without waiting for the certain period of time.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There are devices that automatically start the system or transition to a standby state by detecting the approach or departure of a person using a distance sensor (ranging sensor) that detects distance using infrared rays or the like (for example, Patent Document 1). For example, when a person's departure is detected in a device in a normal operating state, the screen is turned off after a certain period of time has passed and the device transitions to a standby state. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-102151 A Summary of the Invention [Problem to be solved by the invention]

[0004] As described above, by providing a waiting time from when the departure of a person is detected until the transition to the standby state, when the departure of a person is temporary or a false detection, it is possible to detect a person and return to the normal operation state before the standby state is unnecessarily entered. In general, in the normal operation state, in order to improve the detection performance of a person, the movement of an object detected using a distance sensor is detected and it is determined whether or not it is a person. However, since low power consumption is desirable in the standby state, the movement of the object is not detected and only the presence or absence of an object is detected at a low frame rate to detect a person. In contrast, during the waiting time from when the departure of a person is detected in the normal operation state until the transition to the standby state, the detection performance of a person in the normal operation state is maintained and the movement of an object is detected, and if the movement of an object is detected, it is determined that a person is present and the state is returned to the normal operation state, so that it is possible to suppress an unnecessary transition to the standby state.

[0005] However, the standby state may be transitioned to by a trigger other than the detection of the person's departure. For example, as a function of the OS (Operating System), there is a function (so-called sleep function) that turns off the screen and transitions to the standby state when a preset time has elapsed without any input from the user. Also, the standby state may be transitioned to by the user performing an operation for transitioning to the standby state (operation of the power button, operation to instruct sleep, etc.). In this way, when the standby state is transitioned to by a trigger other than the detection of the person's departure, the presence of a person may be detected in the person detection process, and when the person's departure is detected thereafter, the movement of an object is detected for a certain standby time, so that the device may be started even if a person other than the user crosses during that time. This startup is not preferable because the standby state is transitioned to by a trigger other than the detection of the person's departure.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that prevent unnecessary startup due to person detection processing when a transition to a standby state is made due to a trigger other than the detection of a person leaving. [Means for solving the problem]

[0007] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention includes a sensor for detecting an object present within a predetermined detection range, and a processor for controlling an operation state of the system to a first operation state or a second operation state with lower power consumption than the first operation state, wherein the processor detects an object present within the detection range using the sensor, determines the presence or absence of a person within the detection range based on the detection result, and transitions to a second detection mode when it is determined that no person is present within the detection range, the second detection mode returns to the first detection mode when the sensor detects movement of an object within the detection range within a certain period of time, and transitions to a third detection mode when no movement of an object is detected within the detection range within the certain period of time, and detects an object present within the detection range with lower power consumption than the first detection mode and the second detection mode. a first operation control process for continuing the first operation state if the detection process transitions from the first detection mode to the second detection mode and returning to the first detection mode within the certain time period in the detection process, and for controlling to the second operation state if the detection process transitions to the third detection mode; and a second operation control process for controlling to the first operation state or the second operation state based on a trigger of a process different from the detection process. When the first operation state is controlled to the second operation state by the second operation control process, if it is determined that a person is present within the detection range in the first detection mode in the detection process, the detection time in the second detection mode is changed from the certain time period to 0, and if it is determined that a person is no longer present within the detection range in the first detection mode, the detection process transitions to the third detection mode without waiting for the certain time period.

[0008] In the above-mentioned information processing device, when the processor controls from the first operating state to the second operating state by the second operation control process, if the processor is in the second detection mode in the detection process, it may transition to the third detection mode without waiting for the certain period of time.

[0009] In the above-mentioned information processing device, the processor may control from the first operating state to the second operating state by the second operation control process when a predetermined time has elapsed without any user input, or when there is a user input to transition to the second operating state.

[0010] In the above information processing device, when the processor is controlled from the second operating state to the first operating state, if the detection time in the second detection mode in the detection process is changed to 0, the processor may return it to the fixed time.

[0011] In the above information processing device, the processor may control from the second operating state to the first operating state by the second operation control process when there is a user input to transition to the first operating state.

[0012] In the above-mentioned information processing device, the processor may transition from the third detection mode to the first detection mode due to determining in the detection process that a person is present within the detection range in the third detection mode, and when the detection process transitions from the third detection mode to the first detection mode, control from the second operation state to the first operation state by the first operation control process.

[0013] In the above information processing device, when the processor determines in the detection process that a person is present within the detection range in the third detection mode, it may transition from the third detection mode to the first detection mode based on the direction of the person's face.

[0014] In the information processing device, the second operating state may be a state in which at least a screen of a display unit is turned off.

[0015] According to a second aspect of the present invention, there is provided a control method for an information processing device including a sensor for detecting an object present within a predetermined detection range and a processor for controlling an operation state of the system to a first operation state or a second operation state with lower power consumption than the first operation state, the control method including: a first detection mode in which the processor detects an object present within the detection range using the sensor, determines the presence or absence of a person within the detection range based on the detection result, and transitions to a second detection mode when it is determined that no person is present within the detection range; the second detection mode in which the processor returns to the first detection mode when it detects the movement of an object within the detection range using the sensor within a certain period of time, and transitions to a third detection mode when no movement of an object is detected within the detection range within the certain period of time; and the third detection mode in which the processor detects an object present within the detection range with lower power consumption than the first detection mode and the second detection mode. a first operation control step of continuing the first operation state if the operation mode returns to the first detection mode within the certain time even if the operation mode transitions from the first detection mode to the second detection mode in the detection step while the operation state is being controlled to the first operation state, and controlling to the second operation state if the operation mode transitions to the third detection mode in the detection step; and a second operation control step of controlling to the first operation state or the second operation state based on a trigger of a process different from the detection step, wherein when the operation state is controlled to the second operation state by the second operation control step, if it is determined in the detection step that a person is present within the detection range in the first detection mode, the detection time in the second detection mode is changed from the certain time to 0, and if it is determined that a person is no longer present within the detection range in the first detection mode, the detection mode is transitioned to the third detection mode without waiting for the certain time. Effect of the Invention

[0016] According to the above-described aspect of the present invention, when a transition to a standby state is made by a trigger other than the detection of a person leaving, it is possible to prevent unnecessary activation by a person detection process. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a perspective view showing an example of the external configuration of an information processing apparatus according to an embodiment. [Diagram 2] 5 is a diagram showing an example of a person detection range of the information processing device according to the embodiment. [Diagram 3] 4A to 4C are explanatory diagrams of a method for determining a face direction according to an embodiment. [Figure 4] 6A to 6C are diagrams showing an example of transition of detection modes in the HPD process according to the embodiment. [Diagram 5] 5A to 5C are views showing an example of HPD processing according to the embodiment. [Figure 6] FIG. 11 is a diagram showing a first example of the HPD processing when transitioning to a standby state is made by a trigger other than the HPD processing according to the embodiment. [Figure 7] FIG. 13 is a diagram showing a second example of the HPD processing when transitioning to a standby state is made by a trigger other than the HPD processing according to the embodiment. [Figure 8] FIG. 1 is a schematic block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 9] FIG. 1 is a schematic block diagram showing an example of a functional configuration of an information processing apparatus according to an embodiment. [Figure 10] 10 is a flowchart showing an example of processing for a motion detection mode in the HPD processing according to the embodiment. [Figure 11] 11 is a flowchart showing an example of a process of restoring a value of a motion detection timer in the HPD process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First, an overview of an information processing device 1 according to this embodiment will be described. [overview] 1 is a perspective view showing an example of the external configuration of an information processing device 1 according to this embodiment. The information processing device 1 is, for example, a notebook PC (Personal Computer).

[0019] The information processing device 1 is, for example, a notebook (clamshell) type PC (Personal Computer). The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are connected using the hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis formed by the hinge mechanism 15. The opening angle resulting from the rotation of the first housing 10 and the second housing 20 is illustrated as "θ".

[0020] The first housing 10 is also called the A cover or the display housing. The second housing 20 is also called the C cover or the system housing. In the following description, the sides of the first housing 10 and the second housing 20 on which the hinge mechanism 15 is provided are called the sides 10c and 20c, respectively. The sides of the first housing 10 and the second housing 20 on the opposite sides to the sides 10c and 20c are called the sides 10a and 20a, respectively. In the drawings, the direction from the side 20a to the side 20c is called the "rear" and the direction from the side 20c to the side 20a is called the "front". In addition, when looking forward from the information processing device 1, the direction toward the right is called the "right side" and the direction toward the left is called the "left side". The right side of the first housing 10 and the second housing 20 is called the side 10b and 20b, respectively, and the left side is called the side 10d and 20d, respectively. Moreover, a state in which the first housing 10 and the second housing 20 overlap and are completely closed (a state in which the opening angle θ=0°) is referred to as a "closed state." In the closed state, the surfaces of the first housing 10 and the second housing 20 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." Moreover, a state in which the first housing 10 and the second housing 20 are open relative to the closed state is referred to as an "open state."

[0021] The external appearance of the information processing device 1 shown in FIG. 1 shows an example of an open state. In the open state, the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined depending on the range of angles that can be rotated by the hinge mechanism 15, etc.

[0022] A display unit 110 is provided on the inner surface of the first housing 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. A ToF sensor 130 is provided in a peripheral region of the display unit 110 on the inner surface of the first housing 10. For example, the ToF sensor 130 is disposed on the side surface 20a side of the peripheral region of the display unit 110. Note that the position where the ToF sensor 130 is disposed is merely an example, and the ToF sensor 130 may be disposed in another location as long as it can face in a direction facing the display screen of the display unit 110.

[0023] The ToF sensor 130 is a distance measurement sensor that measures the distance to an object (e.g., a person) that exists in a direction facing the display screen of the display unit 110 (i.e., in front of the information processing device 1). For example, the ToF sensor 130 includes a light emitting unit that emits infrared rays and a light receiving unit that receives the reflected light of the emitted infrared rays that are reflected back from the surface of the object. The ToF sensor 130 emits infrared rays forward at a predetermined sampling period (e.g., 1 Hz) and receives the reflected light of the emitted infrared rays, thereby outputting a distance measurement signal corresponding to the distance to the object (e.g., a person) using a ToF (Time of Flight) method that converts the time difference from emission to reception into distance by receiving the reflected light of the emitted infrared rays.

[0024] A power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator for the user to instruct power on or off, transition from a standby state to a normal operation state, transition from the normal operation state to a standby state, etc. The normal operation state is an operation state of the system in which processing can be executed without particular restrictions, and corresponds to, for example, the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0025] The standby state is a state in which at least a part of the system processing is restricted, and in which power consumption is lower than in the normal operation state. For example, the standby state is a state in which at least the screen of the display unit 110 is turned off (hereinafter referred to as "screen off"), and may be a state equivalent to modern standby in Windows (registered trademark) or S3 (sleep) defined by ACPI.

[0026] Further, on the inner surface of the second housing 20, a keyboard 151 and a touch pad 153 are provided as input devices (HID: Human Interface Device) that accept user operation input. Note that, instead of or in addition to the keyboard 151 and the touch pad 153, a touch sensor may be provided as the input device, or a mouse or an external keyboard may be connected. In the case of a configuration in which a touch sensor is provided, an area corresponding to the display screen of the display unit 110 may be configured as a touch panel that accepts operations. Furthermore, the input device may include a microphone into which voice is input.

[0027] In addition, when the first housing 10 and the second housing 20 are in a closed state, the display unit 110 provided on the inner surface of the first housing 10 and the keyboard 151 and touchpad 153 provided on the inner surface of the second housing 20 are covered by the surface of the other housing and cannot function.

[0028] The information processing device 1 executes a human presence detection (HPD) process to detect a person present in front of the information processing device 1, based on the distance measurement signal output by the ToF sensor .

[0029] 2 is a diagram showing an example of a distance measurement range of the ToF sensor 130 according to the present embodiment. In the open state, the ToF sensor 130 arranged on the inner surface of the first housing 10 measures the distance to an object (e.g., a person) in a direction (forward) facing the inner surface of the first housing 10. The ToF sensor 130 is a distance measurement sensor for detecting a person (e.g., a user) present in front, and the detection range for detecting a person is called a detection range FoV (Field of View: detection viewing angle). The detection range FoV corresponds to an angular range in which the ToF sensor 130 can measure distances.

[0030] For example, the ToF sensor 130 divides the detection range FoV into measurement units of 8×8 squares, and measures distance for each square (measurement unit). Note that since the purpose is to detect a person (user) using the information processing device 1, distances to objects that are a certain distance or more (for example, 2 m) away may be excluded from the distance measurement targets. Note that distances to objects that are too far away for infrared rays to reach cannot be measured in the first place.

[0031] Furthermore, the information processing device 1 detects the movement of an object detected within the detection range FoV (motion detection) in order to distinguish a person from objects other than a person. When the detected object is moving, the information processing device 1 can also determine that the detected object is a person.

[0032] The information processing device 1 controls the operation state of the system of the information processing device 1 according to the presence or absence of a person by HPD processing. For example, when the information processing device 1 detects that a person approaches the information processing device 1 and is in front (Presence=True), it starts up the system and controls it to a normal operation state. Also, when a person leaves the information processing device 1 and is no longer detected in front (Presence=False), the information processing device 1 controls it to a standby state.

[0033] Furthermore, when the information processing device 1 detects the presence of a person in front of the information processing device 1, the information processing device 1 detects the direction of the person's face based on the distance measurement signal output by the ToF sensor 130. For example, the information processing device 1 determines whether the person's face is facing the direction of the information processing device 1 (the direction of the display unit 110). Here, a state in which the person's face is facing the direction of the information processing device 1 (the direction of the display unit 110) (a state in which the face is facing forward with respect to the information processing device 1) is a state in which the person is paying attention to the information processing device 1. On the other hand, a state in which the person's face is not facing the direction of the information processing device 1 (the direction of the display unit 110) (a state in which the face is facing left, right, up, or down with respect to the information processing device 1 and is not facing forward with respect to the information processing device 1) is a state in which the person is not paying attention to the information processing device 1.

[0034] For example, the information processing device 1 may control the startup of the system and control (dimming control) the screen brightness of the display unit 110 based on the determination result of the face direction. Specifically, when the face is not facing forward (when the user is not paying attention to the information processing device 1), the information processing device 1 saves power by lowering the screen brightness of the display unit 110. When the face is again facing forward (when the user is paying attention to the information processing device 1), the information processing device 1 returns the screen brightness to the original level before lowering it.

[0035] (How to determine face direction) Here, a method for determining the face direction based on the distance measurement signal output from the ToF sensor 130 will be described. In this embodiment, the information processing device 1 determines the face direction as the front, left, right, up, or down. The left-right direction is the face direction in the horizontal direction corresponding to the rotation direction about a vertical axis passing through the center of the face. The up-down direction is the face direction in the vertical direction corresponding to the rotation direction about a horizontal axis passing through the center of the face.

[0036] FIG. 3 is an explanatory diagram of a method for determining the face direction according to this embodiment. In this diagram, the detection range FoV is divided into 64 measurement units of 8×8 squares, and an example of a distance measurement value for each square (measurement unit) is shown by a number in each square. For example, the distance measurement value of each square is a distance measurement value measured by the ToF sensor 130 at a predetermined period (for example, at intervals of 1 second). Since a person moves to some extent, the distance measurement value of each square is constantly fluctuating. Therefore, in order to obtain a highly reliable distance measurement value, the distance measurement value measured at a predetermined period (for example, at intervals of 1 second) may be time-averaged.

[0037] In this diagram, the distance measurement values ​​shown in numbers within each square are in millimeters. In the example shown, squares with distance values ​​between 450 and 610 are the range in which people are present. Squares with distance values ​​of 1000 or more are distance measurements of objects on the ceiling or behind people. Squares with no distance values ​​displayed are squares where the object is too far away to measure.

[0038] The range of a person has a characteristic that the edge of the range is generally mountain-shaped, and the width of the part of the torso above the shoulders is shorter than the shoulder width. For example, when the edge of the range of squares where the distance measurement value is obtained within 1 m (1000 mm) and the difference is small (here, about 450 to 610) becomes mountain-shaped with the characteristics of a person, the information processing device 1 detects the range as the range of a person (i.e., detects the presence of a person). In the illustrated example, the six squares lined up in the horizontal direction (left-right direction) from the square marked SL (Shoulder Left) to the square marked SR (Shoulder Right) correspond to the shoulder range (shoulder width), and the width of the part above the shoulder range is shorter than the shoulder width.

[0039] Furthermore, the information processing device 1 detects a narrow range above the shoulder range as the face range. For example, the information processing device 1 detects a 3 (horizontal) x 4 (vertical) square above the shoulder range within the person's range as the face range. The size of this face range corresponds to the face range of a person present at a distance where the information processing device 1 is being used (where a keyboard is being operated) when distance measurement is performed with a detection range FoV of 8 x 8 squares.

[0040] The information processing device 1 may detect the 3×3 squares above the shoulder area of ​​the person's range as the face area. When the detection range FoV is measured using a measurement unit other than 8×8 squares, the face area is also set to a range that matches the number of measurement units, instead of 3×4 squares or 3×3 squares.

[0041] As shown in the figure, the central square in the face area is regarded as the center of the face, and the distance measurement value of the square above the central square marked FT (Face Top) is regarded as the distance measurement value of the upper part of the face (forehead position). The distance measurement value of the square below the central square marked FB (Face Bottom) is regarded as the distance measurement value of the lower part of the face (chin position). The distance measurement value of the square to the left of the central square marked FL (Face Left) is regarded as the distance measurement value of the left part of the face. The distance measurement value of the square to the right of the central square marked FR (Face Right) is regarded as the distance measurement value of the left part of the face.

[0042] If the face area is 3x3 squares, the center square of the 3x3 squares will be the square in the center of the 3x3 squares, but if the face area is 3 (horizontal) x 4 (vertical) squares, it will be either the square in the center column of the second row or the mast in the center column of the third row. Here, the lower square (the square in the third row) is given priority as the center square.

[0043] The upper cell (cell in the second row) may be prioritized as the center cell. Also, the distance measurements of both cells may be tracked, and the cell with the smaller distance measurement may be prioritized as the center cell, or the cell with the largest amount of variation (amount of movement) in the distance measurement may be prioritized as the center cell.

[0044] The information processing device 1 determines the orientation of the face based on the distance measurement values ​​of the upper, lower, left, and right parts of the face. For example, the information processing device 1 determines the orientation of the face in the vertical direction (up and down direction) based on the difference between the distance measurement values ​​of the upper and lower parts of the face. The information processing device 1 also determines the orientation of the face in the horizontal direction (left and right direction) based on the difference between the distance measurement values ​​of the left and right parts of the face.

[0045] For example, when the difference between the distance measurement value of the upper part of the face and the distance measurement value of the lower part is equal to or greater than a predetermined threshold value and the distance measurement value of the upper part of the face is smaller than the distance measurement value of the lower part of the face, the information processing device 1 determines that the face is facing downward. On the other hand, when the difference between the distance measurement value of the upper part of the face and the distance measurement value of the lower part of the face is equal to or greater than a predetermined threshold value and the distance measurement value of the lower part of the face is smaller than the distance measurement value of the upper part of the face, the information processing device 1 determines that the face is facing upward.

[0046] Furthermore, when the difference between the distance measurement value of the left part of the face and the distance measurement value of the right part is equal to or greater than a predetermined threshold value and the distance measurement value of the left part of the face is smaller than the distance measurement value of the right part, the information processing device 1 determines that the face is facing right. On the other hand, when the difference between the distance measurement value of the left part of the face and the distance measurement value of the right part of the face is equal to or greater than a predetermined threshold value and the distance measurement value of the right part of the face is smaller than the distance measurement value of the left part, the information processing device 1 determines that the face is facing left.

[0047] Furthermore, when the difference between the distance measurement value of the upper part and the distance measurement value of the lower part of the face is less than a predetermined threshold value and the difference between the distance measurement value of the left part and the distance measurement value of the right part of the face is less than a predetermined threshold value, the information processing device 1 determines that the face is facing forward. In this way, the information processing device 1 determines whether the face is facing upward or downward, left or right, or forward, based on the distance measurement values ​​of the upper, lower, left, and right parts of the face, thereby determining the face orientation.

[0048] The information processing device 1 may determine the vertical (up-down) and horizontal (left-right) orientation of the face depending on which of the upper, lower, left, and right parts of the face has the smallest distance measurement value. The information processing device 1 may also determine that the face is facing forward when the difference between the distance measurement values ​​of the upper, lower, left, and right parts of the face is less than a predetermined threshold.

[0049] (Control of detection mode in HPD processing) The information processing device 1 controls the operating state of the system according to the detection result of the HPD processing, and also changes the detection mode in the HPD processing. For example, when performing HPD processing in a normal operating state, the information processing device 1 detects both the movement of an object and the direction of a face when detecting a person, but in a standby state, it detects only the presence or absence of an object at a low frame rate without detecting the movement of an object or the direction of a face, thereby reducing power consumption.

[0050] FIG. 4 is a diagram showing an example of transition of detection modes in the HPD process according to the present embodiment. In a normal operation state, the HPD process is performed in a presence detection mode. The presence detection mode is a detection mode in which, for example, when detecting a person, processing is performed with high power consumption (for example, 30 mW) to detect both the movement of an object and the direction of a face. For example, the presence detection mode detects an object present in the detection range FoV using the ToF sensor 130, and determines the presence or absence of a person in the detection range FoV based on the detection result. Specifically, the presence detection mode transitions to a motion detection mode when it is determined that a person is absent from a state in which a person is present in the detection range FoV (Presence=True) (Presence=False).

[0051] The motion detection mode is a detection mode in which, when the absence of a person is detected in the presence detection mode, the device does not immediately transition to a standby state, but transitions to the standby state after the absence of a person is detected for a certain period of time. This motion detection mode is provided to wait for transition to the standby state so that, when the absence (departure) of a person is temporary or is a false detection, the device can detect a person and return to the normal operating state before going into standby state unnecessarily, and is a detection mode in which processing is performed with high power consumption (e.g., 30 mW) like the presence detection mode.

[0052] For example, in the motion detection mode, if the ToF sensor 130 detects the movement of an object within the detection range FoV for a certain period of time, it is determined that a person is present within the detection range FoV (Presence=True) and the mode returns to the presence detection mode. In addition, in the motion detection mode, if no movement of an object is detected within the detection range FoV for a certain period of time, the mode transitions to a sleep mode. Hereinafter, the timer that times the above-mentioned certain period of time in this motion detection mode is referred to as a "motion detection timer." The motion detection timer is set to, for example, 30 seconds.

[0053] When the normal operation state is transitioned to the standby state (screen off), the HPD process is performed in the sleep mode. The sleep mode is a detection mode that detects an object present within the detection range FoV with low power consumption (for example, 1 mW) compared to the presence detection mode and the motion detection mode. The sleep mode detects only the presence or absence of an object within the detection range FoV at a low frame rate, and does not detect the movement of the object or determine the direction of the face. In other words, the sleep mode is a detection mode that detects the approach of a person from a state where a person has left and is absent (Presence = False) by simply detecting the presence or absence of an object within the detection range FoV. Due to the determination that a person is present within the detection range FoV in the sleep mode (detection of the approach of a person), the system transitions to the presence detection mode, and the system is controlled from the standby state to the normal operation state.

[0054] Note that when the approach of a person is detected in the sleep mode, the device may transition to the presence detection mode and be controlled from the standby state to the normal operation state; however, the example shown in FIG. 4 shows an example in which the device not only detects the approach of a person but also determines the direction of the person's face before controlling the device to the normal operation state.

[0055] For example, if the approach of a person is detected in sleep mode, the system temporarily transitions to attention wake mode. Attention wake mode is a detection mode that consumes high power (e.g., 30 mW) like the presence detection mode, and also determines the facial direction of a person detected within the detection range FoV. In presence detection mode, only a person whose face is facing forward (a person who is paying attention to the information processing device 1) is determined to be a user, transitioning to presence detection mode, and the system is started up and controlled to a normal operating state. On the other hand, if the departure of a person is detected in attention wake mode, the system returns to sleep mode.

[0056] Next, the HPD processing when the system transitions to a standby state in response to detection of a person's leaving will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the HPD processing according to this embodiment. In this diagram, the horizontal axis represents time (t), and the system operation, user state, and HPD processing are shown in chronological order.

[0057] At time t0, the user is present in front of the information processing device 1 (within the detection range FoV). The information processing device 1 is in a normal operating state, and the screen brightness of the display unit 110 is standard brightness. The information processing device 1 is executing HPD processing in a presence detection mode, detects the presence of a person within the detection range FoV, and sets "Presence=True" as the detection result of the HPD processing.

[0058] When the user leaves at time t1, the information processing device 1 no longer detects a person (moving object) within the detection range FoV through HPD processing. At time t2, the information processing device 1 determines that the person is no longer present, sets the detection result of the HPD processing to "Presence=False", and transitions to a motion detection mode. In addition, when the information processing device 1 transitions to the motion detection mode, it starts timing a motion detection timer.

[0059] In the motion detection mode, if the information processing device 1 detects the movement of an object within the detection range FoV before the time count of the motion detection timer (e.g., 30 seconds) expires, it determines that a person is present within the detection range FoV, sets "Presence=True" as the detection result of the HPD process, and returns to the presence detection mode. On the other hand, in the motion detection mode, if the information processing device 1 does not detect the movement of an object within the detection range FoV before the time count of the motion detection timer (e.g., 30 seconds) expires, it transitions to a sleep mode at time t3 and transitions the system to a standby state (screen off).

[0060] Here, there are other triggers for transitioning to the standby state besides the detection of a person's departure by the HPD process as shown in Fig. 6. An example of a trigger for transitioning to the standby state other than the HPD process is a function of the OS that turns off the screen and transitions to the standby state when a preset time has elapsed without any user input (HID input) (so-called sleep function). In addition, transition to the standby state may occur when the user performs an operation for transitioning to the standby state (such as operating the power button or issuing a sleep command).

[0061] In this way, when the device transitions to the standby state due to a trigger other than the HPD process, there may be cases where the presence of a person is detected by the HPD process (Presence = True). At this time, the device is operating in the presence detection mode, and when a person's departure (Leave) is detected, the device transitions to the motion detection mode in the conventional HPD process as shown in Fig. 5. In the motion detection mode, a process is performed to detect the movement of an object and return to the normal operation state, so that there is an advantage in that the device does not transition to the standby state unnecessarily when the device transitions to the standby state due to the person's departure (Leave) as a trigger as shown in Fig. 5. However, when the device transitions to the standby state due to a trigger other than the HPD process, there is a concern that if a person's departure (Leave) is detected and the device transitions to the motion detection mode, the device may detect the movement of an object and start up unnecessarily even if the person only crosses the road.

[0062] Therefore, when the information processing device 1 according to this embodiment transitions to the standby state, if it is determined in the HPD process that the presence of a person is detected in the presence detection mode, the information processing device 1 changes the motion detection time in the motion detection mode to 0. As a result, when it is determined in the presence detection mode that a person is no longer present (Presence=False), the information processing device 1 transitions to the sleep mode without transitioning to the motion detection mode. A comparison of the conventional process and the process of this embodiment at this time is shown in FIG. 6.

[0063] Fig. 6 is a diagram showing a first example of HPD processing when transitioning to a standby state is made by a trigger other than the HPD processing according to this embodiment. In this diagram, similar to Fig. 5, the horizontal axis represents time (t) and the system operation, user state, and HPD processing are shown in chronological order, with (A) showing the conventional processing and (B) showing the processing according to this embodiment.

[0064] At time t10, the user is present in front of the information processing device 1 (within the detection range FoV). The information processing device 1 is in a normal operating state, and the screen brightness of the display unit 110 is standard brightness. The information processing device 1 is executing HPD processing in a presence detection mode, detects the presence of a person within the detection range FoV, and sets "Presence=True" as the detection result of the HPD processing.

[0065] At time t11, the information processing device 1 transitions to a standby state (screen off) due to a trigger other than the HPD processing, such as a sleep function of the OS or an operation for transitioning to a standby state (such as an operation of the power button or an operation to instruct sleep). At this time, the information processing device 1 continues to execute the HPD processing in the presence detection mode, and when the user leaves at time t12, the information processing device 1 no longer detects a person (a moving object) within the detection range FoV by the HPD processing. At time t13, the information processing device 1 determines that a person is no longer present, and sets the detection result of the HPD processing to "Presence = False" (time t13).

[0066] In the conventional process shown in (A), the information processing device 1 transitions to the motion detection mode at time t13, and transitions to the sleep mode at time t15 after the motion detection timer (e.g., 30 seconds) has finished timing. Therefore, if the information processing device 1 detects the movement of an object within the detection range FoV before the motion detection timer (e.g., 30 seconds) has finished timing, it determines that a person is present within the detection range FoV (Presence=True) and starts up the system. Therefore, there is a concern that the information processing device 1 may detect the movement of an object and start up unnecessarily, for example, even if a person merely crosses the road.

[0067] Therefore, as shown in (B), when the information processing device 1 according to this embodiment transitions to a standby state (screen off) with the detection result of the HPD process being "Presence=True" (time t11), the information processing device 1 changes the motion detection timer to 0. As a result, when it is determined in the presence detection mode that a person is no longer present (Presence=False) (time t13), the information processing device 1 transitions to the sleep mode without transitioning to the motion detection mode, thereby preventing unnecessary activation.

[0068] The example shown in Figure 6 is an example of HPD processing when a transition to a standby state is made by a trigger other than HPD processing during presence detection mode. Next, HPD processing when a transition to a standby state is made by a trigger other than HPD processing during motion detection mode will be described with reference to Figure 7.

[0069] Fig. 7 is a diagram showing a second example of HPD processing when transitioning to a standby state is made by a trigger other than the HPD processing according to this embodiment. In this diagram, similar to Fig. 6, the horizontal axis represents time (t) and the system operation, user state, and HPD processing are shown in chronological order, with (A) showing the conventional processing and (B) showing the processing according to this embodiment.

[0070] In the conventional processing shown in (A), the information processing device 1 transitions to the motion detection mode at time t13, and transitions to the sleep mode at time t15 after the motion detection timer (e.g., 30 seconds) has finished timing, but assume that the information processing device 1 transitions to the standby state (screen off) at time t14 before the motion detection timer has finished timing due to a trigger other than the HPD processing. In this case, there is a concern that the information processing device 1 may detect the movement of an object, for example, even if a person just passes by, and start up unnecessarily between times t14 and t15.

[0071] Therefore, in the information processing device 1 of this embodiment, when the information processing device 1 transitions to a standby state due to a trigger other than HPD processing at time t14 during motion detection mode, as shown in (B), it transitions from the motion detection mode to a sleep mode at that point in time, thereby preventing unnecessary startup.

[0072] [Hardware configuration of information processing device] Fig. 8 is a schematic block diagram showing an example of a hardware configuration of the information processing device 1 according to the present embodiment. In Fig. 7, the same reference numerals are used for components corresponding to those in Fig. 1. The information processing device 1 includes a display unit 110, a ToF sensor 130, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a main processing unit 300, and a power supply unit 400.

[0073] The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of application programs running on the system processing.

[0074] As described above, the ToF sensor 130 is a distance measurement sensor that uses the ToF method to measure the distance to an object (e.g., a person) that exists in front. For example, the ToF sensor 130 outputs a distance measurement signal including a distance measurement value that measures the distance to an object (e.g., a person) that exists in the detection range FoV in the direction facing the inner surface of the first housing 10 (forward).

[0075] The power button 140 outputs an operation signal to the EC 200 in response to a user operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to accepting an operation on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC 200.

[0076] The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0077] The storage unit 170 includes storage media such as a hard disk drive (HDD), a solid state drive (SSD), a RAM, a ROM, etc. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data acquired by the operation of the programs.

[0078] The power supply unit 400 supplies power to each unit according to the operating state of each unit of the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of direct current power supplied from an AC (Alternate Current) / DC adapter or a battery (battery pack) into a voltage required by each unit. The power whose voltage has been converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

[0079] The EC200 is a microcomputer including a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and an input / output (I / O) logic circuit. The CPU of the EC200 reads a control program (firmware) prestored in its own ROM, and executes the read control program to fulfill its functions. The EC200 operates independently of the main processing unit 300, controls the operation of the main processing unit 300, and manages its operating state. The EC200 is also connected to a power button 140, an input device 150, a power supply unit 400, and the like.

[0080] For example, the EC 200 communicates with the power supply unit 400 to obtain information on the battery state (such as remaining capacity) from the power supply unit 400 and outputs control signals and the like for controlling the supply of power according to the operating state of each unit of the information processing device 1 to the power supply unit 400. The EC 200 also obtains operation signals from the power button 140 and the input device 150, and outputs to the main processing unit 300 operation signals related to the processing of the main processing unit 300 among the obtained operation signals.

[0081] The main processing unit 300 is composed of a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304, and is capable of executing processing of various application programs on an OS (Operating System) through system processing based on the OS.

[0082] CPU 301 is a processor that executes processes based on BIOS programs, processes based on OS programs, processes based on application programs that run on the OS, etc. For example, CPU 301 executes a startup process that starts the system from a standby state and transitions it to a normal operating state, a sleep process that transitions it from the normal operating state to a standby state, etc. CPU 301 also executes a screen brightness control process that controls the screen brightness of display unit 110 based on the above-mentioned face direction determination result, etc.

[0083] The GPU 302 is connected to the display unit 110. The GPU 302 executes image processing and generates display data under the control of the CPU 301. The GPU 302 outputs the generated display data to the display unit 110.

[0084] The chipset 303 has a function as a memory controller and a function as an I / O controller. For example, the chipset 303 controls the reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. The chipset 303 also controls the input and output of data from the communication unit 160, the display unit 110, and the EC 200. The chipset 303 also has a function as a sensor hub. For example, the chipset 303 acquires a ranging signal output from the ToF sensor 130 and executes various processes such as HPD processing.

[0085] The system memory 304 is used as a reading area for the programs executed by the CPU 301 and a working area for writing processing data.

[0086] The CPU 301, the GPU 302, and the chipset 303 may be configured as a single integrated processor, or some or each of them may be configured as individual processors. For example, in a normal operation state, the CPU 301, the GPU 302, and the chipset 303 are all in operation, but in a standby state, only at least a part of the chipset 303 is in operation.

[0087] [Functional configuration of information processing device] Next, a detailed description will be given of the functional configuration of the information processing device 1 that controls the operating state of the system in response to the HPD process or a trigger other than the HPD process.

[0088] 9 is a schematic block diagram showing an example of a functional configuration of the information processing device 1 according to this embodiment. The information processing device 1 includes a detection processing unit 210 that performs HPD processing based on a distance measurement signal from the ToF sensor 130, and a system processing unit 310 that performs system processing based on the BIOS and OS programs, the detection results by the detection processing unit 210, and the like.

[0089] The detection processing unit 210 includes a human detection unit 211, a motion detection timer 212, and a detection result output unit 213 as functional components that perform the above-mentioned HPD processing by the CPU 301 or the chipset 303 or the like executing a specific program.

[0090] The human detection unit 211 performs HPD processing to detect or determine the direction of the face of a person within the detection range FoV based on the distance measurement value of the ToF sensor 130. Specifically, the human detection unit 211 performs HPD processing by switching between a presence detection mode, a motion detection mode, a sleep mode, and an attention activation mode.

[0091] In the presence detection mode, the person detection unit 211 detects an object present within the detection range FoV using the ToF sensor 130, and determines whether or not a person is present within the detection range FoV based on the detection result. For example, when the person detection unit 211 determines that a person is no longer present within the detection range FoV in the presence detection mode, the person detection unit 211 transitions to the motion detection mode.

[0092] In the motion detection mode, the person detection unit 211 starts counting the motion detection timer 212 (for example, 30 seconds) in response to a transition to the motion detection mode. The person detection unit 211 detects the movement of an object within the detection range FoV until the counting of the motion detection timer 212 ends. If the object is a person, there is movement (for example, slight movement), so the person detection unit 211 determines that a completely still object is not a person, and detects only objects with movement (for example, slight movement) as a person. For example, the person detection unit 211 determines whether or not the object is moving based on the amount of fluctuation in the distance measurement value of the ToF sensor 130 measured at a predetermined period (for example, one-second intervals).

[0093] For example, the human detection unit 211 returns to the presence detection mode if it detects the movement of an object within the detection range FoV before the time count of the motion detection timer 212 ends in the motion detection mode. Also, the human detection unit 211 transitions to the sleep mode if it does not detect the movement of an object within the detection range FoV before the time count of the motion detection timer 212 ends in the motion detection mode.

[0094] In the sleep mode, the human detection unit 211 detects an object present within the detection range FoV with lower power consumption than in the presence detection mode and the motion detection mode. For example, in the sleep mode, the human detection unit 211 detects only the presence or absence of an object at a low frame rate to detect a person without detecting the movement of the object.

[0095] Furthermore, the human detection unit 211 transitions from the sleep mode to the presence detection mode when it is determined that a human is present within the detection range FoV in the sleep mode. For example, when the information processing device 1 determines that a human is present within the detection range FoV in the sleep mode in the HPD process, it transitions to the attention activation mode. In the attention activation mode, the person detection unit 211 also determines the facial orientation of a person detected within the detection range FoV, and transitions from the sleep mode to the presence detection mode only when the facial orientation is facing forward (the person is looking at the information processing device 1). Note that if the person detection unit 211 detects the departure of a person in the attention activation mode due to the determination that a person is present within the detection range FoV in the sleep mode, the person detection unit 211 returns to the sleep mode.

[0096] Furthermore, when the human detection unit 211 is controlled to change from the normal operation state to the standby state based on a trigger of a process other than the HPD process, if it is determined in the HPD process that a person is present within the detection range FoV in the presence detection mode, it changes the set time of the motion detection timer 212 to 0. As a result, if the human detection unit 211 subsequently determines that a person is no longer present within the detection range FoV in the presence detection mode, it transitions to the sleep mode without waiting for a certain period of time (e.g., 30 seconds) (see FIG. 6(B)).

[0097] In addition, when the information processing device 1 is controlled to change from a normal operating state to a standby state based on a trigger for processing other than the HPD processing, if the information processing device 1 is in motion detection mode in the HPD processing, it ends the timing of the motion detection timer 212 even if it is halfway through, and transitions to sleep mode at that point without waiting for a certain period of time (e.g., 30 seconds) (see FIG. 7(B)).

[0098] When the human detection unit 211 determines that a human is present within the detection range FoV, the detection result output unit 213 sets the detection result of the HPD processing to "Presence = True" and outputs it. Also, when the human detection unit 211 no longer detects a human within the detection range FoV, the detection result output unit 213 sets the detection result to "Presence = False" and outputs it.

[0099] The system processing unit 310 is a functional configuration realized by executing the BIOS and OS programs by the CPU 11. For example, the system processing unit 310 includes an operation control unit 311 and a screen-off timer 312 as functional configurations realized by executing the OS programs.

[0100] The operation control unit 311 performs a first operation control process (operation control process by HPD process) and a second operation control process (operation control process by a process different from the HPD process).

[0101] In the first operation control process, the operation control unit 311 controls the operation state of the system based on the detection result of the HPD process by the detection processing unit 210. For example, in a state where the operation control unit 311 is controlling to the normal operation state, if the operation control unit 311 transitions from the presence detection mode to the motion detection mode in the HPD process but returns to the presence detection mode within a certain period of time, the operation control unit 311 continues the normal operation state, and controls to the standby state when the operation control unit 311 transitions to the sleep mode in the HPD process. Furthermore, when the operation control unit 311 transitions from the sleep mode to the presence detection mode via the attention activation mode by the HPD process, the operation control unit 311 controls to change from the standby state to the normal operation state.

[0102] In addition, in the second operation control process, the operation control unit 311 controls to switch to the normal operation state or the standby state based on a trigger of a process other than the HPD process. For example, when a preset time has elapsed without a user input (HID input), or when a user input (power button operation, sleep instruction operation, etc.) for transitioning to the standby state has been made, the operation control unit 311 controls to switch to the normal operation state or the standby state based on a trigger of a process other than the HPD process. The screen-off timer 312 is a timer for measuring the time without a user input (HID input).

[0103] In addition, when there is a user input (such as operating the power button or instructing startup) to transition to the normal operation state, the operation control unit 311 controls the state to the normal operation state or the standby state based on a trigger for processing other than the HPD processing.

[0104] [HPD processing operation] Next, with reference to FIG. 10, the operation of the motion detection mode in the HPD processing when the normal operation state is changed to the standby state based on a trigger of a process other than the HPD processing described with reference to FIG. 6(B) and FIG. 7(B) will be described.

[0105] FIG. 10 is a flowchart showing an example of processing for the motion detection mode in the HPD processing according to this embodiment.

[0106] (Step S101) When the detection processing unit 210 goes into a standby state based on a trigger of a process other than the HPD process, the detection processing unit 210 determines whether or not a person is present within the detection range FoV (Presence). If the detection processing unit 210 determines that a person is present (Presence=True), the process proceeds to step S103. On the other hand, if the detection processing unit 210 determines that a person is not present (Presence=False), the process proceeds to step S107.

[0107] (Step S103) The detection processing unit 210 saves the current value of the motion detection timer 212. Then, the process proceeds to step S105.

[0108] (Step S105) The detection processing unit 210 changes the value of the motion detection timer 212 to 0, and ends the process.

[0109] (Step S107) The detection processing unit 210 judges whether or not the standby state was entered during the motion detection mode. If the detection processing unit 210 judges that the standby state was entered during the motion detection mode (YES), the process proceeds to step S109. On the other hand, if the detection processing unit 210 judges that the standby state was entered during the motion detection mode (NO), the process ends because the transition from the motion detection mode to the sleep mode has already occurred.

[0110] (Step S109) The detection processing unit 210 transitions from the motion detection mode to the sleep mode.

[0111] Next, the operation of the process of restoring the value of the motion detection timer 212 after changing it to 0 by the process shown in FIG. 10 will be described with reference to FIG.

[0112] FIG. 11 is a flowchart showing an example of a process for restoring the value of the motion detection timer 212 in the HPD process according to this embodiment.

[0113] (Step S201) The detection processing unit 210 judges whether or not the normal operation state (screen on) has been entered in the standby state. If the detection processing unit 210 judges that the normal operation state (screen on) has not been entered (NO), it performs the process of step S201 again. On the other hand, if the detection processing unit 210 judges that the normal operation state (screen on) has been entered (YES), it proceeds to the process of step S203.

[0114] (Step S203) The detection processing unit 210 determines the current value of the motion detection timer 212. If the detection processing unit 210 determines that the current value of the motion detection timer 212 is 0, the process proceeds to step S205, and the value of the motion detection timer 212 is restored to the value saved in step S103 of FIG.

[0115] On the other hand, if the detection processing unit 210 determines in step S203 that the current value of the motion detection timer 212 is greater than 0 (i.e., has not been changed to 0), there is no need to restore the value of the motion detection timer 212, and so the processing ends.

[0116] [Summary of the embodiment] As described above, the information processing device 1 according to the present embodiment includes a ToF sensor 130 (an example of a sensor) for detecting an object present within a predetermined detection range FoV, and a processor (e.g., CPU 301, chipset 303, etc.) for controlling the operation state of the system to a normal operation state (an example of a first operation state) or a standby state (an example of a second operation state) with low power consumption compared to the normal operation state. The information processing device 1 performs HPD processing (an example of a detection processing) having at least a presence detection mode (an example of a first detection mode), a motion detection mode (an example of a second detection mode), and a sleep mode (an example of a third detection mode). For example, in the presence detection mode, the information processing device 1 detects an object present within the detection range FoV using the ToF sensor 130, and determines whether or not a person is present within the detection range FoV based on the detection result. Then, when the information processing device 1 determines in the presence detection mode that a person is no longer present within the detection range FoV, it transitions to the motion detection mode. In addition, in the motion detection mode, when the information processing device 1 detects the movement of an object in the detection range FoV for a certain time (for example, 30 seconds) using the ToF sensor 130, the information processing device 1 returns to the presence detection mode, and when the movement of an object is not detected in the detection range for the certain time, the information processing device 1 transitions to the sleep mode. In addition, the sleep mode is a detection mode for detecting an object present in the detection range FoV with low power consumption compared to the presence detection mode and the motion detection mode. In addition, the information processing device 1 performs a first operation control process (operation control process by HPD process) and a second operation control process (operation control process by a process different from the HPD process). For example, in the first operation control process, when the information processing device 1 is controlled to the normal operation state, even if the presence detection mode transitions from the presence detection mode to the motion detection mode in the HPD process, if the information processing device 1 returns to the presence detection mode within a certain time, the information processing device 1 continues the normal operation state, and when the information processing device 1 transitions to the sleep mode in the HPD process, the information processing device 1 controls to the standby state. In the second operation control process, the information processing device 1 controls to a normal operation state or a standby state based on a trigger of a process other than the HPD process. When the information processing device 1 controls from the normal operation state to the standby state based on a trigger of a process other than the HPD process, if it is determined in the HPD process that a person is present within the detection range FoV in the presence detection mode, the information processing device 1 changes the detection time in the motion detection mode (the set time of the motion detection timer) from a fixed time (e.g., 30 seconds) to 0, and if it is determined that a person is no longer present within the detection range FoV in the presence detection mode, the information processing device 1 transitions to a sleep mode without waiting for the fixed time.

[0117] As a result, when the information processing device 1 transitions to the standby state due to a trigger other than the detection of a person's departure by the HPD process, the information processing device 1 transitions to the sleep mode instead of the motion detection mode even if the information processing device 1 detects a person's departure thereafter, so that it is possible to prevent the information processing device 1 from being unnecessarily started up by the HPD process. Therefore, the information processing device 1 can appropriately control the HPD process.

[0118] In addition, when the information processing device 1 is controlled to change from a normal operating state to a standby state based on a trigger for processing other than the HPD processing, if the information processing device 1 is in motion detection mode in the HPD processing, it transitions to sleep mode without waiting for a certain period of time (e.g., 30 seconds).

[0119] As a result, when the information processing device 1 transitions to the standby state due to a trigger other than the detection of a person's departure by the HPD process, if the information processing device 1 is in the motion detection mode, the motion detection mode is terminated and the device transitions to the sleep mode, so that unnecessary startup by the HPD process can be suppressed. Therefore, the information processing device 1 can appropriately control the HPD process.

[0120] In addition, when a preset time has elapsed without any user input (HID input), or when there is a user input (such as operating the power button or entering sleep mode) to transition to a standby state, the information processing device 1 controls the device to change from a normal operating state to a standby state based on a trigger for processing other than the HPD processing.

[0121] This allows the information processing device 1 to be in a standby state even for processing other than the HPD processing, and even in this case, the HPD processing can be appropriately controlled.

[0122] In addition, when the information processing device 1 is controlled from a standby state to a normal operating state, if the detection time (the set time of the motion detection timer) in the motion detection mode in the HPD processing is changed to 0, it is returned to the above-mentioned fixed time (e.g., 30 seconds).

[0123] As a result, when the information processing device 1 transitions to a standby state due to a trigger other than the detection of a person leaving by HPD processing, even if the information processing device 1 subsequently detects a person leaving, it can change the control so that it transitions to sleep mode instead of transitioning to motion detection mode, and can return to the state without affecting subsequent control.

[0124] Furthermore, when there is an input from the user for transitioning to the normal operation state, the information processing device 1 performs control from the standby state to the normal operation state by a second operation control process (an operation control process separate from the HPD process).

[0125] This allows the information processing device 1 to be started from a standby state even for processing other than the HPD processing, and even in this case, the HPD processing can be appropriately controlled.

[0126] Furthermore, the information processing device 1 transitions from the sleep mode to the presence detection mode due to the determination in the HPD processing that a person is present within the detection range FoV in the sleep mode. Furthermore, when the information processing device 1 transitions from the sleep mode to the presence detection mode by the HPD processing, the information processing device 1 controls from the standby state to the normal operation state by a first operation control processing (operation control processing by the HPD processing).

[0127] This allows the information processing device 1 to be woken up from a standby state due to detection of the approach of a person by the HPD process.

[0128] Furthermore, when the information processing device 1 determines in the HPD process that a person is present within the detection range FoV in the sleep mode, it transitions from the sleep mode to the presence detection mode (attention activation mode) based on the direction of the person's face.

[0129] This enables the information processing device 1 to be woken up from a standby state when the HPD process detects that a person with his / her face facing forward (looking at the information processing device 1) has approached.

[0130] The standby state is a state in which at least the screen of the display unit 110 is turned off (screen off).

[0131] This allows the information processing device 1 to reduce power consumption in a standby state, and also prevents others from viewing the display content on the screen when the user is absent.

[0132] Moreover, the control method in the information processing device 1 according to the present embodiment includes a detection step of detecting an object present within the detection range FoV using the ToF sensor 130 in a presence detection mode (an example of a first detection mode), determining whether or not a person is present within the detection range FoV based on the detection result, and transitioning to a motion detection mode (an example of a second detection mode) when it is determined that no person is present within the detection range FoV; and a step of returning to the presence detection mode when the ToF sensor 130 detects the movement of an object within the detection range FoV within a certain period of time (e.g., 30 seconds) in the motion detection mode, and transitioning to a sleep mode (an example of a third detection mode) when no movement of an object is detected within the detection range FoV within the certain period of time. the detection step of switching the operation mode to the normal operation state or the standby state based on a trigger of a process other than the detection step; a detection step of detecting an object present within the detection range FoV in the sleep mode with low power consumption for the presence detection mode and the motion detection mode; a first operation control step of continuing a normal operation state (an example of the first operation state) if the operation mode returns to the presence detection mode within a certain period of time even if the operation mode transitions from the presence detection mode to the motion detection mode in the detection step, while being controlled to a first operation control process (operation control process by HPD process), and controlling to a standby state (an example of the second operation state) if the operation mode transitions to the sleep mode in the detection step; and a second operation control step of controlling to the normal operation state or the standby state based on a trigger of a process other than the detection step. The control method in the information processing device 1 is such that, when the normal operation state is controlled to the standby state by the second operation control step, if it is determined in the detection step that a person is present within the detection range FoV in the presence detection mode, the detection time in the motion detection mode (the set time of the motion detection timer) is changed from a fixed time (e.g., 30 seconds) to 0, and if it is determined that a person is no longer present within the detection range FoV in the presence detection mode, the device transitions to the sleep mode without waiting for the fixed time. Control methods.

[0133] As a result, the control method in the information processing device 1 is such that when the device transitions to the standby state due to a trigger other than the detection of a person's departure by the HPD process, the device transitions to the sleep mode instead of the motion detection mode even if the device subsequently detects the departure of a person, thereby making it possible to prevent the device from being unnecessarily started up by the HPD process. Therefore, the control method in the information processing device 1 can appropriately control the HPD process.

[0134] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the configurations described in the above embodiment can be combined in any combination.

[0135] In the above embodiment, the configuration example in which the ToF sensor 130 is built into the information processing device 1 has been described, but the present invention is not limited to this. For example, the ToF sensor 130 does not have to be built into the information processing device 1, and may be configured to be attachable to the information processing device 1 (for example, any one of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or via a wire.

[0136] In the above embodiment, the ToF sensor 130 using infrared rays has been described as an example of a distance measurement sensor, but the present invention is not limited thereto. For example, a distance measurement sensor using a laser or ultrasonic waves may be used. Instead of the ToF sensor 130, a camera (imaging unit) may be used to detect the presence or absence of a person within the detection range FoV and to determine the direction of the person's face. In this case, the camera (imaging unit) may be configured to be built into the information processing device 1, or may be configured to be attached to the information processing device 1 (for example, any of the side surfaces 10a, 10b, 10c, etc.) as an external accessory of the information processing device 1, and may be communicatively connected to the information processing device 1 wirelessly or by wire.

[0137] The standby state may include a state in which the screen is locked. The screen is locked in such a way that a preset image (e.g., an image for screen lock) is displayed on the display unit so that the contents being processed cannot be seen, and the device cannot be used until the lock is released (e.g., user authentication).

[0138] The information processing device 1 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.

[0139] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0140] In addition, some or all of the functions of the information processing device 1 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used.

[0141] Furthermore, the information processing device 1 of the above embodiment is not limited to a notebook PC, but may be, for example, a desktop PC, a tablet terminal device, a smartphone, a game device, a multimedia terminal, or the like. [Explanation of symbols]

[0142] 1 Information processing device, 10 First housing, 20 Second housing, 15 Hinge mechanism, 110 Display unit, 130 ToF sensor, 140 Power button, 150 Input device, 151 Keyboard, 153 Touch pad, 160 Communication unit, 170 Memory unit, 200 EC, 210 Detection processing unit, 211 Person detection unit, 212 Motion detection timer, 213 Detection result output unit, 300 Main processing unit, 301 CPU, 302 GPU, 303 Chipset, 304 System memory, 310 System processing unit, 311 Operation control unit, 312 Screen off timer, 400 Power supply unit

Claims

1. A sensor for detecting an object present within a predetermined detection range; a processor that controls an operation state of the system to a first operation state or a second operation state having lower power consumption than the first operation state; Equipped with The processor, a first detection mode for detecting an object present within the detection range using the sensor, determining the presence or absence of a person within the detection range based on the detection result, and transitioning to a second detection mode when it is determined that no person is present within the detection range; the second detection mode for returning to the first detection mode when the sensor detects movement of an object within the detection range within a fixed time period, and transitioning to a third detection mode when no movement of an object is detected within the detection range within the fixed time period; and the third detection mode for detecting an object present within the detection range with lower power consumption than the first detection mode and the second detection mode; a first operation control process for continuing the first operation state when the detection process transitions from the first detection mode to the second detection mode and the detection process returns to the first detection mode within the certain period of time while controlling the first operation state, and for controlling the second operation state when the detection process transitions to the third detection mode; a second operation control process for controlling the operation state to the first operation state or the second operation state based on a trigger of a process other than the detection process; Do the following: When the first operation state is controlled to the second operation state by the second operation control process, if it is determined in the detection process that a person is present within the detection range in the first detection mode, the detection time in the second detection mode is changed from the certain time to 0, and if it is determined that a person is no longer present within the detection range in the first detection mode, a transition is made to the third detection mode without waiting for the certain time. Information processing device.

2. The processor, when the first operation state is controlled to the second operation state by the second operation control process, if the second detection mode is in the detection process, the detection mode is transitioned to the third detection mode without waiting for the certain period of time. The information processing device according to claim 1 .

3. The processor, when a preset time has elapsed without a user input, or when a user input has been made for transitioning to the second operation state, the second operation control process controls the operation state from the first operation state to the second operation state.

3. The information processing device according to claim 1 or 2.

4. The processor, When the operation state is changed from the second operation state to the first operation state, if the detection time in the second detection mode is changed to 0 in the detection process, the detection time is returned to the certain time. The information processing device according to claim 1 .

5. The processor, When a user input is received to transition to the first operation state, the second operation control process controls the second operation state to the first operation state. The information processing device according to claim 4.

6. The processor, In the detection process, when it is determined that a person is present within the detection range in the third detection mode, the detection mode is transitioned from the third detection mode to the first detection mode; When the detection process causes a transition from the third detection mode to the first detection mode, the first operation control process controls the state from the second operation state to the first operation state. The information processing device according to claim 4.

7. The processor, When it is determined in the detection process that a person is present within the detection range in the third detection mode, the detection mode is transitioned from the third detection mode to the first detection mode based on a face direction of the person. The information processing device according to claim 6.

8. The second operating state is a state in which at least the screen of the display unit is turned off. The information processing device according to claim 1 .

9. 1. A control method for an information processing device including a sensor for detecting an object present within a predetermined detection range, and a processor for controlling an operation state of a system to a first operation state or a second operation state having lower power consumption than the first operation state, comprising: The processor, a detection step including a first detection mode in which the sensor is used to detect an object present within the detection range, and the presence or absence of a person within the detection range is determined based on the detection result, and a transition to a second detection mode is made when it is determined that no person is present within the detection range; the second detection mode is used to return to the first detection mode when the sensor detects movement of an object within the detection range within a fixed period of time, and a transition to a third detection mode when no movement of an object is detected within the detection range within the fixed period of time; and the third detection mode is used to detect an object present within the detection range with lower power consumption than the first detection mode and the second detection mode; a first operation control step of continuing the first operation state if the first operation mode returns to the first detection mode within the certain period of time even if the first operation mode transitions from the first detection mode to the second detection mode in the detection step, and controlling to the second operation state if the first operation mode transitions to the third detection mode in the detection step; a second operation control step of controlling the operation state to the first operation state or the second operation state based on a trigger of a process different from the detection step; Including, When the first operation state is controlled to the second operation state by the second operation control step, if it is determined in the detection step that a person is present within the detection range in the first detection mode, the detection time in the second detection mode is changed from the certain time to 0, and if it is determined that a person is no longer present within the detection range in the first detection mode, a transition is made to the third detection mode without waiting for the certain time. Control methods.

Citation Information

Patent Citations

  • Information processor and image input device

    JP2016062148A

  • Image forming device

    JP2017019137A

  • Information processor

    JP2018157302A

  • Image forming apparatus and power saving control method

    JP2019208153A

  • Electronic device, control method, and program

    JP2020102151A

Cited By

  • Information processing device and control method

    JP2026123547A

  • Information processing device and control method

    JP7924441B1