Information processing apparatus and control method

Abstract

The invention relates to an information processing apparatus and a control method. The information processing device performs detection processing including: a first detection mode in which a transition to a second detection mode is made when it is determined that there is no person; a second detection mode for returning to the first detection mode when the motion of the object is detected during a certain period of time, and transitioning to the third detection mode when the motion of the object is not detected during the certain period of time; and a third detection mode in which the object is detected with low power consumption, and when the first operation state or the second operation state with low power consumption relative to the first operation state is controlled on the basis of a trigger of a process different from the detection process, when it is determined that a person is present in the first detection mode during the detection process, the object is detected with low power consumption. The detection time in the second detection mode is changed to 0, and when it is determined that there is no person in the first detection mode, the detection mode shifts to the third detection mode without waiting for a certain time.

Description

Technical Field

[0001] This invention relates to an information processing apparatus and a control method. Background Technology

[0002] There are devices that automatically start the system or switch to standby mode by using a distance sensor (range sensor) that detects the approach and departure of a person by using infrared or other distance sensors (e.g., Patent Document 1). For example, if a person is detected leaving the device in its normal operating state, the screen turns off (screen off) and switches to standby mode after a certain period of time.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2020-102151

[0004] As described above, there are advantages such as: setting a standby time from the detection of a person's departure to the transition to a standby state allows for the detection of a person and a return to the normal operating state before unnecessarily entering a standby state, even if the departure is temporary or a false detection. Generally, in the normal operating state, to further improve person detection performance, a distance sensor is used to detect the movement of the detected object to determine if it is a person. However, in the standby state, low power consumption is preferred, so object movement cannot be detected, and the presence or absence of the object is detected only at a low frame rate to detect a person. In contrast, by maintaining the person detection performance of the normal operating state during the standby time from the detection of a person's departure to the transition to a standby state in the normal operating state, object movement is detected. Therefore, if object movement is detected, it is determined that a person is present, and the normal operating state is returned to, thus suppressing unnecessary transitions to a standby state.

[0005] However, sometimes the system transitions to standby mode via a trigger different from the detection of a person's departure. For example, as a function of the OS (Operating System), there is a function that transitions to standby mode by turning off the screen (screen off) after a preset time has elapsed without user input (the so-called sleep function). Additionally, there are also cases where the system transitions to standby mode due to user actions (power button operation, sleep indicator operation, etc.). Thus, even when the system transitions to standby mode via a trigger different from the detection of a person's departure, sometimes the presence of a person is detected during the human detection process. If the person then leaves, the system detects movement of objects within a certain standby time. Therefore, sometimes the system will activate even if someone other than the user crosses the path during this period. Since the system transitions to standby mode via a trigger different from the detection of a person's departure, this activation is not preferable. Summary of the Invention

[0006] The present invention was made in view of the above circumstances, and one of its objectives is to provide an information processing apparatus and control method that prevents unnecessary activation of human detection processing when the device is switched to a standby state by a trigger that is different from the detection of human absence.

[0007] This invention was made to solve the aforementioned problems. The information processing apparatus according to a first aspect of this invention includes: a sensor for detecting objects existing within a predetermined detection range; and a processor for controlling the system's operating state to a first operating state or a second operating state, wherein the power consumption of the second operating state is lower than that of the first operating state. The processor performs detection processing, first action control processing, and second action control processing. The detection processing includes: a first detection mode in which the sensor detects objects existing within the detection range and determines the presence or absence of a person within the detection range based on the detection result; and transitions to a second detection mode if it is determined that no person exists within the detection range; the second detection mode in which, if the sensor detects movement of an object within the detection range for a certain period of time, returns to the first detection mode; and transitions to a third detection mode if no movement of an object is detected within the detection range for the same period of time; and the third detection mode, which is relative to the first detection mode. The detection mode and the second detection mode are performed with low power consumption to detect objects existing in the detection range. In the first action control process, when the control is in the first action state, even if the detection process transitions from the first detection mode to the second detection mode but returns to the first detection mode within the certain period of time, the first action state continues. When the detection process transitions to the third detection mode, the control is in the second action state. In the second action control process, the control is in the first action state or the second action state based on a triggering process different from the detection process. When the control is in the second action control process from the first action state to the second action state, if the detection process determines that a person exists in the detection range in the first detection mode, the detection time in the second detection mode is changed from the certain period of time to 0. If the detection process determines that no person exists in the detection range in the first detection mode, the control is in the third detection mode without waiting for the certain period of time.

[0008] In the aforementioned information processing apparatus, when the processor is controlled to switch from the first action state to the second action state through the second action control processing, and the detection processing is in the second detection mode, the processor may switch to the third detection mode without waiting for the aforementioned certain period of time.

[0009] The information processing apparatus described above may also be configured such that, when a preset time has elapsed in the state without user input, or when there is user input for transitioning to the second action state, the processor controls the process from the first action state to the second action state through the second action control process.

[0010] In the aforementioned information processing apparatus, when the control changes from the second operation state to the first operation state, if the detection time in the second detection mode is changed to 0 during the detection processing, the processor returns to the aforementioned certain time.

[0011] The information processing apparatus described above may also be configured such that, in the event of user input for transferring to the first action state, the processor controls the process from the second action state to the first action state through the second action control processing.

[0012] The information processing device described above may also be configured such that, during the detection process, when it is determined that a person is present within the detection range under the third detection mode, the processor switches from the third detection mode to the first detection mode. When switching from the third detection mode to the first detection mode through the detection process, the processor controls the second action state to the first action state through the first action control process.

[0013] The information processing device described above may also be configured such that, during the detection process, if it is determined that a person is present within the detection range in the third detection mode, the processor switches from the third detection mode to the first detection mode based on the orientation of the person's face.

[0014] In the aforementioned information processing device, the second operating state may also be configured such that the screen of the display unit is at least turned off.

[0015] Furthermore, a second aspect of the present invention relates to a control method in an information processing apparatus, the information processing apparatus comprising: a sensor for detecting objects existing within a predetermined detection range; and a processor for controlling the operation state of the system to a first operation state or a second operation state, wherein the power consumption of the second operation state is lower than that of the first operation state. The control method includes a detection step performed by the processor, a first operation control step, and a second operation control step. The detection step comprises: a first detection mode in which the sensor detects objects existing within the detection range and determines the presence or absence of a person within the detection range based on the detection result, and transitions to a second detection mode if it is determined that no person exists within the detection range; the second detection mode in which, if the sensor detects the movement of an object within the detection range for a certain period of time, returns to the first detection mode, and transitions to a third detection mode if no movement of an object is detected within the detection range for the certain period of time; and the third detection mode, which is relative to the first detection mode. The detection mode and the second detection mode are used to detect objects within the detection range with low power consumption. In the first action control step, when the control is in the first action state, even if the detection step transitions from the first detection mode to the second detection mode but returns to the first detection mode within the specified time period, the first action state continues. When the detection step transitions to the third detection mode, the control is in the second action state. In the second action control step, the control is in the first action state or the second action state based on a trigger that is different from the processing in the detection step. When the control is in the second action state from the first action state to the second action state through the second action control step, if it is determined in the first detection mode that a person exists within the detection range, the detection time in the second detection mode is changed from the specified time period to 0. If it is determined in the first detection mode that no person exists within the detection range, the control is in the third detection mode without waiting for the specified time period.

[0016] According to the above-described method of the present invention, it is possible to suppress unnecessary activation of human detection processing when the system transitions to a standby state through a detection that is different from the detection of human absence. Attached Figure Description

[0017] Figure 1 This is a perspective view showing a structural example of the appearance of the information processing device involved in the embodiment.

[0018] Figure 2 This is a diagram illustrating an example of the human detection range of the information processing device involved in the implementation.

[0019] Figure 3 This is an explanatory diagram of the method for determining the orientation of the face according to the implementation method.

[0020] Figure 4 This is a diagram illustrating an example of the shift in detection mode during HPD processing according to the implementation method.

[0021] Figure 5 This is a diagram illustrating an example of HPD processing involved in an implementation method.

[0022] Figure 6 This diagram illustrates a first example of HPD processing when transitioning to a standby state from a trigger-based HPD process as described in the implementation.

[0023] Figure 7 This diagram illustrates a second example of HPD processing when transitioning to a standby state from a trigger-based HPD process as described in the implementation.

[0024] Figure 8 This is a simplified block diagram illustrating an example of the hardware structure of the information processing apparatus involved in the implementation.

[0025] Figure 9 This is a simplified block diagram illustrating an example of the functional structure of the information processing apparatus involved in the implementation.

[0026] Figure 10 This is a flowchart illustrating an example of motion detection mode processing in the HPD processing involved in the implementation.

[0027] Figure 11 This is a flowchart illustrating an example of the process of restoring the value of the motion detection timer in the HPD processing involved in the implementation.

[0028] Explanation of reference numerals in the attached figures

[0029] 1…Information processing device; 10…First frame; 20…Second frame; 15…Hinge mechanism; 110…Display unit; 130…ToF sensor; 140…Power button; 150…Input device; 151…Keyboard; 153…Touchpad; 160…Communication unit; 170…Storage unit; 200…EC; 210…Detection processing unit; 211…Human detection unit; 212…Motion detection timer; 213…Detection result output unit; 300…Main processing unit; 301…CPU; 302…GPU; 303…Chipset; 304…System memory; 310…System processing unit; 311…Motion control unit; 312…Screen off timer; 400…Power supply unit. Detailed Implementation

[0030] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0031] First, an overview of the information processing apparatus 1 involved in this embodiment will be described.

[0032] [summary]

[0033] Figure 1 This is a perspective view showing a structural example of the appearance of the information processing device 1 according to this embodiment. The information processing device 1 is, for example, a notebook PC (Personal Computer).

[0034] Information processing device 1 is, for example, a notebook-type (clamshell) PC (Personal Computer). Information processing device 1 includes a first frame 10, a second frame 20, and a hinge mechanism 15. The first frame 10 and the second frame 20 are joined by the hinge mechanism 15. The first frame 10 is capable of rotating relative to the second frame 20 about a rotation axis formed by the hinge mechanism 15. The opening angle resulting from the rotation of the first frame 10 and the second frame 20 is illustrated as "θ".

[0035] The first frame 10 is also referred to as the A cover or the display frame. The second frame 20 is also referred to as the C cover or the system frame. In the following description, the sides of the first frame 10 and the second frame 20 that have the hinge mechanism 15 are referred to as side surfaces 10c and 20c, respectively. The sides of the first frame 10 and the second frame 20 opposite to side surfaces 10c and 20c are referred to as side surfaces 10a and 20a, respectively. In the illustration, the direction from side surface 20a toward side surface 20c is designated as "rear," and the direction from side surface 20c toward side surface 20a is designated as "front." Furthermore, when looking forward from the information processing device 1, the direction to the right is designated as "right," and the direction to the left is designated as "left." The right side surfaces of the first frame 10 and the second frame 20 are referred to as side surfaces 10b and 20b, respectively, and the left side surfaces are referred to as side surfaces 10d and 20d, respectively. Furthermore, the state in which the first frame 10 and the second frame 20 overlap and are completely closed (the state with an opening angle θ = 0°) is referred to as the "closed state." In the closed state, the faces of the first frame 10 and the second frame 20 that face each other are called their "inner faces", and the faces opposite to their inner faces are called their "outer faces". In addition, the state in which the first frame 10 and the second frame 20 are opened relative to the closed state is called the "open state".

[0036] Figure 1The information processing device 1 shown is an example of its open state. The open state is the state in which the side 10a of the first frame 10 and the side 20a of the second frame 20 are separated. In the open state, the inner surfaces of both the first frame 10 and the second frame 20 are displayed. The open state is one of the states in which the user uses the information processing device 1, typically with an opening angle θ of approximately 100 to 130°. Furthermore, the range of the opening angle θ that constitutes the open state can be arbitrarily determined based on the range of angles that can be rotated via the hinge mechanism 15.

[0037] A display unit 110 is provided on the inner surface of the first frame 10. The display unit 110 is configured to include a liquid crystal display (LCD), an organic EL (electroluminescence) display, or the like. Furthermore, a ToF sensor 130 is provided in the area surrounding the display unit 110 on the inner surface of the first frame 10. For example, the ToF sensor 130 is disposed on the side 10a side of the area surrounding the display unit 110. Moreover, the position of the ToF sensor 130 is just one example; it can be placed in any other location as long as it faces the display screen of the display unit 110.

[0038] The ToF sensor 130 is a ranging sensor that measures the distance to an object (e.g., a person) located in the direction opposite to the display screen of the display unit 110 (i.e., in front of the information processing device 1). For example, the ToF sensor 130 is configured to include a light-emitting part that emits infrared light and a light-receiving part that receives the reflected light from the surface of the object after the emitted infrared light is reflected back by the object. The ToF sensor 130 emits infrared light forward at a predetermined sampling period (e.g., 1 Hz) and receives the reflected light of the emitted infrared light, thereby using the ToF (Time of Flight) method, which converts the time difference between emission and reception of light into distance, and outputs a ranging signal corresponding to the distance to the object (e.g., a person).

[0039] Additionally, a power button 140 is provided on the side 20b of the second frame 20. The power button 140 is an operator used by the user to indicate whether the power is turned on or off, to transition from standby mode to normal operation mode, and vice versa. Normal operation mode refers to the system's operation mode in which processing can be performed without special restrictions, for example, equivalent to the S0 state defined by ACPI (Advanced Configuration and Power Interface).

[0040] Standby state is a state in which at least some of the system's processing is restricted, and it is a state in which power consumption is lower than that of normal operation. For example, standby state is a state in which at least the screen of the display unit 110 is turned off (hereinafter referred to as "screen off"), and it can also be the modern standby state in Windows (registered trademark), or a state equivalent to S3 (sleep) as defined by ACPI.

[0041] Additionally, a keyboard 151 and a touchpad 153 are provided on the inner surface of the second housing 20 as input devices (HID: Human Interface Device) for receiving user input. Furthermore, a touch sensor may be provided instead of the keyboard 151 and touchpad 153, or a mouse or external keyboard may be connected. In the case of a structure with a touch sensor, the area corresponding to the display screen of the display unit 110 may be configured as a touch panel for receiving operations. Additionally, the input device may include a microphone for inputting sound.

[0042] Furthermore, in the closed state where the first frame 10 and the second frame 20 are closed, the display 110 located on the inner surface of the first frame 10 and the keyboard 151 and touchpad 153 located on the inner surface of the second frame 20 are covered by the other frame surface, rendering them unable to function.

[0043] The information processing device 1 performs HPD (Human Presence Detection) processing to detect a person present in front of the information processing device 1 based on the ranging signal output by the ToF sensor 130.

[0044] Figure 2 This diagram illustrates an example of the ranging range of the ToF sensor 130 according to this embodiment. In its open state, the ToF sensor 130, disposed on the inner surface of the first frame 10, measures the distance to an object (e.g., a person) in a direction facing (forward) opposite to the inner surface of the first frame 10. This ToF sensor 130 is a ranging sensor for detecting a person (e.g., a user) present in front of it; the detection range for detecting the person is called the detection range FoV (Field of View). The detection range FoV corresponds to the range of angles that the ToF sensor 130 can measure.

[0045] For example, the ToF sensor 130 divides the detection range FoV into 8×8 grid (mass) measurement units and measures distance on a per-grid (measurement unit) basis. Furthermore, since the purpose is to detect a person (user) using the information processing device 1, distances to objects at a certain distance (e.g., 2m) or greater can be excluded from the distance measurement. Additionally, distances to objects that are inaccessible by infrared light would normally be unmeasurable.

[0046] In addition, the information processing device 1 detects the motion of objects detected within the detection range FoV in order to distinguish between people and other objects. If the detected object is moving, the information processing device 1 can also determine that the detected object is a person.

[0047] Information processing device 1 controls its system operation state based on the presence or absence of a person using HPD processing. For example, when a person approaches information processing device 1 and its presence is detected (Presence = True), information processing device 1 activates the system and operates normally. Conversely, when a person leaves information processing device 1 and no person is detected (Presence = False), information processing device 1 enters standby mode.

[0048] Furthermore, when a person is detected in front of the information processing device 1, the information processing device 1 detects the orientation of the person's face based on the ranging signal output by the ToF sensor 130. For example, the information processing device 1 determines whether the person's face is facing the direction of the information processing device 1 (the direction of the display unit 110). Here, the state where the person's face is facing the direction of the information processing device 1 (the direction of the display unit 110) (the state where the face is facing forward relative to the information processing device 1) is defined as the state of looking at the information processing device 1. On the other hand, the state where the person's face is not facing the direction of the information processing device 1 (the state where the face is not facing forward relative to the information processing device 1, such as facing left, right, up, or down) is defined as the state of not looking at the information processing device 1.

[0049] For example, the information processing device 1 can also control the system startup and the brightness of the display unit 110 (dimming control) based on the determination of the face's orientation. Specifically, if the face is not facing forward (not looking at the information processing device 1), the information processing device 1 saves power by reducing the brightness of the display unit 110. In addition, when the face is facing forward again (if it is looking at the information processing device 1), the information processing device 1 returns to the original brightness level before the dimming.

[0050] (Methods for determining facial orientation)

[0051] Here, a method for determining the orientation of the face based on the ranging signal output from the ToF sensor 130 will be described. In this embodiment, the information processing device 1 determines the orientation as front, left, right, up, or down. Left-right orientation refers to the orientation of the face in the horizontal direction corresponding to the direction of rotation about a vertical axis passing through the center of the face. Up-down orientation refers to the orientation of the face in the vertical direction corresponding to the direction of rotation about a horizontal axis passing through the center of the face.

[0052] Figure 3 This is an explanatory diagram of the method for determining facial orientation according to this embodiment. The diagram divides the detection range (FoV) into 64 measurement units of 8×8 grids, and an example is shown where the distance measurement value of each unit is represented by a number within each grid. For example, the distance measurement value of each grid is a distance measurement value measured by the ToF sensor 130 at a predetermined period (e.g., a 1-second interval). Since people have many movements, the distance measurement values ​​of each grid are always changing. Therefore, in order to obtain highly reliable distance measurement values, time averaging can also be performed on the distance measurement values ​​measured at a predetermined period (e.g., a 1-second interval).

[0053] In this diagram, the distance values ​​displayed as numbers in each cell are in millimeters. In the example shown, cells with distance values ​​between 450 and 610 represent areas where people are present. Cells with distance values ​​above 1000 represent distances to objects located on the ceiling or behind people. Additionally, cells without displayed distance values ​​represent objects too far away to be measured.

[0054] The range of a person has the following characteristics: the edge of the range is generally mountain-shaped, and the width of the body above the shoulders is shorter than the width of the shoulders. For example, if the edge of the range of a grid with a distance value within 1m (1000mm) and a small difference (around 450-610 in this case) becomes a mountain-shaped range with human characteristics, the information processing device 1 detects this range as a human range (i.e., detects the presence of a person). In the illustrated example, the six grids arranged horizontally (left-right direction) from the grid labeled SL (Shoulder Left) to the grid labeled SR (Shoulder Right) correspond to the range of the shoulders (shoulder width), and the width of the part above the shoulders is shorter than the width of the shoulders.

[0055] Furthermore, the information processing device 1 detects the narrowest area on the left and right sides of the shoulder-length range as the range of the face. For example, the information processing device 1 detects the 3 (horizontal) × 4 (vertical) grids on the upper side of the shoulder-length range as the range of the face. When measuring the detection range FoV using an 8×8 grid, the size of this face range is equivalent to the range of a person's face at the distance of using the information processing device 1 (for keyboard operation).

[0056] Furthermore, the information processing device 1 can also detect the upper 3×3 grid within the range of a person's shoulders as the range of the face. Additionally, when measuring the FoV of the detection range using measurement units other than 8×8 grids, the range of the face is also set to a range consistent with the number of measurement units, instead of 3×4 or 3×3 grids.

[0057] Additionally, as shown in the diagram, the center grid of the face is designated as the center of the face. The measurement value of the FT (Face Top) grid above the center grid is set as the measurement value for the upper part of the face (forehead). The measurement value of the FB (Face Bottom) grid below the center grid is set as the measurement value for the lower part of the face (chin). The measurement value of the FL (Face Left) grid to the left of the center grid is set as the measurement value for the left side of the face. The measurement value of the FR (Face Right) grid to the right of the center grid is set as the measurement value for the right side of the face.

[0058] Furthermore, when the face area is a 3x3 grid, the center cell of the face area becomes the center cell of the 3x3 grid. However, when the face area is a 3 (horizontal) x 4 (vertical) grid, it becomes either the center cell of the second row or the center cell of the third row. Here, the bottom cell (the cell of the third row) is preferentially designated as the center cell.

[0059] Alternatively, the top cell (the cell in the second row) can be prioritized as the center cell. Another option is to track the distance between the cells on both sides, prioritizing the cell with the smaller distance value as the center cell, or prioritizing the cell with the larger change in distance value (movement).

[0060] The information processing device 1 determines the orientation of the face based on distance measurements of the upper, lower, left, and right sides of the face. For example, the information processing device 1 determines the orientation of the face in the vertical direction (up-down direction) based on the difference between the distance measurements of the upper and lower parts of the face. Furthermore, the information processing device 1 determines the orientation of the face in the horizontal direction (left-right direction) based on the difference between the distance measurements of the left and right sides of the face.

[0061] For example, if the difference between the measurement values ​​of the upper and lower parts of the face is greater than or equal to a predetermined threshold, and the measurement value of the upper part of the face is smaller than the measurement value of the lower part, the information processing device 1 determines that the face is facing downwards. On the other hand, if the difference between the measurement values ​​of the upper and lower parts of the face is greater than or equal to a predetermined threshold, and the measurement value of the lower part of the face is smaller than the measurement value of the upper part, the information processing device 1 determines that the face is facing upwards.

[0062] Furthermore, if the difference between the distance measured on the left and right sides of the face is greater than or equal to a predetermined threshold, and the distance measured on the left side of the face is smaller than the distance measured on the right side, the information processing device 1 determines that the face is facing to the right. On the other hand, if the difference between the distance measured on the left and right sides of the face is greater than or equal to a predetermined threshold, and the distance measured on the right side of the face is smaller than the distance measured on the left side, the information processing device 1 determines that the face is facing to the left.

[0063] Furthermore, if the difference between the measurement values ​​of the upper and lower parts of the face is less than a predetermined threshold, and the difference between the measurement values ​​of the left and right parts of the face is less than a predetermined threshold, the information processing device 1 determines that the face is facing forward. Thus, the information processing device 1 determines the orientation of the face based on the measurement values ​​of the upper, lower, left, and right parts of the face, whether it is facing upward or downward, left or right, or whether it is facing forward.

[0064] Furthermore, the information processing device 1 can also determine the orientation of the face in the vertical (up-down) and horizontal (left-right) directions based on which part of the face has the smallest distance measurement value among the upper, lower, left, and right parts. Additionally, the information processing device 1 can also determine that the face is facing forward if the difference between the distance measurement values ​​of the upper, lower, left, and right parts of the face is less than a predetermined threshold.

[0065] (Control of detection modes in HPD processing)

[0066] The information processing device 1 controls the system's operating state based on the detection results of HPD processing, and also changes the detection mode in HPD processing. For example, when the information processing device 1 performs HPD processing in the normal operating state, it detects both the object's motion and the face's orientation when detecting a person. However, in the standby state, it neither detects the object's motion nor the face's orientation, and only detects the presence or absence of objects at a low frame rate to reduce power consumption.

[0067] Figure 4This diagram illustrates an example of the shift in detection mode during HPD processing according to this embodiment. In normal operation, HPD processing is performed in Presence Detection Mode. Presence Detection Mode is, for example, a high-power (e.g., 30mW) detection mode that detects both object movement and facial orientation when detecting a person. For example, Presence Detection Mode uses a ToF sensor 130 to detect objects within the detection range (FoV) and determines the presence or absence of a person within the FoV based on the detection results. Specifically, if the presence of a person is determined to be absent (Presence = False) from the state that a person is present within the FoV (Presence = True), Presence Detection Mode shifts to Motion Detection Mode.

[0068] Motion detection mode is a detection mode where, when the absence of a person is detected in presence detection mode, the system does not immediately transition to standby mode. Instead, it waits for a certain period of time after detecting the absence of a person before transitioning to standby mode. This motion detection mode is set at the transition waiting position to standby mode, so that if the absence (departure) of a person is temporary or a false detection, the system can detect the person before unnecessarily entering standby mode and return to the normal operating state. Like presence detection mode, it operates at high power consumption (e.g., 30mW).

[0069] For example, in motion detection mode, if the ToF sensor 130 detects movement of an object within the detection range (FoV) for a certain period of time, it determines that a person exists within the FoV (Presence = True) and returns to presence detection mode. Conversely, if no movement of an object is detected within the FoV for a certain period of time, the motion detection mode transitions to sleep mode. Hereinafter, the timer used to time the aforementioned period in motion detection mode will be referred to as the "motion detection timer." The motion detection timer is, for example, set to 30 seconds.

[0070] When transitioning from normal operation to standby (screen off) mode, HPD processing is performed in sleep mode. Sleep mode is a detection mode that detects objects within the detection range (FoV) at low power (e.g., 1mW) compared to presence detection and motion detection modes. Sleep mode only detects the presence of objects within the FoV at a low frame rate, without detecting object movement or determining facial orientation. In other words, sleep mode detects a person's approach by simply detecting the presence of objects within the FoV, even when the person is absent (Presence = False). When a person is detected within the FoV in sleep mode (person's approach is detected), the system transitions to presence detection mode, and the system is controlled to return from standby to normal operation.

[0071] In addition, it can switch to presence detection mode if a person's approach is detected in sleep mode, and be controlled from standby state to normal operation state, but... Figure 4 The example shown illustrates not only the approach of a person but also the control of the person's normal action state after determining the direction of their face.

[0072] For example, if a person's approach is detected in sleep mode, the system temporarily switches to attention wake mode. Attention wake mode is a detection mode that operates at high power (e.g., 30mW) similar to presence detection mode, and it also determines the orientation of a person's face detected within the detection range (FoV). In presence detection mode, only people whose faces are facing directly towards the system (people looking at the information processing device 1) are identified as users, and the system switches to presence detection mode, with system startup controlled to normal operation. On the other hand, if a person's departure is detected in attention wake mode, the system returns to sleep mode.

[0073] Next, refer to Figure 5 The HPD process is explained when the system switches to standby mode based on the detection of a person leaving. Figure 5 This is a diagram illustrating an example of HPD processing according to this embodiment. The diagram uses time (t) as the horizontal axis and shows the system's actions, the user's state, and HPD processing in a time sequence.

[0074] At time t0, the user is in front of the information processing device 1 (within the detection range FoV). In its normal operating state, the brightness of the screen on the display unit 110 is at standard brightness. The information processing device 1 performs HPD processing in Presence Detection Mode, and upon detecting the presence of a person within the detection range FoV, sets "Presence = True" as the detection result of the HPD processing.

[0075] If the user leaves at time t1, the information processing device 1 will not detect a person (moving object) within the detection range (FoV) through HPD processing. At time t2, the information processing device 1 determines that no person exists, sets the detection result of HPD processing to "Presence = False", and transitions to motion detection mode. Furthermore, if the information processing device 1 transitions to motion detection mode, it will start the motion detection timer.

[0076] In motion detection mode, if an object's movement is detected within the detection range (FoV) before the motion detection timer (e.g., 30 seconds) expires, the information processing device 1 determines that a person is present within the FoV, sets "Presence = True" as the detection result of HPD processing, and returns to the presence detection mode. On the other hand, in motion detection mode, if no object's movement is detected within the FoV until the motion detection timer (e.g., 30 seconds) expires, at time t3, the information processing device 1 transitions to sleep mode and the system transitions to standby mode (screen off).

[0077] Here, the transition to standby mode is also triggered via... Figure 6 The HPD (Hyper-Processing) function shown detects situations other than the user leaving the room. As a trigger for transitioning to standby mode other than through HPD processing, for example, as an OS function, there is a function that turns off the screen and transitions to standby mode when there has been no user input (HID input) for a preset period of time (the so-called sleep function). Alternatively, there are cases where the user performs an operation to transition to standby mode (power button operation, sleep indicator operation, etc.).

[0078] Thus, when transitioning to standby mode via a trigger other than HPD processing, there are also times when HPD processing detects a person's presence (Presence = True). In this case, actions are performed in presence detection mode. If a person's departure is detected, the existing HPD processing will proceed as follows: Figure 5As shown, it transitions to motion detection mode. In motion detection mode, if the object's motion is detected, it returns to its normal motion state. Therefore, as... Figure 5 As shown, when transitioning to standby mode via HPD processing triggered by a person leaving, there is an advantage that the transition to standby mode is not unnecessary. However, when transitioning to standby mode via a trigger other than HPD processing, if a person leaving is subsequently detected and the transition to motion detection mode is initiated, it is possible that even if the movement of an object is only detected by a person crossing the road, the mode may be unnecessarily activated.

[0079] Therefore, when the information processing device 1 according to this embodiment switches to standby mode, if it determines that a person is detected in the presence detection mode during HPD processing, the motion detection time in the motion detection mode is changed to 0. Thus, if the information processing device 1 determines that no person is present (Presence = False) in the presence detection mode, it does not switch to motion detection mode but switches to sleep mode. Figure 6 This indicates a comparison between the existing processing and the processing in this embodiment.

[0080] Figure 6 This diagram illustrates a first example of HPD processing when transitioning to standby state via a trigger other than the HPD processing described in this embodiment. This diagram is related to... Figure 5 Similarly, the horizontal axis is used as time (t), and the system's actions, user status, and HPD processing are shown in time sequence. (A) represents the existing processing, and (B) represents the processing involved in this embodiment.

[0081] At time t10, the user is in front of the information processing device 1 (within the detection range FoV). In its normal operating state, the brightness of the screen on the display unit 110 of the information processing device 1 is at standard brightness. When the information processing device 1 performs HPD processing in presence detection mode, it detects the presence of a person within the detection range FoV and sets "Presence = True" as the detection result of the HPD processing.

[0082] At time t11, information processing device 1 transitions to standby mode (screen off) via triggers other than HPD processing, through the OS's sleep function, operations for transitioning to standby mode (power button operation, sleep indicator operation, etc.). At this time, information processing device 1 continues to execute HPD processing in presence detection mode. If the user leaves at time t12, information processing device 1 will not detect a person (moving object) within the detection range (FoV) through HPD processing. At time t13, information processing device 1 determines that no person exists and sets the detection result of HPD processing to "Presence = False" (time t13).

[0083] Here, in the existing process shown in (A), the information processing device 1 transitions to motion detection mode at time t13 and to sleep mode at time t15 after the motion detection timer (e.g., 30 seconds) has finished counting down. Therefore, if the information processing device 1 detects the movement of an object within the detection range (FoV) before the motion detection timer (e.g., 30 seconds) ends, it determines that a person is present within the detection range (FoV) (Presence = True) and activates the system. Consequently, the information processing device 1 may unnecessarily activate, for example, even if a person is simply crossing the street, by detecting the movement of an object.

[0084] Therefore, as shown in (B), when the information processing device 1 of this embodiment transitions to standby mode (screen off) when the HPD processing detection result is "Presence = True" (time t11), it changes the motion detection timer to 0. Thus, when the information processing device 1 determines that no one is present in the presence detection mode (Presence = False) (time t13), it transitions to sleep mode instead of motion detection mode, thereby suppressing unnecessary startup.

[0085] Figure 6 The example shown is an example of HPD processing when transitioning to standby mode via a trigger other than HPD processing in presence detection mode. Next, refer to... Figure 7 This section explains the HPD processing when transitioning to standby mode via a trigger other than HPD processing in motion detection mode.

[0086] Figure 7 This diagram illustrates a second example of HPD processing when transitioning to standby mode via a trigger other than the HPD processing described in this embodiment. This diagram is consistent with... Figure 6 Similarly, the horizontal axis is used as time (t), and the system's actions, user status, and HPD processing are shown in time sequence. (A) represents the existing processing, and (B) represents the processing involved in this embodiment.

[0087] In the existing process shown in (A), the information processing device 1 transitions to motion detection mode at time t13, and to sleep mode at time t15 after the motion detection timer (e.g., 30 seconds) has finished counting down. However, at time t14, before the motion detection timer finishes counting down, it transitions to standby mode (screen off) via a trigger other than HPD processing. In this case, during the period from time t14 to t15, the information processing device 1 may unnecessarily activate, for example, by detecting the movement of an object even if it is just a person crossing the street.

[0088] Therefore, as shown in (B), when the information processing device 1 of this embodiment is switched from motion detection mode to sleep mode at time t14 by a trigger other than HPD processing in motion detection mode, unnecessary startup is suppressed.

[0089] [Hardware Structure of Information Processing Device]

[0090] Figure 8 This is a simplified block diagram illustrating an example of the hardware structure of the information processing apparatus 1 according to this embodiment. Figure 8 In the middle, to and Figure 1 The corresponding structural elements of each part are labeled with the same reference numerals. The information processing device 1 is configured to include a display unit 110, a ToF sensor 130, a power button 140, an input device 150, a communication unit 160, a storage unit 170, an EC (Embedded Controller) 200, a main processing unit 300, and a power supply unit 400.

[0091] Display unit 110 displays display data (images) generated based on system processing executed by main processing unit 300 and application processing that operates on the system processing.

[0092] As described above, the ToF sensor 130 is a ranging sensor that uses the ToF method to determine the distance to an object (e.g., a person) present in front of it. For example, the ToF sensor 130 outputs a ranging signal containing a ranging value, which is obtained by measuring the distance to an object (e.g., a person) present in a detection range FoV in the direction facing (front) opposite the inner surface of the first frame 10.

[0093] The power button 140 outputs an operation signal to the EC200 based on the user's operation. The input device 150 is an input unit that accepts user input, and is configured to include, for example, a keyboard 151 and a touchpad 153. In response to receiving operations on the keyboard 151 and the touchpad 153, the input device 150 outputs an operation signal indicating the operation content to the EC200.

[0094] The communication unit 160 can be communicatively connected to other devices via a wireless or wired communication network to send and receive various types of data. For example, the communication unit 160 is configured to include a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark).

[0095] The storage unit 170 is configured to include storage media such as HDD (Hard Disk Drive), SSD (Solid State Drive), RAM, and ROM. The storage unit 170 stores various programs such as the operating system, device drivers, and applications, as well as various data acquired through the actions of these programs.

[0096] The power supply unit 400 supplies power to each unit according to the operating status of each unit in the information processing device 1. The power supply unit 400 includes a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the DC power supplied from the AC (Alternate Current) / DC adapter or battery (battery pack) into the voltage required by each unit. The power converted by the DC / DC converter is supplied to each unit via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from EC200.

[0097] The EC200 is a microcomputer configured to include a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and I / O (Input / Output) logic circuits. The EC200's CPU reads the control program (firmware) pre-stored in its ROM, executes the read control program, and performs its functions. The EC200 operates independently of the main processing unit 300, controlling the operation of the main processing unit 300 and managing its operating state. Furthermore, the EC200 is connected to a power button 140, an input device 150, and a power supply unit 400.

[0098] For example, EC200 communicates with power supply unit 400 to obtain information about the battery status (remaining capacity, etc.) from power supply unit 400, and outputs control signals, such as control signals for controlling the power supply corresponding to the operating status of each part of information processing device 1, to power supply unit 400. In addition, EC200 obtains operation signals from power button 140 and input device 150, and outputs operation signals related to the processing of main processing unit 300 from the obtained operation signals to main processing unit 300.

[0099] The main processing unit 300 is configured to include a CPU (Central Processing Unit) 301, a GPU (Graphics Processing Unit) 302, a chipset 303, and a system memory 304. Through OS (Operating System) based system processing, it is able to execute various application processing on the OS.

[0100] CPU 301 is a processor that executes BIOS-based program processing, OS-based program processing, and application processing that operates on the OS. For example, CPU 301 executes startup processing, which starts the system from standby mode and transitions it to normal operation mode, and sleep processing, which transitions the system from normal operation mode to standby mode. In addition, based on the aforementioned determination of facial orientation, CPU 301 executes screen brightness control processing, which controls the screen brightness of the display unit 110.

[0101] GPU 302 is connected to display unit 110. GPU 302 performs image processing to generate display data based on the control of CPU 301. GPU 302 outputs the generated display data to display unit 110.

[0102] Chipset 303 functions as a memory controller and an I / O controller. For example, chipset 303 controls the reading and writing of data from system memory 304, storage unit 170, etc., by CPU 301 and GPU 302. Additionally, chipset 303 controls the input and output of data from communication unit 160, display unit 110, and EC200. Furthermore, chipset 303 functions as a sensor hub. For example, chipset 303 acquires ranging signals output from ToF sensor 130 and performs various processes such as HPD processing.

[0103] System memory 304 is used as a reading area for programs executed by CPU 301 and a job area for writing processing data.

[0104] Furthermore, the CPU 301, GPU 302, and chipset 303 can be configured as a single integrated processor, or they can be configured as individual processors, either partially or individually. For example, in normal operation, the CPU 301, GPU 302, and chipset 303 are all operating, but in standby mode, only at least a portion of the chipset 303 is operating.

[0105] [Functional Structure of Information Processing Devices]

[0106] Next, the functional structure of the information processing device 1 for the action status of the control system triggered by HPD processing or other methods will be described in detail.

[0107] Figure 9 This is a simplified block diagram illustrating an example of the functional structure of the information processing apparatus 1 according to this embodiment. The information processing apparatus 1 includes: a detection processing unit 210 that performs HPD processing based on the ranging signal from the ToF sensor 130, and a system processing unit 310 that performs system processing based on programs from the BIOS and OS, as well as the detection results from the detection processing unit 210.

[0108] The detection processing unit 210 includes a human detection unit 211, a motion detection timer 212, and a detection result output unit 213. It is a functional structure that performs the above-mentioned HPD processing by executing a specific program, such as a CPU 301 or a chipset 303.

[0109] The human detection unit 211 performs HPD processing, which detects or determines people within the detection range (FoV) and the orientation of their faces, based on the ranging value from the ToF sensor 130. Specifically, the human detection unit 211 switches between presence detection mode, motion detection mode, sleep mode, or attention activation mode for HPD processing.

[0110] In presence detection mode, the person detection unit 211 uses the ToF sensor 130 to detect objects within the detection range FoV, and determines whether a person is present within the detection range FoV based on the detection results. For example, if the person detection unit 211 determines in presence detection mode that no person is present within the detection range FoV, it will transition to motion detection mode.

[0111] In motion detection mode, the human detection unit 211 starts timing the motion detection timer 212 (e.g., 30 seconds) upon transition to motion detection mode. The human detection unit 211 detects the movement of objects within the detection range (FoV) until the motion detection timer 212 finishes. If the object is a person, it exhibits movement (e.g., a slight movement), therefore the human detection unit 211 determines that completely stationary objects are not people, and only detects objects with movement (e.g., slight movements) as people. For example, the human detection unit 211 determines whether an object is moving based on the amount of change in the ranging value of the ToF sensor 130 measured at predetermined intervals (e.g., 1-second intervals).

[0112] For example, if the human detection unit 211 detects an object's movement within the detection range FoV while in motion detection mode until the motion detection timer 212 expires, it returns to the presence detection mode. Alternatively, if the human detection unit 211 does not detect an object's movement within the detection range FoV while in motion detection mode until the motion detection timer 212 expires, it transitions to sleep mode.

[0113] In sleep mode, the human detection unit 211 detects objects within the detection range (FoV) with lower power consumption compared to the presence detection mode and motion detection mode. For example, in sleep mode, the human detection unit 211 does not detect the movement of objects but only detects the presence or absence of objects at a low frame rate to detect people.

[0114] Furthermore, the human detection unit 211 switches from sleep mode to presence detection mode when it determines that a human is present within the detection range (FoV) in sleep mode. For example, in HPD processing, if it determines that a human is present within the detection range (FoV) in sleep mode, the information processing device 1 switches to attention activation mode.

[0115] In attention-activated mode, the person detection unit 211 also determines the orientation of the face of a person detected within the FoV detection range. Only when the face is facing forward (attention information processing device 1) does it switch from sleep mode to presence detection mode. Furthermore, if a person is detected as being present within the FoV detection range in sleep mode, but is detected as leaving in attention-activated mode, the person detection unit 211 returns to sleep mode.

[0116] Furthermore, when the human detection unit 211 switches from a normal operating state to a standby state based on a triggering process different from HPD processing, if the HPD processing determines that a person is present within the detection range (FoV), the motion detection timer 212 is set to 0. Then, if the human detection unit 211 determines that no person is present within the detection range (FoV) in the presence detection mode, it transitions to sleep mode without waiting for a certain period (e.g., 30 seconds). (See reference...) Figure 6 (B)

[0117] Furthermore, when the information processing device 1 is controlled to switch from a normal operating state to a standby state based on a triggering process different from HPD processing, if it is in motion detection mode during HPD processing, the motion detection timer 212 is also stopped midway, and the device transitions to sleep mode at that time point without waiting for a certain period of time (e.g., 30 seconds). (See reference) Figure 7 (B)

[0118] If the human detection unit 211 determines that a human is present within the detection range (FoV), the detection result output unit 213 sets "Presence = True" as the detection result processed by HPD and outputs it. Conversely, if the human detection unit 211 does not detect a human within the detection range (FoV), it sets "Presence = False" and outputs it.

[0119] The system processing unit 310 is a functional structure implemented by the CPU 11 executing programs of the BIOS and the OS. For example, the system processing unit 310 includes an action control unit 311 and a screen off timer 312, and is a functional structure implemented by executing programs of the OS.

[0120] The motion control unit 311 performs first motion control processing (motion control processing based on HPD processing) and second motion control processing (motion control processing based on processing different from HPD processing).

[0121] In the first motion control process, the motion control unit 311 controls the system's motion state based on the detection results of the HPD processing by the detection processing unit 210. For example, when the motion control unit 311 is in a normal motion state, it continues to operate normally even if it transitions from presence detection mode to motion detection mode during HPD processing and then returns to presence detection mode within a certain period of time. When it transitions to sleep mode during HPD processing, it controls the system to a standby state. Furthermore, when the system transitions from sleep mode to presence detection mode via attention activation mode through HPD processing, the motion control unit 311 controls the system to operate normally from the standby state.

[0122] Furthermore, in the second motion control process, the motion control unit 311 controls the system to either a normal operating state or a standby state based on a triggering process different from the HPD process. For example, if a preset time has elapsed since there has been no user input (HID input), or if there is user input (power button operation, sleep indicator operation, etc.) to transition to the standby state, the motion control unit 311 controls the system to either a normal operating state or a standby state based on a triggering process different from the HPD process. The screen-off timer 312 is a timer used to count the time during which there has been no user input (HID input).

[0123] In addition, when there is user input (operation of the power button, start indication operation, etc.) to switch to the normal operating state, the motion control unit 311 controls the system to either the normal operating state or the standby state based on the triggering of a process different from the HPD process.

[0124] [HPD processing actions]

[0125] Next, refer to Figure 10 Based on something different from the reference Figure 6 (B) Figure 7 The triggering of HPD processing, as explained in (B), is the action of processing in motion detection mode during HPD processing when the normal operation state is controlled to standby state.

[0126] Figure 10 This is a flowchart illustrating an example of processing in motion detection mode within the HPD processing described in this embodiment.

[0127] (Step S101) When the system enters a standby state based on a process different from HPD processing, the detection processing unit 210 determines whether a person is present within the detection range (FoV). If the detection processing unit 210 determines that a person is present (Presence = True), it proceeds to step 103. On the other hand, if the detection processing unit 210 determines that no person is present (Presence = False), it proceeds to step S107.

[0128] (Step S103) The detection processing unit 210 saves the current value of the motion detection timer 212. Then, it proceeds to the processing in step S105.

[0129] (Step S105) The detection processing unit 210 changes the value of the motion detection timer 212 to 0 and ends the processing.

[0130] (Step S107) The detection processing unit 210 determines whether the standby state is in motion detection mode. If the detection processing unit 210 determines that the standby state is in motion detection mode (yes), it proceeds to step S109. On the other hand, if the detection processing unit determines that the standby state is not in motion detection mode (no), the process has already transitioned from motion detection mode to sleep mode, and therefore ends.

[0131] (Step S109) The detection processing unit 210 switches from motion detection mode to sleep mode.

[0132] Next, refer to Figure 11 For passing Figure 10 The process shown is explained when the value of the motion detection timer 212 is changed to 0 and then restored to its original value.

[0133] Figure 11 This is a flowchart illustrating an example of the process of restoring the value of the motion detection timer 212 in the HPD processing involved in this embodiment.

[0134] (Step S201) The detection processing unit 210 determines whether the system has entered a normal operating state (screen on) from the standby state. If the detection processing unit 210 determines that the system has not entered a normal operating state (screen on) (No), it repeats step S201. On the other hand, if the detection processing unit 210 determines that the system has entered a normal operating state (screen on) (Yes), it proceeds to step S203.

[0135] (Step S203) The detection processing unit 210 determines the current value of the motion detection timer 212. If the detection processing unit 210 determines that the current value of the motion detection timer 212 is 0, it proceeds to step S205, restoring the value of the motion detection timer 212 to its original value. Figure 10 The value saved in step S103.

[0136] On the other hand, if the detection processing unit 210 determines in step S203 that the current value of the motion detection timer 212 is greater than 0 (i.e., it has not been changed to 0), the processing ends because it is not necessary to restore the value of the motion detection timer 212.

[0137] [Summary of Implementation Methods]

[0138] As described above, the information processing apparatus 1 according to this embodiment includes: a ToF sensor 130 (an example of a sensor) for detecting objects present within a predetermined detection range (FoV); and a processor (e.g., CPU 301, chipset 303, etc.) for controlling the system's operating state to either a normal operating state (an example of a first operating state) or a standby state with low power consumption relative to the normal operating state (an example of a second operating state). The information processing apparatus 1 performs HPD processing (an example of detection processing) having at least a presence detection mode (an example of a first detection mode), a motion detection mode (an example of a second detection mode), and a sleep mode (an example of a third detection mode). For example, in the presence detection mode, the information processing apparatus 1 uses the ToF sensor 130 to detect objects present within the detection range (FoV) and determines the presence or absence of a person within the detection range (FoV) based on the detection results. Furthermore, in the presence detection mode, if it is determined that no person is present within the detection range (FoV), the information processing apparatus 1 switches to the motion detection mode. Furthermore, in motion detection mode, if the ToF sensor 130 detects the movement of an object within the detection range (FoV) for a certain period of time (e.g., 30 seconds), the information processing device 1 returns to the presence detection mode. If no movement of an object is detected within the detection range for a certain period of time, it transitions to sleep mode. Sleep mode is a detection mode that detects objects present within the detection range (FoV) with lower power consumption compared to presence detection mode and motion detection mode. Additionally, the information processing device 1 performs a first motion control process (motion control process based on HPD processing) and a second motion control process (motion control process based on processing different from HPD processing). For example, in the first motion control process, if the device is in a normal operating state, and even if it transitions from presence detection mode to motion detection mode during HPD processing but returns to presence detection mode for a certain period of time, it continues in the normal operating state; and if it transitions to sleep mode during HPD processing, it enters a standby state.

[0139] Furthermore, in the second motion control process, the information processing device 1 controls the system to either a normal operation state or a standby state based on a triggering process different from the HPD process. Moreover, when the information processing device 1 controls the system to switch from a normal operation state to a standby state based on a triggering process different from the HPD process, in the HPD process, if it determines in the presence detection mode that a person is present within the detection range (FoV), it changes the detection time (set time of the motion detection timer) in the motion detection mode from a certain time (e.g., 30 seconds) to 0. In the presence detection mode, if it determines that no person is present within the detection range (FoV), it transitions to sleep mode without waiting for a certain time.

[0140] Therefore, when the information processing device 1 is switched to standby mode by a trigger that is different from the detection of a person leaving based on HPD processing, it will switch to sleep mode instead of motion detection mode even if a person's departure is subsequently detected. Thus, it can suppress unnecessary activation of HPD processing. Therefore, the information processing device 1 can appropriately control HPD processing.

[0141] Furthermore, when the information processing device 1 is controlled to switch from a normal operating state to a standby state based on a triggering process different from HPD processing, it will switch to a sleep mode without waiting for a certain period of time (e.g., 30 seconds) if it is in motion detection mode in HPD processing.

[0142] Therefore, when the information processing device 1 switches to standby mode via a trigger that is different from the detection of a person leaving based on HPD processing, it switches to sleep mode if it is in motion detection mode, thus suppressing unnecessary activation via HPD processing. Consequently, the information processing device 1 can appropriately control HPD processing.

[0143] In addition, if a preset time has elapsed in the state where there is no user input (HID input), or if there is user input for transitioning to standby mode (operation of the power button, sleep instruction operation, etc.), the information processing device 1 controls the switch from the normal operation state to the standby state based on the triggering of a process different from HPD processing.

[0144] Therefore, the information processing device 1 can also be in standby mode during processing other than HPD processing, and in this case, HPD processing can be appropriately controlled.

[0145] Furthermore, when the information processing device 1 is switched from standby mode to normal operation mode, if the detection time (set time of motion detection timer) in motion detection mode during HPD processing is changed to 0, it returns to the aforementioned certain time (e.g., 30 seconds).

[0146] Therefore, when the information processing device 1 is switched to standby mode by triggering a detection of a person's departure that is different from HPD-based processing, even if the control is subsequently changed so that it switches to sleep mode instead of motion detection mode even if a person's departure is detected, it can return in a way that does not affect subsequent control.

[0147] In addition, when there is user input for transitioning to normal operation state, the information processing device 1 controls the standby state to normal operation state through a second motion control process (motion control process based on a process different from HPD process).

[0148] Therefore, the information processing device 1 can start from standby mode in processing other than HPD processing, and in this case, HPD processing can be appropriately controlled.

[0149] Furthermore, during HPD processing, the information processing device 1 transitions from sleep mode to presence detection mode when it determines that a person is present within the detection range (FoV) while in sleep mode. Additionally, when the information processing device 1 transitions from sleep mode to presence detection mode via HPD processing, it controls the device from standby state to normal operation state via first action control processing (action control processing based on HPD processing).

[0150] Thus, the information processing device 1 can be activated from standby mode when a person is detected approaching via HPD processing.

[0151] In addition, in HPD processing, if it is determined that a person is present in the FoV detection range in sleep mode, the information processing device 1 also switches from sleep mode to presence detection mode based on the orientation of the person's face (note the start mode).

[0152] Therefore, when the information processing device 1 detects that a person with a face facing forward (looking at the information processing device 1) is approaching through HPD processing, it can start from the standby state.

[0153] Furthermore, the standby state is a state in which the display unit 110's screen is turned off (screen off).

[0154] As a result, the information processing device 1 can reduce power consumption in standby mode and display content that cannot be visually confirmed by others when the user is not present.

[0155] Furthermore, the control method in the information processing apparatus 1 according to this embodiment includes: a detection step, in a presence detection mode (an example of a first detection mode), using a ToF sensor 130 to detect objects existing within a detection range FoV, and determining the presence or absence of a person within the detection range FoV based on the detection result, and transitioning to a motion detection mode (an example of a second detection mode) if it is determined that no person exists within the detection range FoV; a detection step, in the motion detection mode, returning to the presence detection mode if the ToF sensor 130 detects the movement of an object within the detection range FoV for a certain period of time (e.g., 30 seconds), and transitioning to a sleep mode if no movement of an object is detected within the detection range FoV for a certain period of time. (An example of a third detection mode) transition; detection step, in sleep mode, detecting objects present within the detection range FoV with low power consumption relative to presence detection mode and motion detection mode; first motion control step, in the state of being controlled for first motion control processing (motion control processing based on HPD processing), continuing the normal operation state even if the transition from presence detection mode to motion detection mode in the above detection step is to return to presence detection mode for a certain period of time (an example of a first operation state), and controlling to standby state in the case of transitioning to sleep mode in the above detection step (an example of a second operation state); and second motion control step, controlling to normal operation state or standby state based on a trigger of processing different from the above detection step. Furthermore, when the control method in the information processing device 1 controls the device to switch from a normal operating state to a standby state through the second action control step described above, in the detection step, if it is determined in the presence detection mode that a person is present within the detection range FoV, the detection time (set time of the motion detection timer) in the motion detection mode is changed from a certain time (e.g., 30 seconds) to 0, and if it is determined in the presence detection mode that no person is present within the detection range FoV, the device switches to a sleep mode without waiting for a certain time.

[0156] Therefore, when the control method in the information processing device 1 switches to standby mode by triggering a human departure detection that is different from HPD-based processing, it switches to sleep mode instead of motion detection mode even if human departure is subsequently detected. This suppresses unnecessary activation of HPD processing. Consequently, the control method in the information processing device 1 can appropriately control HPD processing.

[0157] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the specific structures are not limited to the embodiments described above, and also include designs that do not depart from the spirit of the present invention. For example, the structures described in the above embodiments can be combined arbitrarily.

[0158] Furthermore, in the above embodiment, a structural example of embedding the ToF sensor 130 in the information processing device 1 has been described, but it is not limited to this. For example, the ToF sensor 130 may not be embedded in the information processing device 1, or it may be configured to be installed as an external accessory of the information processing device 1 (e.g., any one of the sides 10a, 10b, 10c, etc.) and communicate with the information processing device 1 wirelessly or via a wired connection.

[0159] Furthermore, in the above embodiment, an infrared ToF sensor 130 was used as an example for distance measurement, but it is not limited to this. For example, a distance measurement sensor using laser, ultrasound, or the like could also be used. Alternatively, instead of the ToF sensor 130, a camera (image capture unit) could be used to detect the presence or absence of a person within the detection range (FoV) and determine the orientation of the person's face. In this case, the camera (image capture unit) could be configured to be built into the information processing device 1, or it could be configured to be mounted on the information processing device 1 as an external accessory (e.g., any one of the sides 10a, 10b, 10c, etc.) and communicate with the information processing device 1 wirelessly or via a wired connection.

[0160] Furthermore, standby mode can also include a screen-locked state. Screen lock refers to a state in which a pre-set image (e.g., a screen lock image) is displayed on the display unit, making it impossible to visually confirm the content being processed, and the device cannot be used until the lock is released (e.g., user authentication).

[0161] Furthermore, the aforementioned information processing apparatus 1 has an internal computer system. Moreover, programs for implementing the functions of each structure of the information processing apparatus 1 can be recorded on a computer-readable recording medium, and the processing in each structure of the information processing apparatus 1 is performed by having the computer system read and execute the program recorded on the recording medium. Here, "having the computer system read and execute the program recorded on the recording medium" includes the computer system installation program. The term "computer system" here includes hardware such as an operating system and peripheral devices. Additionally, the "computer system" may also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Furthermore, "computer-readable recording medium" refers to portable media such as floppy disks, optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium containing the program can also be a non-transitory recording medium such as a CD-ROM.

[0162] Furthermore, the recording medium may also include internal or external recording media accessible from a distribution server for distributing the program. Additionally, the program may be divided into multiple parts, each downloaded at different time intervals, and then assembled from various components of the information processing device 1, with each part distributed via a different distribution server. Moreover, the term "computer-readable recording medium" also includes structures that retain the program for a certain period, such as a server for sending the program over a network or volatile memory (RAM) within a computer system acting as a client. Furthermore, the program described above may be part of a structure used to implement the aforementioned functions. Further, it may be a so-called differential file (differential program) that can be implemented by combining the aforementioned functions with a program already recorded in the computer system.

[0163] Alternatively, some or all of the functions of the information processing apparatus 1 in the above embodiments can be implemented as integrated circuits such as LSI (Large Scale Integration). Each function can be processed individually, or some or all can be integrated for processing. Furthermore, the method of integrated circuit implementation is not limited to LSI; it can also be implemented using dedicated circuits or general-purpose processors. Additionally, if advancements in semiconductor technology lead to integrated circuit technologies that replace LSI, integrated circuits based on such technologies can also be used.

[0164] Furthermore, the information processing device 1 described in the above embodiments is not limited to a laptop PC; for example, it may be a desktop PC, a tablet terminal device, a smartphone, a gaming device, a multimedia terminal, etc.

Claims

1. An information processing apparatus including: a sensor configured to detect an object present in a predetermined detection range; and a processor that controls an action state of the system to be a first action state or a second action state, wherein a power consumption of the second operation state is lower than a power consumption of the first operation state, the processor performs a detection process, a first operation control process, and a second operation control process, the detection process includes a first detection mode in which detection of an object present in the detection range is performed using the sensor, and presence or absence of a person in the detection range is determined based on a detection result, and in a case where it is determined that there is no person in the detection range, the detection process is shifted to a second detection mode, the second detection mode in which, in a case where an operation of an object is detected in the detection range during a certain time period using the sensor, the detection process is returned to the first detection mode, and in a case where an operation of an object is not detected in the detection range during the certain time period, the detection process is shifted to a third detection mode, and the third detection mode in which detection of an object present in the detection range is performed with a lower power consumption than in the first detection mode and the second detection mode, in the first operation control process, in a case where the detection process is shifted from the first detection mode to the second detection mode but is returned to the first detection mode during the certain time period in a state where the first operation state is controlled, the first operation state is continued, and in a case where the detection process is shifted to the third detection mode, the second operation state is controlled, in the second operation control process, the first operation state or the second operation state is controlled based on a trigger of a process different from the detection process, in a case where the second operation state is controlled from the first operation state by the second operation control process, in a case where it is determined in the first detection mode in the detection process that there is a person in the detection range, a detection time in the second detection mode is changed from the certain time to 0, and in a case where it is determined in the first detection mode that there is no person in the detection range, the third detection mode is shifted without waiting for the certain time. 2.The information processing apparatus according to claim 1, wherein in a case where the second operation state is controlled from the first operation state by the second operation control process, in a case where it is the second detection mode in the detection process, the processor shifts to the third detection mode without waiting for the certain time. 3.The information processing apparatus according to claim 1 or 2, wherein in a case where a state where there is no input of a user has continued for a predetermined time, or in a case where there is an input of a user for shifting to the second operation state, the processor controls the second operation state from the first operation state by the second operation control process. 4.The information processing apparatus according to claim 1, wherein In a case where the detection time in the second detection mode in the detection processing is changed to 0 when the second operation state is controlled to the first operation state, the processor returns to the certain time.

5. The information processing apparatus according to claim 4, wherein In a case where there is an input of a user for shifting to the first operation state, the processor controls from the second operation state to the first operation state by the second operation control processing.

6. The information processing apparatus according to claim 4, wherein In the detection processing, the processor shifts from the third detection mode to the first detection mode based on a determination in the third detection mode that there is a person in the detection range, In a case where the third detection mode is shifted to the first detection mode by the detection processing, the processor controls from the second operation state to the first operation state by the first operation control processing.

7. The information processing apparatus according to claim 6, wherein In the detection processing, in a case where there is a determination in the third detection mode that there is a person in the detection range, the processor shifts from the third detection mode to the first detection mode based on an orientation of a face of the person.

8. The information processing apparatus according to claim 1, wherein The second operation state is a state in which at least a screen of a display section is turned off.

9. A control method, which is a control method in an information processing apparatus that includes a sensor configured to detect an object present in a predetermined detection range and a processor configured to control an operation state of the system to a first operation state or a second operation state, the second operation state having lower power consumption than the first operation state, The control method includes a detection step, a first operation control step, and a second operation control step performed by the processor, The detection step includes a first detection mode in which detection of an object present in the detection range is performed using the sensor, and a determination is made based on a detection result as to whether there is a person in the detection range, and in a case where there is no person in the detection range, the second detection mode is shifted to; the second detection mode in which, in a case where an action of an object is detected in the detection range during a certain time, the first detection mode is returned to, and in a case where an action of an object is not detected in the detection range during the certain time, the third detection mode is shifted to; and the third detection mode in which detection of an object present in the detection range is performed with lower power consumption than in the first detection mode and the second detection mode, In the first operation control step, in a case where the first operation state is controlled, even in a case where the first detection mode is shifted to the second detection mode in the detection step and the first detection mode is returned to during the certain time, the first operation state is continued, and in a case where the third detection mode is shifted to in the detection step, the second operation state is controlled, In the above-mentioned second operation control step, the control to the first operation state or the second operation state is performed based on a trigger of a process different from the above-mentioned detection step, In the case where it is determined in the above-mentioned detection step in the first detection mode that a person is present in the detection range when the control from the first operation state to the second operation state is performed by the above-mentioned second operation control step, the detection time in the second detection mode is changed from the certain time to 0, and in the case where it is determined in the above-mentioned detection step in the first detection mode that a person is not present in the detection range, the transition to the third detection mode is performed without waiting for the certain time.

Images