Equipment control method and device, electronic equipment, chip and storage medium
The device status is determined through sensors and image acquisition components and low-power control is performed, which solves the problem of short battery life of smart devices when not in use, and achieves more efficient power consumption management and user experience improvement.
Patent Information
- Application Number
- CN202410940130.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-12
- Publication Date
- 2024-11-19
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the prior art, it is difficult for smart devices to effectively perform low-power control when users are not in use, resulting in a shortening of battery life, and lack of combination of behavior recognition and low-power control, affecting user experience.
Data is collected through sensor and image acquisition components to determine the device status. If it is a non-usage state, perform low-power control operations, such as CPU low-power state, reduced screen refresh rate, extended sensor call interval, etc., and cancel low-power control. The device is switched to use.
It realizes reducing power consumption, extending battery life, improving user experience when users are not actually using the device, and provides a wider and flexible low-power control strategy.
Smart Images

Figure CN118984482A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of chip technology, and in particular to a device control method, apparatus, electronic device, chip and storage medium. Background Art
[0002] When a user uses a smart device, such as a mobile phone, the mobile phone can identify the user's behavior through sensors to improve the user experience based on the identified user behavior. Summary of the invention
[0003] The present disclosure provides a device control method, apparatus, electronic device, chip and storage medium to solve the problems in the related art.
[0004] The first aspect of the present disclosure provides a device control method, which includes: determining a device state based on data collected by a sensor and / or an image acquisition component, wherein the device state is used to determine whether the device is actually in use; when the device state is a non-use state, performing a low power consumption control operation on the device.
[0005] In some embodiments of the present disclosure, the non-use state includes at least one of the following: the device is held in hand and is in a hanging state; the device is not performing any operation and is in a horizontal state; the device is not lifted up and is in a moving state; the device has positioning services turned on and is in a stationary state; the device's screen is awakened and the screen is not being looked at.
[0006] In some embodiments of the present disclosure, the sensor includes at least one of an accelerometer, a gyroscope, and a positioning system. Determining the device state based on data collected by the sensor includes at least one of the following: when the data collected by the accelerometer and the gyroscope meet a first condition, determining that the device is held and in a hanging state; when the data collected by the accelerometer meets a second condition, determining that the device has not performed any operation and is in a horizontal state; when the data collected by the accelerometer and the gyroscope meet a third condition, determining that the device has not been lifted and is in a moving state; when the data collected by the positioning system meets a fourth condition, determining that the device has turned on the positioning service and is in a stationary state; when the device is in a screen-on state and the image acquisition component determines that the user has not looked at the screen within a preset time period based on the user's eye movement behavior, determining that the device's screen is awakened and the screen is in a non-looking state.
[0007] In some embodiments of the present disclosure, performing low power control operations on a device includes at least one of the following: controlling the CPU of the device to enter a low power state; relaxing the conditions for the CPU of the device to enter a low power state; switching the thread scheduling of the device to a low power CPU; frequency regulation to restrict the CPU of the device from using high energy consumption frequencies; limiting the cache usage size of the device; reducing the frequency of the memory DDR of the device; controlling the screen of the device to enter a low power state; reducing the display frame rate and screen refresh rate of the device; reducing the screen brightness of the device; reducing the touch screen reporting rate of the device; and extending the sensor call interval of the device.
[0008] In some embodiments of the present disclosure, after executing low power consumption control on the device, the method further includes: when the device state changes from a non-use state to a use state, canceling the low power consumption control executed on the device.
[0009] In some embodiments of the present disclosure, the use status includes at least one of the following: the device is lifted up; the device receives a wake-up instruction; the device receives an operation instruction.
[0010] The second aspect embodiment of the present disclosure proposes a device control device, which includes: a first processing unit, used to determine the device status based on data collected by a sensor and / or an image acquisition component, and the device status is used to determine whether the device is actually used; a second processing unit, used to perform low power consumption control operations on the device when the device status is a non-use state.
[0011] The third aspect embodiment of the present disclosure proposes an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the first aspect embodiment of the present disclosure.
[0012] The fourth aspect embodiment of the present disclosure proposes a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the first aspect embodiment of the present disclosure.
[0013] The fifth aspect embodiment of the present disclosure proposes a chip, characterized in that it includes at least one processor and a communication interface; the communication interface is used to receive signals input into the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method described in the first aspect embodiment of the present disclosure through logic circuits or execution code instructions.
[0014] In summary, the device control method proposed in the present disclosure can obtain the user's real-time requirements for the device by collecting real-time data of the device to determine whether the device is actually in use. It can also control the device to enter a low-power state when the user is not actually using the device, thereby reducing power consumption.
[0015] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.
[0017] Figure 1 A schematic diagram of a flow chart of a device control method provided by an embodiment of the present disclosure;
[0018] Figure 2 A schematic diagram of a flow chart of a device control method provided by an embodiment of the present disclosure;
[0019] Figure 3 A schematic diagram of a flow chart of a device control method provided by an embodiment of the present disclosure;
[0020] Figure 4 A flowchart of a power consumption control method based on behavior recognition provided by an embodiment of the present disclosure;
[0021] Figure 5 A schematic diagram of the structure of a device control device provided in an embodiment of the present disclosure;
[0022] Figure 6 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure;
[0023] Figure 7 A schematic diagram of the chip structure provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0024] Embodiments of the present disclosure are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.
[0025] The battery life of mobile phones has always been the focus of users. The battery life of mobile phones can be extended by controlling the low power consumption of mobile phone chips. Low power consumption control can be achieved in many ways, including hardware optimization, software optimization, communication optimization and user behavior optimization. Among them, low power consumption control of mobile phones through software optimization is the current focus.
[0026] The low power consumption control of mobile phones is divided into hardware and software. The low power consumption design of software includes software dynamic power consumption control, CPU power saving mode design, dynamic adjustment of peripherals, software structure-level power consumption optimization strategy, software task-level power consumption optimization and dynamic configuration of system resources. Software dynamic power consumption control is one of the key points of current low power consumption design of mobile phone chips.
[0027] Software designed low power consumption is mainly in specific mobile phone modes, such as power saving mode, etc., by adjusting the mobile phone settings such as brightness, animation frame rate, data transmission and reception, CPU load, etc. through software.
[0028] Behavior recognition technology refers to the identification and analysis of user behavior through the use of sensors and machine learning algorithms. Behavior recognition on mobile phones includes: gait recognition, posture recognition, gesture recognition, location recognition, voice recognition, etc. Behavior recognition can improve user experience.
[0029] At present, the behavior recognition of mobile phones is mainly used to improve the user experience, such as lift to wake, screen off when the phone is close to the ear when making a call, screen off when the phone is put in the pocket, etc. Take lift to wake as an example: the accelerometer and gyroscope of the mobile phone can recognize that the user has picked up the phone, and then pass the recognition result to the display module, finally lighting up the screen.
[0030] However, the current software design of low power consumption is targeted at specific mobile phone modes, and the modes usually need to be set manually, or the modes are not personalized enough, which affects the user experience. In addition, the current related technologies also lack the combination of mobile phone behavior recognition and low power consumption control.
[0031] Therefore, in order to solve the above problems, the present disclosure proposes a device control method that can perform low-power control based on behavior recognition, and does not affect the user's use and experience while controlling power consumption. This method builds a general low-power control framework based on behavior recognition, which has stronger applicability. This method is not limited to one scenario, but lists a variety of specific scenarios, so that the low-power control strategy has a wider range of applications and strong scalability, providing options for low-power control in more scenarios in the future; in addition, this method enriches the means of low-power control and provides a more comprehensive and effective low-power control method.
[0032] The specific contents of this method are as follows.
[0033] Figure 1 The following is a flow chart of a device control method provided by an embodiment of the present disclosure. Figure 1 As shown, the method can be executed by an electronic device, and optionally, the method can be executed by a terminal. The method can include the following steps.
[0034] Step 101, determining a device status based on data collected by a sensor and / or an image acquisition component, where the device status is used to determine whether the device is actually used.
[0035] In some embodiments, for example, the device may be a smart device, such as a terminal, such as a mobile phone, a tablet, or other device.
[0036] In some embodiments, the sensor includes at least one of an accelerometer, a gyroscope, and a positioning system. For example, the positioning system may be a Global Positioning System (GPS).
[0037] In some embodiments, the image acquisition component can be used to acquire device surrounding environment information and user's facial information. For example, the image acquisition component can be a camera of a terminal.
[0038] Step 102: When the device is in a non-use state, a low power consumption control operation is performed on the device.
[0039] In some embodiments, the non-use state may be a state in which the user is not actually using the device.
[0040] In some embodiments, the device may include a display screen. For example, when the screen of the device is in a lit state, that is, in a bright screen state, it can be determined whether the device is in use.
[0041] In some embodiments, the non-use state includes at least one of the following: the device is held in hand and is in a hanging state; the device is not performing any operation and is in a horizontal state; the device is not lifted up and is in a moving state; the device has positioning services turned on and is stationary; the device's screen is awakened and the screen is not being looked at.
[0042] Specifically, when the device is held in hand and in a hanging state, it is determined that the device is in a non-use state. For example, when the device is a mobile phone, the mobile phone is held in hand by the user and in a hanging state. It can be considered that the user diverts attention to do other things and forgets to lock the screen. At this time, the device is not actually used, so it can be determined that the device is in a non-use state.
[0043] Specifically, when the device is not performing any operation and is in a horizontal state, it is determined that the device is in a non-use state. For example, when the device is a mobile phone, the mobile phone is not performing any operation and is in a horizontal state. For example, the mobile phone is placed flat on a table, indicating that the device is idle at this time. Although the screen is on, the user is not actually using the mobile phone. At this time, it can be considered that the user has forgotten to lock the screen or the attention has been temporarily diverted.
[0044] Alternatively, the device may not be in a horizontal state but no operation is performed, or it can be said that when the device is in a stationary state and no operation is performed, it can be determined that the device is in a non-use state. For example, when the device is a mobile phone, the mobile phone is placed on a mobile phone stand and no operation is performed. At this time, it can be considered that the user forgets to lock the screen or the attention is temporarily diverted, and the user is not actually using the mobile phone.
[0045] Specifically, when the device is not lifted and is in a moving state, it is determined that the device is in a non-use state. For example, when the device is a mobile phone, in scenarios such as running and cycling, the user can put the mobile phone in a pocket or fix it on a bracket. At this time, the mobile phone is not lifted and is in a moving state. Since users pay less attention to mobile phones in similar scenarios, it can be determined that the device is not actually used in such scenarios. At this time, it can be determined that the device is in a non-use state.
[0046] Specifically, when the device has a positioning service turned on and is in a stationary state, it is determined that the device is in a non-use state. For example, when the device is a mobile phone, when the mobile phone turns on a navigation application that requires a positioning service, such as a map application based on GPS positioning, it can be considered that the user needs to go to a certain location and thus needs navigation. However, when the mobile phone has a positioning service turned on and is in a stationary state, it can be considered that the user has forgotten to turn off the positioning service, or the location is not a terminal that the user is concerned about, and there is no need to frequently update the user's location. At this time, the user does not actually want to use the positioning service, and it can be determined that the device is in a non-use state.
[0047] Specifically, when the screen of the device is awakened and the screen is not being looked at, it is determined that the device is in a non-use state. For example, when the device is a mobile phone, the screen of the device is awakened, that is, the screen of the device is in a lit state, but the screen of the device is not being looked at, which may indicate that the user does not need to look at the screen. For example, when the user plays a video or makes a video call, the user only needs to obtain sound information and does not need to watch the screen. At this time, it can be determined that the device is in a non-use state.
[0048] In some embodiments, performing low power control operations on the device includes at least one of the following: controlling the device's CPU to enter a low power state; relaxing the conditions for the device's CPU to enter a low power state; switching the device's thread scheduling to a low power CPU; frequency regulation to limit the device's CPU from using high energy consumption frequencies; limiting the device's cache usage size; reducing the device's double data rate (DDR) frequency; controlling the device's screen to enter a low power state; reducing the device's display frame rate and screen refresh rate; reducing the device's screen brightness; reducing the device's touch screen reporting rate; and extending the device's sensor call interval.
[0049] In the above embodiments, by controlling the CPU of the device to enter a low power state, it is possible to reduce the operating power consumption of the CPU, save device power, extend the service life of the device battery, and reduce the heat generated by the device, especially when the device is working outdoors in summer, the user experience can be improved; by relaxing the conditions for the CPU of the device to enter a low power state, the device can enter a low power state in a timely manner, improve the response speed to low power control instructions, and shorten the time to enter a low power state. The power consumption can be further reduced by shortening the time to enter the low power state; by switching the thread scheduling of the device to a low-power CPU, the power consumption of the business scheduling process can be reduced while ensuring the normal operation of the business; by limiting the CPU of the device from using high-energy consumption frequencies, it can be avoided that the device generates large power consumption due to the use of high-energy consumption frequencies, and high-energy consumption frequency resources can be saved and power consumption can be reduced.
[0050] In the above embodiment, by limiting the cache usage size of the device, memory cost problems, device operating speed problems, etc. caused by excessive cache size can be avoided. By controlling the cache size of the device within a reasonable range, the device response speed can be improved and the device power consumption can be reduced.
[0051] In the above embodiment, by reducing the frequency of the device DDR, the power consumption of the device can be reduced, the battery life can be extended, and the heat generation of the device can be reduced.
[0052] In the above embodiment, by controlling the screen of the device to enter a low power consumption state, the power consumption of the device screen can be reduced; by reducing the display frame rate and screen refresh rate of the device, reducing the screen brightness of the device, and reducing the touch screen reporting rate of the device, the power consumption caused by the device screen can be reduced when the current business has low requirements for screen display.
[0053] In the above embodiment, by extending the sensor call interval of the device, the device power consumption caused by sensor call can be reduced when there is no interaction with the device. For example, when the device turns on the positioning service but does not move for a period of time, the user may not pay attention to his or her own location, or the user's location changes little over a period of time. At this time, the call interval of the positioning service can be extended to reduce the power consumption generated in the process of obtaining the user's location.
[0054] In some embodiments, when the device is in different scenarios where the device is not in use, different low-power operations can be performed on the device. For example, when the device has a positioning service turned on and is in a stationary state, the sensor call interval of the device can be extended; for example, when the device screen is awakened and the screen is not being looked at, the device screen can be controlled to enter a low-power state, etc. The low-power control methods in specific scenarios can be combined according to actual conditions, and this is not limited by the present disclosure.
[0055] In summary, the above-mentioned embodiments of the present disclosure can reduce the power consumption of the device by determining the device status and performing low-power consumption control on the device when the device is not in use. While meeting the business operation requirements of the device, it can save device power, extend the standby time of the device, and extend the service life of the device battery. By reducing power consumption, the heat generated by the operation of the device can be reduced, and problems such as device offline caused by device overheating can be reduced, thereby improving user experience.
[0056] Figure 2 The following is a flow chart of a device control method provided by an embodiment of the present disclosure. Figure 2 As shown, based on Figure 1 In the illustrated embodiment, the method comprises the following steps.
[0057] Step 201: When the data collected by the accelerometer and the gyroscope meet the first condition, it is determined that the device is held and in a hanging state.
[0058] In some embodiments, the state of the device can be determined based on the accelerometer and gyroscope of the sensor, where the first condition can be that the acceleration data of the device collected by the accelerometer is less than the acceleration threshold within a period of time, and the angle of the device collected by the gyroscope is within a certain range. For example, when the angle is [80, 100], it can be determined that the device is in a hanging state. When the acceleration is small, it can indicate that the user is stationary in the hanging state or the angle change is small, and it is still in the hanging state.
[0059] In some embodiments, the specific conditions of the first condition can be set according to actual applications, and the method of determining whether the device is held and in a hanging state can be determined according to actual conditions, which is not limited by the present disclosure.
[0060] Step 202: When the data collected by the accelerometer meets the second condition, it is determined that the device is not performing any operation and is in a horizontal state.
[0061] In some embodiments, the state of the device can be determined based on the accelerometer of the sensor, wherein the second condition can optionally be that the acceleration data of the device collected by the accelerometer is 0, and the device has not received any operation from the user, which can indicate that the device is stationary, and the device has not performed any operation and is in a horizontal state, that is, it is in an unused state.
[0062] In some embodiments, the second condition may also be other data requirements for determining whether the device is stationary, which may be set according to actual conditions and is not limited in this disclosure.
[0063] Step 203: When the data collected by the accelerometer and the gyroscope meet the third condition, it is determined that the device is not lifted and is in a moving state.
[0064] In some embodiments, the state of the device can be determined based on the accelerometer and gyroscope of the sensor, where the third condition can be that the speed of the accelerometer-detected device is within a certain speed range, the angle of the gyroscope-detected device is within a certain range, and so on. The specific data range can be set according to the actual scenario, or the specific requirements for the accelerometer and gyroscope to collect data can be determined according to the actual scenario, which is not limited by the present disclosure.
[0065] In some embodiments, the third condition can be preset according to actual applications. When the third condition is met, it can be determined that the device is not lifted and is in a moving state, where the moving state can be a moving state in scenarios such as running and cars, which is not limited by the present disclosure.
[0066] In some embodiments, optionally, the third condition may also include the image acquisition component determining that the user has not looked at the screen within a preset time period based on the collected user eye movement behavior. In other words, when the device is in a moving state without being lifted and not being looked at by the user, the user is in a moving state and is not paying attention to the device. For example, when the user is running, the device can record motion data but does not need to look at the screen. At this time, the device screen can be controlled to enter a low power consumption state to reduce power consumption.
[0067] In the above embodiment, the third condition can only limit the data of the sensor, which can timely control the device to enter a low power consumption state and reduce resource consumption; or the third condition can limit the data of the sensor and the data of the image acquisition component at the same time, which can improve the accuracy of low power consumption scene recognition and optimize user experience. Step 204, when the data collected by the positioning system meets the fourth condition, determine that the device turns on the positioning service and is in a stationary state.
[0068] In some embodiments, the status of the device can be determined based on the positioning system, where the fourth condition can be that the positioning system of the device is turned on, but the device is detected to have not moved for a period of time, or the position of the device has changed little over a period of time. In this case, it can be confirmed that the device has turned on the positioning service and is in a stationary state.
[0069] In some embodiments, the fourth condition can be set according to the actual application scenario, which is not limited by the present disclosure. Step 205: when the device is in the screen-on state and the image acquisition component determines that the user has not looked at the screen within a preset time period based on the user's eye movement behavior, it is determined that the screen of the device is awakened and the screen is in the unlooked-at state.
[0070] In some embodiments, when the device is in the screen-on state, the image acquisition component can track the user's eye movements and analyze the user's device usage status based on the user's eye movements. For example, when the phone remains in the screen-on state, the phone's camera can track the user's eye movements. If the user is not detected looking at the screen within a preset time period, it can be determined that the device's screen is awakened and the screen is not being looked at, and the device is not in use.
[0071] In some embodiments, the specific preset time period can be set according to the actual application scenario, which is not limited by the present disclosure.
[0072] In summary, the above-mentioned embodiments of the present application can determine the state of the device based on the data collected by the sensor and image acquisition component of the device, and can be used to determine whether the device is actually in use. It is convenient to determine that when the device is in a non-use state, control the device to enter a low power consumption state to reduce the power consumption of the device.
[0073] Figure 3 The following is a flow chart of a device control method provided by an embodiment of the present disclosure. Figure 3 As shown, based on Figure 1 In the illustrated embodiment, the method comprises the following steps.
[0074] Step 301: when the device state changes from the non-use state to the use state, cancel the low power consumption control performed on the device.
[0075] In some embodiments, the usage status includes at least one of the following: the device is lifted up; the device receives a wake-up instruction; the device receives an operation instruction.
[0076] In other words, the device can cancel the low power control performed on the device after detecting that the device is lifted or detecting that the user interacts with the device. The detection of the device being lifted can be detected based on data collected by the device's sensor, and the user interacting with the device can be the device receiving a wake-up instruction, an operation instruction, etc. from the user, such as the user clicking on the device screen to input, etc.
[0077] In some embodiments, after detecting that the device has switched to the use state, it may indicate that the user needs to start using the device. At this time, the low power consumption control needs to be canceled to facilitate a faster response to user instructions and completion of related services.
[0078] In some embodiments, determining the usage status of a device may also include other methods, which are not limited by the present disclosure.
[0079] In some embodiments, canceling low-power control performed on the device may include tightening the entry conditions for the CPU to enter various low-power states, removing the scheduling isolation of high-power CPUs, removing frequency modulation restrictions on high-efficiency frequencies, removing cache usage restrictions, restoring DDR frequency, increasing display frame rate and screen refresh rate, increasing touch screen reporting rate, shortening sensor call intervals, etc., so as to improve the response speed of the device and improve user experience.
[0080] In summary, the above embodiments of the present disclosure can cancel the low power consumption control performed on the device when the device is switched from an unused state to a used state, thereby improving the user experience by increasing the response speed of the device.
[0081] The technical solution of the present disclosure is further described in detail below in conjunction with specific application examples.
[0082] The following is a power consumption control method based on behavior recognition provided by an embodiment of the present disclosure. The process of the method is as follows: Figure 4 As shown, the method determines whether the user is actually using the mobile phone in the screen-on state based on behavior recognition. If not, it is considered a low-power event and specific low-power control measures are implemented.
[0083] Among them, the user behaviors in the following scenarios belong to low power events. Low power events refer to the situation where the phone recognizes the user's behavior at this time through sensors, which can make the phone enter a low power state without affecting the user's use and experience. When the following behaviors are recognized, the phone can be set to enter the corresponding low power state:
[0084] 1. When the phone is held in the hand and hanging down, it can be assumed that the user has diverted his attention to other things and forgotten to lock the screen.
[0085] 2. The phone is placed on the desktop and the user does not perform any operation. It can be assumed that the user has forgotten to lock the screen or his attention has been temporarily diverted.
[0086] 3. When running or cycling, users will not keep their eyes on their phones. Therefore, when the screen is not locked and the phone is not lifted, the phone can be set to enter low power consumption control.
[0087] 4. When opening a map or other application that often uses GPS, if the user does not move for a period of time, it can be assumed that the user has forgotten to close the GPS application, or that the user's location is not of concern to the user and does not require frequent positioning. In this case, the GPS call interval can be extended.
[0088] The following scenario assumes that the user starts using the phone again. When the following behaviors are identified, the phone is set to exit the low power consumption event and respond to the user in a timely manner:
[0089] 1. The user picks up the phone.
[0090] 2. The user interacts with the phone.
[0091] The complete process of the program is as follows.
[0092] 1. Perform user behavior recognition based on mobile phone sensors (such as accelerometer, gyroscope, GPS, etc.), identify the user's gaze, posture, gesture, etc., and obtain behavior recognition results.
[0093] 2. Determine whether the identified behavior belongs to a low-power event, that is, determine whether the corresponding low-power control can be entered.
[0094] The following are specific user behaviors associated with low power events, as well as the sensors and identification methods required for identification:
[0095] 1) Behavior: The phone is held in the hand and hanging down, and the user forgets to lock the screen;
[0096] Sensors: accelerometer, gyroscope;
[0097] Identification method: The sensor is used to identify that the user is holding the phone in a hanging position for a period of time.
[0098] 2) Behavior: The phone is placed on the desktop and the user does not perform any operation, or the user forgets to lock the screen or temporarily diverts attention;
[0099] Sensor: accelerometer;
[0100] Identification method: The sensor recognizes that the phone is stationary and the user has not performed any operation for a period of time.
[0101] 3) Behavior: Running or cycling, the user does not raise the phone;
[0102] Sensors: accelerometer, gyroscope;
[0103] Identification method: Use sensors to identify the user's motion status and the posture of holding the phone.
[0104] 4) Behavior: When opening a map or other GPS-enabled app, the user does not move for a period of time;
[0105] Sensor: GPS;
[0106] Identification method: When using maps or other applications that always keep GPS on, the user's location is identified through GPS as not changing for a period of time.
[0107] Low power events can be categorized based on the sensor used to identify the behavior:
[0108]
[0109]
[0110] 3. Select the corresponding low power consumption control method according to the low power consumption event.
[0111] After detecting a low power event, the system enters low power control to limit the power consumption of the device and save power. The specific control methods and categories are as follows:
[0112]
[0113] 4. Behavior recognition based on sensors is used to determine whether the user has used the phone again. If the user has not used the phone, the phone will remain in a low-power state; if the user starts using the phone again, the phone will exit the low-power event and return to normal use, thereby responding to the user in a timely manner.
[0114] 1) Use the phone sensor to detect whether the user has started using the phone again. If any of the following behaviors is identified, it is considered that the user has started using the phone again:
[0115] a) Detecting that the user picks up the phone through a low-power sensor;
[0116] b) Detecting that the user is interacting with the phone.
[0117] 2) The mobile phone exits the operation from the low-power event: tighten the entry conditions for the CPU to enter various low-power states, release the scheduling isolation of high-power CPUs, release the frequency modulation restrictions on high-efficiency frequencies, release the cache usage restrictions, restore the DDR frequency, increase the display frame rate and screen refresh rate, increase the touch screen reporting rate, and shorten the sensor call interval, so as to improve the device's response speed and improve the user experience.
[0118] In summary, the above examples of the present disclosure reduce battery consumption when a foreground program is running on the mobile phone but the user is not using the mobile phone; adjust low power control when the user is about to use the mobile phone, prepare to respond to user input in a timely manner, and improve user experience.
[0119] Figure 5 FIG. 5 is a schematic diagram of a device control apparatus 500 provided in an embodiment of the present disclosure. Figure 5 As shown, the apparatus includes: a first processing unit 510, for determining a device state based on data collected by a sensor and / or an image acquisition component, wherein the device state is used to determine whether the device is actually used; and a second processing unit 520, for determining that the device is in a low power consumption scenario when the device state is a non-use state, and performing a low power consumption control operation on the device.
[0120] In some embodiments, the non-use state includes at least one of the following: the device is held in hand and is in a hanging state; the device is not performing any operation and is in a horizontal state; the device is not lifted up and is in a moving state; the device has positioning services turned on and is stationary; the device's screen is awakened and the screen is not being looked at.
[0121] In some embodiments, the sensor includes at least one of an accelerometer, a gyroscope, and a positioning system.
[0122] In some embodiments, the first processing unit 510 can also be used to determine that the device is held and in a hanging state when the data collected by the accelerometer and the gyroscope meets the first condition; determine that the device is not performing any operation and is in a horizontal state when the data collected by the accelerometer meets the second condition; determine that the device is not lifted and is in a moving state when the data collected by the accelerometer and the gyroscope meets the third condition; determine that the device has the positioning service turned on and is in a stationary state when the data collected by the positioning system meets the fourth condition; and determine that the screen of the device is awakened and is not being looked at when the device is in a screen-on state and the image acquisition component determines that the user has not looked at the screen within a preset time period based on the user's eye movement behavior.
[0123] In some embodiments, the second processing unit 520 can also be used to control the device's CPU to enter a low power state; relax the conditions for the device's CPU to enter a low power state; switch the device's thread scheduling to a low power CPU; frequency control the device's CPU to not use high energy consumption frequencies; limit the device's cache usage size; reduce the device's memory DDR frequency; control the device's screen to enter a low power state; reduce the device's display frame rate and screen refresh rate; reduce the device's screen brightness; reduce the device's touch screen reporting rate; and extend the device's sensor call interval.
[0124] In some embodiments, the device control apparatus further includes a third processing unit configured to cancel the low power consumption control performed on the device when the device state changes from a non-use state to a use state.
[0125] In some embodiments, the usage status includes at least one of the following: the device is lifted up; the device receives a wake-up instruction; the device receives an operation instruction.
[0126] In summary, the device control device 500 can determine the status of the device based on the collected data, and determine whether the user is actually using the device based on the status of the device. When the device is not in use, the device can be controlled to enter a low-power state, thereby reducing power consumption while meeting business operations and reducing power waste.
[0127] In the embodiments provided in the present application, the methods and devices provided in the embodiments of the present application are introduced. In order to implement the functions in the methods provided in the embodiments of the present application, the electronic device may include a hardware structure and a software module, and implement the functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. A function of the functions may be executed in the form of a hardware structure, a software module, or a hardware structure plus a software module.
[0128] Figure 6 is a block diagram of an electronic device 600 for implementing the above method according to an exemplary embodiment. For example, the electronic device 600 may be a mobile phone, a computer, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0129] Reference Figure 6 , the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .
[0130] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.
[0131] The memory 604 is configured to store various types of data to support operations on the electronic device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0132] The power supply component 606 provides power to the various components of the electronic device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.
[0133] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0134] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.
[0135] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0136] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of components, such as the display and keypad of the electronic device 600, and the sensor assembly 614 can also detect the position change of the electronic device 600 or a component of the electronic device 600, the presence or absence of user contact with the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and the temperature change of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0137] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR (NewRadio) or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0138] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.
[0139] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, and the above instructions can be executed by the processor 620 of the electronic device 600 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0140] The embodiments of the present disclosure further provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the above embodiments of the present disclosure.
[0141] An embodiment of the present disclosure further proposes a communication system, which includes a terminal and a network device. The terminal is used to implement the method described in the embodiment of the first aspect of the present disclosure, and the network device can be used to implement the method described in the embodiment of the second aspect of the present disclosure.
[0142] Figure 7 FIG. 7 is a schematic diagram of a chip 700 for implementing the above method according to an exemplary embodiment. Figure 7 The chip 700 includes a communication interface 701 and at least one processor 702. The communication interface 701 is used to receive signals input into the chip 700 or signals output from the above chip 700. The processor 702 communicates with the communication interface 701 and implements the method described in the above embodiments of the present disclosure through logic circuits or executing code instructions.
[0143] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0144] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any at least one embodiment or example in a suitable manner.
[0145] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention belong.
[0146] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processing module, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection having at least one wiring (control method), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.
[0147] It should be understood that the various parts of the embodiments of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0148] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0149] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. The above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.
[0150] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.
Claims
1. A device control method, It is characterized in that The method comprises: Determine the device status based on the data collected by the sensor and / or the image acquisition component, wherein the device status is used to determine whether the device is actually used; When the device is in a non-use state, a low power consumption control operation is performed on the device.
2. The method according to claim 1, It is characterized in that The non-use state includes at least one of the following: The device is held in hand and in a hanging position; The device is not in operation and is level; The equipment is not lifted and is in a moving state; The device has the positioning service turned on and is in a stationary state; The screen of the device is awakened and the screen is in an unattended state.
3. The method according to claim 2, It is characterized in that The sensor includes at least one of an accelerometer, a gyroscope, and a positioning system, and determining the device state based on data collected by the sensor includes at least one of the following: When the data collected by the accelerometer and the gyroscope meet a first condition, determining that the device is held by hand and in a hanging state; When the data collected by the accelerometer meets the second condition, determining that the device is not performing any operation and is in a horizontal state; When the data collected by the accelerometer and the gyroscope meet a third condition, determining that the device is not lifted and is in a moving state; When the data collected by the positioning system meets the fourth condition, determining that the device has a positioning service turned on and is in a stationary state; When the device is in a screen-on state and the image acquisition component determines, based on the user's eye movement behavior, that the user has not looked at the screen within a preset time period, it is determined that the screen of the device is awakened and is in a non-looking state.
4. The method according to claim 2, It is characterized in that The performing of a low power consumption control operation on the device comprises at least one of the following: Controlling the CPU of the device to enter a low power consumption state; Relaxing the conditions under which the CPU of the device enters a low power consumption state; Switching the thread scheduling of the device to a low-power CPU; Frequency regulation limits the CPU of the device to not use high energy consumption frequencies; Limiting the size of cache usage of the device; Reducing the frequency of the memory DDR of the device; Controlling the screen of the device to enter a low power consumption state; Reducing the display frame rate and screen refresh rate of the device; reducing the screen brightness of the device; Reducing the touch screen reporting rate of the device; Increase the sensor call interval for the device in question.
5. The method according to claim 1, It is characterized in that After performing low power consumption control on the device, the method further includes: When the device state is changed from the non-use state to the use state, the low power consumption control performed on the device is canceled.
6. The usage status includes at least one of the following: The device is lifted; The device receives a wake-up instruction; The device receives an operation instruction.
7. A device control apparatus, the device include: A first processing unit, configured to determine a device state based on data collected by the sensor and / or the image acquisition component, wherein the device state is used to determine whether the device is actually used; The second processing unit is used to perform a low power consumption control operation on the device when the device is in a non-use state.
8. An electronic device, It is characterized in that include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 6.
9. A non-transitory computer-readable storage medium storing computer instructions, It is characterized in that The computer instructions are used to cause the computer to execute the method according to any one of claims 1-6.
10. A chip, It is characterized in that It includes at least one processor and a communication interface; the communication interface is used to receive a signal input to the chip or a signal output from the chip, and the processor communicates with the communication interface and implements the method as described in any one of claims 1 to 6 through a logic circuit or executing code instructions.
Citation Information
Patent Citations
Terminal screen turn-off control method and apparatus, computer readable storage medium, and terminal
CN108388414A
Power consumption management method and device of mobile terminal and computer readable storage medium
CN114253385A
Mobile terminal and GPS power consumption control method and device thereof, and medium
CN118301716A
Method for reducing GPS power consumption by using acceleration sensor of mobile device
KR1020140094147A
Method for reducing power consumption and electronic device
WO2020155055A1
