Display screen control method and electronic equipment

Abstract

The invention provides a display screen control method and electronic equipment. The method comprises the following steps: the electronic equipment starts detection based on the state of a display screen and the state of a proximity light sensor in combination with the condition of whether user operation is received or not. In the detection process, if the electronic equipment detects the target biological characteristic information, the electronic equipment can control the display screen to change from the semi-screen-off state to the screen-on state. Therefore, the control method of the display screen is provided, so that a user can turn on the display screen of the electronic equipment without operating the electronic equipment. Moreover, the electronic equipment starts detection under the condition that certain conditions are met, so that the power consumption can be effectively reduced while the real-time performance and the high efficiency of detection are ensured.

Description

[0001] This application is a divisional application of the invention patent application with the application number 202110923990.6, the application date of August 12, 2021, and the invention creation name of "Control Method of Display Screen and Electronic Device" submitted to the China National Patent Office. The entire content of the original application is incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal devices, and particularly to a control method of a display screen and an electronic device. Background Art

[0003] Currently, when a mobile phone is in the screen-on state, if no user operation is received within a period of time, the mobile phone will enter the screen-off state. That is to say, if the user expects the mobile phone to continuously maintain the screen-on state, the user needs to touch or perform other operations on the mobile phone before it enters the screen-off state. However, when the user is in a reading scenario or a scenario where it is inconvenient to operate the mobile phone, this way of manually triggering the mobile phone to maintain the screen-on state will affect the user experience. Summary of the Invention

[0004] To solve the above problems, this application provides a control method of a display screen and an electronic device. In this method, the electronic device can control the display screen to turn on based on biometric information, thereby improving the user experience.

[0005] In a first aspect, the present application provides an electronic device. The electronic device includes: one or more processors, a memory, and a fingerprint sensor. And one or more computer programs, where the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, the electronic device is caused to perform the following steps: When the electronic device is in the screen-off state and receives a first user operation. In response to the received first user operation, the electronic device changes from the screen-off state to the screen-on state. When the electronic device is in the screen-on state and no user operation is received within a first duration and the proximity light sensor of the electronic device meets a preset condition, a first detection is started. During the first detection, the electronic device detects biometric information. At a first moment during the first detection, the electronic device changes from the screen-on state to a semi-screen-off state. At a second moment during the first detection, when the electronic device detects first target biometric information, the electronic device changes from the semi-screen-off state to the screen-on state. In this way, the electronic device can monitor the states of various modules and components of the electronic device based on set conditions, so as to start detecting biometric information only when the set conditions are met. Thereby avoiding the problem of excessive system power consumption caused by continuous detection, effectively reducing the system power consumption, and saving battery power consumption. When the specified biometric information is detected, the display screen of the electronic device turns on. Thereby providing a way to control the screen-on of the electronic device, enabling the display screen of the electronic device to turn on without the user's operation, so as to improve the user experience.

[0006] Exemplarily, the preset condition corresponding to the proximity light sensor is that the proximity light sensor is not blocked.

[0007] Exemplarily, if the proximity light sensor does not meet the preset condition, the electronic device does not start the first detection.

[0008] Exemplarily, the first detection may optionally be the detection window in the present application.

[0009] Exemplarily, the first user operation may optionally be the user pressing the power button.

[0010] Exemplarily, the electronic device can collect biometric information through a camera.

[0011] Exemplarily, the frame rate of the camera for collecting biometric information can be 5fps, thereby reducing the system power consumption while ensuring the detection efficiency and real-time performance.

[0012] According to the first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: from the third moment when the electronic device changes from the screen-off state to the screen-on state to the first moment, no user operation is detected, and at the first moment, the electronic device changes from the screen-on state to the semi-screen-off state. In this way, after the electronic device turns on the screen, if no user operation is received within the specified duration, the electronic device changes from the screen-on state to the semi-screen-off state.

[0013] Exemplarily, when in the screen-on state, the brightness of the display screen is the first brightness. When in the semi-screen-off state, the brightness of the display screen is the second brightness, and the second brightness is less than the first brightness.

[0014] Exemplarily, when the display screen of the electronic device is in the screen-on state, what is displayed on the display screen can be the desktop or the application interface.

[0015] According to the first aspect, or any one of the implementation manners of the above first aspect, the duration between the third moment and the first moment is the second duration.

[0016] Exemplarily, the user can set the second duration between the third moment and the first moment in the display and brightness interface.

[0017] Exemplarily, the second duration can be 30 seconds, 1 minute, 5 minutes, 10 minutes, etc.

[0018] According to the first aspect, or any one of the implementation manners of the above first aspect, the duration between the starting moment of the first detection and the first moment is the third duration, and the third duration is less than the second duration. In this way, the electronic device can set the first duration based on different second durations so that the duration between the starting moment of the detection and the moment of semi-screen-off is fixed.

[0019] According to the first aspect, or any one of the implementation manners of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: detecting the first target biometric information and ending the first detection. In this way, after the electronic device detects the biometric information, it can end the current detection to reduce power consumption.

[0020] According to the first aspect, or any one of the implementation manners of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: the electronic device changes from the semi-screen-off state to the screen-on state, no user operation is received within the first duration, and the proximity light sensor meets the preset condition, and the second detection is started. At the fourth moment within the second detection, the second target biometric is detected, and the electronic device is controlled to remain in the screen-on state. In this way, by detecting the biometric information, the electronic device can control the display screen of the electronic device to continuously remain in the screen-on state without the user repeating the operation on the mobile phone, improving the user experience.

[0021] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: detecting a second target biometric feature and ending the second detection.

[0022] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: the electronic device maintains a lit screen state, does not receive a user operation within a first duration, and the proximity light sensor meets a preset condition, and starts a third detection; the third detection duration is a second duration. At a fifth moment within the third detection, a third target biometric feature is detected, and the electronic device is controlled to maintain the lit screen state. In this way, the electronic device can start the detection each time it detects that the set conditions are met, so as to save system power while maintaining the efficiency of the detection.

[0023] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: detecting a third target biometric feature and ending the second detection.

[0024] According to the first aspect, or any implementation of the above first aspect, the duration between the start time of the second detection and a fourth moment is a fifth duration, and the duration between the start time of the third detection and the fifth moment is a sixth duration; the sixth duration is different from the fifth duration.

[0025] Exemplarily, during the process of the user's continuous gaze, the fifth duration and the sixth duration can be equal, for example, both are 1 s.

[0026] Exemplarily, during the process of the user's intermittent gaze, the fifth duration and the sixth duration can be different.

[0027] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: the electronic device changes from a semi-off screen state to a lit screen state, does not receive a user operation within a first duration, and the proximity light sensor meets a preset condition, and starts a fourth detection. At a sixth moment within the fourth detection, an operation of the user pressing the power-on key is detected, and the electronic device changes from the lit screen state to the off screen state. In this way, the user can continue to monitor the states of various modules or components of the electronic device during the detection process. When the power-on key of the electronic device is pressed, the display screen of the electronic device turns off. And this detection ends.

[0028] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: Detecting an operation of the user pressing the power-on key, ending the fourth detection.

[0029] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: The electronic device changes from the semi-off screen state to the on screen state, does not receive a user operation within the first time period, and the proximity light sensor meets a preset condition, starting the fifth detection. At the seventh moment within the fifth detection, receiving a first voice call information, ending the fifth detection. In this way, when the electronic device starts a specific application, the electronic device can avoid detection, thereby further saving power consumption. Exemplarily, the specific application can be a voice application, an application for unlocking an application lock, etc. Exemplarily, after the electronic device answers a voice call, it turns off the screen after a preset time period.

[0030] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: The electronic device changes from the semi-off screen state to the on screen state, does not receive a user operation within the first time period, and the proximity light sensor meets a preset condition, starting the sixth detection; Detecting biometric information within the sixth detection; At the eighth moment within the sixth detection, the electronic device changes from the on screen state to the semi-off screen state; At the ninth moment, the sixth detection ends, and the electronic device changes from the semi-off screen state to the off screen state. In this way, in the case where the electronic device does not detect biometric information, when the electronic device turns off the screen, the detection ends.

[0031] According to the first aspect, or any implementation of the above first aspect, the first target biometric information is human eye feature information. In this way, the present application can identify a human eye gaze to control the on screen state of the display screen when it is determined that the user is gazing at the screen. Thus, an intelligent way to control the on screen state of the display screen is provided, without the user having to operate the electronic device manually, improving the user experience.

[0032] According to the first aspect, or any implementation of the above first aspect, when the computer program is executed by one or more processors, the electronic device is caused to perform the following steps: Displaying a smart perception interface, where the smart perception interface includes a gaze non-screen-off option; Receiving an operation of the user clicking the gaze non-screen-off option, determining that the gaze non-screen-off function is enabled; When the electronic device is in the on screen state, does not receive a user operation within the first time period, and the proximity light sensor of the electronic device meets a preset condition, and the gaze non-screen-off option is enabled, starting the first detection. In this way, when the user enables the gaze non-screen-off function, the electronic device can execute the display screen control method in the present application.

[0033] In a second aspect, the present application provides a method for controlling a display screen. The method includes: when the electronic device is in the screen-off state, receiving a first user operation; in response to the received first user operation, changing from the screen-off state to the screen-on state; when the electronic device is in the screen-on state, if no user operation is received within a first duration and the proximity light sensor of the electronic device meets a preset condition, starting a first detection; within the first detection, detecting biometric information; at a first moment within the first detection, the electronic device changes from the screen-on state to the semi-screen-off state; at a second moment within the first detection, when the first target biometric information is detected, the electronic device changes from the semi-screen-off state to the screen-on state.

[0034] According to the second aspect, for the electronic device to change from the screen-on state to the semi-screen-off state, it includes: from the third moment when the electronic device changes from the screen-off state to the screen-on state to the first moment, no user operation is detected, and at the first moment, the electronic device changes from the screen-on state to the semi-screen-off state.

[0035] According to the second aspect, or any one of the implementation manners of the above second aspect, the duration between the third moment and the first moment is a second duration.

[0036] According to the second aspect, or any one of the implementation manners of the above second aspect, the duration between the start moment of the first detection and the first moment is a third duration, and the third duration is less than the second duration.

[0037] According to the second aspect, or any one of the implementation manners of the above second aspect, the method further includes: when the first target biometric information is detected, ending the first detection.

[0038] According to the second aspect, or any one of the implementation manners of the above second aspect, the method further includes: when the electronic device changes from the semi-screen-off state to the screen-on state, if no user operation is received within a first duration and the proximity light sensor meets the preset condition, starting a second detection; at a fourth moment within the second detection, when the second target biometric feature is detected, controlling the electronic device to remain in the screen-on state.

[0039] According to the second aspect, or any one of the implementation manners of the above second aspect, the method further includes: when the second target biometric feature is detected, ending the second detection.

[0040] According to the second aspect, or any one of the implementation manners of the above second aspect, the method further includes: when the electronic device remains in the screen-on state, if no user operation is received within a first duration and the proximity light sensor meets the preset condition, starting a third detection; the duration of the third detection is the second duration; at a fifth moment within the third detection, when the third target biometric feature is detected, controlling the electronic device to remain in the screen-on state.

[0041] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: detecting a third target biometric feature and ending the second detection.

[0042] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: the duration between the start time of the second detection and a fourth time is a fifth duration, and the duration between the start time of the third detection and a fifth time is a sixth duration; the sixth duration is different from the fifth duration.

[0043] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: when the electronic device changes from a semi-off screen state to a lit screen state, no user operation is received within a first duration, and the proximity light sensor meets a preset condition, starting a fourth detection; at a sixth time within the fourth detection, detecting an operation of the user pressing the power-on key, and the electronic device changes from the lit screen state to the off screen state.

[0044] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: detecting an operation of the user pressing the power-on key and ending the fourth detection.

[0045] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: when the electronic device changes from a semi-off screen state to a lit screen state, no user operation is received within a first duration, and the proximity light sensor meets a preset condition, starting a fifth detection; at a seventh time within the fifth detection, receiving a first voice call message and ending the fifth detection.

[0046] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: when the electronic device changes from a semi-off screen state to a lit screen state, no user operation is received within a first duration, and the proximity light sensor meets a preset condition, starting a sixth detection; detecting biometric information within the sixth detection; at an eighth time within the sixth detection, the electronic device changes from the lit screen state to the semi-off screen state; at a ninth time, the sixth detection ends, and the electronic device changes from the semi-off screen state to the off screen state.

[0047] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: the first target biometric information is human eye feature information.

[0048] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: displaying a smart perception interface, where the smart perception interface includes a gaze non-screen-off option; receiving an operation of the user clicking the gaze non-screen-off option, determining that the gaze non-screen-off function is enabled; when the electronic device is in the lit screen state, no user operation is received within a first duration, and the proximity light sensor of the electronic device meets a preset condition, and the gaze non-screen-off option is enabled, starting a first detection.

[0049] The second aspect and any implementation of the second aspect respectively correspond to the first aspect and any implementation of the first aspect. For the technical effects corresponding to the second aspect and any implementation of the second aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation of the first aspect above, which will not be elaborated here.

[0050] In a third aspect, the present application provides a computer-readable medium for storing a computer program, the computer program including instructions for executing the method in the second aspect or any possible implementation of the second aspect.

[0051] In a fourth aspect, the present application provides a computer program, the computer program including instructions for executing the method in the second aspect or any possible implementation of the second aspect.

[0052] In a fifth aspect, the present application provides a chip, the chip including a processing circuit and transceiver pins. Among them, the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the second aspect or any possible implementation of the second aspect to control the receive pin to receive a signal and control the transmit pin to transmit a signal. Description of the Drawings

[0053] Figure 1 Schematic diagram of the hardware structure of the electronic device shown exemplarily;

[0054] Figure 2 Schematic diagram of the software structure of the electronic device shown exemplarily;

[0055] Figure 3a Schematic diagram of the user interface shown exemplarily;

[0056] Figure 3b Schematic diagram of the user interface shown exemplarily;

[0057] Figure 3c Schematic diagram of the user interface shown exemplarily;

[0058] Figure 4 Schematic diagram of the display screen state of the electronic device shown exemplarily;

[0059] Figure 5 Schematic diagram of the user interface shown exemplarily;

[0060] Figure 6 Schematic diagram of the module interaction shown exemplarily;

[0061] Figure 7 Schematic diagram of the detection condition judgment process shown exemplarily;

[0062] Figure 8 Schematic diagram of the gaze non-screen-off detection process shown exemplarily;

[0063] Figure 9 Schematic diagram of the module interaction shown exemplarily;

[0064] Figure 10 Schematic diagram of the image frame acquisition shown exemplarily;

[0065] Figure 11 Schematic diagram of the recognition process shown exemplarily;

[0066] Figure 12 Schematic diagram of the module interaction shown exemplarily;

[0067] Figure 13 Schematic diagram of the non-screen-off detection shown exemplarily;

[0068] Figure 14 Schematic diagram of the gaze non-screen-off detection shown exemplarily;

[0069] Figure 15a Schematic diagram of the application scenario shown exemplarily;

[0070] Figure 15b Schematic diagram of the display screen state of the electronic device shown exemplarily;

[0071] Figure 16 Schematic diagram of the recognition process shown exemplarily;

[0072] Figure 17 Schematic diagram of the non-screen-off detection shown exemplarily;

[0073] Figure 18 Schematic diagram of the display screen state of the electronic device shown exemplarily;

[0074] Figure 19 Schematic diagram of the non-screen-off detection shown exemplarily;

[0075] Figure 20 Schematic diagram of the non-screen-off detection shown exemplarily;

[0076] Figure 21 Schematic diagram of the display screen state of the electronic device shown exemplarily;

[0077] Figure 22 Schematic diagram of the non-screen-off detection shown exemplarily;

[0078] Figure 23 Schematic diagram of the non-screen-off detection shown exemplarily;

[0079] Figure 24 Schematic diagram of the non-screen-off detection shown exemplarily;

[0080] Figure 25 Schematic structural diagram of the exemplary device shown. Detailed implementation mode

[0081] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present application.

[0082] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone.

[0083] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe the specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, rather than to describe the specific order of the target objects.

[0084] In the embodiments of the present application, words such as "exemplary" or "for example" are used to give examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0085] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" refers to two or more. For example, a plurality of processing units refers to two or more processing units; a plurality of systems refers to two or more systems.

[0086] Figure 1 The schematic structural diagram of the electronic device 100 is shown. It should be understood that Figure 1 The shown electronic device 100 is only an example of an electronic device, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 1The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits. It should be noted that in the embodiments of this application, only the electronic device 100 is described as a mobile phone. The electronic device in the embodiments of this application can also be a device with a display screen such as a tablet, a wearable device, a TV, a smart home device, a vehicle-mounted device, etc., and this application does not make any limitations.

[0087] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0088] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0089] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0090] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may hold the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0091] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0092] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193, etc. through different I2C bus interfaces. For example: The processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 to communicate with the touch sensor 180K through the I2C bus interface to implement the touch function of the electronic device 100.

[0093] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 can be coupled to the audio module 170 through the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface to implement the function of answering a call through a Bluetooth headset.

[0094] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

[0095] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0096] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only illustrative and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0097] The charging management module 140 is used to receive a charging input from a charger. The charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.

[0098] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0099] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0100] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0101] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 can be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be provided in the same device.

[0102] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0103] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be transmitted from the processor 110, perform frequency modulation on them, amplify them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0104] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0105] Electronic device 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0106] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1. Exemplarily, the processor can control the state of the display screen. Optionally, in the embodiments of the present application, the state of the display screen includes a lit screen, a semi-off screen, and an off screen.

[0107] The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, etc.

[0108] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be provided in the camera 193.

[0109] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0110] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0111] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0112] The NPU is a neural-network (NN) computing processor. By learning from the biological neural network structure, such as learning from the transmission pattern between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.

[0113] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0114] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0115] The electronic device 100 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, and the application processor, etc. For example, music playback, recording, etc.

[0116] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0117] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can include at least two parallel plates having a conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

[0118] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake during shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of jitter of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and enables the lens to offset the jitter of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenarios.

[0119] The barometric pressure sensor 180C is used to measure the barometric pressure. In some embodiments, the electronic device 100 calculates the altitude according to the barometric pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0120] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0121] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0122] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0123] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0124] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0125] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0126] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 utilizes the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by low temperature. In some other embodiments, when the temperature is lower than yet another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0127] The touch sensor 180K, also known as the "touch panel". The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch display screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a different position from that of the display screen 194.

[0128] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signals of the vibrating bone mass of the human vocal part. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M to implement the voice function. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 180M to implement the heart rate detection function.

[0129] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys. They can also be touch keys. The electronic device 100 can receive key inputs and generate key signal inputs related to the user settings and function controls of the electronic device 100. Exemplarily, in the embodiments of the present application, the processor can determine whether the non-screen-off condition is met based on the triggering conditions of the proximity sensor, touch sensor, and / or power-on key. Specific details will be described in detail in the following embodiments.

[0130] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations for different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations on different regions of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminder, receiving messages, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0131] The indicator 192 can be an indicator light and can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0132] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of this application, taking the Android system with a layered architecture as an example, the software structure of the electronic device 100 is exemplarily described.

[0133] Figure 2 It is the software structure block diagram of the electronic device 100 in the embodiments of this application.

[0134] The layered architecture of the electronic device 100 divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0135] The application layer can include a series of application packages.

[0136] As Figure 2 shown, the application packages can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, always-on display, etc. Exemplarily, the always-on display application (which can also be simply referred to as the always-on display app) can be used to control the electronic device to perform always-on display detection and can control the electronic device to be always-on, that is, in the lit screen and unlocked state.

[0137] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0138] As Figure 2As shown in the figure, the application framework layer may include a window manager, a view system, a resource manager, a sensing service, an input management service (Input Manager Service), an AO (always on) service, a trusted execution environment (TEE), a power management service, etc.

[0139] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0140] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0141] The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, and so on.

[0142] The input management service is used to manage the input part of the entire system, including keys (such as the HOME key, power-on key, etc.), keyboards, mice, touchscreens, and so on.

[0143] The power management service is used for the always-on application system interface, which enables the always-on application to control the display screen of the electronic device not to turn off through the interface provided by the power management service.

[0144] The AO service, also known as the low-power AO service, is started after being triggered by the sensing service in the always-on application. It can identify whether there is a human eye gaze through pre-stored detection algorithms, such as face recognition algorithms and human eye gaze recognition algorithms. And after identifying that there is a human eye gaze, it reports the recognition result to the sensing service.

[0145] The sensing service is used for subscription management and providing interfaces, etc. Exemplarily, the sensing service can be called by multiple applications or services. The sensing service can establish corresponding processes for each application or service through subscription management, and transmit the data uploaded by the underlying module to different applications or services according to the processes corresponding to the application or service. Exemplarily, the sensing service can provide an interface for upper-layer applications to call the underlying module according to the needs of the application. For example, the sensing service can receive an indication signal from the always-on application through the interface between the sensing service and the always-on application. In response to the indication of the always-on application, the sensing service can call the corresponding module or service through the interface between the sensing service and other modules or services. For example, in response to the indication of the always-on application, it calls the input management service, the power management service, etc.

[0146] The TEE is used to isolate highly security-sensitive applications from the general software environment, provide a dedicated trusted execution environment TEE, and protect the confidentiality, integrity, and access rights of the resources and data of the applications. The applications executed on the TEE side are called trusted applications (TAs), such as applications that execute key services like signature, encryption, and decryption calculations. Since the TA runs in the trusted execution environment TEE, the deployment / upgrade operations of the TA need to strictly follow the security verification specifications of the TEE issuer (usually the terminal manufacturer), such as using measures like digital signatures to ensure that all aspects of the TEE are truly trustworthy. Optionally, in the embodiments of the present application, the TEE can be used to store the images captured by the camera to protect user privacy. The AO service can detect the graphics in the TEE based on the detection algorithm to determine whether the image includes a human face and whether there is a gaze. Specific details will be described in the following embodiments.

[0147] The Android Runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0148] The core libraries include two parts: one part is the functional functions that the Java language needs to call, and the other part is the core libraries of Android.

[0149] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of the object lifecycle, stack management, thread management, security and exception management, and garbage collection.

[0150] The system libraries can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing libraries (such as: OpenGL ES), 2D graphics engines (such as: SGL), etc.

[0151] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0152] The media libraries support the playback and recording of a variety of common audio and video formats, as well as static image files, etc. The media libraries can support a variety of audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0153] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0154] The 2D graphics engine is a graphics engine for 2D drawing.

[0155] The kernel layer is the layer between the hardware and the software. The kernel layer includes at least a display driver, a camera driver, a Bluetooth driver, a sensor driver, etc.

[0156] It can be understood that Figure 2 The components included in the illustrated application framework layer, system library, and runtime layer do not constitute a specific limitation on the electronic device 100. In some other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements.

[0157] Figure 3a It is a schematic diagram of the user interface shown for illustration. Please refer to FIG. 3. Exemplarily, the display and brightness interface 301 includes one or more options. The options include but are not limited to: font size and thickness, display size, screen options 302, etc. It should be noted that due to the display size of the interface, the options shown in the display and brightness interface 301 are only some of the options in the display and brightness settings.

[0158] Exemplarily, the screen options 302 include one or more options, including but not limited to: sleep option 303, color adjustment and color temperature, screen resolution, and more display settings options. Among them, the sleep option 303 is used to set the screen off time. For example, when the sleep option 303 currently indicates that the sleep duration is 10 minutes, that is to say, the mobile phone will turn off the screen after 10 minutes when the screen is on and there is no user operation (including touch operations, button operations, etc.).

[0159] Still referring to Figure 3a , exemplarily, the user clicks on the sleep 303 option. Please refer to Figure 3b , in response to the received user click operation, the mobile phone displays a sleep option box 306 at the lower part of the display and brightness interface 301. It should be noted that the size and position of the sleep option box 306 are only for illustrative purposes and are not limited in this application.

[0160] Exemplarily, the sleep option box 306 includes but is not limited to: 15 - second option, 30 - second option 306, 1 - minute option, 5 - minute option, 10 - minute option, and cancel option 307. It should be noted that the values and quantities of the options are only for illustrative purposes and are not limited in this application. If the user clicks on the cancel option 307, the electronic device cancels the display of the sleep option box 306 in response to the received user operation.

[0161] Exemplarily, the user clicks on the 30 - second option 306. Please refer to Figure 3c, in response to the received user operation, the mobile phone displays the updated sleep parameters in the sleep option 303 in the display and brightness interface 301, that is, it displays "after 30 seconds". For example, please refer to Figure 4 of (1), the mobile phone displays the desktop. It should be noted that the mobile phone may enter the desktop from the lock screen interface or transfer from other applications to the desktop. For example, the mobile phone enters the desktop in response to the received user unlocking operation. The mobile phone starts detecting whether it has received a user operation from the moment of the last (which can also be understood as the latest) received user operation. Optionally, as Figure 4 shown in (2) of, if no user operation is received within 24s, the mobile phone enters the semi-screen-off mode. It can be understood that the display screen of the mobile phone dims. The degree of dimming of the display screen can be set according to actual needs, and this application does not make any limitations. It should be noted that when the mobile phone is in the semi-screen-off mode, all applications and modules in the mobile phone operate normally. For example, in the semi-screen-off mode, the mobile phone can still receive user operations, and in response to the received user operation, the screen lights up again.

[0162] Please refer to Figure 4 of (3), exemplarily, when the mobile phone is in the semi-screen-off mode, if no user operation is detected within 6s, the mobile phone enters the screen-off mode. Optionally, the screen-off mode can be understood as the mobile phone being locked, and the display screen of the mobile phone is turned off (i.e., black screen).

[0163] However, in some scenarios, when the user is using the mobile phone but unable to operate it, if the user expects the mobile phone to light up, and due to the mobile phone setting the sleep mode, the mobile phone will turn off the screen after 30 seconds without operation. For example, if the user browses recipes using the mobile phone during cooking. At this time, it is inconvenient for the user to operate the mobile phone at any time, and the mobile phone will go to sleep after detecting that the user has no operation within 30 seconds. The current way to solve this problem is to change the sleep option, such as selecting a longer sleep duration or choosing not to sleep. But in fact, in more scenarios: the user has already started cooking and is unable to operate the mobile phone with hands, and at this time, it is inconvenient for the user to change the sleep option. In this case, it will affect the user experience.

[0164] In the embodiment of the present application, a method for realizing non-screen-off is provided, which can control the mobile phone not to turn off the screen under the condition of meeting the non-screen-off condition, so as to improve the user experience. Figure 5 is a schematic diagram of the user interface shown exemplarily. Please refer to Figure 5 , exemplarily, the intelligent perception interface 501 includes but is not limited to an intelligent non-screen-off option box and an air gesture option box. Optionally, the intelligent non-screen-off option box includes but is not limited to: a gaze non-screen-off option 502, a sound non-screen-off option 503, and an occlusion non-screen-off option 504.

[0165] Exemplarily, if the user can click the option 502 of staying awake while being stared at to trigger the function of staying awake while being stared at, in the embodiments of the present application, after the mobile phone responds to the received user operation and starts the function of staying awake while being stared at (which can also be called the service of staying awake while being stared at), the mobile phone will control the mobile phone to remain in the lit screen state based on the detected user's stare. Specific embodiments will be described in the following embodiments and will not be elaborated here for the time being.

[0166] Exemplarily, if the user clicks the option 503 of staying awake while there is sound, in the embodiments of the present application, after the mobile phone responds to the received user operation and starts the function of staying awake while there is sound, the mobile phone will control the mobile phone to remain in the lit screen state based on the detected sound.

[0167] Exemplarily, if the user clicks the option 504 of staying awake while being blocked, in the embodiments of the present application, after the mobile phone responds to the received user operation and starts the function of staying awake while being blocked, the mobile phone will control the mobile phone to remain in the lit screen state based on the blocking situation where the proximity light sensor is blocked.

[0168] It should be noted that in the embodiments of the present application, only the examples of staying awake while being stared at, staying awake while there is sound, and staying awake while being blocked are used for illustration. That is to say, the mobile phone can judge whether to keep the screen lit based on conditions such as whether it is stared at, whether a specific sound is monitored, and whether it is detected as being blocked. In other embodiments, the mobile phone can also be based on other conditions, such as whether blinking is detected, whether a specific gesture is detected, whether a knock is detected, etc., to control the lit screen state of the display screen, and the present application does not make any limitations. Correspondingly, different options corresponding to different conditions can be displayed in the intelligent non-screen-off option box, for example, it can include the option of staying awake while blinking, etc.

[0169] It should be further noted that as described above, the intelligent non-screen-off option box optionally includes multiple options, and the user can choose not to turn on any of them, or can choose to turn on one or more options, and the present application does not make any limitations. For example, if the user turns on the option 502 of staying awake while being stared at and the option 503 of staying awake while there is sound, then the mobile phone can, during the detection process, control the mobile phone to remain in the lit screen state after detecting the user's stare and / or receiving the specified sound.

[0170] Figure 6 For the schematic diagram of module interaction shown by way of example. Please refer to Figure 6, Exemplarily, take the user clicking on the option 502 of "do not turn off the screen when gazing" as an example. The do not turn off the screen application (which can also be referred to as the intelligent do not turn off the screen application) receives the user operation. The do not turn off the screen application sends indication information to the perception service through the interface between the two, for indicating the perception service to start the judgment process of the detection conditions. Optionally, the "judgment process of the detection conditions" in the embodiments of the present application optionally refers to judging the conditions for whether to start the gaze do not turn off the screen detection. When all the detection conditions are met, the mobile phone will start the gaze do not turn off the screen detection. If the detection conditions are not met, the gaze do not turn off the screen detection will not be started. It can be understood that the detection conditions are the prerequisite conditions for performing the gaze do not turn off the screen detection. The sound detection is similar to the occlusion detection and will not be elaborated here.

[0171] Exemplarily, after the perception service is started in response to the indication of the do not turn off the screen application, it can obtain the states of the proximity light sensor, the touch sensor, and the keys through the input management service. Also, the perception service can obtain the state of the display screen through the display driver. The perception service can combine the obtained states of each module (or device) to judge whether the detection conditions are met.

[0172] Combined with Figure 6 , Figure 7 For the judgment process of the detection conditions shown exemplarily. Please refer to Figure 7 , the specific process for the perception service to judge whether the detection conditions are met includes:

[0173] S701, the perception service judges whether the screen is on.

[0174] Exemplarily, please refer to Figure 6 , the perception service, in response to the indication of the do not turn off the screen application, obtains the state of the display screen through the display driver. Optionally, the screen state can include the screen off state, the semi-screen off state, and the screen on state. Among them, the screen on state further includes the locked screen and the unlocked screen. For example, when the mobile phone is in the screen off state and receives the operation of the user clicking the power button, after the mobile phone unlocks through face recognition, the desktop is displayed, and at this time the display screen is in the screen on state. Exemplarily, when the mobile phone is in the screen off state and receives the operation of the user clicking the power button, when the face recognition result is not successful, the locked screen interface is displayed, and at this time the display screen is in the screen on state. Another example, in the locked screen mode (the display screen is on), if no user operation is received within a specified duration (for example, 20s, which can be set according to actual needs and is not limited in this application), the locked screen interface becomes the semi-screen off state, and after no user operation is received within 3s (which can be set according to actual needs and is not limited in this application), it enters the screen off mode, that is, the display screen turns off.

[0175] Please continue to refer to Figure 6, Exemplarily, the sensing service can obtain the state of the display screen through the display driver to determine whether the state of the display screen is on. In one example, if the display screen is currently on, then S702 is executed. In another example, if the display screen is currently off or in a semi-off state, it is determined that the detection condition is not met, and this judgment process ends.

[0176] Optionally, in the embodiments of the present application, after the sensing service is started, it can trigger the display driver to report the state of the display screen in real time. For example, the sensing service can send an indication message to the display driver to instruct the display driver to report the state of the display screen to the sensing service.

[0177] S702, the sensing service determines whether the proximity light sensor is blocked.

[0178] Exemplarily, please refer to Figure 6 , the sensing service can send an indication message to the input manager to instruct the input manager to obtain the states of the proximity light sensor and the touch sensor from the sensor driver, and, obtain the state of a key (such as the power-on key) from the key driver. In response to the indication of the sensing service, the input management service obtains the states of the proximity light sensor and the touch sensor in real time through the sensor driver, and obtains the state of the key in real time through the key driver.

[0179] For example, if the user places the mobile phone face down on the table or puts the mobile phone in the pocket, the proximity light sensor will be blocked. After the proximity light sensor detects the blockage, it sends a detection signal to the sensor driver. The sensor driver can determine that the proximity light sensor is blocked based on the received detection signal, that is, there is a proximity light sensor blockage event. The sensor driver can output the proximity light sensor blockage event to the input management service. In response to the received proximity light sensor blockage event, the input management service determines that the proximity light sensor is blocked. The input management service instructs the sensing service that the proximity light sensor is blocked.

[0180] Exemplarily, if the proximity light sensor is not blocked, optionally, the proximity light sensor may not output a detection signal. That is to say, the sensor driver determines that there is no proximity light blockage event when it does not receive the detection signal sent by the proximity light sensor. It should be noted that Figure 7 The "end" step shown is optionally that the sensing service ends this judgment process when it determines that a certain condition is not met. After this process ends, the sensing service re-executes S701, which will not be repeated hereinafter.

[0181] S703, the sensing service determines whether it has been unlocked.

[0182] Exemplarily, please refer to Figure 6, the sensing service can obtain the current state of the display screen through the display driver. When it is determined that the display screen is on and the proximity light sensor is not blocked, the sensing service can further obtain whether the display screen is currently in an unlocked state through the display driver. It should be noted that the steps executed by the modules in the embodiments of the present application are only illustrative examples. For example, in other embodiments, the sensing service can also obtain the display state or the unlocked state of the display screen through other modules, and the present application does not make any limitations.

[0183] In one example, if the sensing service obtains that the mobile phone is currently unlocked, for example, the mobile phone currently displays the desktop, or the mobile phone currently displays a game application (it can also be other applications, and the present application does not make any limitations), then S704 is executed. In another example, if the sensing service determines that the mobile phone is not unlocked, for example, the mobile phone screen is on but in the locked screen mode, the current judgment process ends.

[0184] S704, the sensing service determines whether to start a set application.

[0185] Exemplarily, the sensing service can retrieve information of the foreground application. Exemplarily, the "foreground application" is optionally an application that is currently running and displayed on the display screen. For example, the display interface of the mobile phone currently displays a video application and a document, and both the document and the video application are foreground applications. Of course, in some embodiments, the "foreground application" is optionally an application that is running, displayed on the display screen, and the last application operated by the user. The present application does not make any limitations.

[0186] Exemplarily, the sensing service can determine whether the foreground application is a specified application according to the retrieved information of the foreground application. In the embodiments of the present application, when the mobile phone starts some specified applications, the mobile phone can determine that the detection conditions are not met, that is, there is no need to perform subsequent non-screen-off detection. For example, if the foreground application is a voice call application, correspondingly, when the user uses the voice call, even if the mobile phone screen is off, it will not affect the voice call application. Therefore, for the voice call application, it is not necessary to start the non-screen-off detection process. Of course, the specified applications can include other one or more applications (or functions, or services) in addition to voice calls. For example, if the mobile phone is running a video application and the video application is full-screen displayed. At this time, when the application lock is enabled in the full-screen display of the video application, the mobile phone will continuously keep the screen on and not locked. Another example is that if the mobile phone is running a video conference application, optionally, the video conference application automatically enables the application lock after startup. After the sensing service detects the startup of the video conference application, the current detection process ends. It should be noted that the specified applications in the embodiments of the present application are only illustrative examples. In other embodiments, the specified applications can also be applications that require the screen to continuously remain on and unlocked, and the present application does not make any limitations.

[0187] In one example, if the sensing service detects that the specified application is launched, this process ends. Optionally, after the specified application ends its operation, the sensing service resumes execution from S701.

[0188] In another example, if the sensing service detects that the specified application is not launched, S705 is executed.

[0189] It should be noted that in the embodiments of the present application, the determination order of the conditions for S702 - S704 is not limited. For example, the sensing service can first determine whether it is unlocked and then determine whether the proximity light sensor is blocked. In the embodiments of the present application, the sensing service can also detect each condition simultaneously, and the present application does not make any limitations.

[0190] S705, the sensing service determines whether there is a user operation within a preset duration.

[0191] Exemplarily, please refer to Figure 6 , as described above, the sensing service can determine whether there is a user operation through the input management service. User operations include, but are not limited to, operations such as touching the display screen and pressing the power-on key. For example, if the user clicks on the touch screen, the touch sensor will detect the user's click operation and output a detection signal to the sensor driver. In response to the received detection signal, the sensor driver determines that there is a touch event. The sensor driver outputs the touch event to the input management service. Based on the received touch event, the input management service determines that there is a current user touch operation and sends an indication message to the sensing service to indicate that there is a current user touch operation. Correspondingly, the sensing service determines that there is a user touch operation and this detection process ends. Another example, if the user presses the power-on key, the key driver will detect that the key is pressed, and the key driver outputs a power-on key press event to the input management service. In response to the received event, the input management service sends an indication message to the sensing service to indicate that there is a current power-on key press operation. Correspondingly, the sensing service determines that there is a user operation of pressing the power-on key and this detection process ends.

[0192] Exemplarily, the sensing service can preset a user operation detection duration. As Figure 3bAs shown, in the embodiments of the present application, the mobile phone can provide several sleep options, including a 15-second option, a 30-second option 306, a 1-minute option, a 5-minute option, and a 10-minute option. Correspondingly, according to the different sleep durations, the corresponding user operation detection durations are also different. For example, taking a sleep duration of 30 seconds as an example, starting from the last operation when the mobile phone is in the screen-on state, if no user operation is received within 24 seconds, the mobile phone enters the semi-screen-off mode. In the semi-screen-off mode, if no user operation is received within 6 seconds, the mobile phone enters the screen-off mode. It should be noted that the duration settings described in the embodiments of the present application are only illustrative examples, and the present application does not make any limitations, and will not be repeated hereinafter. Exemplarily, in the scenario where the sleep duration is 30s, the mobile phone executes S701 to S704. That is, when the sensing service detects that the mobile phone is in the screen-on state, unlocked state, has not started any specified application, and the proximity light sensor is not blocked, the sensing service starts to monitor whether a user operation is received and continuously monitors for 19s. That is to say, in the case of a sleep duration of 30s, the corresponding preset duration (i.e., the continuous duration for detecting whether a user operation is received) is 19s. Optionally, if within 19s, the sensing service does not receive any user operation indicated by the input management service, then the sensing service determines that no user operation is received within the preset duration and starts the non-screen-off detection process, that is, executes S706. Optionally, if within 19s, the sensing service detects a user operation, then this process ends and S701 is repeatedly executed. Optionally, if within 19s, the sensing service detects that the proximity light sensor is blocked, for example, the user places the front of the mobile phone on the desktop or puts the mobile phone in the pocket, then the sensing service ends this process and S701 is repeatedly executed. It can be understood that in the case of a 30s sleep, the sensing service starts the non-screen-off detection 5s before entering the semi-screen-off state, thereby reducing the system power consumption while ensuring the real-time detection.

[0193] S706, the sensing service starts to detect.

[0194] Exemplarily, still referring to Figure 6 , after the sensing service detects that the detection conditions are met, that is, all the conditions in S701 to S705 are met, the sensing service sends an indication message to the non-screen-off application to indicate that the detection conditions are met. Exemplarily, in response to the indication message sent by the sensing service received, the non-screen-off application determines that all the detection conditions are met and can start the non-screen-off detection. The non-screen-off application can send an indication message to the sensing service to indicate the start of the non-screen-off detection. Optionally, the non-screen-off application can, based on the user's selection, indicate to the sensing service which specific non-screen-off detection to start. It should be noted that for different detection types, the corresponding detection conditions can be the same or different. For example, if the user is in Figure 5If the selection in Figure 5 includes the option of staying awake when looking, the stay-awake application sends indication information to the perception service to indicate the perception service to start the stay-awake detection when looking. If the user is in

[0195] S707, the perception service determines whether the stay-awake condition is met.

[0196] As described above, the stay-awake conditions corresponding to different stay-awake detections may be different. Here, the scenario of staying awake when looking is taken as an example for illustration. Please refer to Figure 8 , for example, after the perception service starts the stay-awake detection in response to the indication of the stay-awake application, it performs the detection based on multiple conditions corresponding to the stay-awake function when looking. The stay-awake conditions when looking include but are not limited to at least one of the following:

[0197] 1) During the detection, no voice call is running;

[0198] 2) During the detection, no touch operation is detected.

[0199] 3) During the detection, no lock screen operation is detected.

[0200] 4) During the detection, the foreground application does not start the application lock.

[0201] 5) During the detection, the proximity light sensor is not continuously blocked.

[0202] 6) During the detection, a look is detected.

[0203] It should be noted that only the above conditions are taken as examples in the embodiments of the present application. In other embodiments, more or fewer conditions may be included, and the present application does not make any limitations.

[0204] Furthermore, it should be noted that the perception service may be set with a detection duration. In the embodiments of the present application, for different sleep durations, the corresponding detection durations may be the same or different. For example, if the sleep duration is 15 s, the corresponding detection duration may optionally be 7 s. If the sleep duration is 30 s, the corresponding detection duration may optionally be 11 s. If the sleep duration is 1 minute, 2 minutes, 5 minutes or 10 minutes, the corresponding detection duration may be 11 s. The above values are only for illustrative examples and can be set according to actual needs, and the present application does not make any limitations.

[0205] Exemplarily, in the embodiments of the present application, the sensing service performs detection based on the above conditions. When any one of conditions 1) to 5) is not satisfied, the current detection process ends, and S701 is repeatedly executed. When condition 6) is satisfied, that is, when the sensing service determines that there is a gaze, the sensing module notifies the non-screen-off application that the gaze non-screen-off condition is met, and the non-screen-off application can control the phone to turn on the screen.

[0206] In a possible implementation manner, the voice non-screen-off conditions include but are not limited to at least one of the following:

[0207] 1) During the detection period, no voice call is in progress;

[0208] 2) During the detection period, no touch operation is detected.

[0209] 3) During the detection period, no lock screen operation is detected.

[0210] 4) During the detection period, the foreground application does not activate the application lock.

[0211] 5) During the detection period, the proximity light sensor is not continuously blocked.

[0212] 6) During the detection period, a specified sound is detected.

[0213] Exemplarily, the descriptions of conditions 1) to 5) can be referred to the above text and will not be elaborated here. Optionally, the specified sound can have a voice command with specified content. For example, when the user says "turn on the screen" to the phone, the phone can respond to the detected voice and keep the screen on.

[0214] In another possible implementation manner, the occlusion non-screen-off conditions include but are not limited to at least one of the following:

[0215] 1) During the detection period, no voice call is in progress;

[0216] 2) During the detection period, no touch operation is detected.

[0217] 3) During the detection period, no lock screen operation is detected.

[0218] 4) During the detection period, the foreground application does not activate the application lock.

[0219] 5) During the detection period, the proximity light sensor is not continuously blocked.

[0220] 6) During the detection period, the proximity light sensor is blocked a specified number of times.

[0221] Exemplarily, the descriptions of conditions 1) to 5) can be referred to the above, and will not be elaborated here. Exemplarily, the number of times the proximity light sensor is blocked can be optionally once or more than once, and the duration of each block is less than a set threshold (for example, 1 s). For example, the user can wave a palm at the display screen. During the waving process, the proximity light sensor is blocked multiple times, and the duration of each block is less than the set threshold, then the requirement of condition 6) is met. It should be noted that in the embodiments of the present application, the detection of not turning off the screen when gazing is used as an example for illustration. The implementation methods of not turning off the screen when there is sound and not turning off the screen when blocked can refer to the specific content of the detection of not turning off the screen when gazing, and the present application will not give examples one by one.

[0222] The following takes the detection of the condition of not turning off the screen when gazing as an example for illustration. In combination with Figure 8 , Figure 9 is a schematic diagram of module interaction shown exemplarily. Please refer to Figure 9 , exemplarily, the sensing service starts to detect the condition of not turning off the screen when gazing in response to the indication of the not-turning-off-screen application. The sensing service can obtain the states of the proximity light sensor, the touch sensor, and the power-on key through the input management service to determine whether there is a user operation. The specific description can be referred to the above, and will not be elaborated here.

[0223] In one example, if the sensing service detects the existence of operations such as a touch operation or a screen locking operation based on the information input by the input management service, or detects that the proximity light sensor is continuously blocked, the sensing service determines that the condition of not turning off the screen when gazing is not met, and re-executes S701. For example, if during the detection period, the user places the mobile phone on the desktop, causing the proximity light sensor to be blocked, then after the sensing module detects that the proximity light sensor is continuously blocked (for example, for more than 3 s, which can be set according to actual needs and is not limited in the present application), the detection of the condition of not turning off the screen when gazing is stopped, and S701 is re-executed. Exemplarily, if during the detection period, the sensing service detects that the user presses the power-on key or touches the screen, the sensing service stops the detection of the condition of not turning off the screen when gazing, and re-executes S701.

[0224] In another example, the sensing service can monitor whether the voice application is started, and the sensing service can monitor whether the foreground application has an application lock. The specific description can be referred to the above, and will not be elaborated here.

[0225] Please continue to refer to Figure 9, exemplarily, taking the case where the perception service determines that all of the above conditions 1) to 5) are satisfied during detection as an example. The perception service starts detection in response to the received information indicating the start of detection of the non-screen-off application. During the detection, while the perception service continuously detects whether conditions 1) to 5) are satisfied, the perception service instructs the AO service to perform gaze detection. The AO service, in response to the instruction from the perception service, instructs the camera driver to start the camera and outputs the image captured by the camera to the TEE. The camera driver, in response to the instruction from the AO service, obtains the image captured by the camera from the camera and outputs the captured image to the TEE.

[0226] Please refer to Figure 10 , exemplarily, still taking the detection duration of 11s as an example. In the embodiments of the present application, the camera driver can output image frames to the TEE at a frame rate of 5fps (i.e., the number of image frames captured per second), thereby reducing the occupancy of the TEE while ensuring timeliness. Among them, 5fps can optionally be that the camera outputs 5 image frames to the TEE per second. This value is only for illustrative purposes and is not limited in the present application.

[0227] Still refer to Figure 10 , exemplarily, in the embodiments of the present application, the frame rate of the camera can optionally be 60fps, that is, the number of image frames captured per second can optionally be 60. The camera driver can obtain an image frame from the camera every 200ms, output it to the TEE, and continue for 11s (i.e., the detection duration). Optionally, in other embodiments, the camera driver can also control the frame rate of the image captured by the camera. For example, the camera can capture images based on a frame rate of 5fps, that is, capture an image frame every 200ms and output it to the camera driver. The frame rate is only for illustrative purposes and is not limited in the present application.

[0228] Still refer to Figure 9 , exemplarily, the TEE obtains the image frames captured by the camera from the camera driver. For example, the TEE can obtain 5 image frames from the camera driver every 1 second. The AO service can identify the images in the TEE based on a preset detection algorithm (which can also be called an identification algorithm).

[0229] Figure 11 Schematic diagram of the identification process shown exemplarily. Please refer to Figure 11, Exemplarily, the camera driver outputs an image frame to the TEE. The AO service performs recognition on the image frame in the TEE based on a face detection algorithm to detect whether the image frame includes a single human face. Optionally, if the image frame does not include a face or includes multiple human faces, the AO service determines that the recognition of the image frame fails and continues to process the next image frame. Optionally, in the embodiments of the present application, after the AO service recognizes an image frame, the recognized image frame is deleted from the TEE. Optionally, the AO service can also delete the 5 recognized image frames (it can also be other quantities, which are not limited in the present application) after recognizing every 5 image frames, so as to reduce the TEE occupancy and further improve the security of user privacy.

[0230] , Exemplarily, if the AO service detects that the image frame includes a single human face, the AO service, based on a gaze detection algorithm, recognizes whether the human eyes in the single human face are gazing. For example, assume that the user is facing the mobile phone, but the user's gaze is directed to other places outside the mobile phone. Correspondingly, the image captured by the camera includes the user's face. The AO service recognizes a single human face based on the face detection algorithm. During the gaze detection process, if the AO service recognizes that the user is not gazing at the mobile phone, it determines that the current recognition fails and continues to process the next image frame. Exemplarily, if the user is facing the mobile phone and the user is gazing at the display screen. Correspondingly, the image captured by the camera includes the user's face. The AO service recognizes a single human face based on the face detection algorithm. During the gaze detection process, if the AO service recognizes that the user is gazing at the mobile phone, it determines that the gaze detection is successful. It should be noted that the specific details of the algorithm can refer to the prior art and will not be elaborated in the present application.

[0231] Still referring to Figure 9 , Exemplarily, when the AO service determines that the gaze detection is successful and, at the same time, when the above-mentioned conditions 1) to 5) are all satisfied, the AO service determines that the gaze non-screen-off condition is met. The AO service sends an indication message to the non-screen-off application for indicating that the gaze non-screen-off condition is met.

[0232] Please refer to Figure 12 , Exemplarily, in response to the indication message received from the perception service, the non-screen-off application determines that the non-screen-off condition is met. The non-screen-off application sends an indication message to the perception service for indicating to turn on the screen. In response to the received indication message, the perception service sends an indication message to the power management service through the interface provided by the power management service for indicating to control the display screen to turn on. In response to the indication from the perception service, the power management service controls the display screen to turn on through the display driver. In the embodiments of the present application, "the display screen turns on" can optionally be that the display screen is currently in the on state and controls the display screen to continue to be in the on state. Or, it can also be that the display screen is currently in the semi-screen-off state and controls the display screen to enter the on state. Specific examples will be described in detail in the following embodiments.

[0233] Exemplarily, after the sensing service turns on the display screen, it repeatedly executes S705, that is, continues to monitor whether there is a user operation within a preset duration, and after detecting no operation within the preset duration, continues to execute the gaze non-screen-off monitoring process. Exemplarily, if the sensing service determines that the gaze non-screen-off condition is not met, the current process ends, and the sensing service repeatedly executes S701.

[0234] Next, a specific example is used to elaborate on the non-screen-off solution in the embodiments of the present application. Exemplarily, still taking the user's selection to enable the gaze non-screen-off function as an example for illustration. Figure 13 It is a schematic diagram of non-screen-off detection shown exemplarily. Please refer to Figure 13 , Exemplarily, at time T0, the mobile phone responds to the received user's unlocking operation and enters the desktop from the locked screen mode (or the screen-off mode). This scenario is only an exemplary example. The scenario where the mobile phone enters the screen-on state can also be that the mobile phone enters the desktop after exiting from other applications; or, the user has been using the mobile phone, and starting from time T0, the mobile phone is in the screen-on state and there is no user operation.

[0235] Exemplarily, at time T0, the sensing module executes S701 to S704. After S701 to S704 are all satisfied, the sensing module continues to execute S705, that is, detects whether a user operation is received within a preset duration (for example, 19s). The specific detection process can refer to Figures 6 - 7 the relevant content, which will not be elaborated here. In this example, it is described by taking the sensing service not detecting a user operation within 19s as an example.

[0236] At time T1, in combination with Figure 9 , the sensing service responds to the indication of the non-screen-off application and starts to perform gaze non-screen-off detection. It can also be understood that the sensing service starts a detection window, and within the detection window, it detects whether the gaze non-screen-off condition is met. Optionally, taking the sleep duration as 30s as an example, the time difference between the start edge (or rising edge, that is, time T1) of the detection window and the start time of semi-screen-off (that is, time T2) is 5s, and the duration of the detection window is 11s, that is, the end edge (that is, the falling edge, that is, time T3) of the detection window is the same as the end time of the semi-screen-off mode. The specific detection process can refer to Figures 9 - 11 the relevant content, which will not be elaborated here. That is to say, the sensing service can start detection 5s before the mobile phone enters the semi-screen-off state and continue to detect when the mobile phone remains in the semi-screen-off state. It should be noted that the various times and durations in the embodiments of the present application are only exemplary examples, and the present application does not make any limitations, and will not be repeated in the following text

[0237] Exemplarily, at Figure 13In a scenario where the user has not been looking at the mobile phone, for example, correspondingly, during the detection period of the perception service (i.e., within 11 seconds), the user's gaze is not detected, so it is determined that the gaze non-screen-off condition is not met. Optionally, please refer to Figure 9 For example, the perception service may send indication information to the AO service to instruct the AO service to stop gaze detection. In response to the indication of the perception service, the camera driver instructs the camera to stop capturing images. Of course, if the camera driver and the camera are being called by other applications, the camera driver and the camera can continue to work, and the camera driver stops transmitting image frames to the TEE.

[0238] Still referring to Figure 13 For example, the mobile phone maintains the semi-screen-off state for 6 seconds and enters the screen-off mode, that is, the screen-off interface is displayed. The current detection process of the perception service ends, and S701 is executed again. That is, after the mobile phone lights up again, the above steps are repeated.

[0239] Figure 14 Another schematic diagram of non-screen-off detection shown by way of example. Please refer to Figure 14 For example, the description of the time points T0 to T2 can refer to the above text and will not be elaborated here. At time point T3, the user is facing the mobile phone and looking at the mobile phone display screen. At this time, the mobile phone is already in the semi-screen-off state, as Figure 15a shown.

[0240] Combined with Figure 9 For example, the camera driver outputs the image frames captured by the camera to the TEE. Please refer to Figure 16 For example, at time point T3, which can also be understood as the 8th second after the start of this detection window, the image frame 3 captured by the camera includes the user's face image. Still referring to Figure 9 For example, during the detection of the image frame 3 by the AO service, it is determined that the image frame 3 includes a single face, and based on the gaze detection algorithm, it is determined that there is a user's gaze. The AO service may indicate to the perception service that there is a current user's gaze. In response to the indication of the AO service, the perception service sends indication information to the non-screen-off service to indicate that the non-screen-off condition is met. In response to the indication of the perception service, the non-screen-off application determines that the gaze non-screen-off condition is met. Correspondingly, the non-screen-off application may instruct the perception service to control the display screen to light up. The specific interaction process of each module can refer to the relevant description in Figure 12 and will not be elaborated here. As Figure 15bAs shown, exemplarily, at time T4, the display screen of the mobile phone enters the lit screen state from the semi-off state. It should be noted that the delay (including camera capture delay and algorithm delay) in the embodiments of the present application is only for illustrative purposes. Optionally, the algorithm delay can be in milliseconds. For example, the user gazes at the screen at time T3, and the camera starts capturing image frame 3 200 ms (or less than 200 ms) after T3. Image frame 3 includes the user's image. The AO service recognizes image frame 3, and after recognizing the human eye, the perception service controls the display screen to light up at time T4 based on the recognition result of the AO service. Optionally, the interval between time T3 and time T4 is optionally at the millisecond level. The delay shown in the drawings of the embodiments of the present application is only for illustrative distance, and the present application does not make any limitations.

[0241] For example, the user gazes at the display screen at time T3, but due to delays such as camera capture and algorithms, the display screen lights up at time T4 (1 s after T3).

[0242] Figure 17 Another non-off screen detection schematic diagram is exemplarily shown. Exemplarily, in this scenario, the example of the user intermittently gazing at the mobile phone screen is used for illustration. It should be noted that Figure 17 the duration and time of the user's gaze shown are only for illustrative purposes, and the present application does not make any limitations. Please refer to Figure 17 , exemplarily, the screen of the mobile phone is in the off screen mode starting from time T0. Of course, the mobile phone may have been in the off screen mode before time T0, or at time T0, the user presses the power on key to make the mobile phone enter the off screen mode, and the present application does not make any limitations. At time T1, as Figure 18 shown in (1), the user presses the power on key. As Figure 18 shown in (2), in response to the received user operation, after unlocking the face, the mobile phone displays the desktop, and at this time, the mobile phone is in the lit screen state.

[0243] Still referring to Figure 17 , exemplarily, from time T0 to time T1, the perception service follows Figures 6 - 7The process shown is executed. Since the mobile phone is in the screen-off state from time T0 to T1, the sensing service determines that the detection conditions are not met and repeats the execution of S701. Exemplarily, when the mobile phone is in the screen-off mode, that is, when the display screen is in the screen-off state, the user clicks the power-on button, and the mobile phone performs face recognition unlocking on the user. At time T1, the mobile phone unlocks successfully and displays the desktop. It should be noted that the way for the mobile phone in the embodiments of the present application to change from the screen-off mode to the desktop mode, or which can be understood as changing from the screen-off state to the lit screen state, is only a schematic example. For example, in other embodiments, the user can also make the mobile phone change from the screen-off state to the lit screen state (referring to the lit screen state after unlocking) by means of sliding to unlock, etc. The sensing service obtains from the display driver that the state of the display screen is lit, and the mobile phone is in the unlocked state (i.e., the desktop mode), the proximity light sensor of the mobile phone is not blocked, and no application with an application lock is running. That is, all of S701 to S704 are satisfied. The sensing service continuously monitors for 19 s starting from time T1 to monitor whether there is any user operation within 19 s. In the embodiments of the present application, the case where no user operation is detected is taken as an example for description. That is to say, the sensing service determines that the detection conditions are met. At time T2, the sensing service sends an indication message to the non-screen-off application to indicate that the detection conditions are met. The non-screen-off application responds to the indication of the sensing service and sends an indication message to the sensing service to indicate the sensing service to perform subsequent gaze non-screen-off detection. The sensing service responds to the indication of the non-screen-off application and opens a detection window, as Figure 17 shown. At time T2, the sensing service starts the detection and opens the detection window. The description of the detection window can refer to the above text and will not be elaborated here. It should be noted that from time T1 to T2, although the user intermittently gazes at the display screen, since the sensing service does not start the detection window from time T1 to T2, the sensing service cannot obtain the user's gaze situation.

[0244] Exemplarily, from time T2 to time T3, the user does not gaze at the display screen. Correspondingly, the sensing module fails to detect the user's gaze. The specific detection process can refer to Figures 8 - 9The description thereof will not be repeated here. Exemplarily, at time T3 (where the interval between time T3 and time T2 is 3 s), the user is gazing at the display screen. The perception service detects the user's gaze, determines that the condition for not dimming the screen when gazing is met, and the perception service notifies the non-dimming application. At time T4 (where the interval between time T4 and time T3 is 1 s), in response to the instruction of the non-dimming application, the perception service controls the display screen to light up through the power management module. It can be understood that if at time T4, the perception service does not detect the user's gaze, the display screen will enter the semi-dimming state after the lighting-up duration reaches 24 s. At time T4, however, since the user's gaze is detected, the display screen remains in the lit state, and the duration of the lit state is re-timed (the duration is 24 s). That is to say, if the user's gaze or user operation is not detected after the next 24 s (timed from time T4), the display screen will enter the semi-dimming state.

[0245] Please continue to refer to Figure 17 , Exemplarily, at time T4, the display screen re-starts the lighting-up timing, and the timing duration is 24 s. The perception service starts to execute from S705, that is, starting from time T4, it again detects whether there is any user operation within 19 s. Exemplarily, within the next detection window, the perception service detects the user's gaze at the 4th second after the detection window is opened, and at the 5th second, which can also be understood as just before the display screen is about to enter the semi-dimming state, controls the display screen to continue to remain in the lit state. For the specific description, please refer to the above text and will not be repeated here.

[0246] Figure 19 Another schematic diagram of non-dimming detection shown for exemplification. Exemplarily, in this scenario, an example of the user intermittently gazing at the mobile phone screen is used for illustration. It should be noted that Figure 19 The duration and time of the user's gaze shown in Figure 19 are only for illustrative purposes and are not limited in this application. Please refer to Figure 18 , Exemplarily, the screen of the mobile phone is in the off-screen mode starting from time T0. Of course, the mobile phone may have been in the off-screen mode before time T0, or at time T0, the user presses the power-on key to make the mobile phone enter the off-screen mode, which is not limited in this application. At time T1, as Figure 18 (1) shown in

[0247] Still refer to Figure 19 , Exemplarily, during time T0 - T1, the perception service executes according to the Figures 6 - 7 shown process. For the specific description, please refer to the relevant content of Figure 17 and will not be repeated here. Exemplarily, as Figure 19As shown, in this embodiment, the user continuously gazes at the mobile phone display screen starting from time T2.

[0248] At time T3, the perception service starts the gaze non-screen-off detection and opens the detection window. For the description of the detection window, please refer to the above, and it will not be elaborated here. It should be noted that from time T2 to T3, although the user continuously gazes at the display screen, since the perception service does not start the detection window from time T2 to T3, the perception service cannot obtain the user's gaze situation.

[0249] As Figure 19 shown, in this embodiment, the user continuously gazes at the display screen. Therefore, after the perception service opens the detection window, it can detect the user's gaze. At time T4, the perception service can control the display screen to remain on. Optionally, as described above, the time difference between time T3 and time T4 can be optionally the algorithm delay, for example, it can be 1s, and of course it can also be a smaller or larger value, which is not limited in this application.

[0250] Exemplarily, the display screen starts timing again for 24s from time T4. And the perception service repeats S705 from time T4, that is, continues to monitor whether a user operation is received within 19s. The specific process can be referred to the above description and will not be elaborated here. Exemplarily, at time T5, the perception service starts the gaze non-screen-off detection again. At time T6, after the perception service detects the user's gaze, it controls the display screen to remain on.

[0251] Figure 20 Another non-screen-off detection schematic diagram shown for exemplification. Please refer to Figure 20 , exemplarily, the perception service starts to detect gaze non-screen-off at time T1, that is, opens the detection window. Exemplarily, the preset detection duration is 11s. In this embodiment, at time T2, that is, when the detection duration is 3s, as Figure 21 shown in (1), the user presses the power button. As Figure 21 shown in (2), the mobile phone enters the screen-off mode in response to the received user operation, that is, the display screen turns off. Correspondingly, at time T2, the perception module can determine that the power button is pressed through the input management service, and the perception module can determine that the mobile phone is locked. According to Figure 8 the relevant description, when the perception module performs the gaze non-screen-off detection, if Figure 8 any one of the conditions is triggered, then the current detection process ends. Exemplarily, still referring to Figure 20 , the perception module ends the current detection at time T2 and repeats S701. For the un-described part, please refer to the above and it will not be elaborated here.

[0252] Figure 22 Another non-screen-off detection schematic diagram shown for exemplification. Please refer toFigure 22 Exemplarily, the sensing service starts detecting non - screen - off on gaze at time T1, i.e., opens a detection window. At time T2, the user touches the display screen, and the display screen remains lit. In response to the obtained user operation of touching the display screen, the sensing service determines that the non - screen - off on gaze condition is not met, and this detection process ends. The sensing service repeats the execution of S701. It should be noted that Figure 22 only a scenario of the user's touch operation is schematically shown. In other embodiments, Figure 22 the shown process is also applicable to the scenario where the sensing service detects that the foreground application starts an application lock during the detection process. That is to say, if at time T2, the foreground application starts the application lock, then the mobile phone remains lit, the sensing service ends this detection process, and repeats the execution of S701.

[0253] Figure 23 is another schematic diagram of non - screen - off detection shown exemplarily. Please refer to Figure 23 Exemplarily, the sensing service starts detecting non - screen - off on gaze at time T1, i.e., opens a detection window. At time T2, the user answers a voice call. The sensing service detects that the user answers the voice call and determines that the non - screen - off on gaze condition is not met, and this detection process ends. The sensing service repeats the execution of S701. Exemplarily, at time T3, after the display screen remains lit for 24 s, it enters a semi - screen - off state. That is to say, during the process of the user making or answering a voice call, whether the mobile phone is lit does not affect the user's use of the mobile phone. Correspondingly, the mobile phone can enter the semi - screen - off state to save power. It should be noted that Figure 23 only a scenario of the voice call is schematically shown. In other embodiments, Figure 23 the shown process is also applicable to the scenario where the sensing service detects that the proximity light sensor is continuously blocked during the detection process. That is to say, if at time T2, the user places the mobile phone on the desktop, causing the proximity light sensor to be continuously blocked, correspondingly, the sensing service ends this detection process and repeats the execution of S701. The mobile phone can enter the semi - screen - off state after remaining lit for 24 s.

[0254] Figure 24 is another schematic diagram of non - screen - off detection shown exemplarily. Please refer to Figure 24 Exemplarily, during the process of the sensing module executing S705, i.e., detecting whether there is a user operation within 19 s, at time T1 (for example, the 15th s after the detection starts), the sensing service detects that the user touches the screen. The sensing module can determine that the detection condition is not met in response to the received user operation of touching the screen, and this detection process ends. The sensing service repeats the execution of S701, and the subsequent process can refer to the relevant descriptions in the above - mentioned embodiments and will not be elaborated here.

[0255] It is understandable that, in order for an electronic device to implement the above functions, it includes the corresponding hardware and / or software modules for executing each function. Combining the algorithm steps of each example described in the embodiments disclosed in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.

[0256] In one example, Figure 25 FIG. shows a schematic block diagram of a device 2500 according to an embodiment of the present application. The device 2500 may include: a processor 2501 and a transceiver / transceiver pin 2502. Optionally, it further includes a memory 2503.

[0257] The various components of the device 2500 are coupled together through a bus 2504. Among them, the bus 2504 includes, in addition to the data bus, a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, all kinds of buses are referred to as bus 2504 in the figure.

[0258] Optionally, the memory 2503 can be used for the instructions in the foregoing method embodiments. The processor 2501 can be used to execute the instructions in the memory 2503, control the receiving pin to receive signals, and control the sending pin to send signals.

[0259] The device 2500 can be the electronic device or the chip of the electronic device in the foregoing method embodiments.

[0260] Among them, all the relevant contents of each step involved in the foregoing method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be elaborated here.

[0261] This embodiment also provides a computer storage medium. Computer instructions are stored in the computer storage medium. When the computer instructions run on an electronic device, the electronic device is enabled to execute the above relevant method steps to implement the method in the above embodiments.

[0262] This embodiment also provides a computer program product. When the computer program product runs on a computer, the computer is enabled to execute the above relevant steps to implement the method in the above embodiments.

[0263] In addition, an embodiment of the present application further provides a device, which may specifically be a chip, component, or module. The device may include a processor and a memory connected to each other. The memory is used to store computer-executable instructions. When the device runs, the processor may execute the computer-executable instructions stored in the memory to enable the chip to execute the methods in the above method embodiments.

[0264] Among them, the electronic device, computer storage medium, computer program product, or chip provided in this embodiment is all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be elaborated here.

[0265] Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0266] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling, direct coupling, or communication connection can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in electrical, mechanical, or other forms.

[0267] The units described as separate components may or may not be physically separated. The components displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0268] In addition, in each embodiment of the present application, each functional unit may be integrated in one processing unit, or each unit may exist physically separately, or two or more units may be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0269] Any content of each embodiment of the present application, as well as any content of the same embodiment, can be freely combined. Any combination of the above content is within the scope of the present application.

[0270] When an integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods of the various embodiments of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0271] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

[0272] The steps of the method or algorithm described in connection with the disclosed content of the embodiments of the present application can be implemented in a hardware manner or by a processor executing software instructions. The software instructions can be composed of corresponding software modules. The software modules can be stored in a random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, compact disc read-only memory (CD-ROM), or any other form of storage medium well-known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0273] Those skilled in the art should be able to realize that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented by hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. The computer-readable medium includes computer storage media and communication media, where the communication media includes any medium that facilitates the transmission of a computer program from one place to another. The storage media can be any available medium accessible by a general-purpose or special-purpose computer.

[0274] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them fall within the protection scope of the present application.

Claims

1. A control method for a display screen, characterized in that, Applied to an electronic device, the method includes: When the electronic device is in the screen-on state, perform a condition judgment; When the condition judgment meets the detection condition, perform target detection; When a target is detected, control the electronic device to maintain the screen-on state; wherein, the target is any one of eye gaze, a specific sound, and a specific gesture.

2. The method according to claim 1, wherein The condition judgment includes: Judge whether a first operation of the user is received within a first duration; The performing target detection when the condition judgment meets the detection condition includes: When it is determined that the first operation is not received within the first duration, perform the target detection.

3. The method according to claim 2, characterized in that, The condition judgment further includes: Judge whether the proximity light sensor of the electronic device is blocked, judge whether the electronic device is unlocked, and judge whether the electronic device has launched a set application; Wherein, the set application is an application that automatically enables an application lock to keep the electronic device in the screen-on state; The judging whether a first operation of the user is received within a first duration includes: When it is determined that the proximity light sensor of the electronic device is not blocked, and the electronic device is unlocked, and the electronic device has not launched the set application, judge whether a first operation of the user is received within a first duration.

4. The method according to claim 3, characterized in that The judging whether the proximity light sensor of the electronic device is blocked, judging whether the electronic device is unlocked, and judging whether the electronic device has launched the set application includes: When the proximity light sensor is blocked, or the electronic device is not unlocked, or the electronic device has not launched the set application, end the process of the condition judgment.

5. The method according to claim 2, wherein The duration of the target detection is a second duration; The sum of the second duration and the first duration is equal to a third duration; wherein, the third duration is the preset sleep duration of the electronic device.

6. The method according to claim 1, wherein When the target is eye gaze, the performing target detection includes: Collect an image frame, and detect whether the image frame includes a human face; When the image frame includes the human face, detect whether there is eye gaze in the image frame.

7. The method according to claim 6, wherein The detecting whether the image frame includes a human face includes: Identify the human face in the image frame based on a face detection algorithm; The detecting whether there is eye gaze in the image frame when the image frame includes the human face includes: When it is identified that the image frame includes a single human face, identify whether the eyes of the single human face are gazing based on a gaze detection algorithm.

8. The method according to claim 7, wherein The method further includes: When it is identified that the image frame includes multiple human faces or does not include a human face, identify the human face in the next image frame of the image frame based on the face detection algorithm.

9. The method according to claim 6, characterized in that, The collecting the image frame includes: Collect the image frame at a preset frame rate; wherein, the preset frame rate is 60fps or 5fps.

10. The method according to claim 9, characterized in that, The electronic device is deployed with a Trusted Execution Environment (TEE), and the TEE is used to isolate high-security sensitive applications from a general software environment; The collecting the image frame and detecting whether the image frame includes a human face includes: Store the image frame collected by the electronic device in the TEE according to the preset frame rate; Detect whether the image frame stored in the TEE includes a face.

11. The method according to claim 10, wherein After detecting whether the image frame stored in the TEE includes a face, it further includes: Delete the image frame from the TEE.

12. The method according to claim 1, wherein When the target is a specific sound, the performing of the target detection includes: Detect whether there is a voice command with specified content.

13. The method according to claim 1, wherein When the target is a specific gesture, the performing of the target detection includes: Detect whether the number of times the proximity light sensor is blocked is greater than a first threshold and whether the blocking duration is less than a second threshold.

14. The method according to claim 1, wherein Before performing the condition judgment, it further includes: Display a smart perception interface; the smart perception interface includes at least one of a gaze no-screen-off option, a sound no-screen-off option, and an occlusion no-screen-off option; Receive a second operation from the user to activate the option function corresponding to the second operation; wherein, the second operation is an operation to turn on the gaze no-screen-off option, the sound no-screen-off option, or the occlusion no-screen-off option.

15. The method according to claim 1, characterized in that, Before performing the target detection, it further includes: Detect whether a voice call is running, detect whether the electronic device has received a touch operation, detect whether the electronic device has received a lock screen operation, detect that the foreground application has not started an application lock, and detect that the proximity light sensor is not continuously blocked.

16. An electronic device, characterized in that, It includes: A memory and a processor, the memory is used to store a computer program, and the processor is used to execute the computer program to perform the method according to any one of claims 1-15.

17. A computer-readable storage medium, comprising a computer program, characterized in that, When the computer program runs on an electronic device, the electronic device is caused to execute the method according to any one of claims 1-15.

18. A computer program product, characterized in that, It includes computer program code, and when the computer program code is executed by an electronic device, it implements the control method of the display screen according to any one of claims 1-15.

Images