Method for controlling always on display, and electronic device and storage medium

Abstract

The present application relates to the technical field of display. Provided are a method for controlling always on display (AOD), and an electronic device and a storage medium. By means of the solution of the present application, once a touch-panel drive receives a screen touch event in a screen-off state, the touch-panel drive immediately notifies a display drive to execute an energization process, such that the energization and initialization of a display screen are started in advance. Moreover, as described in the related art, the touch-panel drive transfers the screen touch event in the screen-off state to an AOD application, such that the AOD application starts an AOD process. In this way, the energization process and AOD start process of the display screen can be concurrently implemented, such that the overall time consumed for the AOD process can be greatly shortened. Therefore, when a user gently touches the display screen in the screen-off state, AOD becomes quicker, thereby improving the user experience.

Description

Method for controlling screen-off display, electronic device, and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on June 30, 2023, with application number 202310804902.X and application name “Method, electronic device and storage medium for controlling screen-off display”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a method for controlling screen-off display, an electronic device, and a storage medium. Background Art

[0003] With the rapid development of electronic technology, electronic devices such as smartphones and tablets are becoming increasingly versatile and have become indispensable tools in people's lives and work. For example, users frequently turn on their mobile phone screens to check information such as the time and notifications. To facilitate basic information like the time while conserving battery life, the always-on display (AOD) feature has emerged.

[0004] The implementation principle of the AOD function is: after the screen of the electronic device is turned off, some pixels of the screen can be lit up to display information such as clock, date, battery level, message reminders, etc., while other pixels of the screen are always in a closed state. For example, these closed pixels appear black, so that users can conveniently view the above information without lighting up the entire screen of the electronic device, and can reduce the power consumption of the electronic device.

[0005] Currently, when an electronic device is in the screen-off state, it takes a long time for the screen-off pattern to be displayed after the user touches the screen. That is to say, the screen-off display process in the screen-off state in the related art has the problem of being time-consuming.

[0006] Summary of the Invention

[0007] The present application provides a method, electronic device and storage medium for controlling the off-screen display. In the scenario where the screen is touched in the off-screen state, the off-screen display startup process and the display screen power-on process are executed simultaneously, which significantly shortens the off-screen display time and improves the user experience.

[0008] In a first aspect, the present application provides a method for controlling an off-screen display, which is applied to an electronic device, the electronic device including a processor and a display screen, the processor including an off-screen display AOD application, a display driver, and a touch screen driver, the method comprising:

[0009] When the display screen is in the off state, the display driver receives a touch screen event transmitted by the touch screen driver (the touch screen event is a preset touch screen operation of the user on the display screen); in response to the touch screen event, the display driver triggers the display screen to power on and initialize; the display driver starts timing from the moment the display screen is triggered to power on; the display driver receives a power-on instruction from the AOD application; in response to the power-on instruction, the display driver determines whether the timing duration is greater than or equal to the preset duration; when the timing duration is greater than or equal to the preset duration, the display driver returns a completion message; or, when the timing duration is less than the preset duration, the display driver waits until the timing duration is greater than or equal to the preset duration and returns a completion message; the display driver receives an AOD display instruction from the AOD application; in response to the AOD display instruction, the display driver triggers the display screen to display the off pattern.

[0010] Through the method for controlling the off-screen display provided by the embodiment of the present application, once the touch screen driver receives a touch screen event in the off-screen state, the touch screen driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related art, the touch screen driver passes the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display screen power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the off-screen display process. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.

[0011] In the related art, when the display screen is in the off state, if the touch screen driver receives a touch screen event, the touch screen driver will pass the touch screen event in the off state to the input subsystem, and then the input subsystem will pass the touch screen event to the AOD application, and the AOD application will start the off screen display process, and then the display driver will trigger the display screen to power on and initialize. After completing the power-on and initialization, the display driver will trigger the display screen to display the off screen pattern to realize the off screen display.

[0012] Compared to related technologies, the present invention's solution is improved in that, after the touchscreen driver senses a touchscreen event in the off-screen state, it notifies the display driver to execute the power-on process. Simultaneously, the touchscreen driver transmits the touchscreen event in the off-screen state to the input subsystem, which then transmits the touchscreen event in the off-screen state to the AOD application to trigger the off-screen display startup process.

[0013] That is to say, after the touch screen driver senses the touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the power-on process, and at the same time notifies the AOD application to start the screen-off display process. Compared with the related art, the display driver executes the power-on process in advance in the screen-off display process of this application. It can be understood that before starting the screen-off display process, the display driver has started to execute the power-on process, and after starting the screen-off display process, the display driver has completed the power-on process or is about to complete the power-on process. The beneficial effect of this is that the display screen power-on process and the screen-off display startup process are executed at the same time, which significantly shortens the time consumed by the screen-off display.

[0014] In another possible implementation, when the touch screen driver receives a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the display power-on process, so that the display starts to power on in advance, and the power-on time is approximately in the range of [20ms, 50ms]. At the same time, the touch screen driver passes the touch screen event in the screen-off state to the AOD application, and the AOD application starts the screen-off display process: the AOD application sends an AOD startup instruction to the display, and the AOD startup instruction can carry the display initialization parameters. When the display receives the display initialization parameters, since the display has completed power-on in advance, the display can quickly enter initialization, which can also save a certain amount of time and make the screen-off display faster.

[0015] In some possible implementations, the display driver triggers the display screen to power on and initialize in response to the touch screen event, including: the display driver determines that the touch screen event meets the screen-off display triggering condition; in response to the touch screen event, the display driver triggers the display screen to power on and initialize.

[0016] Through the above solution, after the touch screen driver senses a touch screen event in the off-screen state, the touch screen driver not only notifies the AOD application to start the off-screen display process, but also notifies the display driver to execute the power-on process.

[0017] Compared with the related technology in which the touch screen driver passes the touch screen event in the screen off state to the AOD application, the AOD application starts the off-screen display process, and then the display driver executes the power-on process, the present application solution can allow the touch screen driver to immediately notify the display driver to execute the power-on process when the touch screen driver senses the touch screen event in the screen off state, which can shorten the time taken for the off-screen display.

[0018] In actual implementation, based on the hardware requirements of the screen IC chip specifications, it takes about 120ms to power on and initialize the display, and the software takes about 150ms to process the off-screen display process, so the AOD overall process takes a minimum of about 270ms. Through the present application solution, since the display power-on process and the off-screen display startup process can be executed in parallel, for example, when the off-screen display process is implemented in the off-screen state, 120ms can be saved, so the overall time is 150ms, which shows that the overall time is significantly shortened. Therefore, when the user touches the display in the off-screen state, the off-screen display becomes faster, which improves the user experience.

[0019] In some possible implementations, the above-mentioned screen-off display triggering conditions include: the electronic device has turned on the screen-off display function, the display screen is in the screen-off state, and the user input operation is a preset touch screen operation.

[0020] In some possible implementations, the preset touch screen operation may be an operation of lightly touching or clicking the display screen.

[0021] If the touch screen event meets the screen off display triggering condition, then the touch screen event will trigger the screen off display. This ensures that the current scene is a scene where the user input operation triggers the screen off display.

[0022] It should be noted that the display driver can determine whether the touch screen event meets the screen off display trigger condition; the touch screen driver can also determine whether the touch screen event meets the screen off display trigger condition, and then when the touch screen driver determines that the touch screen event meets the screen off display trigger condition, the touch screen driver passes the touch screen event to the display driver to trigger the display driver to execute the power-on process, or the touch screen driver directly notifies the display driver to execute the power-on process.

[0023] In some possible implementations, the display driver triggering the display screen to power on and initialize includes: the display driver triggering the integrated chip IC of the display screen to start powering on and initializing.

[0024] It should be noted that the protocol stipulates that powering on and initializing the display takes a preset time (denoted as T1). In other words, after the preset time T1, the display completes initialization and is ready to execute the display task issued by the display driver. In other words, the display driver needs to wait for the preset time T1, that is, until the display completes initialization, before returning a power-on completion message to the upper layer to further complete the screen off display.

[0025] In the present application, the processor may further include a drawing module and a backlight module. The drawing module is used to draw a screen-off pattern. The backlight module is used to collect AOD backlight parameters. The AOD may retrieve the screen-off pattern and AOD backlight parameters from the drawing module and the backlight module, respectively, and generate an AOD display instruction based on the screen-off pattern and the AOD backlight parameters.

[0026] In some possible implementations, the above-mentioned response to the AOD display instruction, the display driver triggers the display screen to display the screen-off pattern, including: the display driver sends the AOD display instruction to the IC of the display screen, so that the IC of the display screen controls the display screen to turn on the backlight with AOD backlight parameters and display the screen-off pattern based on the AOD display instruction.

[0027] In the present application, the processor also includes an input subsystem. The touch screen event is also transmitted to the input subsystem by the touch screen driver, and the input subsystem transmits the touch screen event to the AOD application. The power-on instruction and AOD display instruction are instructions issued by the AOD application in response to the touch screen event.

[0028] In some possible implementations, the time when the touch screen event is delivered to the display driver is earlier than or equal to the time when the touch screen event is delivered to the AOD application.

[0029] Compared to related technical processes, in this application, after the touch screen driver senses a touch screen event in the off-screen state, the touch screen driver not only notifies the AOD application to start the off-screen display process, but also notifies the display driver to execute the power-on process. Moreover, the display power-on process is executed earlier than the off-screen display startup process, or the display power-on process and the off-screen display startup process are executed simultaneously.

[0030] This beneficial effect is reflected in the following: before starting the off-screen display process, the display driver has already started the power-on process, and after starting the off-screen display process, the display driver has already completed the power-on process or is about to complete the power-on process. In this way, by executing the off-screen display startup process and the display power-on process in parallel, the time taken to display off is significantly shortened.

[0031] In this application solution, the processor also includes a power management service module, a surface drawing SurfaceFlinger service module, and a hardware synthesis module HWC. The power-on instruction is issued by the AOD application, transmitted through the power management service module, SurfaceFlinger service module and HWC, and reaches the display driver.

[0032] Among them, after the power-on instruction is transmitted to the HWC module, the HWC module sends the power-on instruction to the display driver; when the HWC module receives the completion message returned by the display driver, the HWC module sends the AOD display instruction to the display driver.

[0033] In the present application, in response to a touch screen event in the off-screen state, the AOD application sends an AOD startup instruction to the lower layer. The AOD startup instruction includes a power-on instruction and an AOD display instruction. The AOD startup instruction passes through the power management service module and the SurfaceFlinger service module in the software architecture in sequence, and then reaches the HWC. The HWC first sends a power-on instruction to the display driver. Since the display has been powered on or is about to be powered on at this time, the display driver does not need to trigger the display to power on.

[0034] The display driver responds differently depending on whether the display has been powered on or is about to be powered on:

[0035] Case 1: When the display has been powered on, the display driver directly returns an OK message to the HWC. Case 2: When the display is about to be powered on, the display driver waits for the display to be powered on before returning an OK message to the HWC.

[0036] After the HWC receives the OK message returned by the display driver, the HWC sends an AOD display instruction to the display driver, and then the display driver sends the AOD display instruction to the display screen. In response to the AOD display instruction, the display screen displays the screen-off pattern.

[0037] Compared to related technical processes, the present invention's solution significantly shortens the time it takes to turn off the screen by executing the display driver's power-on process before initiating the off-screen display process, and by completing or about to complete the power-on process after initiating the off-screen display process. This parallel execution of the off-screen display startup process and the display screen processing process significantly reduces the time it takes to turn off the screen.

[0038] In a second aspect, the present application provides a device for controlling an off-screen display, the device comprising a unit for executing the method described in the first aspect. The device may correspond to executing the method described in the first aspect. For the relevant description of the units in the device, please refer to the description of the first aspect above, and for the sake of brevity, no further details are given here.

[0039] The method described in the first aspect above can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a processing module or unit, a display module or unit, etc.

[0040] In a third aspect, the present application provides an electronic device comprising a display screen, a processor, a computer program or instructions stored in the processor and a memory, wherein the processor is configured to execute the computer program or instructions so that the method in the first aspect is executed.

[0041] In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program (also referred to as instructions or code) for implementing the method in the first aspect. For example, when the computer program is executed by a computer, the computer can perform the method in the first aspect.

[0042] In a fifth aspect, the present application provides a chip comprising a processor. The processor is configured to read and execute a computer program stored in a memory to perform the method of the first aspect and any possible implementation thereof. Optionally, the chip further comprises a memory, the memory being connected to the processor via a circuit or wire.

[0043] In a sixth aspect, the present application provides a chip system comprising a processor. The processor is configured to read and execute a computer program stored in a memory to perform the method of the first aspect and any possible implementation thereof. Optionally, the chip system further comprises a memory, the memory being connected to the processor via a circuit or wire.

[0044] In a seventh aspect, the present application provides a computer program product, which includes a computer program (also referred to as instructions or codes). When the computer program is executed by an electronic device, the electronic device implements the method in the first aspect.

[0045] It can be understood that the beneficial effects of the second to seventh aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] FIG1 is a schematic diagram of an application scenario of a method for controlling off-screen display provided in an embodiment of the present application;

[0047] FIG2 is a schematic diagram of the screen-off display process in the method for controlling the screen-off display provided in an embodiment of the present application;

[0048] FIG3 is a schematic diagram showing a comparison between a method for controlling screen-off display provided by an embodiment of the present application and related technologies;

[0049] FIG4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0050] FIG5 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0051] FIG6 is a flowchart of a method for controlling screen-off display provided by a related art;

[0052] FIG7 is a timing diagram of a method for controlling screen-off display provided by a related art;

[0053] FIG8 is a schematic diagram showing the time consumption of a method for controlling screen-off display provided by a related art;

[0054] FIG9 is a schematic flow chart of a method for controlling off-screen display according to an embodiment of the present application;

[0055] FIG10 is a timing diagram of a method for controlling off-screen display provided in an embodiment of the present application;

[0056] Figure 11 is a schematic diagram of the time consumption of the method for controlling the screen off display provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0058] The term "and / or" as used herein describes an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. The symbol " / " as used herein indicates that the related objects are in an "or" relationship, for example, A / B means either A or B.

[0059] In the specification and claims herein, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. In the description of the embodiments of this application, unless otherwise specified, the meaning of "plurality" refers to two or more. For example, "multiple processing units" refers to two or more processing units, etc.; "multiple components" refers to two or more components, etc.

[0060] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0061] With the rapid development of electronic technology, electronic devices such as smartphones and tablets have become increasingly versatile and have become indispensable tools in people's lives and work. For example, mobile phone users frequently turn on their screens to check information like the time and notifications. To facilitate basic information like the time while conserving battery life, the off-screen display feature has emerged.

[0062] The principle of the off-screen display function is that when the electronic device's screen is off, some pixels on the screen can be illuminated to display information such as the clock, date, battery level, and message reminders, while other pixels on the screen remain off. For example, these off pixels appear black. This allows users to conveniently view the above information without lighting up the entire screen of the electronic device, and can also reduce the power consumption of the electronic device. Electronic devices usually have the off-screen display function turned on by default.

[0063] Electronic devices can support the following two scenarios for triggering screen-off display:

[0064] Scenario 1: The screen turns off after a timeout or by pressing the power button.

[0065] As shown in Figure 1 (a), when an electronic device switches from an on-screen state to an off-screen state, the off-screen display is automatically triggered. This means that some pixels on the screen light up to display an off-screen pattern. For example, the off-screen pattern may include information such as the clock, date, and notifications, making it easier for users to access these commonly used information and reducing the electronic device's power consumption. After the off-screen pattern displays for a period of five seconds, it automatically disappears.

[0066] Scenario 2: Touch the screen in the off state to trigger the off-screen display.

[0067] As shown in Figure 1(b), when the electronic device is in the screen-off state, if the user taps or clicks the display, the screen-off display is triggered, that is, a local area of ​​the screen is illuminated, and the screen-off pattern is displayed. Then, after a period of time (5 seconds), the screen-off pattern automatically disappears. This method of tapping or clicking the screen to trigger the screen-off display in the screen-off state is called "touch mode."

[0068] Currently, for the above scenario 2, it takes a long time for the electronic device to realize the off-screen display in the off-screen state, and there is a problem of excessive delay in the off-screen display. It should be noted that the embodiments of the present application mainly study and improve the problem of excessive delay in the off-screen display in the above scenario 2.

[0069] The inventors of this application have found that the main reasons why it takes a long time to turn off the screen in the current off state include: based on the hardware requirements of the screen IC chip specifications, it takes about 120ms to power on and initialize the display, and the software takes about 150ms to process the off screen display process, so the overall off screen display process takes a minimum of about 270ms. This will cause the screen to take a long time to turn off, and therefore will give users a feeling that "the screen is slow to turn off".

[0070] In order to solve the problem of slow screen-off display, an embodiment of the present application provides a method for controlling screen-off display. Through the solution of the present application, once the touch screen driver receives a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related art, the touch screen driver passes the touch screen event in the screen-off state to the AOD application, and the AOD application starts the screen-off display process. In this way, the display screen power-on process and the screen-off display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the screen-off display process. Therefore, when the user touches the display screen in the screen-off state, the screen-off display becomes faster, which improves the user experience.

[0071] Figure 2 shows a schematic diagram of the state changes of the display screen during the screen-off display process. As shown in Figure 2, the display screen is in the screen-off state. When the electronic device receives a touch screen event, the screen-off display process is started. The display screen is first powered on and initialized, and then the display screen displays the screen-off pattern to achieve screen-off display. The protocol stipulates that it takes a preset time (denoted as T1) to power on and initialize the display screen. That is to say, after the preset time T1, the display screen completes initialization and is ready to execute the display task issued by the display driver.

[0072] It should be noted that the display driver needs to wait for a preset time length T1, that is, until the display screen is initialized, before returning the power-on completion message to the upper layer to further complete the screen off display. Exemplarily, the preset time length T1 can be 120ms. The specified preset time length is for illustrative purposes only and can be set according to actual usage requirements. This embodiment of the application is not limited thereto.

[0073] In an embodiment of the present application, the screen-off display process involves a power-on instruction and an AOD display instruction. The AOD display instruction is used to control the display screen to display a screen-off pattern. The power-on instruction is used to control the power-on of the display screen, specifically to control the power-on of the display screen IC (also known as the display driver integrated chip). Therefore, "display screen power-on" actually refers to "display screen IC power-on". It can be understood that when the display screen IC is in a powered-on state, the display screen IC can provide display content for the display screen, and the display screen IC can respond to the AOD display instruction to control the display screen to display a screen-off pattern.

[0074] In order to better understand the embodiment of the present application, the embodiment of the present application is briefly described below in comparison with the related art with reference to FIG3 :

[0075] Figure 3 (a) shows the screen-off display process in the screen-off state provided by the related art. As shown in Figure 3 (a), when a touch screen event occurs in the screen-off state, the AOD application is first notified of the touch screen event in the screen-off state. The AOD application then initiates the screen-off display process. Next, the display is powered on and the screen-off pattern is displayed to achieve the screen-off display.

[0076] Figure 3(b) shows the off-screen display process in the off-screen state provided by this application. As shown in Figure 3(b), when a touch screen event occurs in the off-screen state, the display driver is immediately notified to execute the power-on process, and the AOD application is notified to start the off-screen display process. In this way, the display power-on process and the off-screen display startup process are executed in parallel to complete the off-screen display.

[0077] Compared to related technologies, the present invention's solution is improved in that, after the touchscreen driver senses a touchscreen event in the off-screen state, it notifies the display driver to execute the power-on process. Simultaneously, the touchscreen driver transmits the touchscreen event in the off-screen state to the input subsystem, which then transmits the touchscreen event in the off-screen state to the AOD application to initiate the off-screen display process.

[0078] That is to say, after the touch screen driver senses the touch screen event in the off-screen state, the touch screen driver immediately notifies the display driver to execute the power-on process, and at the same time notifies the AOD application to start the off-screen display process.

[0079] Compared with the related art, the display driver in the off-screen display process of this application executes the power-on process in advance. It can be understood that before starting the off-screen display process, the display driver has already started the power-on process, and after starting the off-screen display process, the display driver has completed the power-on process or is about to complete the power-on process.

[0080] This has the beneficial effect of allowing the display screen power-on process and the screen-off display startup process to be executed simultaneously, significantly shortening the screen-off display time.

[0081] It should be noted that the electronic device described in this application is an electronic device having a display screen and an off-screen display function. For example, the electronic device can be a smart terminal such as a mobile phone, tablet computer, or smartwatch. The specific technology and specific device form used by the electronic device are not limited here. For ease of description, the subsequent embodiments all use the mobile phone as an example of the electronic device.

[0082] 4 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, etc.

[0083] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. For example, the processor 110 is used to execute the method for controlling the off-screen display in the embodiment of the present application.

[0084] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0085] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0086] The external memory 120 generally refers to an external memory. In the embodiment of the present application, the external memory refers to a memory other than the memory of the electronic device and the cache of the processor, and the memory is generally a non-volatile memory.

[0087] Internal memory 121, also referred to as "memory," can be used to store computer-executable program code, including instructions. Internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system and at least one application required for a function (e.g., sound playback, image playback, etc.).

[0088] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be an organic light-emitting diode (OLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0089] The touch sensor 180K, also known as a "touch panel" or touch screen sensor, can be mounted on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor 180K detects touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194.

[0090] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0091] Button 190 includes a power button, which is used to trigger turning on or off the display screen. For example, when the display screen is in a bright screen state, if the user presses the power button, the display screen state changes from the bright screen state to the dark screen state.

[0092] The above is a specific description of the embodiments of the present application using the electronic device 100 as an example. It should be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. The electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in the figure may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0093] Furthermore, operating systems run on the above components, such as the iOS operating system developed by Apple, the Android open-source operating system developed by Google, and the Windows operating system developed by Microsoft. Application programs can be installed and run on these operating systems.

[0094] The operating system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0095] FIG5 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

[0096] A layered architecture divides software into several layers, each with distinct roles and divisions of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: from top to bottom, the application layer, the application framework layer, the system native library (referred to as the native layer), the hardware abstraction layer (HAL), and the kernel layer. For ease of illustration, Figure 5 also illustrates the hardware layer that interacts with the above software structure.

[0097] It should be noted that Android is a Linux-based operating system primarily used for portable devices. Upper-layer application development in the Android system (e.g., the application layer and application framework layer) is generally done in Java. Because some underlying tasks are not easily implemented in Java, tasks involving local services, linked libraries, or hardware drivers are often implemented using C programs, which run in the system's native libraries. These libraries contain interfaces for Java to call C++ code.

[0098] The application layer may include a series of application packages. For example, the application layer may include AOD applications and other applications, which are not limited in this embodiment of the present application.

[0099] The application framework layer provides an application programming interface (API) and a programming framework for the application layer's applications. The application framework layer includes some predefined functions, which are not limited in this embodiment of the application.

[0100] For example, the application framework layer may include a power management service (PMS) module, wherein the PMS module is used to manage power on and power off of the display screen.

[0101] Exemplarily, the application framework layer may further include an AOD service module, and the AOD service module is used to provide an off-screen display service for the AOD application.

[0102] Exemplarily, the application framework layer may further include a drawing module. The drawing module is used to provide a screen-off pattern for screen-off display.

[0103] The Native layer can include multiple functional modules. For example, in the present application, the Native layer includes a surface drawing (SurfaceFlinger) service module. Among them, the function of the SurfaceFlinger service module is to accept graphic display data from multiple sources, synthesize them, and then send them to the display device. The image display can be completed by multiple classes such as SurfaceFlinger, HWC, display screen, etc.

[0104] In the present application, the Native layer also includes an input subsystem. The input subsystem is one of the important system services in the Android operating system, which is dedicated to processing various external input signals of input devices. Input devices include: display screen, keyboard, mouse, etc. Taking the user input as a touch screen display as an example, after the display screen is touched, the corresponding hardware driver (such as the touch screen driver of the kernel layer) will be triggered. After the touch screen driver receives the touch screen event, the touch screen driver will write the touch screen event to the corresponding input device node, and then the input system will read the touch screen event from the device node, and then pass the touch screen event up layer by layer, and pass the touch screen event to the corresponding activity.

[0105] The HAL layer may include a hardware composition module (hwcomposer, HWC), which has the function or ability to use hardware to complete image data combination and display, providing hardware support for the SurfaceFlinger service.

[0106] The kernel layer is the layer between hardware and software, relaying application requests to the hardware. It provides the most fundamental functions of the operating system. Typically, the kernel layer provides system services such as process management, interrupt response, memory management, networking, and inter-process communication.

[0107] In the present application, the kernel layer includes a display driver. The display driver can be combined with a display integrated circuit or chip (integrated circuit, IC) to jointly control the display function of the display. For example, the display driver and the display IC, in a combination of software and hardware, jointly implement the off-screen display function. The display driver can also be used to set the backlight parameters of the display; wherein, when the backlight parameter of the display is set to 0, the display is in the off-screen state; when the backlight parameter of the display is set to any value in the range of [1, 255], the display is in the bright screen state.

[0108] In the present application, the kernel layer also includes a touch panel (TP) driver. In the present application, the TP driver is used to receive touch screen events sent by the touch screen sensor of the display screen, report the touch screen events to the input subsystem, and pass the touch screen events to the display driver to trigger the display driver to execute the power-on process.

[0109] The hardware layer can include a display screen (such as an OLED or LCD), which is equipped with an IC (also called a display IC). The hardware layer also includes a touchscreen sensor. When a user clicks or touches the display screen, the touchscreen sensor can sense the user's touch operation and determine a touchscreen event. The touchscreen sensor can then send the touchscreen event to the TP driver.

[0110] It should be noted that although the embodiments of the present application are described using the Android system as an example, its basic principles are also applicable to electronic devices based on operating systems such as iOS or Windows.

[0111] The execution subject of the method for controlling the off-screen display provided in the embodiment of the present application can be the above-mentioned electronic device, or a functional module and / or functional entity in the electronic device that can implement the method for controlling the off-screen display, and the present application solution can be implemented in hardware and / or software. The specific implementation can be determined according to actual use requirements and is not limited by the embodiment of the present application. The following uses an electronic device as an example and combines the accompanying drawings to exemplarily illustrate the method for controlling the off-screen display provided in the embodiment of the present application.

[0112] In order to highlight the improvements of the embodiments of the present application over the related art, the following compares the present application solution with the related art in terms of the off-screen display process, timing diagram, and time consumption, and explains the improvements. First, in conjunction with Figures 6 to 8, the off-screen display process, timing diagram, and time consumption in the related art are explained. Then, in conjunction with Figures 9 to 11, the method for controlling the off-screen display provided by the embodiments of the present application is explained in terms of the off-screen display process, timing diagram, and time consumption.

[0113] Related technologies - screen-off display process

[0114] Figure 6 is a schematic diagram of the software architecture of the off-screen display process in the off-screen state in the related art. The off-screen display process in the off-screen state can be divided into two phases: the first phase: the touch screen event transmission process, and the second phase: the off-screen display initiation and completion process. The touch screen event transmission process is shown in the direction indicated by the dotted arrow, while the off-screen display initiation and completion process are shown in the direction indicated by the solid arrow.

[0115] Phase 1: Touch screen event transmission process

[0116] Referring to Figure 6, when the electronic device is in the screen-off state, if the user clicks or touches the display, the TP driver of the electronic device will receive the user's click or touch operation, that is, the TP driver will sense the touch screen event in the screen-off state. The TP driver transmits the touch screen event in the screen-off state to the input subsystem, and the input subsystem then transmits the touch screen event in the screen-off state to the AOD application.

[0117] Phase 2: Turn off the screen to display the startup and completion process

[0118] After receiving a touch screen event in the screen-off state, the AOD application starts the screen-off display process.

[0119] It should be noted that when the electronic device is in the off state, the display IC is in the off state. When starting the off-screen display process, it is first necessary to trigger the display IC to power on, and then the display IC controls the display to display the off-screen pattern.

[0120] Referring to ② in Figure 6, the AOD application sends an AOD startup instruction, which includes a power-on instruction and an AOD display instruction. The AOD startup instruction is transmitted through the power management service module and the SurfaceFlinger service module in the software architecture in turn, and then reaches the HWC. The HWC first sends a power-on instruction to the display driver. Accordingly, the display driver responds to the power-on instruction and triggers the display IC to power on. Then, referring to ③ in Figure 6, the display driver returns an OK message to the HWC. After the HWC receives the OK message, the HWC sends the AOD display instruction to the display driver. The display driver sends the AOD display instruction to the display IC. In response to the AOD display instruction, the display IC controls the display to display the screen-off pattern and completes the screen-off display.

[0121] It can be seen from Figure 6 that during the screen-off display process in the screen-off state, according to relevant technologies, the touch screen event in the screen-off state needs to be passed to the AOD application first, and then the AOD application starts the screen-off display process. In the AOD implementation process, it is necessary to trigger the display screen to power on first, and then trigger the display screen to display the screen-off pattern, thereby completing the screen-off display.

[0122] Based on Figure 6, Figure 7 shows a timing diagram of the off-screen display process in the off-screen state in the related art. Referring to Figure 7, the method includes the following steps S101-S115.

[0123] S101: When the display screen is in an off state, the display screen receives a touch screen operation.

[0124] In actual implementation, when a user touches or clicks a display screen, a touch sensor provided on the display screen can sense the user's touch screen operation.

[0125] Among them, the event of the display screen being touched or clicked when it is in the off state can be called a touch screen event in the off state.

[0126] S102: The display screen reports a touch screen event in the screen-off state to the TP driver.

[0127] S103: The TP driver transmits the touch screen event in the screen-off state to the input subsystem.

[0128] S104: The input subsystem transmits the touch screen event in the screen-off state to the AOD application.

[0129] In actual implementation, when the display screen is touched, the corresponding kernel layer TP driver will be triggered. After the TP driver receives the touch screen event, it will write the touch screen event to the corresponding input device node. Then the input system will read the touch screen event from the device node and pass the touch screen event up layer by layer.

[0130] S105 , in response to a touch screen event in the screen-off state, the AOD application is started, and triggers the start of the AOD service.

[0131] After the AOD application and AOD service are started, the screen-off display process can be started.

[0132] S106: The AOD application sends an AOD startup instruction to the power management service module. The AOD startup instruction is transparently transmitted through the power management service module and the SurfaceFlinger service module in sequence and reaches the HWC.

[0133] The AOD startup instruction includes a power-on instruction and an AOD display instruction.

[0134] The following S107-S112 illustrate the process of powering on the display screen.

[0135] S107, the HWC sends a power-on instruction to the display driver in response to the AOD start instruction, where the power-on instruction is used to control the display screen IC to power on.

[0136] S108 , the display driver sends a power-on instruction to the display screen to drive the display screen to power on.

[0137] S109 , in response to the power-on instruction, the display screen is powered on.

[0138] In actual implementation, the display driver sends a power-on instruction to the display screen IC, and then the display screen IC is powered on in response to the power-on instruction.

[0139] S110 , when the display driver sends a power-on instruction to the display screen, the timing starts.

[0140] In actual implementation, it usually takes a preset time for the display screen to power on. For example, the preset time may be 120ms.

[0141] S111, the display driver determines whether the timing duration reaches a preset duration.

[0142] If the timing duration reaches (ie, is greater than or equal to) the preset duration, the following S112 is continued to be executed.

[0143] If the timing duration does not reach (ie is less than) the preset duration, the process waits until the timing duration reaches the preset duration, and then executes the following S112.

[0144] S112: The display driver returns a completion (OK) message to the HWC.

[0145] The following S113-S115 illustrate the process of the display screen completing the off-screen display.

[0146] S113, after receiving the OK message, the HWC sends an AOD display instruction to the display driver.

[0147] S114, the display driver sends the AOD display instruction to the display screen to drive the display screen to display the screen-off pattern.

[0148] S115, in response to the AOD display instruction, the display screen displays a screen-off pattern.

[0149] Among them, in response to the AOD display instruction, the display screen IC first obtains the screen-off image, and then controls the display screen to display the screen-off pattern to complete the screen-off display process.

[0150] It can be seen from Figure 7 that during the screen-off display process in the screen-off state, according to relevant technologies, it is necessary to first pass the touch screen event in the screen-off state to the AOD application, and then the AOD application starts the screen-off display process, and then the display screen is powered on. After the display screen is powered on, the display screen displays the screen-off pattern, thereby completing the screen-off display.

[0151] The above illustrates the screen-off display process and timing diagram in the screen-off state in the related art through Figures 6 and 7 respectively. The following analyzes the AOD time consumption in the screen-off state in the related art in combination with Figure 8.

[0152] As shown in Figure 8, in the related art, when the display screen is in the off-screen state, if the user clicks or touches the display screen of the electronic device, the TP driver of the electronic device receives the touch screen event in the off-screen state, and the TP driver notifies the AOD application to start the off-screen display process. The AOD application then starts the off-screen display process: the display screen is first powered on, and then the display screen displays the off-screen pattern, completing the off-screen display process. Through analysis, it can be seen that in the off-screen display process, the upper-layer software module first processes the business of the off-screen display process, and then the upper-layer software module issues instructions to the display screen hardware. The display screen hardware implements the power-on and off-screen display of the display screen based on the instructions issued by the upper-layer software module.

[0153] That is, the off-screen display process includes the off-screen display startup process time and the display screen power-on process time. For example, the off-screen display startup process time is recorded as t1, the display screen power-on process time is t2, and the total time is t1+t2.

[0154] In actual implementation, the process of triggering the screen-off display through a light touch mode typically takes more than 270ms, of which the software module takes about 150ms to process the AOD service and the display IC hardware takes about 120ms to power on.

[0155] Regarding the off-screen display process in the related art, there is a problem that the off-screen display is slow to be implemented.

[0156] This application - screen off display process

[0157] In response to the problem that the screen-off display process in the screen-off state in the above-mentioned related technologies is time-consuming, the embodiments of the present application have made improvements in the process. Once the TP driver receives a touch screen event in the screen-off state, the TP driver immediately notifies the display driver to execute the power-on process, so that the display starts to power on and initialize in advance; on the other hand, as in the related technologies, the TP driver passes the touch screen event in the screen-off state to the AOD application, and the AOD application starts the screen-off display process. In this way, the display power-on process and the screen-off display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the screen-off display process. Therefore, when the user touches the display screen in the screen-off state, the screen-off display becomes faster, which improves the user experience.

[0158] In the embodiment of the present application, the screen-off display process includes a screen-off display startup process and a display screen power-on process. The screen-off display startup process includes the process of the AOD application issuing a power-on instruction and an AOD display instruction, as well as the process of executing the power-on instruction and the AOD display instruction. The display screen power-on process includes the process of the upper layer notifying the display screen to power on, and the process of powering on and initializing the display screen.

[0159] For ease of explanation, the power-on instruction and the AOD display instruction may be collectively referred to as an AOD startup instruction, wherein the AOD display instruction may include a screen-off pattern and an AOD backlight parameter.

[0160] Figure 9 shows a schematic diagram of the software architecture of the off-screen display process in the off-screen state provided by an embodiment of the present application. The off-screen display process in the off-screen state can be divided into two stages: the first stage: the TP driver notifies the display driver to execute the power-on process and notifies the AOD application to start the off-screen display process; and the second stage: the display driver executes the power-on process and the AOD application starts the off-screen display process.

[0161] Phase 1: The TP driver notifies the display driver to execute the power-on process and notifies the AOD application to start the screen-off display process

[0162] Referring to the direction indicated by the thin solid arrow ① in Figure 9, when the electronic device is in the screen-off state, if the user clicks or touches the display screen, the TP driver of the electronic device will receive the user's single-click or touch operation of the display screen, that is, the TP driver will perceive the touch screen event in the screen-off state.

[0163] Different from the related technical process shown in FIG6 , in the embodiment of the present application, after the TP driver senses a touch screen event in the screen-off state, the TP driver performs the following actions:

[0164] On the one hand, referring to the direction indicated by the thick solid arrow in Figure 9 (1), the TP driver notifies the display driver to execute the power-up process. Accordingly, the display driver triggers the display screen to power on and initialize. Compared to related technologies, the display driver executes the power-up process in advance.

[0165] On the other hand, referring to the direction indicated by the dotted arrow ② in FIG9 , the TP driver transmits the touch screen event in the screen-off state to the input subsystem, and then the input subsystem transmits the touch screen event in the screen-off state to the AOD application.

[0166] That is to say, after the TP driver senses a touch screen event in the screen-off state, the TP driver not only notifies the AOD application to start the screen-off display process, but also notifies the display driver to execute the power-on process, so that the display driver executes the power-on process before receiving the power-on instruction issued by the AOD application.

[0167] Compared with the related technology in which the TP driver passes the touch screen event in the off-screen state to the AOD application, the AOD application starts the off-screen display process, and then the display driver executes the power-on process, the present application solution can allow the TP driver to immediately notify the display driver to execute the power-on process when the TP driver senses the touch screen event in the off-screen state. In this way, the display screen power-on process and the off-screen display startup process are implemented in parallel, which can shorten the off-screen display time.

[0168] Phase 2: The display driver executes the power-on process and the AOD application starts the screen-off display process

[0169] In an embodiment of the present application, while the display driver is executing the power-on process, the TP driver passes the touch screen event in the screen-off state to the AOD application, and then the AOD application starts the screen-off display process. In this way, the time consumption is shortened by executing the screen-off display startup process and the display screen power-on process in parallel.

[0170] Referring to the direction indicated by the thin solid arrow ③ in Figure 9, in response to a touch screen event in the off-screen state, the AOD application sends an AOD startup instruction to the lower layer. The AOD startup instruction includes a power-on instruction and an AOD display instruction. The AOD startup instruction passes through the power management service module and the SurfaceFlinger service module in the software architecture in sequence, and then reaches the HWC. The HWC first sends a power-on instruction to the display driver. Since the display has been powered on or is about to be powered on at this time, the display driver does not need to trigger the display to power on.

[0171] When the display screen has been powered on, the display driver directly returns an OK message to the HWC. Alternatively, when the display screen is about to be powered on, the display driver waits for the display screen to be powered on before returning an OK message to the HWC.

[0172] After the HWC receives the OK message returned by the display driver, the HWC sends an AOD display instruction to the display driver, and then the display driver sends the AOD display instruction to the display screen. In response to the AOD display instruction, the display screen displays the screen-off pattern.

[0173] Unlike the related art process shown in Figure 6, the present application solution has already started the power-on process before starting the off-screen display process, and after starting the off-screen display process, the display driver has already completed the power-on process or is about to complete the power-on process. In this way, by executing the display power-on process and the off-screen display startup process in parallel, the off-screen display time is significantly shortened.

[0174] For example, in related technologies, it takes about 150ms for a software module to process AOD services, and based on the hardware requirements of the screen chip specifications, it takes about 120ms for the display to power on. However, since the display power-on process and the off-screen display startup process can be executed in parallel in this application, the total AOD time is less than 270ms. Therefore, this application reduces the time required to complete the off-screen display in the off-screen state.

[0175] Based on Figure 9, Figure 10 shows a timing diagram of the off-screen display process in the off-screen state in an embodiment of the present application. Referring to Figure 10, the method includes the following steps S201-S217.

[0176] S201, when the display screen is in the off state, the display screen receives a touch screen operation.

[0177] It should be noted that the display screen is provided with a touch sensor. The touch sensor and the display screen constitute a touch screen. The touch sensor is used to detect touch operations applied on or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Accordingly, the display screen can provide visual output related to the touch operations.

[0178] The touch screen operation may be referred to as a touch screen operation in the screen-off state, and the event corresponding to the touch screen operation may be referred to as a touch screen event in the screen-off state.

[0179] S202: The display screen reports a touch screen event in the screen-off state to the TP driver.

[0180] It should be noted that the main difference between the timing diagram of the embodiment of the present application shown in Figure 10 and the related technology timing diagram shown in Figure 7 is S203-S207 (power-on in advance) and S212-S214 (power-on has been completed or is about to be completed) shown in the dotted box in Figure 10.

[0181] The following first describes the process of applying for early power-on in conjunction with S203-S207.

[0182] S203: The TP driver transmits the touch screen event in the screen-off state to the display driver.

[0183] S204: The display driver determines whether a screen-off display triggering condition is met based on a touch screen event in the screen-off state.

[0184] Among them, the above-mentioned screen-off display triggering conditions may include: the electronic device has turned on the screen-off display function, the display screen is in the screen-off state, and the user input operation is a preset touch screen operation.

[0185] It should be noted that the TP driver can notify the display driver to execute the power-on process in any of the following ways:

[0186] Method 1: The TP driver transmits the touchscreen event in the off-screen state to the display driver, which then determines whether the touchscreen event meets the off-screen display trigger condition. If the touchscreen event meets the off-screen display trigger condition, the display driver executes the power-on process. If the touchscreen event does not meet the off-screen display trigger condition, the display driver does not execute the power-on process.

[0187] Method 2: The TP driver determines whether the screen-off display trigger condition is met based on the touchscreen event in the screen-off state. If the touchscreen event in the screen-off state meets the screen-off display trigger condition, the TP driver passes the touchscreen event to the display driver, triggering the display driver to execute the power-on process. If the touchscreen event in the screen-off state does not meet the screen-off display trigger condition, the TP driver does not pass the touchscreen event to the display driver.

[0188] Method 3: The TP driver determines whether the screen-off display trigger condition is met based on the touchscreen event in the screen-off state. If the touchscreen event in the screen-off state meets the screen-off display trigger condition, the TP driver notifies the display driver to execute the power-on process, thereby triggering the display driver to execute the power-on process. If the touchscreen event in the screen-off state does not meet the screen-off display trigger condition, the TP driver does not notify the display driver to execute the power-on process.

[0189] For ease of explanation, FIG10 takes the above-mentioned method 1 as an example for explanation. In actual implementation, any of the above-mentioned methods may be used to implement the TP driver notifying the display driver to execute the power-on process.

[0190] S205 , the display driver executes a power-on process, that is, the display driver triggers the display screen to power on.

[0191] S206, the display screen is powered on and initialized.

[0192] In actual implementation, the display driver triggers the display IC to power on and initialize.

[0193] S207 , the display driver starts timing from the moment the display screen is triggered to be powered on.

[0194] S208: The TP driver transmits the touch screen event in the screen-off state to the input subsystem.

[0195] In some embodiments, the touch screen driver transmits the touch screen event to the display driver earlier than the touch screen driver transmits the touch screen event to the input subsystem.

[0196] In other embodiments, the time when the touch screen driver transmits the touch screen event to the display driver is equal to the time when the touch screen driver transmits the touch screen event to the input subsystem.

[0197] S209: The input subsystem transmits the touch screen event in the screen-off state to the AOD application.

[0198] In actual implementation, when the display screen is touched, the corresponding kernel layer TP driver will be triggered. After the TP driver receives the touch screen event, it will write the touch screen event to the corresponding input device node. Then the input system will read the touch screen event from the device node and pass the touch screen event up layer by layer.

[0199] S210 , in response to a touch screen event in the screen-off state, the AOD application is started, and triggers the start of the AOD service.

[0200] After the AOD application and AOD service are started, the screen-off display process can be started.

[0201] S211: The AOD application sends an AOD startup instruction to the power management service module. The AOD startup instruction is transparently transmitted through the power management service module and the SurfaceFlinger service module in sequence and reaches the HWC.

[0202] The AOD startup instruction includes a power-on instruction and an AOD display instruction.

[0203] The following S212 - S214 illustrate the AOD processing strategy of the present application in the case of early power-on.

[0204] S212, the HWC sends a power-on instruction to the display driver in response to the AOD start instruction, where the power-on instruction is used to control the display screen IC to power on.

[0205] S213 , in response to the power-on instruction, the display driver determines whether the timing duration is greater than or equal to a preset duration.

[0206] Compared to related technologies, this application has already implemented the power-on process in advance. After the display driver receives the power-on command, it does not send the power-on command to the display (as shown by the × in Figure 10). Instead, it determines whether the display has completed power-on and initialization. In actual implementation, the display power-on and initialization usually takes a preset time, for example, the preset time can be 120ms.

[0207] If the timing duration is greater than or equal to the preset duration, it indicates that the display screen has completed power-on and initialization, and then the following S214 is executed, that is, the TP driver returns an OK message to the HWC.

[0208] If the timing duration is less than the preset duration, it means that the display screen has not completed power-on and initialization, and the display driver waits until the timing duration reaches the preset duration, and then executes the following S214.

[0209] S214: The display driver returns an OK message to the HWC.

[0210] The following S215-S217 illustrate the process of implementing the screen-off display.

[0211] S215, after receiving the OK message, the HWC sends an AOD display instruction to the display driver.

[0212] S216, the display driver sends the AOD display instruction to the display screen to drive the display screen to display the screen-off pattern.

[0213] Among them, the AOD display instruction may include a screen-off pattern.

[0214] S217, in response to the AOD display instruction, the display screen displays a screen-off pattern.

[0215] In actual implementation, in response to the AOD display instruction, the display IC controls the display to display the screen-off pattern, completing the screen-off display process.

[0216] In some embodiments, the AOD display instruction also includes AOD backlight parameters. It should be noted that in actual implementation, the upper layer will first send the screen-off pattern to the display screen, and then send the AOD backlight parameters to the display screen. In actual implementation, in response to the AOD display instruction, the display IC controls the display screen to turn on the backlight and display the screen-off pattern according to the AOD backlight parameters, completing the screen-off display process.

[0217] The solution of the related technology is that in the screen-off display process, the touch screen event in the screen-off state is first passed to the AOD application, and then the AOD application starts the screen-off display process, and the upper-level software module handles the screen-off display business. Then the upper-level software module sends instructions to the display hardware, and the display hardware completes the power-on of the display based on the instructions sent by the upper-level software module, and then realizes the screen-off display.

[0218] Compared to related technologies, in the embodiment of the present application, when the TP driver receives a touch screen event in the off-screen state, the TP driver immediately notifies the display driver to execute the power-on process, so that the display starts powering on and initializing in advance. At the same time, the TP driver passes the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the time to complete the off-screen display in the off-screen state.

[0219] The above illustrates the screen-off display process and timing diagram in the screen-off state in an embodiment of the present application through Figures 9 and 10 respectively. The following is an analysis of the AOD time consumption in the screen-off state provided by the embodiment of the present application in conjunction with Figure 11.

[0220] As shown in (a) of Figure 11, in the related art, when the display screen is in the off state, if the user clicks or touches the display screen of the electronic device, the TP driver receives the touch screen event in the off state. The TP driver first notifies the AOD application to start the off screen display process, and then the AOD application starts the off screen display process: the display screen is first powered on, and then the display screen displays the off screen pattern, completing the off screen display process. The off screen display process includes the off screen display startup process taking time t1 and the display screen power-on process taking time t2, and the overall time consumption is t1 + t2.

[0221] As shown in (b) of Figure 11, when the display screen is in the off state, if the user clicks or touches the display screen of the electronic device, the TP driver receives the touch screen event in the off state. Compared with the related art, the improvement of this application is that the display screen power-on process and the off-screen display startup process are executed in parallel:

[0222] The TP driver immediately notifies the display driver to execute the power-on process, allowing the display to start powering on and initializing in advance. At the same time, the TP driver passes the touch screen event in the off-screen state to the AOD application, notifying the AOD application to start the off-screen display process.

[0223] Therefore, when the display screen is powered on and initialized, the AOD application starts the screen-off display process. After the display screen is powered on and initialized, the display screen displays the screen-off pattern, completing the screen-off display process.

[0224] In this application, the off-screen display process includes the off-screen display startup process, which takes time t1, and the display screen power-on process, which takes time t2. Because the display screen power-on process and the off-screen display startup process can be executed in parallel, the overall time taken is less than t1 + t2. Therefore, this application solution reduces the time it takes to complete the off-screen display in the off-screen state.

[0225] In actual implementation, based on the hardware requirements of the screen IC chip specifications, it takes about 120ms (i.e. t2) to power on and initialize the display screen, and the software takes about 150ms (i.e. t1) to process the off-screen display process, so the AOD overall process takes a minimum of about 270ms. Through the present application solution, since the display screen power-on process and the off-screen display startup process can be executed in parallel, for example, when the off-screen display process is implemented in the off-screen state, 120ms can be saved, so the overall time consumption is 150ms, which shows that the overall time consumption is significantly shortened. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.

[0226] Through the solution of this application, once the touch screen driver receives a touch screen event in the off-screen state, the touch screen driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related art, the touch screen driver passes the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display screen power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the off-screen display process. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.

[0227] In another possible implementation, when the touch screen driver receives a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the display power-on process, so that the display starts to power on in advance, and the power-on time is approximately in the range of [20ms, 50ms]. At the same time, the touch screen driver passes the touch screen event in the screen-off state to the AOD application, and the AOD application starts the screen-off display process: the AOD application sends an AOD startup instruction to the display, and the AOD startup instruction can carry the display initialization parameters. When the display receives the display initialization parameters, since the display has completed power-on in advance, the display can quickly enter initialization, which can also save a certain amount of time and make the screen-off display faster.

[0228] This application solution shortens the time it takes to achieve the off-screen display in the off-screen state by improving the mobile phone software system. When a user clicks or touches the display screen of an electronic device in the off-screen state, the electronic device uses the method for controlling the off-screen display provided by this application to quickly display the off-screen pattern, improving the user experience. The off-screen display performance optimization solution described in the embodiment of this application can support all current products and is compatible with all domestic and overseas versions, with universal applicability.

[0229] It should be noted that, in the embodiments of the present application, "greater than" can be replaced by "greater than or equal to", "less than or equal to" can be replaced by "less than", or "greater than or equal to" can be replaced by "greater than", and "less than" can be replaced by "less than or equal to".

[0230] The various embodiments described herein may be independent solutions or may be combined according to internal logic, and all of these solutions fall within the scope of protection of this application.

[0231] The present application also provides a chip, which is coupled to a memory and is used to read and execute computer programs or instructions stored in the memory to perform the methods in the above embodiments.

[0232] The present application also provides an electronic device, which includes a chip, and the chip is used to read and execute computer programs or instructions stored in a memory, so that the methods in each embodiment are executed.

[0233] This embodiment also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method for controlling the screen off display in the above-mentioned embodiment.

[0234] This embodiment also provides a computer program product, in which a computer-readable storage medium stores program code. When the computer program product runs on a computer, the computer executes the above-mentioned related steps to implement the method for controlling the off-screen display in the above-mentioned embodiment.

[0235] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module. The device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions. When the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the method of controlling the screen-off display in the above-mentioned method embodiments.

[0236] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0237] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0238] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for controlling screen-off display, characterized in that: The method is applied to an electronic device, the electronic device includes a processor and a display screen, the processor includes an off-screen display AOD application, a display driver, and a touch screen driver, and the method includes: When the display screen is in an off-screen state, the display driver receives a touch screen event transmitted by the touch screen driver, where the touch screen event is a preset touch screen operation on the display screen by the user; In response to the touch screen event, the display driver triggers the display screen to power on and initialize; The display driver starts timing from the moment when the display screen is triggered to be powered on; The display driver receives a power-on instruction from the AOD application; In response to the power-on instruction, the display driver determines whether the timing duration is greater than or equal to a preset duration; When the timing duration is greater than or equal to the preset duration, the display driver returns a completion message; or, when the timing duration is less than the preset duration, the display driver waits until the timing duration is greater than or equal to the preset duration and then returns the completion message; The display driver receives an AOD display instruction from the AOD application; In response to the AOD display instruction, the display driver triggers the display screen to display a screen-off pattern.

2. The method according to claim 1, characterized in that In response to the touch screen event, the display driver triggers the display screen to power on and initialize, including: The display driver determines that the touch screen event satisfies a screen-off display triggering condition; In response to the touch screen event, the display driver triggers the display screen to power on and initialize.

3. The method according to claim 2, characterized in that The screen-off display triggering condition includes: the electronic device has turned on the screen-off display function, the display screen is in the screen-off state, and the user input operation is the preset touch screen operation.

4. The method according to any one of claims 1 to 3, characterized in that The preset touch screen operation is an operation of lightly touching or clicking the display screen.

5. The method according to any one of claims 1 to 4, characterized in that The display driver triggers the display screen to power on and initialize, including: The display driver triggers the integrated chip IC of the display screen to start powering on and initializing.

6. The method according to any one of claims 1 to 5, characterized in that In response to the AOD display instruction, the display driver triggers the display screen to display a screen-off pattern, including: The display driver sends an AOD display instruction to the IC of the display screen, so that the IC of the display screen controls the display screen to display the screen-off pattern based on the AOD display instruction.

7. The method according to any one of claims 1 to 6, characterized in that The processor also includes an input subsystem; The touch screen event is also transmitted by the touch screen driver to the input subsystem, and the input subsystem transmits the touch screen event to the AOD application; The power-on instruction and the AOD display instruction are instructions issued by the AOD application in response to the touch screen event.

8. The method according to claim 7, characterized in that The time when the touch screen event is delivered to the display driver is earlier than or equal to the time when the touch screen event is delivered to the AOD application.

9. The method according to any one of claims 1 to 8, characterized in that The processor also includes a power management service module, a surface drawing SurfaceFlinger service module and a hardware synthesis module HWC; The power-on instruction is issued by the AOD application, and is sent through the power management service module, the The SurfaceFlinger service module and the HWC are transmitted to the display driver.

10. The method according to claim 9, characterized in that After the power-on instruction is transmitted to the HWC module, the HWC module sends the power-on instruction to the display driver; when the HWC module receives the completion message returned by the display driver, the HWC module sends the AOD display instruction to the display driver.

11. An electronic device, characterized in that: The electronic device comprises a display screen, a processor, a memory and a computer program stored in the memory, wherein the processor is used to execute the computer program so that the electronic device implements the method as claimed in any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 10.

13. A computer program product, characterized in that The computer program product comprises a computer program code, and when the computer program code is executed by an electronic device, the electronic device executes the method according to any one of claims 1 to 10.

Images