Method for controlling screen-off display, electronic equipment and storage medium
By executing the display power-on and screen-off display processes in parallel in electronic devices, the problem of time-consuming touch screen in the screen-off state is solved, and the user experience is improved.
Patent Information
- Application Number
- CN202310804902.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-30
- Publication Date
- 2024-12-31
AI Technical Summary
When existing electronic devices touch the screen while the screen is off, the display of the screen takes a long time, which affects the user experience.
After the touch screen driver senses the touch screen event in the screen out state, the display driver is immediately notified to perform the power-on process and pass the touch screen event to the AOD application to perform the display power-on and screen out display processes in parallel, shortening the The overall time-consuming display of the screen is displayed.
It significantly shortens the time-consuming display of the screen, allowing users to see the screen off pattern more quickly when touching the screen while the screen is off, improving the user experience.
Smart Images

Figure CN119225506A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a method for controlling screen-off display, an electronic device, and a storage medium. Background Art
[0002] With the rapid development of electronic technology, electronic devices such as smart phones and tablets have more and more functions and have become indispensable tools in people's lives and work. Taking mobile phones as an example, users often turn on the screen of their mobile phones to check time, notifications and other information. In order to facilitate users to check basic information such as time and save power of electronic devices, the always on display (AOD) function of electronic devices came into being.
[0003] The implementation principle of the AOD function is: after the screen of the electronic device is turned off, some pixels of the screen can be lit up to display information such as clock, date, battery level, message reminders, etc., while other pixels of the screen are always in a closed state, for example, these closed pixels appear black, so that users can conveniently view the above information without lighting up the entire screen of the electronic device, and can reduce the power consumption of the electronic device.
[0004] Currently, when an electronic device is in the screen-off state, it takes a long time for the screen-off pattern to be displayed after the user touches the screen. In other words, the screen-off display process in the screen-off state in the related art is time-consuming. Summary of the invention
[0005] The present application provides a method for controlling the off-screen display, an electronic device and a storage medium. In the scenario where the screen is touched in the off-screen state, the off-screen display startup process and the display screen power-on process are executed simultaneously, which significantly shortens the off-screen display time and improves the user experience.
[0006] In a first aspect, the present application provides a method for controlling an off-screen display, the method being applied to an electronic device, the electronic device comprising a processor and a display screen, the processor comprising an off-screen display AOD application, a display driver, and a touch screen driver, the method comprising:
[0007] When the display screen is in the off state, the display driver receives a touch screen event transmitted by the touch screen driver (the touch screen event is a preset touch screen operation of the user on the display screen); in response to the touch screen event, the display driver triggers the display screen to power on and initialize; the display driver starts timing from the moment the display screen is triggered to power on; the display driver receives a power-on instruction from the AOD application; in response to the power-on instruction, the display driver determines whether the timing duration is greater than or equal to the preset duration; when the timing duration is greater than or equal to the preset duration, the display driver returns a completion message; or, when the timing duration is less than the preset duration, the display driver waits until the timing duration is greater than or equal to the preset duration and returns a completion message; the display driver receives an AOD display instruction from the AOD application; in response to the AOD display instruction, the display driver triggers the display screen to display an off pattern.
[0008] Through the method for controlling the off-screen display provided by the embodiment of the present application, once the touch screen driver receives a touch screen event in the off-screen state, the touch screen driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related art, the touch screen driver passes the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display screen power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the off-screen display process. Therefore, when the user touches lightly on the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.
[0009] In the related technology, when the display screen is in the off state, if the touch screen driver receives a touch screen event, the touch screen driver will pass the touch screen event in the off state to the input subsystem, and then the input subsystem will pass the touch screen event to the AOD application, and the AOD application will start the off screen display process, and then the display driver will trigger the display screen to power on and initialize. After completing the power-on and initialization, the display driver will trigger the display screen to display the off screen pattern to achieve the off screen display.
[0010] Compared with the related art, the improvement of the present application lies in that after the touch screen driver senses the touch screen event in the off-screen state, the touch screen driver notifies the display driver to execute the power-on process. At the same time, the touch screen driver transmits the touch screen event in the off-screen state to the input subsystem, and then the input subsystem transmits the touch screen event in the off-screen state to the AOD application to trigger the off-screen display startup process.
[0011] That is to say, after the touch screen driver senses a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the power-on process, and at the same time notifies the AOD application to start the screen-off display process. Compared with the related art, the display driver executes the power-on process in advance in the screen-off display process of the present application. It can be understood that before starting the screen-off display process, the display driver has started to execute the power-on process, and after starting the screen-off display process, the display driver has completed the power-on process or is about to complete the power-on process. The beneficial effect of this is that the display screen power-on process and the screen-off display startup process are executed at the same time, which significantly shortens the time consumed for the screen-off display.
[0012] In another possible implementation, when the touch screen driver receives a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the display screen power-on process, so that the display screen starts to power on in advance, and the power-on time is approximately in the range of [20ms, 50ms]. At the same time, the touch screen driver passes the touch screen event in the screen-off state to the AOD application, and the AOD application starts the screen-off display process: the AOD application sends an AOD startup instruction to the display screen, and the AOD startup instruction can carry the display screen initialization parameters. When the display screen receives the display screen initialization parameters, since the display screen has completed power-on in advance, the display screen can quickly enter initialization, which can also save a certain amount of time and make the screen-off display faster.
[0013] In some possible implementations, in response to the touch screen event, the display driver triggers the display screen to power on and initialize, including: the display driver determines that the touch screen event satisfies the screen-off display triggering condition; in response to the touch screen event, the display driver triggers the display screen to power on and initialize.
[0014] Through the above solution, after the touch screen driver senses a touch screen event in the screen-off state, the touch screen driver not only notifies the AOD application to start the screen-off display process, but also notifies the display driver to execute the power-on process.
[0015] Compared with the related art in which the touch screen driver transmits the touch screen event in the screen-off state to the AOD application, the AOD application starts the off-screen display process, and then the display driver executes the power-on process, the present application solution can allow the touch screen driver to immediately notify the display driver to execute the power-on process when the touch screen driver senses the touch screen event in the screen-off state, thereby shortening the off-screen display time.
[0016] In actual implementation, based on the hardware requirements of the screen IC chip specifications, it takes about 120ms to power on and initialize the display screen, and the software takes about 150ms to process the off-screen display process, so the AOD overall process takes a minimum of about 270ms. Through the present application scheme, since the display screen power-on process and the off-screen display startup process can be executed in parallel, for example, when the off-screen display process is implemented in the off-screen state, 120ms can be saved, so the overall time consumption is 150ms, which shows that the overall time consumption is significantly shortened. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.
[0017] In some possible implementations, the above-mentioned screen-off display triggering conditions include: the electronic device has turned on the screen-off display function, the display screen is in the screen-off state, and the user input operation is a preset touch screen operation.
[0018] In some possible implementations, the preset touch screen operation may be an operation of lightly touching or clicking the display screen.
[0019] If the touch screen event meets the screen off display triggering condition, it means that the touch screen event will trigger the screen off display. This ensures that the current scene is a scene where the user input operation triggers the screen off display.
[0020] It should be noted that the display driver can determine whether the touch screen event meets the screen off display trigger condition; the touch screen driver can also determine whether the touch screen event meets the screen off display trigger condition, and then when the touch screen driver determines that the touch screen event meets the screen off display trigger condition, the touch screen driver passes the touch screen event to the display driver to trigger the display driver to execute the power-on process, or the touch screen driver directly notifies the display driver to execute the power-on process.
[0021] In some possible implementations, the display driver triggers the display screen to power on and initialize, including: the display driver triggers the integrated chip IC of the display screen to start powering on and initializing.
[0022] It should be noted that the protocol stipulates that it takes a preset time (recorded as T1) for the display screen to be powered on and initialized. That is to say, after the preset time T1, the display screen is initialized and ready to execute the display task issued by the display driver. In other words, the display driver needs to wait for the preset time T1, that is, until the display screen is initialized, before returning the power-on completion message to the upper layer, so as to further complete the screen off display.
[0023] In the present application scheme, the processor may further include a drawing module and a backlight module. The drawing module is used to draw a screen-off pattern. The backlight module is used to collect AOD backlight parameters. The AOD may retrieve the screen-off pattern and the AOD backlight parameters from the drawing module and the backlight module, respectively, and generate an AOD display instruction according to the screen-off pattern and the AOD backlight parameters.
[0024] In some possible implementations, in response to the AOD display instruction, the display driver triggers the display screen to display the screen-off pattern, including: the display driver sends the AOD display instruction to the IC of the display screen, so that the IC of the display screen controls the display screen to turn on the backlight with AOD backlight parameters and display the screen-off pattern based on the AOD display instruction.
[0025] In the present application, the processor also includes an input subsystem. The touch screen event is also transmitted to the input subsystem by the touch screen driver, and the input subsystem transmits the touch screen event to the AOD application. The power-on instruction and the AOD display instruction are instructions issued by the AOD application in response to the touch screen event.
[0026] In some possible implementations, the time when the touch screen event is delivered to the display driver is earlier than or equal to the time when the touch screen event is delivered to the AOD application.
[0027] Compared with the related technical process, after the touch screen driver senses the touch screen event in the off-screen state, the present application solution not only notifies the AOD application to start the off-screen display process, but also notifies the display driver to execute the power-on process. Moreover, the display screen power-on process is executed earlier than the off-screen display start process, or the display screen power-on process and the off-screen display start process are executed at the same time.
[0028] Such beneficial effects are reflected in that: before starting the off-screen display process, the display driver has already started executing the power-on process, and after starting the off-screen display process, the display driver has completed the power-on process or is about to complete the power-on process. In this way, by executing the off-screen display startup process and the display screen power-on process in parallel, the time consumed for off-screen display is significantly shortened.
[0029] In the present application, the processor also includes a power management service module, a surface drawing SurfaceFlinger service module and a hardware synthesis module HWC. The power-on instruction is issued by the AOD application, transmitted through the power management service module, the SurfaceFlinger service module and the HWC, and reaches the display driver.
[0030] Among them, after the power-on instruction is transmitted to the HWC module, the HWC module sends the power-on instruction to the display driver; when the HWC module receives the completion message returned by the display driver, the HWC module sends the AOD display instruction to the display driver.
[0031] In the present application scheme, in response to a touch screen event in the screen-off state, the AOD application sends an AOD startup instruction to the lower layer, and the AOD startup instruction includes a power-on instruction and an AOD display instruction. The AOD startup instruction passes through the power management service module and the SurfaceFlinger service module in the software architecture in turn, and then reaches the HWC. The HWC first sends a power-on instruction to the display driver. Since the display screen has been powered on or is about to be powered on at this time, the display driver does not need to trigger the display screen to power on.
[0032] The display driver responds differently to different situations in which the display has been powered on or is about to be powered on:
[0033] Case 1: When the display screen has been powered on, the display driver directly returns an OK message to the HWC. Case 2: When the display screen is about to be powered on, the display driver waits for the display screen to be powered on before returning an OK message to the HWC.
[0034] After the HWC receives the OK message returned by the display driver, the HWC sends an AOD display instruction to the display driver, and then the display driver sends the AOD display instruction to the display screen. In response to the AOD display instruction, the display screen displays the screen-off pattern.
[0035] Compared with the related technical process, the display driver of the present application has already started the power-on process before starting the off-screen display process, and after starting the off-screen display process, the display driver has completed the power-on process or is about to complete the power-on process. In this way, by executing the off-screen display startup process and the display screen processing process in parallel, the time consumed for off-screen display is significantly shortened.
[0036] In a second aspect, the present application provides a device for controlling off-screen display, the device comprising a unit for executing the method in the first aspect. The device may correspond to executing the method described in the first aspect, and the relevant description of the unit in the device can refer to the description of the first aspect, which will not be repeated here for the sake of brevity.
[0037] The method described in the first aspect above can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a processing module or unit, a display module or unit, etc.
[0038] In a third aspect, the present application provides an electronic device comprising a display screen, a processor, a computer program or instructions stored in the processor and a memory, wherein the processor is used to execute the computer program or instructions so that the method in the first aspect is executed.
[0039] In a fourth aspect, the present application provides a computer-readable storage medium on which a computer program (also referred to as instructions or codes) for implementing the method in the first aspect is stored. For example, when the computer program is executed by a computer, the computer can perform the method in the first aspect.
[0040] In a fifth aspect, the present application provides a chip, including a processor. The processor is used to read and execute a computer program stored in a memory to perform the method in the first aspect and any possible implementation thereof. Optionally, the chip also includes a memory, and the memory is connected to the processor via a circuit or wire.
[0041] In a sixth aspect, the present application provides a chip system, including a processor. The processor is used to read and execute a computer program stored in a memory to perform the method in the first aspect and any possible implementation thereof. Optionally, the chip system also includes a memory, and the memory is connected to the processor via a circuit or wire.
[0042] In a seventh aspect, the present application provides a computer program product, which includes a computer program (also referred to as instructions or codes). When the computer program is executed by an electronic device, the electronic device implements the method in the first aspect.
[0043] It can be understood that the beneficial effects of the second to seventh aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] Figure 1 A schematic diagram of an application scenario of the method for controlling screen-off display provided in an embodiment of the present application;
[0045] Figure 2 A schematic diagram of a screen-off display process in a method for controlling screen-off display provided in an embodiment of the present application;
[0046] Figure 3 A schematic diagram comparing the method for controlling screen-off display provided in an embodiment of the present application with related technologies;
[0047] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0048] Figure 5 A schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;
[0049] Figure 6 A flowchart of a method for controlling screen-off display provided for related technologies;
[0050] Figure 7 A timing diagram of a method for controlling screen-off display provided in the related art;
[0051] Figure 8 A schematic diagram of the time consumption of a method for controlling screen-off display provided in the related art;
[0052] Fig. 9 A flowchart of a method for controlling screen-off display provided in an embodiment of the present application;
[0053] Fig.10 A timing diagram of a method for controlling screen-off display provided in an embodiment of the present application;
[0054] Fig.11 A schematic diagram of the time consumption of the method for controlling the screen off display provided in an embodiment of the present application. DETAILED DESCRIPTION
[0055] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0056] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The symbol " / " in this article indicates that the associated objects are in an or relationship, for example, A / B means A or B.
[0057] The terms "first" and "second" in the specification and claims herein are used to distinguish different objects rather than to describe a specific order of objects. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two, for example, multiple processing units refer to two or more processing units, etc.; multiple elements refer to two or more elements, etc.
[0058] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0059] With the rapid development of electronic technology, electronic devices such as smartphones and tablets have more and more functions and have become indispensable tools in people's lives and work. Taking mobile phones as an example, users often turn on the screen of their mobile phones to check the time, notifications and other information. In order to facilitate users to check basic information such as time and save power of electronic devices, the screen-off display function of electronic devices came into being.
[0060] The principle of the off-screen display function is that after the electronic device turns off the screen, some pixels of the screen can be lit up to display information such as the clock, date, battery level, and message reminders, while other pixels of the screen are always in an off state, for example, these off pixels appear black, so that users can conveniently view the above information without lighting up the entire screen of the electronic device, and the power consumption of the electronic device can be reduced. Electronic devices usually turn on the off-screen display function by default.
[0061] Electronic devices can support the following two scenarios for triggering screen-off display:
[0062] Scenario 1: The screen turns off after a timeout or by pressing the power button.
[0063] like Figure 1 As shown in (a) in the figure, when the electronic device changes from on screen to off screen, the off screen display will be automatically triggered, that is, some pixels on the screen will be lit up and an off screen pattern will be displayed. For example, the off screen pattern includes information such as clock, date, and notification, which is convenient for users to view the above commonly used information and can reduce the power consumption of the electronic device. Then, after the off screen pattern is displayed for a period of time (5 seconds), the off screen pattern will automatically disappear.
[0064] Scenario 2: Touch the screen lightly when the screen is off to trigger the screen off display.
[0065] like Figure 1 As shown in (b) in FIG, when the electronic device is in the screen-off state, if the user touches or clicks the display screen, the screen-off display will be triggered, that is, a local area of the screen will be lit up and the screen-off pattern will be displayed. Then, after a period of time (5 seconds), the screen-off pattern will automatically disappear. This method of touching or clicking the screen in the screen-off state to trigger the screen-off display can be called "touch mode".
[0066] At present, for the above scenario 2, it takes a long time for the electronic device to realize the off-screen display in the off-screen state, and there is a problem of too long delay in the off-screen display. It should be noted that the embodiment of the present application mainly studies and improves the problem of too long delay in the off-screen display in the above scenario 2.
[0067] The inventors of the present application have discovered that the reasons why the screen-off display takes a long time in the current screen-off state mainly include: based on the hardware requirements of the screen IC chip specifications, it takes about 120ms to power on and initialize the display screen, and the software takes about 150ms to process the screen-off display process, so the overall screen-off display process takes a minimum of about 270ms. This will cause the screen-off display to take a long time, and therefore will give users a feeling that "the screen-off display is slow".
[0068] In order to solve the problem of slow display when the screen is off, an embodiment of the present application provides a method for controlling the display when the screen is off. Through the solution of the present application, once the touch screen driver receives a touch screen event in the screen off state, the touch screen driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related art, the touch screen driver passes the touch screen event in the screen off state to the AOD application, and the AOD application starts the screen off display process. In this way, the display screen power-on process and the screen off display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the screen off display process. Therefore, when the user touches the display screen in the screen off state, the screen off display becomes faster, which improves the user experience.
[0069] Figure 2 Schematic diagram showing the state change of the display screen during the screen off display process. Figure 2 As shown, the display screen is in the off state. When the electronic device receives a touch screen event, the off screen display process is started. The display screen is first powered on and initialized, and then the display screen displays the off screen pattern to achieve off screen display. The protocol stipulates that it takes a preset time (recorded as T1) to power on and initialize the display screen. In other words, after the preset time T1, the display screen completes initialization and is ready to execute the display task issued by the display driver.
[0070] It should be noted that the display driver needs to wait for a preset time length T1, that is, after the display screen is initialized, it will return the power-on completion message to the upper layer to further complete the screen off display. Exemplarily, the preset time length T1 can be 120ms. The preset time length is for illustrative purposes only and can be set according to actual usage requirements, and is not limited in the embodiments of this application.
[0071] In an embodiment of the present application, the screen-off display process involves power-on instructions and AOD display instructions. The AOD display instruction is used to control the display screen to display a screen-off pattern. The power-on instruction is used to control the power-on of the display screen, specifically to control the power-on of the display screen IC (also called the display driver integrated chip). Therefore, "display screen power-on" actually refers to "display screen IC power-on". It can be understood that when the display screen IC is in a powered-on state, the display screen IC can provide display content for the display screen, and the display screen IC can respond to the AOD display instruction to control the display screen to display the screen-off pattern.
[0072] In order to better understand the embodiments of the present application, Figure 3 The embodiments of the present application are briefly described in comparison with the related art:
[0073] Figure 3 (a) in FIG. 1 shows the screen-off display process in the screen-off state provided by the related art. Figure 3 As shown in (a), when a touch screen event occurs in the screen-off state, the AOD application is first notified of the touch screen event in the screen-off state, and then the AOD application starts the screen-off display process. Next, the display screen is powered on first, and then the screen-off pattern is displayed to achieve the screen-off display.
[0074] Figure 3 (b) in FIG. 1 shows the screen-off display process in the screen-off state provided by the present application. Figure 3 As shown in (b), when a touch screen event occurs in the off-screen state, the display driver is immediately notified to execute the power-on process, and the AOD application is notified to start the off-screen display process. In this way, the display power-on process and the off-screen display start process are executed in parallel to complete the off-screen display.
[0075] Compared with the related art, the improvement of the present application lies in that after the touch screen driver senses the touch screen event in the off-screen state, the touch screen driver notifies the display driver to execute the power-on process. At the same time, the touch screen driver transmits the touch screen event in the off-screen state to the input subsystem, and then the input subsystem transmits the touch screen event in the off-screen state to the AOD application to start the off-screen display process.
[0076] That is to say, after the touch screen driver senses a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the power-on process, and at the same time notifies the AOD application to start the screen-off display process.
[0077] Compared with the related art, the display driver in the off-screen display process of the present application executes the power-on process in advance. It can be understood that before starting the off-screen display process, the display driver has already started to execute the power-on process, and after starting the off-screen display process, the display driver has completed the power-on process or is about to complete the power-on process.
[0078] This has the beneficial effect that the display screen power-on process and the screen-off display startup process are executed simultaneously, which significantly shortens the screen-off display time.
[0079] It should be noted that the electronic device described in this application is an electronic device with a display screen and a screen-off display function. For example, the electronic device can be a smart terminal such as a mobile phone, a tablet computer, a smart watch, etc. The specific technology and specific device form used by the electronic device are not limited here. For the convenience of description, the subsequent embodiments are all exemplified by the electronic device being a mobile phone.
[0080] See also Figure 4 , is a structural diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a touch sensor 180K, an ambient light sensor 180L, and the like.
[0081] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. For example, the processor 110 is used to execute the method for controlling the off-screen display in an embodiment of the present application.
[0082] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0083] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0084] The external memory 120 generally refers to an external memory. In the embodiment of the present application, the external memory refers to a memory other than the memory of the electronic device and the cache of the processor, and the memory is generally a non-volatile memory.
[0085] The internal memory 121, which may also be referred to as "memory", may be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
[0086] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may be an organic light-emitting diode (OLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0087] The touch sensor 180K is also called a "touch panel" or a touch screen sensor. The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194.
[0088] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0089] The button 190 includes a power button, which is used to trigger turning on or off the display screen. For example, when the display screen is in a light-on state, if the user presses the power button, the display screen state changes from the light-on state to the light-off state.
[0090] The above is a specific description of the embodiment of the present application using the electronic device 100 as an example. It should be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. The electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.
[0091] In addition, an operating system is running on the above components, such as the iOS operating system developed by Apple, the Android open source operating system developed by Google, and the Windows operating system developed by Microsoft. Application programs can be installed and run on the operating system.
[0092] The operating system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.
[0093] Figure 5 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[0094] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom: application layer (applications), application framework layer (application framework), system Native library (called Native layer), hardware abstraction layer (HAL) and kernel layer (kernel). For ease of explanation, Figure 5 The hardware layer that interacts with the above software structure is also reflected.
[0095] It should be noted that the Android system is a Linux-based operating system, mainly used for portable devices. The development of upper-layer applications (such as the application layer and application framework layer) in the Android system is generally completed based on Java. Since some low-level tasks are not easy to implement in Java, when it comes to tasks such as local services, link libraries or hardware drivers, it is usually necessary to allow C programs to implement them, and C programs run in the system Native library. The system Native library includes an interface for Java to call C++ code.
[0096] The application layer may include a series of application packages. For example, the application layer may include AOD applications and other applications, and the embodiments of the present application do not impose any limitation on this.
[0097] The application framework layer provides an application programming interface (API) and a programming framework for the application programs of the application layer. The application framework layer includes some predefined functions, which are not limited in any way in the embodiments of the present application.
[0098] Exemplarily, the application framework layer may include a power management service (PMS) module, wherein the power management service module is used to manage power on and power off of the display screen.
[0099] Exemplarily, the application framework layer may further include an AOD service module, and the AOD service module is used to provide an off-screen display service for the AOD application.
[0100] Exemplarily, the application framework layer may further include a drawing module. The drawing module is used to provide a screen-off pattern for screen-off display.
[0101] The Native layer can include multiple functional modules. For example, in the present application, the Native layer includes a surface drawing (SurfaceFlinger) service module. Among them, the function of the SurfaceFlinger service module is to accept graphic display data from multiple sources, synthesize them, and then send them to the display device. Image display can be specifically completed by multiple classes such as SurfaceFlinger, HWC, display screen, etc.
[0102] In the present application, the Native layer also includes an input subsystem. The input subsystem is one of the important system services in the Android operating system, which is dedicated to processing various external input signals of input devices. Input devices include: display screen, keyboard, mouse, etc. Taking the user input as a touch screen as an example, after the display screen is touched, the corresponding hardware driver (such as the touch screen driver of the kernel layer) will be triggered. After the touch screen driver receives the touch screen event, the touch screen driver will write the touch screen event to the corresponding input device node, and then the input system will read the touch screen event from the device node, and then pass the touch screen event up layer by layer, and pass the touch screen event to the corresponding activity.
[0103] The HAL layer may include a hardware composition module (hwcomposer, HWC), which has the function or ability to use hardware to complete image data combination and display, and provide hardware support for the SurfaceFlinger service.
[0104] The kernel layer is a layer between hardware and software. Its role is to pass application requests to the hardware. The kernel layer provides the most basic functions of the operating system. Usually, the kernel layer provides system services such as process management, interrupt response, memory management, network and inter-process communication.
[0105] In the present application, the kernel layer includes a display driver. The display driver can be combined with a display integrated circuit or chip (integrated circuit, IC) to jointly control the display function of the display. For example, the display driver and the display IC, in a combination of software and hardware, jointly implement the off-screen display function. The display driver can also be used to set the backlight parameters of the display; wherein, when the backlight parameters of the display are set to 0, the display is in an off-screen state; when the backlight parameters of the display are set to any value in the range of [1, 255], the display is in a bright screen state.
[0106] In the present application, the kernel layer also includes a touch panel (TP) driver. In the present application, the TP driver is used to receive touch screen events sent by the touch screen sensor of the display screen, report the touch screen events to the input subsystem, and pass the touch screen events to the display driver to trigger the display driver to execute the power-on process.
[0107] The hardware layer may include a display screen (such as OLED or LCD), and the display screen is provided with an IC, also called a display screen IC. The hardware layer also includes a touch screen sensor. When a user clicks or touches on the display screen, the touch screen sensor of the display screen can sense the user's touch screen operation and determine that there is a touch screen event. The touch screen sensor of the display screen can send the touch screen event to the TP driver.
[0108] It should be noted that although the embodiments of the present application are described using the Android system as an example, its basic principles are also applicable to electronic devices based on operating systems such as iOS or Windows.
[0109] The execution subject of the method for controlling the off-screen display provided in the embodiment of the present application can be the above-mentioned electronic device, or it can be a functional module and / or functional entity in the electronic device that can implement the method for controlling the off-screen display, and the present application scheme can be implemented in hardware and / or software, which can be determined according to actual use requirements, and the embodiment of the present application is not limited. The following takes an electronic device as an example, and combines the accompanying drawings to exemplarily illustrate the method for controlling the off-screen display provided in the embodiment of the present application.
[0110] In order to highlight the improvements of the embodiments of the present application over the related art, the following compares the present application scheme with the related art in terms of the off-screen display process, timing diagram, and time consumption in the off-screen state, and explains the improvements. Figures 6 to 8Describe the screen off display process, timing diagram and time consumption in the related technology, and then combine Figures 9 to 11 , the method for controlling the off-screen display provided in an embodiment of the present application is described in terms of the off-screen display process, timing diagram, and time consumption.
[0111] Related technologies - screen-off display process
[0112] Figure 6 : is a software architecture diagram of the off-screen display process in the off-screen state in the related art. Among them, the off-screen display process in the off-screen state can be divided into two stages: the first stage: the touch screen event transmission process, and the second stage: the off-screen display start and completion process. Among them, the touch screen event transmission process refers to the direction indicated by the dotted arrow, and the off-screen display start and completion refer to the direction indicated by the solid arrow.
[0113] Phase 1: Touch screen event transmission process
[0114] refer to Figure 6 As shown in ①, when the electronic device is in the screen-off state, if the user clicks or touches the display screen, the TP driver of the electronic device will receive the user's single click or touch operation of the display screen, that is, the TP driver will sense the touch screen event in the screen-off state. The TP driver passes the touch screen event in the screen-off state to the input subsystem, and then the input subsystem passes the touch screen event in the screen-off state to the AOD application.
[0115] Phase 2: Turn off the screen to display the startup and completion process
[0116] After receiving a touch screen event in the screen-off state, the AOD application starts the screen-off display process.
[0117] It should be noted that when the electronic device is in the screen-off state, the display IC is in the power-off state. When starting the screen-off display process, it is first necessary to trigger the display IC to power on, and then the display IC controls the display to display the screen-off pattern.
[0118] refer to Figure 6 As shown in ②, the AOD application sends an AOD startup instruction, which includes a power-on instruction and an AOD display instruction. The AOD startup instruction is transmitted through the power management service module and the SurfaceFlinger service module in the software architecture in turn, and then reaches the HWC. The HWC first sends a power-on instruction to the display driver, and accordingly, the display driver responds to the power-on instruction and triggers the display IC to power on. Then, refer to Figure 6As shown in ③, the display driver returns an OK message to the HWC. After the HWC receives the OK message, the HWC sends an AOD display instruction to the display driver. The display driver sends the AOD display instruction to the display IC. In response to the AOD display instruction, the display IC controls the display to display the screen-off pattern and completes the screen-off display.
[0119] pass Figure 6 It can be seen that during the screen-off display process in the screen-off state, according to relevant technologies, the touch screen event in the screen-off state needs to be passed to the AOD application first, and then the AOD application starts the screen-off display process. In the AOD implementation process, it is necessary to trigger the display screen to power on first, and then trigger the display screen to display the screen-off pattern, thereby completing the screen-off display.
[0120] exist Figure 6 On the basis of Figure 7 The timing diagram of the screen-off display process in the screen-off state in the related art is shown. Figure 7 As shown, the method includes the following steps S101-S115.
[0121] S101, when the display screen is in an off state, the display screen receives a touch screen operation.
[0122] In actual implementation, when a user touches or clicks a display screen, a touch sensor provided on the display screen can sense the user's touch screen operation.
[0123] Among them, the event that the display screen is touched or clicked when it is in the off state can be called a touch screen event in the off state.
[0124] S102, the display screen reports a touch screen event in the screen-off state to the TP driver.
[0125] S103, the TP driver transmits the touch screen event in the screen-off state to the input subsystem.
[0126] S104: The input subsystem transmits the touch screen event in the screen-off state to the AOD application.
[0127] In actual implementation, when the display screen is touched, the corresponding kernel layer TP driver will be triggered. After the TP driver receives the touch screen event, it will write the touch screen event to the corresponding input device node. Then the input system will read the touch screen event from the device node and pass the touch screen event up layer by layer.
[0128] S105, in response to a touch screen event in the screen-off state, the AOD application is started, and triggers the start of the AOD service.
[0129] After the AOD application and AOD service are started, the screen-off display process can be started.
[0130] S106, the AOD application sends an AOD startup instruction to the power management service module. The AOD startup instruction is transparently transmitted through the power management service module and the SurfaceFlinger service module in sequence and reaches the HWC.
[0131] The AOD startup instruction includes a power-on instruction and an AOD display instruction.
[0132] The following S107-S112 illustrate the process of powering on the display screen.
[0133] S107, the HWC sends a power-on instruction to the display driver in response to the AOD start instruction, where the power-on instruction is used to control the display screen IC to power on.
[0134] S108, the display driver sends a power-on instruction to the display screen to drive the display screen to power on.
[0135] S109, in response to the power-on instruction, the display screen is powered on.
[0136] In actual implementation, the display driver sends a power-on instruction to the display screen IC, and then the display screen IC is powered on in response to the power-on instruction.
[0137] S110, when the display driver sends a power-on instruction to the display screen, the timing starts.
[0138] In actual implementation, it usually takes a preset time for the display screen to power on, for example, the preset time may be 120 ms.
[0139] S111, the display driver determines whether the timing duration reaches a preset duration.
[0140] If the timing duration reaches (ie, is greater than or equal to) the preset duration, the following S112 is continued to be executed.
[0141] If the timing duration does not reach (ie is less than) the preset duration, wait until the timing duration reaches the preset duration, and then execute the following S112.
[0142] S112, the display driver returns a completion (OK) message to the HWC.
[0143] The following S113-S115 illustrate the process of the display screen completing the screen-off display.
[0144] S113, after receiving the OK message, the HWC sends an AOD display instruction to the display driver.
[0145] S114, the display driver sends the AOD display instruction to the display screen to drive the display screen to display the screen-off pattern.
[0146] S115, in response to the AOD display instruction, the display screen displays a screen-off pattern.
[0147] Among them, in response to the AOD display instruction, the display screen IC first obtains the screen-off image, and then controls the display screen to display the screen-off pattern to complete the screen-off display process.
[0148] pass Figure 7 It can be seen that during the screen-off display process in the screen-off state, according to relevant technologies, the touch screen event in the screen-off state needs to be passed to the AOD application first, and then the AOD application starts the screen-off display process, and then the display screen is powered on. After the display screen is powered on, the display screen displays the screen-off pattern, thereby completing the screen-off display.
[0149] Above through Figure 6 and Figure 7 The screen-off display process and timing diagram in the screen-off state in the related art are respectively described. Figure 8 Analyze the AOD time consumption in the screen-off state in related technologies.
[0150] like Figure 8 As shown, in the related art, when the display screen is in the off-screen state, if the user clicks or touches the display screen of the electronic device, the TP driver of the electronic device receives the touch screen event in the off-screen state, and the TP driver notifies the AOD application to start the off-screen display process, and then the AOD application starts the off-screen display process: the display screen is powered on first, and then the display screen displays the off-screen pattern to complete the off-screen display process. Through analysis, it can be seen that in the off-screen display process, the upper-level software module first processes the business of the off-screen display process, and then the upper-level software module sends instructions to the display screen hardware, and the display screen hardware implements the power-on and off-screen display of the display screen based on the instructions sent by the upper-level software module.
[0151] That is to say, the off-screen display process includes the off-screen display startup process time and the display screen power-on process time. For example, the off-screen display startup process time is recorded as t1, the display screen power-on process time is t2, and the overall time is t1+t2.
[0152] In actual implementation, the process of triggering the screen off display through the touch mode usually takes more than 270ms. Among them, the software module takes about 150ms to process the AOD service, and the display IC hardware takes about 120ms to power on.
[0153] Regarding the off-screen display process in the related art, there is a problem that the off-screen display is slow to implement.
[0154] This application - screen off display process
[0155] In view of the problem that the off-screen display process in the off-screen state in the above-mentioned related technologies is time-consuming, the embodiment of the present application has made improvements in the process. Once the TP driver receives a touch screen event in the off-screen state, the TP driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related technology, the TP driver passes the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display screen power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the off-screen display process. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.
[0156] In the embodiment of the present application, the screen-off display process includes the screen-off display startup process and the display screen power-on process. Among them, the screen-off display startup process includes the process of the AOD application sending the power-on instruction and the AOD display instruction, and the process of executing based on the power-on instruction and the AOD display instruction. The display screen power-on process includes the process of the upper layer notifying the display screen to power on, and the process of powering on and initializing the display screen.
[0157] For the convenience of explanation, the power-on instruction and the AOD display instruction may be collectively referred to as an AOD startup instruction. The AOD display instruction may include a screen-off pattern and an AOD backlight parameter.
[0158] Fig. 9 The software architecture diagram of the off-screen display process in the off-screen state provided by an embodiment of the present application is shown. Among them, the off-screen display process in the off-screen state can be divided into two stages: the first stage: the TP driver notifies the display driver to execute the power-on process and notifies the AOD application to start the off-screen display process, and the second stage: the display driver executes the power-on process and the AOD application starts the off-screen display process.
[0159] Phase 1: The TP driver notifies the display driver to execute the power-on process and notifies the AOD application to start the screen-off display process
[0160] refer to Fig. 9 In the direction indicated by the thin solid arrow ① in the figure, when the electronic device is in the screen-off state, if the user clicks or touches the display screen, the TP driver of the electronic device will receive the operation of the user clicking or touching the display screen, that is, the TP driver will sense the touch screen event in the screen-off state.
[0161] Different from Figure 6 In the related technical process shown in the embodiment of the present application, after the TP driver senses a touch screen event in the screen-off state, the TP driver performs the following actions:
[0162] On the one hand, referring to Fig. 9In the direction indicated by the thick solid arrow in ①, the TP driver notifies the display driver to execute the power-on process. Accordingly, the display driver triggers the display screen to power on and initialize. Compared with the related art, the display driver will execute the power-on process in advance.
[0163] On the other hand, refer to Fig. 9 In the direction shown by the dotted arrow in ②, the TP driver transmits the touch screen event in the off-screen state to the input subsystem, and then the input subsystem transmits the touch screen event in the off-screen state to the AOD application.
[0164] That is to say, after the TP driver senses a touch screen event in the screen-off state, the TP driver not only notifies the AOD application to start the screen-off display process, but also notifies the display driver to execute the power-on process, so that the display driver executes the power-on process before receiving the power-on instruction issued by the AOD application.
[0165] Compared with the related art in which the TP driver transmits the touch screen event in the screen-off state to the AOD application, the AOD application starts the off-screen display process, and then the display driver executes the power-on process, the present application scheme can allow the TP driver to immediately notify the display driver to execute the power-on process when the TP driver senses the touch screen event in the screen-off state. In this way, the display screen power-on process and the off-screen display startup process are implemented in parallel, which can shorten the off-screen display time.
[0166] Phase 2: The display driver executes the power-on process and the AOD application starts the screen-off display process
[0167] In an embodiment of the present application, while the display driver executes the power-on process, the TP driver passes the touch screen event in the screen-off state to the AOD application, and then the AOD application starts the screen-off display process. In this way, the time consumption is shortened by executing the screen-off display startup process and the display screen power-on process in parallel.
[0168] refer to Fig. 9 In the direction shown by the thin solid arrow in ③, in response to the touch screen event in the off state, the AOD application sends an AOD startup instruction to the lower layer. The AOD startup instruction includes a power-on instruction and an AOD display instruction. The AOD startup instruction passes through the power management service module and the SurfaceFlinger service module in the software architecture in turn, and then reaches the HWC. The HWC first sends a power-on instruction to the display driver. Since the display has been powered on or is about to be powered on at this time, the display driver does not need to trigger the display to power on.
[0169] When the display screen has been powered on, the display driver directly returns an OK message to the HWC. Alternatively, when the display screen is about to be powered on, the display driver waits for the display screen to be powered on before returning an OK message to the HWC.
[0170] After the HWC receives the OK message returned by the display driver, the HWC sends an AOD display instruction to the display driver, and then the display driver sends the AOD display instruction to the display screen. In response to the AOD display instruction, the display screen displays the screen-off pattern.
[0171] Different from Figure 6 In the related technical process shown, before starting the off-screen display process, the display driver has already started the power-on process, and after starting the off-screen display process, the display driver has completed the power-on process or is about to complete the power-on process. In this way, by executing the display screen power-on process and the off-screen display startup process in parallel, the time consumed for the off-screen display is significantly shortened.
[0172] For example, in the related art, the software module takes about 150ms to process the AOD service, and based on the hardware requirements of the screen chip specifications, the display screen takes about 120ms to power on. Since the display screen power-on process and the screen-off display startup process of this application can be executed in parallel, the total AOD time is less than 270ms. Therefore, this application reduces the time required to complete the screen-off display in the screen-off state.
[0173] exist Fig. 9 On the basis of Fig.10 The timing diagram of the screen-off display process in the screen-off state in the embodiment of the present application is shown. Fig.10 As shown, the method includes the following steps S201-S217.
[0174] S201, when the display screen is in the off state, the display screen receives a touch screen operation.
[0175] It should be noted that a touch screen sensor is provided on the display screen. The touch screen is composed of the touch screen sensor and the display screen. The touch screen sensor is used to detect a touch operation acting on or near it. The touch screen sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Accordingly, a visual output related to the touch operation can be provided through the display screen.
[0176] The touch screen operation may be referred to as a touch screen operation in the screen-off state, and the event corresponding to the touch screen operation may be referred to as a touch screen event in the screen-off state.
[0177] S202, the display screen reports a touch screen event in the screen-off state to the TP driver.
[0178] It should be noted that Fig.10 The timing diagram of the embodiment of the present application shown in FIG. Figure 7 Compared with the related technology timing diagram shown in the figure, the main difference is Fig.10The dashed box in the middle shows S203 - S207 (power-on in advance), and S212 - S214 (power-on has been completed or is about to be completed).
[0179] The following first describes the process of early power-on in this application in conjunction with S203-S207.
[0180] S203, the TP driver transmits the touch screen event in the screen-off state to the display driver.
[0181] S204: The display driver determines whether a screen-off display triggering condition is met based on a touch screen event in the screen-off state.
[0182] Among them, the above-mentioned screen-off display triggering conditions may include: the electronic device has turned on the screen-off display function, and the display screen is in the screen-off state, and the user input operation is a preset touch screen operation.
[0183] It should be noted that the TP driver can notify the display driver to execute the power-on process in any of the following ways:
[0184] Method 1: The TP driver passes the touch screen event in the off-screen state to the display driver, which determines whether the touch screen event meets the off-screen display trigger condition. If the touch screen event in the off-screen state meets the off-screen display trigger condition, the display driver executes the power-on process. If the touch screen event in the off-screen state does not meet the off-screen display trigger condition, the display driver does not execute the power-on process.
[0185] Method 2: The TP driver determines whether the off-screen display trigger condition is met based on the touch screen event in the off-screen state. If the touch screen event in the off-screen state meets the off-screen display trigger condition, the TP driver passes the touch screen event to the display driver to trigger the display driver to execute the power-on process. If the touch screen event in the off-screen state does not meet the off-screen display trigger condition, the TP driver will not pass the touch screen event to the display driver.
[0186] Method 3: The TP driver determines whether the screen-off display trigger condition is met based on the touch screen event in the screen-off state. If the touch screen event in the screen-off state meets the screen-off display trigger condition, the TP driver notifies the display driver to execute the power-on process to trigger the display driver to execute the power-on process. If the touch screen event in the screen-off state does not meet the screen-off display trigger condition, the TP driver does not notify the display driver to execute the power-on process.
[0187] For ease of explanation, Fig.10 The above method 1 is taken as an example for description. In actual implementation, any of the above methods can be used to implement the TP driver notifying the display driver to execute the power-on process.
[0188] S205, the display driver executes a power-on process, that is, the display driver triggers the display screen to power on.
[0189] S206, the display screen is powered on and initialized.
[0190] In actual implementation, the display driver triggers the display IC to power on and initialize.
[0191] S207, the display driver starts timing from the moment the display screen is triggered to power on.
[0192] S208, the TP driver transmits the touch screen event in the screen-off state to the input subsystem.
[0193] In some embodiments, the touch screen driver transmits the touch screen event to the display driver earlier than the touch screen driver transmits the touch screen event to the input subsystem.
[0194] In other embodiments, the time when the touch screen driver transmits the touch screen event to the display driver is equal to the time when the touch screen driver transmits the touch screen event to the input subsystem.
[0195] S209: The input subsystem transmits the touch screen event in the screen-off state to the AOD application.
[0196] In actual implementation, when the display screen is touched, the corresponding kernel layer TP driver will be triggered. After the TP driver receives the touch screen event, it will write the touch screen event to the corresponding input device node. Then the input system will read the touch screen event from the device node and pass the touch screen event up layer by layer.
[0197] S210, in response to a touch screen event in the screen-off state, the AOD application is started, and triggers the start of the AOD service.
[0198] After the AOD application and AOD service are started, the screen-off display process can be started.
[0199] S211, the AOD application sends an AOD startup instruction to the power management service module. The AOD startup instruction is transmitted through the power management service module and the SurfaceFlinger service module in sequence and reaches the HWC.
[0200] The AOD startup instruction includes a power-on instruction and an AOD display instruction.
[0201] The following S212 - S214 illustrate the AOD processing strategy of the present application in the case of early power-on.
[0202] S212, the HWC sends a power-on instruction to the display driver in response to the AOD startup instruction, where the power-on instruction is used to control the display screen IC to power on.
[0203] S213, in response to the power-on instruction, the display driver determines whether the timing duration is greater than or equal to a preset duration.
[0204] Compared with the related art, the present application has executed the power-on process in advance. After the display driver receives the power-on command, the display driver will not send the power-on command to the display screen (such as Fig.10 In the actual implementation, the display screen power-on and initialization usually takes a preset time, for example, the preset time may be 120ms.
[0205] If the timing duration is greater than or equal to the preset duration, it means that the display screen has completed power-on and initialization, and then the following S214 is executed, that is, the TP driver returns an OK message to the HWC.
[0206] If the timing duration is less than the preset duration, it means that the display screen has not completed power-on and initialization, and the display driver waits until the timing duration reaches the preset duration, and then executes the following S214.
[0207] S214, the display driver returns an OK message to the HWC.
[0208] The following S215-S217 illustrate the process of implementing the screen-off display.
[0209] S215, after receiving the OK message, the HWC sends an AOD display instruction to the display driver.
[0210] S216, the display driver sends the AOD display instruction to the display screen to drive the display screen to display the screen-off pattern.
[0211] Among them, the AOD display instruction may include a screen-off pattern.
[0212] S217, in response to the AOD display instruction, the display screen displays a screen-off pattern.
[0213] In actual implementation, in response to the AOD display instruction, the display IC controls the display to display the screen-off pattern, completing the screen-off display process.
[0214] In some embodiments, the AOD display instruction also includes an AOD backlight parameter. It should be noted that in actual implementation, the upper layer will first send a screen-off pattern to the display screen, and then send the AOD backlight parameter to the display screen. In actual implementation, in response to the AOD display instruction, the display IC controls the display screen to turn on the backlight and display the screen-off pattern according to the AOD backlight parameter, completing the screen-off display process.
[0215] The solution of the related technology is that in the screen-off display process, the touch screen event in the screen-off state is first passed to the AOD application, and then the AOD application starts the screen-off display process, and the upper-level software module handles the screen-off display service. Then the upper-level software module sends instructions to the display hardware, and the display hardware completes the power-on of the display based on the instructions sent by the upper-level software module, and then realizes the screen-off display.
[0216] Compared with the related art, in the embodiment of the present application, when the TP driver receives a touch screen event in the off-screen state, the TP driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance. At the same time, the TP driver transmits the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display screen power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the time to complete the off-screen display in the off-screen state.
[0217] Above through Fig. 9 and Fig.10 The screen-off display process and timing diagram in the screen-off state in the embodiment of the present application are respectively described. Fig.11 Analyze the AOD time consumption in the screen-off state provided in the embodiment of the present application.
[0218] like Fig.11 As shown in (a), in the related art, when the display screen is in the off-screen state, if the user clicks or touches the display screen of the electronic device, the TP driver receives the touch screen event in the off-screen state, and the TP driver first notifies the AOD application to start the off-screen display process, and then the AOD application starts the off-screen display process: the display screen is powered on first, and then the display screen displays the off-screen pattern to complete the off-screen display process. The off-screen display process includes the off-screen display startup process consuming time t1 and the display screen power-on process consuming time t2, and the overall time consumption is t1+t2.
[0219] like Fig.11 As shown in (b), when the display screen is in the off state, if the user clicks or touches the display screen of the electronic device, the TP driver receives the touch screen event in the off state. Compared with the related art, the improvement of this application is that the display screen power-on process and the off-screen display startup process are executed in parallel:
[0220] The TP driver immediately notifies the display driver to execute the power-on process, so that the display starts powering on and initializing in advance. At the same time, the TP driver transmits the touch screen event in the off-screen state to the AOD application, notifying the AOD application to start the off-screen display process.
[0221] Therefore, when the display screen is powered on and initialized, the AOD application starts the screen-off display process. After the display screen is powered on and initialized, the display screen displays the screen-off pattern to complete the screen-off display process.
[0222] In this application, the off-screen display process includes the off-screen display startup process time t1 and the display screen power-on process time t2. Since the display screen power-on process and the off-screen display startup process can be executed in parallel, the overall time consumption is less than t1+t2. Therefore, the solution of this application reduces the time to complete the off-screen display in the off-screen state.
[0223] In actual implementation, based on the hardware requirements of the screen IC chip specifications, it takes about 120ms (ie t2) to power on and initialize the display screen, and the software takes about 150ms (ie t1) to process the off-screen display process, so the AOD overall process takes a minimum of about 270ms. Through the present application scheme, since the display screen power-on process and the off-screen display startup process can be executed in parallel, for example, when the off-screen display process is implemented in the off-screen state, 120ms can be saved, so the overall time consumption is 150ms, which shows that the overall time consumption is significantly shortened. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.
[0224] Through the solution of this application, once the touch screen driver receives a touch screen event in the off-screen state, the touch screen driver immediately notifies the display driver to execute the power-on process, so that the display screen starts to power on and initialize in advance; on the other hand, as in the related art, the touch screen driver passes the touch screen event in the off-screen state to the AOD application, and the AOD application starts the off-screen display process. In this way, the display screen power-on process and the off-screen display startup process can be implemented in parallel, thereby greatly reducing the overall time consumption of the off-screen display process. Therefore, when the user touches the display screen in the off-screen state, the off-screen display becomes faster, which improves the user experience.
[0225] In another possible implementation, when the touch screen driver receives a touch screen event in the screen-off state, the touch screen driver immediately notifies the display driver to execute the display screen power-on process, so that the display screen starts to power on in advance, and the power-on time is approximately in the range of [20ms, 50ms]. At the same time, the touch screen driver passes the touch screen event in the screen-off state to the AOD application, and the AOD application starts the screen-off display process: the AOD application sends an AOD startup instruction to the display screen, and the AOD startup instruction can carry the display screen initialization parameters. When the display screen receives the display screen initialization parameters, since the display screen has completed power-on in advance, the display screen can quickly enter initialization, which can also save a certain amount of time and make the screen-off display faster.
[0226] The present application scheme shortens the time taken to realize the off-screen display in the off-screen state by improving the mobile phone software system. When the user clicks or touches the display screen of the electronic device in the off-screen state, the electronic device uses the method for controlling the off-screen display provided by the present application to quickly display the off-screen pattern, thereby improving the user experience. The optimization scheme for the off-screen display performance described in the embodiment of the present application can support all current products and adapt to all domestic and overseas versions, and has universality and versatility.
[0227] It should be noted that, in the embodiments of the present application, "greater than" can be replaced by "greater than or equal to", "less than or equal to" can be replaced by "less than", or "greater than or equal to" can be replaced by "greater than", and "less than" can be replaced by "less than or equal to".
[0228] The various embodiments described herein may be independent solutions or may be combined according to internal logic, and all of these solutions fall within the protection scope of this application.
[0229] The present application also provides a chip, which is coupled to a memory and is used to read and execute computer programs or instructions stored in the memory to execute the methods in the above embodiments.
[0230] The present application also provides an electronic device, which includes a chip, and the chip is used to read and execute a computer program or instruction stored in a memory, so that the method in each embodiment is executed.
[0231] This embodiment also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method for controlling the screen off display in the above-mentioned embodiment.
[0232] This embodiment also provides a computer program product, in which a computer-readable storage medium stores program code. When the computer program product runs on a computer, the computer executes the above-mentioned related steps to implement the method for controlling the screen off display in the above-mentioned embodiment.
[0233] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer execution instructions, and when the device is running, the processor may execute the computer execution instructions stored in the memory so that the chip executes the method of controlling the screen off display in the above-mentioned method embodiments.
[0234] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.
[0235] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0236] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for controlling screen-off display, characterized in that: The method is applied to an electronic device, the electronic device includes a processor and a display screen, the processor includes an off-screen display AOD application, a display driver, and a touch screen driver, and the method includes: When the display screen is in an off-screen state, the display driver receives a touch screen event transmitted by the touch screen driver, where the touch screen event is a preset touch screen operation on the display screen by the user; In response to the touch screen event, the display driver triggers the display screen to power on and initialize; The display driver starts timing from the moment when the display screen is triggered to be powered on; The display driver receives a power-on instruction from the AOD application; In response to the power-on instruction, the display driver determines whether the timing duration is greater than or equal to a preset duration; When the timing duration is greater than or equal to the preset duration, the display driver returns a completion message; or, when the timing duration is less than the preset duration, the display driver waits until the timing duration is greater than or equal to the preset duration and then returns the completion message; The display driver receives an AOD display instruction from the AOD application; In response to the AOD display instruction, the display driver triggers the display screen to display a screen-off pattern.
2. The method according to claim 1, characterized in that In response to the touch screen event, the display driver triggers the display screen to power on and initialize, including: The display driver determines that the touch screen event satisfies a screen-off display triggering condition; In response to the touch screen event, the display driver triggers the display screen to power on and initialize.
3. The method according to claim 2, characterized in that The screen-off display triggering condition includes: the electronic device has turned on the screen-off display function, the display screen is in the screen-off state, and the user input operation is the preset touch screen operation.
4. The method according to any one of claims 1 to 3, characterized in that The preset touch screen operation is an operation of lightly touching or clicking the display screen.
5. The method according to any one of claims 1 to 4, characterized in that The display driver triggers the display screen to power on and initialize, including: The display driver triggers the integrated chip IC of the display screen to start powering on and initializing.
6. The method according to any one of claims 1 to 5, characterized in that In response to the AOD display instruction, the display driver triggers the display screen to display a screen-off pattern, including: The display driver sends an AOD display instruction to the IC of the display screen, so that the IC of the display screen controls the display screen to display the screen-off pattern based on the AOD display instruction.
7. The method according to any one of claims 1 to 6, characterized in that The processor also includes an input subsystem; The touch screen event is also transmitted by the touch screen driver to the input subsystem, and the input subsystem transmits the touch screen event to the AOD application; The power-on instruction and the AOD display instruction are instructions issued by the AOD application in response to the touch screen event.
8. The method according to claim 7, characterized in that The time when the touch screen event is delivered to the display driver is earlier than or equal to the time when the touch screen event is delivered to the AOD application.
9. The method according to any one of claims 1 to 8, characterized in that The processor also includes a power management service module, a surface drawing SurfaceFlinger service module and a hardware synthesis module HWC; The power-on instruction is issued by the AOD application, transmitted through the power management service module, the SurfaceFlinger service module and the HWC, and reaches the display driver.
10. The method according to claim 9, characterized in that After the power-on instruction is transmitted to the HWC module, the HWC module sends the power-on instruction to the display driver; when the HWC module receives the completion message returned by the display driver, the HWC module sends the AOD display instruction to the display driver.
11. An electronic device, characterized in that: The electronic device comprises a display screen, a processor, a memory and a computer program stored in the memory, wherein the processor is used to execute the computer program so that the electronic device implements the method as claimed in any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 10.
Citation Information
Cited By
Method for controlling always on display, and electronic device and storage medium
EP4653984A1
