Screen-off display method and device, electronic equipment and readable storage medium
By generating marking information when the electronic device wakes up, indicating that the screen-off image is not updated, the problem of old images returning in the screen-off display is solved, and the continuity and accuracy of the screen-off display is achieved.
Patent Information
- Application Number
- CN202510328440.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-19
- Publication Date
- 2025-07-04
AI Technical Summary
When the electronic device wakes up from the sleep state, the old screen-out image may be returned, affecting the screen-out display effect.
When the application processor wakes up and displays the screen-off image, mark information is generated through the layer processing process, indicating that the current screen-off image is not updated, and the display of the screen-off image is maintained through the display driver until the next frame of the image is ready.
This avoids the time fallback of the screen-out image, improves the effect of the screen-out display, and ensures the continuity and accuracy of the screen-out display.
Smart Images

Figure CN120255834A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of electronic devices, and particularly relates to an off-screen display method, device, electronic device, and readable storage medium. Background Art
[0002] With the development of the image display technology of electronic devices, when the electronic device is in the off-screen state, the display screen of the electronic device can activate only some pixels to display some display content, so that the user can see information such as time, power, and network status without touching the electronic device when the electronic device is in the off-screen state. This display technology is called the Always On Display (AOD) technology.
[0003] In the related art, before the electronic device enters the off-screen state, first, N off-screen images are generated in the Application Processor (AP), and these N frames are stored in the shared storage space shared by the low-power processor and the application processor. When the electronic device is in the sleep state, the low-power processor drives the display hardware to read and display the N off-screen images from the shared content in the display order through the display driver.
[0004] However, when the electronic device receives a wake-up operation and some applications other than the off-screen application in the electronic device initiate a frame refresh request, the AP is awakened. At this time, the off-screen image is generated and sent for display by the AP. However, since at the moment when the application initiates a frame refresh request, the AP may send the last off-screen image generated before entering the sleep state for display, which may cause the electronic device to display the old off-screen image again, affecting the off-screen display effect of the electronic device. Summary of the Invention
[0005] The purpose of the embodiments of this application is to provide an off-screen display method, device, electronic device, and readable storage medium, which can avoid reverting to display the old off-screen image and improve the off-screen display effect of the electronic device.
[0006] In a first aspect, the embodiments of this application provide an off-screen display method. The off-screen display method includes: when the application processor of the electronic device is awakened and the screen of the electronic device displays a first off-screen image in the off-screen state, if a first frame refresh request initiated by a first application is received through the layer processing process, generate first marking information, where the first marking information is used to indicate not to update the first off-screen image; through the layer processing process, transmit the first marking information to the display driver of the electronic device; through the display driver, maintain the display of the first off-screen image according to the first marking information; where the first application is an application program other than the off-screen application in the electronic device.
[0007] In a second aspect, an embodiment of the present application provides a standby display device, which includes a processing module, a transmission module, and a display module. The processing module is configured to generate first marking information if a first frame refresh request initiated by a first application is received through a layer processing process when the application processor of the electronic device is awakened and the electronic device displays a first standby image. The first marking information is used to indicate not to update the first standby image. The transmission module is configured to transmit the first marking information to the display driver of the electronic device through the layer processing process. The display module is configured to maintain the display of the first standby image according to the first marking information through the display driver. Wherein, the first application is an application program in the electronic device other than the standby application.
[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores a program or instruction that can run on the processor. When the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.
[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0010] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the method described in the first aspect.
[0011] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0012] In an embodiment of the present application, when the application processor of the electronic device is awakened and the electronic device displays a first standby image, if a first frame refresh request initiated by a first application is received through a layer processing process, first marking information is generated. The first marking information is used to indicate not to update the first standby image. Through the layer processing process, the first marking information is transmitted to the display driver of the electronic device. Through the display driver, the display of the first standby image is maintained according to the above first marking information. Wherein, the first application is an application program in the electronic device other than the standby application. In this solution, when the electronic device is awakened and does not need to update the current standby image, the electronic device can set marking information, so that through the layer processing process, according to the marking information, it is indicated that the display driver does not update the first standby image when receiving a frame refresh request initiated by an application other than the standby application, thereby avoiding reverting to display an old standby image and improving the standby display effect of the electronic device. Description of the Drawings
[0013] Figure 1 is the display workflow of a screen-off image provided by an embodiment of the present application;
[0014] Figure 2 is a schematic flowchart of a screen-off display method provided by an embodiment of the present application;
[0015] Figure 3 is a schematic diagram of a mobile phone screen-off image display provided by an embodiment of the present application;
[0016] Figure 4 is a schematic flowchart of maintaining the screen-off image display provided by an embodiment of the present application;
[0017] Figure 5 is a schematic flowchart of maintaining the fingerprint image display in the screen-off image provided by an embodiment of the present application;
[0018] Figure 6 is one of the schematic structural diagrams of a screen-off display device provided by an embodiment of the present application;
[0019] Figure 7 is another schematic structural diagram of a screen-off display device provided by an embodiment of the present application;
[0020] Figure 8 is one of the schematic hardware structures of an electronic device provided by an embodiment of the present application;
[0021] Figure 9 is another schematic hardware structure of an electronic device provided by an embodiment of the present application. Detailed Description of the Embodiments
[0022] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.
[0023] The terms "first", "second", etc. in the description and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of the same type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the description means at least one of the connected objects, and the character " / ", generally represents an "or" relationship between the associated objects before and after.
[0024] Some terms and nouns involved in the embodiments of the present application are explained below.
[0025] The terms "at least one (item)", "at least one of" and the like in the description and claims of the present application refer to any one, any two or more combinations of the objects they contain. For example, at least one (item) of a, b, and c can represent: "a", "b", "c", "a and b", "a and c", "b and c", and "a, b, and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" means two or more, and its meaning is similar to that of "at least one (item)".
[0026] 1) AOD: It is a mobile phone display technology. When the mobile phone is in the sleep state, the user can also see information such as time and battery power without unlocking the mobile phone. Since only some pixels are activated to display this information instead of the entire screen, it helps to reduce the power consumption caused by screen usage. This technology has been widely applied in both Android and IOS. To achieve better power consumption effects and reduce the number of wake-ups of the AP, heterogeneous AOD is a new technical solution, which is achieved by transferring the AOD function to an auxiliary core with lower power consumption.
[0027] 2) Heterogeneous system: A system composed of computing units with different types of instruction sets and architectures.
[0028] In the related art, in order to reduce the power consumption of an electronic device with AOD technology, usually two processors are set in the electronic device, namely an application processor (AP) used when the electronic device is in the working state, and a low-power processor used when the electronic device is in the sleep state, such as a sensor control processor (SCP).
[0029] 3) Dynamic Random Access Memory (DRAM): It is a semiconductor memory. The main principle is to use the amount of charge stored in a capacitor to represent whether a binary bit (bit) is 1 or 0. In reality, since there is a leakage current phenomenon in transistors, the amount of charge stored in the capacitor is not sufficient to correctly distinguish the data, resulting in data damage. Therefore, for DRAM, periodic charging is an inevitable requirement. Due to this characteristic of needing to be refreshed regularly, it is called a "dynamic" memory.
[0030] 4) Inter-Processor Interrupt (IPI): is a special type of interrupt, that is, in a multi-processor system, if the interrupt handler requires action from other processors, an interrupt behavior issued by one processor to another processor. The actions that may be required include: flushing the memory management unit cache of other processors, such as the translation lookaside buffer, when a processor changes the memory mapping; shutdown, when the system is shut down by a processor.
[0031] 5) The layer processing process can be the system layer synthesis management service process (Surfaceflinger, SF), which is a process in the Android display framework. SurfaceFlinger is a key component in the Android system, mainly responsible for the synthesis and rendering of the screen display. It is a special process whose main function is to synthesize all Surfaces into the Framebuffer, and then display it to the user on the screen.
[0032] 6) Sleep (DOZE) mode: In DOZE mode, the screen of the electronic device has a certain backlight, and the system can refresh the picture at this time. The system will wake up the device at regular intervals and open a short "maintenance window" so that the application can perform key operations. The frequency of these maintenance windows will decrease as the device is stationary for a longer time, thereby further saving power. Once the device is awakened or connected to a charger, it will immediately exit DOZE mode and all applications will resume normal activities.
[0033] 7) Hardware Composer (HWC): It is the hardware abstraction layer (HAL) module for window (Layer) synthesis and display in the system, providing hardware support for SF.
[0034] 8) Display driver: used to drive the display hardware to perform image display operations.
[0035] 9) Heterogeneous AOD system: An electronic device with AOD function has two processors, one processor is used when the electronic device is in working state, such as AP, and the other processor is used when the electronic device is in sleep state, such as SCP.
[0036] For example, Figure 1 2 shows a flowchart of off-screen image display. Figure 1 As shown, the off-screen image display process includes the following processes 1 to 3:
[0037] Process 1: In the application-side process of the operating system, first modify the native AOD alarm mode to a non-wake-up mode, and obtain the address of the destination register (PIC_M). This block address is exposed to the application side through the cache area sharing and synchronization (Direct Memory Access Buffer, DMA_BUF) mechanism. The application side stores N off-screen images into the memory area through mmap.
[0038] It can be understood that the above N off-screen images are generated in advance by the AOD application in the application processor at each predetermined time point.
[0039] Process 2: When the electronic device is in the sleep state, in the suspend process of the aod bottom-layer driver, the AP sends an IPI message to the SCP, notifying the AOD task therein to start working, and handing over the display control right to the SCP. At this time, the AOD task in the SCP will take out the corresponding picture from PIC_M according to the current time point and send it for display.
[0040] Process 3: When the electronic device is awakened and the system operation resumes, in the resume process of the aod bottom-layer driver, the AP will send an IPI message to the SCP, causing the SCP to stop the AOD task and enter the sleep state, and hand over the display control right back to the AP.
[0041] According to the above introduction of the off-screen image display process, when the electronic device is awakened, the AP will also be awakened, that is, the SCP hands over the display control right to the AP. However, at this time, it may not have reached the frame refresh time of the next off-screen image, so there is no next off-screen image yet. But since the AP has been awakened, when receiving a frame refresh request from any application, the display driver will drive the display hardware to perform frame refresh. Therefore, the display hardware will display the last off-screen image cached in the AP display link, which will cause the problem of time regression and displaying old frames.
[0042] The identifier in this application is used to indicate information such as text, symbols, images, etc., and can use the identifier or other containers as the carrier of the display information, including but not limited to text identifiers, image identifiers, symbol identifiers, etc.
[0043] It should be noted that for the off-screen display method provided in the embodiments of this application, the execution subject can be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a handheld computer, an in-vehicle electronic device, etc. In some embodiments of this application, taking the electronic device as the execution subject to execute the off-screen display method as an example, the off-screen display method provided in the embodiments of this application is described.
[0044] The following will, with reference to the accompanying drawings, explain in detail the screen-off display method, device, electronic device, and readable storage medium provided by the embodiments of the present application through specific embodiments and their application scenarios.
[0045] In the related art, before the electronic device enters the screen-off state, first, N screen-off images are generated in the application processor and stored in the shared storage space shared by the low-power processor and the application processor. When the electronic device is in the sleep state, the low-power processor drives the display hardware to read and display the N screen-off images from the shared content in the display order through the display driver.
[0046] However, when the electronic device receives a wake-up operation and some applications other than the AOD application in the electronic device initiate a frame refresh request, the AP is awakened. At this time, the screen-off image is generated and sent for display by the AP. However, since at the moment when the application initiates a frame refresh request, the AP has not yet generated and sent a new screen-off image.
[0047] For example, before the electronic device enters the sleep state, the AOD application generates a screen-off image of 11:09 in the AP and refreshes and displays it on the display screen of the electronic device, that is, the screen-off image of 11:09 is currently displayed on the display screen. When the electronic device enters the sleep state, the AP hands over the display control to the SCP. At this time, the SCP obtains the current local actual (Real-Time Clock, RTC) time and retrieves the previously stored screen-off images. For example, at the actual time of 11:10, the screen-off image of 11:10 is displayed, and at the actual time of 11:11, the screen-off image of 11:11 is displayed.
[0048] Then, when the electronic device is awakened, the AP is also awakened at the same time, and at this time, other applications other than the AOD application initiate a frame refresh request, such as submitting a commit command. However, the AOD application has not yet sent the AOD layer of 11:12 to the surfaceflinger. The surfaceflinger can only send the screen-off image generated recently according to the received AOD layer for display, that is, the above-mentioned screen-off image of 11:09. Therefore, the screen-off image displayed on the display screen at this time is the screen-off image of 11:09, that is, time regression occurs. Subsequently, when the predetermined time point is reached, the AOD layer of 11:12 that needs to be refreshed and displayed is sent to the surfaceflinger. The surfaceflinger generates and displays the screen-off image of 11:12 according to the AOD layer of 11:12. At this time, the screen-off image displayed on the display screen is the screen-off image of 11:12. In this way, the phenomenon that the electronic device displays an old frame will occur, that is, the electronic device will revert to displaying an old screen-off image, affecting the screen-off display effect of the electronic device.
[0049] To solve this problem, an embodiment of the present application provides a method, apparatus, electronic device, and readable storage medium for screen-off display. When the application processor of the electronic device is awakened and the screen of the electronic device displays a first screen-off image in the screen-off state, if a first frame refreshing request initiated by a first application is received through a layer processing process, first marking information is generated, and the first marking information is used to indicate not to update the first screen-off image; through the layer processing process, the first marking information is transmitted to the display driver of the electronic device; through the display driver, the display of the first screen-off image is maintained according to the first marking information; wherein, the first application is an application program in the electronic device other than the screen-off application. In this solution, when the electronic device is awakened and there is no need to update the current screen-off image, the electronic device can set marking information, so that through the layer processing process, according to the marking information, it is indicated to the display driver that when a frame refreshing request initiated by an application other than the screen-off application is received, the first screen-off image is not updated, thereby avoiding reverting to display an old screen-off image and improving the screen-off display effect of the electronic device.
[0050] The execution subject of the screen-off display method provided by the embodiment of the present application may be a screen-off display device. Exemplarily, the screen-off display device may be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. Hereinafter, the screen-off display method provided by the embodiment of the present application will be exemplarily described by taking an electronic device as an example.
[0051] An embodiment of the present application provides a screen-off display method, Figure 2 which shows a flowchart of a screen-off display method provided by an embodiment of the present application. This method can be applied to an electronic device. As Figure 2 shown, the screen-off display method provided by the embodiment of the present application may include the following steps 201 to 203.
[0052] Step 201: When the application processor of the electronic device is awakened and the screen of the electronic device displays a first screen-off image in the screen-off state, if a first frame refreshing request initiated by a first application is received through a layer processing process, first marking information is generated.
[0053] In some embodiments of the present application, the above application processor may be awakened by any of the following actions: a user touches the display screen of the electronic device, a user presses a key of the electronic device, a user moves the electronic device, or the electronic device receives a data packet.
[0054] Exemplarily, the above user touching the display screen of the electronic device may be that the electronic device receives an input from the user, for example, a click input or a swipe input.
[0055] Exemplarily, the user pressing the button of the electronic device can be pressing the power button, or pressing the volume button, or pressing the home button, etc.
[0056] Exemplarily, the user moving the electronic device can be the user gently moving the electronic device, or moving the electronic device from the current position to any other position.
[0057] Exemplarily, the electronic device receiving a data packet can be receiving push information pushed by an application in the electronic device, or receiving a message sent by another electronic device or the network, etc. For example, the information "The goods have arrived" pushed by a food delivery application, and a chat message sent by another user received by a communication application.
[0058] It can be understood that the above application processor being awakened means that the application processor changes from the sleep state to the working state, that is, the application processor starts to execute tasks after being awakened.
[0059] In some embodiments of the present application, the above screen-off state is the display state of the display screen of the electronic device when the electronic device is in the sleep state.
[0060] In some embodiments of the present application, the above first screen-off image is obtained from the screen-off application in the application processor.
[0061] Exemplarily, the above first screen-off image can display conventional information such as time, date, network status, and battery level, and can also display the background image in the lock screen interface.
[0062] Example 1, as Figure 3 shown, on the display screen 31 of the electronic device, a screen-off image 32 is displayed, and the time 11:11 and conventional marks 33 are displayed in the screen-off image 32, for example, a battery level mark, a network status mark, etc.
[0063] In some embodiments of the present application, the above first application is an application program in the electronic device other than the screen-off application.
[0064] Exemplarily, the above first application can be a fingerprint application, a screen password application, a face recognition application, etc.
[0065] In some embodiments of the present application, the above first frame brushing request is used to instruct the layer processing process to generate a corresponding display image and send it for display, that is, to update the current display image.
[0066] In some embodiments of the present application, the above first marking information is used to instruct not to update the first screen-off image.
[0067] In some embodiments of the present application, the above not updating the first screen-off image means maintaining the display of the first screen-off image.
[0068] Exemplarily, the above-mentioned generation of the first marking information may be directly generating the first mark, or setting the first mark to 1.
[0069] Exemplarily, since the first off-screen image is not updated, which is equivalent to retaining the old frame, the first mark may also be referred to as the old frame hint.
[0070] In some embodiments of the present application, the above-mentioned layer processing process is the system layer composition management service process, that is, the above-mentioned SF.
[0071] In some embodiments of the present application, the above-mentioned layer management process is used to manage different layers, such as superimposing layers, or deleting layers, etc., to generate the final display image.
[0072] Optionally, in some embodiments of the present application, the above-mentioned step 201 may be specifically implemented through the following step 201a.
[0073] Step 201a: If a first frame refreshing request is received through the layer processing process and the receiving moment of the first frame refreshing request has not reached the first time point, generate the first marking information.
[0074] In some embodiments of the present application, the above-mentioned first time point is the frame refreshing time point of the next off-screen image of the first off-screen image.
[0075] Exemplarily, one minute is a time point for the frame refreshing time.
[0076] Example 2, in combination with Example 1, the time when the layer processing process receives the first frame refreshing request is 11:11, and it has not reached the frame refreshing time 11:12 of the next off-screen image. Therefore, the first marking information is generated.
[0077] Step 202: The electronic device transmits the first marking information to the display driver of the electronic device through the layer processing process.
[0078] In some embodiments of the present application, the above-mentioned display driver is used to drive the display hardware to display an image.
[0079] In some embodiments of the present application, when transmitting the first mark to the display driver of the electronic device, the first mark is also stored in the DRAM to facilitate subsequent reading or modification of the first mark by the display driver.
[0080] Step 203: The electronic device maintains the display of the first off-screen image according to the first marking information through the display driver.
[0081] In some embodiments of the present application, the above-mentioned maintaining the first off-screen image can be understood as not updating the currently displayed first off-screen image.
[0082] In some embodiments of the present application, the electronic device reads the first marker information through the display driver. When the first marker information is used to indicate not to update the first off-screen image, the display driver is used to drive the display hardware to maintain the current display of the first off-screen image.
[0083] In the off-screen display method provided by the embodiments of the present application, when the application processor of the electronic device is awakened and the screen of the electronic device displays a first off-screen image in the off-screen state, if a first frame brushing request initiated by a first application is received through the layer processing process, first marker information is generated, and the first marker information is used to indicate not to update the first off-screen image; through the layer processing process, the first marker information is transmitted to the display driver of the electronic device; through the display driver, the display of the first off-screen image is maintained according to the first marker information; wherein, the first application is an application program other than the off-screen application in the electronic device. In this solution, when the electronic device is awakened and there is no need to update the current off-screen image, the electronic device can set marker information, so that the layer processing process can, according to the marker information, instruct the display driver not to update the first off-screen image when a frame brushing request initiated by an application other than the off-screen application is received, thereby avoiding reverting to display an old off-screen image and improving the off-screen display effect of the electronic device.
[0084] Optionally, in some embodiments of the present application, after the step 202 “through the display driver, maintain the display of the first off-screen image according to the first marker information”, the off-screen display method provided by the embodiments of the present application further includes the following steps 301 to 303.
[0085] Step 301: The electronic device initiates a second frame brushing request to the layer processing process through the off-screen application at a first time point.
[0086] In some embodiments of the present application, the first time point is the frame brushing time point of the next off-screen image of the first off-screen image.
[0087] Exemplarily, each minute is a time point of the frame brushing time.
[0088] In some embodiments of the present application, the second frame brushing request is used to instruct the layer processing process to generate an off-screen image corresponding to the first time point and send it to the display hardware for display on the display screen of the electronic device.
[0089] Step 302: The electronic device forwards the second frame brushing request to the display driver through the layer processing service.
[0090] Exemplarily, the electronic device forwards the second frame brushing request to the display driver through the system layer composition management service, so as to inform the display driver that the first time point has been reached and the off-screen image currently displayed on the display screen needs to be frame-brushed, that is, to update and display a new off-screen image.
[0091] Step 303: Through the display driver, clear the first marker information according to the second frame refresh request, and display the next frame of the screen-off image.
[0092] Exemplarily, clearing the first marker information in the display driver may be directly deleting the first marker or setting the first marker to 0.
[0093] Example 2: Combining with Example 1, the time when the layer processing process receives the second frame refresh request sent by the screen-off application is 11:12, which has reached the frame refresh time of the next frame of the screen-off image. Therefore, after the layer processing process forwards the second frame refresh request to the display driver, it clears the first marker information to drive the display hardware to display the next frame of the screen-off image of the first screen-off image.
[0094] In this way, by clearing the first marker, when the first time point is reached, the electronic device can normally display the next frame of the screen-off image, avoiding the problem that the time always remains at a certain point without update, and ensuring the screen-off display effect of the electronic device.
[0095] The following uses specific examples to exemplarily illustrate steps 201 to 203 and steps 301 to 303 in the screen-off display method provided by the embodiments of the present application.
[0096] Embodiment 1: As Figure 4 shown, it may specifically include the following steps A1 to A4.
[0097] Step A1: In the DOZE mode, the first application initiates a frame refresh request, that is, the above-mentioned first frame refresh request. At this time, there is an AOD layer, that is, the above-mentioned first screen-off image has no update.
[0098] Exemplarily, the lack of update of the above AOD layer means that the current time point has not reached the frame refresh time of the next screen-off image.
[0099] Example 3: When the time point reaches 11:09, the screen-off application sends a frame refresh request to the SF, sends the screen-off image layer to the SF, then generates a screen-off image of 11:09 through the SF, and transmits it to the display hardware for display on the display screen of the electronic device. Then, the electronic device enters the sleep state, and the AP hands over the display control right to the SCP. When the time reaches 11:10 and 11:11 respectively, the SCP reads the screen-off display images corresponding to 11:10 and 11:11 that have been stored in the SCP. Then, between 11:11 and 11:12, the electronic device is awakened, that is, the AP is awakened, and the first application sends a frame refresh request to the SF. Since the current time point is between 11:11 and 11:12, that is, it has not reached the frame refresh time of the next screen-off image, the current screen-off image has no update.
[0100] Step A2: In the DOZE mode, and when the AOD layer already exists in the SF, raise the hint, i.e., generate the first mark as described above.
[0101] Example 4: Combining with Example 3 above, between 11:11 and 11:12, the electronic device is woken up, i.e., the AP is woken up, and the first application sends a frame refresh request to the SF. Since the current time point is between 11:11 and 11:12, that is, it has not reached the frame refresh time of the next off-screen image yet, therefore, the current off-screen image has no update. At this time, the SF raises the hint.
[0102] Step A3: According to the frame refresh request sent by the first application to the SF above, pass the above hint to the display driver, and the display driver does not drive the display hardware to refresh the image, that is, maintains the current off-screen image.
[0103] It can be understood that combining with Example 4, the current off-screen image is the off-screen image corresponding to 11:11.
[0104] Step A4: When the off-screen application sends a frame refresh request, the display driver clears the hint. At this time, the display driver can drive the display hardware to refresh the image and update the display of the next frame of the off-screen image.
[0105] It can be understood that combining with Example 4, the next frame of the off-screen image is the off-screen display image of 11:12.
[0106] In summary, this embodiment introduces an old frame mark, raises the hint in the DOZE mode and when the AOD layer exists in the SF, and clears the hint when the AOD layer is updated. And this hint needs to be passed from the SF to the hwc, and the hwc brings the hint into the driver layer through atomiccommit. The display driver determines whether to discard a frame according to the hint mark, that is, when the hint flag is set, it does not drive the display hw to perform the actual image drawing action, that is, maintains the display of the current off-screen image. In this way, the electronic device can set the mark information to indicate that in the case of receiving the first frame refresh request sent by the first application, the first off-screen image is not updated, so that when the application processor of the electronic device is woken up to generate the image of the first frame refresh request, the display driver does not update the first off-screen image as indicated by the first mark, thereby avoiding reverting to display the old off-screen image and improving the off-screen display effect of the electronic device.
[0107] The above-mentioned first embodiment can well solve the problems of the old frames, but new problems will be introduced in actual tests. First, if the fingerprint application and the screen-off application initiate frame brushing requests simultaneously, then the screen-off image and the fingerprint animation will be displayed simultaneously. Next, the fingerprint application initiates a frame brushing request to request the display of the fingerprint disappearance animation. However, since the screen-off application does not initiate a frame brushing request at this time, that is, there is no need to update the screen-off image, a hint is generated. When the display driver detects the hint, it will not drive the display hardware to refresh the image, that is, the current screen-off image remains unchanged without being refreshed. As a result, the fingerprint disappearance animation will not be displayed by the display hardware, and then the fingerprint icon will not disappear within the specified time, but will be displayed continuously until the next screen-off image update, and the hint is cleared, and the display driver can drive the display hardware to perform the operation of refreshing the image. In this way, the continuous display of the fingerprint icon causes additional power consumption. For this, the screen-off display method provided by the embodiment of the present application further includes the following steps.
[0108] Optionally, in some embodiments of the present application, the screen-off display method provided by the embodiment of the present application further includes the following step 401.
[0109] Step 401: When the first screen-off image is transmitted from the sensing control processor of the electronic device to the display hardware of the electronic device, generate a second marking information and store the second marking information in the shared memory.
[0110] In some embodiments of the present application, the above-mentioned second marking information is used to represent that the application processor is awakened and the electronic device displays the first screen-off image.
[0111] In other words, the above-mentioned second marking information is used to represent that the application processor is awakened and the display screen of the electronic device displays the first screen-off image in the screen-off state.
[0112] It can be understood that the above-mentioned second marking information is used to indicate that the SCP has transmitted the screen-off image to the display hardware.
[0113] Exemplarily, when the application processor in the electronic device is awakened, if the currently displayed first screen-off image is transmitted by the SCP, generate the second marking information in the SCP and store the second marking in the shared memory, such as, DRAM.
[0114] Exemplarily, the above-mentioned second marking information can be denoted as scp_show_count.
[0115] Exemplarily, the generation of the above-mentioned second marking information can be directly generating the second marking, or setting the second marking to 1.
[0116] In this way, the display driver can clearly know the source of the current off-screen image to determine whether to maintain the display of the current off-screen image or obtain the previously cached off-screen image from the AP. If the off-screen image is transmitted by SCP, the display of the current off-screen image is maintained; if the off-screen image has not been transmitted, the last off-screen image cached in the AP is directly displayed.
[0117] Optionally, in some embodiments of the present application, after the above-mentioned step 401, the screen-off display method provided in the embodiments of the present application also includes steps 501 to 503.
[0118] Step 501: The electronic device initiates a second frame refresh request to the layer processing process at a first time point through a screen-off application.
[0119] In some embodiments of the present application, the first time point is a frame refresh time point of the next frame of the first off-screen image.
[0120] Exemplarily, one frame refresh time is every minute.
[0121] In some embodiments of the present application, the second frame refresh request is used to instruct generation of a screen-off image corresponding to the first time point, and is sent to the display hardware for display on the display screen of the electronic device.
[0122] Step 502: The electronic device forwards the second frame refresh request to the display driver through the layer processing process.
[0123] Exemplarily, the electronic device forwards the second frame refresh request to the display driver through the layer processing process, so as to inform the display driver that the first time point has been reached at the current moment and the off-screen image displayed on the current display screen needs to be refreshed, i.e., the new off-screen image is updated and displayed.
[0124] Step 503: Clear the second mark information according to the second frame refresh request through the display driver, and display the next frame of the screen-off image.
[0125] Exemplarily, clearing the second mark information may be directly deleting the second mark, or setting the second mark to 0.
[0126] Example 2, combined with Example 1, the time when the layer processing process receives the second frame refresh request sent by the screen-off application is 11:12, and the frame refresh time for the next frame of the screen-off image has arrived. Therefore, after the layer processing process forwards the second frame refresh request to the display driver, it clears the second mark information to drive the display hardware to display the next frame of the screen-off image of the first screen-off image.
[0127] In this way, by clearing the second flag, when the first time point is reached, the electronic device can normally display the next frame of the screen-off image, avoiding the problem that the time remains at a certain point without update and ensuring the screen-off display effect of the electronic device.
[0128] It should be noted that the two embodiments of steps 301 to 303 and steps 501 to 503 can be two separate embodiments or two embodiments executed simultaneously.
[0129] In a possible embodiment, when a second frame refresh request is received through the display driver, the first flag in the display driver is cleared, and the next frame of the screen-off image is displayed.
[0130] In a possible embodiment, when a second frame refresh request is received through the display driver, the second flag in the display driver is cleared, and the next frame of the screen-off image is displayed.
[0131] In another possible embodiment, when a second frame refresh request is received through the display driver, the first flag and the second flag in the display driver are cleared simultaneously, and the next frame of the screen-off image is displayed.
[0132] It can be understood that clearing the first flag is used to indicate that the display driver can normally drive the display hardware to refresh the screen, and clearing the second flag is used to indicate that the display driver can normally drive the display hardware to display other image layers except the screen-off image layer.
[0133] In this way, by clearing the first flag and the second flag, when the first time point is reached, the electronic device can normally display the next frame of the screen-off image, and can normally drive the display hardware to display other display images through the display driver, avoiding the problem that the time remains at a certain point without update and ensuring the screen-off display effect of the electronic device.
[0134] Optionally, in some embodiments of the present application, after step 501, the screen-off display method provided by the embodiments of the present application further includes steps 601 and 602.
[0135] Step 601: If the electronic device receives a third frame refresh request initiated by a first application through the layer processing process, a target image is generated through the layer processing process and transmitted to the display driver.
[0136] In some embodiments of the present application, when a third frame refresh request initiated by a first application is received by the layer processing process, since the screen-off display image does not need to be updated, first flag information still needs to be generated and transmitted to the display driver together with the target image.
[0137] In some embodiments of the present application, the above third frame brushing request is used to request the layer processing process to generate a corresponding target image.
[0138] Exemplarily, if the first application is a fingerprint application, after receiving the third frame brushing request from the layer processing process, a fingerprint icon is generated; if the first application is a password application, after receiving the third frame brushing request from the layer processing process, a password button is generated; if the first application is a face brushing application, after receiving the third frame brushing request from the layer processing process, a face brushing icon is generated.
[0139] Step 602, the electronic device displays the target image on the currently displayed screen-off image through the display driver.
[0140] In some embodiments of the present application, when displaying the target image on the currently displayed screen-off image, it is necessary to ensure that the second marking information is cleared.
[0141] Exemplarily, the above "the second marking information is cleared" means that the electronic device can superimpose and display the generated target image on the layer of the screen-off image.
[0142] In one example, since the first marking information is still held up, but the second marking information has been cleared, at this time, the display driver can drive the display hardware to maintain the display layer of the current screen-off image and superimpose and display the generated target image on the layer of the screen-off image.
[0143] In this way, even if the display driver detects the first marking indicating not to update the first screen-off image, if the second marking is cleared, the display driver can still normally drive the display hardware to display the target image. Thus, other display images except the screen-off image are displayed normally, and further the screen-off display effect of the electronic device is ensured.
[0144] The following takes a specific example to exemplarily illustrate the method described in steps 401 to 602 of the screen-off display method provided in the embodiments of the present application.
[0145] Embodiment 2: As Figure 5 shown, taking the first application as a fingerprint application and the screen-off application as the AOD APP as an example, the screen-off method may include the following steps B1 to B4.
[0146] It should be noted that in this embodiment, when the AP is awakened, the heterogeneous AOD kernel driver will timely notify the AOD APP to prepare to transmit the next frame of the screen-off image, that is, when the AP is awakened, it is exactly the frame brushing time of the screen-off image. And the drawing of the fingerprint application and the AOD APP will occur within one display cycle, where the vsync signal marks the start of a display cycle.
[0147] Step B1: The current time is 11:09. The AOD APP prepares the screen-off layer for 11:09. Through the display link of the AP, the display hardware is driven to display the screen-off image corresponding to 11:09.
[0148] It can be understood that the above display link of the AP is to transmit the screen-off layer of 11:09 to the SF to generate the screen-off image of 11:09, and then transmit the screen-off image to the display application, waiting for the display driver to drive the display hardware to display.
[0149] Step B2: The AP enters the sleep state and hands over the display control right to the SCP. The sub-device enters the sleep state, and the AP hands over the display control right to the SCP. When the time reaches 11:10 and 11:11 respectively, the SCP reads the screen-off display images corresponding to 11:10 and 11:11 that have been stored in the SCP. And in the SCP, scp_show_count is written into the shared memory, that is, the above second flag, indicating that the SCP has sent pictures.
[0150] It should be noted that since the second flag is stored in the shared memory, the AP side can also read and modify this second flag.
[0151] Step B3: The AP is awakened. As can be known from the foregoing description, before the fingerprint application and the AOD APP initiate a frame refresh request, there may be other applications initiating a frame refresh request, then the hint, that is, the above first flag, will be raised. When the fingerprint application and the AOD APP initiate a frame refresh request at the same time, the hint will be cleared. At the same time, when this frame refresh request is transmitted to the display driver, scp_show_count will be cleared. At this time, the Display driver can drive the display hardware to refresh the display image, and at this time, 11:12 and the fingerprint icon, that is, the above next frame screen-off image and the target image, are displayed.
[0152] Step B4: In the DOZE mode, the fingerprint application initiates a frame refresh request again, that is, the above third frame refresh request. The SF draws the fingerprint disappearance animation according to the frame refresh request. At this time, since the screen-off image does not need to be updated, therefore, the hint is raised again. However, since scp_show_count has been cleared in Step B3, the fingerprint disappearance animation will not be discarded. At this time, the display driver can drive the display hardware to maintain the display of the screen-off image corresponding to 11:12 and normally display the fingerprint disappearance animation.
[0153] Thus, in this embodiment, a display scheme for old frames of heterogeneous AOD is designed, by introducing frame dropping judgments in two dimensions. That is, the first marker on the SF side and the second marker on the SCP side are introduced to ensure the accuracy of heterogeneous AOD display. It achieves a seamless display switch of heterogeneous AOD in the actual electronic device application, avoiding problems that users cannot tolerate, such as time rollback and fingerprints always being displayed until the next time update, and improving the effect of the electronic device's off-screen display.
[0154] Each of the above method embodiments, or various possible implementation manners in each method embodiment, can be executed alone, or any two or more of them can be combined and executed. It can be specifically determined according to actual usage requirements, and the embodiments of the present application do not limit this.
[0155] For the window blurring processing method provided in the embodiments of the present application, the execution subject can be an electronic device or a window blurring processing device. In the embodiments of the present application, taking the window blurring processing device executing the window blurring processing method as an example, the window blurring processing device provided in the embodiments of the present application is described.
[0156] Figure 6 Shows a possible structural schematic diagram of the off-screen display device involved in the embodiments of the present application. As Figure 6 shown, the off-screen display device 700 may include: a processing module 701, a transmission module 702, and a display module 703.
[0157] Among them, the above-mentioned processing module 701 is used to generate first marker information if a first frame request initiated by a first application is received through the layer processing process when the application processor of the electronic device is awakened and the electronic device displays a first off-screen image; the first marker information is used to indicate not to update the first off-screen image; the above-mentioned transmission module 702 is used to transmit the first marker information generated by the processing module 701 to the display driver of the electronic device through the layer processing process; the above-mentioned display module 703 is used to maintain the display of the first off-screen image according to the first marker information generated by the processing module 701 through the display driver; where the first application is an application program in the electronic device other than the off-screen application.
[0158] Optionally, in some embodiments of the present application, the above-mentioned processing module 701 is specifically used to generate first marker information if a first frame request is received through the layer processing process and the reception moment of the first frame request has not reached the first time point; where the first time point is the frame refreshing time point of the next off-screen image of the first off-screen image.
[0159] Optionally, in some embodiments of the present application, after the display module 703 maintains the display of the first off-screen image according to the first marking information through display driving, the transmission module 702 is further configured to initiate a second frame brushing request to the layer processing process at a first time point through the off-screen application; the transmission module 702 is further configured to forward the second frame brushing request to the display driver through layer processing; the processing module 701 is further configured to clear the first marking information according to the second frame brushing request sent by the transmission module 702 through the display driver; the display module 703 is further configured to display the next off-screen image.
[0160] Optionally, in some embodiments of the present application, in combination with Figure 6 , as Figure 7 shown, the device 700 further includes: a storage module 704; when the first off-screen image is transmitted from the sensing control processor of the electronic device to the display hardware of the electronic device, the processing module 701 is further configured to generate second marking information; the storage module 704 is configured to store the second marking information generated by the processing module 701 in the shared memory; the second marking information is used to represent that the application processor is awakened and the electronic device displays the first off-screen image.
[0161] Optionally, in some embodiments of the present application, after the processing module 701 generates the second marking information, the transmission module 702 is further configured to initiate a second frame brushing request to the layer processing process at a first time point through the off-screen application, where the first time point is the frame brushing time point of the next off-screen image of the first off-screen image; the transmission module 702 is further configured to forward the second frame brushing request to the display driver through layer processing; the processing module 701 is further configured to clear the second marking information according to the second frame brushing request sent by the transmission module 702 through the display driver; the display module 703 is further configured to display the next off-screen image.
[0162] Optionally, in some embodiments of the present application, after the processing module 701 clears the second marking information according to the second frame brushing request and displays the next off-screen image, if a third frame brushing request initiated by a first application is received through the layer processing process, the processing module 701 is further configured to generate a target image through the layer processing process; the transmission module 702 is further configured to transmit the target image generated by the processing module 701 to the display driver; the display module 703 is further configured to display the target image generated by the processing module 701 on the currently displayed off-screen image through the display driver.
[0163] In the screen-off display device provided in the embodiment of the present application, when the application processor of the electronic device is awakened and the screen of the electronic device displays a first screen-off image in the screen-off state, if a first frame refreshing request initiated by a first application is received through the layer processing process, first marking information is generated, and the first marking information is used to indicate not to update the first screen-off image; through the layer processing process, the first marking information is transmitted to the display driver of the electronic device; through the display driver, the display of the first screen-off image is maintained according to the first marking information; wherein, the first application is an application program other than the screen-off application in the electronic device. In this solution, when the electronic device is awakened and there is no need to update the current screen-off image, the electronic device can set marking information, so that through the layer processing process, according to the marking information, it is indicated to the display driver that when a frame refreshing request initiated by an application other than the screen-off application is received, the first screen-off image is not updated, thereby avoiding reverting to display an old screen-off image and improving the screen-off display effect of the electronic device.
[0164] The screen-off display device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an in-vehicle electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and can also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiment of the present application does not make specific limitations.
[0165] The screen-off display device in the embodiment of the present application can be a device with an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems. The embodiment of the present application does not make specific limitations.
[0166] The screen-off display device provided in the embodiment of the present application can implement each process implemented by the embodiment of the screen-off display method and achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0167] Optionally, asFigure 8 As shown in the figure, an embodiment of the present application further provides an electronic device 800, including a processor 801 and a memory 802. A program or instruction that can run on the processor 801 is stored on the memory 802. When the program or instruction is executed by the processor 801, each step of the above-described embodiment of the screen-off display method is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described in detail here.
[0168] It should be noted that the electronic device in the embodiment of the present application includes the above-mentioned mobile electronic device and non-mobile electronic device.
[0169] Figure 9 It is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application.
[0170] The electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110, etc.
[0171] Those skilled in the art can understand that the electronic device 100 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 110 through a power management system, so as to manage functions such as charging, discharging, and power consumption management through the power management system. Figure 9 The structure of the electronic device shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements, which will not be described in detail here.
[0172] Among them, the above-mentioned processor 110 is used to generate first marking information if a first frame request initiated by a first application is received through a layer processing process when the application processor of the electronic device is awakened and the electronic device displays a first screen-off image; the first marking information is used to indicate not to update the first screen-off image; the above-mentioned processor 110 is used to transmit the first marking information to the display driver of the electronic device through the layer processing process; the display unit 106 is used to maintain the display of the first screen-off image according to the first marking information through the display driver; among them, the first application is an application program other than the screen-off application in the electronic device.
[0173] Optionally, in some embodiments of the present application, the above-mentioned processor 110 is specifically used to generate first marking information if a first frame request is received through a layer processing process and the reception time of the first frame request does not reach a first time point; where the first time point is the frame brushing time point of the next screen-off image of the first screen-off image.
[0174] Optionally, in some embodiments of the present application, the above-mentioned processor 110 is further configured to, after the above-mentioned display unit 106 maintains the display of the first off-screen image according to the first marking information through display driving, initiate a second frame brushing request to the layer processing process at a first time point through the off-screen application; the above-mentioned processor 110 is further configured to forward the second frame brushing request to the display driving through layer processing; the above-mentioned processor 110 is further configured to, through the display driving, clear the first marking information according to the above-mentioned second frame brushing request; the above-mentioned display unit 106 is further configured to display the next off-screen image.
[0175] Optionally, in some embodiments of the present application, when the first off-screen image is transmitted by the sensing control processor of the electronic device to the display hardware of the electronic device, the above-mentioned processor 110 is further configured to generate second marking information; the above-mentioned memory 109 is configured to store the above-mentioned second marking information in the shared memory; the second marking information is used to represent that the application processor is awakened and the electronic device displays the first off-screen image.
[0176] Optionally, in some embodiments of the present application, after generating the second marking information, the above-mentioned processor 110 is further configured to initiate a second frame brushing request to the layer processing process at a first time point through the off-screen application, where the first time point is the frame brushing time point of the next off-screen image of the first off-screen image; the above-mentioned processor 110 is further configured to forward the second frame brushing request to the display driving through layer processing; the above-mentioned processor 110 is further configured to, through the display driving, clear the second marking information according to the above-mentioned second frame brushing request; the above-mentioned display unit 106 is further configured to display the next off-screen image.
[0177] Optionally, in some embodiments of the present application, after the above-mentioned processor 110 clears the second marking information according to the second frame brushing request through the display driving and displays the next off-screen image, if a third frame brushing request initiated by a first application is received through the layer processing process, the target image is generated through the layer processing process; the above-mentioned processor 110 is further configured to transmit the above-mentioned target image to the display driving; the above-mentioned display unit 106 is further configured to, through the display driving, display the above-mentioned target image on the currently displayed off-screen image.
[0178] In the electronic device provided in the embodiment of the present application, when the application processor of the electronic device is awakened and the screen of the electronic device displays a first off-screen image in the off-screen state, if a first frame refreshing request initiated by a first application is received through a layer processing process, first marking information is generated, and the first marking information is used to indicate not to update the first off-screen image; through the layer processing process, the first marking information is transmitted to the display driver of the electronic device; through the display driver, the display of the first off-screen image is maintained according to the first marking information; wherein, the first application is an application program other than the off-screen application in the electronic device. In this solution, when the electronic device is awakened and there is no need to update the current off-screen image, the electronic device can set marking information, so that through the layer processing process, the display driver is instructed according to the marking information not to update the first off-screen image when receiving a frame refreshing request initiated by an application other than the off-screen application, thereby avoiding reverting to display an old off-screen image and improving the off-screen display effect of the electronic device.
[0179] It should be understood that in the embodiment of the present application, the input unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes the image data of a static picture or a video obtained by an image capturing device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. The other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here.
[0180] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area can store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 109 can include volatile memory or non-volatile memory, or the memory 109 can include both volatile and non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 109 in the embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.
[0181] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 110 either.
[0182] The embodiments of the present application also provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the above embodiment of the screen-off display method and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0183] Among them, the processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs, etc.
[0184] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement each process of the above embodiment of the screen-off display method and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.
[0185] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.
[0186] The embodiments of the present application provide a computer program product. The program product is stored in a storage medium and is executed by at least one processor to implement each process of the above embodiment of the screen-off display method and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.
[0187] It should be noted that in this article, the term "including", "comprising", or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article, or device including a series of elements not only includes those elements but also includes other elements not explicitly listed, or further includes elements inherent to such a process, method, article, or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article, or device including that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, the features described with reference to certain examples may be combined in other examples.
[0188] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases, the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.
[0189] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific implementation manners. The above specific implementation manners are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.
Claims
1. An off-screen image display method, characterized in that, The method includes: When the application processor of the electronic device is awakened and the electronic device displays a first off-screen image, if a first frame request initiated by a first application is received through a layer processing process, first marking information is generated; the first marking information is used to indicate not to update the first off-screen image; The first marking information is transmitted to the display driver of the electronic device through the layer processing process; Through the display driver, the display of the first off-screen image is maintained according to the first marking information; Wherein, the first application is an application program other than the off-screen application in the electronic device.
2. The method according to claim 1, wherein The step of generating first marking information if a first frame request initiated by a first application is received through a layer processing process includes: If the first frame request is received through the layer processing process and the reception time of the first frame request does not reach a first time point, first marking information is generated; Wherein, the first time point is the frame refreshing time point of the next off-screen image of the first off-screen image.
3. The method according to claim 2, wherein After maintaining the display of the first off-screen image according to the first marking information through the display driver, the method further includes: The off-screen application initiates a second frame request to the layer processing process at the first time point; The second frame request is forwarded to the display driver through the layer processing; Through the display driver, the first marking information is cleared according to the second frame request, and the next off-screen image is displayed.
4. The method according to claim 1, wherein The method further includes: When the first off-screen image is transmitted from the sensing control processor of the electronic device to the display hardware of the electronic device, second marking information is generated and stored in the shared memory; the second marking information is used to represent that the application processor is awakened and the electronic device displays the first off-screen image.
5. The method according to claim 4, wherein After generating the second marking information, the method further includes: The off-screen application initiates a second frame request to the layer processing process at a first time point, where the first time point is the frame refreshing time point of the next off-screen image of the first off-screen image; The second frame request is forwarded to the display driver through the layer processing; Through the display driver, the second marking information is cleared according to the second frame request, and the next off-screen image is displayed.
6. The method according to claim 5, characterized in that, After clearing the second marking information according to the second frame request through the display driver and displaying the next off-screen image, the method further includes: If a third frame request initiated by the first application is received through the layer processing process, a target image is generated by the layer processing process and transmitted to the display driver; Through the display driver, the target image is displayed on the currently displayed off-screen image.
7. An off-screen display device, characterized in that, The off-screen display device includes: a processing module, a transmission module, and a display module; The processing module is configured to generate first marking information if a first frame brushing request initiated by a first application is received through a layer processing process when the application processor of the electronic device is awakened and the electronic device displays a first off-screen image; the first marking information is used to indicate not to update the first off-screen image. The transmission module is configured to transmit the first marking information generated by the processing module to the display driver of the electronic device through the layer processing process. The display module is configured to maintain the display of the first off-screen image according to the first marking information generated by the processing module through the display driver. Wherein, the first application is an application program in the electronic device other than the off-screen application.
8. The device according to claim 7, characterized in that, The processing module is specifically configured to generate first marking information if the first frame request is received through the layer processing process and the receiving time of the first frame brushing request does not reach a first time point. Wherein, the first time point is the frame brushing time point of the next off-screen image of the first off-screen image.
9. The device according to claim 8, characterized in that The transmission module is further configured to, after the display module maintains the display of the first off-screen image according to the first marking information through the display driver, initiate a second frame brushing request to the layer processing process at the first time point through the off-screen application. The transmission module is further configured to forward the second frame brushing request to the display driver through the layer processing. The processing module is further configured to clear the first marking information according to the second frame brushing request sent by the transmission module through the display driver. The display module is further configured to display the next off-screen image.
10. The device according to claim 7, characterized in that The device further includes: a storage module. The processing module is further configured to generate second marking information if the first off-screen image is transmitted from the sensing control processor of the electronic device to the display hardware of the electronic device. The storage module is configured to store the second marking information generated by the processing module into a shared memory; the second marking information is used to characterize that the application processor is awakened and the electronic device displays the first off-screen image.
11. The device according to claim 10, characterized in that, The device further includes: a transmission module. The transmission module is configured to, after the processing module generates the second marking information, initiate a second frame brushing request to the layer processing process at a first time point through the off-screen application, where the first time point is the frame brushing time point of the next off-screen image of the first off-screen image. The transmission module is further configured to forward the second frame brushing request to the display driver through the layer processing. The processing module is further configured to clear the second marking information according to the second frame brushing request sent by the transmission module through the display driver. The display module is further configured to display the next off-screen image.
12. The device according to claim 11, characterized in that, The processing module is further configured to, after clearing the second marking information according to the second frame brushing request and displaying the next off-screen image through the display driver, if a third frame brushing request initiated by the first application is received through the layer processing process, generate a target image through the layer processing process. The transmission module is further configured to transmit the target image generated by the processing module to the display driver; The display module is further configured to display, via the display driver, the target image generated by the processing module on the currently displayed off-screen image.
13. An electronic device, characterized in that, It includes a processor and a memory, and the memory stores programs or instructions that can run on the processor. When the programs or instructions are executed by the processor, the steps of the off-screen display method according to any one of claims 1 to 6 are implemented.
14. A readable storage medium, characterized in that, Programs or instructions are stored on the readable storage medium, and when the programs or instructions are executed by a processor, the steps of the off-screen display method according to any one of claims 1 to 6 are implemented.
15. A computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the off-screen display method according to any one of claims 1 to 6.