Always-on display method and apparatus

Abstract

An always-on display method and apparatus, which relate to the technical field of terminals. The method is applied to an electronic device, the electronic device comprising a main processor and an auxiliary processor. The method comprises: when an electronic device is in an always-on display state, an auxiliary processor acquiring event information of a first event corresponding to a first application program; if it is determined that the first event is required to be responded to by a main processor, the auxiliary processor waking up the main processor and instructing the main processor to generate display data in response to the first event; and after obtaining the display data obtained by means of the main processor responding to the first event, the auxiliary processor performing display control on the basis of the display data.

Description

A method and apparatus for displaying an always-on display

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202410995974.1, filed on July 23, 2024, entitled "A Method and Apparatus for Always-on Display", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of terminal technology, and in particular to a method and apparatus for always-on display. Background Technology

[0004] Terminal devices (such as mobile phones) are being used more and more widely because they can provide rich and intelligent services. The screen (or display) is one of the main sources of power consumption in terminal devices. In order to reduce power consumption, terminal devices can adopt low-power always-on display modes, such as AOD (always-on display) mode, which controls the screen to light up a part to display some important information without lighting up the entire screen.

[0005] Low-power always-on display mode typically reduces power consumption by lowering brightness and resolution, and by not supporting interactive features. This results in poor display quality on terminal devices in low-power always-on display mode, affecting the user experience.

[0006] Improving the display effect of terminal devices while ensuring low power consumption is a technical problem that needs to be solved. Summary of the Invention

[0007] This application provides an always-on display method and apparatus to improve the display effect of electronic devices while ensuring low power consumption.

[0008] In a first aspect, a screen-off display method is provided, which can be applied to an electronic device, the electronic device including a main processor and a secondary processor, the method comprising: when the electronic device is in a screen-off display state, the secondary processor acquires event information of a first event corresponding to a first application; if the secondary processor determines that the first event needs to be responded to by the main processor, it wakes up the main processor and instructs the main processor to respond to the first event and generate display data; after obtaining the display data obtained by the main processor in response to the first event, the secondary processor performs display control according to the display data.

[0009] In the implementation manner, in the screen-off display state, the secondary processor can wake up the primary processor and instruct the primary processor to perform display processing, so that the primary processor with higher processing capability can be used to process display data of the application, and compared with the secondary processor processing the display data, the display effect can be improved, and thus the user experience can be improved.

[0010] In a possible implementation manner, before the secondary processor wakes up the primary processor, the secondary processor further determines a scene corresponding to the first event according to the first event, wherein the scene includes a response result or a display effect of the first event; and the secondary processor determines that the first event needs to be responded by the primary processor according to the scene.

[0011] In the implementation manner, the primary processor performs display processing according to the first event only when the secondary processor determines that the secondary processor cannot achieve the display effect corresponding to the first event, so that the primary processor can be woken up on demand, and thus the display effect can be improved while the power consumption is kept low.

[0012] In a possible implementation manner, the waking up the primary processor and instructing the processor to respond to the first event includes: the secondary processor sends first information to the primary processor, the first information including event information of the first event, and the first information being used to instruct the primary processor to respond to the first event.

[0013] In a possible implementation manner, the first information further includes display parameters, and the display parameters are used to generate display data.

[0014] In the implementation manner, the secondary processor can send the display data to the primary processor, so that the primary processor can perform display processing according to the display data, and thus the secondary processor can achieve smooth transition of the display effect when performing display control based on the obtained display data, and thus the user experience can be improved.

[0015] In a possible implementation manner, the display parameters include one or more of the following: brightness, saturation, gray scale, and frame rate.

[0016] In a possible implementation manner, the first information further includes address information of a buffer area, and the buffer area is used to buffer display data generated by the primary processor.

[0017] In a possible implementation manner, after the primary processor is woken up, the first application is run, and other applications on the primary processor remain in a state before the primary processor is woken up, so that the power consumption of the primary processor can be reduced as much as possible.

[0018] In a possible implementation, the method further includes: the main processor sets the display state as a low-power state, in which the first application is in a running state and the other applications remain in the states before the main processor is woken up.

[0019] In a possible implementation, the method further includes: after the main processor generates the display data, the main processor enters a sleep state. After the main processor completes processing of the display data, the main processor can automatically enter a sleep state, thereby reducing power consumption of the electronic device.

[0020] In a possible implementation, the method further includes: after the main processor generates the display data, the main processor sets the display state as a low-power suspend state, in which the main processor is in a sleep state and the auxiliary processor performs display control.

[0021] In a second aspect, a method for screen-off display is provided, which can be applied to a main processor in an electronic device, and the method includes: when the electronic device is in a screen-off display state, the main processor is woken up by the auxiliary processor, and receives first information from the auxiliary processor, the first information including event information of a first event corresponding to a first application, the first information being used to instruct the main processor to generate display data in response to the first event; the main processor generates display data according to the first information; and the main processor instructs the auxiliary processor to perform display control according to the display data.

[0022] In the above implementation, in the screen-off display state, the auxiliary processor can wake up the main processor, and the main processor performs display processing, thereby the main processor with higher processing capability can be used to process display data of an application, and compared with processing of display data by the auxiliary processor, display effect can be improved, thereby improving user experience.

[0023] In a possible implementation, the first information further includes display parameters; and the main processor generates display data according to the first information, including: the main processor generates display data according to the event information of the first event and the display parameters.

[0024] In a possible implementation, the display parameters include one or more of the following: brightness, saturation, gray scale, and frame rate.

[0025] In a possible implementation, the first information further includes address information of a buffer area; and the method further includes: the main processor stores the display data in a corresponding buffer area according to the address information.

[0026] In a possible implementation, the method further includes: after the main processor is woken up by the auxiliary processor, running the first application, and other applications on the main processor maintaining states before the main processor is woken up.

[0027] In a possible implementation, the method further includes: the main processor setting a display state as a low-power state, in which the first application is in a running state and the other applications maintain states before the main processor is woken up.

[0028] In a possible implementation, the method further includes: after the main processor generates the display data, the main processor enters a sleep state.

[0029] In a possible implementation, the method further includes: after the main processor generates the display data, the main processor sets a display state as a low-power suspend state, in which the main processor sleeps and the auxiliary processor performs display control.

[0030] In a third aspect, an electronic device is provided, including a main processor and an auxiliary processor, the auxiliary processor being configured to implement the method in any one of the first aspect, and the main processor being configured to implement the method in any one of the second aspect.

[0031] In a fourth aspect, an apparatus is provided, including a unit or module configured to implement the method in any one of the first aspect, or a unit or module configured to implement the method in any one of the second aspect.

[0032] In a fifth aspect, an apparatus is provided, including one or more processors configured to implement the method in any one of the first aspect.

[0033] In a sixth aspect, a readable storage medium is provided, the readable storage medium storing a program or instructions, when the program or instructions are run on an apparatus, causing the apparatus to implement the method in any one of the first aspect, or implement the method in any one of the second aspect.

[0034] In a seventh aspect, a chip system is provided, including a processor configured to support a computer apparatus to implement the method in any one of the first aspect, or implement the method in any one of the second aspect.

[0035] In an eighth aspect, a program product is provided, the program product including a program; when the program is run on a computer, causing the computer to implement the method in any one of the first aspect, or implement the method in any one of the second aspect. BRIEF DESCRIPTION OF DRAWINGS

[0036] FIG. 1 is a schematic diagram of interface changes of a service card of a take-out application in a lock screen display mode in response to data from a network side according to an embodiment of the present application;

[0037] FIG. 2 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

[0038] FIG. 3 is a schematic diagram of a software system architecture of an electronic device according to an embodiment of the present application;

[0039] FIG. 4 is a schematic diagram of a software system architecture of an electronic device according to another embodiment of the present application;

[0040] FIG. 5 is a schematic diagram of a flow of event registration when a lock screen is displayed according to an embodiment of the present application;

[0041] FIG. 6 is a schematic diagram of a flow of switching of a lock screen display according to an embodiment of the present application;

[0042] FIG. 7 is a schematic diagram of a flow of a lock screen display performed by a main processor according to an embodiment of the present application;

[0043] FIG. 8 is a schematic diagram of a flow of a lock screen display performed by an auxiliary processor according to an embodiment of the present application;

[0044] FIG. 9 is a schematic diagram of a device structure according to an embodiment of the present application. DETAILED DESCRIPTION

[0045] A low-power lock screen display mode (for example, an AOD display mode) can be used to reduce the power consumption of an electronic device. Currently, the related art provides the following two implementation methods of a low-power lock screen display mode:

[0046] The first implementation method: the low-power lock screen display mode is implemented by a main processor. After the electronic device is locked, the main processor of the electronic device is in a sleep state. When it is necessary to refresh a user interface of a foreground application, the main processor is woken up, the user interface data of the foreground application is updated, and the display system is controlled to display the updated user interface. This implementation method has high power consumption because it is implemented by the main processor.

[0047] The second implementation method: the low-power consumption screen-off display mode is implemented by the auxiliary processor. After the electronic device is in the screen-off state, the main processor is in hibernation, and the auxiliary processor is responsible for refreshing the user interface of the foreground application. For example, when the user interface of the foreground application needs to be refreshed, the auxiliary processor updates the user interface data of the foreground application and controls the display system to display the updated user interface. Compared with the first implementation method, the second implementation method can reduce the power consumption of the electronic device. However, the capability (such as the drawing capability and the computing power) of the auxiliary processor is lower than that of the main processor, and in addition, the auxiliary processor is usually equipped with a lightweight operating system, and therefore cannot support complex display effects and interactive display effects.

[0048] Therefore, how to improve the display effect of the electronic device while ensuring low power consumption of the electronic device is a technical problem to be solved at present.

[0049] To this end, the embodiments of the present application provide a screen-off display method that can be applied to an electronic device, and an electronic device and a related apparatus that can implement the method.

[0050] In the embodiments of the present application, when the electronic device is in the screen-off display mode (or screen-off display state), the auxiliary processor can wake up the main processor and instruct the main processor to perform display processing, so that the main processor with high processing capability can be used to process the display data of the application. Compared with the processing of the display data by the auxiliary processor, the display effect can be improved, and the user experience can be improved, so that the display effect of the electronic device can be improved while ensuring low power consumption of the electronic device. The above processing process can be performed without user awareness.

[0051] First, the technical terms related to the embodiments of the present application are introduced.

[0052] (1) Main processor and auxiliary processor

[0053] In an electronic device having a main processor and a secondary processor, the main processor, such as an application processor (AP), typically a CPU, is used to perform most of the processing operations. The secondary processor, also referred to as a co-processor, is a processor specially designed to work with the main processor to complete certain computing tasks. For example, the secondary processor can include a microcontroller unit (MCU), a digital signal processor (DSP), etc. For example, the secondary processor can be a SensorHub (SensorHub is a low-power MCU). The secondary processor can also be a small core in a system on chip (SoC). The secondary processor usually has lower performance, lower bottom current, higher energy efficiency, and lower power consumption compared to the main processor.

[0054] Optionally, in an embodiment of the present application, the secondary processor can include one or more of the following components: a communication component (such as a low-power Bluetooth communication component), a power system, a navigation positioning system related component (such as including a positioning system protocol stack), a near field communication component, a graphic code payment related component, a call service related component, a short message related component, an always on display (AOD) related component, etc. The navigation positioning system can include a global navigation satellite system (GNSS), etc., and the embodiments of the present application do not limit this.

[0055] For example, if the secondary processor includes the above components, since the secondary processor can have a communication component, the secondary processor can support call services, so that it is not necessary to switch to the main processor to perform call services, thereby saving power consumption; since the secondary processor can have a near field communication component, the secondary processor can support near field communication related functions, so that it is not necessary to switch to the main processor to perform near field communication services, thereby saving power consumption; since the secondary processor can have a graphic code payment related component, the secondary processor can support graphic code payment related functions, so that it is not necessary to switch to the main processor to perform graphic code payment services, thereby saving power consumption; for another example, since the secondary processor can have a navigation positioning system related component, the secondary processor can support navigation positioning services, so that it is not necessary to switch to the main processor to perform navigation positioning services, thereby saving power consumption.

[0056] (2) Main operating system and lightweight operating system

[0057] In this embodiment, the main processor of the electronic device can run a main operating system, while the secondary processor can run a lightweight operating system (LiteOS, or a lightweight operating system). The main operating system and the lightweight operating system are relatively independent. For example, the main operating system can be... Operating System (Harmony) A lightweight operating system could be Harmony Lite OS, such as HarmonyL3 or later versions, which can serve as the primary operating system. As another example, the primary operating system could be Android. A lightweight operating system could be a lightweight version of Android. As another example, the primary operating system could be a Microsoft operating system. A lightweight operating system could be a Microsoft lightweight operating system.

[0058] Compared to the main operating system, a lightweight operating system refers to a type of operating system that is small, flexible, fast, and easy to use. Lightweight operating systems have fewer functions and consume relatively fewer resources compared to the main operating system, thus saving system resources and improving system efficiency.

[0059] An application can run on either the main operating system or a lightweight operating system. When running on a lightweight operating system, it may consume fewer system resources (including memory) than when running on the main operating system. An application running on a lightweight operating system may only implement some of its functionalities. For example, an audio player running on a lightweight operating system may only support play, pause, previous, and next playback functions, lacking features like album selection. Therefore, an application running on a lightweight operating system can be called a simplified version of the application.

[0060] (3) Always-on display

[0061] AOD, short for Always On Display, is a screen-off display technology that allows for the partial illumination of the screen without turning on the entire screen to display important information such as time, weather, and notifications. The content displayed in AOD can continuously change position on the screen to avoid the risk of screen burn-in caused by maintaining a screen-off display mode for extended periods. In some embodiments of this application, the user interface of applications such as wallpapers can also be displayed in full-screen mode during AOD display.

[0062] The AOD display technology is based on the characteristics of the OLED screen, so that part of the information can be obtained in the standby interface, and the low power consumption advantage is obtained. OLED is the English abbreviation of organic light-emitting diode or organic electroluminescence display, that is, organic light-emitting diode or organic electroluminescence display (or organic light-emitting semiconductor display). The black area of the OLED screen does not consume power, and only the display of the non-black area consumes power.

[0063] The AOD display can also be called the screen-off display or the screen-out display or the screen-out display. The embodiments of the present application take the screen-off display as an example for description.

[0064] In the embodiments of the present application, when the electronic device is in the screen-off display mode, the main processor of the electronic device is in sleep state, and the auxiliary processor of the electronic device is running. In the screen-off display mode, the interface displayed on the screen of the electronic device is displayed by the auxiliary processor.

[0065] Some screen-off display application scenarios related to the embodiments of the present application can include, for example:

[0066] Scenario one:

[0067] In the screen-off display mode, an application program can be run on the auxiliary processor, and the interface of the application program is displayed on the screen. In the case where no user interaction occurs, the interface of the application program is displayed by the auxiliary processor. In the case where user interaction occurs, the content and / or display effect displayed by the interface of the application program needs to change accordingly. If the auxiliary processor cannot generate corresponding display data for the interface change of the application program due to its limited processing capability and the like, the auxiliary processor can briefly wake up the main processor, and the main processor is responsible for generating corresponding display data based on the user interaction, and after generating the display data, the auxiliary processor is switched to, and the auxiliary processor is responsible for display processing of the display data, and the main processor enters the sleep state again.

[0068] For example, in the screen-off display mode, a dynamic wallpaper application is running on the secondary processor, and the wallpaper displayed by the dynamic wallpaper application includes a water surface of a lake. When the user clicks or gazes at the water surface, the dynamic wallpaper application needs to display an animation effect of ripples on the water surface. In the case where the user does not click or gaze at the screen, the wallpaper displayed by the dynamic wallpaper application is static, and the display of the wallpaper is controlled by the secondary processor. When the user clicks or gazes at the water surface of the lake, the secondary processor wakes up the primary processor, the primary processor generates display data that can present the animation effect of ripples on the water surface based on the user operation, and then switches back to the secondary processor, which is responsible for display processing of the display data to present the animation effect on the screen.

[0069] For another example, in the screen-off display mode, an audio player is running on the secondary processor, and the interface of the audio player is displayed on the screen of the electronic device, which can include control components such as a play key, a previous song play key, a next song play key, and a key for displaying an album cover. When the user clicks the play key, the play key changes from a “play” display effect (for example, a triangular logo) to a “pause” display effect (for example, a double vertical line logo), and the change of the display effect is controlled by the secondary processor. When the user clicks the “key for displaying an album cover”, the audio player needs to display the album cover corresponding to the currently played audio, which is a video. In this case, the secondary processor wakes up the primary processor, the primary processor generates display data that can present the video based on the user operation, and then switches back to the secondary processor, which is responsible for display processing of the display data to display the video on the screen.

[0070] Scenario Two:

[0071] In the screen-off display mode, a service card of an application program can run on the secondary processor. The service card is a service form, which can provide an atomized service capability with a finer granularity than an application program, and directly displays the service or content most concerned by the user in the form of an interactive card. The service card can also provide an entry of one or more shortcut functions, so that the user can conveniently trigger a specific function included in the application program. The service card can also track the change of the service or card content over time to display the latest service or content. For example, the service card of a weather application program can display real-time weather information, and for another example, the service card of a takeout application program can display real-time delivery status changes.

[0072] When the content displayed on the service card needs to be updated based on the data from the network side, if the secondary processor cannot generate the corresponding display data due to its limited processing capability and the like, the secondary processor can briefly wake up the primary processor, and the primary processor is responsible for generating the corresponding display data based on the data from the network side. After the display data is generated, the secondary processor is switched again, the secondary processor is responsible for display processing of the display data, and the primary processor enters the sleep state again.

[0073] For example, in the screen-off display mode, the service card of the weather application running on the secondary processor is displayed on the screen of the electronic device, and the service card can display real-time weather information. When the weather data from the network side indicates that the current or future weather is extreme weather such as heavy rain, the service card will display an animation effect of the heavy rain weather in order to remind the user. The secondary processor cannot generate the corresponding display data due to its limited processing capability and the like, and the secondary processor can briefly wake up the primary processor, and the primary processor is responsible for generating the corresponding display data. After the display data is generated, the secondary processor is switched again, the secondary processor is responsible for display processing of the display data, and the primary processor enters the sleep state again.

[0074] For example, in the screen-off display mode, the service card of the weather application running on the secondary processor is displayed on the screen of the electronic device, and the service card can display real-time weather information. When the weather data from the network side indicates that the current or future weather is extreme weather such as heavy rain, the service card will display an animation effect of the heavy rain weather in order to remind the user. The secondary processor cannot generate the corresponding display data due to its limited processing capability and the like, and the secondary processor can briefly wake up the primary processor, and the primary processor is responsible for generating the corresponding display data. After the display data is generated, the secondary processor is switched again, the secondary processor is responsible for display processing of the display data, and the primary processor enters the sleep state again.

[0075] Scenario three:

[0076] In the screen-off display mode, for some application programs, when a new message of the application program arrives at the electronic device from the network side, the secondary processor can display a notification message on the screen to prompt that a new message of the application program has arrived. Optionally, the embodiments of the present application allow the user to set which application program or which application programs need to display the notification message.

[0077] In one possible scenario, when a new message of an application arrives at the electronic device, the secondary processor displays a notification message. When the user clicks the notification message, the secondary processor can wake up the primary processor, and the primary processor opens the application and displays the new message in response to the user operation.

[0078] In another possible scenario, a new message notification event of an application can be registered when entering the screen-off display mode, so that when the event occurs in the screen-off display mode, the secondary processor can switch to the primary processor for corresponding display processing. Specifically, when a new message of the application arrives at the electronic device in the screen-off display state, the secondary processor briefly wakes up the primary processor, the primary processor generates corresponding display data based on the new message, and after generating the display data, the secondary processor is switched to the secondary processor for display processing of the display data, and the primary processor enters the sleep state again.

[0079] For example, taking a takeout application as an example, when entering the screen-off display mode, the new message notification event of the delivery status corresponding to the takeout application is registered. When the delivery status from the network side indicates that the delivery personnel arrives at a new location, the secondary processor can briefly wake up the primary processor, the primary processor is responsible for generating corresponding display data (for example, an animation of the delivery personnel arriving at a new location from the original location), and after generating the display data, the secondary processor is switched to the secondary processor for display processing of the display data, and the primary processor enters the sleep state again.

[0080] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0081] The embodiments of the present application can be applied to an electronic device configured with a display screen, and the display screen of the electronic device can support screen-off display. The electronic device can be, for example, a mobile phone, a tablet computer, a notebook computer, a netbook, a smart screen, a vehicle-mounted device, and a business intelligent terminal (including a video phone, a conference table intelligent terminal, etc.), a personal digital assistant (PDA), an augmented reality (AR) \ virtual reality (VR) device, an artificial intelligence (AI) device, etc. The above electronic devices can also be other electronic devices, such as a laptop with a touch-sensitive surface (e.g., a touch panel). The embodiments of the present application do not limit the specific form of the electronic device.

[0082] The electronic device to which the embodiments of the present application can be applied can include, for example, but is not limited to, a device running Google's Android operating system (OS) and / or a device running Apple's iOS operating system (OS). or other operating system electronic device.

[0083] The electronic device in the embodiments of the present application can realize human-computer interaction.

[0084] The electronic device in the embodiments of the present application has at least two processors, one of which is a main processor and the other is an auxiliary processor. The main processor is loaded with a main operating system, and the auxiliary processor is loaded with a lightweight operating system.

[0085] The electronic device in the embodiments of the present application can have one display screen or multiple display screens. Taking a single-screen electronic device with one display screen as an example, the single-screen electronic device can be a single-screen straight phone, a tablet computer, etc. Taking a double-screen electronic device with two display screens as an example, the double-screen electronic device can be a folding-screen phone, a double-screen straight phone, etc.

[0086] The internal hardware structure of the electronic device in the embodiments of the present application is described below in combination with FIG. 2.

[0087] Referring to FIG. 2, it is a hardware structure schematic diagram of an electronic device provided in the embodiments of the present application.

[0088] As shown in FIG. 2, the electronic device 100 can execute the method provided in the embodiments of the present application. The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0089] The processor 110 can include one or more processing units. For example, the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a display processing unit (DPU), a neural-network processing unit (NPU), and / or the like. Different processing units can be independent devices or integrated in one or more processors. In some embodiments, the electronic device 100 can also include one or more processors 110. The processor is the nerve center and command center of the electronic device 100. The processor can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions. The processor 110 can also be provided with a memory for storing instructions and data.

[0090] The camera 193 can include one camera or a set of cameras. The camera 193 can include a front camera and a rear camera.

[0091] The sensor module 180 can include one or more of a pressure sensor 180A, a gyro sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, a vibration sensor, and an infrared detection sensor.

[0092] The electronic device 100 can implement a display function through a GPU, a display screen 194, an application processor AP, and the like. The display screen 194 is used to display images, videos, and the like.

[0093] The electronic device 100 can implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. For example, music playing, recording, and the like.

[0094] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0095] FIG. 3 is a software system architecture block diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 3, the software system architecture of the electronic device can be a layered architecture, for example, the software can be divided into several layers, and the layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, the application layer, the application framework layer (FWK), the runtime and system library, the kernel layer, and the hardware layer.

[0096] The application layer can include a series of application packages. As shown in FIG. 3, the application layer can include camera, settings, skin module, user interface (UI), third-party application, etc. Among them, the third-party application can include wireless local area network (WLAN), music, call, Bluetooth, video, memo, note, etc.

[0097] In one possible implementation, the application can be developed using java language, and can be completed by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the underlying of the operating system (such as the hardware layer, the kernel layer, etc.) through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems of the operating system.

[0098] The application framework layer provides application programming interface and programming framework for the application of the application layer. The application framework layer includes some predefined functions. As shown in FIG. 3, the application framework layer can include activity manager, window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0099] The activity manager is used to manage the life cycle of each application and provide common navigation back function, and provides an interactive interface for the window of all programs.

[0100] The window manager is used to manage windows programs. The window manager can get the display screen size, determine whether there is a status bar, lock the screen, take a screenshot, etc. The content provider is used to store and obtain data, and make the data accessible to the application program. The data can include video, image, audio, dialed and received calls, browsing history and bookmarks, phonebook, etc.

[0101] The view system includes visual controls, such as controls that display text, controls that display pictures, etc. The view system can be used to build an application program. A display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon can include a view that displays text and a view that displays a picture.

[0102] The phone manager is used to provide the communication function of the electronic device. For example, the management of the call state (including call connection, call hang-up, etc.).

[0103] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc.

[0104] The notification manager enables the application program to display notification information in the status bar, which can be used to convey a type of message that can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform the completion of the download, message reminders, etc. The notification manager can also be a notification that appears in the top status bar of the system in the form of a chart or a scroll bar text, such as a notification of an application program running in the background, and can also be a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, issuing a prompt sound, the electronic device vibrating, the indicator light flashing, etc.

[0105] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system. The core library includes two parts: one part is the function function that the java language needs to call, and the other part is the core library of the operating system. The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java file of the application program layer and the application program framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0106] The system library can include a plurality of functional modules. For example, a surface manager, a media framework, a three-dimensional graphics processing library (e.g., OpenGL ES), a two-dimensional graphics engine (e.g., SGL), and the like. The surface manager is used to manage the display subsystem and provides a plurality of applications with a fusion of two-dimensional and three-dimensional layers. The media framework supports a plurality of commonly used audio, video format playback and recording, and static image files, and the like. The media framework can support a plurality of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, and the like. The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, synthesis, and layer processing, and the like. The two-dimensional graphics engine is a drawing engine for two-dimensional drawing. In some embodiments, the three-dimensional graphics processing library can be used to draw a three-dimensional motion trajectory image, and the two-dimensional graphics engine can be used to draw a two-dimensional motion trajectory image.

[0107] The kernel layer is a layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

[0108] The hardware layer can include various sensors, such as an acceleration sensor, a gravity sensor, a touch sensor, and the like.

[0109] Optionally, a hardware abstraction layer (HAL) can also be included between the kernel layer and the hardware layer. The HAL can abstract hardware, which hides the hardware interface details of a specific platform, provides a virtual hardware platform for the operating system, and has hardware independence, which can be ported on a plurality of platforms.

[0110] It should be understood that the hardware structure of the electronic device can be as shown in FIG. 2, and the software system architecture can be as shown in FIG. 3, wherein the software system architecture in the electronic device corresponds to a software program and / or a module stored in the internal memory 121, and the processor 110 can run the software program and the application stored in the internal memory 121 to execute the flow of the display method provided in the embodiments of the present application.

[0111] In addition to the above examples, the method proposed in the present application can also be applied to other types of software systems, such as a Hongmeng operating system, a windows operating system, an iOS operating system, and the like.

[0112] Based on the architecture shown in FIG. 2 or FIG. 3, the embodiment of the present application provides a screen-off display method and a related device capable of implementing the method. In the screen-off display method, the auxiliary processor can perform screen-off display processing after the electronic device is in the screen-off state, so as to reduce the power consumption of the electronic device. In some scenarios in the screen-off display mode, the main processor can be switched to perform screen-off display processing, i.e., the main processor performs user interface data updating and display operation, so as to improve the display effect. After the main processor completes the user interface data updating and display, the auxiliary processor is switched to perform screen-off display processing.

[0113] The system architecture related to the screen-off display method provided by the embodiment of the present application is described below in combination with FIG. 4.

[0114] Referring to FIG. 4, the software system architecture block of an electronic device provided by the embodiment of the present application is shown, which includes some functional modules related to implementing the screen-off display method provided by the embodiment of the present application.

[0115] As shown in FIG. 4, the system architecture includes a main operating system and a lightweight operating system. The main operating system runs in the main processor, and the lightweight operating system runs in the auxiliary processor.

[0116] The lock screen application and the screen-off display application can run on the main operating system, or in other words, the lock screen application and the screen-off display application can run on the main processor.

[0117] The application layer includes the lock screen application and the screen-off display application.

[0118] The lock screen application can lock the screen to avoid others using the electronic device. The lock screen application can lock the screen in response to a user's lock screen operation, such as the power key of the electronic device being pressed or a user gesture. The lock screen application can also lock the screen when the electronic device is in an unattended state and the duration exceeds a threshold.

[0119] The screen-off display application is an application capable of displaying specific content in the lock screen state of the electronic device, such as time, date, wallpaper, service card, etc. Some examples of the screen-off display application include:

[0120] Screen-off clock application: This application can display various times on the phone, and you can view the time without waking up the phone. The application also provides the function of setting different screen-off pictures.

[0121] Screen-off wallpaper application: This application can display cool wallpapers when the phone is in the screen-off display mode, maintaining the cool effect of the screen saver.

[0122] In some embodiments of the present application, the always-on display application can allow displaying a service card of an application when the electronic device is in the always-on display mode. Optionally, the user can be allowed to make a setting through which it can be allowed to display a service card of which application or applications.

[0123] In some other embodiments of the present application, the always-on display application can allow displaying a user interface corresponding to a new message from a network side when the electronic device is in the always-on display mode.

[0124] It should be understood that the always-on display application can implement one or more of the above-mentioned functions, such as displaying time and displaying a service card, and the present application does not limit this.

[0125] The application framework layer of the main operating system can include a display management service (e.g., DisplayManager), a graphics compositor, and a hardware mixed renderer, and can also include a power management service (e.g., PowerManagerService) and a lock screen management service (e.g., KeyguardManagerService). The application framework layer of the light-weight operating system can include a sensor manager (e.g., SensorManager).

[0126] The kernel layer can include modules / services for the main operating system, such as a display driver. The kernel layer can also include modules / services for the light-weight operating system, such as an always-on display service (or AOD App), an always-on display wake-up sensor (e.g., AodWakeUpSensor), and a display subsystem (DSS) driver. The kernel layer can also include other modules / services, such as a sensor driver, which can be used for both the main operating system and the light-weight operating system. The above-mentioned power management service, lock screen management service, display management service, graphics compositor, and always-on display service are system services. A system service is a component that can perform long-running operations in the background.

[0127] Optionally, the hardware mixed renderer can also be located in the system layer or the HAL layer, and the present application does not limit this.

[0128] The hardware layer includes devices such as displays, cameras, and sensors.

[0129] It should be understood that in some embodiments of the present application, “display”, “display device”, “display screen”, and “screen” can be replaced with each other.

[0130] It should also be understood that in the system architecture shown in FIG. 4, the names of the functional modules are only one possible example, and the present application does not limit the naming method of the functional modules.

[0131] It should also be understood that the system architecture shown in FIG. 4 is only one possible example, and in other embodiments of the application, more or fewer components can be included than shown, or certain components can be combined, or split apart, or arranged differently.

[0132] The components included in the system architecture shown in FIG. 4 are described below.

[0133] (1) Graphics compositor

[0134] The graphics compositor is a resident system service. The graphics compositor can compose the 2D or 3D display data of multiple applications and then send the data to the display for display. One application can correspond to one surface, and a surface corresponds to a region in memory. The surface is allocated by the graphics compositor, and the application can obtain a graphics buffer from the graphics compositor and draw graphics on the graphics buffer through an open graphics library (OpenGL) / graphics processing engine (such as Skia). The graphics compositor can compose the data saved in the graphics buffer of each application and output the data to the display screen.

[0135] Optionally, the graphics compositor can be implemented by a service component with similar functions in the native operating system. For example, in the Android® system, the graphics compositor can be SurfaceFlinger. SurfaceFlinger can use OpenGL ES (OpenGL for embedded systems) for layer composition.

[0136] (2) Hardware mixing renderer

[0137] The hardware mixing renderer is a HAL layer module for layer composition and display in the host operating system, and the hardware mixing renderer can provide hardware support for the graphics compositor. The hardware mixing renderer can perform layer composition through a hardware device to reduce the composition pressure of the GPU.

[0138] In some embodiments of the application, the graphics compositor can provide the hardware mixer with a complete list of all layers, and the hardware mixer can determine how to process the layers according to its hardware capabilities. For example, some or all of the layers are composed by the hardware mixer, or some or all of the layers are composed by the GPU. The hardware mixer can mark the composition method for each layer.

[0139] ​In some embodiments of the present application, the graphics composer can compose all layers marked as GPU composition into one output buffer, and then hand over the output buffer to the hardware compositor together with other layers marked as hardware compositor composition, and the hardware compositor can complete the composition and display of the remaining layers.

[0140] Optionally, the hardware compositor can be implemented by a service component with similar functions in the native operating system. For example, the hardware compositor can be HWC (hardware composer).

[0141] (3) Display management service

[0142] The display management service is a resident system service. The display management service can be used to manage the life cycle of the display, and provide functions for accessing and controlling the display. The display management service can determine how to control the logical display according to the currently connected physical display, and send notifications to the system and applications when the display state changes, etc.

[0143] The system can use the display management service to create a virtual screen, and the virtual screen can divide the screen into different areas. One virtual screen is associated with one canvas (for example, a surface in the Android system), and the virtual screen can obtain a corresponding buffer through the canvas, and the buffer is used to store the data displayed on the virtual screen. The display management service can call the graphics composer to perform composition processing, and finally obtain the data to be displayed on the virtual screen, and hand over the data to the display for display.

[0144] The display management service can control the display state (or display mode) of the display. In the embodiments of the present application, the display state supported by the display management service can include one or more of the following:

[0145] On state: In the on state, the display can display.

[0146] Off state: In the off state, the display cannot display.

[0147] Suspended state (or fake off state): System hibernation state, entered after the electronic device is locked or the screen is turned off.

[0148] Doze state: In the embodiments of the present application, in the Doze state, the main processor is woken up, the system only allows the lock screen display application to wake up, and the display data of the lock screen display application can be updated, and other applications on the main processor remain in the state of the lock screen or the screen off, for example, in the hibernation state.

[0149] Optionally, in the Doze state, the maximum frame rate can be limited to reduce the power consumption of the electronic device. For example, a maximum frame rate can be set for the Doze state, and in the Doze state, the frame rate of the display data does not exceed the maximum frame rate.

[0150] Doze Suspend: In this state, the main processor is in sleep mode, and the display is controlled by the secondary processor to display.

[0151] Doze and Doze Suspend can be applied when the electronic device is in the screen-off display mode. For example, when the electronic device is in the screen-off display mode, if the screen-off display processing is switched from being performed by the secondary processor to being performed by the main processor, the display state can be set to the Doze state, so that only the corresponding application (for example, an application that needs to respond to the current user interaction operation) can update the display data, and other applications are not awakened, thereby reducing the power consumption of the electronic device. For another example, when the electronic device is in the screen-off display mode, after the main processor completes the screen-off display processing, the display state can be set to the Doze Suspend state, so that the main processor is in sleep mode, and the display is controlled by the secondary processor to display, thereby reducing the power consumption of the electronic device while ensuring the display effect.

[0152] (4) Power management service

[0153] The power management service is responsible for managing the power of the device. For example, it can control whether the electronic device enters sleep mode or wake-up mode.

[0154] (5) Lock screen management service

[0155] The lock screen management service is used to manage the lock screen.

[0156] (6) Sensor manager and screen-off display wake-up sensor

[0157] The sensor manager is located in the application framework layer in the lightweight operating system and is a kind of resident system service that can be created at boot.

[0158] The screen-off display wake-up sensor is a kind of virtual device that can be connected with the devices (for example, sensors) in the hardware layer to provide data from the hardware layer sensors to the upper layer (for example, the sensor manager in the application framework layer). The screen-off display wake-up sensor can link the hardware layer sensors to the SoC, so that the secondary processor can monitor and process the events detected by the hardware layer sensors.

[0159] Optionally, the screen-off display wake-up sensor can be connected with the sensor of the hardware layer through an inter-integrated circuit (I2C) interface or a serial peripheral interface (SPI).

[0160] Optionally, the screen-off display wake-up sensor can be realized by extending the function of a virtual device with similar function in the native operating system (for example, adding the interaction function with the screen-off display service). For example, the system can extend the function of AodWakeUpSensor in the kernel layer to obtain the screen-off display wake-up sensor.

[0161] It should be understood that the screen-off display wake-up sensor can also be a new virtual device provided by the embodiments of the present application.

[0162] The sensor manager can be connected with the screen-off display wake-up sensor of the kernel layer to form an event information transmission channel between the sensor of the hardware layer and the upper layer (for example, the application framework layer or the application layer).

[0163] (7) Screen-off display service

[0164] When the screen is locked, the sensor manager can distribute the event that needs to be monitored in the screen-off display mode to the screen-off display wake-up sensor, and then distribute the event to the screen-off display service, so as to register the event to the screen-off display service.

[0165] In the screen-off display mode, the screen-off display service can receive the event information detected by the virtual sensor, and determine whether the screen-off display needs to be performed by the main processor according to the event information. In another possible implementation, in the screen-off display mode, the screen-off display wake-up sensor can receive the event information detected by the virtual sensor, and send the event information to the screen-off display service, so that the screen-off display service determines whether the screen-off display needs to be performed by the main processor according to the event information.

[0166] In summary, the functions of the screen-off display service can include the following:

[0167] Function 1: In the screen-off display mode, the event that needs to be monitored is registered in the screen-off display mode.

[0168] Function 2: When the electronic device is in the screen-off display mode, the event information from the sensor driver can be received.

[0169] Function 3: After receiving sensor-driven event information, it can be determined whether to switch to the main processor for screen-off display. If it is determined to switch to the main processor for screen-off display, the event information is uploaded to the upper layer to perform the switching operation for screen-off display through the established event information transmission channel.

[0170] (8) Display driver

[0171] Display driver can refer to hardware-level driving circuit or software or firmware-level driver for controlling and managing display.

[0172] Hardware-level display driver can refer to a circuit or component for modulating the phase, peak value, frequency, etc. of the potential signal applied to the electrode of the display device to establish a driving electric field, thereby realizing the display effect. Hardware-level display driver focuses on how to realize the display effect of the image on the hardware level.

[0173] Software or firmware-level display driver is a kind of software or firmware for controlling and managing display, such as liquid crystal display in computer system, television screen, etc. Its role is to convert image and video data into a format that display can understand and control display to display in a specified way. Display driver ensures that image and video content can be presented on the screen with appropriate resolution, color mode and refresh rate by communicating and coordinating with display. Software-level display driver is responsible for converting image data into a format that display can understand and controlling display parameters of the device.

[0174] For example, display driver can include display subsystem (DSS) driver, which includes liquid crystal display (LCD) driver, etc. The present application does not make any limitation.

[0175] The DSS driver can directly connect a display such as an LCD supporting a corresponding interface on a board level. The DSS driver can synthesize multiple graphic buffers (such as user interface data of two different applications) as input into one output. The DSS driver can support simple graphic transformation and synthesis, such as supporting some simple image processing functions as follows: color transformation, gama transformation, picture rotation, and the like. The DSS driver converts data into an output signal, such as a High Definition Multimedia Interface (HDMI) signal, a MIPI DPI signal (where MIPI is an acronym for mobile industry processor interface, and DPI is an acronym for display pixel interface), and the like.

[0176] In a possible implementation, the kernel layer includes a first display driver (for example, the "display driver" in FIG. 4) and a second display driver (for example, the DSS driver in FIG. 4), the first display driver being a display driver corresponding to the main operating system, and the second display driver being a display driver corresponding to the light-weight operating system. The first display driver and the second display driver can be different in terms of a driving circuit structure or software control. In another possible implementation, the main operating system and the light-weight operating system share the display driver.

[0177] Based on the system architecture shown in FIG. 4, when the electronic device is locked, events that need to be monitored in the screen-off display mode can be registered to the screen-off display wake-up sensor and the screen-off display service through the sensor manager, so that the screen-off display service can monitor and report the registered events. For example, a flow of registering events when the screen is locked can be as shown in FIG. 5.

[0178] Referring to FIG. 5, a flowchart of registering events when the screen is locked is provided in an embodiment of the present application.

[0179] When the screen is locked, the main processor registers events that need to be monitored in the screen-off display mode to the auxiliary processor after detecting a screen locking event.

[0180] As shown in FIG. 5, the flow can include the following steps:

[0181] Step 501: When the electronic device is locked, the screen locking application program notifies the screen-off display application program, so that the screen-off display application program knows that a screen locking event has occurred.

[0182] After the screen locking event occurs, the electronic device enters the screen-off display mode, at this time, the main processor enters a sleep state, and the auxiliary processor is in a working state.

[0183] Optionally, the lock screen application and the screen-off display application can interact based on an interprocess communication (IPC) mechanism.

[0184] Embodiments of the present application can support multiple lock screen modes. For example, the lock screen modes supported by embodiments of the present application can include:

[0185] Lock screen mode 1: the lock screen is triggered by the power key of the electronic device. For example, after the power key of the electronic device is pressed and released by the user, the electronic device is locked.

[0186] Lock screen mode 2: timeout lock screen. When the length of time that the screen of the electronic device is in the on-screen state reaches a preset length of time, the electronic device is locked.

[0187] Lock screen mode 3: the lock screen is triggered by the distance sensor. During a call, if the distance sensor detects that the face is close to the screen, the electronic device is locked.

[0188] It should be understood that the above only exemplarily lists several possible lock screen modes, and embodiments of the present application do not limit the lock screen mode.

[0189] It should also be understood that the lock screen processes corresponding to the above several lock screen modes can involve related functions or services provided by the application framework layer and the kernel layer of the operating system, and embodiments of the present application do not limit this.

[0190] Step 502: The screen-off display application sends event registration information to the sensor manager in the lightweight operating system, the event registration information being used to indicate events that need to be monitored in the screen-off display mode.

[0191] In a possible implementation manner, the event registration information can include one or more of the following:

[0192] - indication information of the type of the event, the indication information being used to indicate the type of the event;

[0193] - the name of the event.

[0194] In a possible implementation manner, the type of the event that needs to be monitored in the screen-off display mode can include one or more of the following:

[0195] - touch event:

[0196] For example, the touch event can include:

[0197] ACTION_DOWN: the user's finger pressing operation, which can also represent the start of a touch event.

[0198] ACTION_MOVE: the user's finger moves on the screen, and slight movement in general triggers a series of movement events.

[0199] ACTION_POINTER_DOWN: additional finger pressing operation.

[0200] ACTION_POINTER_UP: additional finger leaving operation.

[0201] ACTION_UP: the user's finger leaves the screen, and one lifting operation can mark the end of a touch event.

[0202] -Swing events:

[0203] Swing events are events provided by the user interface programming toolkit. For example, it can include window events, adjustment events (events for adjusting the scroll bar), action events (events for monitoring the clicking of buttons or menus, etc.).

[0204] -Other events:

[0205] For example, gaze events. Gaze events are events based on visual sensors. Based on the detection data of the visual sensor (such as a low-power camera), the gaze action of the human eye to the screen can be determined, and the position of the line of sight of the human eye on the screen can be determined.

[0206] For another example, notification message events. Notification message events refer to events in which, in the screen-off display mode, when the electronic device receives a new message from the network side for a certain application or certain applications, the user is notified. For example, for a food delivery application, the notification message event can be: when the electronic device receives a new message of the food delivery application, display notification information that a new message has arrived. For another example, still taking the food delivery application as an example, the notification message event can also be: when the electronic device receives a new message of the food delivery application, display the content of the new message in an animated manner.

[0207] It should be understood that the above only exemplarily shows some events that can need to be monitored in the screen-off display mode, and the embodiments of the present application do not limit this.

[0208] The events that need to be monitored in the screen-off display mode can be defined by the system or set by the user, and the present application does not limit this. For example, in the case where the "screen gaze" function option of the electronic device is turned on, the gaze event can be included in the events that need to be monitored in the screen-off display mode. For another example, in the case where the notification message permission of the food delivery application is authorized, the notification message event for the food delivery application can be included in the events that need to be monitored in the screen-off display mode.

[0209] In a possible implementation, the event registration information can further include indication information of a scenario that needs to be displayed by the main processor. The indication information is used to indicate a scenario that needs to be displayed by the main processor in a system state. The always-on display service can determine whether the current scenario belongs to the scenario that needs to be displayed by the main processor according to the received event information.

[0210] The scenario can correspond to (or represent) a response result or a display effect of the application program to the event. For example, a possible scenario is an animation scenario of ripples on the water surface. It can be understood that the application program can have different response results to different events. For example, for some events, the response result of the application program to the event is to display a cool and fancy animation effect, which can need to be generated by the main processor according to the event, and therefore, the indication information of the scenario can be set for the event, to indicate that the display processing needs to be performed by the main processor. For other events, the response result of the application program to the event does not need to display a cool and fancy animation effect, and the display processing can be performed by the secondary processor according to the event, and therefore, the indication information of the scenario can not be set for the event, or the indication information of the scenario that does not need to be displayed by the main processor can be set.

[0211] Taking a dynamic wallpaper application as an example, in the always-on display mode, the display of the electronic device displays a dynamic wallpaper, and the dynamic wallpaper displays a meadow and a lake. If the user event is an event of the user clicking or staring at the water surface of the lake, the corresponding scenario is an effect of ripples on the water surface of the lake, and the display effect of the scenario cannot be implemented by the secondary processor, and therefore, the indication information is set for the event, to indicate that the display processing is performed by the main processor. If the user event is an event of the user clicking or staring at the meadow, the corresponding scenario is an effect of the meadow maintaining a current display state, and therefore, the indication information does not need to be set for the event.

[0212] Taking an always-on display application displaying a three-dimensional cartoon image as an example, in the always-on display mode, the display of the electronic device displays a three-dimensional image of a cartoon. If the user event is an event of the user pressing and sliding leftward or rightward on the cartoon image, or an event of the user staring at the cartoon image and shaking the head leftward, the corresponding scenario is an effect of the three-dimensional image of the cartoon turning rightward or leftward, and the display effect of the scenario cannot be implemented by the secondary processor, and therefore, the indication information is set for the event, to indicate that the display processing is performed by the main processor.

[0213] Taking the audio player as an example, in the screen-off display mode, the display of the electronic device displays the control component of the audio player, such as a pause key, a play key, an album cover display key, and the like. If the user event is an event of a user clicking the album cover display key, the corresponding scenario is to display the album cover corresponding to the currently played audio, the album cover is a video, and the display effect corresponding to the scenario cannot be implemented by the auxiliary processor. Therefore, the indication information is set for the event, to indicate that the display processing is performed by the main processor.

[0214] Taking the weather application service card as an example, in the screen-off display mode, the display of the electronic device displays the weather service card, and the current weather information is displayed in the weather service card. If it is required to display a cool storm dynamic effect for the weather data from the network side, the display effect corresponding to the scenario cannot be implemented by the auxiliary processor. Therefore, the indication information is set for the event, to indicate that the display processing is performed by the main processor.

[0215] It should be understood that the above only exemplarily lists several examples of the "scenario", and the present application does not limit this.

[0216] It should also be understood that using the indication information to indicate the scenario that requires the display processing by the main processor is only one possible implementation manner, and the present application does not limit the specific implementation manner of how to indicate the scenario that requires the display processing by the main processor. For example, an event list can also be set, and the events in the event list all require the display processing by the main processor; or other manners are used to mark the events that require the display processing by the main processor.

[0217] In a possible implementation manner, the scenario that requires the display processing by the main processor in the screen-off display mode can be specified in the system in advance. For example, taking the dynamic wallpaper application as an example, if the dynamic wallpaper application is a system application, it can be specified in the system in advance that the display processing by the main processor is required in the following scenario: in the screen-off display mode, for the dynamic wallpaper in the dynamic wallpaper application, the user clicks or gazes at the lake water surface region in the dynamic wallpaper.

[0218] In another possible implementation manner, the scenario that requires the display processing by the main processor in the screen-off display mode can be specified by the application. For example, taking the audio player as an example, if the audio player is a third-party application, it can be specified in the application that the display processing by the main processor is required in the following scenario: in the screen-off display mode, for the user interface of the audio player, the user clicks the album cover display key.

[0219] In step 503, the sensor manager sends the event registration information to the screen-off display wake-up sensor.

[0220] Step 504: The always-on display wake-up sensor sends the event registration information to the always-on display service.

[0221] After the always-on display service receives the event registration information, the always-on display service performs event registration processing.

[0222] After the event registration, in the always-on display mode, the always-on display service monitors the event. When the registered event occurs, the information of the event can be sent to the upper layer through the always-on display wake-up sensor.

[0223] For example, the registered event includes a gaze event. When the always-on display service receives the detection data of the vision sensor, the information of the gaze event can be sent to the always-on display wake-up sensor, and the information can include the detection data of the vision sensor.

[0224] In one possible implementation, when the electronic device is in the screen-off state, the display state is set to a low-power suspend state (DozeSuspend). In the DozeSuspend state, the main processor is in sleep mode, and the display is controlled by the auxiliary processor to display.

[0225] Optionally, when the electronic device is in the screen-off state, the display management service in the main operating system can set the display state to DozeSuspend.

[0226] Optionally, when the electronic device is in the screen-off state, for example, when the screen-off state is triggered by the power key of the electronic device, the power management service in the main operating system can set the display state to DozeSuspend after obtaining the event.

[0227] In the always-on display mode, the display processing operation can be switched from the auxiliary processor to the main processor for execution to improve the display effect. For example, the switching process of the always-on display processing operation can be as shown in FIG. 6 or FIG. 7.

[0228] Referring to FIG. 6, the switching process of the always-on display provided in the embodiment of the present application can include the following steps:

[0229] Step 601: In the always-on display mode, when a first event occurs, the auxiliary processor can obtain event information of the first event.

[0230] The first event can be a user operation event, for example, a touch event of the user on the screen or a gaze event of the user on the screen. The first event can also be an event triggered by an application, or the first event can be an event triggered when a new message from the network side is received.

[0231] For example, when the sensor of the hardware layer detects a user operation, the auxiliary processor can report event information of the event to the auxiliary processor, which can include detection data of the sensor, such as the type of user operation, the position of the user operation on the screen, and the like, which is not limited in the present application.

[0232] For another example, in the screen-off display mode, the application program can also generate the first event. For example, taking the service card of the weather application program as an example, the service card can receive real-time weather data pushed by the network side, and when receiving the weather data from the network side, it can be considered that the first event occurs, and the event information of the first event includes the received weather data. For another example, the application program (such as the service card of the weather application program) can need to obtain data from the network side and update the display at regular intervals, and when the application program obtains data from the network side, it can be considered that the first event occurs.

[0233] Based on the architecture shown in FIG. 4, taking the first event as a user operation event as an example, the specific implementation of step 601 can refer to steps 700 to 701 in FIG. 7, and the specific implementation is described in FIG. 7.

[0234] Step 602: The auxiliary processor determines whether the main processor needs to be awakened to respond to the event for screen-off display processing. If it is determined that the main processor needs to be awakened, go to step 603; if it is determined that the main processor does not need to be awakened, go to step 607.

[0235] In one possible implementation, the auxiliary processor can determine the corresponding scene according to the event information, and determine whether it needs to switch to the main processor to perform screen-off display processing according to the scene.

[0236] As shown in the event registration process of FIG. 5, when performing event registration, for the scene that needs to be responded by the main processor to generate display data, the indication information of the event that generates the scene can be set to indicate that the display processing needs to be switched to the main processor, or the event that can generate the scene can be stored in the event list. For the events in the event list, the display processing needs to be switched to the main processor. Correspondingly, in step 602, the auxiliary processor can determine whether the first event needs to be displayed by the main processor according to the event information of the first event.

[0237] For example, taking the user operation of the user's gaze on the lake surface in the dynamic wallpaper as an example, the auxiliary processor can determine the region of the gaze event on the lake surface in the dynamic wallpaper according to the position information contained in the event information, and determine that the corresponding scene is a scene that needs to be displayed by the main processor in the screen-off display mode, and thus determine that it needs to switch to the main processor to perform screen-off display processing.

[0238] Based on the architecture shown in FIG. 4, the specific implementation of step 602 can refer to step 702 in FIG. 7, and the specific implementation can refer to the description of FIG. 7.

[0239] Step 603: The secondary processor sends first information to the primary processor, and the first information includes the event information described above. The first information is used to instruct (or trigger) the primary processor to perform the screen-off display processing.

[0240] Optionally, the screen-off display service can first wake up the primary processor, for example, send a wake-up instruction to the primary processor to wake up the primary processor. In another implementation, the secondary processor can also wake up the primary processor through the first information.

[0241] In a possible implementation, the first information can further include address information of a buffer for storing display data generated by the primary processor.

[0242] In a possible implementation, the first information can further include display parameters, and the primary processor can generate or update the display data based on the display parameters. Since the lightweight operating system and the main operating system are independent of each other, the display parameters in the main operating system and the lightweight operating system are also independent of each other, for example, the frame rates in the main operating system and the lightweight operating system can be different. When the main operating system performs display processing, the display data is generated or updated based on the display parameters in the main operating system, which can cause differences in display effects before and after the display processing by the primary processor, affecting the user viewing experience. By using the above implementation provided in the embodiment of the application, the secondary processor can send the display parameters in the lightweight operating system to the primary processor, so that the primary processor can generate or update the display data based on the display parameters, thereby smoothly transitioning the display effects before and after the display processing by the primary processor, and improving the user experience.

[0243] Optionally, the display parameters can include one or more of the following: brightness, saturation, gray scale, frame rate, etc.

[0244] Based on the architecture shown in FIG. 4, the specific implementation of step 603 can refer to steps 703 to 705 in FIG. 7, and the specific implementation can refer to the description of FIG. 7.

[0245] Step 604: The primary processor generates display data based on the first information.

[0246] In a possible implementation, after receiving the first information, the main processor sets the display state to a low-power state (Doze), in which the first application running in the main processor is woken up, the first application generates or updates its display data, and other applications can remain in a state of being frozen when the main processor is in the sleep state. The first application is an application corresponding to the first event. For example, if the first event is a user operation event of gazing at the surface of water in a dynamic wallpaper application, the first application is the dynamic wallpaper application; for another example, if the first event is an event in which a service card of a weather application obtains weather data pushed by a network side, the first application is the weather application corresponding to the service card; for another example, if the first event is a delivery state update event of a takeout application from a network side, the first application is the takeout application.

[0247] Optionally, the main processor performs graphics composition processing or the like on the display data generated or updated by the first application, obtains screen display data, and stores the screen display data in a storage location specified by the secondary processor or in a preset storage location.

[0248] Optionally, in the Doze state, the frame rate of the display data does not exceed a maximum frame rate corresponding to the Doze state.

[0249] In a possible implementation, after completing the screen-off display processing, the main processor sets the display state to a low-power suspend state (DozeSuspend), in which the main processor is in the sleep state and the display is controlled by the secondary processor to display.

[0250] Optionally, the display state can be set by a display management service in the main operating system.

[0251] Based on the architecture shown in FIG. 4, the specific implementation of step 604 can refer to steps 706 to 714 in FIG. 7, and the specific implementation can refer to the description of FIG. 7.

[0252] Step 605: After completing the screen-off display processing, the main processor notifies the secondary processor.

[0253] In this step, after completing the screen-off display processing, the main processor can send a notification message to the secondary processor, where the notification message is used to indicate that the main processor has completed the screen-off display processing. The main processor switches to the sleep state.

[0254] Based on the architecture shown in FIG. 4, the specific implementation of step 605 can refer to step 715 in FIG. 7.

[0255] Step 606: After receiving the notification from the main processor, the secondary processor performs display control based on the display data.

[0256] Based on the architecture shown in FIG. 4, the specific implementation of step 606 can refer to steps 716 to 717 in FIG. 7.

[0257] Step 607: In the case where it is determined in step 602 that the main processor does not need to be woken up, the auxiliary processor generates display data according to the event information of the first event, and performs display control based on the display data. The specific implementation of this step can refer to the flow shown in FIG. 8.

[0258] In the flow shown in FIG. 6 or FIG. 7, in the screen-off display mode, the auxiliary processor can wake up the main processor and instruct the main processor to perform display processing, so that the main processor with higher processing capability can be used to process the display data, which can improve the display effect compared with the auxiliary processor processing the display data, and thus improve the user experience.

[0259] Based on the above flow, the screen-off display capability of complex dynamic effect interaction can be supported in the screen-off scene, and a balanced method of ensuring low power consumption and display effect. For example, in the screen-off display mode, for the interaction scene where the user gazes at a local area in the dynamic wallpaper, the auxiliary processor can wake up the main processor, and the main processor performs display processing for the scene, so as to realize dynamic effect interaction and improve the display effect while ensuring overall low power consumption.

[0260] Based on the above flow, in the case of displaying a service card or a notification card or an application card (such as a card of an audio application program) in the screen-off display mode, the auxiliary processor can wake up the main processor, and the main processor refreshes the above card for the scene, so as to realize a more complex display effect and improve the display effect while ensuring overall low power consumption.

[0261] Referring to FIG. 7, a screen-off display flow executed by the main processor is provided in an embodiment of the present application, which is described taking a user operation event as the first event as an example.

[0262] As shown in the figure, the flow can include the following steps:

[0263] Step 700: The sensor of the hardware layer sends detection data to the sensor driver of the kernel layer.

[0264] Step 701: The sensor driver of the kernel layer generates event information of the first event according to the detection data, and sends the event information to the screen-off display service of the kernel layer.

[0265] Step 702: The screen-off display service determines that the main processor needs to be switched to perform screen-off display processing according to the event information of the first event.

[0266] Optionally, after obtaining the event information from the hardware layer, the always-on display service can determine whether the currently received event belongs to the registered event according to the registered event that needs to be monitored in the always-on display mode, and if the event belongs to the event that needs to be monitored in the always-on display mode, the subsequent judgment can be continued, otherwise the event can be ignored or discarded.

[0267] For example, taking the user operation of clicking the screen as an example, the touch sensor can detect the clicking operation of the user, and can send the relevant information of the detected user operation (such as the clicking operation type indication information and the position of the clicking operation on the screen) to the always-on display service in the kernel layer.

[0268] For example, taking the user operation of gazing at the screen as an example, the gaze sensor can detect the operation of the user gazing at the screen of the electronic device, and can send the relevant information of the detected user operation (such as the gazing operation type indication information and the position of the gazing operation on the screen) to the always-on display service in the kernel layer.

[0269] Optionally, the always-on display service can determine the corresponding scene according to the event information of the first event, and determine whether the scene needs to be displayed by the main processor.

[0270] For example, taking the user operation of gazing at the lake water surface in the dynamic wallpaper as an example, after the always-on display service receives the event information of the first event corresponding to the user operation, it determines that the gazing event acts on the region of the lake water surface in the dynamic wallpaper according to the position information contained in the event information, and determines that the corresponding scene is the scene that needs to be displayed by the main processor in the always-on display mode, and therefore determines that it needs to switch to the always-on display processing performed by the main processor.

[0271] The flow is described taking the always-on display service determining that it needs to switch to the always-on display processing performed by the main processor as an example.

[0272] Step 703: The always-on display service sends first information to the always-on display wake-up sensor, and the first information includes the event information of the first event.

[0273] Optionally, the first information can also include the address information of the buffer for storing the display data generated by the main processor.

[0274] Optionally, the first information can also include display parameters.

[0275] Step 704: The always-on display wake-up sensor sends the first information to the sensor manager in the lightweight operating system of the main processor.

[0276] Step 705: The sensor manager sends the first information to the first application corresponding to the first event.

[0277] Steps 706-707: The first application sends a notification message to a display management service in the main operating system, and the display management service sets the display state to a low power state (Doze) according to the notification.

[0278] In the Doze state, the system only allows the first application to update display data, and other applications remain in a frozen or disabled state when the main processor is in a sleep state.

[0279] Optionally, the display management service can also create a virtual screen. When creating the virtual screen, a surface can be passed into the virtual screen, or the virtual screen can be associated with the surface. The surface corresponds to the content drawn on the virtual screen, or the surface corresponds to a buffer that contains the data to be displayed in the screen-off display mode. Optionally, the virtual screen can correspond to a local area of the display, so that in the screen-off display mode, only the local area of the display is displayed to reduce the power consumption of the electronic device.

[0280] An alternative to steps 706-707 is that the sensor manager in the light operating system can send indication information to the display management service in the main operating system, and the display management service can set the display state to a low power state (Doze) according to the indication information.

[0281] Step 708: The first application generates or updates display data in response to the first event according to the first information, and stores the display data in the buffer corresponding to the first application.

[0282] Optionally, the buffer corresponding to the first application is allocated to the first application by a graphics compositor in the main operating system.

[0283] Optionally, the first application can call the GPU to perform rendering of the display data.

[0284] Step 709: The first application sends a notification message to the graphics compositor, which is used to notify the graphics compositor to perform composition processing.

[0285] In another possible implementation, step 709 can be replaced by: the display management service calls an interface provided by the graphics compositor, so that the graphics compositor performs composition processing.

[0286] Step 710: The graphics compositor performs composition processing operations.

[0287] In some scenarios, the display data of the first application needs to be composited with other display data, for example, in the scenario where the clock and the service card of the weather application are displayed on the screen in the screen-off display mode, the display data corresponding to the service card of the weather application (i.e., the display data of the first application) needs to be graphically composited with the clock display data; in some other scenarios, the display data of the first application does not need to be composited with other display data, for example, in the scenario where the full-screen dynamic wallpaper is displayed on the screen in the screen-off display mode, the display data corresponding to the dynamic wallpaper application does not need to be graphically composited with other display data.

[0288] Step 711: The graphics compositor notifies the hardware blend renderer of the layers that need to be composited by the hardware blend renderer.

[0289] Optionally, the graphics compositor can provide the hardware blend renderer with a complete list of all layers (layer), and the hardware blend renderer can determine how to process these layers according to its hardware capability. For example, some or all of the layers are composited by the hardware blend renderer, or some or all of the layers are composited by the GPU. The hardware blend renderer can mark the composition method for each layer.

[0290] Optionally, the graphics compositor can composite all layers marked for GPU composition into an output to the buffer, and then hand over the buffer and other layers marked for hardware blend renderer composition to the hardware blend renderer, and the hardware blend renderer completes the composition and display of the remaining layers.

[0291] Step 712: The hardware blend renderer performs the composition.

[0292] The display data obtained after the final processing is stored in the buffer for storing the display data generated by the main processor.

[0293] Step 713: The hardware blend processor sends a notification message to the display management service and the first application to notify that the composition is completed.

[0294] Optionally, an alternative of this step is that the hardware blend processor can only send a notification message to the display management service, and does not need to send a notification message to the first application.

[0295] Step 714: The display management service sets the display state to the DozeSuspend state or the off state.

[0296] In the DozeSuspend state, the main processor is in a hibernation state.

[0297] Step 715: The first application sends a notification message to the display management service to inform that the screen-off display processing is completed.

[0298] Optionally, an alternative of this step is that the display management service in the main operating system sends a notification message to the screen-off display service in the light operating system.

[0299] Step 716: The screen-off display service sends a notification message to the display driver.

[0300] Step 717: The display driver acquires display data from the cache for storing display data generated by the main processor according to the notification message, converts the display data into an output signal, and sends the output signal to the display.

[0301] Optionally, the display driver can convert the display data into an HDMI signal, or an MIP IDPI signal, etc., which is not limited in the embodiments of the present application.

[0302] It should be understood that the graphics compositor can also perform the composition processing on all the layers, so that there is no need to send a notification message to the hardware blend renderer, i.e., the hardware blend renderer does not need to perform the layer composition processing.

[0303] It should be understood that the flow shown in FIG. 7 is only one possible example, and the interaction mode between the above modules can be different according to different operating systems, which is not limited in the present application.

[0304] Referring to FIG. 8, a screen-off display flow executed by the secondary processor is provided in the embodiments of the present application, which is described taking a user operation event as the first event as an example.

[0305] As shown in FIG. 8, the flow can include the following steps:

[0306] Step 800: The sensor of the hardware layer sends detection data to the sensor driver of the kernel layer.

[0307] The specific implementation of this step can refer to step 700 in FIG. 7.

[0308] Step 801: The sensor driver of the kernel layer generates event information of the first event according to the detection data, and sends the event information to the screen-off display service of the kernel layer.

[0309] The specific implementation of this step can refer to step 701 in FIG. 7.

[0310] Step 802: The screen-off display service determines that there is no need to switch to perform the screen-off display processing by the main processor according to the event information of the first event.

[0311] The specific implementation of this step can refer to step 802 in FIG. 7.

[0312] Step 803: The always-on display service sends event information of the first event to the always-on display wake-up sensor.

[0313] Step 804: The always-on display wake-up sensor sends the event information of the first event to a first application corresponding to the first event.

[0314] Step 805: The first application generates or updates display data according to the event information of the first event, and stores the display data into a buffer corresponding to the first application.

[0315] Optionally, the first application can call the GPU to perform rendering of the display data.

[0316] Step 806: The first application sends a notification message to the DSS driver.

[0317] Step 807: The DSS driver acquires the display data from the buffer corresponding to the first application according to the notification message, and converts the display data into an output signal.

[0318] Optionally, the DSS driver can perform some simple image processing, color conversion, gama conversion, picture rotation, etc. on the display data of the first application.

[0319] Optionally, the DSS driver can also synthesize the display data of the first application with other display data (e.g. clock data).

[0320] Optionally, the DSS driver can convert the display data into an HDMI signal, or a MIPI DPI signal, etc. The embodiments of the present application do not make any limitation in this aspect.

[0321] Step 808: The DSS driver outputs the output signal to the display for display.

[0322] It should be understood that the flow shown in FIG. 8 is only one possible example, and the interaction mode between the above-mentioned modules can be different according to different operating systems, which is not limited by the present application.

[0323] In some other embodiments of the present application, the capability of the light-weight operating system can be enhanced, so that it can support the drawing and display capability of more complex display content, or support the drawing and display capability of interactive-based dynamic effect, on the basis of supporting the basic graphics drawing capability. In this way, when the electronic device is in the always-on display mode, the auxiliary processor can update the user interface data of the always-on display application, and control the display system to display the updated user interface.

[0324] In a possible implementation, the lightweight graphics drawing framework can be integrated into the lightweight operating system to support the drawing and running of controls in the user interface of the always-on display application under the lightweight operating system of the secondary processor.

[0325] For example, the lightweight graphics drawing framework can be integrated into the lightweight operating system by adding system services, library functions, and the like in the lightweight operating system, or by providing more interfaces.

[0326] Optionally, the method of calling SoC IP hardware acceleration can also be integrated into the lightweight operating system.

[0327] For example, the lightweight graphics drawing framework integrated into the lightweight operating system can implement one or more of the following capabilities:

[0328] (1) Control support capability

[0329] By default, the Image control and the Label control are open.

[0330] Optionally, one or more of the following controls can also be supported: Button control, Box control, CheckBox control, Chart control, List control, and the like.

[0331] (2) Graphics drawing capability

[0332] The following one or more graphics can be drawn: Box, Line, Arc, Curve, Rectangle, Triangle, and the like.

[0333] (3) Graphics transformation capability

[0334] One or more of the following graphics transformation capabilities can be supported: moving, scaling, rotating, and switching.

[0335] (4) Font display capability

[0336] Uniform code (Unicode) encoded character display is supported.

[0337] Optionally, vector font library management can also be supported.

[0338] Optionally, raster font library management can also be supported.

[0339] (5) Text layout capability

[0340] Horizontal left, center, and right alignment are supported, vertical left, center, and right alignment are supported, and optionally, automatic line breaking can also be supported.

[0341] (6) Drawing format

[0342] Input picture format supports one or more of the following: RGB8888, RGB888.

[0343] Drawing output format supports RGB8888.

[0344] (7) Drawing acceleration capability

[0345] Support one or more of the following: IOMCU Vector (Vector data transmission protocol of MCU) / DMA (direct memory access), NPU AIV (NPU is the English abbreviation of neural processing unit, that is, neural processing unit; AIV is an AI video format).

[0346] (8) Input event

[0347] Default off Graphic lite native input event management interface;

[0348] Use AOD application input event management mechanism such as touch panel (TP), Swing, sensor, etc.

[0349] (9) Screen display capability

[0350] Default off Graphic lite native display interface;

[0351] AOD Surface realizes double FB ping-pong display interface.

[0352] It can be understood that in order to realize the functions in the above embodiments, the electronic device includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that the units and method steps of each example described in combination with the embodiments disclosed in the present application can be realized in the form of hardware or hardware and computer software. Whether a certain function is executed in hardware or computer software driven hardware depends on the specific application scenario and design constraints of the technical solution.

[0353] FIG. 9 is a structural schematic diagram of a possible device provided by an embodiment of the present application. The device can be used to realize the functions of the electronic device in the above method embodiments, and thus can also realize the beneficial effects possessed by the above method embodiments. In an embodiment of the present application, the device can be an electronic device as shown in FIG. 2, FIG. 3 or FIG. 4, and can also be a module (such as a chip) applied in a corresponding device.

[0354] As shown in FIG. 9, the apparatus 900 includes a processing unit 910 and a transceiver unit 920. The apparatus 900 is configured to implement the functions of the electronic device in the method embodiments shown in FIG. 5, FIG. 6, FIG. 7 or FIG. 8.

[0355] Optionally, the transceiver unit can include a receiving unit and a sending unit. The receiving unit can receive information such as signaling or data, and the sending unit can send information such as signaling or data under the control of the processing unit.

[0356] When the apparatus 900 is configured to implement the functions of the secondary processor in the electronic device in the embodiments of the present application, when the electronic device is in the screen-off display state, the processing unit 910 is configured to obtain event information of a first event corresponding to a first application program; if it is determined that the first event needs to be responded by the primary processor, the primary processor is woken up through the transceiver unit 920, and the primary processor is instructed to generate display data in response to the first event; after the processing unit 910 obtains the display data obtained by the primary processor in response to the first event, display control is performed according to the display data.

[0357] When the apparatus 900 is configured to implement the functions of the primary processor in the electronic device in the embodiments of the present application, when the electronic device is in the screen-off state, the transceiver unit 920 is configured to receive first information from the secondary processor, the first information including event information of a first event corresponding to a first application program, the first information being used to instruct the primary processor to generate display data in response to the first event; and the processing unit 910 is configured to instruct the secondary processor to perform display control according to the display data through the transceiver unit 920.

[0358] More detailed descriptions of the processing unit 910 and the transceiver unit 920 can be directly obtained by referring to the related descriptions in the method embodiments shown in FIG. 5, FIG. 6, FIG. 7 or FIG. 8, which will not be repeated here.

[0359] The embodiments of the present application also provide an apparatus including a processor and an interface circuit. The processor and the interface circuit are coupled to each other. It can be understood that the interface circuit can be a transceiver or an input / output interface. Optionally, the transceiver can include a receiver and a transmitter. Optionally, the apparatus can further include a memory for storing instructions executed by the processor or storing input data required by the processor to run instructions or storing data generated after the processor runs instructions. When the apparatus is configured to implement the method shown in FIG. 5, FIG. 6, FIG. 7 or FIG. 8, the processor is configured to implement the functions of the processing unit, and the interface circuit is configured to implement the functions of the transceiver unit.

[0360] When the apparatus is a chip applied to an electronic device, the chip implements the functions of the electronic device in the method embodiments. The chip receives information from other modules (such as a radio frequency module or an antenna) in the electronic device, and the information is sent by a network device to the electronic device; or the chip sends information to other modules (such as a radio frequency module or an antenna) in the electronic device, and the information is sent by the electronic device to the network device.

[0361] It can be understood that the processor in the embodiments of the present application can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor can be a microprocessor or any conventional processor.

[0362] In the present application, another example of providing an apparatus is provided, which includes at least one processor and at least one memory, the at least one processor and the at least one memory are coupled, the at least one memory is used to store instructions, when the instructions are executed by the at least one processor, the communication apparatus performs the method in the above embodiments.

[0363] The method steps in the embodiments of the present application can be implemented in hardware, or can be implemented in software instructions executable by a processor. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable read-only memory, a register, a hard disk, a mobile hard disk, a CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium. The storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device or a terminal. The processor and the storage medium can also exist as discrete components in the network device or the terminal.

[0364] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments are performed. The computer can be a general purpose computer, a special purpose computer, a computer network, a network device, a user equipment or other programmable apparatus. The computer programs or instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer programs or instructions can be transferred from one website site, computer, server or data center to another website site, computer, server or data center through wired or wireless manner. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center and the like integrated with one or more available media. The available media can be a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape; or an optical medium, such as a digital video disc; or a semiconductor medium, such as a solid state disk. The computer readable storage medium can be a volatile or non-volatile storage medium, or can include both volatile and non-volatile storage media.

[0365] In various embodiments of the present application, the terms and / or descriptions of different embodiments are consistent and can be referred to each other if there is no special description and logical conflict, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0366] In the present application, "at least one" means one or more, and "multiple" means two or more. The association relationship between the associated objects is described, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. In the literal description of the present application, the character " / ", generally represents that the associated objects before and after are in an "or" relationship; in the formula of the present application, the character " / ", represents that the associated objects before and after are in a "division" relationship. "Including at least one of A, B and C" can mean: including A; including B; including C; including A and B; including A and C; including B and C; including A, B and C.

[0367] It can be understood that various numerical numbers involved in the embodiments of the present application are only distinguished for convenience of description, and are not used to limit the scope of the embodiments of the present application. The size of the serial number of the above processes does not mean the order of execution, and the execution order of the processes should be determined according to its function and inherent logic.

Claims

1. A method of idle screen display, characterized by, The method is applied to an electronic device including a main processor and an auxiliary processor, and includes the following steps: When the electronic device is in a screen-off display state, the auxiliary processor acquires event information of a first event corresponding to a first application program; If the auxiliary processor determines that the first event needs to be responded by the main processor, the auxiliary processor wakes up the main processor and instructs the main processor to generate display data in response to the first event; After the auxiliary processor obtains the display data generated by the main processor in response to the first event, the auxiliary processor performs display control according to the display data.

2. The method of claim 1, wherein, Before the auxiliary processor wakes up the main processor, the method further includes the following steps: The auxiliary processor determines a scene corresponding to the first event according to the first event, wherein the scene includes a response result or a display effect of the first event; The auxiliary processor determines that the first event needs to be responded by the main processor according to the scene.

3. The method according to any one of claims 1 to 2, wherein, The step of waking up the main processor and instructing the main processor to respond to the first event includes the following steps: The auxiliary processor sends first information to the main processor, wherein the first information includes event information of the first event, and the first information is used to instruct the main processor to respond to the first event.

4. The method of claim 3, wherein, The first information further includes display parameters, and the display parameters are used to generate display data.

5. The method of claim 4, wherein, The display parameters include one or more of the following: brightness, saturation, gray scale, and frame rate.

6. The method according to any one of claims 3 to 5, wherein, The first information further includes address information of a buffer area, and the buffer area is used to cache display data generated by the main processor.

7. The method according to any one of claims 1 to 6, wherein The method further includes the following steps: After the main processor is woken up, the main processor runs the first application program, and other application programs on the main processor remain in a state before the main processor is woken up.

8. The method of claim 7, wherein, The method further includes the following steps: The main processor sets a display state to a low-power consumption state, in the low-power consumption state, the first application program is in a running state, and the other application programs remain in the state before the main processor is woken up.

9. The method according to any one of claims 7-8, wherein, The method further includes the following steps: After the main processor generates the display data, the main processor enters a sleep state.

10. The method of claim 9, wherein, The method further includes the following steps: After the main processor generates the display data, the main processor sets a display state to a low-power consumption suspension state, in the low-power consumption suspension state, the main processor sleeps and the auxiliary processor performs display control.

11. An always-on display method, comprising: The method is applied to a main processor in an electronic device, and includes the following steps: When the electronic device is in a screen-off display state, the main processor is woken up by the auxiliary processor, receives first information from the auxiliary processor, the first information includes event information of a first event corresponding to a first application program, and the first information is used to instruct the main processor to generate display data in response to the first event; The main processor generates display data according to the first information; The main processor instructs the auxiliary processor to perform display control according to the display data.

12. The method of claim 11, wherein, The first information further includes display parameters. The main processor generates display data according to the first information includes the following steps: The main processor generates display data according to the event information of the first event and the display parameters.

13. The method of claim 12, wherein, The display parameters include one or more of the following: brightness, saturation, gray scale, and frame rate.

14. The method of any one of claims 12-13, wherein, The first information further comprises address information of the buffer; The method further comprises: The main processor stores the display data into the corresponding buffer according to the address information.

15. The method according to any one of claims 11 to 14, wherein, Further comprising: After the main processor is woken up by the auxiliary processor, the main processor runs the first application, and other applications on the main processor remain in the state before the main processor is woken up.

16. The method of claim 15, wherein, Further comprising: The main processor sets the display state to a low-power state, in which the first application is in a running state, and the other applications remain in the state before the main processor is woken up.

17. The method of any one of claims 15-16, wherein, Further comprising: After the main processor generates the display data, the main processor enters a sleep state.

18. The method of claim 17, wherein, Further comprising: After the main processor generates the display data, the main processor sets the display state to a low-power suspend state, in which the main processor is in a sleep state and the auxiliary processor performs display control.

19. An electronic device, comprising: The apparatus comprises a main processor and an auxiliary processor, the auxiliary processor is configured to implement the method of any one of claims 1-10, and the main processor is configured to implement the method of any one of claims 11-18.

20. An apparatus comprising: The apparatus comprises a unit or module configured to implement the method of any one of claims 1-10, or a unit or module configured to implement the method of any one of claims 11-18.

21. An apparatus, comprising: Further comprising: One or more processors are configured to implement the method of any one of claims 1-10.

22. A readable storage medium, characterized by, The readable storage medium stores a program or instructions, when the program or instructions are run on the apparatus, the apparatus executes the method of any one of claims 1-10, or the method of any one of claims 11-18.

23. A chip system, characterized by The processor is configured to support the computer apparatus to implement the method of any one of claims 1-10, or the method of any one of claims 11-18.

24. A program product, characterized by The program product comprises a program; when the program is run on a computer, the computer executes the method of any one of claims 1-10, or the method of any one of claims 11-18.

Images