Lock screen display method and electronic device
By introducing immersive service modules and lock screen function modules into electronic devices, the display of application content in the lock screen interface is realized, which solves the problem of insufficient user interaction experience in the lock screen state and improves the user's interaction experience in the lock screen state.
Patent Information
- Application Number
- PCT/CN2024/143274
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-20
- Filing Date
- 2024-12-27
- Publication Date
- 2025-12-26
AI Technical Summary
In existing technologies, the user interaction experience of electronic devices is limited when the screen is locked, and the lock screen interface cannot be effectively used to provide more application-related content, which affects the user experience.
By introducing immersive service modules and lock screen function modules into electronic devices, and utilizing the interaction between immersive service interfaces and lock screen function modules, application-related content, including multimedia content and user interfaces, can be displayed on the lock screen interface, supporting various styles of live notification switching and swipe operations.
It enriches the display scenarios of electronic devices, enhances the user's interactive experience in the lock screen state, allows users to view and operate application content in the lock screen interface, and meets the needs of different display scenarios.
Smart Images

Figure CN2024143274_26122025_PF_FP_ABST
Abstract
Description
A lock screen display method and electronic device
[0001] Cross-reference to related applications
[0002] This application claims priority to Chinese Patent Application No. 202410805027.1, filed on June 20, 2024, entitled "A Lock Screen Display Method and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application relates to the field of terminal technology, and in particular to a lock screen display method and electronic device. Background Technology
[0004] With the development of terminal technology, electronic devices such as mobile phones and tablets have been widely used in users' daily work and life. Electronic devices can provide users with richer functions. Users can experience the functions and services provided by various applications installed on their electronic devices. The scenarios in which users use electronic devices are no longer limited to displaying the main interface and application interface when the screen is on. For example, electronic devices can display notification messages on the lock screen to remind users to check relevant information in a timely manner. How to provide users with more interactive experiences in more scenarios has become one of the issues of great concern in the terminal field. Summary of the Invention
[0005] This application provides a lock screen display method and an electronic device, which provide a solution for displaying application-related content in the lock screen interface.
[0006] Firstly, this application provides a lock screen display method, which can be executed by an electronic device. The electronic device includes a first service module, a first service interface, and a lock screen function module. The method includes: the electronic device entering a lock screen state, and a first service in a first application of the electronic device being in a running state; the first application in the electronic device sending first information of the first application to the first service module through the first service interface, the first information including multimedia content or user interface information related to the first service; the first service module in the electronic device sending the first information to the lock screen function module; after receiving the first information, the lock screen function module in the electronic device creating a first window in the lock screen interface; and the lock screen function module in the electronic device displaying the first content of the first application in the first window according to the first information.
[0007] In the above method, the electronic device can provide the application with the function of displaying application content on the lock screen interface. The first application in the electronic device can send the first information of the first application to the first service module through the first service interface provided by the electronic device. After the first service module sends the first information to the lock screen function module, the lock screen function module can display the first content of the first application in the first window of the lock screen interface. Thus, even after the electronic device enters the lock screen state, the user can still view the display content provided by the running application on the lock screen interface, enriching the display scenarios of the electronic device and improving the user experience.
[0008] In one possible design, before the first application in the electronic device sends its first information to the first server module through the first service interface, the method further includes: the first application in the electronic device sending a first request message to the system server, the first request message being used to request screen lock display permission for the first service of the first application from the system server; the first application in the electronic device receiving a response message sent by the system server, the response message being used to instruct the system server to approve the permission request of the first application. With this design, when the first application in the electronic device has a screen lock display requirement, it can request screen lock display permission from the system server. After the system server approves the permission request, the first content of the first application is displayed on the lock screen interface, thereby achieving control over the first application and ensuring the controllability of the content displayed on the lock screen interface of the electronic device.
[0009] In one possible design, the electronic device further includes a service proxy module, and the method further includes: the first service module in the electronic device receiving second information sent by the server through the service proxy module, the second information including multimedia content related to the first service; the first service module in the electronic device sending the second information to the lock screen function module; and the lock screen function module in the electronic device displaying the second content of the first application in the first window according to the second information. Through this design, the electronic device can also provide a service proxy module, allowing the first service module to receive information about the first application sent by the server through the service proxy module, enabling the server to push the content of the first application displayed on the lock screen interface to the electronic device, thus saving the computing power of the electronic device.
[0010] In one possible design, before the first service module in the electronic device sends the first information to the lock screen function module, the method further includes: the first service module in the electronic device performing a risk detection on the first information and determining that the risk detection of the first information passes. This design ensures that the electronic device can control the content displayed on the lock screen interface, preventing advertisements and other content from affecting the user experience.
[0011] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: in response to a first operation triggered by the user in the first window, the electronic device switches to an unlocked state, runs the first application, and displays the user interface of the first task; wherein, the first operation is a click operation triggered by the user in the first window. With this design, when the electronic device displays the first content of the first task on the lock screen, the user can trigger the electronic device to run the first application and display its user interface. Thus, the electronic device can directly continue displaying the user interface of the first application in the unlocked state without requiring the user to manually launch the first application to continue viewing its content, improving the user experience.
[0012] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: in response to a second operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a card-style live notification corresponding to the first task in the lock screen interface; wherein, the second operation is a click operation triggered by the user at any location in the area other than the first window in the lock screen interface, or the second operation is a swipe operation triggered by the user in the first window.
[0013] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: in response to a third operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a capsule-style live notification corresponding to the first task in the lock screen interface; wherein, the third operation is a swipe operation triggered by the user in the first window.
[0014] With the above design, when the electronic device displays the first content of the first application in the first window, the user triggers an operation to switch between displaying a card-style live notification or a capsule-style live notification corresponding to the first task. This allows the user to switch between various styles of live notifications and immersive live content that the electronic device supports, meeting the different needs of the user in different display scenarios.
[0015] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: in response to a fourth operation triggered by the user in the first window, the lock screen function module of the electronic device displays a third content of the first application in the first window; wherein the fourth operation is a swipe operation triggered by the user in the first window, and the third content is sent to the lock screen function module by the first application after updating the first content according to parameters related to the fourth operation. With this design, the user can trigger a swipe operation in the first window to adjust the content displayed in the first window. For example, when the first content is a document, a long interface, etc., the user can swipe in the first window to view more content.
[0016] In one possible design, before the lock screen function module of the electronic device displays the third content of the first application in the first window, the method further includes: the lock screen function module of the electronic device determining that the permission information of the first application includes a first permission, the first permission being used to indicate that responsive swipe operations are supported when displaying the content corresponding to the first task in the lock screen interface.
[0017] In one possible design, the electronic device further includes an always-on display module. After the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: when the electronic device enters the always-on display state, the lock screen function module in the electronic device sends information about the lock screen interface to the always-on display module, the information about the lock screen interface including information about the first content of the first application displayed in the first window; the always-on display module of the electronic device displays the first content of the first application in a second window of the always-on display interface based on the information about the lock screen interface. Through this design, the lock screen function module in the electronic device can also send information about the lock screen interface to the always-on display module, so that the always-on display module can display the first content of the first application in the always-on display interface, further enriching the display scenarios of application content and improving the user experience.
[0018] In one possible design, the electronic device further includes an always-on display module. After the screen lock module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: when the electronic device enters the always-on display state, the always-on display module in the electronic device receives the first information sent by the system server through the service proxy module; the always-on display module in the electronic device displays the first content of the first application in a second window of the always-on display interface based on the first information. With this design, when the electronic device is in the always-on display state, the always-on display module can receive the first information of the first application sent by the server through the service proxy module, and the always-on display module can display the first content of the first application in the second window of the always-on display interface, thereby providing a display scheme for displaying application content in the always-on display state, meeting the user's need to understand application information when the electronic device is in the always-on display state.
[0019] In one possible design, when the service type of the first service is travel information, sports scores, meeting notifications, ticket information, or package pickup information, the first content is multimedia content; when the service type of the first service is map navigation, delivery information, sports and health, or ride-hailing, the first content is a user interface.
[0020] In one possible design, when the first content is a user interface, the first content includes at least one of text controls, icon controls, and multimedia controls.
[0021] Secondly, this application provides a lock screen display method, which can be executed by an electronic device. The electronic device includes a first service module, a service proxy module, and a lock screen function module. The method includes: the electronic device entering a lock screen state, and a first service in a first application of the electronic device being in a running state; the first service module in the electronic device receiving second information sent by a server through the service proxy module, the second information including multimedia content related to the first service; the first service module in the electronic device sending the second information to the lock screen function module; and the lock screen function module in the electronic device displaying the second content of the first application in a first window according to the second information.
[0022] Thirdly, this application provides an electronic device comprising multiple functional modules; the multiple functional modules interact to implement the methods performed by the electronic device in the first aspect and its various embodiments described above. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0023] Fourthly, this application provides an electronic device including at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the methods executed by the electronic device in the first aspect and its various embodiments described above.
[0024] Fifthly, this application also provides a computer program product containing instructions that, when the computer program product is run on a computer, cause the computer to perform the method executed by the server or electronic device in any of the above aspects and their embodiments.
[0025] Sixthly, this application also provides a computer-readable storage medium storing a computer program that, when executed by a computer, causes the computer to perform the method executed by the server or electronic device in any of the above aspects and embodiments.
[0026] In a seventh aspect, this application also provides a chip for reading a computer program stored in a memory and executing the method performed by a server or electronic device in any of the above aspects and their embodiments.
[0027] Eighthly, this application also provides a chip system including a processor for supporting a computer device in implementing the methods performed by a server or electronic device in any of the above aspects and their embodiments. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be composed of chips or may include chips and other discrete devices.
[0028] The technical effects that can be achieved by any of the technical solutions in the second to eighth aspects mentioned above can be described with reference to the technical effects that can be achieved by the technical solution in the first aspect mentioned above, and the repeated parts will not be repeated. Attached Figure Description
[0029] Figure 1 is a schematic diagram of an electronic device displaying notification messages on the lock screen interface according to an embodiment of this application;
[0030] Figure 2 is a schematic diagram of an application scenario for a lock screen display method provided in an embodiment of this application;
[0031] Figure 3 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0032] Figure 4 is a software structure block diagram of an electronic device provided in an embodiment of this application;
[0033] Figure 5 is a schematic diagram of a lock screen display method provided in an embodiment of this application;
[0034] Figure 6 is a schematic diagram of a layer position relationship provided in an embodiment of this application;
[0035] Figure 7 is a schematic diagram of an electronic device displaying an immersive live broadcast according to an embodiment of this application;
[0036] Figure 8 is a flowchart illustrating an immersive live-action user operation provided in an embodiment of this application;
[0037] Figure 9 is a schematic diagram of a lock screen interface of an electronic device provided in an embodiment of this application;
[0038] Figure 10 is a schematic diagram of a lock screen interface of an electronic device provided in an embodiment of this application;
[0039] Figure 11 is a schematic diagram of an immersive live broadcast where the first content is an image, provided in an embodiment of this application;
[0040] Figure 12 is a schematic diagram of a lock screen display method provided in an embodiment of this application;
[0041] Figure 13 is a schematic diagram of an immersive live stream where the first content is a user interface, provided in an embodiment of this application;
[0042] Figure 14 is a schematic diagram of a lock screen display method provided in an embodiment of this application;
[0043] Figure 15 is a flowchart of a lock screen display method provided in an embodiment of this application. Detailed Implementation
[0044] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.
[0045] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.
[0046] With the development of terminal technology, electronic devices offer users increasingly diverse display methods and interactive scenarios. For example, electronic devices are no longer limited to displaying content only when the screen is unlocked and on. When a notification message is received while the screen is locked, the electronic device can display the notification message on the lock screen or in an always-on display (AOD) interface. This ability to display notification messages on the lock screen ensures that users are promptly informed of pending notifications even when the device is locked, and most of these notifications are passively received. For instance, Figure 1 is a schematic diagram of an electronic device displaying notification messages on the lock screen according to an embodiment of this application. Referring to Figure 1, the electronic device can display "Messages" application reminder message 101, social application notification message 102, etc., on the lock screen.
[0047] It is evident that the content that users can view and the actions they can trigger on notification messages displayed in the lock screen state are limited. Based on this, how to provide users with more interactive experiences in various scenarios has become one of the issues of great concern in the terminal industry.
[0048] Based on the above problems, this application provides a lock screen display method for displaying application-related content on the lock screen interface. Figure 2 is a schematic diagram of an application scenario applicable to the lock screen display method provided in this application embodiment. Referring to Figure 2, the application scenario includes an electronic device and a system server; optionally, the application scenario also includes an application server. In this application embodiment, displaying application content on the lock screen interface of the electronic device can be referred to as displaying "immersive live stream." As shown in Figure 2, the electronic device includes an immersive service module, which can provide an immersive service interface for applications installed on the electronic device. This interface can also be called an immersive service kit, which can be a software development kit (SDK) installed on the electronic device. The immersive service module can receive application content sent by the application through calling the immersive service interface and interact with the lock screen function module in the electronic device, thereby displaying the application content in the first window of the lock screen interface. Optionally, as shown in Figure 2, the electronic device may also include an immersive cloud service agent module, which can also be called a push agent. This agent is used to receive application content pushed by the system server. The immersive cloud service agent can send the received application content to the immersive service module. The immersive service module interacts with the lock screen function module to display the application content pushed by the system server received by the electronic device in the first window of the lock screen interface.
[0049] The system server in the scenario shown in Figure 2 can provide immersive cloud service functionality for electronic devices. It provides cloud service interfaces to applications installed on the electronic devices and application servers, enabling applications to obtain permission to display immersive live content on the electronic devices. Furthermore, the immersive cloud service can also perform risk detection on the application content within the immersive live content. Optionally, in this embodiment, the system server shown in Figure 2 can also be a push server for pushing messages to electronic devices.
[0050] The application server in the scenario shown in Figure 2 is used to provide cloud services for applications installed on electronic devices. In this application implementation, the application server can send application content to the electronic device through the system server so that the electronic device can display the received application content in the first window of the lock screen interface.
[0051] Optionally, in some embodiments, the functions of the system server can be implemented by a cluster of computing devices including at least one computing device, wherein at least one computing device in the cluster of computing devices can be used to provide immersive cloud service functions. Alternatively, in other embodiments, the immersive cloud service functions can also be implemented by at least one computing device independent of the system server. This application does not limit this aspect.
[0052] Based on the application scenario shown in Figure 2, an electronic device can request registration from the system server to display the first application for immersive live streaming and at least one corresponding business type. After authorization by the system server, when the electronic device enters the lock screen state, the electronic device determines that the first business in the first application is running. The business type of the first business is the authorized business type corresponding to the first application. The lock screen function module in the electronic device can create a first window in the lock screen interface and display the first content of the first application in the first window. Optionally, the first content of the first application can be multimedia content provided by the first application or the user interface of the first application. The first content of the first application is determined by the lock screen function module based on the first information of the first application. The first information can be sent by the first application in the electronic device to the immersive service module through the immersive service interface, or the first information of the first application can be sent by the application server to the system server, and then sent by the system server to the immersive service module in the electronic device through the immersive cloud service proxy. Through this solution, the electronic device can provide the application with the function of displaying application content in the lock screen interface, so that even after the user triggers the lock screen, the display content provided by the running application can still be viewed in the lock screen interface, enriching the display scenarios of the electronic device and improving the user experience.
[0053] Optionally, referring to Figure 2, the electronic device may further include an AOD module. The AOD module can receive lock screen interface information sent by the lock screen function module, thereby displaying the content displayed in the lock screen interface in the AOD interface when the electronic device is in AOD display state. In this embodiment, after the electronic device enters the AOD display state, the AOD module can receive lock screen interface information sent by the lock screen function module. This lock screen interface information includes immersive live streaming information. After receiving the lock screen interface information sent by the lock screen function module, the AOD module can display immersive live streaming in the AOD interface. In some embodiments, when the electronic device is in the AOD display state, the AOD module can also receive first information of the first application sent by the immersive cloud service in the system server through the immersive cloud service proxy. The AOD module can create a second window in the AOD interface and display first content in the second window according to the first information of the first application.
[0054] The following describes an electronic device and embodiments for using such an electronic device. The electronic device in this application embodiment can be a tablet computer, mobile phone, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), wearable device, etc. This application embodiment does not impose any limitations on the specific type of electronic device.
[0055] In some embodiments of this application, the electronic device may also be a portable terminal device that includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable terminal device include, but are not limited to, devices equipped with... Or portable terminal devices with other operating systems.
[0056] Figure 3 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. As shown in Figure 3, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0057] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has recently used or is repeatedly used. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.
[0058] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. Charging management module 140 receives charging input from the charger. Power management module 141 connects battery 142, charging management module 140, and processor 110. Power management module 141 receives input from battery 142 and / or charging management module 140, providing power to processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.
[0059] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0060] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0061] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0062] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0063] The display screen 194 is used to display the display interface of an application, such as the display page of an application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0064] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0065] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of electronic device 100 (e.g., captured images, recorded videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0066] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.
[0067] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0068] The sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.
[0069] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.
[0070] Touch sensor 180C, also known as a "touch panel," can be located on display screen 194. The touch sensor 180C and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180C detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180C may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0071] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, touch operations applied to different applications (such as taking photos, audio playback, etc.) can correspond to different vibration feedback effects. Touch vibration feedback effects can also be customized. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with electronic device 100.
[0072] It is understood that the components shown in Figure 3 do not constitute a specific limitation on the electronic device 100. The electronic device may include more or fewer components than shown, or combine some components, or separate some components, or have different component arrangements. In addition, the combination / connection relationships between the components in Figure 3 can also be adjusted and modified.
[0073] Figure 4 is a software structure block diagram of an electronic device provided in an embodiment of this application. As shown in Figure 4, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the kernel layer.
[0074] The application layer may include a series of application packages. As shown in Figure 4, the application layer may include a camera, settings, skin modules, a user interface (UI), third-party applications, etc. Third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, etc. In this embodiment, the application layer may include an immersive service interface, through which applications installed on the electronic device can utilize the immersive live display function of the electronic device.
[0075] Notification messages displayed on electronic devices can be divided into two types: live notifications and non-live notifications. Live notifications are those with high timeliness requirements, such as notifications related to ride-hailing tasks and food delivery tasks. Non-live notifications are those with low timeliness requirements, such as notifications from social applications and system version update messages.
[0076] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer can include some predefined functions. As shown in Figure 4, the application framework layer can include a window manager, content provider, view system, phone manager, resource manager, notification manager, immersive service module, immersive cloud service proxy, and lock screen functionality module.
[0077] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making this data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0078] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0079] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).
[0080] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0081] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0082] The Immersive Service Module is used to provide immersive live display functionality for applications installed on electronic devices. The Immersive Service Module can receive application content sent by applications through the Immersive Service Interface, or receive application content sent by the system server through the Immersive Cloud Service Agent, and send the application content to the Lock Screen Function Module to display the corresponding immersive live content on the lock screen interface.
[0083] The Immersive Cloud Service Proxy is used to receive application content sent by the Immersive Cloud Service from the system server.
[0084] The lock screen function module is used to draw the lock screen interface for electronic devices and manage the content and controls displayed on the lock screen interface. In this embodiment, the lock screen function module can receive application content sent by the immersive service and display the application content in the first window of the lock screen interface.
[0085] The runtime includes the core libraries and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0086] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core libraries of the operating system. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0087] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), image processing libraries, etc.
[0088] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0089] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0090] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0091] A 2D graphics engine is a graphics engine for 2D drawing.
[0092] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0093] The hardware layer can include various types of sensors, such as accelerometers, gyroscopes, and touch sensors.
[0094] It should be noted that the structures shown in Figures 3 and 4 are merely examples of electronic devices provided in the embodiments of this application, and cannot be used to limit the electronic devices provided in the embodiments of this application. In specific implementations, electronic devices may have more or fewer devices or modules than those shown in Figures 3 or 4.
[0095] The lock screen display method provided in the embodiments of this application is described below.
[0096] In the lock screen display method provided in this application embodiment, the electronic device provides an immersive live display scheme. This immersive live display refers to the application content displayed by the electronic device in the lock screen state. This application content can be, for example, multimedia content or a user interface provided by the application. Based on the application scenario shown in Figure 2, Figure 5 is a schematic diagram of a lock screen display method provided in this application embodiment. Referring to Figure 5, the method may include the following steps:
[0097] S501: The electronic device sends a first request message to the system server.
[0098] The first request message is used to request lock screen display permissions for at least one business type of the first application from the system server, wherein the lock screen display permissions include immersive live display permissions.
[0099] Optionally, in this embodiment, the user can set whether to enable the immersive live streaming function, and the user can set the application permissions of applications installed on the electronic device to determine whether the applications can use the immersive live streaming function. Applications installed on the electronic device can also request to use the immersive live streaming function. The electronic device can apply to the system server to register the applications requesting to display immersive live streaming and at least one corresponding business type for each application. When an application supports multiple business types, when requesting to use the immersive live streaming function, the application can include at least one business type requested in the request message. For example, the business types supported by the application may include maps, food delivery, express delivery, flights, sports, etc.
[0100] In one optional implementation, when a first application in the electronic device is started or a first service within the first application is running, the first application can send a request message to the electronic device. This request message requests the electronic device to apply to the system server for immersive live-streaming permission corresponding to the first application. The electronic device can send a first request message to the system server, which may include the identifier of the first application and the identifier of the first service. In this way, immersive live-streaming permission for the first application can be requested from the system server only when the application in the electronic device has an immersive display requirement.
[0101] In another optional implementation, the electronic device can register with the system server upon power-on multiple applications capable of using the immersive live streaming function and at least one corresponding service type for each application. Alternatively, when the applications installed on the electronic device change, such as installing a new application or uninstalling an application, the electronic device can register with the system server multiple applications capable of using the immersive live streaming function and at least one corresponding service type for each application. Or, the electronic device can register with the system server multiple applications capable of using the immersive live streaming function and at least one corresponding service type for each application according to a preset period. This method ensures that the applications capable of immersive display on the electronic device are consistent with the applications registered on the system server, guaranteeing that subsequent applications can normally request and display immersive live streaming, and also ensuring security.
[0102] S502: After the system server verifies the first application, it sends a response message to the electronic device.
[0103] The response message sent by the system server to the electronic device is used to instruct the system server to grant permissions through the first application.
[0104] In some embodiments, after receiving a first request message from an electronic device, the system server verifies the first application and returns a response message to the electronic device indicating that the permission request for the first application has been approved. The server may store permission information corresponding to the electronic device, which includes a set of target applications and at least one authorized service type corresponding to each target application in the target application set. The target application set includes the identifier of at least one target application among the multiple applications installed on the electronic device that has permission to display immersive live streaming.
[0105] Optionally, the electronic device can locally store permission information corresponding to the immersive live display function. This permission information includes a set of target applications and at least one authorized service type for each target application in the set. In some scenarios, if the electronic device is not connected to the network, it can authenticate the application requesting to use the immersive live display function and store the permission information corresponding to that application. For example, the permission information corresponding to the application may include an application identifier and at least one service type corresponding to the application. When the electronic device is connected to the network, it can send the locally authenticated permission information to the system server.
[0106] S503: When the electronic device enters the lock screen state, the immersive service module in the electronic device obtains the first information of the first application.
[0107] S504: The immersive service module in the electronic device sends the first information of the first application to the lock screen function module.
[0108] In some embodiments, when the electronic device enters a locked screen state, if the first service in the first application within the electronic device is running, the electronic device can determine that the first application belongs to the target application set based on the stored permission information corresponding to the immersive live display function. That is, the electronic device determines that the first application has permission to display immersive live content, and that the first service is an authorized service type corresponding to the first application. Then, the electronic device can obtain the first information of the first application. This first information includes multimedia content or user interface information related to the first service. For example, the first information may be information about multimedia content such as images, videos, and audio sent by the first application or its corresponding application server to the immersive service module. Another example is information about the user interface related to the first task of the first application, drawn by the first application.
[0109] In an optional implementation, when the first information is multimedia content information provided by the first application, the first information of the first application can be sent by the first application to the immersive service module through the immersive service interface, or the first information of the first application can be sent by the application server to the system server, and then sent by the system server to the immersive server module through the immersive cloud service proxy in the electronic device. In this embodiment, S503 may include the following steps:
[0110] S503a: The first application sends its first information to the immersive service module through the immersive service interface.
[0111] Alternatively, S503 may include the following steps:
[0112] S503b: The first application sends a request message to the application server.
[0113] The request message sent by the first application to the application server is used to request the application server to generate an immersive live stream corresponding to the first service currently running in the first application.
[0114] S503c: The application server sends the first information of the first application to the system server.
[0115] S503d: The system server sends the first information of the first application to the immersive service module through the immersive cloud service agent of the electronic device.
[0116] After receiving the information of the first content of the first application through the above method, the immersive module in the electronic device can send the information of the first content of the first application to the lock screen function module in the electronic device to request the lock screen function module to display the immersive live broadcast on the lock screen interface.
[0117] In another optional implementation, when the first information is user interface information provided by the first application, the first application can send the first information to the immersive service module in the electronic device to request the creation of a first window for displaying the immersive live stream. This first window can be an extension component in the lock screen interface. The immersive service module can send a request message to the lock screen function module to request the lock screen function module to create the first window in the lock screen interface. After the lock screen function module creates the first window in the lock screen interface, it can send a request message to the first application. This request message includes parameters of the first window, such as the position information and size information of the first window. This request message is used to request the first information of the first application. After the first application draws the user interface corresponding to the first service based on the parameters of the first window, it can send the user interface of the first service to the lock screen function module.
[0118] In one optional implementation, after obtaining the first information of the first application, the electronic device can perform risk detection on the first information. For example, the electronic device can determine whether there are sensitive words in the text of the first information or whether the first information includes illegal content such as advertisements. After the risk detection of the first information passes, the information is displayed according to the first information, thereby ensuring that the electronic device can control the content displayed on the lock screen interface and prevent the display of advertisements and other content on the lock screen interface from affecting the user experience.
[0119] Optionally, when the above steps S503 include S503b-S503d, the risk detection step can also be performed by the system server. For example, in S503c, after receiving the first information of the first application sent by the application server, the system server can perform risk detection on the first information. After the risk detection of the first information passes, the system server then executes S503d to send the first information that has passed the risk detection to the electronic device.
[0120] S505: The lock screen function module of the electronic device displays the first content of the first application in the first window of the lock screen interface based on the first information.
[0121] Optionally, the first window can be a non-full-screen window in the lock screen interface. The electronic device can display an immersive live stream of the first application in the first window, that is, display the first content of the first application in the first window.
[0122] Optionally, in this embodiment, the first window may be located on the layer where the lock screen interface is located. For example, Figure 6 is a schematic diagram of a layer position relationship provided in this embodiment. Referring to Figure 6, the layer where the lock screen interface is located is above the layers where the wallpaper, desktop, and application windows are located, while the first window used to display the immersive live stream is located in the layer where the lock screen interface is located.
[0123] For example, Figure 7 is a schematic diagram of an electronic device displaying an immersive live stream according to an embodiment of this application. Referring to Figure 7(a), the electronic device displays flight images of a transportation application in the first window 701 of the lock screen interface; referring to Figure 7(b), the electronic device displays a user interface for recording running in a sports application in the first window 702 of the lock screen interface.
[0124] Optionally, when an electronic device displays an immersive live stream on the lock screen, if the device restarts, the immersive live stream will no longer be displayed after the restart, or other images can be used to cover the immersive live stream on the lock screen. After the user unlocks the electronic device and the device enters the lock screen state again, the electronic device can continue to display the immersive live stream, thereby ensuring user information security.
[0125] In this embodiment of the application, when the electronic device displays the first content of the first application in the first window of the lock screen interface, the user can trigger an operation in the first window. The electronic device can pass the operation triggered by the user to the first application. The first application responds to the operation triggered by the user, draws the second content, and sends the second content to the immersive service module. The immersive service module can call the lock screen function module to display the second content in the first window, thereby refreshing the content displayed in the first window.
[0126] Optionally, to reduce non-standard user interactions during immersive live streams, electronic devices can set application permissions for multiple applications. These permissions include supported user operations when displaying immersive live streams. For example, application permissions for displaying immersive live streams on an electronic device could include: supporting clicks to jump to full-screen application interfaces, supporting swipe operations, etc.
[0127] For example, suppose the electronic device is configured with application permissions that support clicking to jump to a full-screen application interface and supporting swipe operations when using immersive live streaming as the user interface. Figure 8 is a flowchart illustrating a user operation response process in immersive live streaming according to an embodiment of this application. Referring to Figure 8, when a user triggers an operation in immersive live streaming, the immersive service module, the ability manager service (AMS), the screen lock module, and the first application in the electronic device can execute the following steps:
[0128] S801: In response to a click action triggered by the user in the first window, the immersive service module sends a request message to AMS.
[0129] The immersive service module sends a request message to AMS to request the launch of the first application.
[0130] S802: AMS sends a startup command to the first application.
[0131] S803: The first application runs and displays the user interface corresponding to the first task.
[0132] S804: In response to a swipe operation triggered by the user in the first window, the immersive service module determines that the application permissions of the first application include permissions that support swipe operations.
[0133] S805: The immersive service module sends the parameters related to the swipe operation to the first application.
[0134] S806: The first application determines the third content of the first application based on the parameters related to the sliding operation.
[0135] The third content is the content displayed after the first content has been shifted according to the distance corresponding to the sliding operation.
[0136] S807: The first application sends the third content to the lock screen function module.
[0137] S808: The lock screen function module displays third content in the first window.
[0138] In some embodiments of this application, the electronic device can also display live notifications of applications on the lock screen interface. These live notifications on the lock screen interface can have various display styles, such as capsule style, card style, etc. Some applications' services on the electronic device can be displayed on the lock screen interface in the form of live notifications, or in an immersive live format. For example, Figure 9 is a schematic diagram of the lock screen interface of an electronic device provided in an embodiment of this application. Figure 9 uses the ride-hailing service in a ride-hailing application as an example. Referring to Figure 9(a), the electronic device can display a capsule-style live notification 901 for the ride-hailing application; referring to Figure 9(b), the electronic device can display a card-style live notification 902 for the ride-hailing application. Optionally, as shown in Figure 9(b), when displaying the card-style live notification 902 for the ride-hailing application, the electronic device can also display a notification message on the lock screen interface. Referring to Figure 9(c), the electronic device can display an immersive live 903 for the ride-hailing application.
[0139] Optionally, the electronic device can determine whether to display live notifications or immersive live content on the lock screen based on user habits or usage scenarios. For example, when the electronic device is in working mode, to reduce disturbance to the user, the electronic device can display live notifications for ride-hailing apps in a capsule style as shown in Figure 9(a).
[0140] This application embodiment also provides a method for live notification and immersive live switching for the same service in the same application. For example, for a first task running in a first application, when the electronic device displays an immersive live, in response to a first operation triggered by the user in the immersive live, the electronic device triggers unlocking. After successful unlocking, the electronic device can display the user interface of the first task in the first application. For example, the first operation can be a click operation triggered by the user in a non-control display area in the first window.
[0141] When an electronic device displays an immersive live stream, in response to a second action triggered by the user within the immersive live stream, the electronic device can switch to displaying a live stream notification in the card style corresponding to the first task. For example, the second action could be a click action triggered by the user in any location in the lock screen interface other than the first window, or the second action could be a side swipe or up swipe action triggered by the user in the first window, wherein the side swipe action includes left swipe and right swipe.
[0142] When an electronic device displays an immersive live stream, in response to a third action triggered by the user within that immersive live stream, the electronic device can switch to displaying a capsule-style live stream notification corresponding to the immersive live stream. For example, the third action could be a swipe-down action triggered by the user in the first window.
[0143] When an electronic device displays a capsule-style live notification, in response to a fifth action triggered by the user in the live notification, the electronic device can switch to displaying a card-style live notification. For example, the fifth action could be a click action triggered by the user in a non-control display area of the live notification, or the second action could be a swipe action triggered by the user on the capsule-style live notification.
[0144] When an electronic device displays a capsule-style live notification, in response to a sixth action triggered by the user in the live notification, the electronic device can switch to displaying the immersive live content corresponding to the first task. For example, the sixth action can be a click action triggered by the user on the first control, or a long press action triggered by the user in the non-control display area of the live notification. The first control can be the application icon or image of the first application in the capsule-style live notification.
[0145] When an electronic device displays a card-style live notification, in response to a seventh action triggered by the user in the live notification, the electronic device can switch to displaying an immersive live feed. For example, the seventh action can be a click or long press triggered by the user in a non-control display area of the live notification, or the seventh action can be a click triggered by the user on a second control. The second control can be the application icon or image of the first application in the card-style live notification.
[0146] When an electronic device displays a card-style live notification, in response to an eighth action triggered by the user in that live notification, the electronic device can switch to displaying a capsule-style live notification, such as a swipe-down action triggered by the user in that live notification.
[0147] Taking the live notification and immersive live notification shown in Figure 9 as examples, for instance, when the electronic device displays a capsule-style live notification of a ride-hailing app as shown in Figure 9(a), if the user clicks on any location in the area other than the app icon in the live notification or triggers an up swipe operation in the live notification, the electronic device will switch to displaying a card-style live notification of a ride-hailing app as shown in Figure 9(b); if the user clicks on the app icon in the live notification or long-presses the app icon, the electronic device will switch to displaying an immersive live notification as shown in Figure 9(c).
[0148] For example, when an electronic device displays a card-style live notification as shown in Figure 9(b), if the user clicks the application icon in the card-style live notification or clicks or long-presses any position in the non-control display area of the live notification, the electronic device switches to displaying an immersive live feed of a ride-hailing application as shown in Figure 9(c); if the user triggers a swipe-down operation in the live notification, the electronic device switches to displaying a capsule-style live notification as shown in Figure 9(a).
[0149] For example, when the electronic device displays the immersive live stream shown in Figure 9(c), if the user clicks any location outside the control display area in the immersive live stream, the electronic device triggers an unlock operation and displays the user interface of the ride-hailing application after successful unlocking; if the user clicks any area outside the first window in the lock screen interface, or if the user triggers a left swipe, right swipe, or up swipe operation in the first window, the electronic device switches to displaying a card-style live stream notification as shown in Figure 9(b); if the user triggers a swipe-down operation in the first window, the electronic device switches to displaying a capsule-style live stream notification as shown in Figure 9(a).
[0150] It should be noted that the above embodiments of user-triggered electronic device switching of live notification style and switching between immersive live and live notification are only examples and not limitations. In specific implementations, electronic devices may also support other user operations to switch between various styles of live notification and immersive live. This application embodiment does not limit this.
[0151] In some embodiments, when an electronic device displays a lock screen, multiple live notifications may exist. When the electronic device displays a capsule-shaped live notification, it can display one of the multiple live notifications. Assuming the electronic device has a first live notification and a second live notification, when the user triggers a fifth operation on the capsule-shaped first live notification, the electronic device switches to displaying the immersive live stream corresponding to the first live notification, and displays the capsule-shaped second live notification in the area used to display the capsule-shaped live notification. The fifth operation can be, for example, a swipe-up operation triggered by the user in the first live notification. It should be noted that when multiple live notifications exist, the capsule-shaped live notification displayed on the lock screen can be the highest priority live notification, or the live notification received latest, or it can be determined from multiple live notifications in other ways. This application embodiment does not limit this.
[0152] For example, Figure 10 is a schematic diagram of the lock screen interface of an electronic device provided in an embodiment of this application. Referring to Figure 10(a), there are multiple live notifications in the current electronic device, including live notifications corresponding to ride-hailing tasks and live notifications corresponding to food delivery tasks. Due to the limited display area, the electronic device only displays one capsule-shaped live notification in the lock screen interface. For example, the electronic device displays live notification 1001 corresponding to ride-hailing tasks. When the user triggers an up swipe operation in live notification 1001, the electronic device switches to display the lock screen interface shown in Figure 10(b). Referring to Figure 10(b), the electronic device displays an immersive live notification 1002 corresponding to ride-hailing tasks in the lock screen interface, and displays a capsule-shaped live notification 1003 corresponding to food delivery tasks in the display area used to display capsule-shaped live notifications.
[0153] When an electronic device displays multiple card-style live notifications on the lock screen, assuming the electronic device displays a first card-style live notification and a second card-style live notification on the lock screen, the user can trigger a sixth action in the first card-style live notification. The electronic device can switch between displaying the immersive live notification corresponding to the first live notification and displaying the capsule-style second live notification. The sixth action can be, for example, a long press action triggered by the user in a non-control area of the first live notification.
[0154] For example, referring to Figure 10(c), the lock screen of the electronic device includes a live notification 1004 for a ride-hailing task and a live notification 1005 for a food delivery task. When the user triggers a long press operation in any area of the live notification 1005 other than the icon, the electronic device can switch to display the lock screen shown in Figure 10(d). Referring to Figure 10(d), the electronic device displays an immersive live notification 1006 for the food delivery task in the lock screen, and displays a capsule-style live notification 1007 for the ride-hailing task in the display area used to display capsule-style live notifications.
[0155] In some examples of this application, the lock screen state of the electronic device also includes an Always-On Display (AOD) scenario. The lock screen display method provided in the embodiments of this application can also be applied to displaying immersive live content in the AOD interface. The AOD scenario can also be called an always-on display scenario. In the AOD scenario, the electronic device can display the AOD interface, which can also be called the always-on interface. In an optional embodiment, when the electronic device displays the first content of the first application in the first window of the lock screen interface, if the electronic device enters the AOD display state, the lock screen function module of the electronic device can send the lock screen interface information to the AOD module. The lock screen interface information may include the lock screen background, lock screen elements, and immersive live content information. The AOD module can display immersive live content in the AOD interface based on the received lock screen interface information. The display effect of the AOD interface can be seen in the above embodiments of the effect of displaying immersive live content in the lock screen interface, such as the display effect of displaying immersive live content in the lock screen interface shown in Figure 8.
[0156] In another optional implementation, when the electronic device is in AOD display state, the AOD module in the electronic device can receive the first information of the first application sent by the system server through the immersive cloud service agent. The AOD module can create a second window in the AOD interface according to the first information of the first application and display the first content of the first application in the second window, thereby realizing the display of immersive live in the AOD interface. In this implementation, the functions performed by the AOD module can refer to the functions performed by the immersive service module and the lock screen function module in the above embodiments, and the repeated parts will not be described again.
[0157] Optionally, when the electronic device is in AOD display mode, the electronic device only displays the layer where the AOD interface is located on the screen. When the electronic device displays immersive live content in the first window of the AOD interface, the first window is also located in the layer where the AOD interface is located.
[0158] The lock screen display method provided in this application will be further described below with two examples.
[0159] Example 1
[0160] This example uses an image as the first content of the first application displayed in the first window of the lock screen interface on an electronic device. Figure 11 is a schematic diagram of an immersive live stream where the first content is an image, provided by an embodiment of this application. Referring to Figure 11, when the business type of the first application is a business type with a low update frequency, such as travel information, sports scores, package pickup information, meeting notifications, or ticket information, the immersive live stream displayed in the first window of the first application can be an image.
[0161] Figure 12 is a schematic diagram of a lock screen display method provided in an embodiment of this application. Referring to Figure 12, this example uses an image as an example of the first content of the first application displayed in the first window of the lock screen interface on an electronic device. Referring to Figure 12, in this embodiment of the application, the desktop of the electronic device can display a lock screen interface when the screen is locked. The lock screen interface includes lock screen elements and a lock screen background. Lock screen elements can be, for example, a clock control, a calendar control, etc. The lock screen interface may also include a first window, which is used to display the immersive live feed of the application. Optionally, the lock screen interface may also include live notifications of the application. The live feed management module of the electronic device can be used to manage the live notifications and immersive live feeds displayed on the lock screen interface. In this example, the live feed management module can be a sub-module of the lock screen function module in the electronic device shown in Figure 2, and the immersive service module can be the Advanced Notification Service (ANS) module in the operating system.
[0162] In the example shown in Figure 12(a), when the electronic device enters the lock screen state, the first application calls the immersive service interface to send business image information to the immersive service module. The first application belongs to the target application set capable of immersive live display, and the business type corresponding to the business image is an authorized business type for the first application. The immersive service module performs risk detection on the business image. After passing the risk detection, the immersive service module sends the business image information of the first application to the immersive live management module of the system user interface (system UI). The immersive live management module can then display the business image of the first application in the first window of the lock screen interface.
[0163] In the example shown in Figure 12(b), when the electronic device enters the lock screen state, the first application sends a request message to the application server. This request message requests the application server to generate an immersive live stream corresponding to the first service currently running in the first application. The system server's push service receives the service image information of the first application sent by the application server. The first application belongs to the target application set capable of immersive live stream display, and the service type corresponding to the service image is the authorized service type of the first application. The push service can perform risk detection on the service image. After the risk detection is passed, the push service can send the service image information of the first application to the immersive service module of the electronic device through the immersive cloud service proxy. The immersive service module then sends the service image information of the first application to the immersive live stream management module, which can display the service image of the first application in the first window of the lock screen interface.
[0164] It should be noted that the information sent by the push service or the first application to the immersive service module for the business image can be either the business image itself or the unified resource locator (URL) of the business image on the local device. Once the system UI obtains the image URL, it can retrieve the image from the resource library.
[0165] Example 2
[0166] This example uses the first content of the first application displayed in the first window of the lock screen interface of an electronic device as the user interface. Figure 13 is a schematic diagram of an immersive live stream where the first content is the user interface, provided by an embodiment of this application. Referring to Figure 13, when the business type of the first application is a business type with a high update frequency, such as map navigation, delivery information, sports and health, or ride-hailing, the immersive live stream displayed in the first window of the first application can be the user interface.
[0167] Figure 14 is a schematic diagram of a lock screen display method provided in an embodiment of this application. Referring to Figure 14, this example takes the first content of the first application displayed in the first window of the lock screen interface of the electronic device as the user interface. Referring to Figure 14, in this embodiment of the application, the desktop of the electronic device can display a lock screen interface in the lock screen state. For example, the lock screen interface includes lock screen elements and a lock screen background. The lock screen elements can be, for example, a clock control, a calendar control, etc. The lock screen interface may also include a first window, which is used to display the immersive live stream of the application. Optionally, the lock screen interface may also include live notifications of the application. The live stream management module of the electronic device can be used to manage the live notifications and immersive live streams displayed in the lock screen interface. In the example shown in Figure 14, the first window in the lock screen interface can be an extended component used to display the application interface. The live stream management module can manage the position, size, and other parameters of the extended component. In this example, the live stream management module can be a sub-module of the lock screen function module in the electronic device shown in Figure 2, and the immersive service module can be the ANS module in the operating system.
[0168] Referring to Figure 14, when the electronic device enters the lock screen state, the first application can request the immersive service module to create a first window for displaying the immersive live stream. This first window can be an extension component in the lock screen interface. The immersive service module can send a request message to the live stream management module to request the live stream management module to create the first window in the lock screen interface. After the live stream management module creates the first window in the lock screen interface, it can send a request message to the first application. This request message includes parameters of the first window, such as its position and size. Based on the parameters of the first window, the first application draws the user interface corresponding to the first service and then sends the user interface of the first service to the extension component in the lock screen interface through the system UI. The extension component in the lock screen interface can display the user interface of the first application, thereby realizing the display of the user interface of the first application in the first window of the lock screen interface.
[0169] Based on the same concept, this application also provides a lock screen display method, which can be executed by an electronic device. Figure 15 is a flowchart of a lock screen display method provided by this application. Referring to Figure 15, the method includes the following steps:
[0170] S1501: The electronic device enters the screen lock state, and the first service in the first application of the electronic device is running. The first application in the electronic device sends the first information of the first application to the first service module through the first service interface.
[0171] The first information includes multimedia content or user interface information related to the first service, the first service interface can be the immersive service interface in the electronic device shown in Figure 2, and the first service module can be the immersive service module in the electronic device shown in Figure 2.
[0172] S1502: The first service module in the electronic device sends the first information to the screen lock function module.
[0173] S1503: After receiving the first information, the lock screen function module in the electronic device creates the first window in the lock screen interface.
[0174] The first window created by the lock screen function module in the lock screen interface can be a non-full-screen window, such as the first window 701 or the first window 702 in the embodiment shown in Figure 7.
[0175] S1504: The screen lock module in the electronic device displays the first content of the first application in the first window based on the first information.
[0176] In this embodiment, the first content displayed in the first window by the lock screen function module according to the first information can be the immersive live broadcast described in the above embodiment. The first content of the first application can be multimedia content or user interface. For example, the first content in the first window of the lock screen interface shown in Figure 7(a) is an image; the first content in the first window of the lock screen interface shown in Figure 7(b) is a user interface.
[0177] In one optional implementation, before the first application in the electronic device sends its first information to the first server module through the first service interface, the first application in the electronic device sends a first request message to the system server. This first request message requests the system server for lock screen display permission for the first service of the first application. The first application in the electronic device receives a response message from the system server, which instructs the system server to approve the permission request from the first application. The lock screen display permission includes immersive live view permission.
[0178] In an optional implementation, the electronic device further includes a service proxy module. The first service module in the electronic device receives second information sent by the server through the service proxy module, the second information including multimedia content related to the first service. The first service module in the electronic device sends the second information to the lock screen function module. The lock screen function module in the electronic device displays the second content of the first application in the first window according to the second information. The service proxy module can be an immersive cloud service proxy as shown in Figure 2.
[0179] In one optional implementation, before the first service module in the electronic device sends the first information to the lock screen function module, the first service module in the electronic device performs risk detection on the first information, and only sends the first information to the lock screen function module after determining that the risk detection of the first information has passed.
[0180] In one optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, in response to a first operation triggered by the user in the first window, the electronic device switches to an unlocked state, runs the first application, and displays the user interface of the first task; wherein, the first operation is a click operation triggered by the user in the first window. For example, the first operation can be a click operation triggered by the user in a non-control display area of the first window.
[0181] In an optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: in response to a second operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a card-style live notification corresponding to the first task in the lock screen interface; wherein, the second operation is a click operation triggered by the user at any position in the area outside the first window in the lock screen interface, or the second operation is a swipe operation triggered by the user in the first window. For example, the second operation can be a click operation triggered by the user at any position in the area outside the first window in the lock screen interface, or the second operation can be a side swipe or an up swipe operation triggered by the user in the first window, wherein the side swipe operation includes a left swipe operation and a right swipe operation.
[0182] In one optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, in response to a third operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a capsule-shaped live notification corresponding to the first task in the lock screen interface; wherein, the third operation is a swipe operation triggered by the user in the first window. For example, the third operation can be a swipe-down operation triggered by the user in the first window.
[0183] In one optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, in response to a fourth operation triggered by the user in the first window, the lock screen function module of the electronic device displays the third content of the first application in the first window; wherein, the fourth operation is a swipe operation triggered by the user in the first window, and the third content is sent to the lock screen function module by the first application after updating the first content according to parameters related to the fourth operation.
[0184] In one optional implementation, the screen lock function module of the electronic device determines that the permission information of the first application includes a first permission before displaying the third content of the first application in the first window. The first permission is used to indicate that the responsive swipe operation is supported when displaying the content corresponding to the first task in the screen lock interface.
[0185] In an optional embodiment, the electronic device further includes an always-on display module. After the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, when the electronic device enters the always-on display state, the lock screen function module in the electronic device sends information about the lock screen interface to the always-on display module. The information about the lock screen interface includes information about the first content of the first application displayed in the first window. The always-on display module of the electronic device displays the first content of the first application in a second window of the always-on display interface according to the information about the lock screen interface. The always-on display module can be the AOD module in the electronic device shown in Figure 2.
[0186] In an optional implementation, the electronic device further includes an always-on display module. After the screen lock function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: when the electronic device enters the always-on display state, the always-on display module in the electronic device receives the first information sent by the system server through the service proxy module; the always-on display module in the electronic device displays the first content of the first application in a second window of the always-on display interface according to the first information.
[0187] For example, when the service type of the first business is travel information, sports scores, meeting notifications, ticket information, or package pickup information, the first content is multimedia content, as shown in the lock screen interface of Figure 11. When the service type of the first application is a service type with a low update frequency, such as travel information, sports scores, package pickup information, meeting notifications, or ticket information, the immersive live feed displayed in the first window of the first application can be an image. When the service type of the first business is map navigation, delivery information, sports and health, or ride-hailing, the first content is a user interface. As shown in the lock screen interface of Figure 13, when the service type of the first application is a service type with a high update frequency, such as map navigation, delivery information, sports and health, or ride-hailing, the immersive live feed displayed in the first window of the first application can be a user interface.
[0188] For example, when the first content is a user interface, the first content includes at least one of text controls, icon controls, and multimedia controls. Referring to Figure 9(c), when the first content is a user interface, the first content includes text controls such as "Picking up, expected to arrive in 5 minutes" and "License plate number XXXXX white sedan". The first content may also include icon controls such as user avatars, and may also include map image controls.
[0189] Based on the above embodiments, this application also provides a server, including multiple functional modules; the multiple functional modules interact to implement the functions performed by the system server or application server in the various methods described in the embodiments of this application. For example, executing S503c by the application server in the embodiment shown in FIG5, or executing S503d by the system server in the embodiment shown in FIG5. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0190] Based on the above embodiments, this application also provides a server, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the server is running, the at least one processor performs the functions performed by the server in the various methods described in the embodiments of this application. For example, executing S503c by the application server in the embodiment shown in FIG5, or, for example, executing S503d by the system server in the embodiment shown in FIG5.
[0191] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules. These multiple functional modules interact to implement the functions performed by the electronic device in the methods described in the embodiments of this application. For example, the electronic device may include the immersive service interface, immersive service module, immersive cloud service proxy, and screen lock module shown in FIG5. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and can be arbitrarily combined or divided based on specific implementations.
[0192] Based on the above embodiments, this application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor performs the functions performed by the electronic device in the various methods described in the embodiments of this application.
[0193] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to execute the methods described in the embodiments of this application.
[0194] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.
[0195] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.
[0196] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.
[0197] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0198] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.
[0199] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.
[0200] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.
[0201] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of protection of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A lock screen display method, characterized in that, Applied to an electronic device, the electronic device including a first service module, a first service interface, and a screen lock function module, the method includes: The electronic device enters a locked screen state, and the first service in the first application of the electronic device is running. The first application in the electronic device sends the first information of the first application to the first service module through the first service interface. The first information includes multimedia content or user interface information related to the first service. The first service module in the electronic device sends the first information to the screen lock function module; After receiving the first information, the screen lock module in the electronic device creates a first window on the screen lock interface; The screen lock module in the electronic device displays the first content of the first application in the first window based on the first information.
2. The method as described in claim 1, characterized in that, Before the first application in the electronic device sends the first information of the first application to the first server module through the first service interface, the method further includes: The first application in the electronic device sends a first request message to the system server. The first request message is used to request the lock screen display permission of the first service of the first application from the system server. The first application in the electronic device receives a response message sent by the system server, the response message being used to instruct the system server to grant the first application permission.
3. The method as described in claim 1 or 2, characterized in that, The electronic device further includes a service proxy module, and the method further includes: The first service module in the electronic device receives second information sent by the server through the service proxy module, the second information including multimedia content related to the first service; The first service module in the electronic device sends the second information to the screen lock function module; The screen lock module in the electronic device displays the second content of the first application in the first window based on the second information.
4. The method according to any one of claims 1-3, characterized in that, Before the first service module in the electronic device sends the first information to the lock screen function module, the method further includes: The first service module in the electronic device performs risk detection on the first information and determines that the risk detection of the first information has passed.
5. The method according to any one of claims 1-4, characterized in that, After the screen lock module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: In response to a first operation triggered by the user in the first window, the electronic device switches to an unlocked state, runs the first application, and displays the user interface of the first task; The first operation is a click operation triggered by the user in the first window.
6. The method according to any one of claims 1-4, characterized in that, After the screen lock module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: In response to a second operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; The screen lock function module of the electronic device displays a real-time notification in the form of a card corresponding to the first task on the screen lock interface. The second operation is either a click operation triggered by the user at any location in the lock screen interface other than the first window, or a swipe operation triggered by the user in the first window.
7. The method according to any one of claims 1-4, characterized in that, After the screen lock module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: In response to a third operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; The screen lock function module of the electronic device displays a capsule-shaped real-time notification corresponding to the first task on the screen lock interface; The third operation is a swipe operation triggered by the user in the first window.
8. The method according to any one of claims 1-4, characterized in that, After the screen lock module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: In response to a fourth operation triggered by the user in the first window, the lock screen module of the electronic device displays the third content of the first application in the first window; The fourth operation is a swipe operation triggered by the user in the first window, and the third content is the content updated by the first application based on the parameters related to the fourth operation and then sent to the lock screen function module.
9. The method as described in claim 8, characterized in that, Before the screen lock module of the electronic device displays the third content of the first application in the first window, the method further includes: The screen lock function module of the electronic device determines that the permission information of the first application includes a first permission, which is used to indicate that the content corresponding to the first task is displayed on the screen lock interface and the swipe operation is supported.
10. The method according to any one of claims 1-9, characterized in that, The electronic device further includes an always-on display module. After the screen lock module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: When the electronic device enters the always-on display state, the screen lock function module in the electronic device sends the information of the screen lock interface to the always-on display module. The information of the screen lock interface includes the information of the first content of the first application displayed in the first window. The always-on display module of the electronic device displays the first content of the first application in the second window of the always-on display interface based on the information of the lock screen interface.
11. The method according to any one of claims 1-9, characterized in that, The electronic device further includes an always-on display module. After the screen lock module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: When the electronic device enters the always-on display state, the always-on display module in the electronic device receives the first information sent by the system server through the service proxy module; The always-on display module in the electronic device displays the first content of the first application in the second window of the always-on display interface according to the first information.
12. The method according to any one of claims 1-11, characterized in that, When the service type of the first service is travel information, event scores, meeting notifications, ticket information, or package pickup information, the first content is multimedia content; The first service's business type is map navigation, delivery information, sports and health, and ride-hailing, and the first content is the user interface.
13. The method according to any one of claims 1-12, characterized in that, When the first content is a user interface, the first content includes at least one of text controls, icon controls, and multimedia controls.
14. An electronic device, characterized in that, The electronic device includes a memory and a processor; wherein the memory and the processor are coupled, the memory is used to store a computer program, and when the processor executes the computer program, the electronic device performs the method of any one of claims 1-13.
15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1-13.
16. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-13.
Citation Information
Patent Citations
Mobile terminal screen lock interface display method, device and mobile terminal
CN102393807A
Method and device for displaying information on screen locking interface
CN104615350A
Screen-locking interface display method, apparatus and electronic device
CN105243326A
Method and apparatus for displaying related information of taxi-taking application in screen-locking state
CN105975224A
Card display method and electronic equipment
CN118200432A