Screen locking display method and electronic device
By introducing immersive service modules and lock screen function modules into electronic devices, the shortcomings of displaying application-related content on the lock screen interface are addressed, enabling a rich user interaction experience and diversified display in the lock screen state, thereby improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2024-06-20
- Publication Date
- 2026-05-05
AI Technical Summary
In existing technologies, the user interaction scenarios of electronic devices are limited when the screen is locked, and the lock screen interface cannot be effectively used to provide more application-related content display, which affects the user experience.
By introducing immersive service modules and lock screen function modules into electronic devices, application-related content, including multimedia content and user interfaces, can be displayed on the lock screen interface. This supports permission requests, risk detection, and diverse display style switching, thereby enhancing the user interaction experience.
It enriches the display scenarios of electronic devices, allowing users to view application content even when the screen is locked, improving user experience and interactivity, and supporting diverse display styles and content display in the screen-off state.
Smart Images

Figure CN120144217B_ABST
Abstract
Description
[0001] This application is a divisional application. The original application has the application number 202410805027.1 and the original application date is June 20, 2024. The entire contents of the original application are incorporated herein by reference. Technical Field
[0002] This application relates to the field of terminal technology, and in particular to a lock screen display method and electronic device. Background Technology
[0003] With the development of terminal technology, electronic devices such as mobile phones and tablets have been widely used in users' daily work and life. Electronic devices can provide users with richer functions. Users can experience the functions and services provided by various applications installed on their electronic devices. The scenarios in which users use electronic devices are no longer limited to displaying the main interface and application interface when the screen is on. For example, electronic devices can display notification messages on the lock screen to remind users to check relevant information in a timely manner. How to provide users with more interactive experiences in more scenarios has become one of the issues of great concern in the terminal field. Summary of the Invention
[0004] This application provides a lock screen display method and an electronic device, which provide a solution for displaying application-related content in the lock screen interface.
[0005] Firstly, this application provides a lock screen display method, which can be executed by an electronic device. The electronic device includes a first service module, a first service interface, and a lock screen function module. The method includes: the electronic device entering a lock screen state, and a first service in a first application of the electronic device being in a running state; the first application in the electronic device sending first information of the first application to the first service module through the first service interface, the first information including multimedia content or user interface information related to the first service; the first service module in the electronic device sending the first information to the lock screen function module; after receiving the first information, the lock screen function module in the electronic device creating a first window in the lock screen interface; and the lock screen function module in the electronic device displaying the first content of the first application in the first window according to the first information.
[0006] In the above method, the electronic device can provide the application with the function of displaying application content on the lock screen interface. The first application in the electronic device can send the first information of the first application to the first service module through the first service interface provided by the electronic device. After the first service module sends the first information to the lock screen function module, the lock screen function module can display the first content of the first application in the first window of the lock screen interface. Thus, even after the electronic device enters the lock screen state, the user can still view the display content provided by the running application on the lock screen interface, enriching the display scenarios of the electronic device and improving the user experience.
[0007] In one possible design, before the first application in the electronic device sends its first information to the first server module through the first service interface, the method further includes: the first application in the electronic device sending a first request message to the system server, the first request message being used to request screen lock display permission for the first service of the first application from the system server; the first application in the electronic device receiving a response message sent by the system server, the response message being used to instruct the system server to approve the permission request of the first application. With this design, when the first application in the electronic device has a screen lock display requirement, it can request screen lock display permission from the system server. After the system server approves the permission request, the first content of the first application is displayed on the lock screen interface, thereby achieving control over the first application and ensuring the controllability of the content displayed on the lock screen interface of the electronic device.
[0008] In one possible design, the electronic device further includes a service proxy module, and the method further includes: the first service module in the electronic device receiving second information sent by the server through the service proxy module, the second information including multimedia content related to the first service; the first service module in the electronic device sending the second information to the lock screen function module; and the lock screen function module in the electronic device displaying the second content of the first application in the first window according to the second information. Through this design, the electronic device can also provide a service proxy module, allowing the first service module to receive information about the first application sent by the server through the service proxy module, enabling the server to push the content of the first application displayed on the lock screen interface to the electronic device, thus saving the computing power of the electronic device.
[0009] In one possible design, before the first service module in the electronic device sends the first information to the lock screen function module, the method further includes: the first service module in the electronic device performing a risk detection on the first information and determining that the risk detection of the first information passes. This design ensures that the electronic device can control the content displayed on the lock screen interface, preventing advertisements and other content from affecting the user experience.
[0010] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: in response to a first operation triggered by the user in the first window, the electronic device switches to an unlocked state, runs the first application, and displays the user interface of the first task; wherein, the first operation is a click operation triggered by the user in the first window. With this design, when the electronic device displays the first content of the first task on the lock screen, the user can trigger the electronic device to run the first application and display its user interface. Thus, the electronic device can directly continue displaying the user interface of the first application in the unlocked state without requiring the user to manually launch the first application to continue viewing its content, improving the user experience.
[0011] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: in response to a second operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a card-style live notification corresponding to the first task in the lock screen interface; wherein, the second operation is a click operation triggered by the user at any location in the area other than the first window in the lock screen interface, or the second operation is a swipe operation triggered by the user in the first window.
[0012] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: in response to a third operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a capsule-style live notification corresponding to the first task in the lock screen interface; wherein, the third operation is a swipe operation triggered by the user in the first window.
[0013] With the above design, when the electronic device displays the first content of the first application in the first window, the user triggers an operation to switch between displaying a card-style or capsule-style live notification corresponding to the first task. This allows the user to switch between various styles of live notifications and immersive live content supported by the electronic device, meeting the different needs of the user in different display scenarios.
[0014] In one possible design, after the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: in response to a fourth operation triggered by the user in the first window, the lock screen function module of the electronic device displays a third content of the first application in the first window; wherein the fourth operation is a swipe operation triggered by the user in the first window, and the third content is sent to the lock screen function module by the first application after updating the first content according to parameters related to the fourth operation. With this design, the user can trigger a swipe operation in the first window to adjust the content displayed in the first window. For example, when the first content is a document, a long interface, etc., the user can swipe in the first window to view more content.
[0015] In one possible design, before the lock screen function module of the electronic device displays the third content of the first application in the first window, the method further includes: the lock screen function module of the electronic device determining that the permission information of the first application includes a first permission, the first permission being used to indicate that responsive swipe operations are supported when displaying the content corresponding to the first task in the lock screen interface.
[0016] In one possible design, the electronic device further includes an always-on display module. After the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: when the electronic device enters the always-on display state, the lock screen function module in the electronic device sends information about the lock screen interface to the always-on display module, the information about the lock screen interface including information about the first content of the first application displayed in the first window; the always-on display module of the electronic device displays the first content of the first application in a second window of the always-on display interface based on the information about the lock screen interface. Through this design, the lock screen function module in the electronic device can also send information about the lock screen interface to the always-on display module, so that the always-on display module can display the first content of the first application in the always-on display interface, further enriching the display scenarios of application content and improving the user experience.
[0017] In one possible design, the electronic device further includes an always-on display module. After the screen lock module in the electronic device displays the first content of the first application in the first window based on the first information, the method further includes: when the electronic device enters the always-on display state, the always-on display module in the electronic device receives the first information sent by the system server through the service proxy module; the always-on display module in the electronic device displays the first content of the first application in a second window of the always-on display interface based on the first information. With this design, when the electronic device is in the always-on display state, the always-on display module can receive the first information of the first application sent by the server through the service proxy module, and the always-on display module can display the first content of the first application in the second window of the always-on display interface, thereby providing a display scheme for displaying application content in the always-on display state, meeting the user's need to understand application information when the electronic device is in the always-on display state.
[0018] In one possible design, when the service type of the first service is travel information, sports scores, meeting notifications, ticket information, or package pickup information, the first content is multimedia content; when the service type of the first service is map navigation, delivery information, sports and health, or ride-hailing, the first content is a user interface.
[0019] In one possible design, when the first content is a user interface, the first content includes at least one of text controls, icon controls, and multimedia controls.
[0020] Secondly, this application provides a lock screen display method, which can be executed by an electronic device. The electronic device includes a first service module, a service proxy module, and a lock screen function module. The method includes: the electronic device entering a lock screen state, and a first service in a first application of the electronic device being in a running state; the first service module in the electronic device receiving second information sent by a server through the service proxy module, the second information including multimedia content related to the first service; the first service module in the electronic device sending the second information to the lock screen function module; and the lock screen function module in the electronic device displaying the second content of the first application in a first window according to the second information.
[0021] Thirdly, this application provides an electronic device comprising multiple functional modules; the multiple functional modules interact to implement the methods performed by the electronic device in the first aspect and its various embodiments described above. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0022] Fourthly, this application provides an electronic device including at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the methods executed by the electronic device in the first aspect and its various embodiments described above.
[0023] Fifthly, this application also provides a computer program product containing instructions that, when the computer program product is run on a computer, cause the computer to perform the method executed by the server or electronic device in any of the above aspects and their embodiments.
[0024] Sixthly, this application also provides a computer-readable storage medium storing a computer program that, when executed by a computer, causes the computer to perform the method executed by the server or electronic device in any of the above aspects and embodiments.
[0025] In a seventh aspect, this application also provides a chip for reading a computer program stored in a memory and executing the method performed by a server or electronic device in any of the above aspects and their embodiments.
[0026] Eighthly, this application also provides a chip system including a processor for supporting a computer device in implementing the methods performed by a server or electronic device in any of the above aspects and their embodiments. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be composed of chips or may include chips and other discrete devices.
[0027] The technical effects that can be achieved by any of the technical solutions in the second to eighth aspects mentioned above can be described with reference to the technical effects that can be achieved by the technical solution in the first aspect mentioned above, and the repeated parts will not be repeated. Attached Figure Description
[0028] Figure 1 A schematic diagram illustrating the display of notification messages on the lock screen of an electronic device, as provided in an embodiment of this application;
[0029] Figure 2 This is a schematic diagram illustrating an application scenario for a lock screen display method provided in this application embodiment;
[0030] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0031] Figure 4 A software structure block diagram of an electronic device provided in an embodiment of this application;
[0032] Figure 5 A schematic diagram illustrating a lock screen display method provided in an embodiment of this application;
[0033] Figure 6 A schematic diagram illustrating the layer positional relationship provided in an embodiment of this application;
[0034] Figure 7 A schematic diagram illustrating an electronic device displaying an immersive live stream, provided as an embodiment of this application;
[0035] Figure 8 A flowchart illustrating an immersive, live-action user interaction process provided in this application embodiment;
[0036] Figure 9 A schematic diagram of a lock screen interface of an electronic device provided in an embodiment of this application;
[0037] Figure 10 A schematic diagram of a lock screen interface of an electronic device provided in an embodiment of this application;
[0038] Figure 11 A schematic diagram of an immersive live-action experience where the first content is an image, provided as an embodiment of this application;
[0039] Figure 12 A schematic diagram illustrating a lock screen display method provided in an embodiment of this application;
[0040] Figure 13 A schematic diagram of an immersive live stream whose first content is a user interface, provided for an embodiment of this application;
[0041] Figure 14 A schematic diagram illustrating a lock screen display method provided in an embodiment of this application;
[0042] Figure 15 This is a flowchart of a lock screen display method provided in an embodiment of this application. Detailed Implementation
[0043] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.
[0044] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.
[0045] With the development of terminal technology, electronic devices offer users increasingly diverse display methods and interactive scenarios. For example, electronic devices are no longer limited to displaying content only when the screen is unlocked and on. Even when locked, electronic devices can display notifications on the lock screen or in an always-on display (AOD) interface. This ability to display notifications on the lock screen ensures that users are promptly informed of pending notifications even when the device is locked, and most of these notifications are passively received. For example… Figure 1 This is a schematic diagram illustrating the display of notification messages on the lock screen of an electronic device, as provided in an embodiment of this application. (Refer to...) Figure 1 Electronic devices can display "Information" application reminder messages 101, social application notification messages 102, etc. on the lock screen.
[0046] It is evident that the content that users can view and the actions they can trigger on notification messages displayed in the lock screen state are limited. Based on this, how to provide users with more interactive experiences in various scenarios has become one of the issues of great concern in the terminal industry.
[0047] To address the aforementioned problems, this application provides a lock screen display method, which offers a solution for displaying application-related content on the lock screen interface. For example... Figure 2 This is a schematic diagram illustrating an application scenario for a lock screen display method provided in this application embodiment. (Refer to...) Figure 2 This application scenario includes electronic devices and system servers; optionally, it also includes application servers. In this embodiment, displaying application content on the lock screen of an electronic device can be described as displaying "immersive live content," such as... Figure 2As shown, the electronic device includes an immersive service module. This module provides an immersive service interface for applications installed on the device; this interface can also be called an immersive service kit, which can be a software development kit (SDK) installed on the device. The immersive service module can receive application content sent by applications through the immersive service interface and interact with the lock screen module in the electronic device, thereby displaying the application content in the first window of the lock screen interface. Optionally, as... Figure 2 The electronic device may also include an immersive cloud service agent module, which can also be called a push agent. This agent is used to receive application content pushed by the system server. The immersive cloud service agent can send the received application content to the immersive service module. The immersive service module interacts with the lock screen function module to display the application content pushed by the system server received by the electronic device in the first window of the lock screen interface.
[0048] Figure 2 The system server in the illustrated scenario can provide immersive cloud service functionality for electronic devices. This provides cloud service interfaces to applications installed on the electronic devices and their application servers, enabling applications to obtain permission to display immersive live content on the electronic devices. Furthermore, the immersive cloud service can also perform risk detection on the application content within the immersive live content. Optionally, in this embodiment of the application... Figure 2 The system server shown can also be a push server used to push messages to electronic devices.
[0049] Figure 2 The application server in the scenario shown is used to provide cloud services for applications installed on electronic devices. In this implementation, the application server can send application content to the electronic device through the system server so that the electronic device can display the received application content in the first window of the lock screen interface.
[0050] Optionally, in some embodiments, the functions of the system server can be implemented by a cluster of computing devices including at least one computing device, wherein at least one computing device in the cluster of computing devices can be used to provide immersive cloud service functions. Alternatively, in other embodiments, the immersive cloud service functions can also be implemented by at least one computing device independent of the system server. This application does not limit this aspect.
[0051] based on Figure 2In the application scenario shown, an electronic device can request registration from the system server to display a first application for immersive live streaming and at least one corresponding business type. After authorization by the system server, when the electronic device enters a lock screen state, the device determines that the first business within the first application is running. The business type of the first business is the authorized business type corresponding to the first application. The lock screen function module in the electronic device can create a first window on the lock screen interface and display the first content of the first application in the first window. Optionally, the first content of the first application can be multimedia content provided by the first application or the user interface of the first application. The first content of the first application is determined by the lock screen function module based on the first information of the first application. The first information can be sent by the first application in the electronic device to the immersive service module through the immersive service interface, or the first information of the first application can be sent by the application server to the system server, and then sent by the system server to the immersive service module in the electronic device through the immersive cloud service proxy. Through this solution, the electronic device can provide the function of displaying application content on the lock screen interface, so that even after the user triggers the lock screen, the display content provided by the running application can still be viewed on the lock screen interface, enriching the display scenarios of the electronic device and improving the user experience.
[0052] Optionally, refer to Figure 2 The electronic device may also include an AOD (Away From Door) module, which can receive lock screen interface information sent by the lock screen function module, thereby displaying the content displayed on the lock screen interface in the AOD interface when the electronic device is in AOD display state. In this embodiment, after the electronic device enters the AOD display state, the AOD module can receive lock screen interface information sent by the lock screen function module. This lock screen interface information includes immersive live streaming information. After receiving the lock screen interface information sent by the lock screen function module, the AOD module can display the immersive live streaming in the AOD interface. In some embodiments, when the electronic device is in the AOD display state, the AOD module can also receive first information of the first application sent by the immersive cloud service in the system server through the immersive cloud service proxy. The AOD module can create a second window in the AOD interface and display first content in the second window according to the first information of the first application.
[0053] The following describes an electronic device and embodiments for using such an electronic device. The electronic device in this application embodiment can be a tablet computer, mobile phone, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), wearable device, etc. This application embodiment does not limit the specific type of electronic device.
[0054] In some embodiments of this application, the electronic device may also be a portable terminal device that includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable terminal device include, but are not limited to, devices equipped with... Or portable terminal devices with other operating systems.
[0055] Figure 3 This is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. Figure 3 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0056] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has recently used or is repeatedly used. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.
[0057] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. Charging management module 140 receives charging input from the charger. Power management module 141 connects battery 142, charging management module 140, and processor 110. Power management module 141 receives input from battery 142 and / or charging management module 140, providing power to processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.
[0058] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0059] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0060] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0061] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0062] Display screen 194 is used to display the display interface of an application, such as the display page of an application installed on electronic device 100. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0063] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0064] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of electronic device 100 (e.g., captured images, recorded videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0065] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.
[0066] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0067] The sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.
[0068] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.
[0069] Touch sensor 180C, also known as a "touch panel," can be located on display screen 194. The touch sensor 180C and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180C detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180C may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0070] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, touch operations applied to different applications (such as taking photos, audio playback, etc.) can correspond to different vibration feedback effects. Touch vibration feedback effects can also be customized. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with electronic device 100.
[0071] Understandable Figure 3The components shown do not constitute a specific limitation on the electronic device 100. The electronic device may also include more or fewer components than shown, or combine some components, or separate some components, or have different component arrangements. Furthermore, Figure 3 The combination / connection relationships between the components can also be adjusted and modified.
[0072] Figure 4 This is a software structure block diagram of an electronic device provided in an embodiment of this application. For example... Figure 4 As shown, the software architecture of an electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the kernel layer.
[0073] The application layer can include a series of application packages. For example... Figure 4 As shown, the application layer may include a camera, settings, skin modules, a user interface (UI), and third-party applications. These third-party applications may include a gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS. In this embodiment, the application layer may include an immersive service interface, through which applications installed on the electronic device can utilize the immersive live display function of the electronic device.
[0074] Notification messages displayed on electronic devices can be divided into two types: live notifications and non-live notifications. Live notifications are those with high timeliness requirements, such as notifications related to ride-hailing tasks and food delivery tasks. Non-live notifications are those with low timeliness requirements, such as notifications from social applications and system version update messages.
[0075] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer can include some predefined functions. For example... Figure 4 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, immersive service module, immersive cloud service agent, and lock screen function module.
[0076] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making this data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0077] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0078] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).
[0079] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0080] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0081] The Immersive Service Module is used to provide immersive live display functionality for applications installed on electronic devices. The Immersive Service Module can receive application content sent by applications through the Immersive Service Interface, or receive application content sent by the system server through the Immersive Cloud Service Agent, and send the application content to the Lock Screen Function Module to display the corresponding immersive live content on the lock screen interface.
[0082] The Immersive Cloud Service Proxy is used to receive application content sent by the Immersive Cloud Service from the system server.
[0083] The lock screen function module is used to draw the lock screen interface for electronic devices and manage the content and controls displayed on the lock screen interface. In this embodiment, the lock screen function module can receive application content sent by the immersive service and display the application content in the first window of the lock screen interface.
[0084] The runtime includes the core libraries and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0085] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core libraries of the operating system. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0086] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), image processing libraries, etc.
[0087] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0088] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0089] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0090] A 2D graphics engine is a graphics engine for 2D drawing.
[0091] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0092] The hardware layer can include various types of sensors, such as accelerometers, gyroscopes, and touch sensors.
[0093] It should be noted that, Figure 3 and Figure 4 The structure shown is merely an example of an electronic device provided in this application embodiment and is not intended to limit the electronic device provided in this application embodiment in any way. In specific implementations, the electronic device may have more than Figure 3 or Figure 4 The structure shown may contain more or fewer devices or modules.
[0094] The lock screen display method provided in the embodiments of this application is described below.
[0095] In the lock screen display method provided in this application embodiment, the electronic device provides an immersive live display scheme. This immersive live display refers to the application content displayed by the electronic device in the lock screen state. This application content can be, for example, multimedia content or a user interface provided by the application. Based on Figure 2 The application scenarios shown are as follows: Figure 5 This is a schematic diagram of a lock screen display method provided in an embodiment of this application, with reference to... Figure 5 The method may include the following steps:
[0096] S501: The electronic device sends a first request message to the system server.
[0097] The first request message is used to request lock screen display permissions for at least one business type of the first application from the system server, wherein the lock screen display permissions include immersive live display permissions.
[0098] Optionally, in this embodiment, the user can set whether to enable the immersive live streaming function, and the user can set the application permissions of applications installed on the electronic device to determine whether the applications can use the immersive live streaming function. Applications installed on the electronic device can also request to use the immersive live streaming function. The electronic device can apply to the system server to register the applications requesting to display immersive live streaming and at least one corresponding business type for each application. When an application supports multiple business types, when requesting to use the immersive live streaming function, the application can include at least one business type requested in the request message. For example, the business types supported by the application may include maps, food delivery, express delivery, flights, sports, etc.
[0099] In one optional implementation, when a first application in the electronic device is started or a first service within the first application is running, the first application can send a request message to the electronic device. This request message requests the electronic device to apply to the system server for immersive live-streaming permission corresponding to the first application. The electronic device can send a first request message to the system server, which may include the identifier of the first application and the identifier of the first service. In this way, immersive live-streaming permission for the first application can be requested from the system server only when the application in the electronic device has an immersive display requirement.
[0100] In another optional implementation, the electronic device can register with the system server upon power-on multiple applications capable of using the immersive live streaming function and at least one corresponding service type for each application. Alternatively, when the applications installed on the electronic device change, such as installing a new application or uninstalling an application, the electronic device can register with the system server multiple applications capable of using the immersive live streaming function and at least one corresponding service type for each application. Or, the electronic device can register with the system server multiple applications capable of using the immersive live streaming function and at least one corresponding service type for each application according to a preset period. This method ensures that the applications capable of immersive display on the electronic device are consistent with the applications registered on the system server, guaranteeing that subsequent applications can normally request and display immersive live streaming, and also ensuring security.
[0101] S502: After the system server verifies the first application, it sends a response message to the electronic device.
[0102] The response message sent by the system server to the electronic device is used to instruct the system server to grant permissions through the first application.
[0103] In some embodiments, after receiving a first request message from an electronic device, the system server verifies the first application and returns a response message to the electronic device indicating that the permission request for the first application has been approved. The server may store permission information corresponding to the electronic device, which includes a set of target applications and at least one authorized service type corresponding to each target application in the target application set. The target application set includes the identifier of at least one target application among the multiple applications installed on the electronic device that has permission to display immersive live streaming.
[0104] Optionally, the electronic device can locally store permission information corresponding to the immersive live display function. This permission information includes a set of target applications and at least one authorized service type for each target application in the set. In some scenarios, if the electronic device is not connected to the network, it can authenticate the application requesting to use the immersive live display function and store the permission information corresponding to that application. For example, the permission information corresponding to the application may include an application identifier and at least one service type corresponding to the application. When the electronic device is connected to the network, it can send the locally authenticated permission information to the system server.
[0105] S503: When the electronic device enters the lock screen state, the immersive service module in the electronic device obtains the first information of the first application.
[0106] S504: The immersive service module in the electronic device sends the first information of the first application to the lock screen function module.
[0107] In some embodiments, when the electronic device enters a locked screen state, if the first service in the first application within the electronic device is running, the electronic device can determine that the first application belongs to the target application set based on the stored permission information corresponding to the immersive live display function. That is, the electronic device determines that the first application has permission to display immersive live content, and that the first service is an authorized service type corresponding to the first application. Then, the electronic device can obtain the first information of the first application. This first information includes multimedia content or user interface information related to the first service. For example, the first information may be information about multimedia content such as images, videos, and audio sent by the first application or its corresponding application server to the immersive service module. Another example is information about the user interface related to the first task of the first application, drawn by the first application.
[0108] In an optional implementation, when the first information is multimedia content information provided by the first application, the first information of the first application can be sent by the first application to the immersive service module through the immersive service interface, or the first information of the first application can be sent by the application server to the system server, and then sent by the system server to the immersive server module through the immersive cloud service proxy in the electronic device. In this embodiment, S503 may include the following steps:
[0109] S503a: The first application sends its first information to the immersive service module through the immersive service interface.
[0110] Alternatively, S503 may include the following steps:
[0111] S503b: The first application sends a request message to the application server.
[0112] The request message sent by the first application to the application server is used to request the application server to generate an immersive live stream corresponding to the first service currently running in the first application.
[0113] S503c: The application server sends the first information of the first application to the system server.
[0114] S503d: The system server sends the first information of the first application to the immersive service module through the immersive cloud service agent of the electronic device.
[0115] After receiving the information of the first content of the first application through the above method, the immersive module in the electronic device can send the information of the first content of the first application to the lock screen function module in the electronic device to request the lock screen function module to display the immersive live broadcast on the lock screen interface.
[0116] In another optional implementation, when the first information is user interface information provided by the first application, the first application can send the first information to the immersive service module in the electronic device to request the creation of a first window for displaying the immersive live stream. This first window can be an extension component in the lock screen interface. The immersive service module can send a request message to the lock screen function module to request the lock screen function module to create the first window in the lock screen interface. After the lock screen function module creates the first window in the lock screen interface, it can send a request message to the first application. This request message includes parameters of the first window, such as the position information and size information of the first window. This request message is used to request the first information of the first application. After the first application draws the user interface corresponding to the first service based on the parameters of the first window, it can send the user interface of the first service to the lock screen function module.
[0117] In one optional implementation, after obtaining the first information of the first application, the electronic device can perform risk detection on the first information. For example, the electronic device can determine whether there are sensitive words in the text of the first information or whether the first information includes illegal content such as advertisements. After the risk detection of the first information passes, the information is displayed according to the first information, thereby ensuring that the electronic device can control the content displayed on the lock screen interface and prevent the display of advertisements and other content on the lock screen interface from affecting the user experience.
[0118] Optionally, when the above steps S503 include S503b-S503d, the risk detection step can also be performed by the system server. For example, in S503c, after receiving the first information of the first application sent by the application server, the system server can perform risk detection on the first information. After the risk detection of the first information passes, the system server then executes S503d to send the first information that has passed the risk detection to the electronic device.
[0119] S505: The lock screen function module of the electronic device displays the first content of the first application in the first window of the lock screen interface based on the first information.
[0120] Optionally, the first window can be a non-full-screen window in the lock screen interface. The electronic device can display an immersive live stream of the first application in the first window, that is, display the first content of the first application in the first window.
[0121] Optionally, in this embodiment, the first window may be located on the layer where the lock screen interface is located, for example, Figure 6 This is a schematic diagram illustrating a layer positional relationship provided in an embodiment of this application. (Reference) Figure 6 The lock screen is located on a layer above the wallpaper, desktop, and application windows, while the first window used to display immersive live content is located within the lock screen layer.
[0122] For example, Figure 7 This is a schematic diagram of an electronic device displaying an immersive live stream, provided in an embodiment of this application. (Refer to...) Figure 7 In (a), the electronic device displays flight images from a transportation application in the first window 701 of the lock screen interface; see reference. Figure 7 In (b), the electronic device displays the running user interface of the sports application in the first window 702 of the lock screen interface.
[0123] Optionally, when an electronic device displays an immersive live stream on the lock screen, if the device restarts, the immersive live stream will no longer be displayed after the restart, or other images can be used to cover the immersive live stream on the lock screen. After the user unlocks the electronic device and the device enters the lock screen state again, the electronic device can continue to display the immersive live stream, thereby ensuring user information security.
[0124] In this embodiment of the application, when the electronic device displays the first content of the first application in the first window of the lock screen interface, the user can trigger an operation in the first window. The electronic device can pass the operation triggered by the user to the first application. The first application responds to the operation triggered by the user, draws the second content, and sends the second content to the immersive service module. The immersive service module can call the lock screen function module to display the second content in the first window, thereby refreshing the content displayed in the first window.
[0125] Optionally, to reduce non-standard user interactions during immersive live streams, electronic devices can set application permissions for multiple applications. These permissions include supported user operations when displaying immersive live streams. For example, application permissions for displaying immersive live streams on an electronic device could include: supporting clicks to jump to full-screen application interfaces, supporting swipe operations, etc.
[0126] For example, suppose the electronic device is configured with app permissions that allow clicking to jump to a full-screen app interface and supporting swipe gestures when using immersive live streaming as the user interface. Figure 8 This is a schematic flowchart illustrating an immersive, live-action user interaction method as provided in an embodiment of this application. (Reference) Figure 8 When a user triggers an action in an immersive live stream, the immersive service module, the abilitymanager service (AMS), the lock screen module, and the first application in the electronic device can perform the following steps:
[0127] S801: In response to a click action triggered by the user in the first window, the immersive service module sends a request message to AMS.
[0128] The immersive service module sends a request message to AMS to request the launch of the first application.
[0129] S802: AMS sends a startup command to the first application.
[0130] S803: The first application runs and displays the user interface corresponding to the first task.
[0131] S804: In response to a swipe operation triggered by the user in the first window, the immersive service module determines that the application permissions of the first application include permissions that support swipe operations.
[0132] S805: The immersive service module sends the parameters related to the swipe operation to the first application.
[0133] S806: The first application determines the third content of the first application based on the parameters related to the sliding operation.
[0134] The third content is the content displayed after the first content has been shifted according to the distance corresponding to the sliding operation.
[0135] S807: The first application sends the third content to the lock screen function module.
[0136] S808: The lock screen function module displays third content in the first window.
[0137] In some embodiments of this application, the electronic device can also display live notifications of applications on the lock screen. These live notifications on the lock screen can have various display styles, such as capsule style, card style, etc. Some applications' services on the electronic device can be displayed on the lock screen in the form of live notifications, or they can be displayed on the lock screen in an immersive live format. For example, Figure 9 This is a schematic diagram of a lock screen interface of an electronic device provided in an embodiment of this application. Figure 9 This article will use the ride-hailing service in ride-hailing apps as an example for introduction. Figure 9 In (a), electronic devices can display real-time notifications for ride-hailing apps in a capsule-like format; see reference 901. Figure 9 In (b), the electronic device can display a card-style live notification of the ride-hailing app 902, optionally, such as Figure 9 As shown in (b), when an electronic device displays a live notification 902 from a ride-hailing app in a card-style format, it can also display the notification message on the lock screen. (See reference) Figure 9 In (c), electronic devices can display an immersive live stream of a ride-hailing app.
[0138] Optionally, the electronic device can determine whether to display live notifications or immersive live content on the lock screen based on user habits or usage scenarios. For example, when the electronic device is in working mode, to minimize disturbance to the user, the electronic device can... Figure 9The capsule-style display shown in (a) shows a live notification from the ride-hailing app.
[0139] This application embodiment also provides a method for live notification and immersive live switching for the same service in the same application. For example, for a first task running in a first application, when the electronic device displays an immersive live, in response to a first operation triggered by the user in the immersive live, the electronic device triggers unlocking. After successful unlocking, the electronic device can display the user interface of the first task in the first application. For example, the first operation can be a click operation triggered by the user in a non-control display area in the first window.
[0140] When an electronic device displays an immersive live stream, in response to a second action triggered by the user within the immersive live stream, the electronic device can switch to displaying a live stream notification in the card style corresponding to the first task. For example, the second action could be a click action triggered by the user in any location in the lock screen interface other than the first window, or the second action could be a side swipe or up swipe action triggered by the user in the first window, wherein the side swipe action includes left swipe and right swipe.
[0141] When an electronic device displays an immersive live stream, in response to a third action triggered by the user within that immersive live stream, the electronic device can switch to displaying a capsule-style live stream notification corresponding to the immersive live stream. For example, the third action could be a swipe-down action triggered by the user in the first window.
[0142] When an electronic device displays a capsule-style live notification, in response to a fifth action triggered by the user in the live notification, the electronic device can switch to displaying a card-style live notification. For example, the fifth action could be a click action triggered by the user in a non-control display area of the live notification, or the second action could be a swipe action triggered by the user on the capsule-style live notification.
[0143] When an electronic device displays a capsule-style live notification, in response to a sixth action triggered by the user in the live notification, the electronic device can switch to displaying the immersive live content corresponding to the first task. For example, the sixth action can be a click action triggered by the user on the first control, or a long press action triggered by the user in the non-control display area of the live notification. The first control can be the application icon or image of the first application in the capsule-style live notification.
[0144] When an electronic device displays a card-style live notification, in response to a seventh action triggered by the user in the live notification, the electronic device can switch to displaying an immersive live feed. For example, the seventh action can be a click or long press triggered by the user in a non-control display area of the live notification, or the seventh action can be a click triggered by the user on a second control. The second control can be the application icon or image of the first application in the card-style live notification.
[0145] When an electronic device displays a card-style live notification, in response to an eighth action triggered by the user in that live notification, the electronic device can switch to displaying a capsule-style live notification, such as a swipe-down action triggered by the user in that live notification.
[0146] by Figure 9 The live notification and immersive live experience shown are examples, such as when an electronic device displays... Figure 9 When a user taps any location in the capsule-shaped ride-hailing app notification shown in (a) above, or when the user swipes up on the notification, the electronic device switches the display. Figure 9 The card-style live notification for the ride-hailing app shown in (b) above; when the user taps the app icon in the notification or long-presses the app icon, the electronic device switches the display. Figure 9 The immersive live stream shown in (c) is shown in the image.
[0147] For example, when an electronic device displays... Figure 9 When a user clicks the app icon in the card-style live notification shown in (b), or clicks or long-presses any location outside the control display area of the live notification, the electronic device switches the display. Figure 9 (c) shows an immersive live feed from a ride-hailing app; when the user swipes down in the live notification, the electronic device switches its display. Figure 9 The capsule-style live notification shown in (a) is shown in the image.
[0148] For example, when an electronic device displays... Figure 9 When the user clicks on any area outside the control display area in the immersive live stream (as shown in (c)), the electronic device triggers an unlock operation, and after successful unlocking, displays the user interface of the ride-hailing app; when the user clicks on any area outside the first window in the lock screen, or when the user triggers a left swipe, right swipe, or up swipe operation in the first window, the electronic device switches the display. Figure 9 The live notification is in the card style shown in (b); when the user triggers a swipe down operation in the first window, the electronic device switches the display. Figure 9 The capsule-style live notification shown in (a) is shown in the image.
[0149] It should be noted that the above embodiments of user-triggered electronic device switching of live notification style and switching between immersive live and live notification are only examples and not limitations. In specific implementations, electronic devices may also support other user operations to switch between various styles of live notification and immersive live. This application embodiment does not limit this.
[0150] In some embodiments, when an electronic device displays a lock screen, multiple live notifications may exist. When the electronic device displays a capsule-shaped live notification, it can display one of the multiple live notifications. Assuming the electronic device has a first live notification and a second live notification, when the user triggers a fifth operation on the capsule-shaped first live notification, the electronic device switches to displaying the immersive live stream corresponding to the first live notification, and displays the capsule-shaped second live notification in the area used to display the capsule-shaped live notification. The fifth operation can be, for example, a swipe-up operation triggered by the user in the first live notification. It should be noted that when multiple live notifications exist, the capsule-shaped live notification displayed on the lock screen can be the highest priority live notification, or the live notification received latest, or it can be determined from multiple live notifications in other ways. This application embodiment does not limit this.
[0151] For example, Figure 10 This is a schematic diagram of a lock screen interface for an electronic device provided in an embodiment of this application. (Reference) Figure 10 In (a), there are multiple live notifications on the current electronic device, including live notifications for ride-hailing tasks and live notifications for food delivery tasks. Due to limited display area, the electronic device only displays one capsule-shaped live notification on the lock screen, such as live notification 1001 for ride-hailing tasks. When the user triggers an upward swipe operation on live notification 1001, the electronic device switches the display. Figure 10 The lock screen interface shown in (b) is for reference. Figure 10 In (b), the electronic device displays an immersive live stream 1002 corresponding to the ride-hailing task on the lock screen interface, and displays a capsule-style live stream notification 1003 corresponding to the food delivery task in the display area used to display capsule-style live stream notifications.
[0152] When an electronic device displays multiple card-style live notifications on the lock screen, assuming the electronic device displays a first card-style live notification and a second card-style live notification on the lock screen, the user can trigger a sixth action in the first card-style live notification. The electronic device can switch between displaying the immersive live notification corresponding to the first live notification and displaying the capsule-style second live notification. The sixth action can be, for example, a long press action triggered by the user in a non-control area of the first live notification.
[0153] For example, refer to Figure 10In (c), the lock screen of the electronic device includes a live notification 1004 for a ride-hailing task and a live notification 1005 for a food delivery task. When the user triggers a long press on any area of the live notification 1005 other than the icon, the electronic device can switch the display. Figure 10 The lock screen interface shown in (d) is for reference. Figure 10 In (d), the electronic device displays an immersive live stream 1006 corresponding to the food delivery task on the lock screen interface, and the electronic device displays a capsule-style live stream notification 1007 corresponding to the ride-hailing task in the display area used to display capsule-style live stream notifications.
[0154] In some examples of this application, the lock screen state of the electronic device also includes an Always-On Display (AOD) scenario. The lock screen display method provided in the embodiments of this application can also be applied to displaying immersive live content in the AOD interface. The AOD display scenario can also be called an always-on display scenario. In the AOD display scenario, the electronic device can display the AOD interface, which can also be called the always-on interface. In an optional embodiment, when the electronic device displays the first content of the first application in the first window of the lock screen interface, if the electronic device enters the AOD display state, the lock screen function module of the electronic device can send the lock screen interface information to the AOD module. The lock screen interface information may include the lock screen background, lock screen elements, and immersive live content information. The AOD module can display immersive live content in the AOD interface according to the received lock screen interface information. The display effect of the AOD interface can be seen in the above embodiments of the lock screen interface displaying immersive live content effect, such as... Figure 8 The image shows the effect of displaying an immersive live stream on the lock screen.
[0155] In another optional implementation, when the electronic device is in AOD display state, the AOD module in the electronic device can receive the first information of the first application sent by the system server through the immersive cloud service agent. The AOD module can create a second window in the AOD interface according to the first information of the first application and display the first content of the first application in the second window, thereby realizing the display of immersive live in the AOD interface. In this implementation, the functions performed by the AOD module can refer to the functions performed by the immersive service module and the lock screen function module in the above embodiments, and the repeated parts will not be described again.
[0156] Optionally, when the electronic device is in AOD display mode, the electronic device only displays the layer where the AOD interface is located on the screen. When the electronic device displays immersive live content in the first window of the AOD interface, the first window is also located in the layer where the AOD interface is located.
[0157] The following two examples further illustrate the lock screen display method provided in the embodiments of this application.
[0158] Example 1
[0159] This example uses the first content of the first application displayed in the first window of the electronic device's lock screen as an example, such as... Figure 11 This is a schematic diagram illustrating an immersive live-action experience where the first content is an image, provided as an embodiment of this application. (Reference) Figure 11 When the business type of the first application is a business type with a low update frequency, such as travel information, sports scores, package pickup information, meeting notifications, or ticket information, the immersive live broadcast displayed in the first window of the first application can be an image.
[0160] Figure 12 This is a schematic diagram illustrating a screen lock display method provided in an embodiment of this application. (Reference) Figure 12 This example uses the first content of the first application displayed in the first window of the electronic device's lock screen as an example, for reference. Figure 12 In this embodiment, the desktop of the electronic device can display a lock screen interface when the screen is locked. The lock screen interface includes lock screen elements and a lock screen background. Lock screen elements can be, for example, a clock control, a calendar control, etc. The lock screen interface may also include a first window for displaying immersive live feeds of the application. Optionally, the lock screen interface may also include live feed notifications from the application. The live feed management module of the electronic device can be used to manage the live feed notifications and immersive live feeds displayed on the lock screen interface. In this example, the live feed management module can be... Figure 2 The immersive service module, a sub-module of the screen lock function module in the electronic device shown, can be the Advanced Notification Service (ANS) module in the operating system.
[0161] exist Figure 12 In the example shown in (a), when the electronic device enters the lock screen state, the first application calls the immersive service interface to send business image information to the immersive service module. The first application belongs to the target application set capable of immersive live display, and the business type corresponding to the business image is an authorized business type for the first application. The immersive service module performs risk detection on the business image. After passing the risk detection, the immersive service module sends the business image information of the first application to the immersive live management module of the system user interface (system UI). The immersive live management module can then display the business image of the first application in the first window of the lock screen interface.
[0162] exist Figure 12In the example shown in (b), when the electronic device enters the lock screen state, the first application sends a request message to the application server. This request message requests the application server to generate an immersive live stream corresponding to the first service currently running in the first application. The system server's push service receives the service image information of the first application sent by the application server. The first application belongs to the target application set that can perform immersive live stream display, and the service type corresponding to the service image is the authorized service type corresponding to the first application. The push service can perform risk detection on the service image. After the risk detection is passed, the push service can send the service image information of the first application to the immersive service module of the electronic device through the immersive cloud service proxy of the electronic device. The immersive service module sends the service image information of the first application to the immersive live stream management module, and the immersive live stream management module can display the service image of the first application in the first window of the lock screen interface.
[0163] It should be noted that the information sent by the push service or the first application to the immersive service module for the business image can be either the business image itself or the unified resource locator (URL) of the business image on the local device. Once the system UI obtains the image URL, it can retrieve the image from the resource library.
[0164] Example 2
[0165] This example uses the first content of the first application displayed in the first window of the electronic device's lock screen as the user interface example, such as... Figure 13 This is a schematic diagram illustrating an immersive live-action experience where the first content is a user interface, provided as an embodiment of this application. (Reference) Figure 13 When the business type of the first application is a business type with a high update frequency, such as map navigation, delivery information, sports and health, or ride-hailing, the immersive live broadcast displayed in the first window of the first application can be a user interface.
[0166] Figure 14 This is a schematic diagram illustrating a screen lock display method provided in an embodiment of this application. (Reference) Figure 14 This example uses the first content of the first application displayed in the first window of the electronic device's lock screen as the user interface example. (Refer to...) Figure 14 In this embodiment, the desktop of the electronic device can display a lock screen interface when the screen is locked. The lock screen interface includes lock screen elements and a lock screen background. Lock screen elements can be, for example, a clock control, a calendar control, etc. The lock screen interface may also include a first window for displaying immersive live feeds from applications. Optionally, the lock screen interface may also include live feed notifications from applications. The live feed management module of the electronic device can be used to manage the live feed notifications and immersive live feeds displayed on the lock screen interface. Figure 14 In the example shown, the first window in the lock screen can be an extended component used to display the application interface, and the live management module can manage parameters such as the position and size of the extended component. In this example, the live management module can be... Figure 2 The immersive service module, a sub-module of the screen lock function module in the electronic device shown, can be the ANS module in the operating system.
[0167] refer to Figure 14 When an electronic device enters lock screen mode, the first application can request the immersive service module to create a first window for displaying immersive live content. This first window can be an extension component within the lock screen interface. The immersive service module can send a request message to the live content management module to request the live content management module to create the first window within the lock screen interface. After the live content management module creates the first window within the lock screen interface, it can send a request message to the first application. This request message includes parameters for the first window, such as its position and size. Based on these parameters, the first application draws the user interface corresponding to the first service and then sends this user interface to the extension component within the lock screen interface via the system UI. The extension component within the lock screen interface can then display the user interface of the first application, thus enabling the display of the first application's user interface within the first window of the lock screen interface.
[0168] Based on the same concept, embodiments of this application also provide a lock screen display method, which can be executed by an electronic device, such as... Figure 15 A flowchart of a lock screen display method provided in an embodiment of this application is shown below. Figure 15 The method includes the following steps:
[0169] S1501: The electronic device enters the screen lock state, and the first service in the first application of the electronic device is running. The first application in the electronic device sends the first information of the first application to the first service module through the first service interface.
[0170] The first information includes multimedia content or user interface information related to the first service, and the first service interface can be... Figure 2 The immersive service interface in the electronic device shown, the first service module can Figure 2 The immersive service module in the electronic device shown.
[0171] S1502: The first service module in the electronic device sends the first information to the screen lock function module.
[0172] S1503: After receiving the first information, the lock screen function module in the electronic device creates the first window in the lock screen interface.
[0173] The first window created by the lock screen function module in the lock screen interface can be a non-fullscreen window, such as the first window being... Figure 7 The first window 701 or the first window 702 in the illustrated embodiment.
[0174] S1504: The screen lock module in the electronic device displays the first content of the first application in the first window based on the first information.
[0175] In this embodiment, the lock screen function module displays the first content in the first window based on the first information. This content can be the immersive live stream described in the above embodiments, and the first content of the first application can be multimedia content or a user interface, such as in... Figure 7 The first content in the first window of the lock screen interface shown in (a) is an image; Figure 7 The first content in the first window of the lock screen interface shown in (b) is the user interface.
[0176] In one optional implementation, before the first application in the electronic device sends its first information to the first server module through the first service interface, the first application in the electronic device sends a first request message to the system server. This first request message requests the system server for lock screen display permission for the first service of the first application. The first application in the electronic device receives a response message from the system server, which instructs the system server to approve the permission request from the first application. The lock screen display permission includes immersive live view permission.
[0177] In an optional implementation, the electronic device further includes a service proxy module. The first service module in the electronic device receives second information sent by a server through the service proxy module, the second information including multimedia content related to the first service. The first service module in the electronic device sends the second information to the lock screen function module. The lock screen function module in the electronic device displays the second content of the first application in the first window based on the second information. The service proxy module can be... Figure 2 Immersive cloud service agent in the electronic device shown.
[0178] In one optional implementation, before the first service module in the electronic device sends the first information to the lock screen function module, the first service module in the electronic device performs risk detection on the first information, and only sends the first information to the lock screen function module after determining that the risk detection of the first information has passed.
[0179] In one optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, in response to a first operation triggered by the user in the first window, the electronic device switches to an unlocked state, runs the first application, and displays the user interface of the first task; wherein, the first operation is a click operation triggered by the user in the first window. For example, the first operation can be a click operation triggered by the user in a non-control display area of the first window.
[0180] In an optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: in response to a second operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a card-style live notification corresponding to the first task in the lock screen interface; wherein, the second operation is a click operation triggered by the user at any position in the area outside the first window in the lock screen interface, or the second operation is a swipe operation triggered by the user in the first window. For example, the second operation can be a click operation triggered by the user at any position in the area outside the first window in the lock screen interface, or the second operation can be a side swipe or an up swipe operation triggered by the user in the first window, wherein the side swipe operation includes a left swipe operation and a right swipe operation.
[0181] In one optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window based on the first information, in response to a third operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; the lock screen function module of the electronic device displays a capsule-shaped live notification corresponding to the first task in the lock screen interface; wherein, the third operation is a swipe operation triggered by the user in the first window. For example, the third operation can be a swipe-down operation triggered by the user in the first window.
[0182] In one optional implementation, after the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, in response to a fourth operation triggered by the user in the first window, the lock screen function module of the electronic device displays the third content of the first application in the first window; wherein, the fourth operation is a swipe operation triggered by the user in the first window, and the third content is sent to the lock screen function module by the first application after updating the first content according to parameters related to the fourth operation.
[0183] In one optional implementation, the screen lock function module of the electronic device determines that the permission information of the first application includes a first permission before displaying the third content of the first application in the first window. The first permission is used to indicate that the responsive swipe operation is supported when displaying the content corresponding to the first task in the screen lock interface.
[0184] In an optional embodiment, the electronic device further includes an always-on display module. After the lock screen function module in the electronic device displays the first content of the first application in the first window according to the first information, when the electronic device enters the always-on display state, the lock screen function module in the electronic device sends information about the lock screen interface to the always-on display module. The information about the lock screen interface includes information about the first content of the first application displayed in the first window. The always-on display module of the electronic device displays the first content of the first application in a second window of the always-on display interface according to the information about the lock screen interface. The always-on display module can be... Figure 2 The AOD module in the electronic device shown.
[0185] In an optional implementation, the electronic device further includes an always-on display module. After the screen lock function module in the electronic device displays the first content of the first application in the first window according to the first information, the method further includes: when the electronic device enters the always-on display state, the always-on display module in the electronic device receives the first information sent by the system server through the service proxy module; the always-on display module in the electronic device displays the first content of the first application in a second window of the always-on display interface according to the first information.
[0186] For example, when the service type of the first service is travel information, event scores, meeting notifications, ticket information, or package pickup information, the first content is multimedia content, as shown in the reference. Figure 11 The lock screen interface shown, when the first application's service type is a low-frequency update type such as travel information, sports scores, package pickup information, meeting notifications, or ticket information, the immersive live feed displayed in the first window can be an image. When the first service type is map navigation, delivery information, sports and health, or ride-hailing, the first content is the user interface. (See reference...) Figure 13 As shown in the lock screen interface, when the business type of the first application is a business type with a high update frequency, such as map navigation, delivery information, sports and health, or ride-hailing, the immersive live broadcast displayed in the first window of the first application can be a user interface.
[0187] For example, when the first content is a user interface, the first content includes at least one of text controls, icon controls, and multimedia controls. (See reference...) Figure 9 In (c), when the first content is a user interface, the first content includes text controls such as "Picking up, expected to arrive in 5 minutes" and "License plate number XXXXX white sedan". The first content may also include icon controls such as user avatars, and the first content may also include map image controls.
[0188] Based on the above embodiments, this application also provides a server, including multiple functional modules; the multiple functional modules interact to implement the functions performed by the system server or application server in the methods described in the embodiments of this application. For example, [the following is an example of implementation]. Figure 5 The application server in the illustrated embodiment executes S503c, for example, by executing... Figure 5 The system server executes S503d in the illustrated embodiment. The multiple functional modules can be implemented based on software, hardware, or a combination of both, and these modules can be arbitrarily combined or divided based on specific implementations.
[0189] Based on the above embodiments, this application also provides a server, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the server is running, the at least one processor executes the functions performed by the server in the various methods described in the embodiments of this application. For example, ... Figure 5 The application server in the illustrated embodiment executes S503c, for example, by executing... Figure 5 S503d is executed by the system server in the illustrated embodiment.
[0190] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact to realize the functions performed by the electronic device in the methods described in the embodiments of this application. For example, the electronic device may include... Figure 5 The diagram shows an immersive service interface, an immersive service module, an immersive cloud service proxy, and a lock screen function module. These multiple functional modules can be implemented using software, hardware, or a combination of both, and can be arbitrarily combined or divided based on the specific implementation.
[0191] Based on the above embodiments, this application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor performs the functions performed by the electronic device in the various methods described in the embodiments of this application.
[0192] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to execute the methods described in the embodiments of this application.
[0193] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.
[0194] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.
[0195] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.
[0196] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0197] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0198] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0199] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0200] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of protection of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A lock screen display method, characterized in that, The method is applied to an electronic device, which includes a first application and a screen lock function module. When the electronic device enters a screen lock state, a first service in the first application of the electronic device is in a running state. The electronic device also includes a first service module and a first service interface. The lock screen function module obtains the first information of the first application, the first information including multimedia content or user interface information related to the first service; The screen lock module in the electronic device displays a first window on the screen lock interface based on the first information, wherein the first window displays the first content of the first service; The method further includes: The first application in the electronic device sends the first information of the first application to the first service module through the first service interface. The first information includes multimedia content or user interface information related to the first service. The first service module in the electronic device sends the first information to the screen lock function module.
2. The method as described in claim 1, characterized in that, The method further includes: The first application in the electronic device sends a first request message to the system server. The first request message is used to request the lock screen display permission of the first service of the first application from the system server. The first application in the electronic device receives a response message sent by the system server, the response message being used to instruct the system server to grant the first application permission.
3. The method as described in claim 1, characterized in that, The method further includes: The electronic device receives second information sent by the server, the second information including multimedia content related to the first service; The screen lock module in the electronic device obtains the second information; The screen lock module in the electronic device displays the second content of the first application in the first window based on the second information.
4. The method as described in claim 1, characterized in that... The method further includes: The electronic device performs risk detection on the first information and determines that the risk detection of the first information has passed.
5. The method according to any one of claims 1-4, characterized in that, After displaying the first window on the lock screen, the method further includes: In response to a first operation triggered by the user in the first window, the electronic device switches to the unlocked state, runs the first application, and displays the user interface of the first service; The first operation is a click operation triggered by the user in the first window.
6. The method according to any one of claims 1-4, characterized in that, After displaying the first window on the lock screen, the method further includes: In response to a second operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; The lock screen interface displays a real-time notification in a card style corresponding to the first service; The second operation is either a click operation triggered by the user at any location in the lock screen interface other than the first window, or a swipe operation triggered by the user in the first window.
7. The method according to any one of claims 1-4, characterized in that, The method further includes: In response to a third operation triggered by the user in the first window, the electronic device stops displaying the first content of the first application; The screen lock function module of the electronic device displays a capsule-style real-time notification corresponding to the first service on the screen lock interface; The third operation is a swipe operation triggered by the user in the first window.
8. The method according to any one of claims 1-4, characterized in that, The method further includes: In response to a fourth operation triggered by the user in the first window, the lock screen module of the electronic device displays the third content of the first application in the first window; The fourth operation is a swipe operation triggered by the user in the first window, and the third content is the content updated by the first application based on the parameters related to the fourth operation and then sent to the lock screen function module.
9. The method as described in claim 8, characterized in that, Before the screen lock module of the electronic device displays the third content of the first application in the first window, the method further includes: The screen lock function module of the electronic device determines that the permission information of the first application includes a first permission, which is used to indicate that when the content corresponding to the first service is displayed on the screen lock interface, it supports responding to the swipe operation.
10. The method as described in claim 9, characterized in that, The method further includes: When the electronic device enters the always-on display state, the always-on display module of the electronic device displays the first content of the first application in the second window of the always-on display interface according to the first information. or, When the electronic device enters the always-on display state, the electronic device receives the first information sent by the system server; The electronic device displays the first content of the first application in a second window of the always-on display based on the first information.
11. The method as described in claim 10, characterized in that, When the service type of the first service is travel information, event scores, meeting notifications, ticket information, or package pickup information, the first content is multimedia content; The first service's business type is map navigation, delivery information, sports and health, and ride-hailing, and the first content is the user interface.
12. The method as described in claim 11, characterized in that, When the first content is a user interface, the first content includes at least one of text controls, icon controls, and multimedia controls.
13. An electronic device, characterized in that, The electronic device includes a memory and a processor; wherein the memory and the processor are coupled, the memory is used to store a computer program, and when the processor executes the computer program, the electronic device performs the method of any one of claims 1-12.
14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1-12.
15. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-12.
Citation Information
Patent Citations
Screen locking method and mobile terminal
CN101894023A
Authority control method and apparatus
CN106471513A
Lock screen display method and apparatus
CN107168693A