Display method, electronic device and storage medium

By displaying the unlocking interface in an electronic device without waiting for the window to draw the status synchronization, the problem of longer unlocking time in the prior art is solved, and a faster unlocking process and a better user experience is achieved.

CN119002772BActive Publication Date: 2025-04-18HONOR DEVICE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411281555.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-13
Publication Date
2025-04-18
Estimated Expiration
2044-09-13

AI Technical Summary

Technical Problem

In the prior art, the unlocking time of the screen lock process is longer, which affects the user's user experience.

Method used

The subsequent display of the first window is shortened and unlocked is improved by synchronizing the drawing state of the first target window in the electronic device.

Benefits of technology

Saves window synchronization time, shortens unlocking time, and improves user unlocking experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002772B_ABST
    Figure CN119002772B_ABST
Patent Text Reader

Abstract

The present application provides a display method, an electronic device, and a storage medium; the method includes: in response to a user's unlocking operation, obtaining at least one first window, the first window being a window displayed on the electronic device after unlocking; in the case where at least one first window includes a first target window, setting a first state value for the first target window, the first state value being used to indicate that the first target window has been drawn; in the case where at least one first window has the first state value, displaying at least one first window on the electronic device. The embodiments of the present application can shorten the unlocking time and improve the user's unlocking experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and in particular to a display method, electronic device and storage medium. Background Art

[0002] In the development of electronic devices, in order to protect data privacy and security, prevent users from accidentally touching or operating the device, and save device power consumption, the electronic device can use the lock screen function to lock the device screen after the user clicks the power button or does not operate the electronic device for a period of time. When the user needs to use the mobile phone, the electronic device needs to be unlocked.

[0003] Then, in the prior art, the unlocking time of the lock screen process is relatively long, which affects the user experience. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a display method, an electronic device and a storage medium. In this method, the electronic device can display the subsequent first window without synchronizing the drawing state of the first target window, thereby shortening the unlocking time and improving the unlocking efficiency.

[0005] In a first aspect, the present application provides a display method. The display method is applied to an electronic device. The display method includes: in response to an unlocking operation of a user, obtaining at least one first window, where the first window is a window displayed on the electronic device after unlocking; in the case where at least one first window includes a first target window, setting a first state value for the first target window, where the first state value is used to indicate that the first target window has been drawn; in the case where at least one first window has the first state value, displaying at least one first window on the electronic device.

[0006] In an embodiment of the present application, during the unlocking process, the electronic device can mark the first target window as the first state value without synchronizing the drawing state of the first target window. In this way, during the unlocking process, there is no need to wait for the drawing and state synchronization of the above-mentioned window to perform subsequent unlocking animation playback, post-unlocking interface display and other processes, thereby saving the synchronization time of the above-mentioned windows, shortening the unlocking time, and improving the user's unlocking experience.

[0007] Exemplarily, the electronic device according to the embodiment of the present application may be an electronic device to which the Shell Transition framework is applied.

[0008] Exemplarily, the first window may be a window to be displayed. In a desktop unlocking scenario, the first window may be a desktop. In a multi-window unlocking scenario, the first window may include a desktop and a floating window, or the first window may include a desktop and (Picture In Picture, PiP). In an application interface unlocking scenario, the first window may include an application interface.

[0009] Exemplarily, in the scenario where the desktop layer is not destroyed, the first target window may include at least one of a desktop window, a floating window, and a PiP. In another exemplary embodiment, in the scenario where the desktop layer is destroyed, the second target window may include a floating window and / or a PiP.

[0010] Exemplarily, the first state value may be TRUE, which is used to indicate that the first target window has been drawn, and it may also indicate that the synchronization module has completed synchronization of the drawing state of the first target window.

[0011] For example, the electronic device may play the unlocking animation after exiting the lock screen interface, and display at least one first window after the unlocking animation is played. Alternatively, the electronic device may display at least one first window after exiting the unlocking interface.

[0012] Exemplarily, the electronic device may traverse the window containers of each first window to obtain whether each first window has been drawn.

[0013] According to the first aspect, when at least one first window is set with a first status value, before the electronic device displays the at least one first window, the method also includes: when at least one first window includes a second target window, obtaining the drawing status of the second target window; when the second target window is in the first status, determining that the second target window has the first status value, and the first status is used to characterize that the window has been drawn.

[0014] In this way, the electronic device can synchronize the drawing state of the window that needs to be synchronized, so as to switch and display the subsequent unlocking interface after the second target window is drawn, thereby ensuring the normal display of the unlocking process.

[0015] Exemplarily, the second target window may be an application interface or other window that needs to wait for drawing. For example, in the scenario where the desktop layer is not destroyed, the second target window may be an application interface. In the scenario where the desktop layer is destroyed, the second target window may be an application interface or a desktop.

[0016] According to the first aspect, or any implementation of the first aspect above, the electronic device includes a synchronization module and a first window container; obtaining the drawing state of the second target window includes: the synchronization module obtains the drawing state of the second target window through the first window container; when the second target window is in the first state, determining that the second target window has a first state value includes: after the second target window is in the first state, the synchronization module receives the first state value sent by the first window container.

[0017] In this way, the drawing state of each window can be monitored in real time through the window container, so that the drawing state of each window can be monitored in time and displayed subsequently.

[0018] Exemplarily, the synchronization module may be implemented as BLASTSyncEngine.

[0019] Exemplarily, the window container may include WindowContainer. The window container may synchronize the drawing state of the window, and after the drawing of the window is completed, modify its drawing state to ready to show, and return a TRUE value to the synchronization module.

[0020] According to the first aspect, or any implementation method of the above first aspect, the desktop layer of the electronic device is saved after the screen is locked, and the first target window includes the desktop window and / or the first display window, wherein the first display window includes a floating window and / or a picture-in-picture window; when at least one first window includes the first target window, a first status value is set for the first target window, including: for a single first window, when the single first window is a desktop window, a first status value is set for the desktop window; when the single first window is a first display window, a first status value is set for the first display window.

[0021] In this way, the subsequent interface can be displayed without waiting for the desktop, floating window or PiP to be drawn, without destroying the desktop layer, thereby improving the unlocking efficiency.

[0022] According to the first aspect, or any implementation of the first aspect above, the desktop layer of the electronic device is destroyed after the screen is locked, and the first target window includes a first display window, wherein the first display window includes a floating window and / or a picture-in-picture window; in a case where at least one first window includes a first target window, a first status value is set for the first target window, including: in a case where a single first window is a first display window, a first status value is set for the first display window.

[0023] In this way, when the desktop layer is destroyed, the subsequent interface can be displayed without waiting for the floating window or PiP to be drawn, thereby improving the unlocking efficiency.

[0024] According to the first aspect, or any implementation of the first aspect above, before acquiring at least one first window, the method further includes: exiting the lock screen state; and displaying wallpaper.

[0025] In this way, in the scenario where the desktop layer is destroyed, the wallpaper can be mounted before the windows are synchronized, avoiding the black screen state after exiting the unlock interface, improving the lock screen display effect, and improving the user's lock screen experience.

[0026] According to the first aspect, or any implementation of the first aspect above, at least one first window is a desktop window, and displaying at least one first window on an electronic device includes: generating a first motion effect; playing the first motion effect; and displaying the desktop window after the first motion effect is played.

[0027] In this way, the unlocking animation can be played during the process of switching the display desktop on the unlocking interface, which enriches the visibility of the unlocking process and improves the user's unlocking experience.

[0028] Exemplarily, the first animation may be a desktop unlocking animation or a wallpaper unlocking animation.

[0029] According to the first aspect, or any implementation of the first aspect above, at least one first window includes a desktop window and a first display window, wherein the first display window includes a floating window and / or a picture-in-picture window; at least one first window is a desktop window, and displaying at least one first window on an electronic device includes: displaying the desktop window; after the first display window is drawn, displaying the first display window above the desktop window.

[0030] In this way, the loading process of the first display window can be saved, the unlocking time can be saved, and the user's unlocking experience can be improved. In addition, after the lock screen interface is exited, the desktop and the first display window can be directly displayed without playing the animation effect, avoiding the visual interference of the user due to the display complexity in the multi-window display scenario and improving the display effect.

[0031] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors, one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method of the first aspect.

[0032] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, including computer instructions, which, when executed on an electronic device, causes the electronic device to execute the method of the first aspect.

[0033] In a fourth aspect, an embodiment of the present application provides a chip or a chip system, including a processing circuit and an interface circuit, the interface circuit is used to receive code instructions and transmit them to the processing circuit, and the processing circuit is used to run the code instructions to execute the method of the first aspect.

[0034] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program, and when the computer program is run on a computer, it enables the computer to execute the method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 A schematic diagram showing a usage scenario of an electronic device provided in an embodiment of the present application;

[0036] Figures 2 to 4 A set of exemplary interface schematic diagrams of an electronic device during unlocking are shown;

[0037] Figure 5 A schematic diagram of an exemplary device interface provided by an embodiment of the present application is shown;

[0038] Figure 6 An exemplary unlocking animation schematic diagram provided in an embodiment of the present application is shown;

[0039] Figure 7 Another exemplary device interface schematic diagram provided by an embodiment of the present application is shown;

[0040] Figure 8 Another set of exemplary interface schematic diagrams provided in an embodiment of the present application is shown;

[0041] Fig. 9 Another set of exemplary interface schematic diagrams provided in the embodiments of the present application is shown;

[0042] Fig.10 A schematic diagram of the structure of an electronic device is shown;

[0043] Fig.11 is a software structure block diagram of the electronic device of the embodiment of the present application;

[0044] Fig.12 A schematic diagram of a flow chart of a display method provided in an embodiment of the present application is shown;

[0045] Fig.13 A schematic diagram showing a flow chart of another display method provided in an embodiment of the present application is shown;

[0046] Fig.14 A schematic block diagram of a device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0048] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0049] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0050] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0051] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0052] In the development of electronic devices such as mobile phones, in order to protect data privacy and security, prevent users from accidentally touching or operating the device, and save device power consumption, the electronic device can use the lock screen function to lock the device screen after the user clicks the power button or does not operate the electronic device for a period of time.

[0053] And, when the user needs to use the electronic device, Figure 1 A schematic diagram of a usage scenario of an electronic device provided by an embodiment of the present application is shown. Figure 1As shown, taking the electronic device as a mobile phone 100 as an example, the mobile phone 100 may include a power button 110 and a front camera 120 (the mobile phone 100 may also include other structures, which are not shown in this figure). After the user clicks the power button 110 to light up the screen, in the screen off interface or unlock interface, the user can unlock the electronic device by performing face recognition or other methods through the front camera 120. After successfully unlocking, the user can continue to use the functions of the electronic device.

[0054] Before introducing the technical solutions of the embodiments of the present application, in order to facilitate overall understanding, the technical terms involved are first explained.

[0055] (1) Front Desk

[0056] In the embodiment of the present application, the foreground may refer to an interface that can be seen in the display interface of the electronic device after the electronic device is unlocked. For example, the foreground may be an application being displayed or a desktop.

[0057] (2) The desktop layer is destroyed or the non-desktop layer is not destroyed

[0058] After the electronic device is unlocked, the electronic device can notify the desktop application to draw the desktop layer. Also, after the electronic device is locked, the electronic device can destroy the drawn desktop layer, which is hereinafter referred to as desktop layer destruction for ease of description.

[0059] (3) The desktop layer is not destroyed

[0060] After the electronic device is locked, the electronic device may not destroy the drawn desktop layer, so that after the next unlocking, the desktop layer can be displayed by layer refresh. For the sake of description, it is hereinafter referred to as the desktop layer not being destroyed.

[0061] (4) System User Interface (System UI): It refers to the interface through which users interact with the device. System UI can provide status bar, navigation bar, lock screen interface (also called unlock interface), etc. Among them, users can perform operations such as unlocking the screen on the lock screen interface.

[0062] After introducing the above technical terms, the unlocking process involved in the embodiment of the present application will be described.

[0063] For the unlocking process, in order to bring users a richer visual experience during the unlocking process, the unlocking animation can be played after the electronic device is successfully unlocked. With the upgrade of the version, Android began to use the ShellTransition (a framework applied to the Android system) framework for architecture optimization. Switching control and animation processing are uniformly implemented by the Shell Transition module, which solves the stroboscopic problem caused by asynchrony from the architectural perspective. However, the inventors found through research that due to the newly added synchronization mechanism of the new architecture, the overall unlocking performance will be degraded compared with the previous version. For example, on platforms with poor performance, the unlocking waiting time is longer.

[0064] In a related technology, taking the electronic device as a mobile phone 100 as an example, Figures 2 to 4 A set of exemplary interface diagrams of an electronic device during unlocking are shown. Figure 2 As shown, after the user presses the power button 110 on the mobile phone 100 in the lock screen state, the mobile phone 100 responds to the power button triggering operation and displays the screen off interface 120.

[0065] The screen-off interface 120 may display a time control 121, a fingerprint unlock icon 122, etc. In addition, a status bar may also be displayed. Among them, the status bar may include the name of the communication operator "Operator A", one or more signal strength indicators of the mobile communication signal (also known as a cellular signal), a wireless high-fidelity (wireless fidelity, Wi-Fi) signal strength indicator, a battery status indicator, a Bluetooth connection indicator, etc. Optionally, according to actual needs and specific requirements, the status bar 6 may also include a time indicator, an alarm indicator, a vibration / ringtone indicator, etc., without specific restrictions. It should be noted that other information may also be displayed on the screen-off interface 120, such as an information notification bar, etc., without specific restrictions.

[0066] And, continue to see Figure 2 When the user performs a preset operation (such as a swipe up operation) on the screen-off interface 120 , the mobile phone 100 may display the unlocking interface 130 .

[0067] The unlocking interface 130 may include a face recognition logo 131, a password input control 132, and a fingerprint unlocking icon 133. Among them, the password input control 132 may include a numeric keyboard, a password input indicator, etc. On the unlocking interface 130, the user performs face recognition unlocking through the front camera. In addition, on the unlocking interface 130, the user can also perform password unlocking by entering a numeric password or a character password in the password input control 132. In addition, on the unlocking interface 130, the user can also perform fingerprint unlocking by pressing a fingerprint on the fingerprint unlocking icon 133.

[0068] When the user Figure 2 After the unlocking is successful on the unlocking interface 130 shown in FIG. 1 , in a feasible implementation manner, if the desktop is displayed before the mobile phone 100 is locked, continue to refer to FIG. Figure 3 , the mobile phone 100 can load the desktop (draw the desktop) and generate the unlocking animation after the desktop is synchronized. And after the unlocking animation 1 is generated, the mobile phone 100 plays the unlocking animation 1 on the effect playback interface 140, and after the unlocking animation 1 is finished playing, the desktop 150 and the wallpaper 160 (hereinafter referred to as the desktop unlocking scene) are displayed. Among them, the desktop 150 may include multiple application icons 151 (which may be located in the middle of the desktop or the bottom area of ​​the desktop), a status bar and a page indicator. Among them, the status bar can refer to the relevant description of the above part of the embodiment of the present application, which will not be repeated here. The page indicator can be used to indicate the positional relationship between the currently displayed page and other pages, and the page indicator can be used to indicate which page of multiple pages the user is currently browsing. It should be noted that service cards, floating windows, etc. can also be displayed on the desktop 150, and there is no specific restriction on this.

[0069] For unlocking animation 1, it can be a desktop typing animation, a desktop zooming animation, etc., or it can be a custom or default animation. It can be set according to user needs or specific usage scenarios, and there is no specific restriction on this.

[0070] When the user Figure 2 After the unlocking is successful on the unlocking interface 130 shown in FIG. 1 , in another feasible implementation manner, if the mobile phone 100 displays the application interface of the music player application before unlocking, then continue to refer to FIG. Figure 4 After the application interface is loaded (the application interface is drawn) and the state synchronization is completed, the mobile phone 100 can generate the unlocking animation 2, and after the unlocking animation 2 is generated, the mobile phone 100 plays the unlocking animation 2 on the effect playing interface 140, and after the unlocking animation 2 is played, the application interface of the music playing application is displayed (hereinafter referred to as the non-desktop unlocking scene or the application unlocking scene). Among them, the unlocking animation 2 can be a default or custom animation, and there is no specific limitation on it.

[0071] For the above desktop scenario, continue to see Figure 3 After the user successfully unlocks the device, the desktop can be loaded after a long period of time. Also, for the above non-desktop scenarios, continue to refer to Figure 4 After the user successfully unlocks the phone, the phone screen will take a long time to load the application interface.

[0072] The applicant found that in the Shell Transition framework, the electronic device will synchronize the drawing status of all windows to be displayed before playing the unlocking animation. After all window states have been drawn, the animation will be played. This synchronization method often results in a longer unlocking time, affecting the user's unlocking experience.

[0073] Based on this, the embodiment of the present application provides a display solution that can be applied to the unlocking scenario of an electronic device using the Shell Transition framework. It should be noted that the electronic device in the embodiment of the present application can be a handheld device, a vehicle-mounted device, etc. with an unlocking function. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, a smart watch, a vehicle-mounted display screen, and other electronic devices, and there is no specific restriction on them. Through the technical solution provided in the embodiment of the present application, the next interface of the unlocking interface can be displayed without waiting for the synchronization of the drawing status of windows such as the desktop, floating window, or picture-in-picture, which shortens the unlocking time and improves the user experience.

[0074] To facilitate overall understanding, the following describes the display schemes for two different scenarios: when the desktop layer is not destroyed and when the desktop layer is destroyed.

[0075] In a scenario where the desktop layer is not destroyed, in one example, Figure 5 An exemplary device interface diagram provided by an embodiment of the present application is shown. Figure 2 After successfully unlocking on the unlocking interface shown, the electronic device can generate and play the unlocking animation 3 without waiting for the status synchronization of the desktop layer, and after the unlocking animation 3 is played, the desktop 150 with the wallpaper 160 as the background is displayed.

[0076] Among them, for unlocking animation 3, Figure 6 FIG. 1 shows an exemplary unlocking animation diagram provided in an embodiment of the present application. Figure 6 As shown, during the playback of unlocking animation 3, the zooming animation of wallpaper 160 can be displayed. Specifically, at the beginning, as Figure 6 As shown in (1) in FIG. 1 , the electronic device can display area A1 in wallpaper 160. And, as wallpaper 160 is continuously scaled, as shown in FIG. Figure 6 As shown in (2) in FIG. 1 , the electronic device may display area A2 of the wallpaper 160 until the electronic device can display the entire wallpaper 160 (eg, Figure 6 As shown in (3) in the figure), the animation ends.

[0077] It should be noted that in the embodiments of the present application, other animations may be used according to user settings, such as desktop typing effects, other animations, etc., without specific limitations.

[0078] In combination Figure 5-Figure 6 In the display scheme shown, the electronic device can generate and play the unlocking animation without waiting for the desktop to be drawn, thereby shortening the unlocking time and improving the user experience.

[0079] In another example, Figure 7 Another exemplary device interface diagram provided by an embodiment of the present application is shown. Figure 7 As shown, a floating window 170 (hereinafter referred to as a multi-window interface) can also be displayed on the desktop 150. The floating window 170 refers to a floating window in the Android system, which can be displayed on the desktop 150 or on the upper layer of other applications. It can be dragged, scaled, closed, etc. for free. For example, the floating window 170 can display the interface of an information application or the interface of other applications, and there is no restriction on its specific display content. In the scenario where the desktop layer is not destroyed, Figure 8 Another exemplary interface diagram provided by the embodiment of the present application is shown. Figure 2 After successfully unlocking the unlocking interface shown in the figure, the interface of the electronic device will be as follows: Figure 8 Specifically, the electronic device may display the desktop 160 first without waiting for the floating window 170 to be drawn, and when the floating window 170 is drawn in the background, the floating window 170 may be displayed above the desktop 160 .

[0080] It should be noted that the display mode of the Picture in Picture (PiP) interface is similar to the display mode of the above floating window, so I will not go into details. Among them, Picture in Picture is a special type of multi-window mode, which is often used for video playback. In this mode, users can fix videos and other content in a corner of the screen in the form of a small window.

[0081] It should be noted that the solution of this example may also include other windows that can be superimposed on the desktop, and there is no specific limitation on this.

[0082] In the above combination Figure 7-Figure 8 In the display scheme shown, the electronic device can generate and play the unlocking animation without waiting for the desktop 160 and the floating window 170 to be drawn, thereby shortening the unlocking time and improving the user experience.

[0083] In the scene where the desktop layer is destroyed, Fig. 9 Another set of exemplary interface diagrams provided by the embodiment of the present application is shown. Figure 2 After successfully unlocking the unlocking interface shown in the figure, the interface of the electronic device will be as follows: Fig. 9As shown. Specifically, after the user successfully unlocks the device, the electronic device can mount wallpaper 160 (i.e., draw the wallpaper or load the wallpaper). Then, the electronic device can synchronize the desktop drawing state without considering the drawing state of the floating window. If the floating window has not been loaded (or called drawing) after the desktop drawing is completed, the desktop 150 can be displayed above the wallpaper 160 first (at this time, the animation can be omitted). Then, after the floating window 170 is drawn, the floating window 170 is displayed above the desktop 150.

[0084] In the above Fig. 9 In the display scheme shown, the electronic device can generate and play the unlocking animation without waiting for the floating window 170 to be drawn, thereby shortening the unlocking time and improving the user experience.

[0085] After introducing the above overall solution, for ease of understanding, the hardware structure and software structure of the electronic device are described below.

[0086] Fig.10 1 shows a schematic diagram of the structure of the electronic device 1000. It should be understood that Fig.10 The electronic device 1000 shown is only one example of an electronic device, and the electronic device 1000 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different configuration of components. Fig.10 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0087] The electronic device 1000 may include: a processor 1010, an external memory interface 1020, an internal memory 1021, a Universal Serial Bus (USB) interface 1030, a charging management module 1040, a power management module 1041, a battery 1042, an antenna 1, an antenna 2, a mobile communication module 1050, a wireless communication module 1060, an audio module 1070, a speaker 1070A, a receiver 1070B, a microphone 1070C, an earphone interface 1070D, a sensor module 1080, a button 1090, a motor 1091, an indicator 1092, a camera 1093, a display screen 1094, and a Subscriber Identification Module (SIM) card interface 1095, etc. The sensor module 1080 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0088] The processor 1010 may include one or more processing units, for example, the processor 1010 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0089] The controller may be the nerve center and command center of the electronic device 1000. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0090] A memory may also be provided in the processor 1010 for storing instructions and data. In some embodiments, the memory in the processor 1010 is a high-speed cache memory. The USB interface 1030 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 1030 may be used to connect a charger to charge the electronic device 1000, or may be used to transfer data between the electronic device 1000 and a peripheral device. It may also be used to connect headphones to play audio through the headphones. The interface may also be used to connect other electronic devices, such as AR devices, etc.

[0091] The charging management module 1040 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 1040 may receive charging input from a wired charger through the USB interface 1030. In some wireless charging embodiments, the charging management module 1040 may receive wireless charging input through a wireless charging coil of the electronic device 1000. While the charging management module 1040 is charging the battery 1042, it may also power the electronic device through the power management module 1041.

[0092] The power management module 1041 is used to connect the battery 1042, the charging management module 1040 and the processor 1010. The power management module 1041 receives input from the battery 1042 and / or the charging management module 1040, and supplies power to the processor 1010, the internal memory 1021, the external memory, the display screen 1094, the camera 1093, and the wireless communication module 1060. The wireless communication function of the electronic device 1000 can be implemented through the antenna 1, the antenna 2, the mobile communication module 1050, the wireless communication module 1060, the modem processor and the baseband processor.

[0093] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 1000 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0094] The mobile communication module 1050 may provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 1000. The mobile communication module 1050 may include at least one filter, a switch, a power amplifier, a low noise amplifier (Low Noise Amplifier, LNA), etc.

[0095] The wireless communication module 1060 can provide wireless communication solutions for application in the electronic device 1000, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0096] In some embodiments, antenna 1 of electronic device 1000 is coupled to mobile communication module 1050, and antenna 2 is coupled to wireless communication module 1060, so that electronic device 1000 can communicate with the network and other devices through wireless communication technology.

[0097] The electronic device 1000 implements the display function through a GPU, a display screen 1094, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 1094 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 1010 may include one or more GPUs that execute program instructions to generate or change display information.

[0098] The display screen 1094 is used to display images, videos, etc. The display screen 1094 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In some embodiments, the electronic device 1000 may include 1 or M display screens 1094, where M is a positive integer greater than 1. In the embodiment of the present application, the display screen 1094 can be Figure 5-Figure 9 The user interface shown is displayed, and the display screen 1094 can also play the unlocking animation.

[0099] The electronic device 1000 can realize the shooting function through ISP, camera 1093, video codec, GPU, display screen 1094 and application processor.

[0100] ISP is used to process the data fed back by camera 1093. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 1093.

[0101] The camera 1093 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 1000 may include 1 or N cameras 1093, where N is a positive integer greater than 1. In an embodiment of the present application, the camera 1093 may include a front camera, which can be used to collect facial images so that the electronic device can perform face unlocking based on the collected facial images.

[0102] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 1000 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0103] Video codecs are used to compress or decompress digital videos. The electronic device 1000 may support one or more video codecs. Thus, the electronic device 1000 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 10, MPEG2, MPEG3, MPEG4, etc.

[0104] The external memory interface 1020 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 1000. The external memory card communicates with the processor 1010 through the external memory interface 1020 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0105] The internal memory 1021 can be used to store computer executable program codes, which include instructions. The processor 1010 executes various functional applications of the electronic device 1000 and executes the display method of the embodiment of the present application by running the instructions stored in the internal memory 1021. The internal memory 1021 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 1000 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 1021 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UniversalFlash Storage, UFS), etc.

[0106] The electronic device 1000 can implement audio functions such as music playing and recording through the audio module 1070, the speaker 1070A, the receiver 1070B, the microphone 1070C, the headphone jack 1070D, and the application processor.

[0107] The audio module 1070 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1070 can also be used to encode and decode audio signals. In some embodiments, the audio module 1070 can be arranged in the processor 1010, or some functional modules of the audio module 1070 can be arranged in the processor 1010.

[0108] The sensor module 1080 may include a pressure sensor, a fingerprint sensor, a touch sensor, and the like.

[0109] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 1094. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The electronic device 1000 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 1094, the electronic device 1000 detects the touch operation intensity according to the pressure sensor. The electronic device 1000 can also calculate the touch position according to the detection signal of the pressure sensor. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0110] The fingerprint sensor is used to collect fingerprints. The electronic device 1000 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc. In the embodiment of the present application, the fingerprint sensor can be used to detect fingerprints, and when the fingerprint detection is successful, the electronic device 1000 is fingerprint unlocked.

[0111] A touch sensor is also called a "touch panel". The touch sensor can be arranged on the display screen 1094, and the touch sensor and the display screen 1094 form a touch screen, also called a "touch screen". The touch sensor is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. A visual output related to the touch operation can be provided through the display screen 1094. In other embodiments, the touch sensor can also be arranged on the surface of the electronic device 1000, which is different from the position of the display screen 1094.

[0112] In the embodiment of the present application, the electronic device 1000 can detect the user's operation such as clicking and sliding on the display screen 1094 through the touch detection capability provided by the touch sensor, thereby controlling the activation and deactivation of applications and devices, and realizing the jump switching between different user interfaces. In addition, in the embodiment of the present application, the electronic device 1000 can also detect the user's click operation on the numeric keypad on the display screen 1094 to realize the user's input of the unlock password.

[0113] The key 1090 includes a power key, a volume key, etc. The key 1090 may be a mechanical key. It may also be a touch key. The electronic device 1000 may receive key input and generate key signal input related to user settings and function control of the electronic device 1000. In the embodiment of the present application, the user may lock the screen by pressing the power key, and may also display the screen off interface by pressing the power key.

[0114] Motor 1091 can generate vibration prompts. Motor 1091 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. Indicator 1092 can be an indicator light, which can be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0115] In passing Fig.10 After introducing the hardware structure of the electronic device 1000 , the software architecture of the electronic device will be described with reference to the accompanying drawings.

[0116] The software system of the electronic device 1000 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 1000.

[0117] Fig.11 It is a software structure block diagram of the electronic device 1000 according to an embodiment of the present application.

[0118] The layered architecture of the electronic device 1000 divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the hardware abstraction layer (HAL), and the kernel layer.

[0119] The application layer can include a series of application packages.

[0120] like Figure 2As shown, the application package may include desktop, System UI, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications. In the embodiment of the present application, System UI may include a lock screen view mediator module (KeyguardViewMediator), an unlock view manager (HwKeyguardViewMediator) and a remote animation player (HnKeyguardRemoteAnimation). And, in the embodiment of the present application, the desktop can perform desktop drawing and desktop display, etc.

[0121] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0122] like Fig.11 As shown, the application framework layer may include window management services, WM-Shell, content providers, view systems, phone managers, resource managers, notification managers, and the like.

[0123] The window management service is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. In an embodiment of the present application, the window management service may include: a synchronization engine (BLASTSyncEngine), a window container (WindowContainer), and an animation player (KeyguardTransitionHandler), etc. Exemplarily, a window container (WindowContainer), that is, a window container, is used to manage window configuration and layout. In an embodiment of the present application, a window container can manage the drawing state of a window. The synchronization engine (BLASTSyncEngine) can synchronize the drawing states of each window by traversing each window container, and the animation player can control the playback and generation of unlocking animations.

[0124] WM-Shell is used to carry the Shell Transition framework and implement the functions of the Shell Transition framework.

[0125] The hardware abstraction layer is an interface layer located between the application framework layer and the kernel layer, and is used to provide a virtual hardware platform for the operating system.

[0126] The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver. In the embodiment of the present application, when a user inputs a fingerprint through a fingerprint sensor or inputs an unlock password through a touch sensor, the electronic device can detect the unlock operation through the sensor driver of the kernel layer, process the unlock operation, obtain an unlock event, and then transmit the unlock event to the window management service of the framework layer. And, in the embodiment of the present application, the display driver can drive the display screen to Figure 5-Figure 9 The display of any of the user interfaces shown, and the playing of the unlocking animation.

[0127] Understandably, Fig.11 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 1000. In other embodiments of the present application, the electronic device 1000 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0128] After introducing the software and hardware structure of the electronic device, the display method of the embodiment of the present application will be described in conjunction with the accompanying drawings.

[0129] Fig.12 FIG. 1 is a flow chart of a display method provided by an embodiment of the present application. Fig.12 As shown, a display method provided by an embodiment of the present application may include steps S1201 to S1213. The above display method may be applicable to a scenario where the desktop layer is not destroyed.

[0130] S1201, after unlocking is completed, the lock screen module of the electronic device executes the lock screen exit process.

[0131] Regarding the unlocking completion process, in some embodiments, when the sensor driver detects the user's unlocking operation through the sensor, the sensor driver may generate an unlocking event. Furthermore, the sensor driver may transmit the unlocking event to the lock screen module, and the lock screen module may determine whether the user has successfully unlocked the device based on the unlocking event. Furthermore, when it is determined that the user has successfully unlocked the device, the lock screen exit process is triggered.

[0132] The lock screen module is used to process the lock screen process. In some embodiments, the lock screen module may include a lock screen view mediator module (KeyguardViewMediator). The lock screen view mediator module (KeyguardViewMediator) is the mediator of the lock screen module, and processes the lock screen (keyguard) state change as a mediator.

[0133] Regarding the specific implementation of S1201, in one embodiment, S1201 may include the following steps A1 and A2.

[0134] Step A1, the lock screen view mediator module (KeyguardViewMediator) can hide the lock screen interface (unlock interface) through the handhide function when a lock screen exit event is detected.

[0135] In step A2, the lock screen view mediator module (KeyguardViewMediator) executes the normal lock screen exit process through the doKeyguardGoingAway function, and notifies the synchronization module after the lock screen exit process. Among them, KeyguardViewMediator sends a notification message to the synchronization module to notify the synchronization module to exit the lock screen. Alternatively, the synchronization module can monitor whether KeyguardViewMediator executes the lock screen exit process, and there is no specific restriction on this.

[0136] It should be noted that in the embodiment of the present application, the lock screen module can also execute the lock screen exit process through other modules or methods, and there is no specific limitation on this.

[0137] Furthermore, it should be noted that, for each window to be displayed, when the lock screen is exited, the drawing starts. Accordingly, the window container corresponding to each window to be displayed synchronizes the drawing state of the window to be displayed when the lock screen is exited.

[0138] Optionally, after executing the lock screen exit process, the lock screen view mediator module (KeyguardViewMediator) can notify ActivityTaskManagerService (i.e., Android service, used to manage the launch and scheduling of activities). ActivityTaskManagerService uses the keyguardGoingAway function to determine whether it is an unlocking scene. And after determining that it is an unlocking scene, it notifies the synchronization module for processing.

[0139] S1202, the synchronization module determines whether the window to be displayed corresponding to each window container is the desktop in the scenario where the desktop layer is not destroyed. If the judgment result is yes, S1203 is executed, and if the judgment result is no, S1204 is executed.

[0140] The window container can be used to manage the drawing state of the window. Exemplarily, the window container can be implemented as WindowContainer. In the embodiment of the present application, one window to be displayed can correspond to one window container. And, after the drawing of the window to be displayed is completed, the drawing state of the window to be displayed can be modified to ready to show in the corresponding WindowContainer.

[0141] The window to be displayed may be a window that needs to be displayed in the foreground after the unlock is successful, and the number of windows may be one or more. In one embodiment, if the user successfully unlocks and the unlock animation is played (or the unlock animation may not be played), the following is displayed: Figure 5 In the example shown in FIG. 160 (traditional desktop, single window), the window to be displayed may include the desktop window. Accordingly, the window container may include the WindowContainer of the desktop window. In another embodiment, if the user successfully unlocks the computer, the following window may be displayed: Figure 7 The display shown has a floating window 170 (or PiP window), and the window to be displayed may include a floating window (or PiP window). In one example, if the user successfully unlocks the electronic device, Figure 7 In the interface shown (multi-window interface), the windows to be displayed may include the desktop window and the floating window. In another embodiment, if the user successfully unlocks and the animation is played (or the unlocking animation is not played), the Figure 4 If the application interface is shown, the window to be displayed may include the application window. Optionally, if a floating window or PiP is displayed above the application interface, the window to be displayed may include a floating window or a PiP window in addition to the application window.

[0142] The synchronization module can be used to synchronize the drawing states of the windows to be displayed. Exemplarily, the synchronization module can include BLASTSyncEngine. It should be noted that the synchronization module can also be other modules with synchronization functions, which are not specifically limited.

[0143] In some embodiments, after determining that the lock screen is exited, the synchronization module may traverse whether the drawing status of each window to be displayed (which may be referred to as the first window in this application) is synchronized, and execute steps S1202 to S1206 for each window container corresponding to the window to be displayed.

[0144] In a specific example, the synchronization module can traverse each window container through the tryfinish function. For example, BLASTSyncEngine can add the window container of the window to be displayed to the set to be synchronized (such as Syncgroup), and BLASTSyncEngine can traverse each window container in the set to be synchronized. During the traversal process, for each window container, BLASTSyncEngine can determine whether each window to be displayed has been drawn through the isSyncFinished function. Specifically, BLASTSyncEngine can determine whether each window container is a window (desktop window, floating window window or PiP window) that does not require state synchronization through the noNeedSyncWhenKeyguardGoingAway() function (i.e., subsequent S1202 and S1204). And, for windows that need to be synchronized, BLASTSyncEngine can monitor the drawing state of the window to be displayed corresponding to the window container to synchronize the drawing state of the window to be displayed corresponding to each window container. And, it should also be noted that in an embodiment of the present application, the synchronization module can synchronize the next window after a window to be displayed is drawn. Alternatively, the synchronization module may perform multiple rounds of traversal, and in each round of synchronization, the window container of the to-be-displayed window whose status value is FALSE is traversed. The embodiment of the present application does not specifically limit the traversal method of the synchronization module.

[0145] Regarding the specific implementation of S1202, in some embodiments, S1202 may include step A3.

[0146] Step A3, BLASTSyncEngine uses the windowState.mHwWSEx.isPermanentLauncher() function to detect whether the window to be displayed corresponding to each window container is a desktop window in a scenario where the desktop layer is not destroyed.

[0147] Optionally, in S1202, the synchronization module may also determine whether the window to be displayed is a desktop window. It should be noted that in the embodiment of the present application, other methods and functions may be used to determine whether the window to be displayed corresponding to each window container is a desktop window, and no specific limitation is made to this.

[0148] S1203, if the judgment result is yes (that is, the window to be displayed is the desktop layer and the desktop in the scene is not destroyed), the synchronization module does not wait for the desktop to be drawn, and sets the synchronization state of the window to be displayed (desktop) to synchronized.

[0149] Exemplarily, BLASTSyncEngine may set the synchronization state of the window to be displayed to TRUE (which may be referred to as the first state value in the embodiment of the present application, indicating that the drawing state of the window to be displayed has been synchronized) when it is determined that the window to be displayed is the desktop layer and the desktop in the scenario is not destroyed.

[0150] It should be noted that in the embodiment of the present application, other methods may be used to set the window to be displayed as synchronized, and there is no specific limitation on this.

[0151] S1204, if the judgment result is no (that is, the non-desktop layer of the window to be displayed does not destroy the desktop in the scene), the synchronization module can determine whether the window to be displayed is a floating window or PiP. If the judgment result is yes, execute S1205, if the judgment result is no, execute S1206.

[0152] Exemplarily, S1204 may include step A4.

[0153] Step A4, BLASTSyncEngine determines whether the window to be displayed is a floating window or PiP by curmode==WINDOWING_MODE_PINNED Ⅱcurmode==WINDOWING_MODE_FREEFORM. It should be noted that in the embodiment of the present application, other methods and functions can also be used to determine whether the window to be displayed corresponding to each window container is a floating window or PiP, and there is no specific limitation on this. Optionally, BLASTSyncEngine can also determine whether it is a lock screen exit scene during the synchronization of the drawing status of each window. For example, BLASTSyncEngine can determine whether it is a lock screen exit scene by getFlags()&TRANSIT_FLAG_KEYGUARD_GOING_AWAY)! = 0.

[0154] Also, by calling the noNeedSyncWhenKeyguardGoingAway() function, BLASTSyncEngine can use the windowState.mHwWSEx.isPermanentLauncher() function to determine whether the window to be displayed is the desktop. Also, by calling the above function, the curmode==WINDOWING_MODE_PINNED ‖ curmode== WINDOWING_MODE_FREEFORM function can be used to determine whether the window to be displayed is a floating window or PiP.

[0155] Furthermore, it should be noted that, in the embodiment of the present application, for each window to be displayed, the judgments of S1202 and S1204 may be performed sequentially, for example, first judging whether it is a desktop, and if not, then judging whether it is a floating window or a picture-in-picture. Alternatively, it may first judge whether it is a floating window or a picture-in-picture, and then judge whether it is a desktop. Alternatively, the two judgments may be performed simultaneously, and there is no specific restriction on the order of their sequence.

[0156] S1205: If the judgment result is yes (ie, the window to be displayed is a floating window or a PiP), the synchronization module does not wait for the floating window or the PiP to be drawn, and sets the synchronization state of the window to be displayed to synchronized.

[0157] It should be noted that the implementation method of S1205 is similar to that of S1203. Please refer to the relevant description of S1203 and it will not be described in detail.

[0158] S1206: If the judgment result is no, the synchronization module waits for the drawing of the window to be displayed to be completed, and determines that the window to be displayed has been synchronized.

[0159] Exemplarily, if the judgment result is no, it means that the window to be displayed is not a window such as a desktop, a floating window or a PiP that does not need to wait for its drawing to be completed. For example, the window to be displayed may be a window of an application interface.

[0160] For S1206, in some embodiments, for the window to be displayed, the synchronization module (BLASTSyncEngine) may call the isSyncFinished function for the window container of the window to be displayed to monitor whether the drawing of the window to be displayed is completed. When the drawing of the window to be displayed is completed, the window container corresponding to the window to be displayed will record the drawing state of the window as the drawing completion state (ready to show), and the window container will return a state value of TRUE to the synchronization module. The synchronization module may receive the state value TRUE returned by the window container to determine that the drawing state of the window to be displayed has been synchronized. Optionally, when the state synchronization of the window to be displayed has not been completed, the synchronization module may receive a state value FALSE (which may be referred to as a second state value in this application) returned by the window container.

[0161] It should be noted that in the embodiment of the present application, the synchronization module can also monitor the drawing status of the display window in other ways, and there is no specific limitation on this.

[0162] S1207: When the synchronization module determines that all windows to be displayed have been synchronized, the synchronization process ends.

[0163] In some embodiments, the synchronization module (BLASTSyncEngine) can call the finishnow function to end the current synchronization process when the status values ​​of all window containers are TRUE. It should be noted that in the embodiments of the present application, the synchronization process can also be ended by other functions, and there is no specific limitation on this. Optionally, after the synchronization process ends, BLASTSyncEngine can notify the dynamic effect interaction module (KeyguardTransitionHandler) through the switching module (Transitions).

[0164] S1208, after the synchronization process is completed, the motion effect interaction module notifies the motion effect playback module (including the unlock view management module and the motion effect player, and it should be noted that other modules may also be included, and there is no limitation to this) to perform motion effect processing.

[0165] Exemplarily, the dynamic effect interaction module can be implemented as KeyguardTransitionHandler. Among them, KeyguardTransitionHandler can be a callback interface in the Android framework responsible for processing the lock screen (keyguard) transition. Accordingly, S1208 can include step A4.

[0166] Step A4, KeyguardTransitionHandler calls the startAnimation function to notify the animation playing module to play the unlocking animation (or remote animation). It should be noted that in the embodiment of the present application, the synchronization process can also be ended by other functions besides the startAnimation function, and there is no specific limitation on this.

[0167] Optionally, KeyguardTransitionHandler can also use the IRemoteTransitionFinishedCallback function to enable the animation playback module to transmit a feedback after the animation processing is completed, so as to inform the unlock animation that the playback is completed by means of feedback.

[0168] In one example, KeyguardTransitionHandler can initialize the unlock animation through the unlock service (KeyguardService), and then notify the unlock view management module for subsequent judgment. For example, KeyguardService generates applications (apps) and wallpaper windows (wallpapers target) based on taskinfo (i.e., a function or method for obtaining task information). In addition, the transparency of the initial animation window (target) is 0. In addition, the animation start (onAnimationStart) of the corresponding runner is called.

[0169] S1209, the unlock view management module determines whether it is a desktop unlock scene. The desktop unlock scene may refer to the electronic device displaying the desktop after being unlocked.

[0170] In S1209, the unlock view module can determine whether the foreground window displayed after unlocking is the desktop. If the judgment result is no, step S1210 is executed, and if the judgment result is yes, step S1211 is executed. Alternatively, the unlock view management module can also determine whether it is a desktop unlocking scene, that is, a scene in which the electronic device displays the desktop after unlocking.

[0171] In some embodiments, the unlocking view management module may be implemented as an unlocking view manager HwKeyguardViewMediator. Accordingly, S1209 may include the following step A5.

[0172] Step A5, HwKeyguardViewMediato uses the isStartLauncherAnimationAndWallpaperTargetExist function to determine whether the desktop animation is started and the wallpaper window exists. If the judgment result is yes, it means that the desktop is displayed after unlocking, and the desktop unlocking animation needs to be played. And if the judgment result is no, it means that the application interface is displayed after unlocking, and the application unlocking animation needs to be played.

[0173] S1210: The unlock view management module determines whether it is a multi-window unlock scenario. The multi-window scenario may refer to an interface in which a floating window or a PiP interface is superimposed on the interface displayed by the electronic device after unlocking, such as Figure 7 It should be noted that the present application may also refer to an application interface superimposed with floating wear or PiP, and there is no specific limitation on this.

[0174] S1211, the animation player plays the desktop unlocking animation.

[0175] For the desktop unlocking animation, it may refer to the unlocking animation (or unlocking animation) played during the process of switching from the unlocking interface to the desktop. Figure 6 Related description of unlocking animation 3. In one example, the desktop unlocking animation can be a wallpaper animation. It should be noted that the desktop unlocking animation can also be implemented as other customized or default animations or animations according to the actual scene and specific settings, and there is no specific limitation on this.

[0176] In one embodiment, the animation player can be implemented as HnKeyguardRemoteAnimation. Taking wallpaper animation as an example, the specific implementation of S1211 is described. Specifically, S1211 can include the following steps A61 to A63.

[0177] Step A61: The animation player generates wallpaper animation using the static wallpaper, wherein the wallpaper animation may refer to a desktop unlocking animation generated using the static wallpaper.

[0178] For example, HnKeyguardRemoteAnimation can use the setStartWallpaperEnlargeScale function to generate wallpaper animation. It should be noted that HnKeyguardRemoteAnimation can also use other functions to generate other wallpaper animations, and there is no specific limitation on them.

[0179] Step A62, the animation player sends a notification to the desktop to notify the desktop application to display the desktop after the wallpaper animation is played. Specifically, the animation player can notify the desktop application to set the desktop transparency to 1, and notify the desktop application to make a callback. For example, HnKeyguardRemoteAnimation can use the startLauncherAnimationOnKeyguardExit function to notify the desktop application.

[0180] Step A63: The animation player plays the wallpaper animation. For example, HnKeyguardRemoteAnimation can use the startWallpaperScaleAnimation function to play the wallpaper animation.

[0181] Optionally, the animation player can also make a callback after the animation is finished. For example, the desktop application can set the desktop transparency to 1 and then call back to HnKeyguardRemoteAnimation. Then HnKeyguardRemoteAnimation can call back to KeyguardTransitionHandler through KeyguardService.

[0182] Also, it should be noted that after playing the desktop unlocking animation, the electronic device can display the following Figure 5 The desktop is shown.

[0183] S1212: The animation player does not play the lock screen animation.

[0184] In one embodiment, the animation player may not play the lock screen animation, but directly perform a callback. The specific content of the callback can refer to the relevant description in S1211, which will not be described in detail.

[0185] Also, it should be noted that the animation player does not play the lock screen animation. If the floating window or PiP is not finished drawing, the desktop 150 can be displayed first, and then after the floating window or PiP is finished drawing, the floating window or PiP can be displayed above the desktop 150. Also, if the floating window or PiP is finished drawing when switching from the unlock interface to the multi-window interface, it can be directly displayed. Figure 7 The multi-window interface shown.

[0186] S1213, the animation player plays the application unlocking animation.

[0187] In one embodiment, the animation player can be implemented as HnKeyguardRemoteAnimation. Specifically, S1213 can include the following steps A71 and A72.

[0188] Step A71, the animation player generates an application unlock animation. HnKeyguardRemoteAnimation can use the setStartOtherApplicationAnimation function to generate an application unlock animation.

[0189] Among them, the application unlocking animation can refer to the transition animation from the unlocking interface to the application interface (such as the interface of a third-party application), such as Figure 4 Unlock animation 2. It should be noted that HnKeyguardRemoteAnimation can also use other functions to generate other wallpaper animations, and there is no specific limitation on them.

[0190] Step A72, the animation player plays the application unlock animation when the lock screen is exited. For example, HnKeyguardRemoteAnimation can use the startOtherApplicationAnimationOnKeyguardExit function to play the application unlock animation.

[0191] Optionally, after step A73, S1213 may further include step A73.

[0192] Step A73, the animation player transmits back after the animation is finished. For example, HnKeyguardRemoteAnimation can use the finishedCallback.onAnimationFinished() function to transmit back. It should be noted that the transmission method is similar to the transmission method in the above embodiment, and the relevant description of the above embodiment can be referred to, which will not be repeated here.

[0193] In the above scheme provided in the embodiment of the present application, during the unlocking process of the electronic device, the synchronization module can set the synchronization status of the desktop window, floating window, and PiP window to the synchronized state (TRUE). Therefore, during the unlocking process, the electronic device can perform subsequent unlocking animation playback, post-unlocking interface display and other processes without waiting for the above-mentioned windows to be drawn, thereby saving the synchronization time of the above-mentioned windows, thereby shortening the unlocking time and improving the user's unlocking experience. Exemplarily, in the actual process, if the drawing status of the above-mentioned windows needs to be synchronized during the synchronization process, the waiting time of the synchronization process may include the drawing time of the above-mentioned windows and the synchronization time of the synchronization module, etc., while in the embodiment of the present application, there is no need to synchronize the drawing status of the above-mentioned windows, thereby saving 100 to 200 milliseconds of unlocking time and reducing the unlocking time.

[0194] After introducing the above technical solution, for ease of understanding, the specific implementation methods of the above display method in different scenarios are described below through multiple examples.

[0195] In the first example, taking the desktop unlocking scenario as an example, the window to be displayed includes the desktop, and the window container may include the window container corresponding to the desktop (hereinafter referred to as the desktop window container). After the unlocking is completed, the synchronization module can set the synchronization state value of the desktop window container to TRUE. Without waiting for the synchronization of the desktop drawing state, the animation interaction module can notify the animation playback module to play the desktop unlocking animation (such as the wallpaper zooming animation). At this time, the electronic device can play the following after exiting the unlocking interface: Figure 6 The wallpaper zooming effect is shown. And, after the wallpaper zooming effect is played, the electronic device can display the desktop.

[0196] In this example, the electronic device can play the subsequent unlocking animation and display the desktop without waiting for the synchronization of the drawing state of the desktop window, saving the time consumed in waiting for the desktop drawing to be completed during the synchronization process and the time it takes for the synchronization module to synchronize the desktop, thereby shortening the unlocking time and improving the user's unlocking experience.

[0197] In the second example, taking the multi-window unlocking scenario as an example, the windows to be displayed may include the desktop and the floating window. After the unlocking is completed, the floating window begins to draw. Also, if the synchronization module traverses to the desktop window container, it can set its synchronization status value to TRUE. Also, when the synchronization module traverses to the floating window window container (that is, the window container corresponding to the floating window), it can set its synchronization status value to TRUE. At this time, there is no need to wait for the desktop and the floating window to be drawn. The electronic device can display the next interface of the unlocking interface. For example, if the floating window has been drawn at this time, the electronic device can directly display the next interface of the lock screen interface as shown below. Figure 7 Furthermore, if the floating window is not finished drawing at this time, the electronic device can first display the desktop, and after the floating window is finished drawing, the floating window is superimposed and displayed on the desktop.

[0198] It should be noted that the processing method for floating windows in this example is also applicable to PiP. The implementation method of PiP can refer to the relevant description of this example, which will not be repeated here.

[0199] In this example, the electronic device can play the subsequent unlocking animation and display the desktop without waiting for the synchronization of the drawing status of the desktop window and the floating window, saving the time required to wait for the desktop and the floating window to be drawn during the synchronization process and the time taken by the synchronization module to synchronize the desktop, thereby shortening the unlocking time and improving the user's unlocking experience.

[0200] In the third example, taking the unlocking scenario of the application interface as an example, the window to be displayed may include the application interface of a third-party application. After the unlocking is completed, the application interface of the third-party application begins to be drawn. And, if the synchronization module traverses to the window container of the application interface, the drawing state of the application interface can be synchronized through the window container. If the drawing state of the application interface in the window container changes to "ready to show", the window container can return TRUE to the synchronization module, at which time the synchronization module can end the synchronization. After the synchronization ends, the electronic device can generate an application unlocking animation and play it, and display the application interface after the playback ends.

[0201] Optionally, in an embodiment of the present application, if a floating window or PiP is displayed above the application interface, the display method of the floating window or PiP can refer to the description of the previous example, and will not be repeated here.

[0202] After introducing the display scheme in the scenario where the desktop layer is not destroyed through the above content, the display scheme in the scenario where the desktop layer is destroyed will be described in conjunction with the accompanying drawings.

[0203] Fig.13 FIG. 2 is a flow chart of another display method provided by an embodiment of the present application. Fig.13 As shown, a display method provided by an embodiment of the present application may include steps S1201 to S1213. The above display method may be applicable to a scenario where a desktop layer is destroyed. S1301, after unlocking, the lock screen module of the electronic device executes a lock screen exit process.

[0204] It should be noted that the specific implementation of S1301 can refer to the relevant description of S1201, which will not be repeated here. S1302, the lock screen module mounts the wallpaper.

[0205] In some embodiments, the lock screen module can mount the wallpaper by calling forceshowwallpaper. Exemplarily, the lock screen module can generate the wallpaper and display the wallpaper to achieve the mounting of the wallpaper.

[0206] It should be noted that in the embodiment of the present application, the lock screen module can notify the synchronization module after exiting the lock screen process, or notify the synchronization module after the wallpaper is mounted, and there is no specific limitation on this.

[0207] S1303: After the wallpaper is mounted, the window container starts to synchronize the drawing state of the window to be displayed.

[0208] S1304, the synchronization module determines whether the window to be displayed is a floating window or a PiP, if the judgment result is yes, execute S1305, if the judgment result is no, execute S1306.

[0209] In some embodiments, the window containers of the windows to be displayed may constitute a to-be-synchronized set, and the synchronization module sequentially traverses the window containers in the to-be-synchronized set.

[0210] Exemplarily, BLASTSyncEngine determines whether the window to be displayed is a floating window or a PiP by setting curmode==WINDOWING_MODE_PINNED Ⅱcurmode==WINDOWING_MODE_FREEFORM.

[0211] It should be noted that for other contents of S1304, reference can be made to the relevant description of S1204, which will not be described in detail here.

[0212] S1305: If the judgment result is yes (ie, the window to be displayed is a floating window or a PiP), the synchronization module does not wait for the floating window or the PiP to be drawn, and sets the synchronization state of the window to be displayed to synchronized.

[0213] S1306: If the judgment result is no, the synchronization module waits for the drawing of the window to be displayed to be completed, and determines that the window to be displayed has been synchronized.

[0214] For example, if the window to be displayed is a desktop or an application interface, after the window to be displayed is drawn, the drawing state recorded in the window container corresponding to the window to be displayed changes to the drawing completion state (ready to show), and the window container returns a state value of TRUE. The synchronization module can receive the state value TRUE returned by the window container and determine that the drawing state of the window to be displayed has been synchronized.

[0215] It should be noted that for other contents of S1306, reference can be made to the relevant description of S1206 in the above part of the embodiment of the present application, which will not be repeated here.

[0216] S1307: When the synchronization module determines that all windows to be displayed have been synchronized, the synchronization process ends.

[0217] It should be noted that for other contents of S1307, reference can be made to the relevant description of S1207, which will not be repeated here.

[0218] S1308, after the synchronization process is completed, the motion effect interaction module notifies the motion effect playback module (including the unlock view management module and the motion effect player, and it should be noted that it may also include other modules, which is not limited to this) to perform motion effect processing.

[0219] It should be noted that for other contents of S1308, reference can be made to the relevant description of S1208, which will not be elaborated here.

[0220] S1309, the unlock view management module determines whether it is a desktop unlock scene. The desktop unlock scene may refer to the electronic device displaying the desktop after being unlocked.

[0221] S1310: The unlock view management module determines whether it is a multi-window unlock scenario.

[0222] It should be noted that for other contents of S1310, reference can be made to the relevant description of S1210, which will not be elaborated here.

[0223] S1311, the animation player plays the desktop unlocking animation.

[0224] It should be noted that for other contents of S1311, reference can be made to the relevant description of S1211, which will not be elaborated here.

[0225] S1312: The animation player does not play the lock screen animation.

[0226] It should be noted that for other contents of S1312, reference can be made to the relevant description of S1212, which will not be elaborated here.

[0227] S1313, the animation player plays the application unlocking animation.

[0228] It should be noted that for other contents of S1313, reference can be made to the relevant description of S1212, which will not be elaborated here.

[0229] In the above scheme provided in the embodiment of the present application, during the unlocking process of the electronic device, the synchronization module can set the synchronization status of the floating window and the PiP window to the synchronized state (TRUE). Therefore, during the unlocking process, the electronic device can perform subsequent unlocking animation playback, post-unlocking interface display and other processes without waiting for the above-mentioned window to be drawn to be completed, thereby saving the synchronization time of the above-mentioned windows, thereby shortening the unlocking time and improving the user's unlocking experience. Exemplarily, in the actual process, if the drawing state of the above-mentioned windows needs to be synchronized during the synchronization process, the waiting time of the synchronization process may include the drawing time of the above-mentioned windows and the synchronization time of the synchronization module, etc., while in the embodiment of the present application, there is no need to synchronize the drawing state of the above-mentioned windows, thereby reducing the unlocking time.

[0230] Also, when the window is synchronized and the dynamic effect is processed, the electronic device can display the wallpaper first, avoiding the black screen after the unlock interface is exited, and improving the user's unlocking experience. It should be noted that in the embodiment of the present application, according to the actual situation, other static pictures or dynamic pictures besides the wallpaper can also be displayed, and there is no specific limitation on this.

[0231] After introducing the above technical solution, for ease of understanding, the specific implementation methods of the above display method in different scenarios are described below through multiple examples.

[0232] In the first example, taking the desktop unlocking scenario as an example, the window to be displayed includes the desktop, and the window container may include a window container corresponding to the desktop (hereinafter referred to as the desktop window container). After the unlocking is completed, the desktop begins to draw, and the desktop window container begins to synchronize the drawing state of the desktop. Also, if the synchronization module traverses to the desktop window container, the drawing state of the desktop can be synchronized through the window container. If the drawing state of the desktop in the window container changes to "ready to show", the window container can return TRUE to the synchronization module, at which point the synchronization module can end the synchronization. After the synchronization ends, the electronic device can generate and play a desktop unlocking animation, and display the desktop after the playback ends.

[0233] At this time, the electronic device can display the wallpaper after exiting the unlock interface, and generate and play the wallpaper zooming animation (i.e., the desktop unlocking animation) after the desktop is drawn. And, after the wallpaper zooming animation is played, the electronic device can display the desktop.

[0234] In the second embodiment, taking the unlocking scenario of multiple windows as an example, the windows to be displayed may include the desktop and the floating window. The processing method of the desktop window can refer to the description of the previous example, which will not be repeated here.

[0235] For the floating window, after the unlocking is completed, the floating window starts to be drawn. And, when the synchronization module traverses the floating window window container (i.e., the window container corresponding to the floating window), its synchronization state value can be set to TRUE. At this time, after the window drawing is completed, the electronic device can display the next interface of the unlocking interface without waiting for the floating window to be drawn.

[0236] For example, the electronic device can display the wallpaper after exiting the unlock interface. Also, after the desktop is drawn, if the floating window has been drawn, the electronic device can directly display the next interface of the lock screen interface. Figure 7 Furthermore, if the floating window is not finished drawing at this time, the electronic device can first display the desktop, and after the floating window is finished drawing, the floating window is superimposed and displayed on the desktop.

[0237] It should be noted that the processing method for floating windows in this example is also applicable to PiP. The implementation method of PiP can refer to the relevant description of this example, which will not be repeated here.

[0238] In this example, the electronic device can play the subsequent unlocking animation and display the desktop without waiting for the synchronization of the drawing status of the floating window, saving the time required to wait for the floating window to be drawn during the synchronization process and the time taken by the synchronization module to synchronize the desktop, thereby shortening the unlocking time and improving the user's unlocking experience.

[0239] In the third example, taking the unlocking scenario of the application interface as an example, the window to be displayed may include the application interface of a third-party application. The electronic device may first mount the wallpaper, and after the application interface is drawn, generate and play the application unlocking animation, and display the application interface after the playback is completed. It should be noted that the display method of the application interface can refer to the relevant description of the desktop display method in the above example, that is, it will not be repeated here.

[0240] Optionally, in an embodiment of the present application, if a floating window or PiP is displayed above the application interface, the display method of the floating window or PiP can refer to the description of the previous example, and will not be repeated here.

[0241] It is understandable that, in order to realize the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0242] In one example, Fig.14 A schematic block diagram of a device 1400 according to an embodiment of the present application is shown. The device 1400 may include: a processor 1401 and a transceiver / transceiver pin 1402 , and optionally, a memory 1403 .

[0243] The components of the device 1400 are coupled together via a bus 1404, wherein the bus 1404 includes a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, all buses are referred to as bus 1404 in the figure.

[0244] Optionally, the memory 1403 may be used for the instructions in the aforementioned method embodiment. The processor 1401 may be used to execute the instructions in the memory 1403, and control the receiving pin to receive a signal, and control the sending pin to send a signal.

[0245] The apparatus 1400 may be the electronic device or a chip of the electronic device in the above method embodiment.

[0246] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0247] The steps performed by the electronic device 1000 in the display method provided in the above embodiment of the present application may also be performed by a chip system included in the electronic device 100, wherein the chip system may include a processor and a Bluetooth chip. The chip system may be coupled to a memory so that when the chip system is running, the computer program stored in the memory is called to implement the steps performed by the above electronic device 1000. The processor in the chip system may be an application processor or a processor other than an application processor.

[0248] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display method, characterized in that: The method is applied to an electronic device, and the method comprises: In response to an unlocking operation of a user, acquiring at least one first window, where the first window is a window displayed on the electronic device after unlocking; In a case where the at least one first window includes a first target window, setting a first state value for the first target window, the first state value being used to indicate that the first target window has been drawn, wherein when the first state value is set for the first target window, the electronic device does not need to wait for the first target window to be drawn; In a case where the at least one first window has a first state value, the at least one first window is displayed on the electronic device.

2. The method according to claim 1, characterized in that In a case where the at least one first window is set with a first state value, before the electronic device displays the at least one first window, the method further includes: In a case where the at least one first window includes a second target window, acquiring a drawing state of the second target window; When the second target window is in a first state, it is determined that the second target window has the first state value, where the first state is used to indicate that the window has been drawn.

3. The method according to claim 2, characterized in that The electronic device comprises a synchronization module and a first window container; Obtaining the drawing state of the second target window includes: The synchronization module obtains the drawing state of the second target window through the first window container; The step of determining, when the second target window is in the first state, that the second target window has the first state value includes: After the second target window is in the first state, the synchronization module receives the first state value sent by the first window container.

4. The method according to claim 1, characterized in that: The desktop layer of the electronic device is saved after the screen is locked, and the first target window includes a desktop window and / or a first display window, wherein the first display window includes a floating window and / or a picture-in-picture window; In the case where the at least one first window includes a first target window, setting a first state value for the first target window includes: For a single first window, when the single first window is the desktop window, setting the first state value for the desktop window; In a case where the single first window is the first display window, the first state value is set for the first display window.

5. The method according to claim 1, characterized in that The desktop layer of the electronic device is destroyed after the screen is locked, and the first target window includes a first display window, wherein the first display window includes a floating window and / or a picture-in-picture window; In the case where the at least one first window includes a first target window, setting a first state value for the first target window includes: For a single first window, when the single first window is the first display window, the first state value is set for the first display window.

6. The method according to claim 5, characterized in that Before acquiring at least one first window, the method further includes: Exit the lock screen state; Display wallpaper.

7. The method according to claim 1, characterized in that The at least one first window is a desktop window, and displaying the at least one first window on the electronic device includes: Generate the first animation effect; Play the first animation effect; After the first motion effect is played, the desktop window is displayed.

8. The method according to claim 1, characterized in that The at least one first window includes a desktop window and a first display window, wherein the first display window includes a floating window and / or a picture-in-picture window; The at least one first window is a desktop window, and displaying the at least one first window on the electronic device includes: Displaying the desktop window; After the first display window is drawn, the first display window is displayed above the desktop window.

9. An electronic device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored on the memory and when the computer programs are executed by the one or more processors, cause the processors to perform the following steps: In response to an unlocking operation of a user, acquiring at least one first window, where the first window is a window displayed on the electronic device after unlocking; In a case where the at least one first window includes a first target window, setting a first state value for the first target window, the first state value being used to indicate that the first target window has been drawn, wherein when the first state value is set for the first target window, the electronic device does not need to wait for the first target window to be drawn; In a case where the at least one first window has a first status value, the at least one first window is displayed on the electronic device.

10. A computer-readable storage medium, characterized in that: The invention comprises a computer program, characterized in that when the computer program is run on an electronic device, the electronic device executes the display method as claimed in any one of claims 1 to 8.

11. A chip or a chip system, characterized in that: The method comprises a processing circuit and an interface circuit, wherein the interface circuit is used to receive code instructions and transmit the code instructions to the processing circuit, and the processing circuit is used to run the code instructions to execute the display method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Unlocking control method and related products

    CN107193472A

  • Information display method, information display device, electronic equipment and storage medium

    CN117009008A