Dynamic effect display method and device for lock screen interface

Abstract

The embodiment of the invention provides a dynamic effect display method and device for a lock screen interface, relates to the field of terminals, and can reduce power consumption generated when electronic equipment performs face unlocking. The method is applied to the electronic equipment and comprises the steps of displaying a screen locking interface in response to a first screen turn-on operation; wherein the screen locking interface comprises an icon for indicating that the electronic equipment is performing face unlocking; the screen locking interface does not display the dynamic effect of the icon and does not comprise first prompt information, and the first prompt information prompts that the electronic equipment is performing face recognition; in response to the recognized face, displaying a first dynamic effect of the icon; wherein the first dynamic effect prompts that the electronic equipment is performing face unlocking; and in response to successful face recognition, exiting the screen locking interface.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminals, and more particularly to a method and device for displaying dynamic effects on a lock screen interface. Background Art

[0002] At present, electronic devices (such as mobile phones) generally support face unlocking. When a user sets face unlocking on an electronic device, the electronic device can automatically recognize the face when the user triggers the electronic device to enter the lock screen state. In addition, the electronic device can prompt the user of the face recognition status in real time, for example, through text and animation effects. However, this solution of real-time feedback of face recognition status consumes a lot of power. Summary of the invention

[0003] The embodiments of the present application provide a method and device for displaying dynamic effects on a lock screen interface, which can reduce the power consumption generated when an electronic device performs face unlocking.

[0004] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0005] In a first aspect, a method for displaying dynamic effects of a lock screen interface is provided, which is applied to an electronic device, and a face unlocking function of the electronic device is turned on. The method comprises: in response to a first screen-lighting operation, displaying the lock screen interface; wherein the lock screen interface comprises an icon indicating that the electronic device is performing face unlocking; the lock screen interface does not display the dynamic effects of the icon, and does not include a first prompt information, and the first prompt information prompts that the electronic device is performing face recognition; in response to recognizing a face, displaying a first dynamic effect of the icon; wherein the first dynamic effect prompts that the electronic device is performing face unlocking; in response to successful face recognition, exiting the lock screen interface.

[0006] Based on the method provided in the embodiment of the present application, in response to the first screen-on operation, the face unlock icon's animation will not be displayed immediately, and the prompt message that face recognition is in progress will not be displayed. Instead, the first animation of the icon will be displayed when a face is recognized. In this way, the feedback on face unlock is more accurate and power consumption can be saved.

[0007] In one possible implementation, in response to recognizing a face, displaying the first motion effect of an icon includes: in response to recognizing a face, and after a preset time has passed since the first screen-lighting operation was received, displaying the first motion effect of the icon. In this way, the first motion effect of the icon is displayed only when the conditions that a face is detected and a preset time has passed since the first screen-lighting operation was received are met. In this way, the feedback on face unlocking is more accurate and power consumption can be saved. It can be understood that since the preset time is short, although the first motion effect is not displayed before the preset time is reached, it will not affect the user experience. Moreover, after the preset time is reached and a face is detected, the first motion effect is displayed, the feedback on face unlocking is more accurate, and the waiting time perceived by the user can be reduced.

[0008] In one possible implementation, in response to recognizing a face, and after a preset time has passed since the first screen-lighting operation was received, the first motion effect of the icon is displayed, including: if the time difference between the first time point and the second time point is greater than or equal to the preset time, the first motion effect of the icon is displayed immediately; if the time difference between the first time point and the second time point is less than the preset time, the first motion effect screen is displayed after a delay of the first time, and the first time is the difference between the time difference and the preset time; wherein the first time is the time when the first screen-lighting operation is received, and the second time is the time when the face is recognized. That is, when a face is recognized, the preset time has passed since the screen-lighting operation was received, and the first motion effect of the icon (e.g., the lock logo) can be displayed immediately. In this way, the feedback on face unlocking is more accurate and power consumption can be saved.

[0009] In a possible implementation, the method further includes: in response to a failure in face recognition, displaying a second dynamic effect of the icon; wherein the second dynamic effect prompts the user to restart face recognition; in response to an operation to restart face recognition, restarting face recognition; in response to recognizing a face, displaying a first dynamic effect of the icon; wherein the first dynamic effect prompts the electronic device to perform face unlocking. In this way, the user can be promptly fed back that the current face recognition is unsuccessful, and the user can be reminded to retry in time to ensure user experience.

[0010] In one possible implementation, the electronic device includes a lock screen application, a face recognition framework, and a camera. In response to recognizing a face, the first motion effect of the icon is displayed, including: the lock screen application registers a face event with the face recognition framework; the face recognition framework starts the camera; collecting image data includes: the camera collects image data; the face recognition framework recognizes the face based on the image data; if the face recognition framework recognizes the face based on the image data, the face recognition framework returns a face event to the lock screen application, and the face event is used to indicate that the face is recognized based on the image data; the lock screen application receives the face event from the face recognition framework; in response to receiving the face event, the lock screen application displays the first motion effect of the icon. In response to receiving the face event, the lock screen application displays the first motion effect of the icon. In this way, the feedback on face unlocking is more accurate and power consumption can be saved.

[0011] In a possible implementation, the first animation effect is a breathing animation effect, which has low power consumption and can save power consumption.

[0012] In a second aspect, a method for displaying dynamic effects of a lock screen interface is provided, which is applied to an electronic device, and the face unlocking function of the electronic device is turned on. The method includes: in response to a first screen-lighting operation, displaying the lock screen interface; wherein the lock screen interface includes an icon indicating that the electronic device is performing face unlocking; the lock screen interface does not include a first prompt information, and the first prompt information prompts that the electronic device is performing face recognition; after a preset time has passed since the first screen-lighting operation was received, a first dynamic effect of the icon is displayed; wherein the first dynamic effect prompts that the electronic device is performing face unlocking; in response to successful face recognition, exiting the lock screen interface.

[0013] Based on the method provided in the embodiment of the present application, in response to the first screen-on operation, the face unlock icon's dynamic effect will not be displayed immediately, and the prompt information that face recognition is in progress will not be displayed. Instead, the first dynamic effect of the icon will be displayed after a preset time has passed since the first screen-on operation was received. In this way, power consumption can be saved. It is understandable that since the preset time is short, although the first dynamic effect is not displayed before the preset time is reached, it will not affect the user experience.

[0014] In a possible implementation, after a preset time has passed since the first screen-lighting operation was received, displaying the first motion effect of the icon includes: in response to recognizing a face, and after a preset time has passed since the first screen-lighting operation was received, displaying the first motion effect of the icon. That is, after the preset time has expired and a face is detected, the first motion effect is displayed. In this way, the feedback on face unlocking is more accurate, and the waiting time perceived by the user can be reduced.

[0015] In one possible implementation, in response to recognizing a face and after a preset time has passed since a first screen-lighting operation was received, a first motion effect of an icon is displayed, including: if the time difference between a first time point and a second time point is greater than or equal to a preset time, the first motion effect of the icon is displayed immediately; if the time difference between the first time point and the second time point is less than a preset time, the first motion effect screen is displayed after a delay of a first time, where the first time is the difference between the time difference and the preset time; wherein the first time is the time when the first screen-lighting operation is received, and the second time is the time when the face is recognized.

[0016] In one possible implementation, the method also includes: in response to a failure of face recognition, displaying a second animation of the icon; wherein the second animation prompts the user to restart face recognition; in response to an operation of restarting face recognition, restarting face recognition; in response to recognizing a face, displaying a first animation of the icon; wherein the first animation prompts the electronic device that face unlocking is being performed.

[0017] In one possible implementation, an electronic device includes a lock screen application, a face recognition framework and a camera, and in response to recognizing a face, displays a first motion effect of an icon, including: the lock screen application registers a face event with the face recognition framework; the face recognition framework starts the camera; collecting image data includes: the camera collects image data; the face recognition framework recognizes the face based on the image data; if the face recognition framework recognizes the face based on the image data, the face recognition framework returns a face event to the lock screen application, and the face event is used to indicate that the face is recognized based on the image data; the lock screen application receives the face event from the face recognition framework; in response to receiving the face event, the lock screen application displays the first motion effect of the icon.

[0018] In a third aspect, the present application provides a computer-readable storage medium, the computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device (such as a mobile phone), the electronic device executes the method described in the first aspect or the second aspect and any possible design thereof.

[0019] In a fourth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in the first aspect or the second aspect and any possible design thereof.

[0020] In a fifth aspect, an embodiment of the present application provides a device for displaying dynamic effects on a lock screen interface, including a processor, the processor and a memory are coupled, the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the device implements the method described in the first aspect or the second aspect and any possible design thereof. The device may be an electronic device or a server device; or may be a component of an electronic device or a server device, such as a chip.

[0021] In the sixth aspect, an embodiment of the present application provides a dynamic effect display device for a lock screen interface, and the device can be divided into different logical units or modules according to functions, and each unit or module performs different functions, so that the device executes the method described in the first aspect or the second aspect and any possible design method thereof.

[0022] In a seventh aspect, the present application provides a chip system, which includes one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by lines. The above chip system can be applied to an electronic device including a communication module and a memory. The interface circuit is used to receive a signal from the memory of the electronic device and send the received signal to the processor, where the signal includes a computer instruction stored in the memory. When the processor executes the computer instruction, the electronic device can execute the method described in the first aspect or the second aspect and any possible design thereof.

[0023] It can be understood that the beneficial effects that can be achieved by the computer-readable storage medium described in the third aspect, the computer program product described in the fourth aspect, the devices described in the fifth aspect and the sixth aspect, and the chip system described in the seventh aspect provided above can refer to the beneficial effects in the first aspect or the second aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram showing the related technology;

[0025] Figure 2 A timing diagram of the related technology;

[0026] Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0027] Figure 4 A schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0028] Figure 5 A display schematic diagram provided for an embodiment of the present application;

[0029] Figure 6 Another display schematic diagram provided for an embodiment of the present application;

[0030] Figure 7 Another display schematic diagram provided for an embodiment of the present application;

[0031] Figure 8 A signal interaction diagram provided in an embodiment of the present application;

[0032] Fig. 9 A schematic diagram of the interaction between modules provided in an embodiment of the present application;

[0033] Fig.10 A schematic diagram of another type of module interaction provided in an embodiment of the present application;

[0034] Fig.11 A timing diagram provided for an embodiment of the present application;

[0035] Fig.12 Another timing diagram provided for an embodiment of the present application;

[0036] Fig.13 Another timing diagram provided for an embodiment of the present application;

[0037] Fig.14 Another display schematic diagram provided for an embodiment of the present application;

[0038] Fig.15 Another display schematic diagram provided for an embodiment of the present application;

[0039] Fig.16 Another timing diagram provided for an embodiment of the present application;

[0040] Fig.17 Another timing diagram provided for an embodiment of the present application;

[0041] Fig.18 A further signal interaction diagram provided in an embodiment of the present application;

[0042] Fig.19 Another display schematic diagram provided for an embodiment of the present application;

[0043] Fig. 20 A further signal interaction diagram provided in an embodiment of the present application;

[0044] Fig.21 Another display schematic diagram provided for an embodiment of the present application;

[0045] Fig. 22 A schematic diagram of the structure of the chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] At present, when a user sets face unlock on an electronic device, the electronic device can automatically recognize the face when the user triggers the electronic device to enter the lock screen state. In addition, the electronic device can prompt the user of the face recognition status in real time, for example, through text and animation effects.

[0047] For example, taking the electronic device as a mobile phone as an example, Figure 1As shown in (a) in the figure, when the user triggers the mobile phone to enter the lock screen state, the mobile phone can start face recognition and display the lock screen interface 01 at the same time. The lock screen interface 01 may include a lock logo 02 and text prompt information 03. The lock logo 02 may display a real-time dynamic effect (for example, a breathing dynamic effect), and the text prompt information 03 may be "recognizing face" to prompt the user that face recognition is in progress. For another example, Figure 1 As shown in (b) in FIG. 1 , when the user triggers the mobile phone to enter the lock screen light state, the mobile phone can display the lock screen interface 04. The lock screen interface 04 can include a face logo 05, and the face logo 05 can display a dynamic effect (for example, a left and right shaking dynamic effect) in real time to prompt the user that face recognition is in progress.

[0048] like Figure 2 As shown in (a) in Figure 1 In the prompt scheme shown in (a), when the mobile phone starts face recognition, the lock screen interface 01 can be displayed, and the lock icon 02 in the lock screen interface 01 can display dynamic effects in real time, and the text prompt information 03 can be displayed in real time until the face recognition is successful. Figure 2 As shown in (b) in Figure 1 In the prompt scheme shown in (b), the mobile phone can display the lock screen interface 04 while starting face recognition, and the face logo 05 in the lock screen interface 04 can display dynamic effects in real time until the face recognition is successful.

[0049] However, the above-mentioned solution of real-time feedback of face recognition status consumes a lot of power. Considering that users unlock electronic devices many times a day, the power consumption caused by each unlocking will accumulate to be a large expense. For example, taking the electronic device as a mobile phone, assuming that the user unlocks the phone 76 times a day on average, and the average unlocking time is 1s, the current increment is 330mA and the battery capacity is 5000mAh. The power consumption of the user's daily unlocking is: 76*1*330mA=25080mAs≈7mAh, 7mAh / 5000mA=0.14%. That is, the power consumption of unlocking every day is 0.14% of the battery capacity of the electronic device. Therefore, how to reduce the power consumption of unlocking has become an urgent problem to be solved.

[0050] The present application provides a method and device for displaying dynamic effects on a lock screen interface, which can reduce the power consumption generated when an electronic device performs face unlocking.

[0051] Figure 3 A schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application.

[0052] like Figure 3As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0053] Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0054] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0055] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0056] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0057] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0058] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0059] It is understandable that the interface connection relationship between the modules shown in this embodiment is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0060] The charging management module 140 is used to receive charging input from a charger. While the charging management module 140 is charging the battery 142 , it can also power the electronic device through the power management module 141 .

[0061] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. In some other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

[0062] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0063] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network.

[0064] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0065] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194.

[0066] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0067] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0068] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0069] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), a light-emitting diode (LED), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc.

[0070] The electronic device 100 can realize the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor. The ISP is used to process the data fed back by the camera 193. The camera 193 is used to capture static images or videos. The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0071] The camera 193 may include 1 to N cameras. For example, the electronic device may include 2 front cameras and 4 rear cameras. Among them, the front camera may include a TOF camera. The TOF camera includes TX and RX, TX can be used to transmit light signals (infrared light or laser pulses), and RX can be used to receive imaging. TX can be, for example, an infrared light transmitter. RX can be, for example, a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) image sensor.

[0072] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0073] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in an external memory card. The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 can execute various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. For example, in an embodiment of the present application, the processor 110 can execute instructions stored in the internal memory 121, and the internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0074] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0075] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.

[0076] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive the button input and generate a key signal input related to the user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.

[0077] The methods in the following embodiments can all be implemented in the electronic device 100 having the above hardware structure.

[0078] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0079] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through interfaces. In some embodiments, the Android system may include an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, a hardware abstraction layer (HAL) and a kernel layer. It should be noted that the embodiments of the present application are illustrated by taking the Android system as an example. In other operating systems (such as Hongmeng system, IOS system, etc.), as long as the functions implemented by each functional module are similar to those of the embodiments of the present application, the solutions of the present application can also be implemented.

[0080] Among them, the application layer can include a series of application packages.

[0081] like Figure 4 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, lock screen application, setting application, etc. Of course, the application layer may also include other application packages, such as payment application, shopping application, banking application, chat application or financial application, etc., which are not limited in this application.

[0082] Among them, the setting application has the function of setting face unlocking and recording faces, and the recorded faces are used for face unlocking. The lock screen application has the function of performing face unlocking in response to the user's screen light operation (for example, pressing the power button or lifting the operation). Of course, the lock screen application can also perform unlocking processes such as fingerprint unlocking and password unlocking, which are not limited in this application. The embodiments of this application are mainly explained by taking face unlocking as an example.

[0083] The application framework layer provides an application programming interface (API) and a programming framework for the application programs in the application layer. The application framework layer includes some predefined functions. For example, it may include an activity manager, a window manager, a content provider, a view system, a resource manager, a notification manager, a camera service, and a face recognition service, etc., and the embodiments of the present application do not impose any restrictions on this.

[0084] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0085] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0086] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0087] OpenGL ES is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0088] SGL is a graphics engine for 2D graphics.

[0089] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system. The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0090] The HAL layer is an encapsulation of the Linux kernel driver, providing an interface to the upper layer and shielding the implementation details of the low-level hardware.

[0091] The HAL layer may include Wi-Fi HAL, audio HAL, camera HAL, and face recognition control module (Face CA).

[0092] Among them, the camera HAL is the core software framework of the camera. The face recognition control module is the core software framework / application of face recognition.

[0093] Optionally, the software system of the electronic device 100 may further include a Face Trusted Application (Face TA), which is an application for face recognition running in a TEE environment (not shown in the figure). In the embodiment of the present application, Face TA is referred to as a face recognition TA.

[0094] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0095] Among them, the camera driver is the driver layer of the Camera device, which is mainly responsible for the interaction with the hardware.

[0096] The hardware layer includes displays, cameras, etc. Among them, the camera can be used to collect image data.

[0097] In the embodiment of the present application, modules such as face recognition service, camera service, face recognition module, camera HAL, camera driver, face recognition TA, etc. can constitute a face recognition framework. The face recognition framework can be regarded as a bridge for information exchange between the lock screen application and the camera. Due to the existence of the face recognition framework, the lock screen application does not need to pay attention to the underlying logic.

[0098] The technical scheme in the embodiment of the present application will be described below in conjunction with the drawings in the embodiment of the present application. Wherein, in the description of the present application, unless otherwise specified, "at least one" refers to one or more, and "a plurality of" refers to two or more than two. In addition, in order to facilitate the clear description of the technical scheme of the embodiment of the present application, in the embodiment of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. Those skilled in the art will understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not limit necessarily different.

[0099] For ease of understanding, taking a mobile phone as an electronic device as an example, the process of setting up face unlocking is introduced with reference to the accompanying drawings.

[0100] In the embodiment of the present application, the user can set up face unlocking on a mobile phone (for example, mobile phone A). Figure 5 As shown in (a) of FIG. 1 , in response to the user clicking on the setting application 302 on the main interface 301 of the mobile phone (for example, mobile phone A), the mobile phone displays the following Figure 5 In the setting interface 303 shown in (b) of FIG. 303, multiple setting options may be included, such as a personal account setting item (e.g., Glen Gao), a WLAN setting item, a Bluetooth setting item, a mobile network setting item, a more connection setting item, a security and privacy setting item, etc. In response to the user's operation (e.g., a click operation) on the control 304 corresponding to the security and privacy setting item, as shown in FIG. Figure 5 As shown in (c) of FIG. 3 , the mobile phone may display a security and privacy interface 305. The security and privacy interface 305 may include multiple setting items, such as a fingerprint setting item, a face recognition setting item, a lock screen password setting item, etc. In response to the user's operation (e.g., a click operation) on the control 306 corresponding to the face recognition setting item, as shown in FIG. Figure 5 As shown in (d) in FIG. 3 , the mobile phone may display a face recognition interface 307. Optionally, before the mobile phone displays the face recognition interface 307, a password input interface may be displayed to require the user to enter a lock screen password. When the entered lock screen password is correct, the mobile phone displays the face recognition interface 307. The face recognition interface 307 may include an unlock screen setting item, a smart display lock screen notification setting item, and other setting items. For example, other setting items may include a pick up the phone to light up the screen setting item.

[0101] like Figure 6 As shown in (a) in FIG. 1 , in response to the user's operation (eg, a click operation) on the control 308 corresponding to the unlock screen setting item, as shown in FIG. Figure 6 As shown in (b) of FIG. 3 , the mobile phone may display a pop-up box 310, which may include a direct unlock setting item 3101, a slide screen unlock setting item 3102, and a close setting item 3103. If the direct unlock setting item 3101 is selected, the face recognition is directly unlocked after the face recognition is successful. If the slide screen unlock setting item 3102 is selected, the face recognition is successfully unlocked by sliding (swiping up) the screen. If the close setting item 3103 is selected, face recognition is not used to unlock the screen, that is, the face unlock function is closed.

[0102] like Figure 7 As shown in (a) of FIG. 1 , in response to the user's operation (eg, a click operation) on the control 309 corresponding to the setting item of picking up the phone to light up the screen, as shown in FIG. Figure 7As shown in (b) in the figure, the mobile phone can display interface 320, and interface 320 can include prompt animation 3201, prompt text 3202 and pick up the phone to light up the screen switch 3203. Prompt animation 3201 is used to show the user the gesture of picking up the phone to light up the screen. Prompt text 3202 can be, for example, "When the device screen is off, pick up the screen to light up the screen." If the pick up phone to light up the screen switch 3203 is turned on, when the device screen is off, the screen can be lit after picking up the phone. If the pick up phone to light up the screen switch 3203 is not turned on (in the off state), when the device screen is off, the screen will not light up after picking up the phone.

[0103] When face unlocking is set, the mobile phone can execute the following dynamic screen display method.

[0104] like Figure 8 As shown, the embodiment of the present application provides a method for displaying dynamic effects of a lock screen interface, which is described by taking a mobile phone as an example of an electronic device, including:

[0105] 801a. The lock screen application receives the user's screen-lighting operation.

[0106] Among them, the screen-on operation (first screen-on operation) refers to an operation that triggers the phone to light up the screen. Before receiving the screen-on operation, the phone is in the screen-off state or the AOD display state. Exemplarily, the screen-on operation may include pressing the power button, the user lifting the phone when the phone is set to lift the screen to light up, and the user sliding, clicking, or unplugging the charging cable on the phone's display to trigger the screen to light up.

[0107] 801b. In response to the user's screen-lighting operation, a lock screen interface is displayed.

[0108] In response to the user's screen-on operation, the lock screen application can display a lock screen interface on the display screen of the mobile phone. The lock screen interface includes a target element (i.e., an icon indicating that the electronic device is performing face unlocking). The target element can be, for example, a lock logo, a face logo, or other logo, which is not limited in this application.

[0109] For example, the lock screen interface can be as follows Fig.14 In the interface 701 shown in (a), the target element may be a lock icon 702 in the interface 701. Optionally, the lock screen interface may also include other elements, such as date, time, fingerprint identification, lock screen wallpaper, etc., which are not limited in this application.

[0110] Before a face is recognized, the lock screen interface does not display the animation (first animation) of the target element (eg, the lock logo).

[0111] In an embodiment of the present application, the lock screen interface may not display the prompt text (first prompt information) for face recognition. The first prompt information may be a text prompt information, and the first prompt information prompts that the electronic device is performing face recognition. For example, cancel the text prompt "face is being recognized". In this way, the text display space can be streamlined, the depth of field effect of the characters in the lock screen wallpaper can be guaranteed, and power consumption can be saved. In addition, the lock screen wallpaper can be intelligently matted, and the characters are masked above the text (for example, date or time) so that the portrait (face) on the lock screen wallpaper is not blocked by the text.

[0112] 802. At a first point in time, the lock screen application calls a face recognition framework to perform face recognition.

[0113] In response to the user's screen-on operation, at the first point in time, the lock screen application can register a face event with the face recognition framework. The purpose of registering a face event is to enable the face recognition framework to start face recognition, and return a face event to the lock screen application after recognizing a face. The face event is used to indicate that a face has been recognized (detected).

[0114] 803. The face recognition framework starts the camera.

[0115] In an embodiment of the present application, the face recognition framework may include modules such as face recognition service, camera service, face recognition module, camera HAL, and camera driver.

[0116] In one possible design, Fig. 9 As shown in the figure, the process of starting the camera by the face recognition framework includes:

[0117] S1. In response to the lock screen application registering a face event, the face recognition service sends a face recognition request to the face recognition control module.

[0118] S2. The face recognition control module sends a request to open the camera to the camera service.

[0119] S3. In response to receiving the request to open the Camera, the camera service sends a request to open the Camera to the camera HAL.

[0120] S4. The camera HAL sends a request to open the camera to the camera driver module.

[0121] S5. The camera driver module sends a start (stream on) command / instruction to the camera.

[0122] The stream on command is used to drive a camera (for example, a TOF camera) to collect data.

[0123] 804. The camera collects image data.

[0124] Exemplarily, in response to receiving the stream on command, the camera captures image data.

[0125] In a possible design, the image data collected by the camera can be stored in a secure memory (SecureBuffer). The storage location of the image data in the secure memory can be represented by FD1.

[0126] 805. The face recognition framework detects faces based on image data collected by the camera.

[0127] That is, the face recognition framework detects whether there is a face in the image data collected by the camera.

[0128] In one possible design, Fig.10 As shown in the figure, the face recognition framework detects whether there is a face in the image data collected by the camera, including:

[0129] S11. The camera sends FD1 to the camera driver module.

[0130] S12. The camera driver module sends FD1 to the camera HAL.

[0131] S13. The camera HAL sends FD1 to the camera service.

[0132] S14. The camera service sends FD1 to the face recognition control module.

[0133] S15. The face recognition control module sends FD1 to the face recognition TA.

[0134] Among them, the face recognition TA includes the TOF algorithm and the face ID algorithm. Among them, the TOF algorithm is used to convert the RAW data into grayscale and depth images, and calculate whether the face is safe (that is, whether the current user is the owner) based on the grayscale and depth images. The face ID algorithm is used for grayscale image matching and depth image judgment anti-counterfeiting.

[0135] S16, face recognition TA reads the image data to be collected by the camera from the secure memory according to FD1, and determines whether there is a face in the image data to be collected by the camera.

[0136] Exemplarily, the face recognition TA can process the image data collected by the camera through the TOF algorithm to obtain a first grayscale image, and perform face recognition based on the first grayscale image through the face ID algorithm to determine whether there is a face in the image data collected by the camera.

[0137] 806. If a face is detected (recognized), the face recognition framework sends a face event to the lock screen application.

[0138] Among them, the face event is used to indicate that a face is recognized.

[0139] In one possible design, Fig.10 As shown in the figure, the process of the face recognition framework sending a face event to the lock screen application includes:

[0140] S17, face recognition TA sends the face event to the face recognition control module.

[0141] S18. The face recognition control module sends the face event to the face recognition service.

[0142] S19. The face recognition service sends the face event to the lock screen application.

[0143] In addition, if no face is detected, the face recognition framework will not send a face event to the lock screen app, and the subsequent lock screen app will not display the first animation of the target element.

[0144] 807. At a second time point, the lock screen application receives a face event.

[0145] The lock screen application can record the second time point when the face event is received, and can calculate the time difference between the first time point and the second time point.

[0146] In response to receiving the face event, the lock screen application may display the first motion effect of the target element. Before the lock screen application displays the first motion effect of the target element, steps 808 and 809 may also be performed.

[0147] 808. The lock screen application determines whether it is the first time to initiate face recognition.

[0148] It should be noted that after the lock screen application receives the screen-on operation, it can initiate the first face recognition. That is, before initiating the first face recognition, the phone is in the screen-off state.

[0149] In some embodiments, the first face recognition may last for a preset time (e.g., 3 seconds). That is, the first face recognition may start from the moment the screen light-up operation is received and last for a maximum preset time (e.g., 3 seconds). During the preset time, the camera may continuously collect image data, and the face recognition framework performs face recognition based on the image data collected by the camera.

[0150] If face recognition is successful within the preset time (e.g., 3 seconds), face recognition can be terminated and the camera can be turned off. If face recognition is unsuccessful within the preset time (e.g., no face is detected or face comparison fails), that is, the first face recognition fails, the camera is turned off offline to save power.

[0151] In the event that the first face recognition fails, further, a second face recognition can be initiated based on user operations (for example, double-clicking to retry, lifting to retry, etc.), or a second face recognition can be automatically initiated based on displacement sensing, the camera is reopened to collect image data, and face recognition is performed based on the image data collected by the camera. The duration of the second face recognition can be a preset time (for example, 3 seconds) at most. During the preset time, the camera can continuously collect image data, and the face recognition framework performs face recognition based on the image data collected by the camera. If the second face recognition fails, the third face recognition can be initiated by the same logic, and so on. It should be understood that before initiating the second or third face recognition, the phone is in the screen-on state.

[0152] Among them, initiating a second face recognition based on displacement sensing means that after the first face recognition fails, the mobile phone detects the displacement of the mobile phone through sensors such as accelerometers, and can automatically initiate a second face recognition.

[0153] In other embodiments, there is no limit on the duration of the first face recognition, that is, the camera may not be shut down offline and may continue to collect image data so as to perform face recognition based on the image data collected by the camera until face recognition is successful.

[0154] 809. When face recognition is initiated for the first time, the lock screen application determines whether the time difference between the first time point and the second time point is less than a preset time length.

[0155] The preset duration may be, for example, Y seconds, where Y is greater than 0. Optionally, Y is less than 3.

[0156] Exemplarily, assuming that the first time point is T1, the second time point is T2, the time difference between T1 and T2 is ΔT (ie, T1-T2=ΔT), and the preset time length is Y, that is, it is determined whether ΔT is less than Y.

[0157] 810. If ΔT is less than Y, display the first animation of the target element with a delay of (Y-ΔT) milliseconds.

[0158] That is, in response to the recognition of a face, the first animation of the target element (for example, a breathing animation) is displayed with a delay. Wherein, ΔT is less than Y, indicating that when a face is recognized (when the lock screen application receives a face event), the preset time has not passed since the screen light operation was received, and the first animation of the target element can be displayed after the preset time has passed since the screen light operation was received.

[0159] Among them, the first motion effect screen includes a target element, and the target element can display a breathing motion effect. That is, the lock screen application delays the display of the first motion effect of the target element. The first motion effect prompts the electronic device (for example, a mobile phone) that a face unlock is being performed. The first motion effect can be a breathing motion effect. The breathing motion effect can refer to a regular change in at least one of the attributes of the target element, such as size, color, and position. For example, the breathing motion effect can be a regular change in the depth of the color of the target element.

[0160] 811. If ΔT is greater than or equal to Y, the lock screen application immediately displays the first animation effect of the target element.

[0161] That is, in response to recognizing a face, the first animation (e.g., breathing animation) of the target element (e.g., lock logo) is immediately displayed. Where ΔT is greater than or equal to Y, it means that when a face is recognized (when the lock screen application receives a face event), the preset time has passed since the screen light operation was received, and the first animation of the target element (e.g., lock logo) can be immediately displayed.

[0162] That is, when the second time point arrives, the time difference between the first time point and the second time point is greater than or equal to the preset duration (that is, ΔT is greater than or equal to Y), and the lock screen application immediately displays the first animation effect screen (that is, the lock screen application immediately displays the first animation effect of the target element), that is, the target element immediately displays the animation effect (for example, breathing animation).

[0163] Exemplarily, it is assumed that at a first time point, in response to a screen-on operation, the lock screen application registers a face event with the face recognition framework (i.e., initiates the first face recognition). At a second time point, the lock screen application receives a face event, i.e., the lock screen application determines that a face is detected. At a third time point, the duration of face recognition satisfies a preset duration. Among them, the duration of face recognition is the duration from the moment face recognition is initiated (the first time point) to the moment face detection is determined (the second time point). That is, ΔT=Y. Exemplarily, Y can be 1. At a fourth time point, face recognition is successful.

[0164] In some embodiments, Fig.11 As shown, the second time point is earlier than the third time point, that is, ΔT is less than Y. When the second time point is reached, the first motion effect screen (that is, the first motion effect of the target element) can be displayed with a delay of (Y-ΔT) milliseconds, that is, the lock screen application can display the first motion effect screen from the third time point until the fourth time point (that is, stop displaying the first motion effect screen at the fourth time point).

[0165] In other embodiments, Fig.12 As shown, the second time point is later than the third time point, that is, ΔT is greater than Y. The lock screen application can immediately display the first motion effect screen (that is, display the first motion effect of the target element) from the second time point until the fourth time point.

[0166] In some other embodiments, Fig.13 As shown, the second time point is equal to the third time point, that is, ΔT = Y. The lock screen application can immediately display the first motion effect screen (that is, display the first motion effect of the target element) from the second time point until the fourth time point.

[0167] In the embodiment of the present application, after the face recognition is started, the first dynamic effect screen will not be displayed immediately, but the first dynamic effect screen will be displayed only when the face is detected (i.e. the lock screen application receives the face event) and the face recognition duration meets the preset duration (e.g., 1 second). In this way, the feedback of face unlocking is more accurate and power consumption can be saved.

[0168] It is understandable that since the preset time is short, even if the first dynamic effect screen is not displayed before the preset time is reached, it will not affect the user experience. Moreover, after the preset time is reached and a face is detected, the first dynamic effect screen is displayed, which provides more accurate feedback on face unlocking and can reduce the waiting time perceived by the user.

[0169] Furthermore, the embodiment of the present application may also include the following steps:

[0170] 812. If the face recognition is successful, the lock screen application exits the lock screen interface.

[0171] That is, in response to successful face recognition, exit the lock screen interface.

[0172] For example, Fig.14 As shown in (a) of FIG. 1 , in response to a screen-on operation (e.g., pressing the power button), at a first time point, the mobile phone starts face recognition and can display a lock screen interface 701. The lock screen interface 701 may include a lock logo 702. At this time, the lock logo 702 does not display an animation (e.g., a breathing animation). When the duration of face recognition meets a preset duration (e.g., 1 second) and a face is detected (i.e., the lock screen application receives a face event), as shown in FIG. Fig.14 As shown in (b) of FIG. 1 , a first dynamic effect screen 703 may be displayed, and the first dynamic effect screen 703 includes a lock mark 702, and the lock mark 702 displays a first dynamic effect (for example, a breathing dynamic effect). Further, if the face recognition is successful (the face recognition is successful within 3 seconds), as shown in FIG. Fig.14 As shown in (c) of FIG. 1 , when the sliding screen unlock setting item 3102 is selected, an interface 704 may be displayed, which may include an unlock icon 705 (in an open state, which may vividly prompt the user that the face unlock is successful) and a prompt text "Swipe up to enter" 706. In response to the user's sliding up operation, as shown in FIG. Fig.14As shown in (d) in FIG. 1 , the mobile phone can display the desktop. Alternatively, the mobile phone can display the interface of an application (system application or third-party application). Alternatively, when the direct unlock setting item 3101 is selected, if the face recognition is successful, the mobile phone can be unlocked directly without the user's additional operation, such as Fig.14 As shown in (d), the mobile phone can directly display the desktop 707 (or directly display the interface of the application).

[0173] In one possible design, if the currently collected facial information (facial information recognized based on the image data collected by the camera) matches the grayscale image corresponding to the previously recorded facial information (i.e., the facial information collected by the electronic device when the user performs the facial entry operation), it can be considered to be the same user (i.e., the same user performs the facial entry operation and the unlocking operation). Furthermore, if the image data collected by the camera includes depth information, it can be considered that the current user is authentic and trustworthy (not disguised by photos, videos, etc.), and the face of the current user can be considered safe at this time, that is, the face recognition result is successful. If the currently collected facial information does not match the grayscale image corresponding to the previously recorded facial information, or if the currently collected facial information does not include depth information, the face of the current user is considered unsafe, that is, the face recognition result is a failure.

[0174] 813. In response to the failure of face recognition, display a second animation of the target element.

[0175] Among them, the second animation prompts the user to restart face recognition.

[0176] That is, if face recognition fails, the second dynamic effect screen is displayed. The second dynamic effect screen includes a target element, and the target element can display a second dynamic effect (for example, a swinging dynamic effect). The swinging dynamic effect may refer to the target element rotating according to a preset rotation angle or rotation direction. For example, the swinging dynamic effect may be that the target element swings left and right.

[0177] In the case where the first face recognition fails, that is, the face recognition is still unsuccessful after the preset time (for example, 3s) from the start of face recognition (first face recognition), the lock screen application can switch from the first motion effect screen to the second motion effect screen (for example, the target element displays a shaking motion effect), prompting the user to retry to initiate a new round of face recognition (for example, initiating a second face recognition). Optionally, the lock screen application can also display a text prompt message to prompt the user to retry. Exemplary, the text prompt message can be, for example: "Double-click the screen to try again", "Lift the screen to try again", etc. In this way, the user can be promptly fed back that the current face recognition is unsuccessful, reminding the user to retry in time to ensure the user experience.

[0178] For example, assuming that the preset duration Y is 1s, the first face recognition can last up to 3s. From the start of the first face recognition, if the face is recognized within 1s, the animation can be executed from 1s (i.e., the first animation screen is displayed); if the face is recognized within 3s after 1s, the animation can be executed immediately (i.e., the first animation screen is displayed). If the face recognition fails after 3s, the second animation screen can be displayed to remind the user to try again in time.

[0179] For example, the target element is a lock mark. Fig.15 As shown in (a) of FIG. 1 , in response to a screen-on operation (e.g., pressing the power button), at a first point in time, the mobile phone starts face recognition, and then the lock screen interface 701 may be displayed. The lock screen interface 701 may include a lock icon 702. At this time, the lock icon 702 does not display an animation (e.g., a breathing animation). When the duration of face recognition meets a preset duration (e.g., 1 second) and a face is detected (i.e., the lock screen application receives a face event), as shown in FIG. Fig.15 As shown in (b) of FIG. 1 , a first dynamic effect screen 703 may be displayed, and the first dynamic effect screen 703 includes a lock mark 702, and the lock mark 702 displays a first dynamic effect (e.g., a breathing dynamic effect). Further, if the face recognition is still unsuccessful from the moment when the face recognition is started (e.g., the first time point) to the preset time (e.g., 3s), as shown in FIG. Fig.15 As shown in (c) of FIG. 1 , the lock screen application can display a second dynamic effect screen 710, which includes a lock logo 711. The lock logo 711 can display a second dynamic effect (for example, a left-right swaying dynamic effect), and can display a text prompt message 712, prompting the user to double-click the screen to retry to initiate a new round of face recognition. In response to the user's double-click retry operation (i.e., restarting face recognition operation), a second face recognition can be initiated (i.e., restarting face recognition). If a face is detected, such as Fig.15 As shown in (d) in FIG. 7 , the lock screen application can immediately display the first dynamic effect screen 703. That is, in response to the recognition of the face, the first dynamic effect of the target element (e.g., the lock logo) is displayed. The lock logo 702 can display the first dynamic effect (e.g., breathing dynamic effect) until the face recognition is successful (the second face recognition is successful) or the second face recognition is completed.

[0180] In some embodiments, after initiating the Mth (M is an integer greater than or equal to 2) face recognition (e.g., the second face recognition), if a face is detected, the first dynamic effect screen can be displayed. In this way, the feedback of face unlocking is more accurate and power consumption can be saved.

[0181] That is to say, when the first face recognition is started, after the face is detected, it can be considered whether the duration of the face recognition (first face recognition) meets the preset duration condition. In the subsequent face recognition process (for example, the second face recognition), after the face is detected, the animation can be displayed immediately (that is, the first animation screen is displayed), without considering whether the duration of the face recognition (second face recognition) meets the time threshold, so as to promptly feedback to the user that the current face recognition is unsuccessful and remind the user to retry in time.

[0182] For example, Fig.16 As shown, in the case of the first face recognition failure, that is, the face recognition is still unsuccessful after the preset time (for example, 3s) from the start of face recognition (first face recognition), the second dynamic effect screen (that is, the second dynamic effect of the target element) can be displayed at the end of the first face recognition (for example, the 3rd second). Optionally, a prompt text (for example, double-click to retry) can also be displayed to prompt the user to retry. Assuming that the user's double-click retry operation is received at 3.5s, in response to the double-click retry operation, the lock screen application can initiate (start) the second face recognition. Assuming that the lock screen application receives a face event at 4s, the lock screen application can display the first dynamic effect screen again (that is, the first dynamic effect of the target element). The duration of the second face recognition can be a preset time (for example, 3 seconds), that is, the time for displaying the first dynamic effect screen can last up to 6.5s. Of course, if the face recognition is successful between 4s and 6.5s (for example, 4s), the lock screen application stops displaying the first dynamic effect screen and exits the lock screen interface. If the face recognition is successful between 3.5s and 4s (i.e., the second face recognition is successful), the lock screen application can directly exit the lock screen interface. In addition, if the face recognition is still unsuccessful at 6.5s, the second animation screen can be displayed again (from the first animation screen to the second animation screen), and a prompt text (e.g., double-click to try again) can be displayed to prompt the user to try again.

[0183] In some embodiments, after the Mth (M is an integer greater than or equal to 2) face recognition (for example, the second face recognition) is initiated, the first animation screen can be displayed immediately to promptly prompt the user that face recognition is in progress, which can reduce the waiting time perceived by the user and ensure user experience.

[0184] For example, Fig.17As shown, in the case where the first face recognition fails, that is, the face recognition is still unsuccessful after the preset time (for example, 3s) from the start of face recognition (first face recognition), the second dynamic effect screen (that is, the second dynamic effect of the target element) can be displayed at the end of the first face recognition (for example, the 3rd second). Optionally, a prompt text (for example, double-click to retry) can also be displayed to prompt the user to retry. Assuming that at 3.5s, the user's double-click retry operation is received, in response to the double-click retry operation, the lock screen application can initiate a second face recognition and display the first dynamic effect screen (switch from the second dynamic effect screen to the first dynamic effect screen). The duration of the second face recognition can be up to a preset time (for example, 3 seconds), that is, the time for displaying the first dynamic effect screen can last up to 6.5s. Of course, if the face recognition is successful between 3.5s and 6.5s (for example, 4s), the face recognition is successful (that is, the second face recognition is successful), the lock screen application stops displaying the first dynamic effect screen and exits the lock screen interface. In addition, if face recognition is still unsuccessful at 6.5 seconds, the second animation screen can be displayed again (switch from the first animation screen to the second animation screen), and prompt text (for example, double-click to retry) can also be displayed to prompt the user to try again.

[0185] In the embodiment of the present application, text prompts (for example, unlock failed, charging, unlock successfully and slide up to enter) can replace the time and date display. In this way, the text display space can be simplified and the depth of field effect of the characters in the lock screen wallpaper can be guaranteed.

[0186] In a possible design, text prompts such as unlock failed / unlock successful swipe up to enter / double-click to retry have a higher priority than other text prompts (for example, text prompts of charging), so as to timely feedback the current unlocking status to the user.

[0187] The above embodiment determines whether the duration of face recognition meets the preset duration (for example, 1 second) after detecting a face, and then determines whether to delay the display of the first motion effect screen or immediately display the first motion effect screen. In other embodiments, it is also possible to first determine whether the duration of face recognition meets the preset duration (for example, 1 second). If so, determine whether a face is detected. Further determine whether to delay the display of the first motion effect screen or immediately display the first motion effect screen. This application does not make specific limitations on this.

[0188] Based on the method provided in the embodiment of the present application, after starting face recognition, the first dynamic effect screen will not be displayed immediately, but will be displayed only when the face is detected (i.e. the lock screen application receives a face event) and the face recognition duration meets the preset duration (e.g., 1 second). In this way, the feedback on face unlocking is more accurate and power consumption can be saved.

[0189] It is understandable that since the preset time is short, even if the first dynamic effect screen is not displayed before the preset time is reached, it will not affect the user experience. Moreover, after the preset time is reached and a face is detected, the first dynamic effect screen is displayed, which provides more accurate feedback on face unlocking and can reduce the waiting time perceived by the user.

[0190] In addition, for abnormal or timeout scenarios where the first face recognition fails, timely feedback can be given to the user that the current face recognition is unsuccessful, reminding the user to retry in time.

[0191] In summary, the method provided in the embodiment of the present application can ensure that most unlocking scenarios do not generate excess power consumption, and can provide timely prompts for abnormal or timeout scenarios, thereby reducing the waiting time perceived by the user and ensuring user experience.

[0192] like Fig.18 As shown, an embodiment of the present application provides a method for displaying a dynamic effect picture, which is described by taking a mobile phone as an example of an electronic device, including steps 1801a-1808.

[0193] Among them, steps 1801a-1807 can refer to steps 801a-807 and are not repeated here.

[0194] 1808. In response to receiving the face event, the lock screen application displays the first animation effect of the target element.

[0195] That is, in response to recognizing a human face, a first animation effect (eg, a breathing animation) of a target element (eg, a lock logo) is displayed.

[0196] For example, Fig.19 As shown in (a) of FIG. 1 , in response to a screen-on operation (e.g., pressing the power button), at a first time point, the mobile phone starts face recognition, and then the lock screen interface 701 may be displayed. The lock screen interface 701 may include a lock icon 702. At this time, the lock icon 702 does not display an animation (e.g., a breathing animation). When a face is detected (i.e., the lock screen application receives a face event), as shown in FIG. Fig.19 As shown in (b) in FIG. 7 , a first motion effect screen 703 may be displayed. The first motion effect screen 703 includes a lock logo 702 . The lock logo 702 displays a first motion effect (eg, a breathing motion effect).

[0197] Further, in response to recognizing a human face, and after a preset time has passed since the screen-lighting operation was received (or after a preset time has passed since the screen was turned on), the first animation effect of the target element is displayed. The specific description can be referred to above and will not be repeated here.

[0198] In addition, in the embodiment of the present application, for the abnormal or timeout scenario where the first face recognition fails, the user can be promptly fed back that the current face recognition is unsuccessful, reminding the user to retry in time. Figure 8 The illustrated embodiments are not described in detail here.

[0199] Based on the method provided in the embodiment of the present application, after starting face recognition, the first dynamic effect screen will not be displayed immediately, but after the face is detected (that is, the lock screen application receives a face event), the first dynamic effect screen will be displayed. In this way, the feedback of face unlocking is more accurate and power consumption can be saved.

[0200] like Fig. 20 As shown, the embodiment of the present application provides a method for displaying a dynamic effect picture, which is described by taking the electronic device as a mobile phone as an example, including steps 2001a-2006:

[0201] Among them, steps 2001a-2005 can refer to steps 801a-805 and are not repeated here.

[0202] 2006. Starting from the first time point, after a preset time period, the lock screen application displays the first animation effect of the target element.

[0203] That is, after a preset time has passed since the screen-lighting operation was received, the first animation of the target element is displayed.

[0204] Alternatively, the first animation of the target element may be displayed after a preset time has passed since the screen was turned on.

[0205] For example, Fig.21 As shown in (a) of FIG. 1 , in response to a screen-on operation (e.g., pressing the power button), at a first time point, the mobile phone starts face recognition, and then the lock screen interface 701 may be displayed. The lock screen interface 701 may include a lock logo 702. At this time, the animation of the lock logo 702 (e.g., breathing animation) is not displayed. When the duration of face recognition meets the preset duration (e.g., 1 second), as shown in FIG. Fig.21 As shown in (b) in FIG. 7 , a first motion effect screen 703 may be displayed. The first motion effect screen 703 includes a lock logo 702 . The lock logo 702 displays a first motion effect (eg, a breathing motion effect).

[0206] Further, in response to recognizing a human face, and after a preset time has passed since the screen-lighting operation was received (or after a preset time has passed since the screen was turned on), the first animation effect of the target element is displayed. The specific description can be referred to above and will not be repeated here.

[0207] In addition, in the embodiment of the present application, for the abnormal or timeout scenario where the first face recognition fails, the user can be promptly fed back that the current face recognition is unsuccessful, reminding the user to retry in time. Figure 8 The illustrated embodiments are not described in detail here.

[0208] Based on the method provided in the embodiment of the present application, after starting face recognition, the first dynamic effect screen will not be displayed immediately, but the first dynamic effect screen will be displayed only when the duration of face recognition meets the preset duration (for example, 1 second). In this way, power consumption can be saved. It is understandable that since the preset duration is short, although the first dynamic effect screen is not displayed before the preset duration is reached, it will not affect the user experience.

[0209] Some embodiments of the present application provide an electronic device, which may include: a touch screen, a memory, and one or more processors. The touch screen, the memory, and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the various functions or steps performed by the electronic device in the above method embodiment. The structure of the electronic device can refer to Figure 3 The structure of the electronic device 100 is shown.

[0210] The present application also provides a chip system (eg, a system on a chip (SoC)), such as Fig. 22 As shown, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 and the interface circuit 2202 can be interconnected via lines. For example, the interface circuit 2202 can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit 2202 can be used to send signals to other devices (such as a processor 2201 or a touch screen of an electronic device). Exemplarily, the interface circuit 2202 can read instructions stored in the memory and send the instructions to the processor 2201. When the instructions are executed by the processor 2201, the electronic device can execute the various steps in the above embodiments. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0211] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes each function or step executed by the electronic device in the above-mentioned method embodiment.

[0212] The embodiment of the present application also provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes each function or step executed by the electronic device in the above method embodiment.

[0213] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0214] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0215] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0216] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0217] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0218] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for displaying dynamic effects on a lock screen interface. It is characterized in that Applied to an electronic device, the face unlocking function of the electronic device is turned on, and the method includes: In response to the first screen-on operation, a lock screen interface is displayed; wherein the lock screen interface includes an icon indicating that the electronic device is performing face unlocking; the lock screen interface does not display the animation of the icon and does not include the first prompt information, wherein the first prompt information indicates that the electronic device is performing face recognition; In response to recognizing a human face, displaying a first motion effect of the icon; wherein the first motion effect prompts that the electronic device is performing face unlocking; In response to successful face recognition, exit the lock screen interface.

2. The method according to claim 1, It is characterized in that In response to recognizing the face, displaying the first motion effect of the icon includes: In response to recognizing a human face and after a preset time has passed since receiving the first screen-lighting operation, the first motion effect of the icon is displayed.

3. The method according to claim 2, It is characterized in that In response to recognizing a human face and after a preset time has passed since receiving the first screen-lighting operation, displaying the first motion effect of the icon includes: If the time difference between the first time point and the second time point is greater than or equal to the preset duration, immediately display the first motion effect of the icon; If the time difference between the first time point and the second time point is less than the preset duration, the first animation screen is displayed after a first delay, where the first duration is the difference between the time difference and the preset duration; Among them, the first time point is the time point when the first screen-lighting operation is received, and the second time point is the time point when the face is recognized.

4. The method according to any one of claims 1 to 3, It is characterized in that The method further comprises: In response to a failure in face recognition, displaying a second motion effect of the icon; wherein the second motion effect prompts the user to restart face recognition; In response to the operation of restarting face recognition, restarting face recognition; In response to recognizing a face, a first motion effect of the icon is displayed; wherein the first motion effect prompts that the electronic device is performing face unlocking.

5. The method according to any one of claims 1 to 4, It is characterized in that The electronic device includes a lock screen application, a face recognition framework, and a camera, and in response to recognizing a face, displaying a first motion effect of the icon includes: The lock screen application registers face events with the face recognition framework; The face recognition framework activates the camera; The collected image data includes: The camera collects image data; The face recognition framework recognizes a face based on the image data; If the face recognition framework recognizes a face based on the image data, the face recognition framework returns a face event to the lock screen application, where the face event is used to indicate that a face is recognized based on the image data; The lock screen application receives the face event from the face recognition framework; In response to receiving the face event, the lock screen application displays a first animation effect of the icon.

6. The method according to any one of claims 1 to 5, It is characterized in that The first motion effect is a breathing motion effect.

7. A method for displaying dynamic effects on a lock screen interface. It is characterized in that Applied to an electronic device, the face unlocking function of the electronic device is turned on, and the method includes: In response to the first screen-on operation, a lock screen interface is displayed; wherein the lock screen interface includes an icon indicating that the electronic device is performing face unlocking; the lock screen interface does not include first prompt information, and the first prompt information indicates that the electronic device is performing face recognition; After a preset time has passed since the first screen-lighting operation was received, a first motion effect of the icon is displayed; wherein the first motion effect indicates that the electronic device is performing face unlocking; In response to successful face recognition, exit the lock screen interface.

8. The method according to claim 7, It is characterized in that The displaying of the first motion effect of the icon after a preset time period has passed since the first screen-lighting operation is received includes: In response to recognizing a human face and after a preset time has passed since receiving the first screen-lighting operation, the first motion effect of the icon is displayed.

9. An electronic device, It is characterized in that The electronic device comprises: a wireless communication module, a memory and one or more processors; the wireless communication module, the memory and the processor are coupled; The memory is used to store computer program codes, and the computer program codes include computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, It is characterized in that including computer instructions; When the computer instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 1 to 8.

Images