A fingerprint unlocking method and related device

Abstract

The embodiment of the present application provides a fingerprint unlocking method and related device. When the electronic device is in the screen-off state, in response to the touch driver of the electronic device detecting a first event, the touch driver of the electronic device sends a first power-on instruction corresponding to the first event to the display screen through the fingerprint driver of the electronic device, the fingerprint hardware abstraction module of the electronic device and the hardware synthesizer module of the electronic device, and simultaneously sends the first event to the target display application of the electronic device; in response to the display driver of the electronic device detecting the first fingerprint highlight instruction corresponding to the first event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area; in response to obtaining the first fingerprint image, the electronic device performs fingerprint unlocking. In this way, the display screen is first triggered to power on by the electronic device, and during the power-on process of the display screen, the upper layer of the software can perform logic processing, which is conducive to reducing the time consumption of fingerprint unlocking and improving the efficiency of fingerprint unlocking of electronic devices.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a fingerprint unlocking method and related devices. Background Art

[0002] With the development of electronic devices, electronic devices such as mobile phones and tablets can provide more and more functions for people, becoming an indispensable part of people. Among them, the fingerprint unlocking function is one of the functions provided by electronic devices. The fingerprint unlocking function means that the electronic device can obtain the user's fingerprint image and perform identity authentication to unlock the electronic device so that the user can use the functions provided by the electronic device.

[0003] At present, when an electronic device is in a locked state, it can detect a user's touch operation input in a specific area of ​​the display screen, and then the electronic device can trigger the collection of the user's fingerprint image. However, the process from the electronic device detecting the touch operation to the electronic device triggering the collection of the fingerprint image takes a long time, the fingerprint unlocking speed is slow, and the fingerprint unlocking efficiency is low.

[0004] Therefore, how to reduce the time consumption of fingerprint unlocking to improve the efficiency of fingerprint unlocking has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The present application provides a fingerprint unlocking method and related devices, which trigger the display screen to power on in advance before the electronic device sends a power-on instruction to the display screen at the upper software layer, which is beneficial to reducing the time consumed in powering on the display screen during the fingerprint unlocking process and improving the efficiency of fingerprint unlocking of the electronic device.

[0006] In the first aspect, the present application provides a fingerprint unlocking method, which can be executed by an electronic device, or by a module in the electronic device, such as a chip or a processor. The electronic device includes a display screen, and the method may include: the electronic device is in a screen-off state; in response to the touch driver of the electronic device detecting a first event, the touch driver of the electronic device sends a first power-on instruction corresponding to the first event to the display screen through the fingerprint driver of the electronic device, the fingerprint hardware abstraction module of the electronic device and the hardware synthesizer module of the electronic device, and simultaneously sends the first event to the target display application of the electronic device; the first event is generated based on the detected first fingerprint unlocking operation; in response to the display driver of the electronic device detecting the first fingerprint highlighting instruction corresponding to the first event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area; in response to obtaining a first fingerprint image, the electronic device performs fingerprint unlocking, the first fingerprint image corresponds to the first fingerprint unlocking operation, and the first fingerprint image is obtained based on the highlighted fingerprint unlocking area.

[0007] Through the fingerprint unlocking method provided by the present application, it is realized that when the electronic device is in the off-screen state, the fingerprint unlocking operation input by the user can be quickly performed. Since it takes a certain amount of time for the display screen to be powered on and for the upper layer of the software to perform logical processing on the reported events, the touch driver of the electronic device reports the event corresponding to the fingerprint unlocking operation while sending a power-on instruction to the display screen. It can be realized that during the power-on process of the display screen, the upper layer of the software performs logical processing based on the reported events and issues a corresponding control strategy, without waiting for the power-on instruction issued by the upper layer of the software to trigger the display screen to power on, which can save the time consumed in powering on the display screen, is conducive to improving the efficiency of fingerprint unlocking of electronic devices, and realizing the performance optimization of fingerprint unlocking with the off screen.

[0008] In combination with the first aspect, in one embodiment, in response to the touch driver of the electronic device detecting the first event, the touch driver of the electronic device sends the first power-on instruction corresponding to the first event to the display screen through the fingerprint driver of the electronic device, the fingerprint hardware abstract module of the electronic device and the hardware synthesizer module of the electronic device, including: in response to the touch driver of the electronic device detecting the first event, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstract module of the electronic device; the fingerprint hardware abstract module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; the display driver of the electronic device sends the first power-on instruction to the display screen. In the embodiment of the present application, the touch driver of the electronic device sends the power-on instruction to the display driver through the fingerprint driver, the fingerprint hardware abstract module and the hardware synthesizer module. Compared with the upper layer of the software responding to the event corresponding to the fingerprint unlocking operation, the power-on instruction to the display driver is sent, the link is shorter and the time consumption is shorter, which is conducive to reducing the time consumption of fingerprint unlocking.

[0009] In combination with the first aspect, in one embodiment, the method further includes: in response to the touch device of the electronic device detecting the first fingerprint unlocking operation, the touch device of the electronic device sends a first hardware interrupt corresponding to the first fingerprint unlocking operation to the touch driver of the electronic device; the touch driver of the electronic device generates the first event in response to receiving the first hardware interrupt. In the embodiment of the present application, the functional modules of the electronic device can be used to respond to the fingerprint unlocking operation and generate events when the electronic device is in the off-screen state, so that the upper layer of the software sends down the control strategy.

[0010] In combination with the first aspect, in one embodiment, the sending of the first event to the target display application of the electronic device includes: the touch driver of the electronic device sends the first event to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first event to the fingerprint hardware abstraction module of the electronic device; the fingerprint hardware abstraction module of the electronic device sends the first event to the target display application of the electronic device. In the embodiment of the present application, the fingerprint unlocking event can be reported to the upper layer of the software through the functional modules of the electronic device, so that the upper layer of the software sends a power-on instruction to trigger the initialization of the display screen.

[0011] In combination with the first aspect, in one embodiment, the method further includes: in response to receiving the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, the second power-on instruction carries display parameters, and the display parameters are generated by the power management service module of the electronic device, the system image engine module of the electronic device, and the hardware synthesizer module of the electronic device; the display driver of the electronic device sends the display parameters carried by the second power-on instruction to the display screen; the display screen is initialized based on the display parameters. In an embodiment of the present application, the power-on instruction sent by the upper layer of the software after logical processing carries the display parameters, which can be used to initialize the display screen after power-on. Since the display screen is powered on first, after the display driver receives the power-on instruction sent by the upper layer, it can be directly initialized based on the display parameters in the power-on instruction, which is conducive to reducing the time consumption of fingerprint unlocking and improving the efficiency of fingerprint unlocking with the screen turned off.

[0012] In combination with the first aspect, in one embodiment, in response to receiving the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, including: in response to receiving the first event, the target display application of the electronic device generates the second power-on instruction and sends the second power-on instruction to the power management service module of the electronic device; the power management service module of the electronic device generates a power display parameter in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameter to the system image engine module of the electronic device; the system image engine module of the electronic device generates an image display parameter in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameter and the image display parameter to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device generates a hardware display parameter in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameter, the image display parameter and the hardware display parameter to the display driver of the electronic device, and the display parameter includes the power display parameter, the image display parameter and the hardware display parameter. In the embodiment of the present application, the software upper layer (target display application) can send power-on instructions through various functional modules of the electronic device. The power-on instructions sent by the software upper layer carry the display parameters required for display initialization. In the case where the display is powered on in advance, the display initialization can be triggered after the upper layer sends the power-on instruction, which is beneficial to reduce the time consumption of fingerprint unlocking of the electronic device.

[0013] In combination with the first aspect, in one embodiment, after the display driver of the electronic device sends the display parameters carried by the second power-on instruction to the display screen, the method further includes: the display driver of the electronic device returns the second power-on instruction to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device returns the second power-on instruction to the system image engine module of the electronic device. In the embodiment of the present application, since the power-on instruction (the first power-on instruction) has been sent to the display screen in advance, the second power-on instruction can be returned through the functional modules of the electronic device, and the power-on thread is no longer repeatedly executed.

[0014] In combination with the first aspect, in one embodiment, in response to the display driver of the electronic device detecting the first fingerprint highlight instruction corresponding to the first event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area before the method further includes: in response to the indication information indicating that the display screen has been powered on and initialized, the fingerprint hardware abstraction module of the electronic device sends the first fingerprint highlight instruction to the display driver of the electronic device, and the indication information is generated by the display driver of the electronic device and sent to the fingerprint hardware abstraction module of the electronic device; in response to the display driver of the electronic device detecting the first fingerprint highlight instruction corresponding to the first event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, including: the display driver of the electronic device responds to receiving the first fingerprint highlight instruction, the display driver of the electronic device sends the first fingerprint highlight instruction to the display screen; the display screen responds to the first fingerprint highlight instruction and highlights the fingerprint unlocking area. In the embodiment of the present application, the display driver of the electronic device can receive the fingerprint highlight instruction directly issued by the fingerprint hardware abstraction module, so as to save the time of issuing the fingerprint highlight instruction and reduce the time of fingerprint unlocking with the screen off.

[0015] In combination with the first aspect, in one embodiment, in response to acquiring the first fingerprint image, the electronic device performs fingerprint unlocking, including: matching the first fingerprint image with a fingerprint image preset by the electronic device; when the first fingerprint image matches the fingerprint image preset by the electronic device, the electronic device is unlocked. In the embodiment of the present application, the display screen of the electronic device can acquire the user's fingerprint image and match it after the fingerprint unlocking area is highlighted, thereby completing the identity authentication of the user.

[0016] In combination with the first aspect, in one embodiment, in response to acquiring a fingerprint image, the electronic device performs fingerprint unlocking, including: matching the first fingerprint image with a fingerprint image preset by the electronic device; when the first fingerprint image does not match the fingerprint image preset by the electronic device, the electronic device maintains a locked state and switches from the screen-off state to the screen-on state. In an embodiment of the present application, the display screen of the electronic device can acquire and match the user's fingerprint image after the fingerprint unlocking area is highlighted, thereby completing the identity authentication of the user.

[0017] In combination with the first aspect, in one embodiment, after the electronic device maintains a locked state, the method further includes: in response to the display driver of the electronic device detecting a second fingerprint highlight instruction corresponding to a second event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, and the second event is generated based on the detected second fingerprint unlocking operation; in response to obtaining a second fingerprint image, the electronic device performs fingerprint unlocking, the second fingerprint image corresponds to the second fingerprint unlocking operation, and the second fingerprint image is obtained based on the highlighted fingerprint unlocking area. In an embodiment of the present application, the electronic device can perform fingerprint unlocking in the screen-on state without powering on the display screen, and the user's fingerprint image can be obtained by simply highlighting the fingerprint unlocking area.

[0018] In combination with the first aspect, in one embodiment, before the display driver of the electronic device detects the second fingerprint highlight instruction corresponding to the second event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, the method also includes: in response to the touch device of the electronic device detecting the second fingerprint unlocking operation, the touch device of the electronic device sends the second hardware interrupt corresponding to the second fingerprint unlocking operation to the touch driver of the electronic device; the touch driver of the electronic device generates the second event in response to receiving the second hardware interrupt, and sends the second event to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the second event to the fingerprint hardware abstraction module of the electronic device; the fingerprint hardware abstraction module of the electronic device sends the second fingerprint highlight instruction to the display driver of the electronic device in response to receiving the second event; the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area in response to the display driver of the electronic device detecting the second fingerprint highlight instruction corresponding to the second event, including: the display driver of the electronic device sends the second fingerprint highlight instruction to the display screen in response to receiving the second fingerprint highlight instruction; the display screen highlights the fingerprint unlocking area in response to the second fingerprint highlight instruction. In an embodiment of the present application, the display driver of the electronic device can receive the fingerprint hardware abstraction module and directly send the fingerprint highlight instruction, which is helpful to save the time of sending the fingerprint highlight instruction, thereby helping to reduce the time of fingerprint unlocking with the screen off.

[0019] In a second aspect, the present application provides an electronic device, comprising: a camera, one or more processors, and one or more memories. The camera, the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the fingerprint unlocking method in any possible implementation of any of the above aspects is executed.

[0020] In a third aspect, the present application provides an electronic device, comprising one or more functional modules, which are used to execute a fingerprint unlocking method in any possible implementation of the first aspect.

[0021] In a fourth aspect, the present application provides a chip system, including a chip system applied to an electronic device, the chip system including one or more processors, characterized in that the processor is used to call computer instructions to execute a fingerprint unlocking method as in any possible implementation of the first aspect above.

[0022] In a fifth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables execution of a fingerprint unlocking method as in any possible implementation of the first aspect described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is a schematic diagram of an application scenario of a fingerprint unlocking method provided in an embodiment of the present application;

[0024] Figure 2 This is another application scenario diagram of a fingerprint unlocking method provided by an embodiment of the present application;

[0025] Figure 3 is a software interaction diagram of an electronic device provided in an embodiment of the present application;

[0026] Figure 4 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application;

[0027] Figure 5 This is an optimized schematic diagram of the off-screen fingerprint unlocking solution provided in an embodiment of the present application;

[0028] Figure 6 is a software interaction diagram of another electronic device provided in an embodiment of the present application;

[0029] Figure 7 This is a timing diagram of fingerprint unlocking of an electronic device with a bright screen provided by an embodiment of the present application;

[0030] Figure 8 This is an optimized schematic diagram of the bright screen fingerprint unlocking solution provided in an embodiment of the present application;

[0031] Fig. 9 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0033] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0034] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0035] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0036] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program and / or a computer. By way of illustration, both applications running on a computing device and a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0037] In the process of performing fingerprint unlocking on an electronic device, it is found that: when the electronic device is in a locked state, a display screen with a touch function can detect a touch operation input by a user on a specific area of ​​the display screen, and then the electronic device can trigger the operation of collecting and authenticating the user's fingerprint data. After the identity authentication is passed, the electronic device can unlock the locked state and provide the user with various functions. Among them, after the electronic device detects the touch operation, the user's fingerprint data can be collected by using a hard spot fingerprint unlocking method. Hard spot fingerprint unlocking refers to a method of partially highlighting the panel of the display screen through instructions to collect fingerprint images and thus unlock the locked state of the electronic device. The instructions in the hard spot fingerprint unlocking can be instructions sent from the upper layer to the lower layer. The upper layer can be, for example, an application layer in the software system of the electronic device, and the lower layer can be a kernel layer and a hardware layer in the software system of the electronic device. For example, when the electronic device is in a screen-off state, the instruction can include a power-on instruction and a fingerprint highlight instruction, so that when the electronic device is in a screen-off state and a touch operation input by the user is detected, the display screen of the electronic device can be powered on first based on the instruction, and then highlight the specific area (the area where the user inputs the touch operation), thereby collecting the user's fingerprint data. For another example, when the electronic device is in the screen-on state, the instruction may only include the fingerprint highlight instruction. Thus, when the electronic device is in the screen-on state and detects a touch operation input by the user, the display screen of the electronic device may highlight the specific area (the area where the user inputs the touch operation) based on the instruction, thereby realizing the collection of the user's fingerprint information.

[0038] The power-on command is a command for the display screen of the electronic device to switch from a standby dormant state to a stable working state. After the display screen is powered on, the initialization parameter configuration can be performed. The fingerprint highlight command is a command for highlighting a local area of ​​the display screen that has been powered on and initialized, so that the electronic device can collect fingerprint images.

[0039] Take the scenario of an electronic device performing fingerprint unlocking in the off-screen state as an example. Usually, the electronic device is equipped with a touch device, which can trigger the upper layer (such as the application layer) to issue a power-on instruction after detecting the user's touch operation, and then the lower layer can receive the power-on instruction sent from the upper layer. In response to the power-on instruction, the display screen can be triggered to power on and initialize. After the display screen is powered on and initialized, it can receive a fingerprint highlight instruction issued by the upper layer. In response to the fingerprint highlight instruction, the display driver can trigger the display screen to highlight the fingerprint unlocking area, that is, to highlight the area where the user inputs the touch operation, so that the electronic device collects the user's fingerprint data. In this process, on the one hand, the logic processing performed by the upper layer issuing the instruction takes a long time, and on the other hand, it also takes a long time to power on the display screen, resulting in a long time from receiving the touch operation to collecting the fingerprint data, and the fingerprint unlocking efficiency is low, which brings inconvenience to the user and reduces the user's experience.

[0040] In the embodiment of the present application, the electronic device adopts the form of optical fingerprint unlocking, which refers to the form of collecting fingerprint images and performing identity authentication (comparing with the recorded fingerprint image) by using the principle of light reflection imaging. For example, if the fingerprint image corresponding to the fingerprint unlocking operation matches the fingerprint image preset by the electronic device, the electronic device can unlock the state. Specifically, the electronic device can determine that the fingerprint image corresponding to the fingerprint unlocking operation matches the fingerprint image preset by the electronic device when the similarity between the fingerprint image corresponding to the fingerprint unlocking operation and the fingerprint image preset by the electronic device is greater than or equal to a set threshold. Conversely, the electronic device can determine that the fingerprint image corresponding to the fingerprint unlocking operation does not match the fingerprint image preset by the electronic device when the similarity between the fingerprint image corresponding to the fingerprint unlocking operation and the fingerprint image preset by the electronic device is less than a set threshold. Identity authentication operations can also be performed based on fingerprint images in other ways, and this application does not limit this.

[0041] When an electronic device is collecting fingerprint images, after detecting a touch operation input by a user's finger touching the display screen, the electronic device can trigger a local area of ​​the display screen to emit light, that is, highlight the area touched by the user's finger. The light emitted by the display screen is blocked by the finger, thereby forming a fingerprint image based on the reflected light, and the electronic device can perform identity authentication based on the fingerprint image. For example, the display screen of the electronic device is an organic light-emitting diode (OLED) display screen. After the electronic device detects a touch operation, the OLED organic light-emitting diode in a local area of ​​the display screen (the area touched by the user's finger) emits light to illuminate the fingerprint, and then the reflected light that illuminates the fingerprint can be reflected to the sensor under the display screen to form a fingerprint image. In the fingerprint image, there is a difference in brightness between the ups and downs (protrusions and depressions) of the fingerprint.

[0042] In the following embodiments of the present application, "display screen" may also be referred to as "screen" or "panel" or "panel" or "touch panel" and other terms. The meanings represented are all electrical appliances with touch and display functions, and the names used do not constitute any limitation to the present embodiment. Similarly, the "specific area" mentioned in the embodiments of the present application may also be referred to as "area for user input touch operation", "fingerprint unlocking area" and other names.

[0043] Next, combine Figure 1-Figure 2 The application scenario of the embodiment of the present application is introduced as an example. The application scenario takes the user inputting a touch operation to the fingerprint unlocking area of ​​the electronic device display screen as an example.

[0044] Application scenario 1: Screen-off fingerprint unlocking scenario.

[0045] like Figure 1 As shown in (1), there is a fingerprint unlocking area 12 on the display screen 11 of the electronic device 100, which can be an area for receiving a user input touch operation (fingerprint unlocking operation). Before the electronic device 100 detects a touch operation acting on the fingerprint unlocking area 12, the electronic device is in a locked state, and the display screen 11 of the electronic device is not lit (such as Figure 1 In (1), the display screen 11 of the electronic device 100 is completely black), that is, the electronic device is in the screen-off state, at which time the display screen of the electronic device is powered off and does not display any content. When a touch operation is detected, the display screen 11 of the electronic device 100 can light up the fingerprint unlocking area 12, and then the electronic device 100 can collect the user's fingerprint image based on the lighted fingerprint unlocking area 12 and perform identity authentication.

[0046] like Figure 1As shown in (2), when the electronic device 100 detects a touch operation on the fingerprint unlocking area 12 of the display screen 11, the electronic device 100 can trigger the display screen 11 to power on and perform initialization parameter configuration in response to the touch operation. After powering on and initializing, the electronic device 100 can trigger the display screen 11 to highlight the fingerprint unlocking area 12, that is, trigger the display screen 11 to light up the fingerprint unlocking area 12 (such as Figure 1 (2) The background color of the fingerprint unlocking area 12 is white). For example, if the display screen of the electronic device is an OLED display screen, the electronic device 100 can trigger the OLED organic light emitting diode in the fingerprint unlocking area 12 of the display screen 11 to emit light, thereby illuminating the fingerprint to realize the collection of the fingerprint image.

[0047] Optionally, when the fingerprint unlocking area 12 of the display screen 11 is highlighted, a fingerprint unlocking control, such as a fingerprint spot 13, may also be included in the user interface where the fingerprint unlocking area 12 is highlighted. The fingerprint spot 13 is a control of a fingerprint pattern. The fingerprint spot 13 may be displayed in the fingerprint unlocking area 12, that is, the display position of the fingerprint spot 13 coincides with the fingerprint unlocking area 12 (the highlighted area). For another example, the fingerprint unlocking control may also include a water ripple 14, which is a control similar to a water ripple animation. The display position of the water ripple 14 may be around the fingerprint unlocking area 12, surrounding the fingerprint unlocking area 12. It should be noted that Figure 1 The fingerprint spot 13 and the water ripple 14 are taken as examples for drawing and description. The user interface may also include other fingerprint unlocking controls, which are not limited in this application.

[0048] Application scenario 2: Screen unlocking with fingerprint.

[0049] like Figure 2 As shown in (1), there is a fingerprint unlocking area 12 on the display screen 11 of the electronic device 100, that is, the area where the user inputs the touch operation. Before the touch operation acting on the fingerprint unlocking area 12 is detected, the electronic device is in a locked state. At this time, the display screen 11 of the electronic device 100 can display a lock screen interface, which may include displaying time, incoming calls, messages, battery information, push messages, wallpapers, etc. The electronic device is currently in a bright screen state, and the bright screen state may mean that the display screen 11 has completed power-on and initialization, and the entire display screen 11 is lit up to display content, such as Figure 2 The lock screen interface shown in (1).

[0050] In some embodiments, the lock screen interface may further include prompt information for indicating that the electronic device 100 is currently in a locked state, such as "Please unlock", etc. For another example, the lock screen interface may further include prompt information for indicating a method for unlocking the electronic device 100, such as "Enter fingerprint to unlock", etc. For another example, the lock screen interface may further include a fingerprint unlock control, which may be used to prompt the user to enter a touch operation position, and the fingerprint unlock control may be displayed in the fingerprint unlock area 12. Figure 2 In (1), the lock screen interface including time, battery information, wallpaper, and fingerprint unlocking control (fingerprint spot) is drawn as an example.

[0051] like Figure 2 As shown in (2), when the electronic device 100 detects a touch operation (fingerprint unlocking operation) performed by a user on the fingerprint unlocking area 12, the electronic device 100 responds to the touch operation, and the display screen 11 can highlight the fingerprint unlocking area 12, that is, highlight the area touched by the user.

[0052] In some embodiments, when the fingerprint unlocking area 12 of the display screen 11 is highlighted, a fingerprint unlocking control may be displayed in the user interface (lock screen interface), for example, the fingerprint unlocking control may include a fingerprint spot 13, and the fingerprint spot 13 may overlap with the fingerprint unlocking area 12 (the highlighted area). For another example, the fingerprint unlocking control may include a water ripple 14, and the display position of the water ripple 14 may be around the fingerprint unlocking area 12, surrounding the fingerprint unlocking area 12. In the user interface including the highlighted fingerprint unlocking area 12, in addition to including one or more fingerprint unlocking controls, other controls may also be included for displaying other content.

[0053] It should be noted that in the embodiments of the present application, the touch device of the electronic device is configured on the display screen as an example for drawing and explanation. The touch device can also be configured on the surface of the electronic device, and the present application does not limit this. For example, it can be configured on the physical power button of the electronic device, etc., which can be determined according to the form of the electronic device and business needs. It can be understood that the fingerprint unlocking solution proposed in the embodiments of the present application can be applied to any electronic device that uses a hard spot fingerprint unlocking method, and can be specifically applicable to electronic devices with different forms and functions, as well as adapting to different software versions (such as domestic versions and overseas versions) and chip platforms, and has a certain degree of universality and versatility.

[0054] Next, combine Figure 3-Figure 4 The specific process of implementing screen-off fingerprint unlocking in an electronic device provided in an embodiment of the present application is exemplified.

[0055] See also Figure 3 , Figure 31 is a schematic diagram of software interaction of an electronic device provided by an embodiment of the present application. Before introducing software interaction, the software architecture is described first.

[0056] like Figure 3 As shown, the software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to illustrate the software architecture of the electronic device. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces.

[0057] In some embodiments, the Android system is divided into five layers, from top to bottom, namely, application (APP) layer 31, application framework (FW / FWK) layer 32, native service (Native) layer 33, hardware abstraction layer (HAL) 34 and kernel (Kernel) layer 35. Figure 3 Also shown is a hardware layer 36 that can communicate with the kernel layer 35 .

[0058] The application layer 31, also referred to as the application layer, may include a series of application packages. The application package may include system applications and / or third-party applications. In an embodiment of the present application, the application package may include an always on display (AOD) application 311, which can be used to implement fingerprint unlocking with the screen off and fingerprint unlocking with the screen on.

[0059] In some embodiments, the application layer 31 may also include other applications 312, which may include, for example, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0060] The application framework layer 32 provides an application programming interface (API) and a programming framework for the application of the application layer 31. The application framework layer 32 includes some predefined functions. In an embodiment of the present application, the application framework layer 32 may include a power management service (PMS) module 321, which can be used to manage power and functions in electronic devices such as triggering the screen to turn on or off, brightness adjustment, low power mode, etc., and can also be used to issue control strategies to the application layer 31.

[0061] In some embodiments, the application framework layer 32 may also include a view system, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. Among them:

[0062] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0063] Content providers are used to store and retrieve data and make it accessible to applications. This data can include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0064] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications.

[0065] The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying images.

[0066] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including connected, hung up, etc.). The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0067] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0068] It should be noted that the application layer 31 and the application framework layer 32 run in a virtual machine. The virtual machine executes the Java files of the application layer 31 and the application framework layer 32 as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0069] The local service layer 33 may include multiple functional modules. In the embodiment of the present application, the local service layer 33 may include a system image engine (surfaceflinger, SF) module 331, wherein the system image engine may also be referred to as a system drawing core, an Android image engine, or a layer transmitter, etc. The SF module 331 may be used to obtain image data involved in synthesizing the content to be displayed, and to draw the graphical interface (user interface) of each application according to the obtained image data, as well as the elements displayed in each graphical interface, such as controls in the user interface. The SF module 331 may also send the obtained synthesized data to the hardware synthesizer (hardwarecomposer, HWC) module 341 of the hardware abstraction layer 34.

[0070] In some embodiments, the SF module 331 can also be used to determine the refresh rate (screen refresh rate) of the display screen 362 of the hardware layer 36 when displaying the user interface. For example, the refresh rate of the display screen 362 when displaying the user interface may be 60 Hz.

[0071] The hardware abstraction layer 34 is an interface layer located between the kernel layer 35 and the local service layer 33, which can be used to abstract the hardware and provide a virtual hardware platform for the electronic device. In the embodiment of the present application, the hardware abstraction layer 34 may include a HWC module 341 and a fingerprint hardware abstraction (FP_HAL) module 342. The HWC module 341 can be used for window synthesis and display, and provide hardware support for the SF module 331 to synthesize a graphical interface (user interface). The HWC module 341 can mix the synthesized data transmitted by the SF module 331 into a frame of image to obtain an image to be displayed, and the image to be displayed can be a user interface.

[0072] In some embodiments, the HWC module 341 can also be used to send the image to be displayed and the refresh rate of the display screen 362 when displaying the image to be displayed to the display screen 362 of the hardware layer 36 through the display driver (liquid crystal displaydriver, LCD driver) 353 of the kernel layer 35.

[0073] In the embodiment of the present application, the FP_HAL module 342 can be used to trigger the upper layer to send corresponding instructions after receiving the notification sent by the fingerprint driver (FP driver) 352 of the kernel layer 35. The FP_HAL module 342 is also used to send part or all of the instructions related to fingerprint unlocking to the LCD driver 353.

[0074] The kernel layer 35, which may also be referred to as the driver layer, is a layer between hardware and software. The kernel layer 35 includes various types of drivers. The so-called driver refers to a configuration file written by a hardware manufacturer according to the operating system, which contains information about the hardware device. By adding the driver to the operating system, the electronic device can communicate with the corresponding hardware device. In an embodiment of the present application, the kernel layer 35 may include a touch panel driver (TP driver) 351, an FP driver 352, and an LCD driver 353. Among them:

[0075] TP driver 351 can be used to receive the hardware interrupt corresponding to the touch operation transmitted from the hardware layer 36, and generate the corresponding event (activity) based on the hardware interrupt corresponding to the touch operation. After TP driver 351 generates the corresponding event, it can notify other drivers of the event. After generating the corresponding event, TP driver 351 can also send control strategies to other drivers, such as sending corresponding instructions.

[0076] FP driver352 can be used to further notify other modules, such as the upper layer FP_HAL module 342, after receiving notifications sent by other drivers, such as receiving notifications sent by TPdriver351 at the same layer, to trigger the upper layer to send control strategies. FP driver352 is also used to receive control strategies sent by other modules, such as instructions sent by TP driver351, and further send the instructions to other modules, such as further sending instructions to LCD driver353.

[0077] LCD driver 353 can be used to receive and execute instructions. LCD driver 353 can also be used to trigger the display screen 362 of the hardware layer 36 to power on, initialize parameter configuration, and display the content (user interface) sent by the upper layer.

[0078] In some embodiments, the core layer 35 may also include a camera driver module, an audio driver module, a sensor driver module, and the like.

[0079] The hardware layer 36 may include various hardware devices. In the embodiment of the present application, the hardware layer 36 may include hardware devices such as a touch device 361 and a display screen 362. Among them:

[0080] The touch device 361 may be called touch, and is used to detect a touch operation input by a user, and generate a corresponding hardware interrupt based on the touch operation, and then transmit the hardware interrupt to the TP driver 351 of the kernel layer 35 .

[0081] The display screen 362 is used to display the user interface and various elements in the user interface, such as the fingerprint unlocking control. The display screen 362 can also be used to display the user interface according to the display parameters sent by the upper layer. The display parameters sent by the upper layer can be, for example, refresh rate, resolution, etc. Among them, the display screen 362 includes two states: an off-screen state and a bright-screen state. When the display screen 362 is in the off-screen state, the integrated circuit (IC) of the display screen 362 has been powered off and needs to be powered on and initialized first. The user interface can be displayed only after the parameter configuration is completed. In the embodiment of the present application, the touch device 361 is set on the display screen 362 as an example for explanation. The touch screen composed of the touch device 361 and the display screen 362 can also be called a touch screen.

[0082] In some embodiments, the hardware layer 36 may also include hardware devices such as hardware chips.

[0083] When the electronic device is in the screen-off state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Figure 3 The software interaction process may include:

[0084] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer.

[0085] After receiving the hardware interrupt from the touch device 361, the TP driver 351 can generate a corresponding event, that is, generate a fingerprint unlocking event, which can also be called a fingerprint area event. After generating the fingerprint unlocking event, the TP driver 351 can notify the LCD driver 353 to power on through the FP driver 352, the FP_HAL module 342 and the HWC module 341, that is, the TP driver 351 can send a power-on instruction to the LCD driver 353 through the FP driver 352, the FP_HAL module 342 and the HWC module 341, such as the power-on 11 instruction (11 is the power-on instruction code), which is used to instruct the display screen 362 to power on. Specifically, the TP driver 351 can send a power-on instruction to the FP driver 352, and then the FP driver 352 can send a power-on instruction to the FP_HAL module 342, and then the FP_HAL module 342 further sends the LCD driver 353 power-on instruction to the HWC module 341.

[0086] Furthermore, in response to the power-on instruction, LCD driver 353 can execute the function related to the power-on instruction and obtain the relevant parameters for executing the power-on instruction. And further send the power-on instruction carrying the relevant parameters obtained by LCD driver 353 to display screen 362. After receiving the power-on instruction, display screen 362 can execute the power-on instruction, that is, display screen 362 can be powered on based on the relevant parameters sent by LCD driver 353. After the power-on is completed, display screen 362 can notify LCD driver 353 that the power-on is completed, that is, notify LCD driver 353 that display screen 362 has been successfully powered on. After receiving the notification, LCD driver 353 can wait for further instructions sent by the upper layer.

[0087] It should be noted that Figure 3 The circle mark ① in the middle shows the process of triggering the display screen 362 to power on, that is, the process from the touch device 361 to the display screen 362. After the display screen 362 is powered on, the process of notifying the LCD driver 353 that the power has been successfully powered on is not shown in FIG. Figure 3 Shown.

[0088] Process 2: When TP driver 351 responds to the fingerprint unlock event and sends a power-on command to FP driver 352, TP driver 351 can simultaneously notify other modules to trigger the next operation, such as notifying the upper layer of the software of the fingerprint unlock event. Specifically, TP driver 351 can send a fingerprint unlock event to FP driver 352, and then FP driver 352 sends the fingerprint unlock event to FP_HAL module 342, and then FP_HAL module 342 can send the fingerprint unlock event to the AOD application 311 of the application layer 31.

[0089] After the AOD application 311 receives the notification (fingerprint unlocking event) sent from the FP_HAL module 342, the AOD application 311 can send a power-on instruction, such as a power-on 11 instruction, to the LCD driver 353 through the PMS module 321, the SF module 331, and the HWC module 341. It should be noted that the power-on instruction sent by the AOD application 311 to the LCD driver 353 through the PMS module 321, the SF module 331, and the HWC module 341 also includes the parameters required for the LCD driver 353 to trigger the initialization of the display screen 362, so that the display screen 362 that has completed power-on can be initialized. Parameter configuration. For example, the power-on instruction received by the LCD driver 353 may include, for example, an image to be displayed (user interface) synthesized by the SF module 331 and the HWC module 341, such as a fingerprint unlocking control.

[0090] Since LCD driver 353 has received the power-on instruction sent by HWC module 341 before, and sent the power-on instruction to display screen 362, display screen 362 is powered on in response to the power-on instruction. When LCD driver 353 receives the power-on instruction again, the parameters carried in the power-on instruction can be sent to display screen 362 first to trigger the initialization of display screen 362. Among them, LCD driver 353 can execute related functions based on the power-on instruction sent by HWC module 341, and send the obtained parameters related to the initialization of display screen 362 to display screen 362. Then, after receiving the parameters required for initialization, display screen 362 can be initialized based on the received parameters. And after display screen 362 completes the initialization parameter configuration, return (return) the power-on instruction. Among them, returning (return) the power-on instruction can be understood as notifying the upper display screen 362 that the power-on has been completed, and no longer executing the thread corresponding to the power-on instruction. After the display screen 362 is initialized, the LCD driver 353 may be notified that the initialization is completed, that is, the LCD driver 353 is notified that the display screen 362 is successfully initialized.

[0091] Then, LCD driver 353 can notify HWC module 341 that power-on has been completed, and then HWC module 341 notifies SF module 331 that power-on has been completed. LCD driver 353 can notify HWC module 341 that power-on has been completed after display screen 362 has completed power-on and initialization parameter configuration.

[0092] It should be noted that after the SF module 331 receives the notification sent by the HWC module 341, the SF module 331 does not need to continue to notify other modules. The SF module 331 can modify the parameters used to indicate the display status of the display screen 362 so that other modules can read the parameters modified by the SF module 331 and know the current status of the display screen 362.

[0093] After LCD driver 353 notifies HWC module 341 that display screen 362 has completed power-on, LCD driver 353 can also notify FP_HAL module 342 to issue a fingerprint highlight instruction. Furthermore, after FP_HAL module 342 receives the notification from LCD driver 353, it can issue a fingerprint highlight instruction to LCD driver 353, which is used to instruct the display screen 362 to highlight in the fingerprint unlocking area, so as to collect the fingerprint image input by the user. The fingerprint highlight instruction can include, for example, 29 instructions (29 is the instruction code) and localized high brightness mode (LHBM) instructions. The fingerprint highlight instruction is used to instruct the display screen 362 to highlight in the fingerprint unlocking area, so as to collect the fingerprint data input by the user.

[0094] In some embodiments, when the FP_HAL module 342 sends the fingerprint highlight instruction to the LCD driver 353, the fingerprint highlight instruction can be sent to the LCD driver 353 through the HWC module 341, that is, the FP_HAL module 342 can first send the fingerprint highlight instruction to the HWC module 341, and then the HWC module 341 sends the fingerprint highlight instruction to the LCD driver 353. It should be noted that Figure 3 After receiving the notification from LCD driver 353, FP_HAL module 342 directly sends the fingerprint highlight command to LCD driver 353 as an example for drawing and explaining. FP_HAL module 342 sends the fingerprint highlight command to LCD driver 353 through HWC module 341 without Figure 3 Shown in.

[0095] Furthermore, after receiving the fingerprint highlight instruction, LCD driver 353 can trigger the display screen 362 to highlight the fingerprint unlocking area. Specifically, after receiving the fingerprint highlight instruction, LCD driver 353 can directly send the fingerprint highlight instruction to the display screen 362. LCD driver 353 can also execute functions related to the fingerprint highlight instruction, etc. After LCD driver 353 completes the execution, the fingerprint highlight instruction can be sent to the display screen 362. The fingerprint highlight instruction includes parameters obtained by LCD driver 353 executing functions related to the fingerprint highlight instruction.

[0096] After the display screen 362 receives the fingerprint highlight command, it can highlight the fingerprint unlocking area based on the fingerprint highlight command, that is, a bright spot is displayed in the fingerprint unlocking area of ​​the display screen 362. Furthermore, after the display screen 362 highlights the fingerprint unlocking area, it can notify the LCD driver 353 that the highlighting has been completed (highlighted), that is, it notifies the LCD driver 353 that the display screen 362 has been successfully highlighted.

[0097] After LCD driver 353 receives the notification of highlighting sent by display screen 362 , LCD driver 353 may notify FP_HAL module 342 that display screen 362 has been highlighted, so that FP_HAL module 342 triggers the next operation.

[0098] In some embodiments, the LCD driver 353 may also notify the HWC module 341 that the display screen 362 has completed highlight display, and then the HWC module 341 notifies the FP_HAL module 342 that the display screen 362 has completed highlight display. Figure 3 The middle circle mark ② shows the above process of triggering the fingerprint highlighting of the display screen 362, that is, the process from the FP_HAL module 342 to the display screen 362. After the display screen 362 is highlighted, the process of notifying the LCD driver 353 that the highlighting has been completed is not in Figure 3 Shown.

[0099] In some embodiments, when the display screen 362 performs highlight display in the fingerprint unlocking area, the LCD driver 353 can also trigger the display screen 362 to display part or all of the fingerprint unlocking controls, which may include, for example, fingerprint spot controls, water ripple controls, etc.

[0100] In some embodiments, before notifying the FP_HAL module 342 that the display screen has completed highlighting, the LCDdriver 353 may also determine (check) whether the display screen 362 has been powered on and highlighted (execute a power-on instruction and a fingerprint highlighting instruction). After determining that the display screen 362 has completed powering on and highlighting, the FP_HAL module 342 is notified that the display screen 362 has completed highlighting, thereby triggering the next operation.

[0101] Process 3: After the FP_HAL module 342 receives the notification sent by the LCD driver 353 (the highlighted notification), the FP_HAL module 342 may send a picture acquisition instruction to the LCD driver 353. The picture acquisition instruction is used to trigger the picture acquisition operation, that is, trigger the acquisition of the fingerprint image input by the user.

[0102] After receiving the image acquisition instruction, LCD driver353 can directly send the image acquisition instruction to the display screen 362. LCD driver353 can also execute functions related to the image acquisition instruction. After LCD driver353 completes the execution, the image acquisition instruction can be sent to the display screen 362. The image acquisition instruction includes parameters obtained by LCD driver353 executing functions related to the image acquisition instruction.

[0103] After receiving the image acquisition instruction, the display screen 362 can acquire the fingerprint image corresponding to the touch operation input by the user, and after the acquisition is completed, the LCD driver 353 can be notified that the image acquisition is completed. After the LCD driver 353 receives the notification of the completion of the image acquisition sent by the display screen 362, the LCD driver 353 can notify the FP_HAL module 342 that the display screen 362 has completed the image acquisition.

[0104] After the FP_HAL module 342 receives the notification sent by the LCD driver 353, the FP_HAL module 342 can send a stop acquisition instruction to the LCD driver 353. The stop acquisition instruction is used to trigger the stop acquisition operation, that is, to trigger the display screen 362 to stop acquiring fingerprint images, and can also be used to trigger the display screen 362 to stop highlighting fingerprints. Furthermore, after receiving the stop acquisition instruction, the LCD driver 353 can directly send the stop acquisition instruction to the display screen 362. The LCD driver 353 can also execute functions related to the stop acquisition instruction, etc. After the LCD driver 353 completes the execution, the stop acquisition instruction can be sent to the display screen 362. The acquisition instruction includes parameters obtained by the LCD driver 353 executing functions related to the stop acquisition instruction. After the display screen 362 receives the stop acquisition instruction, it can stop acquiring fingerprint images and notify the LCD driver 353 that the acquisition has stopped.

[0105] In some embodiments, LCD driver 353 may continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, etc., so as to complete fingerprint unlocking in the screen-off state.

[0106] It should be noted that Figure 3 The circle mark ③ in the middle shows the process of issuing the above-mentioned image acquisition instruction or issuing the image acquisition stop instruction, that is, the process from the FP_HAL module 342 to the LCD driver 353. After the display screen 362 acquires images or stops acquiring images, the process of notifying the LCD driver 353 that the image acquisition has been completed or has stopped is not in Figure 3 Shown.

[0107] It should be noted that Figure 3 The circle mark ① in the figure shows the above process 1. Figure 3 The circle mark ② in the figure shows part of the process 2 above. Figure 3 The circle mark ③ in the figure shows part of the process 3 above.

[0108] Please also read Figure 4 , Figure 4 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application. Figure 4 As shown, the application (APP) can be used to represent Figure 3 The application in the application layer 31 shown is, for example, the AOD application 311 mentioned above.

[0109] First, the touch device of the electronic device can detect a touch operation acting on the touch device, such as Figure 1In the application scenario shown, the touch device of the electronic device can detect the touch operation of the user (actor) on the fingerprint unlocking area in the display screen (touch device). It should be noted that Figure 4 The drawing and explanation are made by taking the setting of a touch device on a display screen as an example. The display screen may be a display screen with a touch function, such as a touch screen or a touch control screen.

[0110] (1) In response to the above touch operation, the touch device (display screen) may send a hardware interrupt corresponding to the touch operation to the kernel layer, specifically to the TP driver of the kernel layer.

[0111] After the TP driver receives the hardware interrupt, (2) the TP driver in the kernel layer can generate a fingerprint unlock event (fingerprint area event) and send the fingerprint unlock event to the FP driver. The fingerprint unlock event can also be used to instruct the FP driver to continue to notify other modules. For example, the FP driver can notify the FP_HAL module of the hardware abstraction layer (HAL). The fingerprint unlock event can also be understood as the TP driver sending a power-on instruction to the FP driver to instruct the FP driver to further trigger the display to power on.

[0112] After the FP driver receives the fingerprint unlocking event sent by the TP driver, (3) the FP driver of the hardware abstraction layer can trigger the report to the upper layer. Furthermore, (4) the FP driver of the hardware abstraction layer can send the fingerprint unlocking event to the hardware abstraction layer, specifically to the FP_HAL module of the hardware abstraction layer, so that the FP_HAL module triggers the notification of the HWC module and reports to the upper layer at the same time.

[0113] After the FP_HAL module receives the notification from the FP driver, (5) the FP_HAL module of the hardware abstraction layer can perform logic processing, and then, the FP_HAL module can also notify the HWC module of the fingerprint unlocking event, which can be understood as sending a power-on instruction to the HWC module. Among them, the logic processing, for example, triggers the notification of the fingerprint unlocking event to the upper layer, such as notifying the application in the application layer. It can be understood that the FP_HAL module can simultaneously notify the HWC module at the same layer to send a power-on instruction to the LCD driver, and trigger the notification of the upper layer. That is, (6) the FP_HAL module of the hardware abstraction layer can send the fingerprint unlocking event to the native service layer, that is, the FP_HAL module of the hardware abstraction layer can notify the local service layer.

[0114] After the local service layer receives the notification from the FP_HAL module of the hardware abstraction layer, (7) the local service layer can send the fingerprint unlocking event to the application framework layer (FW), that is, the local service layer can notify the application framework layer.

[0115] Furthermore, after the application framework layer receives the notification from the local service layer, (8) the application framework layer can send the fingerprint unlocking event to the application layer, that is, the application framework layer can notify the application layer. Specifically, it can be transmitted to the application in the application layer, such as the AOD application. Thus, the fingerprint unlocking event is transmitted from the FP driver, through the hardware abstraction layer, the local service layer, and the application framework layer to the application in the application layer.

[0116] During the reporting process of the FP_HAL module, the HWC module of the hardware abstraction layer (9) receives the notification (power-on command) from the FP_HAL module, and can then trigger the issuance of the power-on command. That is, the HWC module of the hardware abstraction layer (10) can send a power-on command to the LCD driver.

[0117] After the LCD driver receives the power-on instruction sent from the HWC module, (11) the LCD driver of the kernel layer can first execute the power-on instruction, such as executing functions related to the power-on instruction 11. After the LCD driver completes the execution, (12) the LCD driver of the kernel layer can send the power-on instruction (such as the power-on instruction 11) to the display screen. The power-on instruction can carry relevant parameters obtained by the LCD driver executing the power-on instruction to trigger the display screen to power on.

[0118] After the display screen receives the power-on command sent by the LCD driver, (13) the display screen can execute the power-on command, that is, the display screen is powered on. Since it takes a certain amount of time to power on the display screen, the fingerprint unlocking event reporting process can continue to be executed during the display screen power-on process, that is, the FP_HAL module sends the fingerprint unlocking event to the AOD application.

[0119] After an application in the application layer (such as an AOD application) receives a notification from the application framework layer, (14) the application layer may issue a power-on instruction, such as issuing a power-on 11 instruction to the application framework layer, and specifically issuing a power-on 11 instruction to the PMS module of the application framework layer. The process of issuing a power-on instruction may also be referred to as a process of each layer executing a power-on instruction.

[0120] In some embodiments, the application in the application layer may also issue other instructions, which may be determined based on the function of the application, and this application does not limit this.

[0121] Then, after receiving the power-on instruction from the application layer, the PMS module of the application framework layer (15) can further send the power-on instruction to the local service layer, for example, it can send a power-on instruction 11 to the SF module of the local service layer. After receiving the power-on instruction, the PMS module can perform logical processing, for example, it can trigger the screen to light up, determine the backlight brightness (normal backlight) parameters of the display screen, etc., and send the determined parameters to the local service layer.

[0122] In the process of the PMS module receiving the power-on instruction and further sending the power-on instruction to the local service layer, the logic processing performed by the PMS module may take, for example, about 100 milliseconds, and the time taken to power on the display may be, for example, about 175 milliseconds. Figure 4 Taking the completion of the display screen power-on as an example, after the display screen power-on is completed, (16) the display screen can notify the LCD driver that the power-on is completed. After receiving the notification, the LCD driver 353 can wait for further instructions sent by the upper layer.

[0123] After the SF module of the local service layer receives the power-on instruction from the PMS module of the application framework layer, (17) the SF module of the local service layer can also further send a power-on instruction to the hardware abstraction layer, for example, it can specifically send a power-on instruction 11 to the HWC module of the hardware abstraction layer. Among them, after receiving the power-on instruction, the SF module can obtain the image data involved in the content to be displayed on the display screen, such as the fingerprint unlocking control, and perform synthesis processing, and then the synthesized display data and the parameters sent by the PMS module can be sent to the HWC module. Optionally, SF can also determine the refresh rate of the display screen when displaying content, and then send the refresh rate parameters to the HWC module.

[0124] After the HWC module receives the power-on instruction from SF, (18) the HWC module of the hardware abstraction layer can further send the power-on instruction to the LCD driver of the kernel layer. The HWC module can receive the display data synthesized by SF and perform synthesis processing to obtain the image to be displayed. Then, the HWC module can send the image to be displayed and the parameters / data sent by the above layers to the LCD driver.

[0125] After the LCD driver receives the power-on instruction from the HWC module, since the LCD driver has already received the power-on instruction and triggered the display screen to power on, the LCD driver can return the power-on instruction. Specifically, since the power-on instruction sent by the AOD application through the PMS module, the SF module and the HWC module also includes the parameters required for the initialization of the display screen, after the LCD driver receives the power-on instruction, (19) the LCD driver of the kernel layer can send the parameters carried by the power-on instruction to the display screen.

[0126] In some embodiments, the LCD driver may also execute related functions based on the power-on instruction sent by the HWC module, and send the obtained parameters to the display screen. Figure 4 Take the LCD driver directly sending the parameters carried in the power-on command sent by the HWC module to the display screen as an example for drawing.

[0127] After the display screen receives the parameters carried by the power-on command, (20) the display screen can be initialized based on the parameters. After the display screen initialization parameters are configured, (21) the display screen can notify the LCD driver that the initialization has been completed, that is, notify the LCD driver that the display screen has been successfully initialized.

[0128] After the LCD driver receives the notification that the display has completed initialization, (22) the LCD driver of the kernel layer can return the power-on instruction, specifically notifying the HWC module that the display has completed power-on, that is, notifying the HWC module that the display has successfully powered on and initialized parameter configuration. (23) The HWC module of the hardware abstraction layer can further notify the local service layer. Specifically, it can notify the SF module of the local service layer that the display has completed power-on.

[0129] In some embodiments, the SF module can modify the parameters used to indicate the current display state of the display screen, so that other modules can read the parameters modified by the SF module and know the current state of the display screen. Therefore, the SF module does not need to continue to notify other modules.

[0130] After the LCD driver sends a notification to the HWC module of the hardware abstraction layer, (24) the LCD driver of the kernel layer can notify the FP_HAL module to issue a fingerprint highlighting command.

[0131] After the FP_HAL module receives the notification from the LCD driver, (25) the FP_HAL module of the hardware abstraction layer can send fingerprint highlighting instructions to the LCD driver of the kernel layer, such as issuing 29 instructions and LHBM instructions.

[0132] After the LCD driver receives the fingerprint highlight command sent from the FP_HAL module, (26) the LCD driver of the kernel layer can execute the fingerprint highlight command, such as executing functions related to the fingerprint highlight command. After the execution is completed, (27) the LCD driver of the kernel layer can send the fingerprint highlight command to the display screen to trigger the display screen to highlight the fingerprint unlocking area. Among them, the fingerprint highlight command sent by the LCD driver to the display screen can carry parameters obtained by the functions related to the LCD driver.

[0133] After receiving the fingerprint highlighting command, the display screen (28) can highlight the fingerprint unlocking area based on the fingerprint highlighting command, for example, display a bright spot in the fingerprint unlocking area of ​​the display screen. Furthermore, after the fingerprint unlocking area is highlighted, (29) the display screen can notify the LCD driver of the kernel layer that the display screen has been highlighted, that is, notify the LCD driver that the display screen has been successfully highlighted.

[0134] After the LCD driver receives the notification sent by the display, (30) the LCD driver of the kernel layer can notify the hardware abstraction layer that the display has completed highlighting. Specifically, the FP_HAL module can be directly notified that the display has completed highlighting. Among them, the LCD driver notifying the FP_HAL module that the highlighting has been completed can also be understood as notifying the FP_HAL module that the power-on and highlighting have been completed, and the FP_HAL module can be notified to trigger the image acquisition operation.

[0135] In some embodiments, before notifying the FP_HAL module that the display screen has completed highlighting, the LCD driver may also determine (check) whether the display screen is powered on and highlighted (execute a power-on instruction and a fingerprint highlighting instruction), and only after determining that the display screen has completed powering on and highlighting, notify the FP_HAL module that the display screen has completed highlighting.

[0136] After the FP_HAL module receives the notification sent by the LCD driver, (31) the FP_HAL module of the hardware abstraction layer can trigger the execution of the image acquisition operation, that is, send an image acquisition instruction to the LCD driver of the kernel layer, and the image acquisition instruction is used to acquire the fingerprint image input by the user.

[0137] After the LCD driver receives the image acquisition instruction, (32) the LCD driver of the kernel layer can send the image acquisition instruction to the display screen.

[0138] Furthermore, after the display screen receives the image acquisition instruction, (33) the display screen can acquire the fingerprint image corresponding to the touch operation input by the user. After the acquisition is completed, (34) the display screen can notify the LCD driver that the image acquisition has been completed. Furthermore, after the LCD driver receives the notification sent by the display screen, (35) the LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the image acquisition.

[0139] After the FP_HAL module receives the notification sent by the LCD driver, (36) the FP_HAL module of the hardware abstraction layer can send a stop (disable) image acquisition instruction to the LCD driver (disable the image acquisition instruction). The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display to stop collecting fingerprint images, and can also be used to trigger the display to stop highlighting fingerprints.

[0140] Furthermore, after the LCD driver receives the stop acquisition instruction, (37) the LCD driver of the core layer can send the stop acquisition instruction to the display screen, and after the display screen receives the stop acquisition instruction, (38) the display screen can stop acquiring fingerprint images. Furthermore, (39) the display screen can notify the LCD driver that the acquisition has stopped.

[0141] Furthermore, the LCD driver can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to unlock the screen with the fingerprint in the off state.

[0142] It should be noted that Figure 4 In the figure, the sending / transmission of events, data, etc. from the bottom layer to the upper layer (from right to left) is represented by a realization arrow, and the sending of data / instructions, etc. from the upper layer to the bottom layer (from left to right) is represented by a dotted arrow.

[0143] Please also read Figure 5 , Figure 5 This is an optimized schematic diagram of the off-screen fingerprint unlocking solution provided in the embodiment of the present application. Figure 5 As shown, the electronic device is in the screen-off state and locked state before receiving the fingerprint unlocking operation.

[0144] In the scheme before the electronic device is optimized, when the touch device of the electronic device detects a touch operation, the TPdriver can report a hardware interrupt and report the fingerprint unlocking event corresponding to the touch operation through the FP driver, thereby triggering the upper layer to send a power-on instruction, such as the power-on 11 instruction. Among them, since the logical processing performed by the PMS module when sending the power-on instruction takes a long time, the duration of the process of reporting the event and sending the power-on instruction can be, for example, 200 milliseconds (ms). After the LCD driver receives the power-on instruction, it can trigger the display screen to power on and initialize. The display screen power-on and initialization takes, for example, 120ms. The power-on and initialization duration is, for example, 200 milliseconds. Figure 5 As shown in the white square in the middle. The LCD driver can report that the display has completed power-on and initialization, thereby triggering the upper layer to send fingerprint highlighting instructions, such as 29 instructions and LHBM instructions ( Figure 5 Take fingerprint 29 command as an example for drawing). Then, the LCD driver can execute the fingerprint highlight command to trigger the display to highlight the fingerprint unlocking area. The duration of the highlight display is, for example, Figure 5 After the fingerprint highlighting command is reported to the display screen, the image acquisition operation is triggered.

[0145] In the optimized solution of the electronic device, after receiving the touch operation, the touch device of the electronic device can send a power-on instruction to the LCD driver while reporting the fingerprint unlocking event to trigger the upper layer to send instructions, and then the LCD driver can first trigger the display screen to power on, that is, send a power-on instruction to the display screen. During the display screen power-on process, each functional module can report the fingerprint unlocking event and trigger the upper layer to send a power-on instruction to the LCD driver, which is equivalent to the LCD driver triggering the display screen to power on, and reporting the fingerprint unlocking event and triggering the upper layer to send instructions at the same time. For example Figure 5 The middle white box includes the display screen power-on in the "report event, issue command" time period. Then, when the power-on command issued by the upper layer is sent to the LCD driver, the LCD driver can trigger the display screen that has completed power-on to initialize. The initialization time is, for example, Figure 5 Furthermore, the LCD driver can directly receive fingerprint highlighting commands issued by the FP_HAL module, such as 29 commands and LHBM commands, and trigger the highlighting of the fingerprint unlocking area. The duration of the highlighting is, for example, Figure 5 After the fingerprint highlighting instruction is reported to the display screen, the image acquisition operation is triggered. It can be seen that the solution provided by the embodiment of the present application can reduce the time consumption of fingerprint unlocking (such as Figure 5 Optimized fingerprint unlocking time).

[0146] In an embodiment of the present application, when the electronic device is in a locked state and receives a touch operation when the electronic device is in a screen-off state, the TP driver of the kernel layer can trigger the process of notifying the LCD driver to power on through the FP driver, the FP_HAL module and the HWC module, while executing the reported process. On the one hand, by decoupling the power-on instruction and the fingerprint highlight instruction, that is, executing the power-on instruction and the fingerprint highlight instruction separately, triggering the execution of the power-on instruction first, that is, triggering the display screen to power on first, so that the display screen can directly perform initialization parameter configuration after power-on is completed, which is conducive to saving the time consumption of fingerprint unlocking; on the other hand, the process of the HWC module notifying the LCD driver to power on is executed simultaneously with the process of reporting and sending the power-on, which can be conducive to reducing the time consumption of the power-on delay part of the display screen, and directly sending the power-on instruction at the kernel layer, compared with sending the power-on instruction across layers, shortens the link involved in the process of sending the power-on instruction, and takes less time. In addition, the fingerprint highlight instruction can be directly triggered to execute in the future, reducing the time consumption of notifying the upper layer to send the fingerprint unlock instruction again, which can also be conducive to improving the efficiency of fingerprint unlocking and realizing the performance optimization of screen-off fingerprint unlocking.

[0147] It should be noted that in the process of triggering the display screen to power on in advance, since the TP driver and the FP driver are two drivers of the kernel layer, the FP_HAL module and the HWC module are two modules of the hardware abstraction layer, and the kernel layer and the hardware abstraction layer are two adjacent layers, the link of sending the power-on instruction to the LCD driver through the TP driver, the FP driver, the FP_HAL module and the HWC module, and transmitting the power-on instruction in the adjacent layers (kernel layer and hardware abstraction layer) is shorter than transmitting the power-on instruction across multiple layers, and the time required to transmit the power-on instruction is less. In terms of saving the time spent on powering on the display screen, the link of transmitting the power-on instruction between the functional modules of the adjacent layers is short, which can save more time and has a great benefit in terms of timeliness.

[0148] Next, combine Figure 6-Figure 7 The specific process of implementing fingerprint unlocking with a bright screen in an electronic device provided in an embodiment of the present application is exemplified.

[0149] Please also read Figure 6 , Figure 6 FIG. 1 is a software architecture diagram of another electronic device provided in an embodiment of the present application. Figure 6 As shown, the software system of the electronic device may include an application layer 31, an application framework layer 32, a local service layer 33, a hardware abstraction layer 34 and a kernel layer 35. Figure 6 The functions of each layer and the modules included can be found in Figure 3The description of the corresponding software architecture will not be repeated here.

[0150] In a possible implementation, when the electronic device is in a screen-off state and determines that the fingerprint image corresponding to the fingerprint unlocking operation does not match the fingerprint image preset by the electronic device, for example, the similarity between the fingerprint image corresponding to the fingerprint unlocking operation and the fingerprint image preset by the electronic device is less than a set threshold, the electronic device can enter a screen-on state, that is, light up the display screen, and display, for example Figure 2 The lock screen interface shown in (1) in FIG. 1 . Furthermore, the electronic device can realize fingerprint unlocking in the bright screen state. For example, the electronic device can further compare the fingerprint image corresponding to the fingerprint unlocking operation in the bright screen state of the electronic device with the fingerprint image preset by the electronic device, and then obtain another identity authentication result.

[0151] When the electronic device is in a screen-on state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Figure 6 The software interaction process may include:

[0152] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer 35.

[0153] After receiving the hardware interrupt from the touch device 361, the TP driver 351 can generate a corresponding event, that is, generate a fingerprint unlock event, which can also be called a fingerprint area event. Then the TP driver 351 can report the fingerprint unlock event, that is, the TP driver 351 can upload the fingerprint unlock event to the FP_HAL module 342 of the hardware abstraction layer 34 through the FP driver 352.

[0154] Furthermore, after receiving the fingerprint unlocking event, the FP_HAL module 342 can issue a fingerprint highlighting instruction. Specifically, the FP_HAL module 342 can directly issue a fingerprint highlighting instruction to the LCD driver 353 of the kernel layer 35, such as issuing a 29 instruction and an LHBM instruction, so that the LCD driver 353 triggers the display screen 362 to highlight, that is, the display screen 362 can specifically highlight the fingerprint unlocking area. Specifically, the LCD driver 353 can directly issue the fingerprint highlighting instruction to the display screen 362. The LCD driver 353 can also execute functions related to the fingerprint highlighting instruction, etc. After the LCD driver 353 is executed, the fingerprint highlighting instruction can be sent to the display screen 362. The fingerprint highlighting instruction includes parameters obtained by the LCD driver 353 executing functions related to the fingerprint highlighting instruction.

[0155] After receiving the fingerprint highlighting instruction, the display screen 362 can highlight the fingerprint unlocking area based on the fingerprint highlighting instruction, that is, a bright spot is displayed in the fingerprint unlocking area of ​​the display screen 362. Furthermore, after the display screen 362 highlights the fingerprint unlocking area, it can notify the LCD driver 353 that the display screen 362 has been highlighted, that is, it notifies the LCD driver 353 that the display screen 362 has been successfully highlighted.

[0156] In some embodiments, when the FP_HAL module 342 sends the fingerprint highlight instruction to the LCD driver 353, the fingerprint highlight instruction can be sent to the LCD driver 353 through the HWC module 341, that is, the FP_HAL module 342 can first send the fingerprint highlight instruction to the HWC module 341, and then the HWC module 341 sends the fingerprint highlight instruction to the LCD driver 353. It should be noted that Figure 6 After receiving the notification from LCD driver 353, FP_HAL module 342 directly sends the fingerprint highlight command to LCD driver 353 as an example for drawing and explaining. FP_HAL module 342 sends the fingerprint highlight command to LCD driver 353 through HWC module 341 without Figure 6 Shown in.

[0157] Furthermore, the LCD driver 353 may notify the FP_HAL module 342 that the display screen 362 has completed highlighting, so that the FP_HAL module 342 triggers the next operation.

[0158] In some embodiments, when the display screen 362 performs highlight display in the fingerprint unlocking area, the LCD driver 353 can also trigger the display screen 362 to display part or all of the fingerprint unlocking controls, which may include, for example, fingerprint spot controls, water ripple controls, etc.

[0159] Before LCD driver 353 notifies FP_HAL module 342 that display screen 362 has completed highlight display, LCD driver 353 may also determine (check) whether display screen 362 is powered on and highlighted. Only after determining that display screen 362 has completed power on and highlighted display, does it notify FP_HAL module 342 that display screen has completed highlight display.

[0160] In some embodiments, the LCD driver 353 may directly notify the FP_HAL module 342 that the display screen 362 has completed highlighting. The LCD driver 353 may also first notify the HWC module 341, and then the HWC module 341 notifies the FP_HAL module 342.

[0161] Process 2: After the FP_HAL module 342 receives the notification sent by the LCD driver 353, the FP_HAL module 342 triggers the image acquisition operation. Specifically, the image acquisition instruction may be sent to the LCD driver 353. The image acquisition instruction is used to trigger the image acquisition operation, that is, trigger the acquisition of the fingerprint data input by the user.

[0162] After receiving the image acquisition instruction, LCD driver 353 can directly send the image acquisition instruction to display screen 362. LCD driver 353 can also execute functions related to the image acquisition instruction. After LCD driver 353 completes the execution, the image acquisition instruction can be sent to display screen 362. The image acquisition instruction includes parameters obtained by LCD driver 353 executing functions related to the image acquisition instruction. After receiving the image acquisition instruction, display screen 362 can acquire the fingerprint image corresponding to the touch operation input by the user. After the acquisition is completed, LCD driver 353 can be notified that the image acquisition has been completed.

[0163] After LCD driver 353 receives the notification of the completion of image acquisition sent by display screen 362, LCD driver 353 can notify FP_HAL module 342 that display screen 362 has completed image acquisition. After FP_HAL module 342 receives the notification sent by LCD driver 353, FP_HAL module 342 can send a stop image acquisition instruction to LCD driver 353. The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display screen 362 to stop acquiring fingerprint images, and can also be used to trigger the display screen 362 to stop highlighting fingerprints. Furthermore, after receiving the stop image acquisition instruction, LCD driver 353 can directly send the stop image acquisition instruction to display screen 362, and LCD driver 353 can also execute functions related to the stop image acquisition instruction, etc. After LCD driver 353 completes execution, the stop image acquisition instruction can be sent to display screen 362. The image acquisition instruction includes parameters obtained by LCD driver 353 executing functions related to the stop image acquisition instruction.

[0164] After receiving the stop image acquisition instruction, the display screen 362 can stop acquiring fingerprint images and notify LCD driver 353 that image acquisition has stopped. Furthermore, LCD driver 353 can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to complete fingerprint unlocking in the off-screen state.

[0165] It should be noted that Figure 6 The middle circle mark ① shows the above process of triggering the display screen 362 fingerprint highlighting. After the display screen 362 fingerprint is highlighted, the process of notifying the LCD driver 353 that the highlighting display has been completed is not in Figure 3 Shown.

[0166] It should be noted that Figure 6 The circle mark ① in the figure shows part of the process 1 above. Figure 6 The circle mark ② in the figure shows part of the process 2 above.

[0167] Please also read Figure 7 , Figure 7 1 is a timing diagram of a fingerprint unlocking method with a bright screen provided in an embodiment of the present application. Figure 7 As shown, first, the LCD driver can determine (check) whether the display screen has been powered on (and initialized), and after determining that the display screen has been powered on, the touch device of the electronic device can detect the touch operation. The LCD driver can determine (check) whether the display screen displays a user interface, such as a lock screen interface.

[0168] When the user inputs a touch operation, the touch device of the electronic device can detect the touch operation input by the user, and at this time, the display screen of the electronic device has been powered on and initialized. (1) In response to the above touch operation, the touch device (display screen) can transmit the hardware interrupt corresponding to the touch operation to the TP driver of the kernel layer. After the TP driver receives the hardware interrupt, (2) the TP driver of the kernel layer can generate the fingerprint unlocking event (fingerprint area event) and send the fingerprint unlocking event (notification) to the FP driver.

[0169] After the FP driver receives the fingerprint unlocking event sent by the TP driver, (3) the FPdriver of the kernel layer can send the fingerprint unlocking event to the hardware abstraction layer (HAL), specifically to the FP_HAL module of the hardware abstraction layer, to notify the FP_HAL module to issue a fingerprint highlighting instruction.

[0170] Furthermore, after the FP_HAL module receives the fingerprint unlocking event (notification) sent by the FP driver, (4) the FP_HAL module of the hardware abstraction layer (HAL) can directly send fingerprint highlighting instructions to the LCD driver of the kernel layer, such as issuing 29 instructions and LHBM instructions.

[0171] In some embodiments, the FP_HAL module may first send a fingerprint highlight instruction to the HWC module, and then the HWC module sends a fingerprint highlight instruction to the LCD driver 353.

[0172] In some embodiments, the FP_HAL module may also continue to report the fingerprint unlocking event, for example, reporting to the application in the application layer through the local service layer and the application framework layer. Figure 7 Take the FP_HAL module directly sending fingerprint highlight commands to the LCD driver as an example to draw and explain, the FP_HAL module sends fingerprint highlight commands to the LCD driver through the HWC module, and the FP_HAL module reports the fingerprint unlocking event to the upper layer without Figure 7 Shown in.

[0173] After the LCD driver receives the fingerprint highlight instruction sent from the FP_HAL module, (5) the LCD driver of the kernel layer can execute the fingerprint highlight instruction, such as the LCD driver can execute functions related to the fingerprint highlight instruction. After the execution is completed, (6) the LCD driver of the kernel layer can send the fingerprint highlight instruction to the display screen to trigger the display screen to highlight the fingerprint unlocking area. Among them, the fingerprint highlight instruction sent by the LCD driver to the display screen can carry the parameters obtained by the LCD driver executing the function.

[0174] After the display screen receives the fingerprint highlight command, (7) the display screen can respond to the fingerprint highlight command and highlight the fingerprint unlocking area, for example, displaying a bright spot in the fingerprint unlocking area of ​​the display screen. Furthermore, (8) the display screen can notify the LCD driver of the kernel layer that the display screen has been highlighted, that is, notifying the LCD driver that the display screen has been successfully highlighted.

[0175] (9) The LCD driver of the kernel layer can notify the hardware abstraction layer that the display screen has completed highlighting. Specifically, the FP_HAL module can be directly notified that the display screen has completed highlighting. Optionally, the LCD driver can notify the FP_HAL module through the HWC module that the display screen has completed highlighting, that is, the LCD driver first notifies the HWC module that the display screen has completed highlighting, and then the HWC module notifies the FP_HAL module that the display screen has completed highlighting. It should be noted that Figure 7 Take LCD driver directly notifying FP_HAL module as an example to draw and explain. LCD driver notifies FP_HAL module through HWC module. Figure 7 Optionally, when the LCD driver notifies the hardware abstraction layer that the display screen has completed highlighting, it can be understood as notifying the FP_HAL module to trigger the image acquisition operation.

[0176] Optionally, before notifying the FP_HAL module that the display screen has completed highlight display, the LCD driver may also determine (check) whether the display screen is powered on and highlighted, and only after determining that the display screen has completed power-on and highlighted display, notify the FP_HAL module that the display screen has completed highlight display.

[0177] After the FP_HAL module receives the notification sent by the LCD driver, (10) the FP_HAL module of the hardware abstraction layer can trigger the execution of the image acquisition operation, that is, send an image acquisition instruction to the LCD driver of the kernel layer, and the image acquisition instruction is used to trigger the acquisition of the fingerprint image input by the user.

[0178] After the LCD driver receives the image acquisition instruction, (11) the LCD driver of the kernel layer can send the image acquisition instruction to the display screen. Optionally, the LCD driver can also execute a function related to the image acquisition instruction and carry the parameters obtained by the execution result in the image acquisition instruction and send it to the display screen. Figure 7 Take the LCD driver directly sending the image acquisition command to the display screen as an example for drawing. After the display screen receives the image acquisition command, (12) the display screen can collect the fingerprint image corresponding to the touch operation input by the user. After the collection is completed, (13) the display screen can notify the LCD driver that the image acquisition has been completed. After the LCD driver receives the notification sent by the display screen, (14) the LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the image acquisition.

[0179] After the FP_HAL module receives the notification sent by the LCD driver, (15) the FP_HAL module of the hardware abstraction layer can send a stop (disable) image acquisition instruction to the LCD driver (disable the image acquisition instruction). The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display to stop collecting fingerprint images, and can also be used to trigger the display to stop highlighting fingerprints.

[0180] Furthermore, after the LCD driver receives the stop acquisition instruction, (16) the LCD driver of the core layer can send the stop acquisition instruction to the display screen, and after the display screen receives the stop acquisition instruction, (17) the display screen can stop acquiring fingerprint images. Furthermore, (18) the display screen can notify the LCD driver that the acquisition has stopped.

[0181] In some embodiments, the LCD driver may also execute related functions based on the stop image acquisition instruction issued by the FP_HAL module, and send the obtained related parameters to the display screen. Figure 7 Take the LCD driver directly sending the stop image acquisition command to the display screen as an example for drawing.

[0182] Furthermore, the LCD driver can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to complete fingerprint unlocking in the bright screen state.

[0183] Please also read Figure 8 , Figure 8 Schematic diagram of the optimized unlocking solution of the bright screen fingerprint provided in the embodiment of the present application. Figure 8As shown, the electronic device is in a bright screen state before receiving the fingerprint unlocking operation, that is, the display screen has completed power-on and initialization parameter configuration. At this time, the electronic device is in a locked state. In the scheme before the electronic device is optimized, when the touch device of the electronic device detects a touch operation, it can report the fingerprint unlocking event and trigger the upper layer to send fingerprint highlighting instructions, such as 29 instructions and LHBM instructions ( Figure 8 Take fingerprint highlight instruction 29 as an example for drawing). Then, the LCD driver can trigger the highlight display of the fingerprint unlocking area, and the duration of the highlight display is, for example, Figure 8 After the fingerprint highlighting command is reported to the display screen, the image acquisition operation is triggered.

[0184] In the optimized solution of the electronic device, when the touch device of the electronic device detects a touch operation, the LCDdriver can receive the fingerprint highlight instruction sent from the FP_HAL module, such as the 29 instruction and the LHBM instruction. Compared with the need to report the fingerprint unlocking event corresponding to the fingerprint unlocking operation and then issue the fingerprint highlight instruction from the upper layer, the link involved in the issuance process of the fingerprint highlight instruction in the optimized solution is shorter, only from the kernel layer to the hardware abstraction layer, and there is no need to issue the fingerprint highlight instruction after reporting the fingerprint unlocking event, thereby saving the time spent before issuing the fingerprint highlight instruction, such as Figure 8 As shown in the optimized fingerprint unlocking time.

[0185] In the embodiment of the present application, after the electronic device receives a touch operation in the screen-on state, since the display screen of the electronic device does not need to be powered on and the parameter configuration is initialized in the screen-on state, the FP_HAL module of the hardware abstraction layer can directly send a fingerprint highlight instruction, which can shorten the time-consuming part, that is, shorten the part from the TP driver reporting to the final issuance of the fingerprint highlight instruction, so that the fingerprint unlocking time is shorter and the fingerprint unlocking efficiency is higher, achieving performance optimization of fingerprint unlocking with the screen on.

[0186] The structure of the electronic device 100 is described below. Fig. 9 , Fig. 9 It is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application.

[0187] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0188] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0189] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0190] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0191] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0192] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0193] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0194] In the embodiment of the present application, the display screen 194 can be powered on when triggered by the display driver, and highlight the fingerprint unlocking area. Optionally, the display screen 194 can also display a user interface when triggered by the display driver, and the user interface can include controls such as fingerprint spots, water ripples, etc. The display screen 194 of the electronic device 100 can be the above Figure 1 and Figure 2 The display screen 11 of the electronic device 100 shown may also be Figure 3 and Figure 6 Display screen 362 in hardware layer 36 of the software system is shown.

[0195] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0196] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0197] In an embodiment of the present application, the fingerprint sensor 180H can be configured under the fingerprint unlocking area of ​​the display screen 194, and is used to perform a capture (fingerprint photography) operation after detecting a touch operation to capture the user's fingerprint image.

[0198] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0199] In the embodiment of the present application, after the touch sensor 180K detects a touch operation acting near its upper edge, it can generate a hardware interrupt corresponding to the touch operation and send the hardware interrupt to the TP driver so that the TP driver triggers the next control strategy.

[0200] Implementing the fingerprint unlocking method provided in the embodiment of the present application can help reduce the time consumption of fingerprint unlocking, improve the efficiency of fingerprint unlocking with the screen off of the electronic device, and achieve performance optimization of fingerprint unlocking with the screen off by optimizing the link of issuing the fingerprint highlighting command when the electronic device is in the screen off state, and can send the trigger to power on the display screen while the reporting process is executed. In addition, by optimizing the link of issuing the fingerprint highlighting command when the electronic device is in the screen off state, the link involved in fingerprint unlocking is shorter and the time consumption is shorter, thereby improving the efficiency of fingerprint unlocking with the screen on of the electronic device, and achieving performance optimization of fingerprint unlocking with the screen on.

[0201] In the embodiments of the present application:

[0202] 1. The fingerprint unlocking operation / touch operation received by the electronic device in the screen-off state can be called the first fingerprint unlocking operation, and the fingerprint unlocking operation / touch operation received by the electronic device in the screen-on state can be called the second fingerprint unlocking operation. For example, the fingerprint unlocking operation received by the touch device of the electronic device, and also the touch operation received by the display screen of the electronic device.

[0203] 2. When the electronic device is in the off-screen state, after the TP driver receives the hardware interrupt sent by the touch device, the corresponding event (fingerprint unlock event / fingerprint area event) generated can be called the first event. The first fingerprint unlock operation corresponds to the first event. When the electronic device is in the on-screen state, after the TP driver receives the hardware interrupt sent by the touch device, the corresponding event (fingerprint unlock event / fingerprint area event) generated can be called the second event. The second fingerprint unlock operation corresponds to the second event.

[0204] 3. When the electronic device is in the screen-off state, the power-on instruction sent by the TP driver in the electronic device to the LCD driver through the FP driver, the FP_HAL module and the HWC module can be called the first power-on instruction, for example, instruction 11.

[0205] When the electronic device is in the screen-off state, the AOD application to which the TP driver in the electronic device reports the fingerprint unlocking event (first event) may be referred to as a target display application.

[0206] The power-on instruction sent by the AOD application (target display application) may be referred to as a second power-on instruction. The parameters for display screen initialization carried in the second power-on instruction may be referred to as display parameters.

[0207] Among them, the display parameters generated by the PMS module in response to the power-on instruction (the second power-on instruction) can be called power display parameters, for example, they can include backlight brightness parameters of the display screen, etc. The display parameters generated by the SF module in response to the power-on instruction (the second power-on instruction) can be called image display parameters, for example, they can include display data related to the content to be displayed on the display screen, etc. The display parameters generated by the HWC module in response to the power-on instruction (the second power-on instruction) can be called hardware display parameters, for example, they can include parameters of the image to be displayed, etc.

[0208] 4. The fingerprint highlighting instruction received when the electronic device is in the off-screen state can be called the first fingerprint highlighting instruction, and the fingerprint highlighting instruction received when the electronic device is in the on-screen state can be called the second fingerprint highlighting instruction. For example, the first fingerprint highlighting instruction and the second fingerprint highlighting instruction include 29 and LHBM instructions.

[0209] 5. The fingerprint image obtained when the electronic device is in the screen-off state can be called the first fingerprint image, and the first fingerprint image corresponds to the first fingerprint unlocking operation. The fingerprint image obtained when the electronic device is in the screen-on state can be called the second fingerprint image, and the second fingerprint image corresponds to the second fingerprint unlocking operation.

[0210] 6. When the electronic device is in the screen-off state, the hardware interrupt sent by the touch device to the touch device based on the first fingerprint unlocking operation can be called the first hardware interrupt, and the first hardware interrupt corresponds to the first fingerprint unlocking operation. When the electronic device is in the screen-on state, the hardware interrupt sent by the touch device to the touch device based on the second fingerprint unlocking operation can be called the second hardware interrupt, and the second hardware interrupt corresponds to the second fingerprint unlocking operation.

[0211] 7. The process of an electronic device performing an identity authentication operation based on a fingerprint image can be called fingerprint unlocking of the electronic device. When the electronic device is in the screen-off state, if the first fingerprint image does not match the preset fingerprint image, the electronic device remains (maintains) the locked state, and then can enter the screen-on state and display the lock screen interface.

[0212] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0213] The embodiments of the present application also provide a computer program product. When the computer program product is executed on an electronic device, the electronic device can implement the steps in the above-mentioned various method embodiments.

[0214] The embodiment of the present application also provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the steps of any method embodiment of the present application. The chip system can be a single chip or a chip module composed of multiple chips.

[0215] The term "user interface (UI)" in the specification, claims and drawings of this application refers to the medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface of an application is source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on the terminal device, and finally presented as content that the user can recognize, such as pictures, text, buttons and other controls. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, pictures and text. The properties and contents of controls in the interface are defined by tags or nodes, such as XML through <textview> 、 <imgview> 、 <videoview>The controls contained in the interface are specified by nodes such as . A node corresponds to a control or attribute in the interface. After parsing and rendering, the node is presented as user-visible content. In addition, many applications, such as hybrid applications, usually also contain web pages in their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. A web page is source code written in a specific computer language, such as hypertext markup language (HTML), cascading style sheets (CSS), JavaScript (JS), etc. The web page source code can be loaded and displayed as user-recognizable content by a browser or a web page display component with similar functions to a browser. The specific content contained in a web page is also defined by tags or nodes in the web page source code. For example, HTML is defined by 、 、 <video> 、 <canvas>To define the elements and attributes of a web page.

[0216] The most common form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be an icon, window, control or other interface element displayed on the display screen of an electronic device, where a control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets and other visual interface elements.

[0217] As used in the specification and appended claims of the present application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include plural expressions, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items. As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "when determining..." or "if (stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "when (stated condition or event) is detected" or "in response to detecting (stated condition or event)", depending on the context.

[0218] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0219] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0220] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A fingerprint unlocking method, characterized in that: Applied to an electronic device, the electronic device includes a display screen, and the method includes: The electronic device is in a screen-off state; In response to the touch driver of the electronic device detecting a first event, the touch driver of the electronic device sends a first power-on instruction corresponding to the first event to the display screen through the fingerprint driver of the electronic device, the fingerprint hardware abstraction module of the electronic device and the hardware synthesizer module of the electronic device, and simultaneously sends the first event to a target display application of the electronic device; the first event is generated based on the detected first fingerprint unlocking operation; In response to the target display application of the electronic device receiving the first event, sending a second power-on instruction to the display driver of the electronic device, wherein the second power-on instruction carries display parameters, and the display parameters are generated by the power management service module of the electronic device, the system image engine module of the electronic device, and the hardware synthesizer module of the electronic device; The display driver of the electronic device sends the display parameters carried by the second power-on instruction to the display screen; the display parameters are used to initialize the display screen; In response to indication information indicating that the display screen has been powered on and initialized, the fingerprint hardware abstraction module of the electronic device sends a first fingerprint highlight instruction corresponding to the first event to the display driver of the electronic device, wherein the indication information is generated by the display driver of the electronic device and sent to the fingerprint hardware abstraction module of the electronic device; In response to the display driver of the electronic device detecting the first fingerprint highlight instruction corresponding to the first event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area; In response to acquiring a first fingerprint image, the electronic device performs fingerprint unlocking, the first fingerprint image corresponds to the first fingerprint unlocking operation, and the first fingerprint image is acquired based on the highlighted fingerprint unlocking area.

2. The method according to claim 1, characterized in that In response to the touch driver of the electronic device detecting a first event, the touch driver of the electronic device sends a first power-on instruction corresponding to the first event to the display screen through the fingerprint driver of the electronic device, the fingerprint hardware abstraction module of the electronic device, and the hardware synthesizer module of the electronic device, including: In response to the touch driver of the electronic device detecting the first event, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; The display driver of the electronic device sends the first power-on instruction to the display screen.

3. The method according to claim 2, characterized in that The method further comprises: In response to the touch device of the electronic device detecting the first fingerprint unlocking operation, the touch device of the electronic device sends a first hardware interrupt corresponding to the first fingerprint unlocking operation to a touch driver of the electronic device; The touch driver of the electronic device generates the first event in response to receiving the first hardware interrupt.

4. The method according to claim 2 or 3, characterized in that: The sending the first event to a target display application of the electronic device includes: The touch driver of the electronic device sends the first event to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first event to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the first event to a target display application of the electronic device.

5. The method according to claim 1, characterized in that In response to receiving the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, including: In response to receiving the first event, the target display application of the electronic device generates the second power-on instruction and sends the second power-on instruction to the power management service module of the electronic device; The power management service module of the electronic device generates a power display parameter in response to the second power-on instruction, and sends the second power-on instruction carrying the power display parameter to the system image engine module of the electronic device; The system image engine module of the electronic device generates an image display parameter in response to the second power-on instruction, and sends the second power-on instruction carrying the power display parameter and the image display parameter to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device generates hardware display parameters in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameters, the image display parameters and the hardware display parameters to the display driver of the electronic device, wherein the display parameters include the power display parameters, the image display parameters and the hardware display parameters.

6. The method according to claim 5, characterized in that After the display driver of the electronic device sends the display parameter carried by the second power-on instruction to the display screen, the method further includes: The display driver of the electronic device returns the second power-on instruction to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device returns the second power-on instruction to the system image engine module of the electronic device.

7. The method according to claim 1, characterized in that In response to the display driver of the electronic device detecting the first fingerprint highlight instruction corresponding to the first event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, including: In response to receiving the first fingerprint highlight instruction, the display driver of the electronic device sends the first fingerprint highlight instruction to the display screen; The display screen highlights the fingerprint unlocking area in response to the first fingerprint highlighting instruction.

8. The method according to claim 1, characterized in that In response to acquiring the first fingerprint image, the electronic device performs fingerprint unlocking, including: Matching the first fingerprint image with a fingerprint image preset by the electronic device; When the first fingerprint image matches a fingerprint image preset by the electronic device, the electronic device is unlocked.

9. The method according to claim 1, characterized in that: In response to acquiring the fingerprint image, the electronic device performs fingerprint unlocking, including: Matching the first fingerprint image with a fingerprint image preset by the electronic device; When the first fingerprint image does not match the fingerprint image preset by the electronic device, the electronic device maintains the locked state and switches from the screen-off state to the screen-on state.

10. The method according to claim 9, characterized in that After the electronic device maintains the locked state, the method further includes: In response to the display driver of the electronic device detecting a second fingerprint highlight instruction corresponding to a second event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, wherein the second event is generated based on the detected second fingerprint unlocking operation; In response to acquiring a second fingerprint image, the electronic device performs fingerprint unlocking, the second fingerprint image corresponds to a second fingerprint unlocking operation, and the second fingerprint image is acquired based on the highlighted fingerprint unlocking area.

11. The method according to claim 10, characterized in that In response to the display driver of the electronic device detecting the second fingerprint highlight instruction corresponding to the second event, before the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, the method further includes: In response to the touch device of the electronic device detecting the second fingerprint unlocking operation, the touch device of the electronic device sends a second hardware interrupt corresponding to the second fingerprint unlocking operation to the touch driver of the electronic device; In response to receiving the second hardware interrupt, the touch driver of the electronic device generates the second event and sends the second event to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the second event to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the second fingerprint highlight instruction to the display driver of the electronic device in response to receiving the second event; In response to the display driver of the electronic device detecting a second fingerprint highlight instruction corresponding to a second event, the display driver of the electronic device controls the display screen to highlight the fingerprint unlocking area, including: The display driver of the electronic device sends the second fingerprint highlight instruction to the display screen in response to receiving the second fingerprint highlight instruction; The display screen highlights the fingerprint unlocking area in response to the second fingerprint highlighting instruction.

12. A computer device, characterized in that: The computer device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the method according to any one of claims 1 to 11 when executed by the processor.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 11.

Images