Fingerprint unlocking method and related device

Abstract

The embodiment of the invention provides a fingerprint unlocking method and a related device. When the electronic equipment is in a screen-off state, the detected first fingerprint unlocking operation can be responded, a touch driver of the electronic equipment can send a first power-on instruction to a display screen through a power-on processing module, and meanwhile, a first event corresponding to the first fingerprint unlocking operation is sent to a target display application program of the electronic equipment; furthermore, the display screen can obtain a first fingerprint highlight instruction corresponding to the first event; in response to the first fingerprint highlight instruction, the display screen can display a fingerprint unlocking area in a highlight manner; and in response to the acquired fingerprint image corresponding to the first fingerprint unlocking operation, performing fingerprint unlocking by the electronic equipment. In this way, the electronic equipment triggers the display screen to be powered on in advance, in the process of powering on the display screen, the software upper layer can conduct logic processing and issue the control strategy, the logic processing and the control strategy are conducted at the same time, time consumed by fingerprint unlocking is shortened, and the efficiency of fingerprint unlocking of the electronic equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a fingerprint unlocking method and related devices. Background Art

[0002] With the development of electronic devices, electronic devices such as mobile phones and tablets can provide more and more functions for people, becoming an indispensable part of people. Among them, the fingerprint unlocking function is one of the functions provided by electronic devices. The fingerprint unlocking function means that the electronic device can obtain the user's fingerprint image and perform identity authentication to unlock the electronic device so that the user can use the functions provided by the electronic device.

[0003] At present, when an electronic device is in a locked state, it can detect a user's touch operation input in a specific area of ​​the display screen, and then the electronic device can trigger the collection of the user's fingerprint image. However, the process from the electronic device detecting the touch operation to the electronic device triggering the collection of the fingerprint image takes a long time, the fingerprint unlocking speed is slow, and the fingerprint unlocking efficiency is low.

[0004] Therefore, how to reduce the time consumption of fingerprint unlocking to improve the efficiency of fingerprint unlocking has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The present application provides a fingerprint unlocking method and related devices, by which the electronic device triggers the power-on of the display screen in advance before reporting the event to the upper layer of the software and issuing the power-on instruction, so that the process of reporting the event and issuing the instruction is carried out simultaneously with the power-on of the display screen, which is beneficial to reducing the time consumption of fingerprint unlocking and improving the efficiency of fingerprint unlocking of the electronic device.

[0006] In the first aspect, the present application provides a fingerprint unlocking method, which can be executed by an electronic device, or by a module in the electronic device, such as a chip or a processor. The electronic device includes a display screen, and the method may include: the electronic device is in a screen-off state; in response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, and simultaneously sends a first event corresponding to the first fingerprint unlocking operation to a target display application of the electronic device; the power-on processing module includes a fingerprint hardware abstraction module of the electronic device, a power management service module of the electronic device, a system image engine module of the electronic device, a hardware synthesizer module of the electronic device, a display screen hardware abstraction module of the electronic device, and a fingerprint driver of the electronic device; the display screen obtains a first fingerprint highlight instruction corresponding to the first event; in response to the first fingerprint highlight instruction, the display screen highlights the fingerprint unlocking area; in response to obtaining a fingerprint image corresponding to the first fingerprint unlocking operation, the electronic device performs fingerprint unlocking.

[0007] Through the fingerprint unlocking method provided by the present application, it is realized that when the electronic device is in the off-screen state, the fingerprint unlocking operation input by the user can be quickly fingerprint unlocked. Since it takes a long time for the display screen to be powered on, and it also takes a long time for the event to be reported and the upper layer of the software to perform logical processing and issue a control strategy, therefore, the touch driver of the electronic device reports the event corresponding to the fingerprint unlocking operation while sending a power-on instruction to the display screen, and the display screen can be powered on in advance, so that the display screen is powered on and the event is reported, and the upper layer of the software performs logical processing based on the reported event and issues a corresponding control strategy at the same time, without waiting for the power-on instruction issued by the upper layer of the software to trigger the display screen to be powered on, which can save the time consumed in powering on the display screen, is conducive to improving the efficiency of fingerprint unlocking of electronic devices, and realizing the performance optimization of fingerprint unlocking with the screen off.

[0008] In combination with the first aspect, in one embodiment, the power-on processing module includes a fingerprint driver of the electronic device and a fingerprint hardware abstract module of the electronic device; in response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through the power-on processing module, including: in response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstract module of the electronic device; the fingerprint hardware abstract module of the electronic device sends the first power-on instruction to the display driver of the electronic device; the display driver of the electronic device sends the first power-on instruction to the display screen. In an embodiment of the present application, the touch driver of the electronic device directly sends a power-on instruction to the display driver through the fingerprint driver and the fingerprint hardware abstract module, and transmits the power-on instruction between adjacent layers. Compared with the upper layer of the software responding to the event corresponding to the fingerprint unlocking operation, the power-on instruction is sent to the display driver, and the link is shorter and the time consumption is shorter, which is conducive to shortening the time consumption of fingerprint unlocking.

[0009] In combination with the first aspect, in one embodiment, the power-on processing module includes a fingerprint driver of the electronic device, a fingerprint hardware abstraction module of the electronic device, a power management service module of the electronic device, a system image engine module of the electronic device and a hardware synthesizer module of the electronic device; in response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through the power-on processing module, including: in response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstraction module of the electronic device; the fingerprint hardware abstraction module of the electronic device sends the first power-on instruction to the power management service module of the electronic device; the power management service module of the electronic device sends the first power-on instruction to the system image engine module of the electronic device; the system image engine module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; the display driver of the electronic device sends the first power-on instruction to the display screen. In the embodiment of the present application, the touch driver of the electronic device sends a power-on instruction to the display driver through the fingerprint driver, the fingerprint hardware abstraction module, the power management service module, the system image engine module and the hardware synthesizer module. The link is relatively complete, which can ensure that the power-on instruction can be sent to the display screen. Compared with the application layer's off-screen display application responds to the event corresponding to the fingerprint unlocking operation before sending the power-on instruction to the display driver. The link is shorter, which is also conducive to shortening the time consumed by fingerprint unlocking.

[0010] In combination with the first aspect, in one embodiment, the power-on processing module includes a fingerprint driver of the electronic device, a fingerprint hardware abstraction module of the electronic device, a display screen hardware abstraction module of the electronic device and a hardware synthesizer module of the electronic device; in response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through the power-on processing module, including: in response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstraction module of the electronic device; the fingerprint hardware abstraction module of the electronic device sends the first power-on instruction to the display screen hardware abstraction module of the electronic device; the display screen hardware abstraction module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; the display driver of the electronic device sends the first power-on instruction to the display screen. In an embodiment of the present application, the touch driver sends a power-on instruction to the display driver through the fingerprint driver, the fingerprint hardware abstraction module, the display hardware abstraction module and the hardware synthesizer module. The link includes the display hardware abstraction module and the hardware synthesizer. The link is relatively complete, which can ensure that the power-on instruction can be sent to the display screen, and the power-on instruction is also transmitted between adjacent layers. The link is short, which is also conducive to shortening the time of fingerprint unlocking.

[0011] In combination with the first aspect, in one embodiment, the power-on processing module includes a fingerprint driver of the electronic device, a fingerprint hardware abstraction module of the electronic device, a display screen hardware abstraction module of the electronic device and a hardware synthesizer module of the electronic device; in response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through the power-on processing module, including: in response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first power-on instruction to the display driver of the electronic device; the display driver of the electronic device sends the first power-on instruction to the display screen hardware abstraction module of the electronic device; the display screen hardware abstraction module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; the display driver of the electronic device sends the first power-on instruction to the display screen. In an embodiment of the present application, the touch driver sends a power-on instruction to the display driver through the fingerprint driver, display driver, display hardware abstraction module and hardware synthesizer module. The link includes the display hardware abstraction module and the hardware synthesizer. The link is relatively complete, which can ensure that the power-on instruction can be sent to the display screen, and the power-on instruction is also transmitted between adjacent layers. The link is short, which is also conducive to shortening the time of fingerprint unlocking.

[0012] In combination with the first aspect, in some embodiments, in response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first event corresponding to the first fingerprint unlocking operation to a target display application of the electronic device, including: in response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device generates the first event and sends the first event to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the first event to the fingerprint hardware abstraction module of the electronic device; the fingerprint hardware abstraction module of the electronic device sends the first event to the target display application of the electronic device. In an embodiment of the present application, the fingerprint unlocking event can be reported to the upper layer of the software through each functional module of the electronic device, so that the upper layer of the software sends a control strategy (power-on instruction).

[0013] In combination with the first aspect, in some embodiments, the method further includes: in response to the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, the second power-on instruction carries display parameters, and the display parameters are generated by the power management service module of the electronic device, the system image engine module of the electronic device, and the hardware synthesizer module of the electronic device; the display driver of the electronic device sends the display parameters carried by the second power-on instruction to the display screen; and the display screen is initialized based on the display parameters. In the embodiment of the present application, the upper layer of software (screen-off display application) can send the second power-on instruction through each functional module of the electronic device, and the power-on instruction sent through the complete link can include parameters for initializing the display screen.

[0014] In combination with the first aspect, in some embodiments, in response to the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, including: in response to the first event, the screen-off display application of the electronic device generates the second power-on instruction, and sends the second power-on instruction to the power management service module of the electronic device; the power management service module of the electronic device generates power display parameters in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameters to the system image engine module of the electronic device; the system image engine module of the electronic device generates image display parameters in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameters and the image display parameters to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device generates hardware display parameters in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameters, the image display parameters and the hardware display parameters to the display driver of the electronic device, and the display parameters include the power display parameters, the image display parameters and the hardware display parameters. In an embodiment of the present application, the software upper layer can send a power-on instruction carrying the display parameters required for display screen initialization through various functional modules of the electronic device. In the case where the display screen is powered on in advance, the display screen initialization can be triggered after the power-on instruction is sent by the upper layer, which is beneficial to reducing the time consumption of fingerprint unlocking of the electronic device.

[0015] In combination with the first aspect, in some embodiments, after the display driver of the electronic device sends the display parameters carried by the second power-on instruction to the display screen, the method further includes: the electronic device display driver returns the second power-on instruction to the hardware synthesizer module of the electronic device; the hardware synthesizer module of the electronic device returns the second power-on instruction to the system image engine module of the electronic device. Since the power-on instruction (first power-on instruction) has been sent to the display screen in advance, the second power-on instruction can be returned through the functional modules of the electronic device, and the power-on thread is no longer repeatedly executed.

[0016] In combination with the first aspect, in some embodiments, the display screen obtains the first fingerprint highlight instruction corresponding to the first event, including: in response to the indication information from the display driver of the electronic device indicating that the display screen has been powered on and initialized, the fingerprint hardware abstraction module of the electronic device sends the first fingerprint highlight instruction to the display driver of the electronic device; the display driver of the electronic device sends the first fingerprint highlight instruction to the display screen; the display screen obtains the first fingerprint highlight instruction from the display driver of the electronic device. In an embodiment of the present application, the display driver of the electronic device can receive the fingerprint highlight instruction directly issued by the fingerprint hardware abstraction module, which is conducive to saving the time of issuing the fingerprint highlight instruction, thereby facilitating shortening the time of fingerprint unlocking with the screen off.

[0017] In combination with the first aspect, in some embodiments, in response to obtaining the fingerprint image corresponding to the first fingerprint unlocking operation, the electronic device performs fingerprint unlocking, including: matching the fingerprint image corresponding to the first fingerprint unlocking operation with the fingerprint image preset by the electronic device to obtain a matching result; when the matching result indicates that the fingerprint image corresponding to the first fingerprint unlocking operation does not match the fingerprint image preset by the electronic device, the electronic device remains locked and switches from the screen-off state to the screen-on state. In an embodiment of the present application, the display screen of the electronic device can obtain the user's fingerprint image and match it after the fingerprint unlocking area is highlighted, thereby completing the identity authentication. After the identity authentication fails, the electronic device can light up the display screen and display the lock screen interface to facilitate further operation by the user, or to output prompt information to the user.

[0018] In combination with the first aspect, in some embodiments, after the electronic device remains in a locked state, the method further includes: in response to detecting a second fingerprint unlocking operation, the display screen acquires a second fingerprint highlighting instruction corresponding to the second fingerprint unlocking operation; in response to the second fingerprint highlighting instruction, the display screen highlights the fingerprint unlocking area; in response to acquiring the fingerprint image corresponding to the second fingerprint unlocking operation, the electronic device performs fingerprint unlocking. In the embodiment of the present application, the electronic device performs fingerprint unlocking in the bright screen state, and the user's fingerprint image can be acquired by simply highlighting the fingerprint unlocking area.

[0019] In combination with the first aspect, in some embodiments, in response to detecting a second fingerprint unlocking operation, the display screen obtains a second fingerprint highlight instruction corresponding to the second fingerprint unlocking operation, including: in response to detecting the second fingerprint unlocking operation, the touch driver of the electronic device generates a second event corresponding to the second fingerprint unlocking operation, and sends the second event to the fingerprint driver of the electronic device; the fingerprint driver of the electronic device sends the second event to the fingerprint hardware abstraction module of the electronic device; the fingerprint hardware abstraction module of the electronic device responds to the second event and sends the second fingerprint highlight instruction to the display driver of the electronic device; the display driver of the electronic device sends the second fingerprint highlight instruction to the display screen; the display screen obtains the second fingerprint highlight instruction from the display driver of the electronic device. In an embodiment of the present application, the display driver of the electronic device can receive the fingerprint highlight instruction directly issued by the fingerprint hardware abstraction module, which is conducive to saving the time consumption of issuing fingerprint highlight instructions and reducing the time consumption of fingerprint unlocking with the screen turned off.

[0020] In a second aspect, the present application provides an electronic device, comprising: a camera, one or more processors, and one or more memories. The camera, the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the fingerprint unlocking method in any possible implementation of any of the above aspects is executed.

[0021] In a third aspect, the present application provides an electronic device, comprising one or more functional modules, which are used to execute a fingerprint unlocking method in any possible implementation of the first aspect.

[0022] In a fourth aspect, the present application provides a chip system, including a chip system applied to an electronic device, the chip system including one or more processors, the processors being used to call computer instructions to execute a fingerprint unlocking method as in any possible implementation of the first aspect above.

[0023] In a fifth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables execution of a fingerprint unlocking method as in any possible implementation of the first aspect described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a schematic diagram of an application scenario of a fingerprint unlocking method provided in an embodiment of the present application;

[0025] Figure 2 This is another application scenario diagram of a fingerprint unlocking method provided by an embodiment of the present application;

[0026] Figure 3 is a software interaction diagram of an electronic device provided in an embodiment of the present application;

[0027] Figure 4 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application;

[0028] Figure 5 is a software interaction diagram of another electronic device provided in an embodiment of the present application;

[0029] Figure 6 This is a timing diagram of another electronic device screen-off fingerprint unlocking provided by an embodiment of the present application;

[0030] Figure 7 is a software interaction diagram of another electronic device provided in an embodiment of the present application;

[0031] Figure 8This is a timing diagram of another electronic device screen-off fingerprint unlocking provided in an embodiment of the present application;

[0032] Fig. 9 is a software interaction diagram of another electronic device provided in an embodiment of the present application;

[0033] Fig.10 This is a timing diagram of fingerprint unlocking of another electronic device with screen turned off provided in an embodiment of the present application;

[0034] Fig.11 This is an optimized schematic diagram of the off-screen fingerprint unlocking solution provided in an embodiment of the present application;

[0035] Fig.12 is a software interaction diagram of another electronic device provided in an embodiment of the present application;

[0036] Fig.13 This is a timing diagram of fingerprint unlocking of an electronic device with a bright screen provided by an embodiment of the present application;

[0037] Fig.14 This is an optimized schematic diagram of the bright screen fingerprint unlocking solution provided in an embodiment of the present application;

[0038] Fig.15 It is a flowchart of a fingerprint unlocking method provided in an embodiment of the present application;

[0039] Fig.16 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0041] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0042] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0043] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0044] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program and / or a computer. By way of illustration, both applications running on a computing device and a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0045] Before further describing the embodiments of the present application in detail, an application scenario of the embodiments of the present application is introduced as an example, wherein a user inputs a touch operation to a fingerprint unlocking area of ​​a display screen of an electronic device.

[0046] Please also read Figure 1-Figure 2 , Figure 1-Figure 2 These are schematic diagrams of application scenarios of a fingerprint unlocking method provided in embodiments of the present application. Figure 1 For the off-screen fingerprint unlocking scenario, Figure 2 This is the fingerprint unlocking scenario with the screen on.

[0047] like Figure 1 As shown in (1), there is a fingerprint unlocking area 12 on the display screen 11 of the electronic device 100, which can be an area for receiving a user input touch operation. Before the electronic device 100 detects a touch operation acting on the fingerprint unlocking area 12, the electronic device is in a locked state, and the display screen 11 of the electronic device is not lit (such as Figure 1 In (1), the display screen 11 of the electronic device 100 is completely black), that is, the electronic device is in the off state. When a touch operation is detected, the display screen 11 of the electronic device 100 can light up the fingerprint unlocking area 12, and then the electronic device 100 can collect the user's fingerprint image based on the lighted fingerprint unlocking area 12 and perform identity authentication.

[0048] like Figure 1 As shown in (2), when the electronic device 100 detects a touch operation on the fingerprint unlocking area 12 of the touch display screen 11, the electronic device 100 responds to the touch operation by triggering the display screen 11 to highlight the fingerprint unlocking area 12, that is, triggering the display screen 11 to light up the fingerprint unlocking area 12 (such as Figure 1 (2) The background color of the fingerprint unlocking area 12 is white). For example, if the display screen of the electronic device is an OLED display screen, the electronic device 100 can trigger the OLED organic light emitting diode in the fingerprint unlocking area 12 of the display screen 11 to emit light, thereby illuminating the fingerprint to realize the collection of the fingerprint image.

[0049] In some embodiments, when the fingerprint unlocking area 12 of the display screen 11 is highlighted, a fingerprint unlocking control, such as a fingerprint spot 13, may also be included in the user interface where the fingerprint unlocking area 12 is highlighted. The fingerprint spot 13 is a control of a fingerprint pattern. The fingerprint spot 13 may be displayed in the fingerprint unlocking area 12, that is, the display position of the fingerprint spot 13 coincides with the fingerprint unlocking area 12 (the highlighted area). For another example, the fingerprint unlocking control may also include a water ripple 14, which is a control similar to a water ripple animation. The display position of the water ripple 14 may be around the fingerprint unlocking area 12, surrounding the fingerprint unlocking area 12. It should be noted that Figure 1 The fingerprint spot 13 and the water ripple 14 are taken as examples for drawing and description. The user interface may also include other fingerprint unlocking controls, which are not limited in this application.

[0050] like Figure 2As shown in (1), there is a fingerprint unlocking area 12 on the display screen 11 of the electronic device 100, that is, the area where the user inputs the touch operation. Before the touch operation acting on the fingerprint unlocking area 12 is detected, the electronic device is in a locked state. At this time, the display screen 11 of the electronic device 100 can display a lock screen interface, which can include, for example, displaying the time, incoming calls, messages, battery information, push messages, wallpapers, etc. The electronic device is currently in a bright screen state, and the bright screen state can refer to lighting up the entire display screen 11 to display content, such as Figure 2 The lock screen interface shown in (1).

[0051] Optionally, the lock screen interface may also include prompt information for prompting that the current electronic device 100 is in a locked state, such as "Please unlock", etc. For another example, the lock screen interface may also include prompt information for prompting a method for unlocking the electronic device 100, such as "Enter fingerprint to unlock", etc. For another example, the lock screen interface may also include a fingerprint unlock control, which may be used to prompt the user to enter a touch operation position, and the fingerprint unlock control may be displayed in the fingerprint unlock area 12. Figure 2 In (1), the lock screen interface including time, battery information, wallpaper, and fingerprint unlocking control (fingerprint spot) is drawn as an example.

[0052] like Figure 2 As shown in (2), when the electronic device 100 detects a touch operation performed by a user on the fingerprint unlocking area 12, the electronic device 100 responds to the touch operation and the display screen 11 can highlight the fingerprint unlocking area 12, that is, highlight the area touched by the user.

[0053] In some embodiments, when the fingerprint unlocking area 12 of the display screen 11 is highlighted, a fingerprint unlocking control may be displayed in the user interface (lock screen interface), for example, the fingerprint unlocking control may include a fingerprint spot 13, and the fingerprint spot 13 may overlap with the fingerprint unlocking area 12 (the highlighted area). For another example, the fingerprint unlocking control may include a water ripple 14, and the display position of the water ripple 14 may be around the fingerprint unlocking area 12, surrounding the fingerprint unlocking area 12. In the user interface including the highlighted fingerprint unlocking area 12, in addition to including one or more fingerprint unlocking controls, other controls may also be included for displaying other content.

[0054] It should be noted that the above-mentioned method of highlighting the fingerprint unlocking area 12 is an example of an electronic device using an optical fingerprint unlocking method. The optical fingerprint unlocking method refers to the method of collecting fingerprint images and performing identity authentication (comparing with the recorded fingerprint image) by using the principle of light reflection imaging. In the process of collecting fingerprint images, after detecting the touch operation input by the user's finger touching the display screen, the electronic device can trigger the local area of ​​the display screen to emit light, that is, highlight the area touched by the user's finger. The light emitted by the display screen is blocked by the finger, thereby forming a fingerprint image based on the reflected light, and the electronic device can perform identity authentication based on the fingerprint image. For example, the display screen of the electronic device is an organic light-emitting diode (OLED) display screen. After the electronic device detects the touch operation, the OLED organic light-emitting diode in the local area of ​​the display screen (the area touched by the user's finger) can illuminate the fingerprint, and then the reflected light illuminating the fingerprint can be reflected to the sensor under the display screen to form a fingerprint image. In the fingerprint image, there is a difference in brightness and darkness in the ups and downs (convexities and concavities) of the fingerprint.

[0055] The above two application scenarios are exemplary descriptions of the hard spot fingerprint unlocking method. The hard spot fingerprint unlocking is: a fingerprint image unlocking method, specifically refers to a method of partially highlighting the panel of the display screen through instructions to realize the collection of fingerprint images and thus unlock the electronic device. Among them, the instruction can be an instruction sent from the upper layer to the lower layer. The upper layer can be, for example, an application layer in the software system of the electronic device, and the lower layer can be a kernel layer and a hardware layer in the software system of the electronic device. When the electronic device is in the screen-off state, the instruction can include a power-on instruction and a fingerprint highlight instruction. When the electronic device is in the screen-on state, the instruction can only include a fingerprint highlight instruction. The power-on instruction refers to an instruction for the display screen of the electronic device to change from a standby dormant state to a stable working state. After the display screen is powered on, the initialization parameter configuration can be performed. The fingerprint highlight instruction refers to an instruction to highlight the display screen in a local area after power-on and initialization, so as to facilitate the electronic device to collect fingerprint images.

[0056] In the process of performing fingerprint unlocking by an electronic device, it is found that: when the electronic device is in a locked state, a touch operation input by a user on a specific area of ​​the display screen can be detected, and then the electronic device can trigger the operation of collecting and authenticating the user's fingerprint data. After the identity authentication is passed, the electronic device can unlock the locked state and provide the user with various functions. Among them, after the electronic device detects the touch operation, the user's fingerprint data can be collected by using a hard spot fingerprint unlocking method, that is, the electronic device can highlight a specific area of ​​the display screen through an instruction to collect the user's fingerprint image. Specifically, when the electronic device is in a screen-off state and a touch operation input by the user is detected, the display screen of the electronic device can be powered on first based on the instruction, and then the specific area (the area where the user inputs the touch operation) can be highlighted, thereby realizing the collection of the user's fingerprint data. When the electronic device is in a screen-on state and a touch operation input by the user is detected, the display screen of the electronic device can highlight the specific area (the area where the user inputs the touch operation) based on the instruction, thereby realizing the collection of the user's fingerprint information.

[0057] Take the scenario of an electronic device performing fingerprint unlocking in the off-screen state as an example. Usually, the electronic device is equipped with a touch device, which can trigger the upper layer (such as the application layer) to issue a power-on instruction after detecting the user's touch operation, and then the lower layer can receive the power-on instruction sent from the upper layer. In response to the power-on instruction, the display screen can be triggered to power on and initialize. After the display screen is powered on and initialized, it can receive a fingerprint highlight instruction issued by the upper layer. In response to the fingerprint highlight instruction, the display driver can trigger the display screen to highlight the fingerprint unlocking area, that is, highlight the area where the user inputs the touch operation, so that the electronic device collects the user's fingerprint data. In this process, on the one hand, the logic processing of the upper layer issuing the instruction takes a long time, and on the other hand, the initialization parameter configuration of the display screen after powering on also takes a long time, resulting in a long time from receiving the touch operation to collecting the fingerprint data, and the fingerprint unlocking efficiency is low, which brings inconvenience to the user and reduces the user's experience.

[0058] In the following embodiments of the present application, "display screen" may also be referred to as "screen" or "panel" or "panel" or "touch panel" and other terms. The meanings represented are all electrical appliances with touch and display functions, and the names used do not constitute any limitation to the present embodiment. Similarly, the "specific area" mentioned in the embodiments of the present application may also be referred to as "area for user input touch operation", "fingerprint unlocking area" and other names.

[0059] In the following embodiments of the present application, the touch device of the electronic device is configured on the display screen as an example for drawing and explanation. The touch device can also be configured on the surface of the electronic device, and the present application does not limit this. For example, it can be configured on the physical power button of the electronic device, etc., which can be determined according to the form of the electronic device and business needs. It can be understood that the fingerprint unlocking solution proposed in the embodiment of the present application can be applied to any electronic device that adopts the hard spot fingerprint unlocking method, and can be specifically applicable to electronic devices with different forms and functions, as well as adapting to different software versions (such as domestic versions and overseas versions) and platforms (such as Qualcomm platforms), and has certain universality and versatility.

[0060] Next, combine Figure 3-Figure 4 The specific process of implementing screen-off fingerprint unlocking in an electronic device provided in an embodiment of the present application is exemplified.

[0061] See also Figure 3 , Figure 3 1 is a schematic diagram of software interaction of an electronic device provided by an embodiment of the present application. Before introducing software interaction, the software architecture is described first.

[0062] like Figure 3 As shown, the software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to illustrate the software architecture of the electronic device. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces.

[0063] In some embodiments, the Android system is divided into five layers, from top to bottom, namely, application (APP) layer 31, application framework (FW / FWK) layer 32, native service (Native) layer 33, hardware abstraction layer (HAL) 34 and kernel (Kernel) layer 35. Figure 3 Also shown is a hardware layer 36 that can communicate with the kernel layer 35 .

[0064] The application layer 31, also referred to as the application layer, may include a series of application packages. The application package may include system applications and / or third-party applications. In an embodiment of the present application, the application package may include an always on display (AOD) application 311, which can be used to implement fingerprint unlocking with the screen off and fingerprint unlocking with the screen on.

[0065] In some embodiments, the application layer 31 may also include other applications 312, and the other applications 312 may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0066] The application framework layer 32 provides an application programming interface (API) and a programming framework for the application of the application layer 31. The application framework layer 32 includes some predefined functions. In an embodiment of the present application, the application framework layer 32 may include a power management service (PMS) module 321, which can be used to manage power and functions in electronic devices such as triggering the screen to turn on or off, brightness adjustment, low power mode, etc., and can also be used to issue control strategies to the application layer 31.

[0067] In some embodiments, the application framework layer 32 may also include a view system, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. Among them:

[0068] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0069] Content providers are used to store and retrieve data and make it accessible to applications. This data can include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0070] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications.

[0071] The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying images.

[0072] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including connected, hung up, etc.). The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0073] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0074] It should be noted that the application layer 31 and the application framework layer 32 run in a virtual machine. The virtual machine executes the Java files of the application layer 31 and the application framework layer 32 as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0075] The local service layer 33 may include multiple functional modules. In the embodiment of the present application, the local service layer 33 may include a system image engine (surfaceflinger, SF) module 331, wherein the system image engine may also be referred to as a system drawing core, an Android image engine, or a layer transmitter, etc. The SF module 331 may be used to obtain image data involved in synthesizing the content to be displayed, and to draw the graphical interface (user interface) of each application according to the obtained image data, as well as the elements displayed in each graphical interface, such as controls in the user interface. The SF module 331 may also send the obtained synthesized data to the hardware synthesizer (hardwarecomposer, HWC) module 341 of the hardware abstraction layer 34.

[0076] In some embodiments, the SF module 331 may also be used to determine a refresh rate (screen refresh rate) of the display screen 362 of the hardware layer 36 when displaying a user interface. For example, the refresh rate of the display screen 362 when displaying a user interface is 60 Hz.

[0077] The hardware abstraction layer 34 is an interface layer located between the kernel layer 35 and the local service layer 34, which can be used to abstract the hardware and provide a virtual hardware platform for the electronic device. In the embodiment of the present application, the hardware abstraction layer 34 may include a HWC module 341 and a fingerprint hardware abstraction (FP_HAL) module 342. The HWC module 341 can be used for window synthesis and display, and provide hardware support for the SF module 331 to synthesize a graphical interface (user interface). The HWC module 341 can mix the synthesized data transmitted by the SF module 331 into a frame of image to obtain an image to be displayed, and the image to be displayed can be a user interface.

[0078] In the embodiment of the present application, the hardware abstraction layer 34 may further include a display hardware abstraction (liquid crystal display hardware abstraction layer, LCD HAL) module 343. In the embodiment of the present application, the LCD HAL module 343 may be used to further notify the HWC module 341 of the hardware abstraction layer 34 after receiving the notification sent by the LCD driver 353 of the kernel layer 35.

[0079] In some embodiments, the LCD HAL module 343 may also be used to perform synthesis processing on the to-be-processed layer (synthesized data), and may drive the task to display the synthesized layer (user interface) on the display screen.

[0080] In some embodiments, the HWC module 341 can also be used to send the image to be displayed and the refresh rate of the display screen 362 when displaying the image to be displayed to the display screen 362 of the hardware layer 36 through the display driver (liquid crystal displaydriver, LCD driver) 353 of the kernel layer 35.

[0081] In the embodiment of the present application, the FP_HAL module 342 can be used to trigger the upper layer to send corresponding instructions after receiving the notification sent by the fingerprint driver (FP driver) 352 of the kernel layer 35. The FP_HAL module 342 is also used to send part or all of the instructions related to fingerprint unlocking to the LCD driver 353.

[0082] The kernel layer 35, which may also be referred to as the driver layer, is a layer between hardware and software. The kernel layer 35 includes various types of drivers. Drivers refer to configuration files written by hardware manufacturers based on the operating system, which contain information about hardware devices. By adding drivers to the operating system, electronic devices can communicate with corresponding hardware devices. In an embodiment of the present application, the kernel layer 35 may include a touch panel driver (TP driver) 351, an FP driver 352, and an LCD driver 353. Among them:

[0083] TP driver 351 can be used to receive the hardware interrupt corresponding to the touch operation transmitted from the hardware layer 36, and generate the corresponding event (activity) based on the hardware interrupt corresponding to the touch operation. After TP driver 351 generates the corresponding event, it can notify other drivers of the event. After generating the corresponding event, TP driver 351 can also send control strategies to other drivers, such as sending corresponding instructions.

[0084] FP driver352 can be used to further notify other modules, such as the upper layer FP_HAL module 342, after receiving notifications sent by other drivers, such as receiving notifications sent by TPdriver351 at the same layer, to trigger the upper layer to send control strategies. FP driver352 is also used to receive control strategies sent by other modules, such as instructions sent by TP driver351, and further send the instructions to other modules, such as further sending instructions to LCD driver353.

[0085] LCD driver 353 can be used to receive and execute instructions. LCD driver 353 can also be used to trigger the display screen 362 of the hardware layer 36 to power on, initialize parameter configuration, and display the content (user interface) sent by the upper layer.

[0086] In some embodiments, the core layer 35 may also include a camera driver module, an audio driver module, a sensor driver module, and the like.

[0087] The hardware layer 36 may include various hardware devices. In the embodiment of the present application, the hardware layer 36 may include hardware devices such as a touch device 361 and a display screen 362. Among them:

[0088] The touch device 361 may be used to detect a touch operation input by a user, and generate a corresponding hardware interrupt based on the touch operation, and then transmit the hardware interrupt to the TP driver 351 of the kernel layer 35 .

[0089] The display screen 362 is used to display the user interface and various elements in the user interface, such as the fingerprint unlocking control. The display screen 362 can also be used to display the user interface according to the display parameters sent by the upper layer. The display parameters sent by the upper layer can be refresh rate, resolution, etc. Among them, the display screen 362 includes two states: the screen-off state and the screen-on state. When the display screen 362 is in the screen-off state, the integrated circuit (IC) of the display screen 362 has been powered off and needs to be powered on and initialized first. The user interface can be displayed after the parameter configuration is completed. In the embodiment of the present application, the touch device 361 is set on the display screen 362 as an example for explanation. The touch screen composed of the touch device 361 and the display screen 362 can also be called a touch screen.

[0090] In some embodiments, the hardware layer 36 may also include hardware devices such as hardware chips.

[0091] When the electronic device is in the screen-off state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Figure 3The software interaction process may include:

[0092] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer.

[0093] After receiving the hardware interrupt from the touch device 361, the TP driver 351 can generate a corresponding event, that is, generate a fingerprint unlocking event, which can also be called a fingerprint area event. After generating the fingerprint unlocking event, the TP driver 351 can send a power-on instruction to the LCD driver 353 through the FP driver 352 and the FP_HAL module 342, that is, the TP driver 351 can notify the FP driver 352, and then the FP driver 352 can notify the FP_HAL module 342 to send a power-on instruction to the LCD driver 353, such as the power-on 11 instruction (11 is the power-on instruction code), and the power-on instruction is used to instruct the display screen 362 to power on. Then, the LCD driver 353 can first execute the power-on instruction, such as executing functions related to the power-on instruction. After the LCD driver 353 is executed, the power-on instruction can be sent to the display screen 362 to trigger the display screen 362 to power on, wherein the power-on instruction sent by the LCD driver 353 to the display screen 362 also carries the relevant parameters obtained by the LCD driver 353 executing the power-on instruction.

[0094] After receiving the power-on instruction, the display screen 362 can execute the power-on instruction, that is, the display screen 362 can be powered on based on the relevant parameters sent by the LCD driver 353. After the power-on is completed, the display screen 362 can notify the LCD driver 353 that the power-on is completed, that is, the LCD driver 353 is notified that the display screen 362 has been successfully powered on. After receiving the notification, the LCD driver 353 can wait for further instructions sent by the upper layer.

[0095] Process 2: When TP driver 351 notifies FP_HAL module 342 through FP driver 352 to send power-on command and fingerprint highlight command to LCD driver 353, TP driver 351 can simultaneously notify other modules to trigger the next operation, such as notifying the upper layer of the fingerprint unlocking event. The TP driver 351 reporting the fingerprint unlocking event to the upper layer can specifically include TP driver 351 sending the fingerprint unlocking event to FP driver 352. Furthermore, FP driver 352 can report the fingerprint unlocking event to the AOD application 311 of the application layer 31 through FP_HAL module 342.

[0096] After the AOD application 311 receives the notification sent from the FP_HAL module 342, the AOD application 311 can send a power-on instruction, such as a power-on 11 instruction, to the LCD driver 353 through the PMS module 321, the SF module 331, and the HWC module 341. It should be noted that the power-on instruction sent by the AOD application 311 to the LCD driver 353 through the PMS module 321, the SF module 331, and the HWC module 341 also includes the parameters required for initializing the display screen 362, so that the display screen 362 that has completed power-on can be initialized. Parameter configuration. For example, the power-on instruction received by the LCD driver 353 may include, for example, an image to be displayed (user interface) synthesized by the SF module 331 and the HWC module 341, such as a fingerprint unlocking control.

[0097] Because before this, LCD driver353 has received the power-on instruction sent by TP driver351 through FP driver352, and sent the power-on instruction to display screen 362 to trigger the display screen 362 to power on. When LCD driver353 receives the power-on instruction again, it can return (return) the power-on instruction. Returning the power-on instruction can be understood as notifying the upper display screen 362 that power-on and initialization have been completed, and the thread corresponding to the power-on instruction is no longer executed. Specifically, LCD driver353 can send the parameters carried in the power-on instruction sent by HWC module 341 to display screen 362. Among them, LCD driver353 can execute related functions based on the power-on instruction sent by HWC module 341, and send the obtained parameters related to the initialization of display screen 362 to display screen 362.

[0098] Then, after receiving the parameters required for initialization, the display screen 362 can be initialized based on the received parameters. After the display screen 362 completes the initialization parameter configuration, the LCD driver 353 is notified that the initialization has been completed, that is, the LCD driver 353 is notified that the display screen 362 has been successfully initialized.

[0099] After receiving the notification, LCD driver353 can return the power-on instruction. Specifically, LCD driver353 can notify HWC module 341 that display screen 362 has completed power-on, and then HWC module 341 notifies SF module 331 that display screen 362 has completed power-on. Among them, LCD driver353 notifies HWC module 341 that display screen 362 has completed power-on, which can be understood as notifying HWC module 341 that display screen 362 has successfully powered on and initialized parameter configuration. Similarly, HWC module 341 notifies SF module 331 that display screen 362 has completed power-on, which can also be understood as notifying SF module 331 that display screen 362 has successfully powered on and initialized parameter configuration.

[0100] It should be noted that after the SF module 331 receives the notification sent by the HWC module 341, the SF module 331 does not need to continue to notify other modules. The SF module 331 can modify the parameters used to indicate the display status of the display screen 362 so that other modules can read the parameters modified by the SF module 331 and know the current status of the display screen 362.

[0101] After the LCD driver 353 can notify the FP_HAL module 342 that the display screen 362 has completed power-on, the LCD driver 353 can also notify the FP_HAL module 342 to trigger the next operation, such as issuing a fingerprint highlighting instruction.

[0102] Optionally, LCD driver 353 may also notify HWC module 341 that display screen 362 has completed highlight display, and then HWC module 341 notifies FP_HAL module 342 that display screen 362 has completed highlight display. Figure 3 Not shown.

[0103] After the FP_HAL module 342 receives the notification from the LCD driver 353, a fingerprint highlight instruction can be sent to the LCD driver 353. The fingerprint highlight instruction is used to instruct the display screen 362 to highlight the fingerprint unlocking area to facilitate the collection of the fingerprint image input by the user. The fingerprint highlight instruction may include, for example, instruction 29 (29 is the instruction code) and a localized high brightness mode (LHBM) instruction.

[0104] In some embodiments, when the FP_HAL module 342 sends the fingerprint highlight instruction to the LCD driver 353, the fingerprint highlight instruction can be sent to the LCD driver 353 through the HWC module 341, that is, the FP_HAL module 342 can first send the fingerprint highlight instruction to the HWC module 341, and then the HWC module 342 sends the fingerprint highlight instruction to the LCD driver 353. It should be noted that this method is Figure 3 Not shown.

[0105] Furthermore, after receiving the fingerprint highlight instruction, LCD driver 353 can trigger the display screen 362 to highlight the fingerprint unlocking area. Specifically, after receiving the fingerprint highlight instruction, LCD driver 353 can directly send the fingerprint highlight instruction to the display screen 362. LCD driver 353 can also execute functions related to the fingerprint highlight instruction, etc. After LCD driver 353 completes the execution, the fingerprint highlight instruction can be sent to the display screen 362. The fingerprint highlight instruction includes parameters obtained by LCD driver 353 executing functions related to the fingerprint highlight instruction.

[0106] After the display screen 362 receives the fingerprint highlight command, it can highlight the fingerprint unlocking area based on the fingerprint highlight command, that is, a bright spot is displayed in the fingerprint unlocking area of ​​the display screen 362. Furthermore, after the display screen 362 highlights the fingerprint unlocking area, it can notify the LCD driver 353 that the highlighting has been completed (highlighted), that is, it notifies the LCD driver 353 that the display screen 362 has been successfully highlighted.

[0107] After LCD driver 353 receives the notification of highlighting sent by display screen 362 , LCD driver 353 may notify FP_HAL module 342 that display screen 362 has been highlighted, so that FP_HAL module 342 triggers the next operation.

[0108] In some embodiments, LCD driver 353 may also notify HWC module 341 that display screen 362 has completed highlight display, and then HWC module 341 notifies FP_HAL module 342 that display screen 362 has completed highlight display. Figure 3 Not shown.

[0109] In some embodiments, when the display screen 362 performs highlight display in the fingerprint unlocking area, the LCD driver 353 can also trigger the display screen 362 to display part or all of the fingerprint unlocking controls, which may include, for example, fingerprint spot controls, water ripple controls, etc.

[0110] Process 3: After the FP_HAL module 342 receives the notification sent by the LCD driver 353, the FP_HAL module 342 may send a capture instruction to the LCD driver 352, where the capture instruction is used to trigger the capture of the fingerprint image corresponding to the touch operation input by the user.

[0111] After receiving the image acquisition instruction, LCD driver352 can directly send the image acquisition instruction to the display screen 362. LCD driver353 can also execute functions related to the image acquisition instruction, and then send the image acquisition instruction to the display screen 362. The image acquisition instruction includes parameters obtained by LCD driver353 executing functions related to the image acquisition instruction.

[0112] After the display screen 362 receives the image acquisition instruction, the fingerprint image corresponding to the touch operation input by the user can be acquired. After the acquisition is completed, the LCD driver 353 can be notified that the image acquisition is completed. After the LCD driver 353 receives the notification of the completion of the image acquisition sent by the display screen 362, the LCD driver 353 can notify the FP_HAL module 342 that the display screen 362 has completed the image acquisition. After the FP_HAL module 342 receives the notification sent by the LCD driver 353, the FP_HAL module 342 can send a stop image acquisition instruction to the LCD driver 352. The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display screen 362 to stop acquiring fingerprint images, and can also be used to trigger the display screen 362 to stop highlighting fingerprints.

[0113] Furthermore, after receiving the stop acquisition instruction, LCD driver 352 can directly send the stop acquisition instruction to display screen 362, and LCD driver 353 can also execute functions related to the stop acquisition instruction, etc. After LCD driver 353 completes the execution, the stop acquisition instruction can be sent to display screen 362, and the acquisition instruction includes parameters obtained by LCD driver 353 executing functions related to the stop acquisition instruction. After receiving the stop acquisition instruction, display screen 362 can stop collecting fingerprint images and notify LCD driver 353 that acquisition has stopped.

[0114] Furthermore, LCD driver 353 can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to complete fingerprint unlocking in the screen-off state.

[0115] It should be noted that Figure 3 The circle mark ① in the figure shows part of the process 1 above. Figure 3 The circle mark ② in the figure shows part of the process 2 above. Figure 3 The circle mark ③ in the figure shows part of the process 3 above.

[0116] Please also read Figure 4 , Figure 4 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application. Figure 4 As shown, the application (APP) can be used to represent Figure 3 The application in the application layer 31 shown is, for example, the AOD application 311 mentioned above.

[0117] First, the touch device of the electronic device can detect a touch operation acting on the touch device, such as Figure 1 In the application scenario shown, the touch device of the electronic device can detect the touch operation of the user (actor) on the fingerprint unlocking area in the display screen (touch device). It should be noted that Figure 4 The drawing and explanation are made by taking the setting of a touch device on a display screen as an example. The display screen may be a display screen with a touch function, such as a touch screen or a touch control screen.

[0118] (1) In response to the above touch operation, the touch device (display screen) may send a hardware interrupt corresponding to the touch operation to the kernel layer, specifically to the TP driver of the kernel layer.

[0119] After the TP driver receives the hardware interrupt, (2) the TP driver in the kernel layer can generate a fingerprint unlock event (fingerprint area event) and send the fingerprint unlock event to the FP driver. The fingerprint unlock event can also be used to instruct the FP driver to continue to notify other modules to send a power-on command (such as a power-on 11 command) to the LCD driver. For example, the FP driver can notify the FP_HAL module of the hardware abstraction layer (HAL) to send a power-on command to the LCD driver.

[0120] After the FP driver receives the fingerprint unlocking event sent by the TP driver, (3) the FP driver of the kernel layer can trigger the report to the upper layer. Then, (4) the FP driver of the kernel layer can send the fingerprint unlocking event to the hardware abstraction layer, specifically to the FP_HAL module of the hardware abstraction layer, so that the FP_HAL module sends a power-on command to the LCD driver and reports to the upper layer at the same time.

[0121] After the FP_HAL module receives the notification from the FP driver, (5) the FP_HAL module of the hardware abstraction layer can perform logic processing, wherein the logic processing performed by the FP_HAL module, for example, triggers notification of the fingerprint unlocking event to the upper layer, such as notifying the application in the application layer, and triggers sending a power-on instruction to the LCD driver.

[0122] (6) The FP_HAL module of the hardware abstraction layer can directly send a power-on instruction to the LCD driver. After the LCD driver receives the power-on instruction sent by the FP_HAL module, (7) the LCD driver of the kernel layer can execute the power-on instruction, such as executing functions related to the power-on 11 instruction, etc. After the LCD driver completes the execution, (8) the LCD driver of the kernel layer can send the power-on instruction (such as the power-on 11 instruction) to the display screen. The power-on instruction can carry the relevant parameters obtained by the LCD driver executing the power-on instruction to trigger the display screen to power on.

[0123] After the display screen receives the power-on command sent by the LCD driver, (9) the display screen can execute the power-on command, that is, the display screen is powered on. Since it takes a certain amount of time to power on the display screen, the fingerprint unlocking event reporting process can continue to be executed during the display screen power-on process, that is, the FP_HAL module sends the fingerprint unlocking event to the AOD application.

[0124] While the FP_HAL module sends the power-on command to the LCD driver, (10) the FP_HAL module of the hardware abstraction layer can send the fingerprint unlocking event to the native service layer (native), specifically, to the SF module of the application framework layer, that is, the FP_HAL module of the hardware abstraction layer can notify the native service layer.

[0125] Furthermore, after the local service layer receives the notification from the FP_HAL module of the hardware abstraction layer, (11) the local service layer can send the fingerprint unlocking event to the application framework layer (FW), specifically to the PMS of the application framework layer, that is, the local service layer can notify the application framework layer.

[0126] Furthermore, after the application framework layer receives the notification from the local service layer, (12) the application framework layer can send the fingerprint unlocking event to the application layer, and specifically can transmit it to the application in the application layer, such as the AOD application, that is, the application framework layer can notify the application layer. Thus, the fingerprint unlocking event is transmitted from the FPdriver, through the hardware abstraction layer, the local service layer, and the application framework layer to the application in the application layer.

[0127] After an application in the application layer (such as an AOD application) receives a notification from the application framework layer, (13) the application layer may issue a power-on instruction, such as issuing a power-on 11 instruction to the application framework layer, and specifically issuing a power-on 11 instruction to the PMS module of the application framework layer. The process of issuing a power-on instruction may also be referred to as a process of each layer executing a power-on instruction.

[0128] In some embodiments, the application in the application layer may also issue other instructions, which may be determined based on the function of the application, and this application does not limit this.

[0129] Then, after receiving the power-on instruction from the application layer, the PMS module of the application framework layer (14) can further send the power-on instruction to the local service layer, for example, it can send a power-on instruction 11 to the SF module of the local service layer. After receiving the power-on instruction, the PMS module can perform logical processing, for example, it can trigger the screen to light up, determine the backlight brightness (normal backlight) parameters of the display screen, etc., and send the determined parameters to the local service layer.

[0130] In the process of the PMS module receiving the power-on instruction and further sending the power-on instruction to the local service layer, the logic processing performed by the PMS module may take, for example, about 100 milliseconds, and the time taken to power on the display may be, for example, about 175 milliseconds. Figure 4 Taking the power-on completion of the display screen as an example, after the display screen is powered on, (15) the display screen can notify the LCD driver that the power-on is completed. After receiving the notification, the LCD driver can wait for further instructions from the upper layer.

[0131] After the SF module of the local service layer receives the power-on instruction from the PMS module of the application framework layer, (16) the SF module of the local service layer can also further send a power-on instruction to the hardware abstraction layer, for example, it can specifically send a power-on instruction 11 to the HWC module of the hardware abstraction layer. Among them, after receiving the power-on instruction, the SF module can obtain the image data involved in the content to be displayed on the display screen, such as the fingerprint unlocking control, and perform synthesis processing, and then the synthesized display data and the parameters sent by the PMS module can be sent to the HWC module. Optionally, SF can also determine the refresh rate of the display screen when displaying content, and then send the refresh rate parameters to the HWC module.

[0132] After the HWC module receives the power-on instruction from SF, (17) the HWC module of the hardware abstraction layer can further send the power-on instruction to the LCD driver of the kernel layer. The HWC module can receive the display data synthesized by SF and perform synthesis processing to obtain the image to be displayed. Then, the HWC module can send the image to be displayed and the parameters / data sent by the above layers to the LCD driver.

[0133] After the LCD driver receives the power-on instruction from the HWC module, since the LCD driver has already received the power-on instruction and triggered the display screen to power on, the LCD driver can return the power-on instruction. Specifically, since the power-on instruction sent by the AOD application through the PMS module, the SF module and the HWC module also includes the parameters required for the initialization of the display screen, after the LCD driver receives the power-on instruction, (18) the LCD driver of the kernel layer can send the parameters carried by the power-on instruction to the display screen.

[0134] In some embodiments, the LCD driver can also execute related functions based on the power-on instruction issued by the HWC module, and send the obtained parameters related to the initialization of the display screen to the display screen. Figure 4 Not shown.

[0135] In some embodiments, when the LCD driver receives the power-on instruction, it is possible that the display screen has not yet completed power-on. If the display screen has not yet completed power-on, then delay is performed. It should be noted that if the display screen has completed power-on before the step is completed, then there is no need to delay, and the delay process does not exist. Figure 4 The delay only exists if the display screen is not powered on before step (17) is completed.

[0136] After the display screen receives the parameters carried by the power-on command, (19) the display screen can be initialized based on the parameters. After the display screen initialization parameters are configured, (20) the display screen can notify the LCD driver that the initialization has been completed, that is, notify the LCD driver that the display screen has been successfully initialized.

[0137] After the LCD driver receives the notification of completed initialization sent by the display, (21) the LCD driver of the kernel layer can return the power-on instruction, specifically notifying the HWC module that the display has been powered on, that is, notifying the HWC module that the display has been successfully powered on and the parameter configuration has been initialized.

[0138] Then, (22) the HWC module of the hardware abstraction layer can further notify the local service layer, and specifically, the SF module of the local service layer can be notified that the display screen has been powered on.

[0139] In some embodiments, the SF module can modify the parameters used to indicate the current display state of the display screen, so that other modules can read the parameters modified by the SF module and know the current state of the display screen. Therefore, the SF module does not need to continue to notify other modules.

[0140] After the LCD driver sends a notification to the HWC module of the hardware abstraction layer, (23) the LCD driver of the kernel layer can notify the FP_HAL module to issue a fingerprint highlighting command.

[0141] After the FP_HAL module receives the notification from the LCD driver, (24) the FP_HAL module of the hardware abstraction layer can send fingerprint highlighting instructions to the LCD driver of the kernel layer, such as issuing 29 instructions and LHBM instructions.

[0142] In some embodiments, when the FP_HAL module sends the fingerprint highlight instruction to the LCD driver, it can send the fingerprint highlight instruction to the LCD driver through the HWC module, that is, the FP_HAL module can first send the fingerprint highlight instruction to the HWC module, and then the HWC module sends the fingerprint highlight instruction to the LCD driver. It should be noted that this method is Figure 4 Not shown in the figure.

[0143] After the LCD driver receives the fingerprint highlight instruction sent from the FP_HAL module, (25) the LCD driver of the kernel layer can execute the fingerprint highlight instruction, for example, the LCD driver can execute the function related to the fingerprint highlight instruction. After the execution is completed, (26) the LCD driver of the kernel layer can send the fingerprint highlight instruction to the display screen to trigger the display screen to highlight the fingerprint unlocking area. Among them, the fingerprint highlight instruction sent by the LCD driver to the display screen can carry the parameters obtained by the function related to the LCD driver.

[0144] After the display screen receives the fingerprint highlight command, (27) the display screen can highlight the fingerprint unlocking area based on the fingerprint highlight command, for example, display a bright spot in the fingerprint unlocking area of ​​the display screen. Furthermore, after the fingerprint unlocking area is highlighted, (28) the display screen can notify the LCD driver of the kernel layer that it has been highlighted, that is, notify the LCD driver that the display screen has been successfully highlighted. After the LCD driver receives the notification sent by the display screen, (29) the LCD driver of the kernel layer can notify the hardware abstraction layer that the display screen has been highlighted. Specifically, the FP_HAL module can be directly notified that the display screen has been highlighted. Among them, the LCD driver notifying the FP_HAL module that the display screen has been highlighted can also be understood as notifying the FP_HAL module that it has completed power-on and highlighting, and notifying the FP_HAL module to trigger the image acquisition operation.

[0145] In some embodiments, before the LCD driver notifies the FP_HAL module that the display screen has completed highlighting, the LCD driver may also determine (check) whether the display screen is powered on and highlighted (execute a power-on instruction and a fingerprint highlighting instruction), and only after determining that the display screen has completed powering on and highlighting, notify the FP_HAL module that the display screen has completed highlighting.

[0146] In some embodiments, the LCD driver may also notify the FP_HAL module through the HWC module that the display screen has been highlighted, that is, the LCD driver may first notify the HWC module that the display screen has been highlighted, and then the HWC module notifies the FP_HAL module that the display screen has been highlighted. Figure 4 Not shown in the figure.

[0147] After the FP_HAL module receives the notification sent by the LCD driver, (30) the FP_HAL module of the hardware abstraction layer can send a picture acquisition instruction to the LCD driver of the kernel layer, and the picture acquisition instruction is used to trigger the acquisition of the fingerprint image input by the user. After the LCD driver receives the picture acquisition instruction, (31) the LCD driver of the kernel layer can send the picture acquisition instruction to the display screen.

[0148] In some embodiments, the LCD driver can execute the image acquisition instruction, such as executing functions related to the image acquisition instruction. After the LCD driver completes the execution, the LCD driver can send the image acquisition instruction to the display screen. The image acquisition instruction can carry relevant parameters obtained by the LCD driver executing the image acquisition instruction to trigger the display screen to acquire the fingerprint image input by the user. It should be noted that this method is Figure 4 Not shown in the figure.

[0149] Furthermore, after the display screen receives the image acquisition instruction, (32) the display screen can acquire the fingerprint image corresponding to the touch operation input by the user. After the acquisition is completed, (33) the display screen can notify the LCD driver that the image acquisition has been completed. Furthermore, after the LCD driver receives the notification sent by the display screen, (34) the LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the image acquisition. After the FP_HAL module receives the notification sent by the LCD driver, (35) the FP_HAL module of the hardware abstraction layer can send a stop (disable) image acquisition instruction to the LCD driver (disable the image acquisition instruction). The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display screen to stop acquiring fingerprint images, and can also be used to trigger the display screen to stop highlighting fingerprints.

[0150] Furthermore, after the LCD driver receives the stop acquisition instruction, (36) the LCD driver of the core layer can send the stop acquisition instruction to the display screen, and after the display screen receives the stop acquisition instruction, (37) the display screen can stop acquiring fingerprint images. Furthermore, (38) the display screen can notify the LCD driver that the acquisition has stopped.

[0151] Furthermore, the LCD driver can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to complete fingerprint unlocking in the off-screen state.

[0152] It should be noted that Figure 4 In the figure, the sending / transmission of events, data, etc. from the bottom layer to the upper layer (from right to left) is represented by a realization arrow, and the sending of data / instructions, etc. from the upper layer to the bottom layer (from left to right) is represented by a dotted arrow.

[0153] Next, combine Figure 5-Figure 6 The specific process of implementing screen-off fingerprint unlocking in another electronic device provided in an embodiment of the present application is exemplified.

[0154] Please also read Figure 5 , Figure 5 1 is a schematic diagram of software interaction of another electronic device provided in an embodiment of the present application. Figure 5 As shown, the software system of the electronic device may include an application layer 31, an application framework layer 32, a local service layer 33, a hardware abstraction layer 34 and a kernel layer 35. Figure 5 The functions of each layer and the modules included can be found in Figure 3 The description of the corresponding software architecture will not be repeated here.

[0155] When the electronic device is in the screen-off state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Figure 5 The software interaction process may include:

[0156] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer.

[0157] After receiving the hardware interrupt from the touch device 361, the TP driver 351 can generate a corresponding event, that is, generate a fingerprint unlocking event. After generating the fingerprint unlocking event, the TP driver 351 can notify the LCD driver 353 to power on through the FP driver 352, the FP_HAL module 342, and the PMS module 321, that is, the TP driver 351 can notify the FP driver 352, and then the FP driver 352 can notify the FP_HAL module 342, and then the FP_HAL module 342 further notifies the PMS module 321 to send a power-on instruction to the LCD driver 353, such as the power-on 11 instruction (11 is the power-on instruction code), and the power-on instruction is used to instruct the display screen 362 to power on. Furthermore, the LCD driver 353 can respond to the power-on instruction and first trigger the display screen 362 to power on. Specifically, the LCD driver 353 can first execute the power-on instruction, such as executing functions related to the power-on instruction. After LCD driver 353 is executed, a power-on instruction may be sent to display screen 362 to trigger display screen 362 to power on. The power-on instruction sent by LCD driver 353 to display screen 362 also carries relevant parameters obtained by LCD driver 353 executing the power-on instruction.

[0158] After receiving the power-on instruction, the display screen 362 can execute the power-on instruction, that is, the display screen 362 can be powered on based on the relevant parameters sent by the LCD driver 353. After the power-on is completed, the display screen 362 can notify the LCD driver 353 that the power-on is completed, that is, the LCD driver 353 is notified that the display screen 362 has been successfully powered on. After receiving the notification, the LCD driver 353 can wait for further instructions sent by the upper layer.

[0159] Among them, the PMS module 321 sending the power-on instruction to the LCD driver 353 may be that the PMS module 321 sends the power-on instruction to the LCD driver 353 through the SF module 331 and the HWC module 341. Specifically, the PMS module 321 sends the power-on instruction to the SF module 331, and then the SF module 331 sends the power-on instruction to the HWC module 341, and finally the HWC module 341 sends the power-on instruction to the LCD driver 353.

[0160] It should be noted that the link in which TP driver 351 triggers the sending of a power-on command to LCD driver 353 partially overlaps with the link in which TP driver 351 triggers the reporting of a fingerprint unlocking event. In the overlapping links, it can be understood that TP driver 351 simultaneously triggers the reporting event and sends a power-on command to LCD driver 353. Specifically, TP driver 351 sends a fingerprint unlocking event to FP driver 352, and the fingerprint unlocking event is used to instruct FP driver 352 to continue reporting the fingerprint unlocking event and further send a power-on command to LCD driver 353. Then, FP driver 352 sends a fingerprint unlocking event to FP_HAL module 342 to continue reporting the fingerprint unlocking event and further sends a power-on command to LCD driver 353.

[0161] in, Figure 5 The specific implementation methods of process 2 and process 3 are the same as Figure 3 The specific implementation methods of process 2 and process 3 are the same, please refer to the above Figure 3 The description of process 2 in the above will not be repeated here.

[0162] It should be noted that Figure 5 The circle mark ① in the figure shows part of the process 1 above. Figure 5 The circle mark ② in the figure shows part of the process 2 above. Figure 5 The circle mark ③ in the figure shows a part of the process 3. There are overlapping links in the process 1 and the process 2 (TP driver 351 sends a fingerprint unlocking event / power-on command to FP driver 352, and FP driver 352 sends a fingerprint unlocking event / power-on command to FP_HAL module 342).

[0163] Please also read Figure 6 , Figure 6 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application. Figure 6 As shown, the application (APP) can be used to represent Figure 5The application in the application layer 31 shown, for example, the above-mentioned AOD application 311. For ease of drawing, Figure 6 The HWC in can be used to represent Figure 3 The HWC module 341 in the hardware abstraction layer 34 shown, FP_HAL can be used to represent Figure 3 The FP_HAL module 342 in the hardware abstraction layer 34 is shown.

[0164] First, the touch device of the electronic device can detect a touch operation acting on the touch device, such as Figure 1 In the application scenario shown, the touch device of the electronic device can detect the touch operation of the user (actor) on the fingerprint unlocking area in the display screen (touch device). It should be noted that Figure 6 The drawing and explanation are made by taking the setting of a touch device on a display screen as an example. The display screen may be a display screen with a touch function, such as a touch screen or a touch control screen.

[0165] (1) In response to the above touch operation, the touch device (display screen) may send a hardware interrupt corresponding to the touch operation to the kernel layer, specifically to the TP driver of the kernel layer.

[0166] After the TP driver receives the hardware interrupt, (2) the TP driver in the kernel layer can generate a fingerprint unlock event (fingerprint area event) and send the fingerprint unlock event to the FP driver. The fingerprint unlock event can also be used to instruct the FP driver to continue to notify other modules to send a power-on instruction (such as a power-on 11 instruction) to the LCD driver. For example, the FP driver can notify the FP_HAL module of the hardware abstraction layer (HAL) to further send a power-on instruction to the LCD driver.

[0167] After the FP driver receives the fingerprint unlocking event (power-on command) sent by the TP driver, (3) the FP driver of the kernel layer can trigger the report to the upper layer. Then, (4) the FP driver of the kernel layer can send the fingerprint unlocking event to the hardware abstraction layer, specifically to the FP_HAL module of the hardware abstraction layer, so that the FP_HAL module further sends a power-on command to the LCD driver, that is, triggers the notification of the PMS module and reports to the upper layer at the same time.

[0168] After the FP_HAL module 342 receives the notification from the FP driver, (5) the FP_HAL module of the hardware abstraction layer can perform logic processing. For example, the FP_HAL module can trigger the notification of the fingerprint unlocking event to the upper layer, such as notifying the application in the application layer, and further trigger the sending of a power-on instruction to the LCD driver. (6) The FP_HAL module of the hardware abstraction layer can send the fingerprint unlocking event to the native service layer, that is, the FP_HAL module of the hardware abstraction layer can notify the native service layer.

[0169] After the local service layer receives the notification from the FP_HAL module of the hardware abstraction layer, (7) the local service layer can send the fingerprint unlocking event to the application framework layer (FW), specifically to the PMS module of the application framework layer, that is, the local service layer can notify the application framework layer.

[0170] Furthermore, after the application framework layer receives the notification from the local service layer, (8) the application framework layer can send the fingerprint unlocking event to the application layer, specifically to the AOD application in the application layer. Thus, the fingerprint unlocking event is transmitted from the FP driver, through the hardware abstraction layer, the local service layer, and the application framework layer to the application in the application layer.

[0171] Among them, after the application framework layer receives the notification from the local service layer, (9) the PMS module of the application framework layer can perform logical processing and send the power-on instruction to the local service layer, specifically, to the SF module of the local service layer.

[0172] After the local service layer receives the notification from the PMS module of the application framework layer, (10) the local service layer can send the power-on instruction to the hardware abstraction layer, specifically, the power-on instruction can be sent to the HWC module. Furthermore, after the HWC module receives the power-on instruction sent from the local service layer, (11) the HWC module of the hardware abstraction layer can send the power-on instruction to the kernel layer, specifically, to the LCD driver of the kernel layer, that is, the HWC module can notify the LCD driver to power on.

[0173] After the LCD driver receives the power-on instruction sent by the PMS module through the SF module and the HWC module, (12) the LCD driver of the kernel layer can execute the power-on instruction, such as executing functions related to the power-on instruction 11. After the LCD driver completes the execution, (13) the LCD driver of the kernel layer can send the power-on instruction (such as the power-on instruction 11) to the display screen. The power-on instruction can carry the relevant parameters obtained by the LCD driver executing the power-on instruction to trigger the display screen to power on.

[0174] After the display screen receives the power-on command sent by the LCD driver, (14) the display screen can execute the power-on command, that is, the display screen is powered on.

[0175] At the same time, after receiving the notification from the application framework layer, the application in the application layer (such as the AOD application) (15) can issue a power-on instruction, such as issuing a power-on instruction 11 to the application framework layer, and specifically issuing a power-on instruction 11 to the PMS module of the application framework layer. The process of issuing a power-on instruction can also be referred to as the process of each layer executing the power-on instruction. (16) The PMS module of the application framework layer can further issue the power-on instruction to the local service layer, such as issuing a power-on instruction 11 to the SF module of the local service layer. (17) The SF module of the local service layer can also further issue a power-on instruction to the hardware abstraction layer, such as issuing a power-on instruction 11 to the HWC module of the hardware abstraction layer. (18) The HWC module of the hardware abstraction layer can further issue a power-on instruction to the LCD driver of the kernel layer.

[0176] Among them, the specific implementation method of steps (15) to (18) is the same as Figure 4 The specific implementation methods of steps (13) to (17) except step (15) are the same, and can be referred to above. Figure 4 The description of steps (13) to (17) except step (15) will not be repeated here.

[0177] It should be noted that when the LCD driver receives the power-on command, the display screen may not have completed power-on. If the display screen has not completed power-on, it will be delayed. It should be noted that if the display screen has completed power-on before the step is completed, there is no need to delay, and the delay process does not exist. Figure 6 The delay only exists if the display screen is not powered on before step (18) is completed.

[0178] After the display screen is powered on, (19) the display screen can notify the LCD driver that the power-on is complete. After receiving the notification, (20) the LCD driver in the core layer can send the parameters carried by the power-on instruction to the display screen.

[0179] (21) The display screen can be initialized based on the parameters. (22) The display screen can notify the LCD driver that the initialization has been completed, that is, it notifies the LCD driver that the display screen has been successfully initialized. (23) The LCD driver of the kernel layer can return the power-on command. (24) The HWC module of the hardware abstraction layer can further notify the local service layer. (25) The LCD driver of the kernel layer can notify the FP_HAL module to issue a fingerprint highlighting command. (26) The FP_HAL module of the hardware abstraction layer can send a fingerprint highlighting command to the LCD driver of the kernel layer. (27) The LCD driver of the kernel layer can execute the fingerprint highlighting command. (28) The LCD driver of the kernel layer can send a fingerprint highlighting command to the display screen. (29) The display screen can highlight the fingerprint unlocking area based on the fingerprint highlighting command. (30) The display screen can notify the LCD driver of the kernel layer that it has been highlighted, that is, it notifies the LCD driver that the display screen has been successfully highlighted. After the LCD driver receives the notification sent by the display screen, (31) the LCD driver of the kernel layer can notify the hardware abstraction layer that the display screen has been highlighted. (32) The FP_HAL module of the hardware abstraction layer can send an image acquisition instruction to the LCD driver of the kernel layer. (33) The LCD driver of the kernel layer can send the image acquisition instruction to the display screen. (34) The display screen can acquire the fingerprint image corresponding to the touch operation input by the user. (35) The display screen can notify the LCD driver that the image acquisition has been completed. (36) The LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the image acquisition. (37) The FP_HAL module of the hardware abstraction layer can send a stop (disable) image acquisition instruction to the LCD driver (disable the image acquisition instruction). (38) The LCD driver of the kernel layer can send the stop image acquisition instruction to the display screen. After the display screen receives the stop image acquisition instruction, (39) the display screen can stop acquiring fingerprint images. (40) The display screen can notify the LCD driver that the image acquisition has stopped.

[0180] Among them, the specific implementation method of steps (20) to (40) is the same as Figure 4 The specific implementation methods of steps (18) to (38) are the same, and can be found in the above Figure 4 The description of steps (18) to (38) will not be repeated here.

[0181] It should be noted that Figure 6 In the figure, the sending / transmission of events, data, etc. from the bottom layer to the upper layer (from right to left) is represented by a realization arrow, and the sending of data / instructions, etc. from the upper layer to the bottom layer (from left to right) is represented by a dotted arrow.

[0182] Next, combine Figure 7-Figure 8 The specific process of implementing screen-off fingerprint unlocking in another electronic device provided in an embodiment of the present application is exemplified.

[0183] Please also read Figure 7 , Figure 7 1 is a schematic diagram of software interaction of another electronic device provided in an embodiment of the present application. Figure 7 As shown, the software system of the electronic device may include an application layer 31, an application framework layer 32, a local service layer 33, a hardware abstraction layer 34 and a kernel layer 35. Figure 7 The functions of each layer and the modules included can be found in Figure 3 The description of the corresponding software architecture will not be repeated here.

[0184] When the electronic device is in the screen-off state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Figure 7 The software interaction process may include:

[0185] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer.

[0186] After receiving the hardware interrupt from the touch device 361 , the TP driver 351 may generate a corresponding event, that is, a fingerprint unlocking event, which may also be referred to as a fingerprint area event.

[0187] In some embodiments, after generating the fingerprint unlocking event, TP driver351 can send a power-on instruction to LCD driver353 through FPdriver352, that is, FP driver352 can directly notify LCD driver353 to power on. The power-on instruction can be, for example, a power-on 11 instruction (11 is the power-on instruction code), which is used to instruct the display screen 362 to power on. Furthermore, LCD driver353 can first execute the power-on instruction, such as executing functions related to the power-on instruction. After LCDdriver353 is executed, the power-on instruction can be sent to the display screen 362 to trigger the display screen 362 to power on, wherein the power-on instruction sent by LCD driver353 to the display screen 362 also carries the relevant parameters obtained by LCD driver353 executing the power-on instruction.

[0188] After receiving the power-on instruction, the display screen 362 can execute the power-on instruction, that is, the display screen 362 can be powered on based on the relevant parameters sent by the LCD driver 353. After the power-on is completed, the display screen 362 can notify the LCD driver 353 that the power-on is completed, that is, the LCD driver 353 is notified that the display screen 362 has been successfully powered on. After receiving the notification, the LCD driver 353 can wait for further instructions sent by the upper layer.

[0189] It should be noted that when the LCD driver 353 is notified directly to power on through the FP driver 352, the LCD driver 353 may fail to trigger the display screen 362 to power on. This is because the link for directly notifying the LCD driver 353 to power on through the FP driver 352 is incomplete. Therefore, the possibility of the LCD driver 353 triggering the display screen 362 to power on successfully can be improved by completing the link. That is, after the display screen 362 fails to power on, it can notify the LCD driver 353 of the power-on failure.

[0190] In the embodiment of the present application, after generating the fingerprint unlocking event, TP driver351 can send a power-on instruction to LCD driver353 through FPdriver352, LCD driver353, LCD HAL module 343 and HWC module 341. Specifically, TP driver351 can notify FP driver352, and then FP driver352 notifies LCD driver353. At this time, LCD driver353 can try to trigger the display screen 362 to power on, that is, the above-mentioned LCD driver353 executes the power-on instruction, and the display screen 362 sends the power-on instruction. Then LCD driver353 notifies LCD HAL module 343, and LCD HAL module 343 notifies HWC module 341 of the fingerprint unlocking event, triggering HWC module 341 to send a power-on instruction to LCD driver353. In this process, the power-on instruction includes the link sent by HWC module 341 to LCD driver353, which improves the integrity of the link and can increase the possibility of LCD driver353 triggering the display screen 362 to power on successfully. Then, LCD driver353 triggers the display screen 362 to power on.

[0191] It should be noted that the link in which TP driver 351 triggers the sending of a power-on command to LCD driver 353 partially overlaps with the link in which TP driver 351 triggers the reporting of a fingerprint unlocking event. In the overlapping link, it can be understood that TP driver 351 simultaneously triggers the reporting event and sends a power-on command to LCD driver 353. Specifically, TP driver 351 sends a fingerprint unlocking event to FP driver 352, and the fingerprint unlocking event is used to instruct FP driver 352 to continue reporting the fingerprint unlocking event and further send a power-on command to LCD driver 353.

[0192] in, Figure 7 The specific implementation methods of process 2 and process 3 are the same as Figure 3 The specific implementation methods of process 2 and process 3 are the same, please refer to the above Figure 3 The description of process 2 and process 3 in the above will not be repeated here.

[0193] It should be noted that Figure 7 The circle mark ① in the figure shows the above process 1. Figure 7 The circle mark ② in the figure shows part of the process 2 above. Figure 7The circle mark ③ in the figure shows a part of the process 3. There is a part of overlapping links in the process 1 and the process 2 (TP driver 351 sends a fingerprint unlocking event / power-on command to FP driver 352).

[0194] Please also read Figure 8 , Figure 8 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application. Figure 8 As shown, the application (APP) can be used to represent Figure 3 The application in the application layer 31 shown, for example, the above-mentioned AOD application 311. For ease of drawing, Figure 8 The HWC in can be used to represent Figure 3 The HWC module 341 in the hardware abstraction layer 34 shown, FP_HAL can be used to represent Figure 3 The FP_HAL module 342 in the hardware abstraction layer 34 shown, the LCD HAL can be used to represent Figure 3 The LCD HAL module 343 in the hardware abstraction layer 34 is shown.

[0195] First, the touch device of the electronic device can detect a touch operation acting on the touch device, such as Figure 1 In the application scenario shown, the touch device of the electronic device can detect the touch operation of the user (actor) on the fingerprint unlocking area in the display screen (touch device). It should be noted that Figure 8 The drawing and explanation are made by taking the setting of a touch device on a display screen as an example. The display screen may be a display screen with a touch function, such as a touch screen or a touch control screen.

[0196] (1) In response to the above touch operation, the touch device (display screen) may send a hardware interrupt corresponding to the touch operation to the kernel layer, specifically to the TP driver of the kernel layer.

[0197] After the TP driver receives the hardware interrupt, (2) the TP driver in the kernel layer can generate a fingerprint unlock event (fingerprint area event) and send the fingerprint unlock event to the FP driver. The fingerprint unlock event can also be used to instruct the FP driver to continue to notify other modules. For example, the FP driver can notify the FP_HAL module of the hardware abstraction layer (HAL) and send a power-on instruction (such as the power-on 11 instruction) to the LCD driver.

[0198] After the FP driver receives the fingerprint unlock event sent by the TP driver, (3) the kernel layer FPdriver can send a fingerprint unlock event to the LCD driver. The fingerprint unlock event can be used to instruct the LCD driver to trigger the display screen to power on, that is, to send a power-on command to the LCD driver. The fingerprint unlock event can also instruct the LCD driver to continue to notify other modules, for example, the LCD driver can notify the LCD HAL module of the hardware abstraction layer.

[0199] It should be noted that in order to improve the success rate of the LCD driver triggering the display screen to power on, in the embodiment of the present application, the complete link of the TP driver sending the power-on instruction to the LCD driver through the FP driver, LCD driver, LCD HAL module and HWC module is drawn and described as an example.

[0200] When the FP driver sends a fingerprint unlocking event (notification) to the LCD driver, the FP driver can also trigger a notification to the upper layer, that is, (4) the FP driver of the kernel layer can send the fingerprint unlocking event to the hardware abstraction layer, specifically to the FP_HAL module of the hardware abstraction layer, so that the FP_HAL module triggers a notification to other modules. It can be understood that steps (3) and (4) can be performed simultaneously.

[0201] After the LCD driver receives the fingerprint unlocking event (notification) sent by the FP driver, (5) the LCD driver can trigger the notification hardware abstraction layer, specifically, the LCD HAL of the notification hardware abstraction layer, so that the LCD HAL module triggers to send a power-on instruction to the LCD driver, wherein the LCD HAL can perform logical processing and further send a power-on instruction to the LCD driver, such as sending a parameter obtained by the LCD HAL processing to the HWC module, so that the HWC module sends a power-on instruction to the LCD driver.

[0202] After the FP_HAL module 342 receives the notification from the FP driver, (6) the FP_HAL module of the hardware abstraction layer can perform logical processing. For example, the FP_HAL module can trigger the notification of the fingerprint unlocking event to the upper layer, such as notifying the application in the application layer. (7) The FP_HAL module of the hardware abstraction layer can send the fingerprint unlocking event to the local service layer (native). (8) The local service layer can send the fingerprint unlocking event to the application framework layer (FW). Furthermore, after the application framework layer receives the notification from the local service layer, (9) the application framework layer can send the fingerprint unlocking event to the application layer. Thus, the fingerprint unlocking event is transmitted from the FP driver, through the hardware abstraction layer, the local service layer, and the application framework layer to the application in the application layer.

[0203] Among them, the specific implementation method of steps (6) to (9) is the same as Figure 6 The specific implementation methods of steps (5) to (8) are the same, please refer to the above Figure 6 The description of steps (5) to (8) will not be repeated here.

[0204] In the process of FPdriver notifying the AOD application through the FP_HAL module, the local service layer, and the application framework layer, after the LCD HAL receives the notification sent by the LCD driver, (10) the LCD HAL of the hardware abstraction layer can send a fingerprint unlocking event to the HWC module, that is, notify the HWC module to send a power-on instruction to the LCD driver. Furthermore, (11) the HWC module of the hardware abstraction layer can perform logical processing. Trigger sending a power-on instruction to the LCD driver. (12) The HWC module of the hardware abstraction layer can send a power-on instruction to the LCD driver, that is, the HWC module can notify the LCD driver to trigger the display screen to power on.

[0205] After the LCD driver receives the power-on instruction sent by the TP driver through the FP driver, the LCD driver, the LCD HAL module and the HWC module, (13) the LCD driver of the kernel layer can execute the power-on instruction, such as executing the power-on 11 instruction, such as executing the function related to the power-on 11 instruction, etc. After the LCD driver completes the execution, (14) the LCD driver of the kernel layer can send the power-on instruction (such as the power-on 11 instruction) to the display screen. The power-on instruction can carry the relevant parameters obtained by the LCD driver executing the power-on instruction to trigger the display screen to power on.

[0206] After the display screen receives the power-on command sent by the LCD driver, (15) the display screen can execute the power-on command, that is, the display screen is powered on.

[0207] After the application in the application layer receives the notification from the application framework layer, (16) the application layer can issue a power-on instruction. (17) The PMS module of the application framework layer can further issue the power-on instruction to the local service layer. (18) The SF module of the local service layer can also further issue a power-on instruction to the hardware abstraction layer. (19) The HWC module of the hardware abstraction layer can further issue a power-on instruction to the LCD driver of the kernel layer. The specific implementation of steps (16) to (19) is the same as Figure 4 The specific implementation methods of steps (13) to (17) except step (15) are the same, and can be referred to above. Figure 4 The description of steps (13) to (17) except step (15) will not be repeated here.

[0208] It should be noted that when the LCD driver receives the power-on command, the display screen may not have completed power-on. If the display screen has not completed power-on, it will be delayed. It should be noted that if the display screen has completed power-on before the step is completed, there is no need to delay, and the delay process does not exist. Figure 8 The delay only exists if the display screen is not powered on before step (19) is completed.

[0209] After the display screen is powered on, (20) the display screen can notify the LCD driver that the power-on is completed. After receiving the notification, (21) the LCD driver in the core layer can send the parameters carried by the power-on instruction to the display screen.

[0210] (22) The display screen can be initialized based on the parameters. (23) The display screen can notify the LCD driver that the initialization has been completed, that is, it notifies the LCD driver that the display screen has been successfully initialized. (24) The LCD driver of the kernel layer can return the power-on command. (25) The HWC module of the hardware abstraction layer can further notify the local service layer. (26) The LCD driver of the kernel layer can notify the FP_HAL module to issue a fingerprint highlighting command. (27) The FP_HAL module of the hardware abstraction layer can send a fingerprint highlighting command to the LCD driver of the kernel layer. (28) The LCD driver of the kernel layer can execute the fingerprint highlighting command. (29) The LCD driver of the kernel layer can send a fingerprint highlighting command to the display screen. (30) The display screen can highlight the fingerprint unlocking area based on the fingerprint highlighting command. (31) The display screen can notify the LCD driver of the kernel layer that it has been highlighted, that is, it notifies the LCD driver that the display screen has been successfully highlighted. After the LCD driver receives the notification sent by the display screen, (32) the LCD driver of the kernel layer can notify the hardware abstraction layer that the display screen has been highlighted. (33) The FP_HAL module of the hardware abstraction layer can send a capture instruction to the LCD driver of the kernel layer. (34) The LCD driver of the kernel layer can send the capture instruction to the display screen. (35) The display screen can capture the fingerprint image corresponding to the touch operation input by the user. (36) The display screen can notify the LCD driver that the capture is completed. (37) The LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the capture. (38) The FP_HAL module of the hardware abstraction layer can send a stop (disable) capture instruction to the LCD driver (disable the capture instruction). (39) The LCD driver of the kernel layer can send the stop capture instruction to the display screen. After the display screen receives the stop capture instruction, (40) the display screen can stop capturing fingerprint images. (41) The display screen can notify the LCD driver that the capture has stopped.

[0211] Among them, the specific implementation method of steps (21) to (41) is the same as Figure 4 The specific implementation methods of steps (18) to (38) are the same, and can be found in the above Figure 4 The description of steps (18) to (38) will not be repeated here.

[0212] It should be noted that Figure 8 In the figure, the sending / transmission of events, data, etc. from the bottom layer to the upper layer (from right to left) is represented by a realization arrow, and the sending of data / instructions, etc. from the upper layer to the bottom layer (from left to right) is represented by a dotted arrow.

[0213] Next, combine Figure 9-10 The specific process of implementing screen-off fingerprint unlocking in another electronic device provided in an embodiment of the present application is exemplified.

[0214] Please also read Fig. 9 , Fig. 9 1 is a schematic diagram of software interaction of another electronic device provided in an embodiment of the present application. Fig. 9 As shown, the software system of the electronic device may include an application layer 31, an application framework layer 32, a local service layer 33, a hardware abstraction layer 34 and a kernel layer 35. Fig. 9 The functions of each layer and the modules included can be found in Figure 3 The description of the corresponding software architecture will not be repeated here.

[0215] When the electronic device is in the screen-off state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Fig. 9 The software interaction process may include:

[0216] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer.

[0217] After receiving the hardware interrupt from the touch device 361 , the TP driver 351 may generate a corresponding event, that is, a fingerprint unlocking event, which may also be referred to as a fingerprint area event.

[0218] In some embodiments, after generating the fingerprint unlocking event, TP driver351 can send a power-on instruction to LCD driver353 through FPdriver352, FP_HAL module 342, LCD HAL module 343 and HWC module 341. The power-on instruction can be, for example, a power-on 11 instruction (11 is the power-on instruction code) to instruct the display screen 362 to power on. Then, LCD driver353 can first trigger the display screen 362 to power on. It should be noted that LCD driver353 can be directly notified to power on through FP_HAL module 342, but LCD driver353 may fail to trigger the display screen 362 to power on when LCD driver353 is directly notified to power on through FP_HAL module 342. This is because the link for directly notifying LCDdriver353 to power on through FP_HAL module 342 is incomplete. Therefore, the possibility of LCD driver353 triggering the display screen 362 to power on successfully can be improved by completing the link.

[0219] In the embodiment of the present application, after generating the fingerprint unlocking event, the TP driver 351 can send a power-on instruction to the LCD driver 353 through the FP driver 352, the FP_HAL module 342, the LCD HAL module 343 and the HWC module 341. Specifically, the TP driver 351 notifies the FP driver 352, and then the FP driver 352 notifies the FP_HAL module 342, the FP_HAL module 342 can notify the LCD HAL module 343, and then the LCD HAL module 343 notifies the HWC module 341 of the fingerprint unlocking event, and then the HWC module 341 can issue a power-on instruction to the LCD driver 353. In this process, the power-on instruction includes the link issued by the HWC module 341 to the LCD driver 353, which improves the integrity of the link and can increase the possibility of the LCD driver 353 triggering the display screen 362 to power on successfully.

[0220] Furthermore, LCD driver 353 may first execute the power-on instruction, for example, execute functions related to the power-on instruction, etc. After LCD driver 353 completes the execution, the power-on instruction may be sent to display screen 362 to trigger the display screen 362 to power on, wherein the power-on instruction sent by LCD driver 353 to display screen 362 also carries relevant parameters obtained by LCD driver 353 executing the power-on instruction.

[0221] After receiving the power-on instruction, the display screen 362 can execute the power-on instruction, that is, the display screen 362 can be powered on based on the relevant parameters sent by the LCD driver 353. After the power-on is completed, the display screen 362 can notify the LCD driver 353 that the power-on is completed, that is, the LCD driver 353 is notified that the display screen 362 has been successfully powered on. After receiving the notification, the LCD driver 353 can wait for further instructions sent by the upper layer.

[0222] It should be noted that the link in which TP driver 351 triggers the sending of a power-on command to LCD driver 353 partially overlaps with the link in which TP driver 351 triggers the reporting of a fingerprint unlocking event. In the overlapping links, it can be understood that TP driver 351 simultaneously triggers the reporting event and sends a power-on command to LCD driver 353. Specifically, TP driver 351 sends a fingerprint unlocking event to FP driver 352, and the fingerprint unlocking event is used to instruct FP driver 352 to continue reporting the fingerprint unlocking event and further send a power-on command to LCD driver 353. Furthermore, FP driver 352 sends a fingerprint unlocking event to FP_HAL module 342 to continue reporting the fingerprint unlocking event, and further sends a power-on command to LCD driver 353.

[0223] in, Fig. 9 The specific implementation methods of process 2 and process 3 are the same as Figure 3 The specific implementation methods of process 2 and process 3 are the same, please refer to the above Figure 3 The description of process 2 in the above will not be repeated here.

[0224] It should be noted that Fig. 9 The circle mark ① in the figure shows part of the process 1 above. Fig. 9 The circle mark ② in the figure shows part of the process 2 above. Fig. 9 The circle mark ③ in the figure shows a part of the process 3. There are overlapping links in the process 1 and the process 2 (TP driver 351 sends a fingerprint unlocking event / power-on command to FP driver 352, and FP driver 352 sends a fingerprint unlocking event / power-on command to FP_HAL module 342).

[0225] Please also read Fig.10 , Fig.10 This is a timing diagram of fingerprint unlocking of an electronic device with the screen turned off provided by an embodiment of the present application. Fig.10 As shown, the application (APP) can be used to represent Fig. 9The application in the application layer 31 shown, for example, the above-mentioned AOD application 311. For ease of drawing, Fig.10 The HWC in can be used to represent Figure 3 The HWC module 341 in the hardware abstraction layer 34 shown, FP_HAL can be used to represent Figure 3 The FP_HAL module 342 in the hardware abstraction layer 34 shown, LCDHAL can be used to represent Figure 3 The LCD HAL module 343 in the hardware abstraction layer 34 is shown.

[0226] First, the touch device of the electronic device can detect a touch operation acting on the touch device, such as Figure 1 In the application scenario shown, the touch device of the electronic device can detect the touch operation of the user (actor) on the fingerprint unlocking area in the display screen (touch device). It should be noted that Fig.10 The drawing and explanation are made by taking the setting of a touch device on a display screen as an example. The display screen may be a display screen with a touch function, such as a touch screen or a touch control screen.

[0227] (1) In response to the above touch operation, the touch device (display screen) may send a hardware interrupt corresponding to the touch operation to the kernel layer, specifically to the TP driver of the kernel layer.

[0228] After the TP driver receives the hardware interrupt, (2) the TP driver in the kernel layer can generate a fingerprint unlock event (fingerprint area event) and send the fingerprint unlock event to the FP driver. The fingerprint unlock event can also be used to instruct the FP driver to continue to notify other modules to send a power-on command (such as a power-on 11 command) to the LCD driver. For example, the FP driver can notify the FP_HAL module of the hardware abstraction layer (HAL).

[0229] After the FP driver receives the fingerprint unlock event (power-on command) sent by the TP driver, (3) the FP driver of the kernel layer can trigger the report to the upper layer. Then (4) the FP driver of the kernel layer can send the fingerprint unlock event to the hardware abstraction layer. Specifically, it can be sent to the FP_HAL module of the hardware abstraction layer. The fingerprint unlock event can be used to instruct the FP_HAL module to further send a power-on command to the LCD driver, that is, to instruct the FP_HAL module to notify the LCD HAL module and report to the upper layer at the same time.

[0230] After the FP_HAL module 342 receives the notification from the FP driver, (5) the FP_HAL module of the hardware abstraction layer can perform logic processing. Specifically, the FP_HAL module can directly notify the LCD HAL to send a power-on instruction to the LCD driver to further trigger the display screen to power on. The FP_HAL module also triggers the notification of the fingerprint unlocking event to the upper layer, such as notifying the application in the application layer.

[0231] (6) The FP_HAL module of the hardware abstraction layer can send the fingerprint unlocking event to the local service layer (native). (7) The local service layer can send the fingerprint unlocking event to the application framework layer (FW). (8) The application framework layer can send the fingerprint unlocking event to the application layer, and specifically can be transmitted to the application in the application layer, such as the AOD application, that is, the application framework layer can notify the application layer. Thus, the fingerprint unlocking event is transmitted from FPdriver to the application in the application layer through the hardware abstraction layer, the local service layer, and the application framework layer.

[0232] Among them, the specific implementation method of steps (5) to (8) is the same as Figure 6 The specific implementation methods of steps (5) to (8) are the same, please refer to the above Figure 6 The description of steps (5) to (8) will not be repeated here.

[0233] In the process of FP driver notifying the AOD application through the FP_HAL module, the local service layer, and the application framework layer, (9) the LCD HAL module of the hardware abstraction layer can notify the HWC module, that is, the LCD HAL module can send a fingerprint unlocking event to the HWC module. The fingerprint unlocking event can be used to instruct the HWC module to send a power-on command to the LCD driver, and instruct the LCD driver to trigger the display screen to power on.

[0234] After the HWC module receives the notification from the LCD HAL, (10) the HWC module can perform logic processing and trigger the sending of a power-on instruction to the LCD driver, that is, notifying the LCD driver to power on. Furthermore, (11) the HWC module of the hardware abstraction layer can send a power-on instruction to the LCD driver and notify the LCD driver to trigger the display to power on.

[0235] After the LCD driver receives the power-on instruction sent by the TP driver through the FP driver, the FP_HAL module, the LCD HAL module, and the HWC module, (12) the LCD driver of the kernel layer can first execute the power-on instruction, such as executing the power-on 11 instruction, such as executing the function related to the power-on 11 instruction, etc. After the LCD driver completes the execution, (13) the LCD driver of the kernel layer can send the power-on instruction (such as the power-on 11 instruction) to the display screen. The power-on instruction can carry the relevant parameters obtained by the LCD driver executing the power-on instruction to trigger the display screen to power on. After the display screen receives the power-on instruction sent by the LCD driver, (14) the display screen can execute the power-on instruction, that is, the display screen is powered on.

[0236] After the application in the application layer receives the notification from the application framework layer, (15) the application layer can issue a power-on instruction. (16) The PMS module of the application framework layer can further issue the power-on instruction to the local service layer. (17) The SF module of the local service layer can also further issue a power-on instruction to the hardware abstraction layer, for example, it can specifically issue a power-on 11 instruction to the HWC module of the hardware abstraction layer. (18) The HWC module of the hardware abstraction layer can further issue a power-on instruction to the LCD driver of the kernel layer.

[0237] Among them, the specific implementation method of steps (15) to (18) is the same as Figure 4 The specific implementation methods of steps (13) to (17) except step (15) are the same, and can be referred to above. Figure 4 The description of steps (13) to (17) except step (15) will not be repeated here.

[0238] It should be noted that when the LCD driver receives the power-on command, the display screen may not have completed power-on. If the display screen has not completed power-on, it will be delayed. It should be noted that if the display screen has completed power-on before the step is completed, there is no need to delay, and the delay process does not exist. Fig.10 The delay only exists if the display screen is not powered on before step (18) is completed.

[0239] After the display screen is powered on, (19) the display screen can notify the LCD driver that the power-on is complete. After receiving the notification, (20) the LCD driver in the core layer can send the parameters carried by the power-on instruction to the display screen.

[0240] (21) The display screen can be initialized based on the parameters. (22) The display screen can notify the LCD driver that the initialization has been completed, that is, it notifies the LCD driver that the display screen has been successfully initialized. (23) The LCD driver of the kernel layer can return the power-on command. (24) The HWC module of the hardware abstraction layer can further notify the local service layer. (25) The LCD driver of the kernel layer can notify the FP_HAL module to issue a fingerprint highlighting command. (26) The FP_HAL module of the hardware abstraction layer can send a fingerprint highlighting command to the LCD driver of the kernel layer. (27) The LCD driver of the kernel layer can execute the fingerprint highlighting command. (28) The LCD driver of the kernel layer can send a fingerprint highlighting command to the display screen. (29) The display screen can highlight the fingerprint unlocking area based on the fingerprint highlighting command. (30) The display screen can notify the LCD driver of the kernel layer that it has been highlighted, that is, it notifies the LCD driver that the display screen has been successfully highlighted. After the LCD driver receives the notification sent by the display screen, (31) the LCD driver of the kernel layer can notify the hardware abstraction layer that the display screen has been highlighted. (32) The FP_HAL module of the hardware abstraction layer can send an image acquisition instruction to the LCD driver of the kernel layer. (33) The LCD driver of the kernel layer can send the image acquisition instruction to the display screen. (34) The display screen can acquire the fingerprint image corresponding to the touch operation input by the user. (35) The display screen can notify the LCD driver that the image acquisition has been completed. (36) The LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the image acquisition. (37) The FP_HAL module of the hardware abstraction layer can send a stop (disable) image acquisition instruction to the LCD driver (disable the image acquisition instruction). (38) The LCD driver of the kernel layer can send the stop image acquisition instruction to the display screen. After the display screen receives the stop image acquisition instruction, (39) the display screen can stop acquiring fingerprint images. (40) The display screen can notify the LCD driver that the image acquisition has stopped.

[0241] Among them, the specific implementation method of steps (20) to (40) is the same as Figure 4 The specific implementation methods of steps (18) to (38) are the same, and can be found in the above Figure 4 The description of steps (18) to (38) will not be repeated here.

[0242] It should be noted that Fig.10 In the figure, the sending / transmission of events, data, etc. from the bottom layer to the upper layer (from right to left) is represented by a realization arrow, and the sending of data / instructions, etc. from the upper layer to the bottom layer (from left to right) is represented by a dotted arrow.

[0243] Please also read Fig.11 , Fig.11 This is an optimized schematic diagram of the off-screen fingerprint unlocking solution provided in the embodiment of the present application. Fig.11 As shown, the electronic device is in the screen-off state and locked state before receiving the fingerprint unlocking operation.

[0244] In the scheme before the electronic device is optimized, when the touch device of the electronic device detects a touch operation, the TPdriver can report a hardware interrupt and report the fingerprint unlocking event corresponding to the touch operation through the FP driver, thereby triggering the upper layer to send a power-on instruction, such as the power-on 11 instruction. Among them, since the logical processing performed by the PMS module when sending the power-on instruction takes a long time, the duration of the process of reporting the event and sending the power-on instruction can be, for example, 200 milliseconds (ms). After the LCD driver receives the power-on instruction, it can trigger the display screen to power on and initialize. The display screen power-on and initialization takes, for example, 120ms. The power-on and initialization duration is, for example, 200 milliseconds. Fig.11 As shown in the light grey box. LCDdriver can report that the display has completed power-on and initialization, thereby triggering the upper layer to send fingerprint highlighting instructions, such as 29 instructions and LHBM instructions ( Fig.11 Take fingerprint 29 command as an example for drawing). Then, the LCD driver can execute the fingerprint highlight command to trigger the display to highlight the fingerprint unlocking area. The duration of the highlight display is, for example, Fig.11 As shown in the dark grey box. After the fingerprint highlighting command is reported to the display screen, the image acquisition operation is triggered.

[0245] In the optimized solution, after receiving a touch operation, the touch device of the electronic device can send a power-on command to the LCD driver while reporting the fingerprint unlocking event to trigger the upper layer to issue a command. This is equivalent to the LCD driver triggering the display screen to power on, and reporting the fingerprint unlocking event and triggering the upper layer to issue a command at the same time. For example, Fig.11 The medium gray box includes the display screen power-on in the "report event, issue command" time period. Then, when the power-on command is issued to the LCD driver, the LCD driver can trigger the display screen that has completed power-on to initialize. The initialization time is, for example, Fig.11 Furthermore, the LCD driver can directly receive fingerprint highlighting commands issued by the FP_HAL module, such as 29 commands and LHBM commands, and trigger the highlighting of the fingerprint unlocking area. The duration of the highlighting is, for example, Fig.11After the fingerprint highlighting instruction is reported to the display screen, the image acquisition operation is triggered. It can be seen that the solution provided by the embodiment of the present application can reduce the time consumption of fingerprint unlocking (such as Fig.11 Optimized fingerprint unlocking time).

[0246] In an embodiment of the present application, when the electronic device is in a locked state and receives a touch operation when the electronic device is in a screen-off state, the TP driver of the kernel layer can execute the reported process while notifying the LCD driver to power on. On the one hand, by decoupling the power-on instruction and the fingerprint highlight instruction, that is, executing the power-on instruction and the fingerprint highlight instruction separately, the TP driver first sends the power-on instruction to the LCD driver, which can trigger the display screen to power on in advance, so that the display screen can directly perform the initialization parameter configuration after the power-on is completed, which is conducive to saving the time of fingerprint unlocking; on the other hand, the process of directly or indirectly notifying the LCD driver to power on through the TP driver is executed at the same time as the process of reporting and sending the power-on, which can help reduce the time of the delay part of the power-on of the display screen, and directly sending the power-on instruction at the kernel layer, compared with sending the power-on instruction across layers, shortens the link involved in the process of sending the power-on instruction, takes less time, and can also help improve the efficiency of fingerprint unlocking, and achieve the performance optimization of screen-off fingerprint unlocking.

[0247] Next, combine Figure 12-13 The specific process of implementing fingerprint unlocking with a bright screen in an electronic device provided in an embodiment of the present application is exemplified.

[0248] Please also read Fig.12 , Fig.12 FIG. 1 is another software interaction diagram of an electronic device provided in an embodiment of the present application. Fig.12 As shown, the software system of the electronic device may include an application layer 31, an application framework layer 32, a local service layer 33, a hardware abstraction layer 34 and a kernel layer 35. Fig.12 The functions of each layer and the modules included can be found in Figure 3 The description of the corresponding software architecture will not be repeated here.

[0249] When the electronic device is in the screen-on state and detects a touch operation on the fingerprint unlocking area, the electronic device responds to the touch operation and executes a Fig.12 The software interaction process may include:

[0250] Process 1: After the touch device 361 of the hardware layer 36 detects a touch operation acting on the touch device 361, for example, the touch device 361 can be set in the display screen 362, and the area where it is set can be called a fingerprint unlocking area. After the touch device 361 (display screen 362) detects the user's touch operation acting on the fingerprint unlocking area, the touch device 361 can upload the hardware interrupt corresponding to the touch operation to the kernel layer 35, specifically to the TP driver 351 of the kernel layer 35.

[0251] After receiving the hardware interrupt from the touch device 361, the TP driver 351 can generate a corresponding event, that is, generate a fingerprint unlock event, which can also be called a fingerprint area event. Then the TP driver 351 can report the fingerprint unlock event, that is, the TP driver 351 can be uploaded to the FP_HAL module 342 of the hardware abstraction layer 34 through the FP driver 352, and the FP_HAL module 342 can issue a fingerprint highlight instruction in response to the fingerprint unlock event.

[0252] Specifically, the FP_HAL module 342 can directly send a fingerprint highlight instruction to the LCD driver 353 of the kernel layer 35, such as sending a 29 instruction and a LHBM instruction, so that the LCD driver 353 triggers the display screen 362 to highlight the display. Specifically, the LCD driver 353 can directly send the fingerprint highlight instruction to the display screen 362, and the display screen 362 can highlight the fingerprint unlocking area in response to the fingerprint highlight instruction, such as displaying a bright spot in the fingerprint unlocking area of ​​the display screen 362.

[0253] Optionally, LCD driver 353 may also execute functions related to the fingerprint highlight instruction, etc. After LCD driver 353 completes the execution, the fingerprint highlight instruction may be sent to display screen 362. The fingerprint highlight instruction includes parameters obtained by LCD driver 353 executing functions related to the fingerprint highlight instruction.

[0254] After the display screen 362 highlights the fingerprint unlocking area, it can notify the LCD driver 353 that it has been highlighted. Then, the LCD driver 353 can notify the FP_HAL module 342 that the display screen 362 has completed the highlighting, and can notify the FP_HAL module 342 to trigger the image acquisition operation.

[0255] Optionally, the FP_HAL module 342 sends the fingerprint highlight instruction to the LCD driver 353 of the kernel layer 35 , which may be that the FP_HAL module 342 sends the fingerprint highlight instruction to the LCD driver 353 through the HWC module 341 . Fig.12 That is, the FP_HAL module 342 first notifies the HWC module 341 to send a fingerprint highlighting instruction to the LCD driver 353, and then the HWC module sends a fingerprint highlighting instruction to the LCD driver 353.

[0256] Optionally, when the display screen 362 performs highlight display in the fingerprint unlocking area, the LCD driver 353 may also trigger the display screen 362 to display part or all of the fingerprint unlocking controls, which may include, for example, a fingerprint spot control, a water ripple control, and the like.

[0257] Furthermore, before LCD driver 353 notifies FP_HAL module 342 that display screen 362 has completed highlight display, LCD driver 353 may also determine (check) whether display screen 362 is powered on and highlighted. Only after determining that display screen 362 has completed power on and highlighted display, does it notify FP_HAL module 842 that display screen has completed highlight display.

[0258] Process 2: After the FP_HAL module 342 receives the notification sent by the LCD driver 353, the FP_HAL module 342 triggers the image acquisition operation. Specifically, the image acquisition instruction can be directly sent to the LCD driver 352. The image acquisition instruction is used to trigger the image acquisition operation, that is, trigger the acquisition of the fingerprint data input by the user.

[0259] After receiving the image acquisition instruction, LCD driver 352 can directly send the image acquisition instruction to display screen 362, and LCD driver 353 can also execute functions related to the image acquisition instruction. After LCD driver 353 completes the execution, the image acquisition instruction can be sent to display screen 362. The image acquisition instruction includes parameters obtained by LCD driver 353 executing functions related to the image acquisition instruction. After receiving the image acquisition instruction, display screen 362 can collect the fingerprint image corresponding to the touch operation input by the user, and after the collection is completed, LCD driver 353 can be notified that the image acquisition has been completed.

[0260] After LCD driver 353 receives the notification of the completion of image acquisition sent by display screen 362, LCD driver 353 can notify FP_HAL module 342 that display screen 362 has completed image acquisition. After FP_HAL module 342 receives the notification sent by LCD driver 353, FP_HAL module 342 can send a stop image acquisition instruction to LCD driver 352. The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display screen 362 to stop acquiring fingerprint images, and can also be used to trigger the display screen 362 to stop highlighting fingerprints. Furthermore, after receiving the stop image acquisition instruction, LCD driver 352 can directly send the stop image acquisition instruction to display screen 362. LCD driver 353 can also execute functions related to the stop image acquisition instruction, and send the stop image acquisition instruction to display screen 362. The image acquisition instruction includes parameters obtained by LCD driver 353 executing functions related to the stop image acquisition instruction.

[0261] After receiving the stop image acquisition instruction, the display screen 362 can stop acquiring fingerprint images and notify LCD driver 353 that image acquisition has stopped. Furthermore, LCD driver 353 can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to complete fingerprint unlocking in the off-screen state.

[0262] It should be noted that Fig.12 The circle mark ① in the figure shows part of the process 1 above. Fig.12 The circle mark ② in the figure shows part of the process 2 above. Fig.12 The middle circle mark ① shows the above process of triggering the display screen 362 fingerprint highlighting. After the display screen 362 fingerprint is highlighted, the process of notifying the LCD driver 353 that the highlighting display has been completed is not in Fig.12 Shown.

[0263] Please also read Fig.13 , Fig.13 1 is a timing diagram of a fingerprint unlocking method with a bright screen provided in an embodiment of the present application. Fig.13 As shown, first, the LCD driver can determine (check) whether the display screen has been powered on (and initialized), and after determining that the display screen has been powered on, the touch device of the electronic device can detect the touch operation. Among them, the LCD driver determines whether the display screen is powered on and initialized, which can be the LCD driver determining whether the display screen displays a user interface, such as displaying a lock screen interface.

[0264] When the user inputs a touch operation, the touch device of the electronic device can detect the touch operation input by the user, and at this time, the display screen of the electronic device has been powered on and initialized. (1) In response to the above touch operation, the touch device (display screen) can transmit the hardware interrupt corresponding to the touch operation to the TP driver of the kernel layer. After the TP driver receives the hardware interrupt, (2) the TP driver of the kernel layer can generate the fingerprint unlocking event (fingerprint area event) and send the fingerprint unlocking event (notification) to the FP driver.

[0265] After the FP driver receives the fingerprint unlocking event sent by the TP driver, (3) the FPdriver of the kernel layer can send the fingerprint unlocking event to the hardware abstraction layer (HAL), specifically to the FP_HAL module of the hardware abstraction layer, to notify the FP_HAL module to issue a fingerprint highlighting instruction.

[0266] Then, after the FP_HAL module receives the fingerprint unlocking event (notification) sent by the FP driver, (4) the FP_HAL module of the hardware abstraction layer (HAL) can send a fingerprint highlighting instruction to the LCD driver of the kernel layer, such as issuing 29 instructions and LHBM instructions. Among them, the FP_HAL module can first notify the HWC module, and then the HWC module sends the fingerprint highlighting instruction to the LCD driver 353.

[0267] Optionally, the FP_HAL module may continue to report the fingerprint unlocking event, for example, by reporting it to an application in the application layer (such as an off-screen display application) through the local service layer and the application framework layer.

[0268] Optionally, the FP_HAL module may first send a fingerprint highlight command to the HWC module, and then the HWC module sends a fingerprint highlight command to LCDdriver353.

[0269] After the LCD driver receives the fingerprint highlight instruction sent from the FP_HAL module, (5) the LCD driver of the kernel layer can execute the fingerprint highlight instruction, such as the LCD driver can execute functions related to the fingerprint highlight instruction. After the execution is completed, (6) the LCD driver of the kernel layer can send a fingerprint highlight instruction to the display screen to trigger the display screen to highlight the fingerprint unlocking area. Among them, the fingerprint highlight instruction sent by the LCD driver to the display screen can carry the parameters obtained by the LCD driver executing the function. (7) The display screen can respond to the fingerprint highlight instruction and highlight the fingerprint unlocking area, for example, display a bright spot in the fingerprint unlocking area of ​​the display screen. Furthermore, (8) the display screen can notify the LCD driver of the kernel layer that it has been highlighted, that is, notify the LCD driver that the display screen has been successfully highlighted.

[0270] After the LCD driver receives the notification, (9) the LCD driver of the kernel layer can notify the hardware abstraction layer that the display screen has completed highlight display. Specifically, it can directly notify the FP_HAL module that the display screen has completed highlight display. Among them, when the LCD driver notifies the hardware abstraction layer that the display screen has completed highlight display, it can be understood that the LCD driver notifies the FP_HAL module to trigger the image acquisition operation.

[0271] Optionally, the LCD driver can notify the FP_HAL module through the HWC module that the display screen has completed highlighting, that is, the LCD driver first notifies the HWC module that the display screen has completed highlighting, and then the HWC module notifies the FP_HAL module that the display screen has completed highlighting. It should be noted that this method Fig.13 Not shown.

[0272] Optionally, before notifying the FP_HAL module that the display screen has completed highlight display, the LCD driver may also determine (check) whether the display screen is powered on and highlighted, and only after determining that the display screen has completed power-on and highlighted display, notify the FP_HAL module that the display screen has completed highlight display.

[0273] After the FP_HAL module receives the notification, (10) the FP_HAL module of the hardware abstraction layer can trigger the execution of the image acquisition operation, that is, send an image acquisition instruction to the LCD driver of the kernel layer, and the image acquisition instruction is used to trigger the acquisition of the fingerprint image input by the user.

[0274] After the LCD driver receives the image acquisition instruction, (11) the LCD driver of the kernel layer can send the image acquisition instruction to the display screen. Optionally, the LCD driver can also execute the function related to the image acquisition instruction, and carry the parameters obtained by the execution result in the image acquisition instruction and send it to the display screen. It should be noted that this method is Fig.13 Not shown in the figure.

[0275] Then, (12) the display screen can collect the fingerprint image corresponding to the touch operation input by the user. After the collection is completed, (13) the display screen notifies the LCD driver that the image collection has been completed. (14) The LCD driver of the kernel layer can notify the FP_HAL module that the display screen has completed the image collection.

[0276] After the FP_HAL module receives the notification, (15) the FP_HAL module of the hardware abstraction layer can send a stop (disable) image acquisition instruction to the LCD driver (disable the image acquisition instruction). The stop image acquisition instruction is used to trigger the stop image acquisition operation, that is, to trigger the display to stop collecting fingerprint images, and can also be used to trigger the display to stop highlighting fingerprints.

[0277] After the LCD driver receives the stop acquisition instruction, (16) the LCD driver of the core layer can send the stop acquisition instruction to the display screen. After the display screen receives the stop acquisition instruction, (17) the display screen can stop acquiring fingerprint images. Furthermore, (18) the display screen can notify the LCD driver that the acquisition has stopped.

[0278] Optionally, the LCD driver can also execute related functions based on the stop acquisition instruction issued by the FP_HAL module, and send the obtained related parameters to the display. Fig.13 Not shown in the figure.

[0279] Furthermore, the LCD driver can continue to send the notification to other modules to trigger further control, such as identity authentication based on the fingerprint image, so as to complete fingerprint unlocking in the bright screen state.

[0280] Please also read Fig.14 , Fig.14 Schematic diagram of the optimized unlocking solution of the bright screen fingerprint provided in the embodiment of the present application. Fig.14As shown, the electronic device is in a bright screen state before receiving the fingerprint unlocking operation, that is, the display screen has completed power-on and initialization parameter configuration. At this time, the electronic device is in a locked state. In the scheme before the electronic device is optimized, when the touch device of the electronic device detects a touch operation, it can report the fingerprint unlocking event and trigger the upper layer to send fingerprint highlighting instructions, such as 29 instructions and LHBM instructions ( Fig.14 Take fingerprint highlight instruction 29 as an example for drawing). Then, the LCD driver can trigger the highlight display of the fingerprint unlocking area, and the duration of the highlight display is, for example, Fig.14 After the fingerprint highlighting command is reported to the display screen, the image acquisition operation is triggered.

[0281] In the optimized solution of the electronic device, when the touch device of the electronic device detects a touch operation, the LCDdriver can receive the fingerprint highlight instruction sent from the FP_HAL module, such as the 29 instruction and the LHBM instruction. Compared with the need to report the fingerprint unlocking event corresponding to the fingerprint unlocking operation and then issue the fingerprint highlight instruction from the upper layer, the link involved in the issuance process of the fingerprint highlight instruction in the optimized solution is shorter, only from the kernel layer to the hardware abstraction layer, and there is no need to issue the fingerprint highlight instruction after reporting the fingerprint unlocking event, thereby saving the time spent before issuing the fingerprint highlight instruction, such as Fig.14 As shown in the optimized fingerprint unlocking time.

[0282] In the embodiment of the present application, after the electronic device receives a touch operation in the screen-on state, since the display screen of the electronic device does not need to be powered on and the parameter configuration is initialized in the screen-on state, the FP_HAL module of the hardware abstraction layer can directly send a fingerprint highlight instruction, which can shorten the time-consuming part, that is, shorten the part from the TP driver reporting to the final issuance of the fingerprint highlight instruction, so that the fingerprint unlocking time is shorter and the fingerprint unlocking efficiency is higher, achieving performance optimization of fingerprint unlocking with the screen on.

[0283] Next, combine Fig.15 The fingerprint unlocking method provided in the embodiment of the present application is exemplarily introduced. Fig.15 , Fig.15 This is a flow chart of a fingerprint unlocking method provided by an embodiment of the present application. The specific process is as follows:

[0284] Step S1501: In response to detecting a first fingerprint unlocking operation, a touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, and simultaneously sends a first event corresponding to the first fingerprint unlocking operation to a target display application of the electronic device.

[0285] In an embodiment of the present application, a fingerprint unlocking operation / touch operation received by an electronic device in a screen-off state can be referred to as a first fingerprint unlocking operation, such as a fingerprint unlocking operation received by a touch device of an electronic device, or a touch operation received by a display screen of an electronic device. The power-on processing module may include two or more of a fingerprint hardware abstraction module of an electronic device, a power management service module of an electronic device, a system image engine module of an electronic device, a hardware synthesizer module of an electronic device, a display screen hardware abstraction module of an electronic device, and a fingerprint driver of an electronic device. When the electronic device is in a screen-off state, after receiving a hardware interrupt sent by a touch device, the TP driver generates a corresponding event (fingerprint unlocking event / fingerprint area event), which can be referred to as a first event.

[0286] When the electronic device is in the screen-off state, the power-on instruction first sent to the LCD driver can be called the first power-on instruction, and the power-on instruction issued by the AOD application can be called the second power-on instruction. The parameters for initializing the display screen carried in the second power-on instruction can be called display parameters. Among them, the display parameters generated by the PMS module in response to the power-on instruction (the second power-on instruction) can be called power display parameters, for example, they may include backlight brightness parameters of the display screen, etc. The display parameters generated by the SF module in response to the power-on instruction (the second power-on instruction) can be called image display parameters, for example, they may include display data related to the content to be displayed on the display screen, etc. The display parameters generated by the HWC module in response to the power-on instruction (the second power-on instruction) can be called hardware display parameters, for example, they may include parameters of the image to be displayed, etc.

[0287] The TP driver sends the first power-on command to the display screen through the power-on processing module, which can be divided into four ways:

[0288] The first method: the power-on processing module includes an FP driver and FP_HAL; the TP driver sends a first power-on instruction to the FP driver; the FP driver sends a first power-on instruction to the FP_HAL; the FP_HAL sends a first power-on instruction to the LCD driver; the LCD driver sends a first power-on instruction to the display screen. This method can be, for example, Figure 3-Figure 4 The embodiments shown are not limited here.

[0289] It should be noted that in this way, the link for sending the first power-on command involves fewer modules and the link is relatively short, so it can help reduce the time spent on fingerprint unlocking of electronic devices with the screen turned off, thereby improving the efficiency of fingerprint unlocking to a certain extent.

[0290] The second method: the power-on processing module includes FP driver, FP_HAL module, PMS module, SF module and HWC module; TP driver sends the first power-on instruction to FP driver; FP driver sends the first power-on instruction to FP_HAL module; FP_HAL module sends the first power-on instruction to PMS module; PMS module sends the first power-on instruction to SF module; SF module sends the first power-on instruction to HWC module; HWC module sends the first power-on instruction to LCD driver; LCD driver sends the first power-on instruction to display screen. This method can be, for example Figure 5-Figure 6 The embodiments shown are not limited here.

[0291] It should be noted that in this way, the first power-on command is sent through the PMS module and the HWC module, and the link is relatively complete. Therefore, it can help reduce the possibility of failure to trigger the display screen to power on in advance. Compared with the AOD application sending the power-on command, it can also reduce the time consumption of fingerprint unlocking and improve the efficiency of fingerprint unlocking.

[0292] The third method: the power-on processing module includes FP driver, FP_HAL module, LCD HAL module and HWC module; TP driver sends the first power-on instruction to FP driver; FP driver sends the first power-on instruction to FP_HAL; FP_HAL sends the first power-on instruction to LCD HAL module; LCD HAL module sends the first power-on instruction to HWC module; HWC module sends the first power-on instruction to LCD driver; LCD driver sends the first power-on instruction to the display screen. This method can be used, for example Figure 9-10 The embodiments shown are not limited here.

[0293] The fourth method: the power-on processing module includes FP driver, FP_HAL module, LCD HAL module and HWC module; TP driver sends the first power-on instruction to FP driver; FP driver sends the first power-on instruction to display driver; LCD driver sends the first power-on instruction to LCD HAL module; LCD HAL module sends the first power-on instruction to HWC module; HWC module sends the first power-on instruction to LCD driver; LCD driver sends the first power-on instruction to display screen. This method can be used, for example Figure 7-Figure 8 The embodiments shown are not limited here.

[0294] It should be noted that in the third and fourth methods, the first power-on instruction is sent through the PMS module, LCDHAL module and HWC module, and the link is relatively complete. Therefore, it can help reduce the possibility of failure to trigger the display screen to power on in advance. Compared with the AOD application sending the power-on instruction, transmitting the power-on instruction between adjacent layers (kernel layer and hardware abstraction layer) can also reduce the time consumption of fingerprint unlocking and improve the efficiency of fingerprint unlocking.

[0295] The target display application of the electronic device may be, for example, an AOD application of the electronic device, and the touch driver of the electronic device sends a first event corresponding to the first fingerprint unlocking operation to the target display application of the electronic device, which may be, for example, Figure 3 Process 2 in the illustrated embodiment is not limited here.

[0296] Step S1502: The display screen obtains a first fingerprint highlight instruction corresponding to a first event.

[0297] In the embodiment of the present application, the fingerprint highlight instruction received when the electronic device is in the screen-off state can be called the first fingerprint highlight instruction. For example, the first fingerprint highlight instruction includes 29 and LHBM instructions. The process of the display screen obtaining the first fingerprint highlight instruction corresponding to the first event can be, for example, Figure 3 Process 2 in the illustrated embodiment is not limited here.

[0298] Step S1503: In response to the first fingerprint highlight instruction, the display screen highlights the fingerprint unlocking area.

[0299] In the embodiment of the present application, the fingerprint highlight instruction corresponding to the fingerprint unlocking operation may be used to indicate that the fingerprint unlocking area on the display screen is highlighted so as to collect the user's fingerprint image and perform identity authentication, for example, Figure 1 The fingerprint unlocking area 12 of the electronic device in (1). The display driver can control the display screen to highlight the fingerprint unlocking area, that is, the area where the user's finger touches the display screen is highlighted. Among them, the display driver can obtain the fingerprint highlighting instruction sent by the fingerprint hardware abstraction module of the hardware abstraction layer. The specific process of obtaining the fingerprint highlighting display and controlling the display screen to highlight the display can be referred to. Figure 3-Figure 10 At this time, the light highlighted on the display screen can illuminate the user's finger, so that the electronic device can collect the fingerprint image of the finger (the fingerprint image corresponding to the fingerprint unlocking operation) to further perform identity authentication operations, thereby determining whether to release the lock state of the electronic device.

[0300] Step S1504: In response to acquiring the fingerprint image corresponding to the first fingerprint unlocking operation, the electronic device performs fingerprint unlocking.

[0301] In a possible implementation, when the fingerprint image corresponding to the fingerprint unlocking operation matches the fingerprint image preset in the electronic device, the electronic device can unlock the state. For example, the electronic device can determine that the fingerprint image corresponding to the fingerprint unlocking operation matches the fingerprint image preset in the electronic device when the similarity between the fingerprint image corresponding to the fingerprint unlocking operation and the fingerprint image preset in the electronic device is greater than or equal to a set threshold. Conversely, the electronic device can determine that the fingerprint image corresponding to the fingerprint unlocking operation does not match the fingerprint image preset in the electronic device when the similarity between the fingerprint image corresponding to the fingerprint unlocking operation and the fingerprint image preset in the electronic device is less than a set threshold. Identity authentication operations can also be performed based on fingerprint images in other ways, and this application does not limit this.

[0302] In some embodiments, the electronic device can be in a locked state and a bright screen state, at which time the display screen of the electronic device is powered on, so that the electronic device can directly call the display driver to obtain the fingerprint highlight instruction corresponding to the fingerprint unlocking operation, and in response to the fingerprint highlight instruction, control the display screen to highlight, and then, when the display screen is highlighted, obtain the fingerprint image corresponding to the fingerprint unlocking operation to further unlock. Among them, the fingerprint highlight instruction received when the electronic device is in the bright screen state can be called the second fingerprint highlight instruction, for example, the second fingerprint highlight instruction and includes 29 and LHBM instructions. The display driver can obtain the fingerprint highlight instruction sent by the FP_HAL module of the hardware abstraction layer. The specific process of obtaining the fingerprint highlight display and controlling the display screen highlight display can be referred to. Figure 12-13 The corresponding description is not repeated here. The hardware abstraction layer and the kernel layer are adjacent layers, and the fingerprint highlight instruction can be transmitted through a shorter link, thereby reducing the delay of fingerprint unlocking. The fingerprint highlight instruction received when the electronic device is in the bright screen state can be called the second fingerprint highlight instruction.

[0303] In some embodiments, when the electronic device is in the screen-off state and determines that the fingerprint image corresponding to the fingerprint unlocking operation does not match the fingerprint image preset by the electronic device, the electronic device can enter the screen-on state, that is, light up the display screen, and display, for example Figure 2The lock screen interface shown in (1). Furthermore, the electronic device can receive a fingerprint unlocking operation input by a user in a bright screen state, and the fingerprint operation can be referred to as a second fingerprint unlocking operation, and a fingerprint highlighting instruction corresponding to the fingerprint unlocking operation is obtained based on the fingerprint unlocking operation. The electronic device can control the display screen to highlight the fingerprint highlighting instruction in response to the fingerprint highlighting instruction to obtain a fingerprint image corresponding to the fingerprint unlocking operation for further identity authentication. For example, the electronic device can compare the fingerprint image corresponding to the fingerprint unlocking operation with the fingerprint image preset by the electronic device, and then obtain the result of the identity authentication. Among them, in the process of obtaining the corresponding fingerprint highlighting instruction based on the fingerprint unlocking operation, the fingerprint unlocking event generated by the TP driver of the electronic device can be referred to as a second event, and the fingerprint highlighting instruction obtained can be referred to as a second fingerprint highlighting instruction.

[0304] In the embodiment of the present application, by optimizing the link for sending the display screen power-on command when the electronic device is in the screen-off state, and being able to send the trigger display screen power-on while the reporting process is executed, it can be helpful to reduce the time consumption of fingerprint unlocking, improve the efficiency of fingerprint unlocking of the electronic device with the screen off, and achieve performance optimization of fingerprint unlocking with the screen off. In addition, by optimizing the link for sending the fingerprint highlight command when the electronic device is in the screen-off state, the link involved in fingerprint unlocking is shorter and the time consumption is shorter, thereby improving the efficiency of fingerprint unlocking of the electronic device with the screen on, and achieving performance optimization of fingerprint unlocking with the screen on.

[0305] The structure of the electronic device 100 is described below. Fig.16 , Fig.16 It is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application.

[0306] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0307] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0308] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0309] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0310] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0311] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0312] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0313] In the embodiment of the present application, the display screen 194 can be powered on when triggered by the display driver, and highlight the fingerprint unlocking area. Optionally, the display screen 194 can also display a user interface when triggered by the display driver, and the user interface can include controls such as fingerprint spots, water ripples, etc. The display screen 194 of the electronic device 100 can be the above Figure 1 and Figure 2 The display screen 11 of the electronic device 100 shown may also be Figure 3 , Figure 5 , Figure 7 , Fig. 9 as well as Fig.12 Display screen 362 in hardware layer 36 of the software system is shown.

[0314] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0315] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0316] In an embodiment of the present application, the fingerprint sensor 180H can be configured under the fingerprint unlocking area of ​​the display screen 194, and is used to perform a capture (fingerprint photography) operation after detecting a touch operation to capture the user's fingerprint image.

[0317] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0318] In the embodiment of the present application, after the touch sensor 180K detects a touch operation acting near its upper edge, it can generate a hardware interrupt corresponding to the touch operation and send the hardware interrupt to the TP driver so that the TP driver triggers the next control strategy.

[0319] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0320] The embodiments of the present application also provide a computer program product. When the computer program product is executed on an electronic device, the electronic device can implement the steps in the above-mentioned various method embodiments.

[0321] The embodiment of the present application also provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the steps of any method embodiment of the present application. The chip system can be a single chip or a chip module composed of multiple chips.

[0322] The term "user interface (UI)" in the specification, claims and drawings of this application refers to the medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface of an application is source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on the terminal device, and finally presented as content that the user can recognize, such as pictures, text, buttons and other controls. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, pictures and text. The properties and contents of controls in the interface are defined by tags or nodes, such as XML through <textview> 、 <imgview> 、 <videoview>The controls contained in the interface are specified by nodes such as . A node corresponds to a control or attribute in the interface. After parsing and rendering, the node is presented as user-visible content. In addition, many applications, such as hybrid applications, usually also contain web pages in their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. A web page is source code written in a specific computer language, such as hypertext markup language (HTML), cascading style sheets (CSS), JavaScript (JS), etc. The web page source code can be loaded and displayed as user-recognizable content by a browser or a web page display component with similar functions to a browser. The specific content contained in a web page is also defined by tags or nodes in the web page source code. For example, HTML is defined by 、 、 <video> 、 <canvas>To define the elements and attributes of a web page.

[0323] The most common form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be an icon, window, control or other interface element displayed on the display screen of an electronic device, where a control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets and other visual interface elements.

[0324] As used in the specification and appended claims of the present application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include plural expressions, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items. As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "when determining..." or "if (stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "when (stated condition or event) is detected" or "in response to detecting (stated condition or event)", depending on the context.

[0325] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0326] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0327] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A fingerprint unlocking method, characterized in that: Applied to an electronic device, the electronic device includes a display screen, and the method includes: The electronic device is in a screen-off state; In response to detecting a first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, and simultaneously sends a first event corresponding to the first fingerprint unlocking operation to a target display application of the electronic device; the power-on processing module includes two or more of a fingerprint hardware abstraction module of the electronic device, a power management service module of the electronic device, a system image engine module of the electronic device, a hardware synthesizer module of the electronic device, a display screen hardware abstraction module of the electronic device, and a fingerprint driver of the electronic device; The display screen acquires a first fingerprint highlight instruction corresponding to the first event; In response to the first fingerprint highlighting instruction, the display screen highlights the fingerprint unlocking area; In response to acquiring the fingerprint image corresponding to the first fingerprint unlocking operation, the electronic device performs fingerprint unlocking.

2. The method according to claim 1, characterized in that The power-on processing module includes a fingerprint driver of the electronic device and a fingerprint hardware abstraction module of the electronic device; In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, including: In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the first power-on instruction to the display driver of the electronic device; The display driver of the electronic device sends the first power-on instruction to the display screen.

3. The method according to claim 1, characterized in that The power-on processing module includes a fingerprint driver of the electronic device, a fingerprint hardware abstraction module of the electronic device, a power management service module of the electronic device, a system image engine module of the electronic device, and a hardware synthesizer module of the electronic device; In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, including: In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the first power-on instruction to the power management service module of the electronic device; The power management service module of the electronic device sends the first power-on instruction to the system image engine module of the electronic device; The system image engine module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; The display driver of the electronic device sends the first power-on instruction to the display screen.

4. The method according to claim 1, characterized in that The power-on processing module includes a fingerprint driver of the electronic device, a fingerprint hardware abstraction module of the electronic device, a display screen hardware abstraction module of the electronic device, and a hardware synthesizer module of the electronic device; In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, including: In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first power-on instruction to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the first power-on instruction to the display hardware abstraction module of the electronic device; The display screen hardware abstraction module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; The display driver of the electronic device sends the first power-on instruction to the display screen.

5. The method according to claim 1, characterized in that The power-on processing module includes a fingerprint driver of the electronic device, a fingerprint hardware abstraction module of the electronic device, a display screen hardware abstraction module of the electronic device, and a hardware synthesizer module of the electronic device; In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends a first power-on instruction to the display screen through a power-on processing module, including: In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends the first power-on instruction to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first power-on instruction to the display driver of the electronic device; The display driver of the electronic device sends the first power-on instruction to the display screen hardware abstraction module of the electronic device; The display screen hardware abstraction module of the electronic device sends the first power-on instruction to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device sends the first power-on instruction to the display driver of the electronic device; The display driver of the electronic device sends the first power-on instruction to the display screen.

6. The method according to any one of claims 2 to 5, characterized in that: In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device sends a first event corresponding to the first fingerprint unlocking operation to a target display application of the electronic device, including: In response to detecting the first fingerprint unlocking operation, the touch driver of the electronic device generates the first event and sends the first event to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the first event to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the first event to a target display application of the electronic device.

7. The method according to claim 6, characterized in that The method further comprises: In response to the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, where the second power-on instruction carries display parameters, and the display parameters are generated by the power management service module of the electronic device, the system image engine module of the electronic device, and the hardware synthesizer module of the electronic device; The display driver of the electronic device sends the display parameter carried by the second power-on instruction to the display screen; The display screen is initialized based on the display parameters.

8. The method according to claim 7, characterized in that In response to the first event, the target display application of the electronic device sends a second power-on instruction to the display driver of the electronic device, including: In response to the first event, the screen-off display application of the electronic device generates the second power-on instruction, and sends the second power-on instruction to the power management service module of the electronic device; The power management service module of the electronic device generates a power display parameter in response to the second power-on instruction, and sends the second power-on instruction carrying the power display parameter to the system image engine module of the electronic device; The system image engine module of the electronic device generates an image display parameter in response to the second power-on instruction, and sends the second power-on instruction carrying the power display parameter and the image display parameter to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device generates hardware display parameters in response to the second power-on instruction, and sends a second power-on instruction carrying the power display parameters, the image display parameters and the hardware display parameters to the display driver of the electronic device, wherein the display parameters include the power display parameters, the image display parameters and the hardware display parameters.

9. The method according to claim 8, characterized in that After the display driver of the electronic device sends the display parameter carried by the second power-on instruction to the display screen, the method further includes: The electronic device display driver returns the second power-on instruction to the hardware synthesizer module of the electronic device; The hardware synthesizer module of the electronic device returns the second power-on instruction to the system image engine module of the electronic device.

10. The method according to claim 8, characterized in that The display screen acquires a first fingerprint highlight instruction corresponding to the first event, including: In response to indication information from a display driver of the electronic device indicating that the display screen has been powered on and initialized, the fingerprint hardware abstraction module of the electronic device sends the first fingerprint highlight instruction to the display driver of the electronic device; The display driver of the electronic device sends the first fingerprint highlighting instruction to the display screen; The display screen obtains the first fingerprint highlight instruction from a display driver of the electronic device.

11. The method according to claim 1, characterized in that: In response to acquiring the fingerprint image corresponding to the first fingerprint unlocking operation, the electronic device performs fingerprint unlocking, including: Matching the fingerprint image corresponding to the first fingerprint unlocking operation with the fingerprint image preset by the electronic device to obtain a matching result; When the matching result indicates that the fingerprint image corresponding to the first fingerprint unlocking operation does not match the fingerprint image preset by the electronic device, the electronic device remains locked and switches from the screen-off state to the screen-on state.

12. The method according to claim 11, characterized in that After the electronic device remains in the locked state, the method further includes: In response to detecting a second fingerprint unlocking operation, the display screen acquires a second fingerprint highlighting instruction corresponding to the second fingerprint unlocking operation; In response to the second fingerprint highlighting instruction, the display screen highlights the fingerprint unlocking area; In response to acquiring the fingerprint image corresponding to the second fingerprint unlocking operation, the electronic device performs fingerprint unlocking.

13. The method according to claim 12, characterized in that In response to detecting a second fingerprint unlocking operation, the display screen acquires a second fingerprint highlight instruction corresponding to the second fingerprint unlocking operation, including: In response to detecting the second fingerprint unlocking operation, the touch driver of the electronic device generates a second event corresponding to the second fingerprint unlocking operation, and sends the second event to the fingerprint driver of the electronic device; The fingerprint driver of the electronic device sends the second event to the fingerprint hardware abstraction module of the electronic device; The fingerprint hardware abstraction module of the electronic device sends the second fingerprint highlight instruction to the display driver of the electronic device in response to the second event; The display driver of the electronic device sends the second fingerprint highlighting instruction to the display screen; The display screen obtains the second fingerprint highlight instruction from a display driver of the electronic device.

14. A computer device, characterized in that: The computer device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the method according to any one of claims 1 to 13 when executed by the processor.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 13.

Images