Fingerprint input method and electronic equipment

Abstract

The invention discloses a fingerprint input method and electronic equipment, and belongs to the technical field of fingerprint identification, and the fingerprint input method comprises the steps: responding to continuous movement of a finger of a user in a fingerprint input region, and collecting a subsequent fingerprint image; determining the similarity between the subsequent fingerprint image and a reference fingerprint template in a fingerprint template library; the reference fingerprint template is a latest fingerprint template stored in a fingerprint template library before a subsequent fingerprint image is collected; if the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than the first duplicate judgment threshold and less than a second duplicate judgment threshold, splicing the subsequent fingerprint image and the reference fingerprint template into a second fingerprint template; and storing the second fingerprint template in a fingerprint template library. In this way, the input operation that the finger of the user continuously moves in the fingerprint input area is supported. Therefore, compared with a fingerprint input mode that a user needs to repeatedly press and lift the finger, the input efficiency is higher, and the user experience is better.

Description

Fingerprint entry method and electronic device Technical Field

[0001] The present application belongs to the field of fingerprint recognition technology, and in particular relates to a fingerprint entry method and electronic device. Background Art

[0002] With the development of electronic device technology, fingerprint recognition technology has been widely used in electronic devices such as mobile phones to realize various functions and facilitate user use. Typically, users need to enter a lot of fingerprint information into the electronic device in advance to ensure sufficient recognition accuracy when using the fingerprint recognition function of the electronic device.

[0003] However, due to limited space in electronic devices, the fingerprint recognition devices (e.g., fingerprint sensors) used to capture fingerprint images are typically small, and can only capture a portion of a finger's fingerprint information at a time. Consequently, during the fingerprint registration process, the user must lift and press their finger multiple times, requiring the user to contact the fingerprint recognition device with different parts of their finger multiple times, in order to complete the entire fingerprint registration. This results in a cumbersome, time-consuming, and inefficient fingerprint registration process.

[0004] Summary of the Invention

[0005] The present application provides a fingerprint entry method and electronic device, which can solve the problem that the fingerprint entry process is relatively complicated, that is, simplify the fingerprint entry process and improve the fingerprint matching success rate in the fingerprint recognition stage.

[0006] In a first aspect, the present application provides a fingerprint entry method, which is applied to an electronic device, wherein the electronic device includes a fingerprint recognition device, and the method includes: in response to detecting that a fingerprint entry area is pressed, collecting an initial fingerprint image; storing the initial fingerprint image as a first fingerprint template in a fingerprint template library; in response to the fingerprint entry area being continuously pressed, collecting a subsequent fingerprint image; determining the similarity between the subsequent fingerprint image and a reference fingerprint template in the fingerprint template library; wherein the reference fingerprint template is the fingerprint template most recently stored in the fingerprint template library before collecting the subsequent fingerprint image; if the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than a first duplicate judgment threshold and less than a second duplicate judgment threshold, splicing the subsequent fingerprint image and the reference fingerprint template into a second fingerprint template; and storing the second fingerprint template in the fingerprint template library.

[0007] In this way, the present application supports the fingerprint entry operation of continuously moving the user's finger in the fingerprint entry area. In this way, compared with the fingerprint entry method that requires the user to repeatedly press and lift the finger, the entry efficiency is higher and the user experience is better.

[0008] In addition, according to the fingerprint entry method provided by this application, after the electronic device captures a fingerprint image, it compares the similarity between the currently captured fingerprint image and the reference template. If the similarity between the two is greater than the first duplication threshold and less than the second duplication threshold, the currently captured fingerprint image and the reference template are spliced ​​together to obtain a fingerprint template that is larger than the most recently entered fingerprint template in the fingerprint template library. In this way, the spliced ​​fingerprint template can contain more fingerprint information. In this way, during the fingerprint recognition stage, using the spliced ​​fingerprint template to compare with the fingerprint authentication image can improve the fingerprint matching success rate.

[0009] In an implementable manner, the method further includes: if the similarity between the subsequent fingerprint image and the reference fingerprint template is less than or equal to the first duplicate determination threshold, storing the subsequent fingerprint image in the fingerprint template library as a third fingerprint template.

[0010] In an implementable manner, the method further includes: if the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than or equal to the second duplicate determination threshold, deleting the subsequent fingerprint image.

[0011] Thus, if the similarity is greater than the second duplicate determination threshold, the currently collected fingerprint image will not be entered into the fingerprint template library as a fingerprint template, so as to ensure that the fingerprint information in each fingerprint template in the fingerprint template library is as different as possible.

[0012] In an implementable manner, after storing the second fingerprint template in the fingerprint template library, the method further includes: deleting the reference fingerprint template.

[0013] In this way, since the second fingerprint template already contains the fingerprint information in the reference fingerprint template, the reference fingerprint template can be deleted to save space in the fingerprint template library, thereby allowing more different fingerprint information to be entered.

[0014] In one implementable manner, determining the similarity between the subsequent fingerprint image and a reference fingerprint template in the fingerprint template library includes: if the subsequent fingerprint image and the initial fingerprint image are two fingerprint images collected continuously, determining the similarity between the subsequent fingerprint image and the first fingerprint template.

[0015] In one implementable manner, stitching the subsequent fingerprint image and the reference fingerprint template into a second fingerprint template includes: extracting a first fingerprint feature of the subsequent fingerprint image; extracting a second fingerprint feature of the reference fingerprint template; and stitching the first fingerprint feature and the second fingerprint feature into the second fingerprint template by overlapping the same parts.

[0016] In one implementable manner, the first fingerprint feature includes at least one of a detail feature, a direction feature, a point distribution feature, and a frequency feature in the subsequent fingerprint image; and the second fingerprint feature includes at least one of a detail feature, a direction feature, a point distribution feature, and a frequency feature in the reference fingerprint template.

[0017] In one implementable manner, determining the similarity between the subsequent fingerprint image and a reference fingerprint template in the fingerprint template library includes: extracting a first fingerprint feature of the subsequent fingerprint image; extracting a second fingerprint feature of the reference fingerprint template; and determining the similarity between the subsequent fingerprint image and the reference fingerprint template based on the first fingerprint feature and the second fingerprint feature.

[0018] In an implementable manner, in response to the fingerprint entry area being continuously pressed, collecting a subsequent fingerprint image includes: in response to the user's finger continuously moving and pressing the fingerprint entry area, collecting a subsequent fingerprint image.

[0019] In an implementable manner, in response to the fingerprint entry area being continuously pressed, collecting subsequent fingerprint images includes: in response to the fingerprint entry area being continuously pressed, collecting subsequent fingerprint images at a fixed frequency.

[0020] In one achievable embodiment, before collecting the initial fingerprint image, the method further includes: displaying a fingerprint entry interface in response to a user triggering an operation on a fingerprint entry function; the fingerprint entry interface includes a fingerprint entry guide animation and / or fingerprint entry prompt information, and the fingerprint entry guide animation is used to display the fingerprint entry process of the finger continuously moving in the fingerprint entry area; the fingerprint entry prompt information is used to prompt the user of a fingerprint entry method, and the fingerprint entry method includes the finger continuously moving in the fingerprint entry area; when it is detected that the fingerprint entry area is pressed, the fingerprint entry area is lit up, a light spot is formed in the fingerprint entry area, and a fingerprint entry process animation is displayed.

[0021] In this way, the user can quickly understand the fingerprint entry operation method, the location of the fingerprint entry area, the fingerprint entry process, etc. based on the user interface displayed by the electronic device.

[0022] In one possible implementation, the trigger operation includes any one of a touch operation, a voice input operation, and a gesture input operation.

[0023] In an implementable manner, after storing the second fingerprint template in the fingerprint template library, the method further includes: updating the fingerprint entry process in the fingerprint entry process animation based on the second fingerprint template.

[0024] In this way, updating the fingerprint registration process can prompt the user which part of the fingerprint of the finger has been successfully registered. In this way, the user can move the position of the finger in the fingerprint registration area based on the fingerprint registration process to quickly register the fingerprint information that has not been collected.

[0025] In one implementation, if the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than or equal to the second duplicate determination threshold, the method further includes: displaying and / or playing a first prompt message, wherein the first prompt message is used to prompt the user that the finger movement amplitude is too small.

[0026] In this way, the user can be prompted to increase the range of finger movement to collect more different fingerprint information.

[0027] In one achievable embodiment, the method further includes: in response to detecting that the fingerprint entry area stops being pressed, the light spot in the fingerprint entry area is extinguished; when the fingerprint template stored in the fingerprint template library does not meet the entry completion conditions, a second prompt information is displayed and / or played, and the second prompt information is used to prompt the user that the fingerprint entry operation is not completed.

[0028] In this way, if the user accidentally leaves the fingerprint entry area before completing the fingerprint entry, the user can be prompted to continue the subsequent entry process without ending the fingerprint entry process. In this way, the previously entered fingerprint template remains valid and there is no need to re-enter.

[0029] In one implementation, the method further includes: in response to detecting that the pressed area of ​​the fingerprint entry area is smaller than a preset area, displaying and / or playing a third prompt message, wherein the third prompt message is used to prompt the user to move the finger to the fingerprint entry area.

[0030] In this way, if the finger moves out of the fingerprint registration area but does not leave the screen, the user does not need to press the fingerprint registration area again without leaving the screen, but only needs to move the finger back to the fingerprint registration area.

[0031] In one implementable manner, after the second fingerprint template is stored in the fingerprint template library, the method further includes: when the fingerprint template stored in the fingerprint template library meets the entry completion condition, displaying a fingerprint entry completion animation and / or a fingerprint entry completion prompt message, wherein the fingerprint entry completion animation and / or the fingerprint entry completion prompt message is used to prompt that the fingerprint entry operation has been completed; when the fingerprint template stored in the fingerprint template library does not meet the entry completion condition, continuing to collect the next fingerprint image.

[0032] In one implementation, the fingerprint template stored in the fingerprint template library meets the entry completion condition including:

[0033] The number of fingerprint templates stored in the fingerprint template library is greater than a template number threshold, and / or the total fingerprint area of ​​the fingerprint templates stored in the fingerprint template library is greater than a fingerprint area threshold.

[0034] In a second aspect, the present application provides an electronic device, comprising a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code comprises computer instructions, and when the processor executes the computer instructions, the electronic device executes the method as described in any one of the first aspects.

[0035] In a third aspect, the present application provides a computer-readable storage medium, characterized in that a computer program or instruction is stored in the computer-readable storage medium, and when the computer program or instruction is executed, the method as described in any one of the first aspects is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0037] FIG1 is a first schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0038] FIG2 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0039] FIG3 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;

[0040] FIG4 is a schematic diagram of a workflow of a fingerprint entry method provided in an embodiment of the present application;

[0041] FIG5 is a second schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0042] FIG6A is a schematic diagram of a workflow of a fingerprint entry method provided in an embodiment of the present application;

[0043] FIG6B is a schematic diagram of the workflow of another fingerprint entry method provided in an embodiment of the present application;

[0044] FIG6C is a schematic diagram of the workflow of another fingerprint entry method provided in an embodiment of the present application;

[0045] FIG7 is a third schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0046] FIG8 is a fourth schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0047] FIG9 is a fifth schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0048] FIG10 is a sixth schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0049] FIG11 is a seventh schematic diagram of a user interface of an electronic device provided in an embodiment of the present application;

[0050] FIG12A is a schematic diagram of a fingerprint matching process provided in an embodiment of the present application;

[0051] FIG12B is a schematic diagram of another fingerprint matching process provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] With the development of electronic device technology, fingerprint recognition technology has been widely used in electronic devices (such as mobile phones, laptops, tablet computers, etc.) to realize various functions and facilitate user use. For example, users can use fingerprint recognition technology to unlock electronic devices, and users can also use fingerprint recognition technology to realize various authentication or verification functions in electronic devices (such as identity verification when making electronic payments, identity verification when logging into applications, etc.). Users can also use fingerprint recognition technology to realize other functions in electronic devices. This application does not limit the application of fingerprint recognition technology.

[0053] In order for a user to use fingerprint recognition technology to perform various functions on an electronic device, the user must first enter a fingerprint template into the electronic device, creating and storing a fingerprint template library within the electronic device. When the user uses the fingerprint recognition function of the electronic device, the electronic device captures the fingerprint authentication image input by the user and compares it with the fingerprint templates in the stored fingerprint template library. If the two match, the electronic device performs a function such as unlocking or authentication.

[0054] In order to improve the recognition accuracy during the fingerprint recognition stage, more fingerprint information can be recorded during the fingerprint registration stage. However, since the fingerprint recognition device (such as the fingerprint sensor) used to collect fingerprint images in electronic devices is usually relatively small, the fingerprint recognition device can only collect fingerprint information of a part of the finger at a time. In this way, during the fingerprint registration stage, the user needs to lift and press the finger multiple times, that is, the user needs to touch the fingerprint recognition device with different parts of the finger multiple times to complete the entire fingerprint registration of a finger. This makes the fingerprint registration process more cumbersome, time-consuming, and inefficient.

[0055] For example, as shown in Figure 1, each time a user enters fingerprint information, they need to perform a continuous finger press and lift action. Generally, to complete the entire fingerprint entry of a finger, the user needs to perform 10 to 20 consecutive finger press and lift actions, and the user needs to contact the fingerprint recognition device with different parts of the finger multiple times. It can be seen that this fingerprint entry method that requires the user to repeatedly press and lift the finger is relatively cumbersome and time-consuming, and the user experience is poor.

[0056] To solve the above problems, an embodiment of the present application provides a fingerprint entry method. According to the fingerprint entry method, during the fingerprint entry stage, the user's finger can, after pressing on the fingerprint entry area, maintain contact with the fingerprint entry area and move continuously in the fingerprint entry area until the finger is lifted up after the entry is completed. Correspondingly, the electronic device can enter the fingerprint template while the user's finger is pressing the fingerprint entry area and moving continuously in the fingerprint entry area. In this way, during the fingerprint entry stage, the user does not need to repeatedly press and lift the finger to achieve the entry of fingerprint information, which simplifies the entry operation and improves the user experience.

[0057] In addition, according to the fingerprint entry method provided by the present application, after the electronic device collects the fingerprint image, it will compare the currently collected fingerprint image with the most recently entered fingerprint template in the fingerprint template library. If the similarity between the two is greater than the first duplicate judgment threshold and less than the second duplicate judgment threshold, the currently collected fingerprint image and the most recently entered fingerprint template are spliced ​​together to obtain a fingerprint template that is larger than the most recently stored fingerprint template in the above-mentioned fingerprint template library and is stored in the fingerprint template library. In this way, the spliced ​​fingerprint template can contain more fingerprint information. In this way, during the fingerprint recognition stage when the user uses the electronic device, the spliced ​​fingerprint template is used to compare with the fingerprint authentication image, which can improve the matching success rate.

[0058] The following describes the fingerprint entry method provided in the embodiment of the present application.

[0059] The fingerprint entry method provided in the embodiments of the present application can be applied to electronic devices. In some implementations, the electronic device can be a mobile phone, tablet computer, personal computer (PC), personal digital assistant (PDA), wearable device, or other electronic device that includes a fingerprint sensor. The embodiments of the present application do not limit the specific form of the electronic device. A fingerprint sensor is a biometric sensor integrated into an electronic device for acquiring and identifying a user's fingerprint.

[0060] For example, taking the electronic device as a mobile phone as an example, FIG2 shows a structural diagram of an electronic device provided in an embodiment of the present application.

[0061] As shown in Figure 2, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0062] Among them, the above-mentioned sensor module 180 may include sensors such as a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L and a bone conduction sensor 180M.

[0063] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0064] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0065] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0066] Processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 110, and thus improves system efficiency. In some embodiments, processor 110 may include one or more interfaces.

[0067] It is understood that the interface connection relationship between the modules illustrated in this embodiment is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0068] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. For example, the display screen 194 can be a touch screen.

[0069] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0070] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0071] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. For example, in an embodiment of the present application, the processor 110 can execute instructions stored in the internal memory 121, and the internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc.

[0072] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor. For example, the microphone 170C can collect the user's voice information, and the speaker 170A can play feedback results of the user's voice information.

[0073] A touch sensor, also known as a "touch panel," can be provided on the display screen 194. The touch sensor and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor is used to detect touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be provided on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0074] In the embodiment of the present application, the electronic device 100 can detect a touch operation input by a user on the touch screen through a touch sensor, and collect one or more of the touch position on the touch screen, the touch time, etc. In some embodiments, the electronic device 100 can determine the touch position of the touch operation on the touch screen by combining the touch sensor 180K and the pressure sensor 180A.

[0075] Keys 190 include a power button, a volume button, and the like. Keys 190 can be mechanical or touch-sensitive. Electronic device 100 can receive key inputs and generate key signal inputs related to user settings and function control of electronic device 100. For example, a long press of the power button can activate the voice interaction function.

[0076] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0077] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0078] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0079] FIG3 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0080] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0081] The application layer can include a series of application packages.

[0082] As shown in FIG3 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and setting.

[0083] The Settings application can be used to set the working mode, fingerprint and password of the electronic device.

[0084] The application layer can also be used to display the user interface corresponding to each application. For example, the application layer can be responsible for providing demonstration animations during the fingerprint entry process (such as fingerprint entry guide animations, fingerprint entry progress animations, etc.), prompt information, and other related resource configurations.

[0085] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0086] As shown in FIG3 , the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a fingerprint recognition framework, a fingerprint service, and the like.

[0087] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0088] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0089] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0090] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0091] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0092] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0093] The fingerprint recognition framework and fingerprint service can be used to connect the application layer and the fingerprint hardware abstraction layer, call back fingerprint hardware abstraction layer related functions, and control the fingerprint entry process.

[0094] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0095] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0096] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0097] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0098] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0099] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0100] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0101] A 2D graphics engine is a drawing engine for 2D drawings.

[0102] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0103] Taking the hardware for collecting fingerprint images as the fingerprint sensor 180H and the hardware for identifying when a user's finger presses or leaves the fingerprint entry area as the touch sensor 180K as an example, the sensor driver of the kernel layer includes a fingerprint driver and a touch driver.

[0104] In some embodiments, electronic devices may also employ a trusted execution environment (TEE) fingerprint solution software architecture. The TEE fingerprint solution software architecture includes a rich execution environment (REE) and a TEE. REE is a common environment for mobile devices, and TEE is typically used for digital rights management, mobile payments, and sensitive data protection. TEE and REE can run in isolation, and TEE and REE can interact through shared memory.

[0105] Because TEE has high security, it can be used to perform specific functions. For example, the fingerprint image acquisition, fingerprint image similarity comparison, fingerprint image processing, fingerprint template entry and other algorithms in the fingerprint registration process in the embodiment of the present application can all be run in TEE.

[0106] The TEE fingerprint solution software architecture also includes a fingerprint hardware abstraction layer. The fingerprint hardware abstraction layer is located on the REE side and is used to interact with the TEE and control the fingerprint driver.

[0107] The methods in the following embodiments can all be implemented in an electronic device having the above hardware structure or software structure.

[0108] FIG4 is a flow chart of a fingerprint recording method provided in an embodiment of the present application. As shown in FIG4 , the fingerprint recording method may include the following steps:

[0109] S201 , in response to a user triggering an operation on a fingerprint entry function, displaying a fingerprint entry interface.

[0110] The user's triggering operation for the fingerprint entry function refers to the input operation that triggers the electronic device to display the fingerprint entry interface.

[0111] For example, as shown in FIG5 , a user may first enter the main settings interface (as shown in FIG5 (a)). Then, the user may trigger the fingerprint and password option in the main settings interface 301. In this way, the user interface switches from the main settings interface to the fingerprint and password settings interface (as shown in FIG5 (b)). Furthermore, the user may trigger the add fingerprint option in the fingerprint and password settings interface. In this way, the user interface switches from the fingerprint and password settings interface to the fingerprint entry interface (as shown in FIG5 (c)).

[0112] Among them, the user's triggering operation for the fingerprint entry function can be a touch operation on the add fingerprint option, or other operations that trigger the add fingerprint function, such as voice input, gesture input, floating operation, etc., which is not specifically limited in the embodiment of this application.

[0113] In order to facilitate the user to intuitively receive the fingerprint entry operation method, a fingerprint entry guide animation and / or fingerprint entry prompt information can be displayed on the fingerprint entry interface. The embodiment of the present application adopts the method of rubbing the fingerprint entry area to enter the fingerprint. Rubbing the fingerprint entry area specifically means that after the user's finger presses the fingerprint entry area, the finger keeps in contact with the fingerprint entry area, instead of lifting the finger, and then the user's finger moves continuously in the fingerprint entry area. While rubbing the fingerprint entry area, the electronic device displays a fingerprint entry guide animation to guide the user's finger to rub the fingerprint entry area to perform fingerprint entry. Similarly, the electronic device can also display fingerprint entry prompt information to prompt the user to rub the fingerprint to enter.

[0114] For example, as shown in FIG5 (c), the fingerprint entry interface may include fingerprint entry prompt information, fingerprint entry guide animation and fingerprint entry area. Among them, the fingerprint entry prompt information can be displayed at the top of the user interface. For example, the fingerprint entry prompt information is a text "Please place your finger in the fingerprint entry area and move it continuously in the fingerprint entry area in a rubbing manner." The fingerprint entry guide animation can be played in the middle area of ​​the user interface. The fingerprint entry guide animation shows the process of the finger moving continuously in the fingerprint entry area in a rubbing manner. The fingerprint entry area can be displayed at the bottom of the user interface. In this way, based on the user interface shown in FIG5 (c), the user can quickly understand the fingerprint entry operation method and the location of the fingerprint entry area.

[0115] After the fingerprint entry interface is displayed, the user can press the fingerprint entry area with their finger, without lifting their finger, and move it continuously in a rubbing motion within the fingerprint entry area, following the prompts on the fingerprint entry interface. The user's finger can be moved continuously along any path within the fingerprint entry area. For example, the user's finger can be moved continuously clockwise or counterclockwise within the fingerprint entry area. For another example, the user's finger can be moved repeatedly up, down, left, and right within the fingerprint entry area. For another example, the user's finger can be moved continuously and randomly within the fingerprint entry area.

[0116] In this way, continuously moving the finger across the fingerprint entry area in a rubbing motion simplifies the entry process by eliminating the need for the user to repeatedly press and lift their finger. Furthermore, continuously moving the finger across the fingerprint entry area in a rubbing motion makes it easier for the entire fingerprint to contact the fingerprint entry area, allowing for quick and complete fingerprint entry.

[0117] Continuing to refer to the flowchart of Figure 4. S202: When it is detected that the fingerprint entry area is pressed, the fingerprint entry area is illuminated, a light spot is formed in the fingerprint entry area, and a fingerprint entry process animation is displayed.

[0118] After the fingerprint entry interface is displayed, the electronic device waits for the user's finger to press the fingerprint entry area. When the user's finger presses the fingerprint entry area, the touch sensor in the electronic device can detect that the fingerprint entry area has been pressed. The fingerprint entry area is used to indicate that the user has touched it.

[0119] For example, after the user's finger presses the fingerprint entry area, the touch sensor can detect touch information (including touch pressure value, touch position, and other information) and report the touch information to the kernel layer. The kernel layer can determine the type of touch event based on the reported touch information. For example, the kernel layer can determine that the touch event type is a press (Down) event. In this way, when a Down event is detected (i.e., the fingerprint entry area is detected to be pressed), the fingerprint entry area is illuminated and the fingerprint entry process animation is displayed.

[0120] For example, as shown in Figure 5 (c) and (d), when the electronic device detects that the fingerprint entry area has been pressed, the fingerprint entry guidance animation in the user interface switches to a fingerprint entry progress animation. The fingerprint entry progress animation can update the fingerprint entry progress as more fingerprint templates are entered. Specifically, the fingerprint entry progress animation can be filled with the entered fingerprint patterns.

[0121] After the fingerprint entry area is illuminated, a light spot may be formed at the location of the fingerprint entry area in the user interface, so that a fingerprint recognition device (e.g., a fingerprint sensor) can capture a clear fingerprint image. The fingerprint entry area may be illuminated by controlling the fingerprint entry area to be highlighted.

[0122] The fingerprint recognition device is located below the touch screen and is set corresponding to the fingerprint recording area. In this way, when the user's finger presses on the fingerprint recording area, the fingerprint recognition device below the fingerprint recording area can use the fingerprint image.

[0123] S203: In response to detecting that the fingerprint entry area is continuously pressed, collecting fingerprint images at a fixed frequency.

[0124] The fingerprint entry area being continuously pressed may include the user's finger pressing the fingerprint entry area, not leaving the fingerprint entry area, and continuously moving in the fingerprint entry area.

[0125] For example, when the electronic device detects a user's finger pressing on the fingerprint entry area, it captures the first fingerprint image M1. Thereafter, the second fingerprint image M2, the third fingerprint image M3, and so on, to the nth fingerprint image Mn are captured at a fixed frequency, where n is a positive integer greater than 1.

[0126] In the embodiment of the present application, the first fingerprint image M1 collected may be referred to as the initial fingerprint image, and the other fingerprint images other than the first fingerprint image M1 may be referred to as subsequent fingerprint images. For example, the subsequent fingerprint image may be any fingerprint image from the second fingerprint image M2, the third fingerprint image M3, ..., the nth fingerprint image Mn.

[0127] In the embodiment of the present application, after each fingerprint image is captured, a fingerprint registration operation is performed based on preset registration rules. For example, for an initial fingerprint image, the initial fingerprint image can be directly stored as an independent fingerprint template in the fingerprint template library. For another example, for any subsequent fingerprint image, the similarity between the subsequent fingerprint image and the reference fingerprint template determines whether to store the subsequent fingerprint image in the fingerprint template library. The reference template refers to the fingerprint template most recently stored in the fingerprint template library before the subsequent fingerprint image is captured.

[0128] The following describes the process of fingerprint registration based on the preset registration rules for the collected fingerprint image. For details, please refer to steps S204 to S211.

[0129] S204: After collecting the initial fingerprint image, store the initial fingerprint image in a fingerprint template library as a first fingerprint template.

[0130] Before the initial fingerprint image is entered into the fingerprint template library, the fingerprint template library is empty, i.e., there are no fingerprint templates. Therefore, there is no need to compare the initial fingerprint image with the fingerprint template for similarity. In this way, after the initial fingerprint image is collected, it can be directly stored in the fingerprint template library as an independent fingerprint template.

[0131] After step S204 is executed, the fingerprint template library includes a fingerprint template, ie, the first fingerprint image.

[0132] S205: Acquire a subsequent fingerprint image and determine a similarity P between the second fingerprint image and a reference fingerprint template in the fingerprint template library.

[0133] In some embodiments, determining the similarity between the subsequent fingerprint image and a reference fingerprint template in a fingerprint template library can be achieved by first extracting a first fingerprint feature of the subsequent fingerprint image and a second fingerprint feature of the reference fingerprint template. Then, based on the first fingerprint feature and the second fingerprint feature, determining a similarity P between the subsequent fingerprint image and the reference fingerprint template.

[0134] Among them, fingerprint features mainly include detail features, direction features, point distribution features and frequency features in the fingerprint image.

[0135] Minutiae include lines, valleys, forks, bifurcation points, etc. in the fingerprint image.

[0136] Directional features refer to the direction and orientation of the lines in the fingerprint image.

[0137] Frequency features, namely the frequency or periodicity of the ridges in a fingerprint image, can be used for fingerprint matching and recognition.

[0138] Point distribution features, i.e., the number of forks in a fingerprint image, the location of bifurcation points, etc., can be used to describe and represent the morphology and structure of a fingerprint pattern.

[0139] It should be noted that the fingerprint features may include one or more features such as detail features, direction features, point distribution features and frequency features in the fingerprint image, and the embodiments of the present application do not limit this.

[0140] In some examples, fingerprint features can be extracted by filtering methods, edge detection methods, direction calculation methods, frequency analysis methods, and morphological processing methods, etc. The fingerprint feature extraction method is not limited in the embodiments of the present application.

[0141] Furthermore, the embodiment of the present application implements different entry strategies for subsequent fingerprint images based on the similarity P between the subsequent fingerprint image and the reference fingerprint template. For details, please refer to the following steps S206 to S208.

[0142] S206: If the similarity P between the subsequent fingerprint image and the reference fingerprint template is greater than the first duplicate determination threshold Y1 and less than the second duplicate determination threshold Y2, the subsequent fingerprint image and the reference fingerprint template are spliced ​​into a second fingerprint template.

[0143] In some embodiments, the following method can be used to stitch a subsequent fingerprint image and a reference fingerprint template together: First, a first fingerprint feature of the subsequent fingerprint image and a second fingerprint feature of the reference fingerprint template can be extracted. Then, the second fingerprint template is stitched together by overlapping the identical portions of the first and second fingerprint features. The overlapping portions of the subsequent fingerprint image and the initial fingerprint image in the stitched second fingerprint template represent the identical features of the two fingerprint images.

[0144] S207: If the similarity P between the subsequent fingerprint image and the reference fingerprint template is less than or equal to the first duplicate determination threshold Y1, the subsequent fingerprint image is used as the third fingerprint template.

[0145] S208: If the similarity P between the subsequent fingerprint image and the reference fingerprint template is greater than or equal to the second duplicate determination threshold Y2, the subsequent fingerprint image will be deleted.

[0146] If the similarity P between the subsequent fingerprint image and the reference fingerprint template is greater than the second duplicate determination threshold Y2, it indicates that the reference fingerprint template has basically included the fingerprint information of the subsequent fingerprint image. In this case, the subsequent fingerprint image may not be stored in the fingerprint template library.

[0147] S209: Store the second fingerprint template or the third fingerprint template in a fingerprint template library.

[0148] The following describes the subsequent fingerprint image entry process by taking the second fingerprint image M2 and the third fingerprint image M3 as examples.

[0149] Figure 6A is a schematic diagram of a second fingerprint image M2 entry process provided in an embodiment of the present application; Figure 6B is a schematic diagram of another second fingerprint image M2 entry process provided in an embodiment of the present application; Figure 6C is a schematic diagram of yet another second fingerprint image M2 entry process provided in an embodiment of the present application.

[0150] As shown in Figures 6A to 6C, when the user's finger presses on the fingerprint entry area (as shown in (a1) in Figure 6A), the first fingerprint image M1 is collected (as shown in (a2) in Figure 6A), and the first fingerprint image M1 is stored as a fingerprint template in the fingerprint template library. When the user's finger moves from the initial pressing position in the fingerprint entry area to the position shown in (b1) in Figure 6A, the second fingerprint image M2 is collected (as shown in (b2) in Figure 6A). Then, the similarity between the second fingerprint image M2 and the fingerprint template most recently stored in the template library is determined. At this time, the fingerprint template most recently stored in the template library is the first fingerprint image M1. In this way, it is equivalent to determining the similarity between the second fingerprint image M2 and the first fingerprint image M1.

[0151] As shown in FIG6A , when the similarity between the second fingerprint image M2 and the first fingerprint image M1 is greater than the first duplicate determination threshold and less than the second duplicate determination threshold, the second fingerprint image M2 and the first fingerprint image M1 are spliced ​​to obtain a spliced ​​fingerprint template M 1+2 (As shown in (b3) in FIG6A ). Next, the spliced ​​fingerprint template M 1+2 Stored in the fingerprint template library. Thus, as shown in (b4) in FIG6A , the fingerprint template library includes two fingerprint templates, the two fingerprint templates are the first fingerprint image M1 and the spliced ​​fingerprint template M 1+2 .

[0152] In some embodiments, the second fingerprint image M2 and the first fingerprint image M1 are spliced ​​together in the following manner: first, the fingerprint features of the second fingerprint image M2 and the first fingerprint image M1 are extracted; then, the same features in the second fingerprint image M2 are overlapped and spliced ​​with the same features in the first fingerprint image M1 to obtain a spliced ​​fingerprint template M2. 1+2 .

[0153] For example, as shown in (b3) in FIG6A , the fingerprint template M 1+2 The overlapping portion of the subsequent fingerprint image M2 and the initial fingerprint image M1 is the same feature portion in the two fingerprint images.

[0154] Compare the first fingerprint image M1 and the fingerprint template M in Figure 6A 1+2 It can be seen that the spliced ​​fingerprint template M 1+2 Contains more fingerprint information. In this way, in the fingerprint recognition stage, using this spliced ​​fingerprint template to match the fingerprint authentication image can improve the matching success rate.

[0155] After the above processing, the fingerprint template library includes two fingerprint templates, namely the first fingerprint image M1 recorded in step S204, and the fingerprint template M1 obtained by splicing the second fingerprint image recorded in step S208 with the first fingerprint image. 1+2 .

[0156] In some embodiments, since the fingerprint template M 1+2 The fingerprint image M1 contains all the fingerprint information of the fingerprint image M1, so the fingerprint image M1 in the fingerprint template library can also be deleted. In this way, the fingerprint template library space can be saved, so that more different fingerprint information can be recorded.

[0157] Similarly, each time a spliced ​​fingerprint template is obtained, its corresponding reference fingerprint template can be deleted.

[0158] As shown in Figure 6B, when the similarity between the second fingerprint image M2 and the first fingerprint image M1 is less than the first duplicate detection threshold, the second fingerprint image M2 is stored as an independent fingerprint template in the fingerprint template library. Thus, as shown in (b3) in Figure 6B, the fingerprint template library includes two fingerprint templates, namely the first fingerprint image M1 and the second fingerprint image M2.

[0159] As shown in Figure 6C, if the similarity between the second fingerprint image M2 and the first fingerprint image M1 is greater than the second duplicate detection threshold, the second fingerprint image M2 is discarded and not stored in the fingerprint template library. In this way, as shown in (b3) in Figure 6C, the fingerprint template library still includes one fingerprint template, namely the first fingerprint image M1.

[0160] Based on the above description of the recording process of the second fingerprint image M2, when performing the recording operation on the third fingerprint image M3, the reference template (the fingerprint template most recently stored in the fingerprint template library) includes three situations:

[0161] Case 1: The reference template is the spliced ​​fingerprint template M 1+2 (Corresponding to Figure 6A).

[0162] The second case: the reference template is the second fingerprint image M2 (corresponding to FIG6B ).

[0163] The third case: the reference template is the first fingerprint image M1 (corresponding to FIG6C ).

[0164] Thus, corresponding to the first case, after collecting the third fingerprint image M3, the third fingerprint image M3 and the fingerprint template M3 are determined. 1+2 If the third fingerprint image M3 is similar to the fingerprint template M 1+2 If the similarity is greater than the first duplicate threshold and less than the second duplicate threshold, the third fingerprint image M3 is compared with the fingerprint template M 1+2 Perform splicing processing to obtain a spliced ​​fingerprint template M 1+2+3 , and the spliced ​​fingerprint template M 1+2+3 Stored in the fingerprint template library. If the third fingerprint image M3 is the same as the fingerprint template M 1+2 If the similarity between the third fingerprint image M3 and the fingerprint template M is less than the first duplicate threshold, the third fingerprint image M3 is used as a fingerprint template and stored in the fingerprint template library. 1+2 If the similarity is greater than the second duplicate judgment threshold, the third fingerprint image M3 is deleted and is not stored in the fingerprint template library.

[0165] Corresponding to the second case, after collecting the third fingerprint image M3, the similarity between the third fingerprint image M3 and the second fingerprint image M2 is determined. If the similarity between the third fingerprint image M3 and the second fingerprint image M2 is greater than the first duplicate judgment threshold and less than the second duplicate judgment threshold, the third fingerprint image M3 and the second fingerprint image M2 are spliced ​​to obtain a spliced ​​fingerprint template M 2+3 , and the spliced ​​fingerprint template M 2+3 Stored in the fingerprint template library. If the similarity between the third fingerprint image M3 and the second fingerprint image M2 is less than the first duplicate detection threshold, the third fingerprint image M3 is treated as a separate fingerprint template and stored in the fingerprint template library. If the similarity between the third fingerprint image M3 and the second fingerprint image M2 is greater than the second duplicate detection threshold, the third fingerprint image M3 is deleted and not stored in the fingerprint template library.

[0166] Corresponding to the third case, after collecting the third fingerprint image M3, the similarity between the third fingerprint image M3 and the first fingerprint image M1 is determined. If the similarity between the third fingerprint image M3 and the first fingerprint image M1 is greater than the first duplicate judgment threshold and less than the second duplicate judgment threshold, the third fingerprint image M3 and the first fingerprint image M1 are spliced ​​together to obtain a spliced ​​fingerprint template M 1+3 , and the spliced ​​fingerprint template M 1+3 Stored in the fingerprint template library. If the similarity between the third fingerprint image M3 and the first fingerprint image M1 is less than the first duplicate detection threshold, the third fingerprint image M3 is treated as a separate fingerprint template and stored in the fingerprint template library. If the similarity between the third fingerprint image M3 and the first fingerprint image M1 is greater than the second duplicate detection threshold, the third fingerprint image M3 is discarded and not stored in the fingerprint template library.

[0167] It should be noted that, for the recording process of the third fingerprint image M3, reference may be made to the description of the recording process of the second fingerprint image M2, which will not be repeated here.

[0168] It should also be noted that the recording process for the fourth fingerprint image M4 . . . nth fingerprint image Mn can refer to the description of the recording process for the second fingerprint image M2 and the third fingerprint image M3 , which will not be repeated here.

[0169] S210: If the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than or equal to the second duplicate determination threshold, a first prompt message is displayed.

[0170] In some embodiments, if the similarity between the second fingerprint image and the first fingerprint image is greater than the second duplicate determination threshold, a first prompt message may be generated, and the first prompt message is used to prompt the user that the finger movement amplitude is too small.

[0171] For example, as shown in Figure 7, the first prompt information may be text displayed on the user interface. For example, the first prompt information may be "Please increase the range of finger movement".

[0172] In the embodiment of the present application, each time a new fingerprint template is stored in the fingerprint template library, the fingerprint entry process animation is updated accordingly.

[0173] For example, as shown in FIG8 (a), when no fingerprint template is stored in the fingerprint template library, the initial fingerprint registration process is displayed in the fingerprint registration process animation. As shown in FIG8 (b), after the first fingerprint template is stored in the fingerprint template library, the fingerprint registration process is updated by filling in the fingerprint pattern corresponding to the first fingerprint template in the fingerprint registration process. As shown in FIG8 (c), after the second fingerprint template is stored in the fingerprint template library, the fingerprint registration process is updated again by filling in the fingerprint pattern corresponding to the second fingerprint template in the fingerprint registration process. Among them, updating the fingerprint registration process can prompt the user which part of the fingerprint of the finger is successfully registered. In this way, the user can move the position of the finger in the fingerprint registration area based on the fingerprint registration process to quickly enter the fingerprint information that has not yet been collected.

[0174] S211, determining whether the fingerprint template stored in the fingerprint template library meets the entry completion condition.

[0175] S212: If the fingerprint template stored in the fingerprint template library meets the entry completion condition, display a fingerprint entry completion animation and / or fingerprint entry completion prompt information.

[0176] In the embodiment of the present application, after each storage of a fingerprint template, it is possible to determine whether the fingerprint template stored in the fingerprint template library meets the entry completion condition.

[0177] In some embodiments, the entry completion condition may include the number of entered fingerprint templates and / or the total fingerprint area of ​​the entered fingerprint templates. Thus, in step S211, it can be determined whether the number of fingerprint templates stored in the fingerprint template library is greater than a template number threshold, and / or whether the total fingerprint area of ​​the fingerprint templates stored in the fingerprint template library is greater than a fingerprint area threshold.

[0178] If the number of fingerprint templates stored in the fingerprint template library is greater than the template number threshold, and / or the total fingerprint area of ​​the fingerprint templates stored in the fingerprint template library is greater than the fingerprint area threshold, a fingerprint entry completion animation and / or a fingerprint entry completion prompt message is displayed. If the fingerprint template stored in the fingerprint template library does not meet the entry completion conditions, the next fingerprint image is captured.

[0179] Correspondingly, as shown in FIG9 , when the fingerprint template stored in the fingerprint template library meets the entry completion condition, the fingerprint entry process animation is displayed on the user interface, and a fingerprint entry completion prompt message is displayed. For example, the text “fingerprint entry completed” is displayed on the user interface.

[0180] After completing the fingerprint registration, the user's finger can leave the fingerprint registration area. In response to detecting that the fingerprint registration area is no longer pressed, the light spot in the fingerprint registration area is extinguished.

[0181] In some embodiments, considering that the user may accidentally leave the fingerprint entry area before completing the fingerprint entry, the following steps S213 to S218 can be used to prompt the user to continue the subsequent entry process without ending the fingerprint entry process. In this way, the previously entered fingerprint template remains valid and there is no need to re-enter it.

[0182] There are two situations in which the fingerprint entry area stops being pressed: the first situation is that the finger is lifted up and leaves the fingerprint entry area; the second situation is that the finger moves out of the fingerprint entry area but is not lifted up.

[0183] For the first case, the following steps S213 to S216 may be performed. For the second case, the following steps S214 to S216 may be performed. Steps S217 to S218 may also be performed.

[0184] S213: Detect that the finger leaves the screen.

[0185] After the user's finger is lifted and leaves the screen, the touch event can be identified as an Up event. In this way, based on the Up event, it can be determined that the user's finger has left the screen.

[0186] S214 , in response to detecting that the finger leaves the screen, extinguishing the light spot.

[0187] Extinguishing the light spot means restoring the brightness of the fingerprint registration area to the level before the light spot was turned on.

[0188] S215: Determine whether the fingerprint template stored in the fingerprint template library meets the entry completion condition.

[0189] If the fingerprint template stored in the fingerprint template library meets the entry completion condition, the process proceeds to step S212. Otherwise, the process proceeds to step S216.

[0190] S216: If the fingerprint template stored in the fingerprint template library does not meet the entry completion condition, generate second indication information.

[0191] The second prompt is used to inform the user that the fingerprint entry operation has not been completed. For example, as shown in Figure 10, the second prompt may be "Fingerprint entry is not yet complete, please press the fingerprint entry area again." In this way, the user presses the fingerprint entry area again according to the second prompt, proceeding to step S202 and subsequent steps to complete the subsequent fingerprint entry operation.

[0192] S217: Detect that the finger moves out of the fingerprint entry area while the finger is still in contact with the screen.

[0193] In one implementable manner, it is possible to determine whether the user's finger has moved out of the fingerprint recording area by checking whether the pressing area of ​​the user's finger in the fingerprint recording area is smaller than a preset area. If the pressing area of ​​the user's finger in the fingerprint recording area is smaller than the preset area, it can be determined that the user's finger has moved out of the fingerprint recording area. Otherwise, it is considered that the user's finger has not moved out of the fingerprint recording area. The preset area can be zero or a value greater than zero. That is to say, in the embodiment of the present application, the finger moving out of the fingerprint recording area means that it can be detected that the user's finger is pressing on the screen, but the pressing area in the fingerprint recording area is small or the finger is not pressed in the fingerprint recording area.

[0194] S218 , in response to detecting that the finger moves out of the fingerprint entry area and the finger is still in contact with the screen, displaying a third prompt message.

[0195] The third prompt message is used to prompt the user to move the finger to the fingerprint entry area. For example, as shown in FIG11 , the third prompt message may be “The finger is not in the fingerprint entry area, please move the finger to the fingerprint entry area.”

[0196] In some embodiments, in response to detecting that the finger has left the fingerprint entry area, the light spot may be extinguished and a fourth prompt message may be displayed. The fourth prompt message is used to remind the user that the finger is not in the fingerprint entry area and that the user needs to lift the finger and re-enter the fingerprint.

[0197] It should be noted that the above-mentioned application embodiment is merely an example of prompting the user by displaying the prompt information on the user interface, and does not limit the prompt information. For example, the prompt information can also be prompted to the user by voice broadcast. Alternatively, the prompt information can also be prompted to the user by a combination of display and voice broadcast, and the present application embodiment does not make specific limitations.

[0198] In summary, the fingerprint registration method provided in the embodiment of the present application supports the registration operation of continuously moving the user's finger in the fingerprint registration area. In this way, compared with the fingerprint registration method that requires the user to repeatedly press and lift the finger, the registration efficiency is higher and the user experience is better.

[0199] In addition, according to the fingerprint entry method provided by the present application, after the electronic device collects the fingerprint image, it compares the similarity between the currently collected fingerprint image and the reference template. If the similarity between the two is greater than the first duplicate judgment threshold and less than the second duplicate judgment threshold, the currently collected fingerprint image and the reference template are spliced ​​to obtain a fingerprint template that is larger than the latest fingerprint template stored in the above-mentioned fingerprint template library. In this way, the spliced ​​fingerprint template can contain more fingerprint information. In this way, during the fingerprint recognition stage when the user uses the electronic device, the fingerprint matching success rate can be improved by comparing the spliced ​​fingerprint template with the fingerprint authentication image. If the similarity between the two is greater than the second duplicate judgment threshold, the currently collected fingerprint image will not be stored as a fingerprint template in the fingerprint template library to ensure that the fingerprint information in each fingerprint template in the fingerprint template library is as different as possible.

[0200] The following describes the fingerprint entry method provided by this application, which can improve the success rate of fingerprint matching.

[0201] FIG12A is a schematic diagram of a fingerprint matching process in related art; FIG12B is a schematic diagram of a fingerprint matching process in an embodiment of the present application.

[0202] As shown in Figure 12A (a), taking the collected fingerprint images M1, M2, M3, and M4 as an example, in the related art, during the fingerprint registration process, the collected fingerprint images M1, M2, M3, and M4 are directly stored as independent fingerprint templates in the fingerprint template library. In this way, after fingerprint registration is completed, the fingerprint template library includes fingerprint templates M1, M2, M3, and M4.

[0203] As shown in (a) of FIG12B , the fingerprint image M1, fingerprint image M2, fingerprint image M3 and fingerprint image M4 are also collected as an example. In the fingerprint entry process of the embodiment of the present application, the collected fingerprint image is used as an independent fingerprint template, the fingerprint image is spliced, and the fingerprint image is not entered. In this way, after the fingerprint entry is completed, the fingerprint template library includes fingerprint templates of different sizes. For example, after the fingerprint entry is completed, the fingerprint template library includes fingerprint templates M1, fingerprint template M2, fingerprint template M3 and fingerprint template M4. 1+2 And fingerprint template M3. Among them, fingerprint template M 1+2 The fingerprint images M1 and M2 are stitched together.

[0204] During the fingerprint recognition phase, after the user presses the fingerprint entry area, a fingerprint authentication image M0 is captured. This image is then matched against a fingerprint template in the fingerprint template library. If the match between the fingerprint authentication image M0 and the fingerprint template reaches 30%, the match is successful, and the electronic device can be unlocked and authenticated successfully. Otherwise, the electronic device is unlocked and authentication fails.

[0205] As shown in FIG12A , the results of matching the fingerprint template library in FIG12A (a) with the fingerprint authentication image M0 are as follows: the matching degree between the fingerprint authentication image M0 and the fingerprint template M1 is 20%, the matching degree between the fingerprint authentication image M0 and the fingerprint template M2 is 15%, the matching degree between the fingerprint authentication image M0 and the fingerprint template M3 is 0%, and the matching degree between the fingerprint authentication image M0 and the fingerprint template M4 is 20%. Therefore, the matching degree between the fingerprint authentication image M0 and each fingerprint template does not reach 30%, and the matching fails.

[0206] As shown in FIG12B, the results of matching the fingerprint template library in FIG12B (a) with the fingerprint authentication image M0 are as follows: the matching degree between the fingerprint authentication image M0 and the fingerprint template M1 is 20%, and the matching degree between the fingerprint authentication image M0 and the fingerprint template M1 is 20%. 1+2 The matching degree of the fingerprint authentication image M0 and the fingerprint template M3 is 40%, and the matching degree of the fingerprint authentication image M0 and the fingerprint template M3 is 0%. 1+2 The matching degree is more than 30%, and the match is successful.

[0207] Comparing Figure 12A and Figure 12B, we can see that due to the fingerprint template M 1+2 Compared with fingerprint template M1 or fingerprint template M2, fingerprint authentication image M0 includes more fingerprint information. Therefore, fingerprint authentication image M0 is matched with fingerprint template M1 and fingerprint template M2 separately, and the matching degrees are 20% and 15% respectively. 1+2 The matching degree is 40%. It can be seen that in the case where the original match could not be successful, the fingerprint template library obtained by the input method provided in the embodiment of the present application can be successfully matched.

[0208] The various method embodiments described herein may be independent solutions or may be combined according to internal logic, and all of these solutions fall within the scope of protection of this application.

[0209] It can be understood that, in the above-mentioned various method embodiments, the methods and operations implemented by the electronic device can also be implemented by components (such as chips or circuits) that can be used in the electronic device.

[0210] The above embodiments introduce the fingerprint entry method provided by the present application. It is understandable that, in order to implement the above functions, the electronic device includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0211] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it will not be described in detail here.

[0212] It should be noted that the processor in the embodiments of the present application can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiment can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The above processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0213] It is understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0214] According to the method provided in the embodiment of the present application, the embodiment of the present application also provides a computer program product, which includes: a computer program or instructions, which, when the computer program or instructions are run on a computer, enables the computer to execute the method of any one of the method embodiments.

[0215] According to the method provided in the embodiment of the present application, the embodiment of the present application also provides a computer storage medium, which stores a computer program or instruction. When the computer program or instruction is run on a computer, the computer executes the method of any one of the embodiments of the method.

[0216] According to the method provided in an embodiment of the present application, an embodiment of the present application also provides an electronic device, including a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device executes the method of any one of the embodiments of the method.

[0217] Those skilled in the art will appreciate that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented using electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0218] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0219] The computer storage medium, computer program product, and electronic device provided in the above-mentioned embodiments of the present application are all used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the corresponding beneficial effects of the method provided above, and will not be repeated here.

[0220] It should be understood that in each embodiment of the present application, the execution order of each step should be determined by its function and internal logic. The size of the sequence number of each step does not mean the order of execution and does not limit the implementation process of the embodiment.

[0221] The various sections of this specification are described in a progressive manner. Similar portions between embodiments can be referenced to each other, and each embodiment focuses on the differences between the other embodiments. In particular, the embodiments of the apparatus, computer storage medium, computer program product, and electronic device are generally similar to the method embodiments, so their descriptions are simplified. For relevant details, refer to the descriptions of the method embodiments.

[0222] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0223] The above-described embodiments of the present application do not constitute a limitation on the scope of protection of the present application.

Claims

1. A fingerprint entry method, applied to an electronic device, wherein the electronic device includes a fingerprint recognition device, characterized in that: The method comprises: In response to detecting that the fingerprint entry area is pressed, collecting an initial fingerprint image; Storing the initial fingerprint image in a fingerprint template library as a first fingerprint template; In response to the fingerprint entry area being continuously pressed, collecting a subsequent fingerprint image; Determine the similarity between the subsequent fingerprint image and a reference fingerprint template in the fingerprint template library; wherein the reference fingerprint template is the fingerprint template most recently stored in the fingerprint template library before collecting the subsequent fingerprint image; If the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than the first duplicate judgment threshold and less than the second duplicate judgment threshold, then splicing the subsequent fingerprint image and the reference fingerprint template into a second fingerprint template; and The second fingerprint template is stored in the fingerprint template library.

2. The method according to claim 1, characterized in that The method further comprises: If the similarity between the subsequent fingerprint image and the reference fingerprint template is less than or equal to the first duplicate determination threshold, the subsequent fingerprint image is stored in the fingerprint template library as a third fingerprint template.

3. The method according to claim 1, characterized in that The method further comprises: If the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than or equal to the second duplicate determination threshold, the subsequent fingerprint image is deleted.

4. The method according to claim 1, characterized in that: After storing the second fingerprint template in the fingerprint template library, the method further includes: Delete the reference fingerprint template.

5. The method according to claim 1, characterized in that The determining of the similarity between the subsequent fingerprint image and the reference fingerprint template in the fingerprint template library comprises: If the subsequent fingerprint image and the initial fingerprint image are two fingerprint images collected continuously, then the similarity between the subsequent fingerprint image and the first fingerprint template is determined.

6. The method according to claim 1, characterized in that Splicing the subsequent fingerprint image and the reference fingerprint template into a second fingerprint template, comprising: extracting a first fingerprint feature of the subsequent fingerprint image; Extracting a second fingerprint feature of the reference fingerprint template; The second fingerprint template is formed by overlapping the same parts of the first fingerprint feature and the second fingerprint feature.

7. The method according to claim 6, characterized in that The first fingerprint feature includes at least one of a detail feature, a direction feature, a point distribution feature and a frequency feature in the subsequent fingerprint image; The second fingerprint feature includes at least one of a detail feature, a direction feature, a point distribution feature and a frequency feature in the reference fingerprint template.

8. The method according to any one of claims 1 to 7, characterized in that: The determining of the similarity between the subsequent fingerprint image and the reference fingerprint template in the fingerprint template library comprises: extracting a first fingerprint feature of the subsequent fingerprint image; Extracting a second fingerprint feature of the reference fingerprint template; Based on the first fingerprint feature and the second fingerprint feature, a similarity between the subsequent fingerprint image and the reference fingerprint template is determined.

9. The method according to claim 1, characterized in that: In response to the fingerprint entry area being continuously pressed, collecting a subsequent fingerprint image comprises: In response to the user's finger continuously moving and pressing in the fingerprint entry area, a subsequent fingerprint image is collected.

10. The method according to claim 1, characterized in that In response to the fingerprint entry area being continuously pressed, collecting a subsequent fingerprint image comprises: In response to the fingerprint entry area being continuously pressed, subsequent fingerprint images are captured at a fixed frequency.

11. The method according to claim 1, characterized in that: Before collecting the initial fingerprint image, the method further includes: In response to the user's triggering operation on the fingerprint entry function, a fingerprint entry interface is displayed; the fingerprint entry interface includes a fingerprint entry guide animation and / or fingerprint entry prompt information, the fingerprint entry guide animation is used to show the fingerprint entry process of the finger moving continuously in the fingerprint entry area; the fingerprint entry prompt information is used to prompt the user a fingerprint entry method, and the fingerprint entry method includes the finger moving continuously in the fingerprint entry area; When it is detected that the fingerprint entry area is pressed, the fingerprint entry area is illuminated, a light spot is formed in the fingerprint entry area, and a fingerprint entry process animation is displayed.

12. The method according to claim 11, characterized in that The trigger operation includes any one of a touch operation, a voice input operation and a gesture input operation.

13. The method according to claim 11, characterized in that After storing the second fingerprint template in the fingerprint template library, the method further includes: Based on the second fingerprint template, the fingerprint entry process in the fingerprint entry process animation is updated.

14. The method according to claim 3, characterized in that If the similarity between the subsequent fingerprint image and the reference fingerprint template is greater than or equal to the second duplicate determination threshold, the method further includes: Display and / or play a first prompt message, where the first prompt message is used to prompt the user that the finger movement amplitude is too small.

15. The method according to claim 11, characterized in that The method further comprises: In response to detecting that the fingerprint entry area stops being pressed, the light spot in the fingerprint entry area turns off; When the fingerprint template stored in the fingerprint template library does not meet the entry completion condition, a second prompt message is displayed and / or played, and the second prompt message is used to prompt the user that the fingerprint entry operation is not completed.

16. The method according to claim 11, characterized in that The method further comprises: In response to detecting that the pressed area of ​​the fingerprint entry area is smaller than a preset area, third prompt information is displayed and / or played, where the third prompt information is used to prompt the user to move the finger to the fingerprint entry area.

17. The method according to claim 1, characterized in that After storing the second fingerprint template in the fingerprint template library, the method further includes: When the fingerprint template stored in the fingerprint template library meets the entry completion condition, displaying a fingerprint entry completion animation and / or fingerprint entry completion prompt information, wherein the fingerprint entry completion animation and / or fingerprint entry completion prompt information is used to prompt that the fingerprint entry operation has been completed; When the fingerprint template stored in the fingerprint template library does not meet the entry completion condition, continue to collect the next fingerprint image.

18. The method according to claim 15 or 17, characterized in that The fingerprint templates stored in the fingerprint template library meet the entry completion conditions including: The number of fingerprint templates stored in the fingerprint template library is greater than a template number threshold, and / or the total fingerprint area of ​​the fingerprint templates stored in the fingerprint template library is greater than a fingerprint area threshold.

19. An electronic device, characterized in that: The electronic device includes a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device executes the method as described in any one of claims 1-18.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program or instruction. When the computer program or instruction is executed, the method according to any one of claims 1 to 18 is executed.

Images