Fingerprint enrollment method and electronic device

Abstract

The present application relates to the technical field of terminals, and provides a fingerprint enrollment method and an electronic device. When enrolling a new fingerprint, an electronic device first plays a sliding enrollment guide animation to guide a user to perform fingerprint sliding enrollment. When it is detected that a finger touches a fingerprint collection area, the electronic device starts fingerprint enrollment once and collects fingerprint images. Then, when x frames of fingerprint images have been collected, the electronic device can determine whether a first preset condition is satisfied so as to determine whether the fingerprint enrollment is a sliding enrollment. When the first preset condition is satisfied, it is indicated that the fingerprint enrollment is a pressing enrollment, so that the electronic device can end the fingerprint enrollment, and add the images collected during the fingerprint enrollment to a template set, and thus the electronic device uses the template set to generate fingerprint information of the finger, thereby improving the collection efficiency of the template set corresponding to the finger, increasing the fingerprint enrollment speed, reducing the number of times of enrollment of the user, and improving fingerprint enrollment experience of the user.

Description

Fingerprint entry method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on June 30, 2023, with application number 202310803495.0 and invention name “A fingerprint entry method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a fingerprint entry method and electronic device. Background Art

[0003] With the development of electronic devices, most of them now have fingerprint recognition capabilities. To achieve this, users need to register their fingerprints in advance. Only when their fingerprints match the registered fingerprints can they unlock the device, make payments, and perform other operations. To improve the user's fingerprint registration experience, how to efficiently register user fingerprints has become a pressing issue.

[0004] Summary of the Invention

[0005] In view of this, the present application provides a fingerprint entry method and electronic device for improving the efficiency of fingerprint entry.

[0006] In a first aspect, the present application provides a fingerprint entry method, which is applied to an electronic device. The electronic device includes a fingerprint collection area, which can be set on the display screen of the electronic device, the side frame of the electronic device, or the back cover of the electronic device. When the electronic device receives a first operation input by the user, it indicates that the user wants to enter a new fingerprint. In response to the first operation, the electronic device can display a first interface, which is used to play a sliding entry guide animation to guide the user to perform sliding entry.

[0007] When it is detected that the first finger touches the fingerprint collection area of ​​the electronic device, it indicates that a fingerprint entry starts, and the electronic device starts to collect the fingerprint image corresponding to the first finger.

[0008] When the number of fingerprint images collected reaches x frames, the electronic device determines whether the electronic device meets a first preset condition to determine whether the current fingerprint registration is a press registration or a slide registration. The first preset condition includes that the similarity between the first fingerprint image and the xth fingerprint image in the x frames of fingerprint images is greater than or equal to a preset similarity, and / or that the first motion data when the electronic device collects the x frames of fingerprint images indicates that the x frames of fingerprint images were registered by the first finger pressing the fingerprint collection area, that is, the fingerprint registration result obtained by the electronic device based on the first motion data indicates press registration, and the first motion data represents the motion data collected by the motion sensor of the electronic device from the time the first finger is detected touching the fingerprint collection area to the time x frames of fingerprint images are collected; x is a positive integer greater than 1.

[0009] If the electronic device satisfies the first preset condition, indicating that the current fingerprint entry is a press entry, the current fingerprint entry can be terminated, the electronic device can stop collecting fingerprint images, and save the first target fingerprint image to the template set corresponding to the first finger; wherein the first target fingerprint image is determined based on the x frames of fingerprint images and is used for fingerprint recognition of the first finger, that is, the template set corresponding to the first finger is used to determine the fingerprint information of the first finger;

[0010] When the above-mentioned electronic device does not meet the first preset condition, it indicates that this fingerprint entry is a sliding entry, and the electronic device can continue to collect fingerprint images until the electronic device meets the second preset condition and stops collecting fingerprint images; wherein, the second preset condition may include stopping collecting fingerprint images when it is detected that the first finger leaves the fingerprint collection area, that is, until the first finger is lifted up, the current fingerprint entry ends, or the sliding entry duration is greater than the preset duration threshold, the sliding entry duration represents the time from the detection of the first finger touching the fingerprint collection area to the current time; the longer the sliding entry duration, the longer the fingerprint entry duration.

[0011] The electronic device saves the second target fingerprint image to the template set corresponding to the first finger. The second target fingerprint image is obtained based on fingerprint images collected from the time the first finger is detected touching the fingerprint collection area until the electronic device satisfies the second preset condition. For example, the second target fingerprint image is obtained from the time the first finger touches the fingerprint collection area until the first finger leaves the fingerprint collection area.

[0012] In this application, when a user's finger is detected touching a fingerprint collection area, a fingerprint registration session begins, and the electronic device collects fingerprint images. After collecting x frames of fingerprint images, the electronic device uses a first preset condition to determine whether the current fingerprint registration session is a press-type registration session or a slide-type registration session. If the current fingerprint registration session is determined to be a press-type registration session, the electronic device will not collect any more valid fingerprint information because the user is stationary on the fingerprint collection area. Therefore, the electronic device can directly terminate the current fingerprint registration session and stop collecting fingerprint images without waiting until the user lifts their finger. The first target fingerprint image collected during the current fingerprint registration session is added to the template set corresponding to the first finger, improving the collection efficiency of the template set corresponding to the first finger, thereby speeding up fingerprint registration and reducing the number of user registration attempts. If the current fingerprint registration session is determined to be a slide-type registration session, the electronic device can continue collecting fingerprint images until the user lifts their finger, terminating the current fingerprint registration session. This allows the electronic device to obtain as many valid fingerprint images as possible, achieving rapid acquisition of fingerprint images and improving fingerprint registration efficiency. Alternatively, when the sliding entry time is longer than a preset time threshold, it indicates that the sliding entry time is too long, and the fingerprint entry can be terminated to avoid the user from entering the fingerprint for a long time and ensure the efficiency of the fingerprint entry.

[0013] In a possible design, the motion sensor may include at least one of an acceleration sensor, a linear acceleration sensor, a gravity acceleration sensor, a magnetometer, a gyroscope sensor, and a rotation vector sensor.

[0014] In a possible design, the first operation may be a click operation on a new fingerprint control displayed on the electronic device.

[0015] In one possible design, since the user's finger is basically stationary on the fingerprint collection area when pressing and recording, the fingerprint portion of the finger collected by the electronic device is basically fixed. Therefore, the fingerprint portions corresponding to the above-mentioned x frames of fingerprint images are basically the same. Therefore, the electronic device can use any frame of fingerprint images in the x frames of fingerprint images, or a fingerprint image whose quality meets the preset quality standard as the above-mentioned first target fingerprint image.

[0016] In one possible design, the electronic device may directly use the fingerprint image collected during the period from when the first finger is detected touching the fingerprint collection area to when the first finger leaves the fingerprint collection area as the second target fingerprint image, or use the fingerprint image collected during this period whose quality meets a preset quality standard as the second target fingerprint image.

[0017] In one possible design, when the electronic device meets the first preset condition, the electronic device outputs a first prompt message; the first prompt message is used to prompt the user to slide to enter the fingerprint, without having to wait until the user lifts the finger before giving the prompt, thereby achieving timely feedback for press entry and timely reminder for sliding entry, so that the user can adjust the fingerprint entry method in time and use the sliding entry method with higher fingerprint entry efficiency to enter the fingerprint, thereby improving the efficiency of fingerprint entry and improving the user entry experience.

[0018] In one possible design, after a fingerprint entry is completed, the electronic device can determine whether a preset stop entry condition is met, that is, whether the fingerprint entry can be terminated. The preset stop entry condition includes at least one of the following: the number of fingerprint images in the template set corresponding to the first finger is greater than a preset stop number threshold; the total fingerprint area corresponding to the template set corresponding to the first finger is greater than a preset fingerprint area; and the number of fingerprint entry attempts is greater than a preset number; the total fingerprint area represents the area of ​​the first finger's fingerprint that has been entered.

[0019] If the preset stop entry condition is not met, it indicates that the user still needs to continue fingerprint entry, that is, the electronic device needs to start a new fingerprint entry and return to the above step of starting to collect the fingerprint image corresponding to the first finger. Alternatively, if the electronic device detects that the first finger has touched the fingerprint collection area, it returns to the above step of starting to collect the fingerprint image corresponding to the first finger, that is, restarting to collect the fingerprint image corresponding to the new fingerprint entry. If x frames of fingerprint images are collected, it is determined whether the new fingerprint entry is a sliding entry.

[0020] When the electronic device meets the preset stop entry conditions, it indicates that the fingerprint entry can be ended. The electronic device ends the entry of the fingerprint of the first finger, determines the fingerprint information of the first finger based on the template set corresponding to the first finger, and completes the entry of the fingerprint of the first finger.

[0021] In a possible design, after the fingerprint of the first finger is recorded, the electronic device receives the first operation input by the user again, indicating that the user needs to record a new fingerprint.

[0022] In response to the above-mentioned first operation, for each fingerprint that already exists in the above-mentioned electronic device (that is, each fingerprint that is recorded), the electronic device obtains the number of various abnormal recording behaviors corresponding to the fingerprint. The number of abnormal recording behaviors corresponding to the fingerprint indicates the number of times the abnormal recording behavior occurs during the fingerprint recording.

[0023] The abnormal input behavior includes at least one of pressing input, abnormal sliding speed, quick lifting, and repeated input;

[0024] For each abnormal input behavior, the electronic device may calculate the sum of the number of times that abnormal input behavior occurs for all existing fingerprints to obtain the total number of times that abnormal input behavior occurs. The higher the total number of times that abnormal input behavior occurs, the higher the probability that the abnormal input behavior occurs during the fingerprint input period.

[0025] The electronic device can then use the abnormal behavior with the highest total number of occurrences as the target abnormal behavior, or use the abnormal behavior with a total occurrence greater than a preset number of occurrences as the target abnormal behavior. The electronic device can then display a second interface, where the second interface is used to play an abnormal behavior guidance animation corresponding to the target abnormal behavior.

[0026] Wherein, each of the existing fingerprints includes the fingerprint of the first finger.

[0027] In this application, considering that in actual use, users generally record fingerprints of multiple fingers, after completing the first finger recording, the user continues to record the second finger fingerprint on the mobile phone. In order to improve the efficiency of fingerprint recording, the electronic device can play corresponding abnormal behavior guidance animations for abnormal recording behaviors that occur frequently during the user's historical fingerprint recording period, thereby achieving targeted playback of guidance animations, reducing the probability of frequent problems that occurred during historical fingerprint recording occurring during the new fingerprint recording period, and improving the effectiveness of guidance animation playback.

[0028] In a possible design, the sliding entry guide animation includes at least one of a sliding speed guide animation portion, a contact duration guide animation portion, and a sliding direction position guide animation portion.

[0029] The sliding speed guiding animation part guides the sliding speed of the user's finger to reduce the probability of the user's finger sliding too fast or too slow.

[0030] The contact duration guiding animation portion guides the length of time the user's finger contacts the fingerprint collection area, so as to reduce the probability of lifting the finger too quickly.

[0031] The sliding direction and position guiding animation portion guides the sliding direction and position of the user's finger to reduce the probability of repeated entry.

[0032] Correspondingly, the abnormal behavior guidance animation may be part of the sliding entry guidance animation.

[0033] In the case where the target abnormal entry behavior includes abnormal sliding speed, the second interface may play the sliding speed guidance animation portion; the sliding speed guidance animation portion here represents the abnormal behavior guidance animation corresponding to the target abnormal entry behavior.

[0034] In the case where the target abnormal entry behavior includes quick lifting, the above-mentioned second interface can play the contact duration guidance animation part; here, the contact duration guidance animation part represents the abnormal behavior guidance animation corresponding to the target abnormal entry behavior.

[0035] In the case where the target abnormal entry behavior includes repeated entry, the above-mentioned second interface can play the contact time guidance animation part; here, the sliding direction position guidance animation part represents the abnormal behavior guidance animation corresponding to the target abnormal entry behavior.

[0036] In the present application, when the electronic device needs to enter a new fingerprint and play a sliding entry guidance animation, the electronic device plays part of the animation content in the sliding entry guidance animation for the user's abnormal entry behavior that occurs more frequently during the historical fingerprint entry period, without having to play the animation content corresponding to the user's abnormal entry behavior that occurs less frequently or does not occur, thereby achieving targeted playback of the guidance animation, thereby achieving fast and effective playback of the guidance animation, shortening the playback time of the guidance animation, and ensuring the success of guiding the user to correctly slide and enter the fingerprint, thereby improving the user experience.

[0037] In one possible design method, when the above-mentioned target abnormal input behavior includes press input, the above-mentioned second interface can play a sliding input guide animation, or at least one of the sliding speed guide animation part, the contact time guide animation part and the sliding direction position guide animation part.

[0038] In another possible design, the abnormal behavior guidance animation corresponding to the abnormal entry behavior may also be a separate abnormal behavior guidance animation, rather than a part of the sliding entry guidance animation. The abnormal behavior guidance animation may be pre-existing in the electronic device.

[0039] In one possible design method, when the electronic device meets the above-mentioned first preset condition, it indicates that the fingerprint entry can be completed. The electronic device can vibrate to prompt the completion of the fingerprint entry. The user can lift his finger and perform the next fingerprint entry, realizing timely feedback of the press entry, so that the user can perform the next fingerprint entry in time, thereby improving the efficiency of fingerprint entry.

[0040] Correspondingly, when the fingerprint image is stopped from being collected when it is detected that the first finger leaves the fingerprint collection area, it indicates that the current fingerprint entry can be ended, and the electronic device can vibrate to prompt that the current fingerprint entry is ended. The user can start the next fingerprint entry, realizing timely feedback of the sliding entry, so that the user can perform the next fingerprint entry in time, thereby improving the efficiency of fingerprint entry.

[0041] In one possible design, when the electronic device satisfies the first preset condition, it indicates that the current press recording can be terminated, and the electronic device can stitch together the x frames of images collected during the current press recording. The electronic device can then use the stitched fingerprint image to determine the partial fingerprint information corresponding to the first finger, which represents the portion of the fingerprint recorded during the current press recording. The electronic device can then display a filled-in image of the first fingerprint based on the partial fingerprint information corresponding to the first finger, providing timely feedback on the press recording.

[0042] Accordingly, after a slide entry is completed, the electronic device can also stitch together the fingerprint images collected during this slide entry (such as the fingerprint images collected from the time the first finger is detected touching the fingerprint collection area to the time the first finger leaves the fingerprint collection area). The electronic device can then use the stitched fingerprint images to determine the partial fingerprint information corresponding to the first finger. The electronic device can then display a filled-in image of the first fingerprint based on the partial fingerprint information corresponding to the first finger, thereby providing timely feedback on the slide entry.

[0043] In one possible design, the process of determining the fingerprint entry result may include:

[0044] The electronic device can use the above-mentioned first motion data as an input parameter of the first preset model, and move the first preset model to obtain a fingerprint entry result. The fingerprint entry result indicates that the fingerprint entry method this time is sliding entry, that is, it indicates that the above-mentioned x frames of fingerprint images are entered by the first finger pressing the fingerprint collection area. Among them, the first preset model is obtained after training the network model based on the sample motion data corresponding to sliding entry and / or the sample motion data corresponding to pressing entry. The first preset model is used to identify the fingerprint entry method based on the motion data, that is, to identify the fingerprint entry method corresponding to the fingerprint image collected during the first motion data collection period, thereby realizing the identification of the fingerprint entry method.

[0045] In a possible design, whether the similarity between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to a preset similarity can be determined by the following implementation.

[0046] In one implementation, when the area of ​​the overlapping region between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to a preset area threshold, the electronic device may determine that the similarity between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to the preset similarity. When the area of ​​the overlapping region between the first fingerprint image frame and the x-th fingerprint image frame is less than the preset area threshold, the electronic device may determine that the similarity between the first fingerprint image frame and the x-th fingerprint image frame is less than the preset similarity.

[0047] In another implementation, the electronic device may use the first fingerprint image frame and the xth fingerprint image frame as input parameters of a second preset model, run the second preset model, and obtain the similarity between the first fingerprint image frame and the xth fingerprint image frame, so that the electronic device can determine whether the similarity between the first fingerprint image frame and the xth fingerprint image frame is greater than or equal to a preset similarity. Alternatively, the second preset model may directly output a similarity comparison result, which is used to indicate whether the similarity between the first fingerprint image frame and the xth fingerprint image frame is greater than or equal to a preset similarity.

[0048] In another implementation, if the number of key points that match between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to a preset number, it indicates that the degree of match between the two is high, and the electronic device may determine that the similarity between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to the preset similarity. If the number of key points that match between the first fingerprint image frame and the x-th fingerprint image frame is less than a preset number, it indicates that the degree of match between the two is low, and the electronic device may determine that the similarity between the first fingerprint image frame and the x-th fingerprint image frame is less than the preset similarity.

[0049] In one possible design, before a user triggers an electronic device to record a fingerprint, the electronic device needs to first launch a fingerprint application. Accordingly, the user can input a second operation (such as a click operation on a fingerprint control), and the electronic device receives the second operation, which is used to trigger the electronic device to launch the fingerprint application.

[0050] In response to the second operation, the electronic device may use the sensed data as an input parameter of a target recognition model, run the target recognition model, and obtain a user identity result input by the target recognition model, where the user identity result indicates whether the current user is the owner of the device, and the sensed data represents motion data generated by a motion sensor of the electronic device based on the touch operation within a target time before receiving the second operation, that is, motion data collected during the period of receiving the touch operation;

[0051] When the user identity result indicates that the current user is the owner of the device, a third interface is displayed, which includes a new fingerprint control.

[0052] If the user identity result indicates that the current user is not the owner of the device, a password input interface is displayed for the user to enter the lock screen password. When the password is entered correctly, the electronic device can display the third interface.

[0053] Among them, the above-mentioned target recognition model can be obtained by training a preset category model using sample data of the owner user (such as motion data collected by the motion sensor during the touch operation of the owner user).

[0054] In this application, since the motion data collected by the motion sensor are different when different users touch the display screen of the mobile phone, that is, the distribution characteristics of the perception data are different, after the electronic device receives the second operation input by the user, the electronic device can use the perception data to determine whether the user currently using the electronic device is the owner of the device, thereby realizing seamless recognition of the user's identity.

[0055] In one possible design, in order to improve data security, after the fingerprint of the first finger is entered, the mobile phone can encrypt and save the fingerprint information of the first finger, or, after the fingerprint of the first finger is successfully entered, if the fingerprint area corresponding to the template set corresponding to the first finger is larger than the preset fingerprint area, the mobile phone will encrypt and save the fingerprint information of the first finger to improve the security of fingerprint information storage and prevent the fingerprint information from being tampered with or obtained.

[0056] In a second aspect, the present application provides an electronic device, comprising a display screen, a memory, and one or more processors; the display screen, the memory, and the processor are coupled; the display screen is used to display an image generated by the processor, the display screen includes a folding screen, and the memory is used to store computer program code, the computer program code including computer instructions; when the processor executes the computer instructions, the electronic device executes the fingerprint entry method as described in any one of the above-mentioned first aspects.

[0057] In a third aspect, the present application provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the fingerprint entry method as described in any one of the first aspects above.

[0058] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the fingerprint entry method as described in any one of the first aspects above.

[0059] It can be understood that the beneficial effects that can be achieved by the electronic device described in the second aspect, the computer-readable storage medium described in the third aspect, and the computer program product described in the fourth aspect provided above can be referred to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] FIG1A is a schematic diagram of a fingerprint entry method according to an embodiment of the present application;

[0061] FIG1B is a schematic diagram of a sliding input direction according to an embodiment of the present application;

[0062] FIG1C is a second schematic diagram of a sliding input direction provided in an embodiment of the present application;

[0063] FIG2 is a third schematic diagram of a sliding input direction provided in an embodiment of the present application;

[0064] FIG3 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0065] FIG4 is a flow chart of a fingerprint entry method according to an embodiment of the present application;

[0066] FIG5A is a schematic diagram of a fingerprint entry interface provided in an embodiment of the present application;

[0067] FIG5B is a second schematic diagram of a fingerprint entry interface provided in an embodiment of the present application;

[0068] FIG5C is a third schematic diagram of a fingerprint entry interface provided by an embodiment of the present application;

[0069] FIG5D is a fourth schematic diagram of a fingerprint entry interface provided in an embodiment of the present application;

[0070] FIG5E is a fifth schematic diagram of a fingerprint entry interface provided in an embodiment of the present application;

[0071] FIG5F is a sixth schematic diagram of a fingerprint entry interface provided in an embodiment of the present application;

[0072] FIG6A is a first schematic diagram of a display of a press input prompt provided by an embodiment of the present application;

[0073] FIG6B is a second schematic diagram of a display of a press input prompt provided in an embodiment of the present application;

[0074] FIG7A is a schematic diagram of a fingerprint filling interface provided in an embodiment of the present application;

[0075] FIG7B is a second schematic diagram of a fingerprint filling interface provided by an embodiment of the present application;

[0076] FIG8 is a seventh schematic diagram of a fingerprint entry interface provided in an embodiment of the present application;

[0077] FIG9 is a first schematic diagram of an interface of an abnormal behavior guidance animation provided by an embodiment of the present application;

[0078] FIG10 is a second schematic diagram of an interface of an abnormal behavior guidance animation provided by an embodiment of the present application;

[0079] FIG11 is a third schematic diagram of an interface of an abnormal behavior guidance animation provided by an embodiment of the present application;

[0080] FIG12 is a fourth schematic diagram of an interface of an abnormal behavior guidance animation provided by an embodiment of the present application;

[0081] FIG13A is a schematic diagram eight of a fingerprint entry interface provided in an embodiment of the present application;

[0082] FIG13B is a ninth diagram of a fingerprint entry interface provided in an embodiment of the present application. DETAILED DESCRIPTION

[0083] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0084] In some embodiments, most electronic devices (such as mobile phones) have a fingerprint recognition function. In order to realize the fingerprint recognition function, the user needs to enter the fingerprint in advance. Taking into account factors such as the spatial structure and cost of the mobile phone, the fingerprint collection area of ​​the mobile phone may become smaller and smaller. In order to improve the efficiency of fingerprint entry, the mobile phone can use a sliding entry method to enter the fingerprint, that is, during the fingerprint entry, the user's finger can slide on the fingerprint collection area of ​​the mobile phone, and the mobile phone collects the corresponding fingerprint image for determining the fingerprint information of the finger using the collected fingerprint image. For example, the user's finger can be placed on the fingerprint collection area as shown in Figure 1A. Then, the user's finger can slide horizontally on the fingerprint collection area of ​​the mobile phone, that is, left and right, that is, along the x direction (as shown in Figure 1B), or the user's finger can slide vertically on the fingerprint collection area of ​​the mobile phone, that is, up and down, that is, along the y direction (as shown in Figure 1C).

[0085] However, most users are accustomed to using the press-to-enter method to register their fingerprints. This involves pressing their finger on the phone's fingerprint collection area (as shown in Figure 2) and then lifting it without sliding it. This method fails. The phone may require repeated guidance on how to perform the swiping method before the user can successfully swipe to register their fingerprint. This results in a longer fingerprint registration process, lower fingerprint registration efficiency, and a poor user experience.

[0086] Therefore, to address the above-mentioned issues, the present application proposes a fingerprint registration method that combines press registration and sliding registration. Considering that users are generally required to perform multiple fingerprint registrations when registering fingerprints, during fingerprint registration, when the electronic device detects that the first finger touches the fingerprint collection area of ​​the electronic device, it indicates that a fingerprint registration has started, and the electronic device can then start collecting the fingerprint image of the first finger. Afterwards, when x frames of fingerprint images are collected, the electronic device can determine whether the electronic device meets a first preset condition. The first preset condition may include that the similarity between the xth frame of fingerprint image corresponding to the first finger collected by the electronic device and the first frame of fingerprint image corresponding to the first finger is greater than a preset similarity and / or the fingerprint registration result determined by the electronic device based on the collected first motion data indicates that the first finger is stationary. The first motion data represents the motion data collected by the motion sensor of the electronic device from the time the electronic device collects the first frame of fingerprint image to the time the electronic device collects the xth frame of fingerprint image. x represents a positive integer greater than 1.

[0087] If the electronic device meets the first preset condition, indicating that the finger did not slide during the current fingerprint registration, that is, the current fingerprint registration method was press registration, the electronic device may terminate the current fingerprint registration, stop collecting fingerprint images, and add the first target fingerprint image collected by the fingerprint device to the template set corresponding to the first finger. The first target fingerprint image is determined based on the x frames of fingerprint images collected during the current fingerprint registration. The electronic device also outputs a first prompt message, which is used to prompt the user to slide to register the fingerprint, providing timely feedback on press registration and prompting timely sliding registration, so that the user can promptly adjust the fingerprint registration method and use the more efficient sliding registration method, thereby improving fingerprint registration efficiency. The electronic device also adds the fingerprint image corresponding to the press registration to the template set corresponding to the first finger, improving the collection efficiency of the template set corresponding to the first finger, thereby increasing the speed of fingerprint registration and enhancing the user registration experience.

[0088] When the electronic device does not meet the first preset condition, it indicates that the finger slid during the current fingerprint entry, that is, the fingerprint entry method is sliding entry. The electronic device can continue to collect fingerprint images until it detects that the first finger leaves the fingerprint collection area, then stops collecting fingerprint images, or stops collecting fingerprint images when the duration of this sliding entry is greater than the preset time threshold, thus ending this fingerprint entry. The sliding entry duration represents the time from the start of this fingerprint entry, that is, from the time when the first finger is detected touching the fingerprint collection area to the current time. Afterwards, the electronic device can add the fingerprint image of the first finger collected during this fingerprint entry to the template set corresponding to the first finger, so as to quickly obtain the fingerprint image, avoid the user from performing fingerprint entry for a long time, ensure the effectiveness of fingerprint entry, and improve the efficiency of fingerprint entry.

[0089] The template set corresponding to the first finger is used to generate fingerprint information corresponding to the first fingerprint.

[0090] It should be understood that the location of the fingerprint collection area shown in Figures 1A, 1B, 1C, and 2 is only an example, and the location of the fingerprint collection area can be set according to needs, and this application does not limit it. In addition, the mobile phone shape shown in Figures 1A, 1B, 1C, and 2 is only an example, and the mobile phone can also be a folding screen mobile phone (such as an external folding screen mobile phone, an internal folding screen mobile phone, a left-right folding mobile phone, a top-down folding mobile phone) or other types of mobile phones, and this application does not limit the shape of the mobile phone.

[0091] For example, the electronic device in the embodiments of the present application may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR) or virtual reality (VR) device, or other electronic device with a fingerprint collection area. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0092] For example, FIG3 shows a schematic structural diagram of the electronic device 100 .

[0093] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (subscriber).

[0094] identification module, SIM) card interface 195, etc.

[0095] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0096] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0097] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0098] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0099] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0100] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0101] The charging management module 140 is configured to receive charging input from a charger, charge the battery 142 , and also power the electronic device through the power management module 141 .

[0102] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0103] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0104] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0105] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0106] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0107] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0108] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0109] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0110] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0111] The ISP is used to process data fed back by the camera 193 .

[0112] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0113] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0114] Video codecs are used to compress or decompress digital video. The NPU is a neural-network (NN) computing processor that draws on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, to rapidly process input information and continuously learn.

[0115] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0116] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0117] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0118] The audio module 170 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals.

[0119] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0120] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0121] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0122] The headphone jack 170D is used to connect a wired headphone.

[0123] The above-mentioned sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, a magnetometer, a linear acceleration sensor, a gravity acceleration sensor, a rotation vector sensor, etc.

[0124] The pressure sensor is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor can be located on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to the pressure sensor, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation using the pressure sensor. The electronic device 100 can also calculate the location of the touch based on the detection signal from the pressure sensor. In some embodiments, touch operations applied to the same touch location but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, an instruction to create a new short message is executed.

[0125] The gyroscope sensor can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor. The gyroscope sensor can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor can also be used for navigation and somatosensory game scenes.

[0126] The accelerometer can detect the magnitude of acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0127] The fingerprint sensor is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application lock, fingerprint photo taking, fingerprint call answering, etc. In some embodiments, the fingerprint sensor transmits the collected fingerprint image to the processor, and the processor performs fingerprint entry or fingerprint unlocking operations based on the fingerprint image. Optionally, the fingerprint sensor can be an optical fingerprint sensor, a capacitive fingerprint sensor, an ultrasonic fingerprint sensor, etc. In an embodiment of the present application, the fingerprint sensor can be set under the display screen of the electronic device or at a specified position on the body of the electronic device (such as the side of the body shown in Figure 1A above), and the position where the fingerprint sensor is set corresponds to the fingerprint collection area.

[0128] A touch sensor, also known as a "touch panel," can be provided on the display screen 194. The touch sensor and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor is used to detect touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be provided on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0129] Bone conduction sensors can pick up vibration signals.

[0130] The magnetometer can be used to test the strength and direction of the magnetic field and locate the orientation of electronic devices. The principle of the magnetometer 180D is similar to that of a compass and can measure the angle between the current electronic device and the four directions of east, south, west and north.

[0131] The linear acceleration sensor is the data obtained by the acceleration sensor after subtracting the influence of gravity.

[0132] The gravity acceleration sensor can sense the change of acceleration force, which is the force acting on the electronic device when it is accelerating.

[0133] The rotation vector in the rotation vector sensor represents the direction of the electronic device and is a data obtained by mixing the coordinate axis and angle.

[0134] In one embodiment, the motion sensor may include at least one of the above-mentioned acceleration sensor, linear acceleration sensor, gravity acceleration sensor, magnetometer, gyroscope sensor, and rotation vector sensor.

[0135] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0136] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, fingerprint collection, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0137] The indicator 192 may be an indicator light. The SIM card interface 195 is used to connect a SIM card. The electronic device 100 may support one or N SIM card interfaces, where N is a positive integer greater than one.

[0138] The present application provides a fingerprint entry method. During fingerprint entry on an electronic device, when the electronic device detects that the user's finger is touching the fingerprint collection area of ​​the mobile phone, it indicates that a fingerprint entry has started, and the mobile phone can start collecting fingerprint images. Afterwards, the mobile phone can use the collected fingerprint image to determine whether the user's finger is sliding, that is, to determine the user's fingerprint entry method, so that the mobile phone adds the fingerprint image to the template set corresponding to the finger according to the fingerprint entry method. The template set is used to determine the fingerprint information of the finger and successfully enter the fingerprint. And during fingerprint entry, the electronic device can enter fingerprints based on both the sliding entry method and the pressing entry method, thereby realizing the fusion of sliding entry and pressing entry, and improving the efficiency of fingerprint entry.

[0139] The following describes a fingerprint registration method provided by an embodiment of the present application in detail, using the example of a mobile phone as an example, where the fingerprint collection area is located on the side of the electronic device (such as the location of the fingerprint collection area shown in Figures 1A, 1B, or 1C). As shown in Figure 4, the method may include steps S301-S316.

[0140] S301: The mobile phone receives a first operation, which triggers the mobile phone to add a fingerprint.

[0141] S302. In response to the first operation, the mobile phone displays interface 1, which displays a sliding input guidance animation.

[0142] For example, the first operation may be a user triggering operation (such as a click operation) on a newly created fingerprint control. The above slide entry guide animation prompts how to perform slide entry.

[0143] For example. The user clicks on the icon 50 of the settings application as shown in Figure 5A. In response to the click operation of the icon 50 of the settings application, the mobile phone can display the settings interface 51 as shown in Figure 5B. When the user wants to add a fingerprint, the user can click on the biometric identification and password control 52 on the settings interface 51. In response to the click operation of the biometric identification and password control 52, the mobile phone can display the interface 53 as shown in Figure 5C, which includes a fingerprint control 54. Afterwards, the user can click on the fingerprint control 54 on the interface 53. In response to the click operation of the fingerprint control 54, the mobile phone can display the password input interface as shown in Figure 5D for the user to enter the lock screen password. When the lock screen password entered by the user is correct, the mobile phone can display the interface 55 as shown in Figure 5E. The interface 55 (or the third interface) includes a new fingerprint control 56, which is used to trigger the mobile phone to add a new fingerprint. Afterwards, when the user clicks on the new fingerprint control 56, the mobile phone may display an interface 1 (or a first interface) as shown in FIG5F in response to the click operation of the new fingerprint control 56. The interface 1 displays the screen in the slide entry guide animation, that is, the mobile phone plays the slide entry guide animation on the interface 1. Here, the user's click operation on the new fingerprint control 56 may be the above-mentioned first operation.

[0144] It should be understood that the sliding entry triggering animation shown in Figure 5F above is a multi-frame animation screen. The process shown in Figures 5A to 5F above is only an example of the fingerprint adding process, and this application does not display it. In addition, the above-mentioned click operation on the new fingerprint control is only an example of the first operation. The first operation can also be other triggering operations. For example, the first operation can be the user inputting a first preset gesture in the relevant interface, such as inputting an S-shaped gesture in the interface shown in Figure 5C above. The first preset gesture is used to trigger the mobile phone display interface 1. Among them, the first preset gesture can be pre-configured in the mobile phone. In addition, the mobile phone can prompt the user of the function triggered by the first preset gesture in the relevant interface. This application does not limit the specific operation type of the above-mentioned first operation.

[0145] S303: When it is detected that the first finger touches the fingerprint collection area of ​​the mobile phone, the mobile phone starts to collect the fingerprint image corresponding to the first finger.

[0146] In an embodiment of the present application, during the playback of the above-mentioned sliding entry guide animation, or after the playback of the above-mentioned sliding entry guide animation ends, if it is detected that one of the user's fingers (i.e., the first finger) touches the fingerprint collection area of ​​the mobile phone, indicating that a fingerprint entry has started, the mobile phone can start collecting fingerprint images to obtain the fingerprint image of the first finger.

[0147] S304: After collecting x frames of fingerprint images corresponding to the first finger, the mobile phone determines whether the similarity between the first frame of fingerprint image and the xth frame of fingerprint image in the x frames of fingerprint images is greater than or equal to a preset similarity.

[0148] Here, x is a positive integer greater than 1, such as x is 10.

[0149] In an embodiment of the present application, after x frames of fingerprint images have been continuously collected, the mobile phone can determine the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image in the x frames of fingerprint image to determine whether the user's finger has slid, that is, to determine whether the current fingerprint entry method is sliding entry or pressing entry. In the case where the similarity between the above-mentioned first frame of fingerprint image and the x-th frame of image is greater than or equal to the preset similarity, it indicates that the similarity between the first frame of fingerprint image and the x-th frame of image is high, and the user's finger has not slid, that is, the probability of being in a stationary state is high, which also indicates that the probability of this fingerprint entry method being pressing entry is high. Therefore, the mobile phone can use the collected x frames of fingerprint image as the fingerprint image corresponding to one fingerprint entry, and the mobile phone can execute S305.

[0150] When the similarity between the first fingerprint image and the x-th fingerprint image in the above x-frame fingerprint images is less than the preset similarity, it indicates that the similarity between the first fingerprint image and the x-th fingerprint image is low, and the user's finger slides, that is, the probability of being in a sliding state is high, which also indicates that the probability of sliding entry is high. Therefore, the mobile phone can continue to collect fingerprint images until the user's finger is lifted, and then end the fingerprint entry. The mobile phone can execute S309.

[0151] In some embodiments, the mobile phone can use the area of ​​the overlapping region between the fingerprint images to determine the similarity between the fingerprint images. For example, the mobile phone can determine whether the area of ​​the overlapping region between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to a preset area threshold. If the area of ​​the overlapping region is greater than or equal to the preset area threshold, the mobile phone can determine that the similarity between the first fingerprint image frame and the x-th fingerprint image frame is greater than or equal to the preset similarity. If the area of ​​the overlapping region is less than the preset area threshold, the mobile phone can determine that the similarity between the first fingerprint image frame and the x-th fingerprint image frame is less than the preset similarity.

[0152] Optionally, the area of ​​the overlapping region may be expressed by a ratio, and the corresponding preset area threshold may also be expressed by a ratio. For example, the preset area threshold is 90%.

[0153] In other embodiments, the mobile phone can use a model to determine the similarity between fingerprint images. For example, the mobile phone can input the above-mentioned first frame fingerprint image and the x-th frame fingerprint image into model 1 (or called the second preset model), and model 1 can calculate the similarity between the first frame fingerprint image and the x-th frame fingerprint image and output the similarity. After obtaining the similarity output by model 1, the mobile phone can compare the similarity with the preset similarity to determine whether the similarity is greater than the preset similarity. Alternatively, model 1 can directly output a similarity comparison result, which indicates whether the similarity between the first frame fingerprint image and the x-th frame fingerprint image is greater than or equal to the preset similarity.

[0154] The aforementioned model 1 is a network model that has been trained using sample fingerprint images (e.g., fingerprint images with a similarity greater than or equal to a preset similarity), and can be used to calculate the similarity between fingerprint images. Optionally, after obtaining the similarity between the fingerprint images, the model 1 can also compare the similarity with the preset similarity to directly output the corresponding similarity comparison result.

[0155] Alternatively, the mobile phone may determine the similarity between the first fingerprint image frame and the xth fingerprint image frame using other methods. For example, the mobile phone may determine the number of matching key points between the fingerprint images, where the number of matching key points represents the similarity between the fingerprint images. Subsequently, the mobile phone may determine whether the similarity between the fingerprint images is greater than or equal to a preset similarity by determining whether the number of matching key points is greater than or equal to a preset number. This application does not limit the method for determining the similarity between fingerprint images.

[0156] S305: The mobile phone stops collecting fingerprint images and determines a first sub-template corresponding to the first finger based on the x frames of fingerprint images.

[0157] The first sub-template (or referred to as the first target fingerprint image) corresponding to the first finger is used to determine the partial fingerprint information corresponding to the first finger.

[0158] S306. The mobile phone adds the first sub-template corresponding to the first finger to the template set corresponding to the first finger.

[0159] In an embodiment of the present application, after the x-th frame of fingerprint image corresponding to the first finger is collected, if the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image is greater than or equal to a preset similarity, it indicates that the user's finger is likely to be stationary on the fingerprint collection area of ​​the mobile phone, that is, the user is currently pressing to record the fingerprint. The mobile phone can stop collecting fingerprint images and use the collected x-frame fingerprint images as the current fingerprint recording, that is, the fingerprint image corresponding to the current pressing recording. Accordingly, the x-frame fingerprint images can be used as the first sub-template corresponding to the first finger. Alternatively, due to the high similarity between the x-frame fingerprint images, the mobile phone can use any one of the x-frame fingerprint images as the first sub-template corresponding to the first finger.

[0160] In some embodiments, a trusted application (TA) in a mobile phone, such as a fingerprint TA (or fingerprint application), can send a stop capture instruction to the fingerprint device, which triggers the fingerprint device to stop capturing fingerprint images. Furthermore, the fingerprint TA can report a first message, such as to a processor, indicating the end of the current press recording.

[0161] S307: The mobile phone outputs a first prompt message, where the first prompt message is used to prompt the user to slide and enter the fingerprint.

[0162] For example, in order to improve the efficiency of fingerprint entry, when the mobile phone determines that the fingerprint entry method this time is press entry, the mobile phone can display a first prompt message, and / or voice output the first prompt message to prompt the user to use the sliding entry method to enter the fingerprint, thereby realizing timely reminder of sliding entry.

[0163] In some embodiments, the mobile phone may display the first prompt information through the interface, that is, the first prompt information is part of the interface (as shown in FIG6A , first prompt information 60). Alternatively, the mobile phone may display the first prompt information through a pop-up window (as shown in FIG6B , first prompt information 61).

[0164] S308. The mobile phone displays an interface 2 based on the first sub-template corresponding to the first finger. The interface 2 displays a filled image of the first fingerprint.

[0165] In some embodiments, when there are multiple fingerprint images in the first sub-template corresponding to the first finger, the mobile phone can splice the first sub-template corresponding to the first finger. Afterwards, the mobile phone can use the spliced ​​fingerprint image to determine the partial fingerprint information corresponding to the first finger, and the partial fingerprint information corresponding to the first finger represents the fingerprint part recorded in this fingerprint recording. Then, the mobile phone can display interface 2, and interface 2 includes a fingerprint display area, and the fingerprint display area is used to display the fingerprint lines recorded subsequently. Correspondingly, the mobile phone can display the fingerprint lines recorded by this press in the fingerprint display area in a first display mode, and the fingerprint lines indicate the partial fingerprint information corresponding to the first finger, realizing dynamic fingerprint filling, so that the user can know the fingerprint part that has been recorded.

[0166] For example, the fingerprint display area displays an initial fingerprint image (fingerprint image 70 as shown in FIG7A ). Subsequently, the mobile phone can change the color of some lines in the initial fingerprint image based on the partial fingerprint information corresponding to the first finger, that is, based on the fingerprint pattern recorded by the current press, and display the latest fingerprint image (fingerprint image 71 as shown in FIG7B ). It should be understood that the dotted line in fingerprint image 71 represents the fingerprint portion that has been recorded, and the color of the dotted line portion in fingerprint image 71 is different from the color of the solid line portion.

[0167] In other embodiments, due to the high similarity between the x frames of fingerprint images, the mobile phone does not need to stitch the x frames of fingerprint images together. Instead, it can directly select a fingerprint image from the x frames of fingerprint images. The mobile phone can then use the selected fingerprint image to determine the partial fingerprint information corresponding to the first finger. For example, the mobile phone can select the first fingerprint image, the xth fingerprint image, or any other fingerprint image from the fingerprint images corresponding to the current press recording, and use the selected fingerprint image to determine the partial fingerprint information corresponding to the first finger, thereby achieving rapid determination of fingerprint information.

[0168] In some embodiments, the mobile phone can activate a motor to vibrate when a fingerprint entry is completed. Alternatively, the motor vibration can be used to prompt the user to lift their finger to proceed to the next fingerprint entry.

[0169] In some embodiments, at the end of a fingerprint entry, the mobile phone may not perform the filling animation, that is, the mobile phone may not execute the above S308.

[0170] The above describes the process of the phone determining that the fingerprint registration method is press registration based on the first and xth fingerprint images. The following will continue to describe the process of the phone processing when the fingerprint registration method is slide registration.

[0171] S309: The mobile phone continues to collect the fingerprint image of the first finger until the mobile phone meets the second preset condition and stops collecting the fingerprint image.

[0172] The second preset condition includes detecting that the first finger has left the fingerprint collection area, or that the sliding entry duration exceeds a preset threshold. The sliding entry duration represents the time elapsed from the detection of the first finger touching the fingerprint collection area to the current time, that is, the time elapsed from the start of the current fingerprint entry to the current time. The longer the sliding entry duration, the longer the fingerprint entry duration.

[0173] In an embodiment of the present application, after the xth frame of fingerprint image corresponding to the first finger is captured, if the similarity between the first frame and the xth frame of fingerprint image is less than a preset similarity, it indicates that the user's finger is unlikely to be stationary on the fingerprint collection area of ​​the mobile phone, that is, the user's finger is sliding, and the user's current fingerprint registration method is sliding registration. The mobile phone does not need to end the current fingerprint registration and can continue to collect fingerprint images corresponding to the current fingerprint registration. When the user's finger is detected to have left the fingerprint collection area, the mobile phone stops collecting fingerprint images. In other words, when the fingerprint image collection stops when the user's finger is lifted, it indicates that the current sliding registration has ended. The mobile phone can stop collecting fingerprint images. Or, if the current sliding registration lasts too long, the mobile phone can automatically end the current fingerprint registration and stop collecting fingerprint images. This avoids the user's fingerprint registration process from taking a long time, ensuring fingerprint registration efficiency. It also avoids the first finger being pressed on the fingerprint collection area for a long time during the sliding process, which causes the mobile phone to collect fingerprint images with higher similarity, ensuring the effectiveness of fingerprint image collection, and thus improving fingerprint registration efficiency.

[0174] S310: The mobile phone uses the fingerprint image collected from the time the first finger touches the fingerprint collection area until the mobile phone meets the second preset condition as the second sub-template corresponding to the first finger.

[0175] S311. The mobile phone adds the second sub-template corresponding to the first finger to the template set corresponding to the first finger.

[0176] For example, the phone can consider the time from the first finger touching the fingerprint collection area to the time the first finger leaves the fingerprint collection area as one sliding entry, or the time from the first finger touching the fingerprint collection area to the time the sliding entry duration exceeds a preset threshold as one sliding entry. Accordingly, the fingerprint image collected during this sliding entry process can be used as the fingerprint image corresponding to this sliding entry, that is, the second sub-template (or second target fingerprint image). Afterwards, the phone can add each fingerprint image in the above second sub-template to the template set corresponding to the first finger.

[0177] In some embodiments, if the mobile phone determines that the fingerprint entry is a sliding entry, it can continue to collect fingerprint images. During the collection process, the mobile phone can determine whether the sliding entry duration is greater than a preset duration threshold. If it is greater, it indicates that the sliding entry duration is too long, and the mobile phone can end the sliding entry, that is, stop collecting fingerprint images. If it is less than or equal to the preset duration threshold, the mobile phone can continue to collect fingerprint images. If the user lifts the first finger, even if the sliding entry duration is less than or equal to the preset duration threshold, the mobile phone can also end the sliding entry.

[0178] In some embodiments, the phone can determine whether there is any abnormal behavior in the current swipe entry based on the second sub-template corresponding to the first finger. If there is abnormal swiping behavior, the phone can output a second prompt message regarding the abnormal swiping behavior to inform the user of the problem with the current swiping entry, thereby guiding the user to correctly perform swiping fingerprint entry and improving fingerprint entry efficiency.

[0179] The abnormal sliding behavior may include at least one of: sliding too slowly, sliding too quickly, lifting too quickly, and repeated entry. Lifting too quickly indicates that the duration of the current sliding entry was short, that is, the contact time between the user's finger and the fingerprint collection area was short. Repeated entry indicates that the fingerprint portion of the current sliding entry already exists.

[0180] Correspondingly, for a sliding speed that is too fast, the second prompt information is used to prompt to reduce the sliding speed. For example, the second prompt information for a sliding speed that is too fast may be "Your finger is sliding too fast, please slow down the sliding speed to enter the data."

[0181] For a sliding speed that is too slow, the second prompt message is used to prompt to increase the sliding speed. For example, the second prompt message for a sliding speed that is too slow may be "your finger is sliding too slowly, please increase the sliding speed slightly to enter the data."

[0182] For lifting the finger too quickly, the second prompt information is used to prompt you to increase the contact time between the finger and the fingerprint collection area. For example, the second prompt information for lifting the finger too quickly can be "Your finger was lifted too quickly, please increase the contact time between your finger and the fingerprint collection area."

[0183] For repeated entry, the second prompt information is used to prompt the user to enter the fingerprint from different angles and directions. For example, the second prompt information for repeated entry may be "Enter the fingerprint from different angles and directions to ensure complete entry."

[0184] In some embodiments, the mobile phone can use the time of the current sliding entry to determine whether there is an abnormal sliding behavior of lifting too quickly in this sliding entry. The mobile phone can obtain a first sliding duration, which represents the time from the user's finger touching the fingerprint collection area of ​​the mobile phone to the user's finger leaving the fingerprint collection area of ​​the mobile phone. If the first sliding duration is less than the preset sliding duration, the mobile phone can determine that there is an abnormal sliding behavior of lifting too quickly in this sliding entry. If the first sliding duration is greater than or equal to the preset sliding duration, the mobile phone can determine that there is no abnormal sliding behavior of lifting too quickly in this sliding entry.

[0185] Alternatively, the mobile phone can use the number of fingerprint images corresponding to a sliding entry to determine whether there is any abnormal sliding behavior of lifting the finger too quickly during this sliding entry. The mobile phone can determine whether the number of fingerprint images in the second sub-template corresponding to the above-mentioned first finger is less than the preset number of images. If it is less than the preset number of images, it indicates that the number of fingerprint images collected during this sliding entry is relatively small, and the mobile phone can determine that there is an abnormal sliding behavior of lifting the finger too quickly during this sliding entry. If it is greater than or equal to the preset number of images, the mobile phone can determine that there is no abnormal sliding behavior of lifting the finger too quickly during this sliding entry.

[0186] Alternatively, the mobile phone may determine whether the slide entry process involves an abnormal lift-up process by other means. For example, the mobile phone may splice the fingerprint image in the second sub-template corresponding to the slide entry process, and use the area and number of pixels of the fingerprint image in the spliced ​​image to determine whether the lift-up process involves an abnormal lift-up process.

[0187] In some embodiments, the mobile phone can use the overlapping area between adjacent fingerprint images in the second sub-template corresponding to a single swipe entry to determine whether the current swipe entry has abnormal behavior of sliding too fast or too slow. When the number of adjacent fingerprint images with an overlapping area greater than a first preset area threshold is too large (e.g., greater than a first number), the mobile phone can determine that the current swipe entry has abnormal behavior of sliding too slowly.

[0188] When the number of adjacent fingerprint images with an overlapping area smaller than a second preset area threshold is excessive (e.g., greater than the second number), the mobile phone may determine that the current swipe entry involves abnormal swiping behavior, such as swiping too fast. The first preset area threshold is greater than the second preset area threshold, and the first number and the second number may be the same or different.

[0189] In some embodiments, the phone can splice the second sub-template corresponding to a single swipe entry. The phone can then use the spliced ​​image to determine the partial fingerprint information corresponding to the first finger recorded in this swipe entry. If the phone already has partial fingerprint information corresponding to the first finger, indicating that the user has recorded a duplicate fingerprint, the phone can determine that this swipe entry has experienced abnormal duplicate entry behavior.

[0190] In some embodiments, when a swipe entry corresponding to a first finger exhibits abnormal swiping behavior, the phone may add the second sub-template corresponding to this swiping entry to the template set corresponding to the first finger to improve entry efficiency. Alternatively, to ensure fingerprint entry accuracy, the phone may not add the second sub-template corresponding to this swiping entry to the template set for the first fingerprint and may delete the second sub-template corresponding to this swiping entry.

[0191] S312. The mobile phone displays interface 3 based on the second sub-template corresponding to the first finger. Interface 3 displays the filled image of the first fingerprint.

[0192] The implementation process of S312 may refer to the implementation process of S308 above, and will not be described in detail here.

[0193] In some embodiments, at the end of a fingerprint entry, the mobile phone may not perform the filling animation, that is, the mobile phone may not execute the above S312.

[0194] In some embodiments, when a sliding entry is completed, the mobile phone can call a motor to vibrate to prompt the completion of the fingerprint entry and proceed to the next fingerprint entry.

[0195] S313: The mobile phone determines whether the mobile phone meets the preset stop recording condition.

[0196] In an embodiment of the present application, after a fingerprint entry is completed, such as after a press entry is completed, or after a slide entry is completed, the mobile phone can determine whether the mobile phone currently meets the preset stop entry conditions, that is, whether the fingerprint entry can be ended, that is, whether a new fingerprint entry needs to be started.

[0197] When the mobile phone does not meet the preset stop entry condition, it indicates that the user still needs to continue fingerprint entry, that is, the mobile phone needs to start a new fingerprint entry, and the mobile phone can execute S314.

[0198] When the mobile phone meets the preset stop entry condition, it indicates that the fingerprint entry can be ended and there is no need to start a new fingerprint entry. The mobile phone can execute S315.

[0199] In some embodiments, the above-mentioned preset stop entry conditions may include at least one of the following: the number of fingerprint images in the template set corresponding to the first finger is greater than a preset stop number threshold, the fingerprint area corresponding to the template set corresponding to the first finger is greater than a preset fingerprint area, and the number of fingerprint entry times is greater than a preset number.

[0200] The fingerprint area corresponding to the template set corresponding to the first finger represents the area of ​​the recorded fingerprint portion of the first finger. The process of determining the total fingerprint area corresponding to the template set corresponding to the first finger may include: the mobile phone may first stitch together all fingerprint images in the template set corresponding to the first finger. The mobile phone may then use the stitched images to extract fingerprint information and determine the fingerprint area, thereby obtaining the fingerprint area corresponding to the template set corresponding to the first finger.

[0201] The above-mentioned number of entry times represents the sum of the number of sliding entry times and the number of pressing entry times.

[0202] It should be noted that, when the mobile phone meets the condition that the total fingerprint area corresponding to the template set corresponding to the first finger is greater than the preset fingerprint area, it indicates that the fingerprint of the first finger has been successfully recorded. When the mobile phone meets the condition that the number of fingerprint images in the template set corresponding to the first finger is greater than the preset stop number threshold, or when the mobile phone meets the condition that the number of fingerprint recordings is greater than the preset number, it is still impossible to determine whether the fingerprint of the first finger has been successfully recorded. The mobile phone can continue to determine whether the first finger has been successfully recorded based on the fingerprint area corresponding to the template set corresponding to the first finger. For example, the mobile phone can determine whether the fingerprint area corresponding to the template set corresponding to the first finger is greater than the preset fingerprint area. If it is greater than the preset fingerprint area, it indicates that the fingerprint of the first finger has been successfully recorded. If it is less than or equal to the preset fingerprint area, it indicates that the fingerprint of the first finger has not been successfully recorded, and the mobile phone can prompt the user to re-enter the first finger.

[0203] S314: The mobile phone starts a new fingerprint entry, collects a new fingerprint image corresponding to the first finger, and returns to the above S304.

[0204] In an embodiment of the present application, if the mobile phone does not meet the preset stop entry conditions, the mobile phone can restart the entry. Specifically, upon detecting that the user's first finger has touched the fingerprint collection area of ​​the electronic device, the mobile phone restarts the collection of the first finger's fingerprint image to obtain a new fingerprint image corresponding to the first finger. Then, when the number of new fingerprint images collected reaches x frames, the similarity between the first and xth fingerprint images in the new x frames of fingerprint images is used to determine whether the current fingerprint entry method is slide entry or press entry, thereby performing the corresponding operation based on the fingerprint entry method.

[0205] In some embodiments, the above-mentioned method of determining the fingerprint entry method of the first finger by the similarity between the first frame fingerprint image and the x-th frame fingerprint image is only an example, and the mobile phone can also determine the entry method this time by other methods. For example, the mobile phone can use the motion data collected by the motion sensor of the mobile phone to determine the fingerprint entry method this time. Generally speaking, the degree of influence of press entry and slide entry on the motion state of the mobile phone is different. Since the finger is stationary on the fingerprint collection area during press entry, and the finger is sliding on the fingerprint collection area during slide entry, compared with press entry, the slide entry has a greater degree of influence on the motion state of the mobile phone, and the posture change of the mobile phone is greater, so that the motion data collected by the mobile phone during press entry is different from the motion data collected by the mobile phone during slide entry.

[0206] Therefore, during a fingerprint entry process, the mobile phone can use the motion data collected by the mobile phone's motion sensor to distinguish whether the fingerprint entry is a sliding entry or a pressing entry. For example, the mobile phone can obtain the first motion data collected by the motion sensor when it detects that the user's first finger touches the fingerprint collection area, that is, after a fingerprint entry starts. The first motion data refers to the motion data collected by the mobile phone's motion sensor within a preset time period from the time the mobile phone detects that the user's finger touches the fingerprint collection area, or the first motion data refers to the motion data collected from the time the mobile phone detects that the user's finger touches the fingerprint collection area to the time the mobile phone collects the xth frame of fingerprint image.

[0207] Afterwards, the mobile phone can input the above-mentioned first motion data into Model 2 (or referred to as the first preset model) and obtain the input method result output by Model 2. The input method result indicates whether the fingerprint input method this time is sliding input or pressing input, thereby determining the fingerprint input method. Model 2 is obtained by training the network model based on relevant sample motion data (such as sample motion data corresponding to pressing input and / or sample motion data corresponding to sliding input).

[0208] The motion sensor may include at least one of a gyroscope sensor, an acceleration sensor, a magnetometer, a linear acceleration sensor, a gravity acceleration sensor, and a rotation vector sensor.

[0209] The gyroscope sensor is used to collect the motion posture data of the mobile phone.

[0210] The accelerometer is used to detect the acceleration and gravity of the phone during movement. Specifically, it can detect the acceleration and gravity along three axes (X, Y, and Z). For example, the accelerometer can detect the tilt direction of the phone.

[0211] A magnetometer measures magnetic field strength and direction. For example, when a phone is held horizontally, the magnetometer can detect the four directions of east, south, west, and north, thus providing a compass function. Another example is when the phone is held vertically, the magnetometer can detect the phone's three-dimensional orientation.

[0212] The linear acceleration sensor is used to detect the magnitude and direction of the offset velocity to which the mobile phone is subjected when it is in a non-stationary state.

[0213] The gravity accelerometer is used to detect the phone's posture and changes in gravity. For example, when a user slides their finger over the fingerprint collection area of ​​the phone, the phone's holding angle and gravity will change accordingly, and the gravity accelerometer in the phone will collect the corresponding change data.

[0214] The rotation vector sensor is used to detect the phone's angular and three-axis data. For example, the rotation vector sensor can detect angular changes and relative orientation changes.

[0215] In some embodiments, after receiving a first operation input by the user, the mobile phone (such as the fingerprint TA on the finger) can trigger the motion sensor to collect motion data in response to the first operation, or trigger the motion sensor to collect motion data when the first fingerprint entry begins. Alternatively, the motion sensor can collect motion data in real time or periodically, and the mobile phone can cache the motion data for a period of time, such as through a sliding window cache. When it is necessary to determine the fingerprint entry method for this time, the first motion data is read from the cache.

[0216] In an embodiment of the present application, the mobile phone can select a method for determining the fingerprint entry method according to demand. For example, in order to accurately determine the fingerprint entry method, the mobile phone can determine the fingerprint entry method through the first frame of fingerprint image and the xth frame of fingerprint image collected during the current fingerprint entry. In addition, the mobile phone can also use the motion data collected by the motion sensor to determine the fingerprint entry method while judging through the first frame of fingerprint image and the xth frame of fingerprint image collected during the current fingerprint entry. When the fingerprint entry methods determined by the two methods are consistent, the mobile phone can directly determine that the fingerprint entry method of this time is the fingerprint entry method determined by any method. When the fingerprint entry methods determined by the two methods are consistent, the mobile phone can use the default fingerprint entry method (such as sliding entry or pressing entry) as the fingerprint entry method.

[0217] S315. The mobile phone stops recording fingerprints.

[0218] S316. The mobile phone determines the fingerprint information of the first finger using the template set corresponding to the first finger.

[0219] In the embodiment of the present application, when the mobile phone meets the preset stop entry conditions, it indicates that the fingerprint collection of the first finger has ended, and the mobile phone no longer needs to collect fingerprint images. The mobile phone can exit the current new fingerprint interface and display the interface shown in Figure 5F above. The mobile phone can also stitch all fingerprint images in the template set corresponding to the first finger, so as to use the stitched image to determine the fingerprint information of the first finger.

[0220] In some embodiments, in order to improve data security, after the fingerprint of the first finger is entered, the mobile phone can encrypt and save the fingerprint information of the first finger, or, after the fingerprint of the first finger is successfully entered, if the fingerprint area corresponding to the template set corresponding to the first finger is larger than the preset fingerprint area, the mobile phone will encrypt and save the fingerprint information of the first finger to improve the security of fingerprint information storage and prevent the fingerprint information from being tampered with or obtained.

[0221] In some embodiments, the sliding entry guidance animation played when recording the fingerprint of the first finger may include a sliding speed guidance animation portion, a contact duration guidance animation portion, and a sliding direction and position guidance animation portion.

[0222] Among them, the sliding speed guidance animation part guides the sliding speed of the user's finger. For example, the sliding speed guidance animation part guides the sliding speed of the user's finger by showing the changes in the position of the user's finger on the fingerprint sensing area (as shown in the multi-frame picture of the sliding entry guidance animation in Figure 9), so as to reduce the probability of the user's finger sliding too fast or too slow.

[0223] The contact duration guidance animation section guides the user's finger on the fingerprint collection area for a certain period of time (as shown in one frame of the contact duration guidance animation section in Figure 10), thereby reducing the probability of lifting the finger too quickly. Alternatively, the contact duration guidance animation section can be the same as the sliding speed guidance animation section mentioned above, guiding the user's finger sliding speed by showing the changes in the position of the user's finger on the fingerprint sensing area.

[0224] The sliding direction and position guiding animation portion guides the sliding direction and sliding position of the user's finger (such as the multiple frames of the sliding direction and position guiding animation portion shown in FIG. 11 or FIG. 12 ) to reduce the probability of repeated entry.

[0225] Generally speaking, in actual use, users will record the fingerprints of multiple fingers. After the first finger is recorded, the user continues to record another finger (or called the second finger) on the mobile phone. In order to improve the efficiency of fingerprint recording, the mobile phone can play the corresponding sliding recording guide animation part for the abnormal recording behavior during the fingerprint recording of the first finger, so as to achieve targeted playback of the sliding recording guide animation and improve the effectiveness of the guide animation playback. Among them, the abnormal recording behavior may include at least one of pressing recording, abnormal sliding speed, lifting too fast (or described as lifting quickly) and repeated recording. Among them, the abnormal sliding speed may include sliding speed too fast and / or sliding speed too slow.

[0226] For example, after the fingerprint entry of the first finger is completed, the mobile phone receives the first operation again (such as the user clicks on the new fingerprint control as shown in Figure 8), indicating that the mobile phone needs to enter a new fingerprint. In response to the first operation, for each finger whose fingerprint has been entered (or described as each fingerprint that already exists for the mobile phone), the mobile phone can count the number of various abnormal entry behaviors that occur during the fingerprint entry, and obtain the number of each abnormal entry behavior corresponding to the fingerprint. Afterwards, for each abnormal entry behavior, the mobile phone can calculate the sum of the number of such abnormal entry behaviors corresponding to all existing fingerprints, and obtain the total number of such abnormal entry behaviors. The higher the total number of a certain abnormal entry behavior, the higher the probability of such abnormal entry behavior occurring during the fingerprint entry period.

[0227] For example, the fingerprint that already exists (i.e., has been recorded) includes the fingerprint of the first finger (fingerprint 1 as shown in Figure 8). Abnormal recording behavior includes press recording, and the mobile phone can count the number of press recordings that occur during the fingerprint recording of the first finger to obtain the total number of press recordings. For another example, the recording behavior includes abnormal sliding speed, and the abnormal sliding speed includes sliding too fast and sliding too slow. The mobile phone can count the number of times the sliding speed is too fast and the number of times the sliding speed is too slow during the fingerprint recording of the first finger, that is, the abnormal sliding behavior that occurs during the fingerprint recording is the number of times the sliding speed is too fast and the number of times the sliding speed is too slow. Afterwards, the mobile phone can calculate the sum of the number of times the sliding speed is too fast and the number of times the sliding speed is too slow to obtain the number of abnormal sliding speeds, that is, the total number of abnormal sliding speeds.

[0228] Afterwards, the mobile phone can display interface 3 (or called the second interface), and play the abnormal behavior guidance animation corresponding to the target abnormal entry behavior on this interface 3. The target abnormal entry behavior can be the abnormal entry behavior with the highest total number of times, or the abnormal entry behavior with a total number of occurrences greater than the preset number of occurrences, so as to achieve targeted playback of the guidance animation and reduce the probability of more problems that occurred during the historical fingerprint entry to occur during the fingerprint entry of a new finger, thereby improving the effectiveness of the guidance animation playback and thus improving the efficiency of fingerprint sliding entry.

[0229] In some embodiments, the above-mentioned sliding entry guidance animation includes at least one frame, and the above-mentioned abnormal behavior guidance animation includes at least one frame. The abnormal behavior guidance animation corresponding to the abnormal sliding speed may be the above-mentioned sliding speed guidance animation part, the abnormal behavior guidance animation corresponding to lifting too fast may be the above-mentioned contact duration guidance animation part, the abnormal behavior guidance animation corresponding to repeated entry may be the above-mentioned sliding direction position guidance animation part, and the abnormal behavior guidance animation corresponding to press entry may be the above-mentioned sliding entry guidance animation. For example, if the target entry behavior has the highest total number of abnormal entry behaviors, and the target entry behavior is abnormal sliding speed, then the mobile phone can play the abnormal behavior guidance animation corresponding to the abnormal fluctuation speed, that is, play the sliding speed guidance animation part, to guide the user to slide and enter at the correct sliding speed, without having to play the animation part that is not related to the sliding speed guidance, thereby achieving fast and effective playback of the abnormal behavior guidance animation and shortening the playback time of the abnormal behavior guidance animation.

[0230] In addition, the abnormal behavior guidance animation corresponding to the abnormal entry behavior may also be a separate abnormal behavior guidance animation, rather than a part of the sliding entry guidance animation. The abnormal behavior guidance animation may be pre-stored in the mobile phone.

[0231] In an embodiment of the present application, if a mobile phone that supports slide-in registration does not incorporate a press-in registration algorithm, during fingerprint registration, the mobile phone's fingerprint device (such as a fingerprint sensor) will continuously collect fingerprint images after the user's finger is pressed. The phone will not vibrate until the user's finger leaves the fingerprint collection area, that is, until the user lifts his finger, to prompt the user to complete the fingerprint registration, fill in the fingerprint, and notify the user of any abnormal behavior during this fingerprint registration. Based on this, when the user's finger does not move on the fingerprint collection area for a long time, that is, when the user uses the press-in registration method to register a fingerprint, the phone will not vibrate and fill in the fingerprint until the user's finger is lifted. This results in the inability to provide feedback and dynamic filling effects for press-in registration, which reduces the user's fingerprint registration experience. Moreover, the user needs to wait until the user's finger is lifted before being prompted to slide-in. The prompt of slide-in registration is less timely, affecting the efficiency of user fingerprint registration. Therefore, it is necessary to integrate a press-in registration algorithm with a mobile phone that supports slide-in registration to achieve timely feedback for press-in registration and timely prompts for slide-in registration, thereby improving the efficiency of user fingerprint registration.

[0232] In some embodiments, the above x can be 10. The time for one sliding entry is about 1.5 seconds, the frame rate of the mobile phone is generally 40 frames per second, and the number of fingerprint images collected by one sliding entry is about 60 frames. After starting a fingerprint entry, after collecting 10 frames of fingerprint images, the mobile phone determines whether the fingerprint entry method this time is sliding entry, that is, determines whether to end this fingerprint entry. When it is determined that the fingerprint entry method this time is not sliding entry but pressing entry, the mobile phone can end this fingerprint entry and prompt the user to perform sliding entry, without having to wait until the end of one sliding entry, that is, without having to collect 60 frames of fingerprint images before determining whether the fingerprint entry method this time is sliding entry, and thus prompting the user to perform sliding entry, thereby achieving timely feedback on fingerprint entry and improving the efficiency of fingerprint entry. In addition, the mobile phone can store any one of the 10 frames of fingerprint images corresponding to this fingerprint entry (that is, the 10 frames of fingerprint images collected during this fingerprint entry) into the template set corresponding to the finger, without discarding the fingerprint image collected during the press entry, thereby improving the collection efficiency of the template set corresponding to the finger, thereby improving the fingerprint collection efficiency of the finger and improving the efficiency of fingerprint entry.

[0233] In some embodiments, when different users touch the display screen of a mobile phone, the motion data (herein referred to as perception data) collected by the mobile phone's motion sensor are different. Specifically, when different users operate the mobile phone, the perception data received by the mobile phone based on the user's touch operation feedback will have different characteristics. Therefore, after the user inputs a second operation, the mobile phone receives the second operation. The second operation can be used to trigger the mobile phone to launch a fingerprint application, such as clicking the fingerprint control shown in Figure 5C above. This second operation can be performed before the first operation.

[0234] In response to the second operation, the mobile phone may obtain sensing data, which represents motion data collected by the motion sensor during the user's touch operation within a target time period before the second operation. For example, if the target time period is 10 minutes, the sensing data represents motion data collected by the mobile phone within 10 minutes before receiving the second operation.

[0235] The above-mentioned perception data may be obtained from a cache.

[0236] Afterwards, the mobile phone can input the perception data into the target recognition model so that the target recognition model can use the distribution characteristics of the perception data to identify the user identity. The user identity indicates whether the user currently using the mobile phone is the owner, that is, whether the current user is the owner user, thereby realizing the identification of the user identity.

[0237] If the user identity indicates that the current user is not the owner of the device, it indicates that the user may be a risky user. To ensure the security of fingerprint data, the mobile phone can display a password input interface (as shown in Figure 5D above) for the user to enter the lock screen password. When the password is entered correctly, the mobile phone can display interface 4 (or called the third interface). This interface 4 (such as interface 55 shown in Figure 5E above, or the interface shown in Figure 8 above) includes a new fingerprint control, so that the user can trigger the new fingerprint control to enter the fingerprint, ensuring the security of fingerprint entry, thereby ensuring the data security of the electronic device.

[0238] If the user's identity indicates that the current user is the owner of the device, indicating that the user is a trusted user, the mobile phone can display interface 4, which includes a new fingerprint control, so that the user can trigger the new fingerprint control to enter the fingerprint. On the basis of ensuring the security of fingerprint entry, the user's identity can be recognized without any sense of touch, reducing user operations and the tediousness of fingerprint entry. For example, the user clicks the fingerprint control shown in Figure 13A, and the mobile phone receives the click operation of the fingerprint control. In response to the click operation, the mobile phone uses the sensing data to identify the user's identity. If the user's identity indicates the owner of the device, the mobile phone does not require the user to enter a password and can directly display the interface shown in Figure 13B.

[0239] The target recognition model can be trained using sample data from the phone's owner to create a preset category model. Specifically, the preset category model can be trained based on initial perception data from the user's first use of the phone. In other words, the preset category model is trained specifically for the phone's owner, making it more targeted and improving the accuracy of user identification. It should be understood that in this embodiment, the series of operations performed after the phone's first power-on are assumed to be those performed by the phone's owner.

[0240] It should be noted that the target recognition model trained by the mobile phone based on the sample data of the owner user is suitable for the mobile phone to determine whether the user is the owner user. That is to say, if the user identities identified by the mobile phone using the target recognition model include the owner user and the non-owner user, the mobile phone needs to collect sample data about the owner user for training and learning to obtain the target recognition model.

[0241] It is understood that after obtaining the target recognition model, the mobile phone can directly input the above-mentioned perception data group into the target recognition model to obtain the user identity result and output the user identity. In addition, the motion data collected by the mobile phone and the identification of the user identity are performed under the user's authorization.

[0242] In some embodiments, after the fingerprint is successfully entered, the mobile phone can use the entered fingerprint to unlock, access applications, make payments, and other operations.

[0243] In some embodiments, the present application provides a computer-readable storage medium including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the fingerprint entry method as described above.

[0244] In some embodiments, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the fingerprint entry method described above.

[0245] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0246] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0247] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0248] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0249] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0250] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A fingerprint entry method, characterized in that: Applied to an electronic device, the electronic device includes a fingerprint collection area, the fingerprint collection area is arranged on a display screen of the electronic device, a side frame of the electronic device, or a rear shell of the electronic device, the method includes: Receiving a first operation; the first operation is used to trigger the electronic device to enter a new fingerprint; In response to the first operation, displaying a first interface, wherein the first interface is used to play a sliding input guide animation; Detecting that a first finger touches the fingerprint collection area, and starting to collect a fingerprint image of the first finger; In the case where x frames of fingerprint images are collected, if the electronic device meets a first preset condition, the electronic device stops collecting fingerprint images and saves a first target fingerprint image in a template set corresponding to the first finger; wherein x is a positive integer greater than 1; the first preset condition includes that the similarity between the first frame of fingerprint images and the xth frame of fingerprint images in the x frames of fingerprint images is greater than or equal to a preset similarity, and / or that the first motion data when the electronic device collects the x frames of fingerprint images indicates that the x frames of fingerprint images are recorded by the first finger by pressing the fingerprint collection area; the first target fingerprint image is obtained based on the x frames of fingerprint images and is used for fingerprint recognition of the first finger; If the electronic device does not meet the first preset condition, the electronic device continues to collect fingerprint images until the electronic device meets the second preset condition and stops collecting fingerprint images; wherein the second preset condition includes detecting that the first finger leaves the fingerprint collection area, or the sliding entry time is greater than a preset time threshold; wherein the sliding entry time represents the time from detecting that the first finger touches the fingerprint collection area to the current time; A second target fingerprint image is saved in the template set corresponding to the first finger; wherein the second target fingerprint image is obtained based on the fingerprint image collected from the time when the first finger is detected to touch the fingerprint collection area to the time when the electronic device meets the second preset condition.

2. The method according to claim 1, characterized in that If the electronic device meets the first preset condition, the x frames of fingerprint images correspond to one fingerprint entry; the method further includes: The electronic device outputs first prompt information; the first prompt information is used to prompt sliding to enter the fingerprint; If the electronic device does not meet the preset stop input condition, returning to the step of starting to collect the fingerprint image of the first finger; When the electronic device meets the preset stop recording condition, stop recording the fingerprint of the first finger, and determine the fingerprint information of the first finger based on the template set corresponding to the first finger; Among them, the preset stop entry condition includes at least one of the following: the number of fingerprint images in the template set corresponding to the first finger is greater than a preset stop number threshold, the total fingerprint area corresponding to the template set corresponding to the first finger is greater than a preset fingerprint area, and the number of fingerprint entry times is greater than a preset number; the total fingerprint area represents the fingerprint area of ​​the first finger that has been entered.

3. The method according to claim 2, characterized in that After stopping recording the fingerprint of the first finger, the method further includes: receiving the first operation; In response to the first operation, for each fingerprint already present in the electronic device, the number of various abnormal input behaviors corresponding to the fingerprint is obtained; the number of abnormal input behaviors corresponding to the fingerprint indicates the number of times the abnormal input behaviors occur during the fingerprint input period; the abnormal input behaviors include pressing input, abnormal sliding speed, etc. At least one of regular, fast lift and repeated entry; For each abnormal input behavior, the sum of the number of abnormal input behaviors corresponding to each fingerprint is calculated to obtain the total number of abnormal input behaviors; Display the second interface; the second interface is used to play the abnormal behavior guidance animation corresponding to the target abnormal entry behavior, and the target abnormal entry behavior represents the abnormal entry behavior with the highest total number of times, or represents the abnormal entry behavior with a total number of times greater than the preset number of occurrences.

4. The method according to claim 3, characterized in that The sliding entry guiding animation includes the abnormal behavior guiding animation.

5. The method according to claim 3 or 4, characterized in that: The sliding entry guiding animation includes at least one of a sliding speed guiding animation part, a contact duration guiding animation part and a sliding direction position guiding animation part; When the target abnormal input behavior includes abnormal sliding speed, the second interface plays the sliding speed guiding animation part; When the abnormal target input behavior includes quick lifting, the second interface plays the contact duration guiding animation part; In the case where the target abnormal input behavior includes repeated input, the second interface plays the sliding direction position guidance animation portion.

6. The method according to any one of claims 1 to 5, characterized in that If the electronic device meets the first preset condition, the method further includes: The electronic device vibrates to prompt the user to start the next fingerprint entry.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: The first motion data is used as an input parameter of a first preset model, and the first preset model is moved to obtain a fingerprint entry result; the fingerprint entry result indicates that the x-frame fingerprint image is entered by the first finger by pressing the fingerprint collection area; the first preset model is obtained by training a network model based on sample motion data corresponding to sliding entry and / or sample motion data corresponding to pressing entry; the first preset model is used to identify the fingerprint entry method corresponding to the fingerprint image based on the motion data.

8. The method according to any one of claims 1 to 7, characterized in that The first operation represents a click operation on a newly created fingerprint control; Before receiving the first operation, the method further includes: Receiving a second operation; the second operation is used to trigger the electronic device to start a fingerprint application; In response to the second operation, the target recognition model is run using the sensed data as an input parameter to obtain a user identity result, wherein the user identity result indicates whether the current user is an owner user, and the sensed data represents motion data generated by a motion sensor of the electronic device based on a touch operation within a target time before receiving the second operation; When the user identity result indicates that the current user is the owner of the machine, a third interface is displayed, and the third interface includes the new fingerprint control.

9. An electronic device, characterized in that: The electronic device includes a fingerprint device, a display screen, a memory and one or more processors; the fingerprint device, the display screen, the memory and the processor are coupled; the fingerprint device is used to collect fingerprint images, the display screen is used to display images generated by the processor, and the memory is used to store computer program codes, and the computer program codes include computer instructions; when the processor executes the computer instructions, the electronic device executes the method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 8.

Images