Fingerprint input method and electronic equipment

Abstract

The invention provides a fingerprint input method and electronic equipment, and relates to the technical field of terminals. And when the electronic equipment inputs a new fingerprint, firstly playing the sliding input guide animation to guide a user to input the fingerprint in a sliding manner. And when it is detected that the finger touches the fingerprint acquisition area, the electronic equipment starts fingerprint input once, and a fingerprint image is acquired. Afterwards, after the number of the collected fingerprint images reaches x frames, the electronic equipment can judge whether a first preset condition is met or not, so as to judge whether the fingerprint input is sliding input or not. When the first preset condition is met, it is indicated that the fingerprint input is pressing input, the electronic device can end the fingerprint input, and the image acquired by the fingerprint input is added to the template set, so that the electronic device generates the fingerprint information of the finger by using the template set, the acquisition efficiency of the template set corresponding to the finger is improved, and the user experience is improved. Therefore, the fingerprint input speed can be increased, the input frequency of the user is reduced, and the fingerprint input experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a fingerprint entry method and electronic device. Background Art

[0002] With the development of electronic devices, most electronic devices have fingerprint recognition function. In order to realize the fingerprint recognition function, users need to enter their fingerprints in advance so that when the user's fingerprint matches the entered fingerprint, they can perform operations such as unlocking and payment. In order to improve the user's fingerprint entry experience, how to achieve efficient entry of user fingerprints has become an urgent problem to be solved. Summary of the invention

[0003] In view of this, the present application provides a fingerprint entry method and an electronic device for improving the efficiency of fingerprint entry.

[0004] In a first aspect, the present application provides a fingerprint entry method, which is applied to an electronic device, wherein the electronic device includes a fingerprint collection area, which can be set on a display screen of the electronic device, a side frame of the electronic device, or a back cover of the electronic device. When the electronic device receives a first operation input by a user, it indicates that the user wants to enter a new fingerprint. In response to the first operation, the electronic device can display a first interface, which is used to play a sliding entry guide animation to guide the user to perform sliding entry.

[0005] When it is detected that the first finger touches the fingerprint collection area of ​​the electronic device, it indicates that a fingerprint entry starts, and the electronic device starts to collect the fingerprint image corresponding to the first finger.

[0006] When the number of fingerprint images collected reaches x frames, the electronic device determines whether the electronic device meets the first preset condition to determine whether the fingerprint entry is a press entry or a slide entry. The first preset condition includes that the similarity between the first frame fingerprint image and the xth frame fingerprint image in the x frames of fingerprint images is greater than or equal to the preset similarity, and / or the first motion data when the electronic device collects x frames of fingerprint images indicates that the x frames of fingerprint images are recorded by the first finger by pressing the fingerprint collection area, that is, the fingerprint entry result obtained by the electronic device based on the first motion data indicates press entry, and the first motion data represents the motion data collected by the motion sensor of the electronic device from the time when the first finger is detected to touch the fingerprint collection area to the time when x frames of fingerprint images are collected; x is a positive integer greater than 1.

[0007] When the electronic device satisfies the first preset condition, it indicates that the current fingerprint entry is a press entry, and the current fingerprint entry can be ended, and the electronic device can stop collecting fingerprint images, and save the first target fingerprint image to the template set corresponding to the first finger; wherein the first target fingerprint image is determined based on the x frames of fingerprint images and is used for fingerprint recognition of the first finger, that is, the template set corresponding to the first finger is used to determine the fingerprint information of the first finger;

[0008] When the above-mentioned electronic device does not meet the first preset condition, it indicates that the current fingerprint entry is a sliding entry, and the electronic device can continue to collect fingerprint images until the electronic device meets the second preset condition and stops collecting fingerprint images; wherein the second preset condition may include stopping collecting fingerprint images when it is detected that the first finger leaves the fingerprint collection area, that is, until the first finger is lifted up, the current fingerprint entry ends, or the sliding entry duration is greater than the preset duration threshold, the sliding entry duration represents the duration from the detection of the first finger touching the fingerprint collection area to the current time; the longer the sliding entry duration, the longer the current fingerprint entry duration.

[0009] The electronic device saves the second target fingerprint image to the template set corresponding to the first finger. The second target fingerprint image is obtained based on the fingerprint image collected from the time when the first finger is detected to touch the fingerprint collection area to the time when the electronic device meets the second preset condition. For example, the second target fingerprint image is obtained from the time when the first finger touches the fingerprint collection area to the time when the first finger leaves the fingerprint collection area.

[0010] In the present application, when it is detected that the user's finger touches the fingerprint collection area, it indicates that a fingerprint entry has started, and the electronic device collects fingerprint images. After collecting x frames of fingerprint images, the electronic device uses the first preset condition to determine whether this fingerprint entry is a press entry or a slide entry. When it is determined that the fingerprint entry method is a press entry, since the user is stationary on the fingerprint collection area, the electronic device will not collect more valid fingerprint information. Therefore, the electronic device can directly end this fingerprint entry and stop collecting fingerprint images without waiting until the user's finger is lifted to end this fingerprint entry. The first target fingerprint image collected during this fingerprint entry is added to the template set corresponding to the first finger, thereby improving the collection efficiency of the template set corresponding to the first finger, thereby improving the speed of fingerprint entry and reducing the number of user entries. When it is determined that the fingerprint entry method is a slide entry, the electronic device can continue to collect fingerprint images until the user lifts his finger and ends this fingerprint entry, so that the electronic device can obtain valid fingerprint images as much as possible, and quickly obtain fingerprint images, thereby improving the efficiency of fingerprint entry. Or when the sliding input time is longer than the preset time threshold, it indicates that the sliding input time is too long, and the fingerprint input can be terminated to avoid the user inputting fingerprints for a long time and ensure the efficiency of fingerprint input.

[0011] In a possible design, the motion sensor may include at least one of an acceleration sensor, a linear acceleration sensor, a gravity acceleration sensor, a magnetometer, a gyroscope sensor, and a rotation vector sensor.

[0012] In a possible design manner, the first operation may be a click operation on a new fingerprint control displayed on the electronic device.

[0013] In a possible design, since the user's finger is basically stationary on the fingerprint collection area when pressing and entering, the fingerprint portion of the finger collected by the electronic device is basically fixed. Therefore, the fingerprint portion corresponding to the above x frames of fingerprint images is basically the same. Therefore, the electronic device can use any frame of fingerprint image in the x frames of fingerprint images, or a fingerprint image whose quality meets the preset quality standard as the above first target fingerprint image.

[0014] In one possible design, the electronic device may directly use the fingerprint image collected during the period from when the first finger is detected touching the fingerprint collection area to when the first finger leaves the fingerprint collection area as the second target fingerprint image, or use the fingerprint image whose quality meets a preset quality standard among the fingerprint images collected during this period as the second target fingerprint image.

[0015] In a possible design, when the electronic device meets the first preset condition, the electronic device outputs a first prompt message; the first prompt message is used to prompt the user to slide to enter the fingerprint, without having to wait until the user lifts the finger before giving the prompt, thereby achieving timely feedback for press entry and timely reminder for slide entry, so that the user can adjust the fingerprint entry method in time and use the sliding entry method with higher fingerprint entry efficiency to enter the fingerprint, thereby improving the efficiency of fingerprint entry and improving the user entry experience.

[0016] In a possible design, after a fingerprint entry is completed, the electronic device can determine whether the electronic device meets the preset stop entry condition, that is, whether the fingerprint entry can be ended. The preset stop entry condition at least includes one of the following: the number of fingerprint images in the template set corresponding to the first finger is greater than the preset stop number threshold, the total fingerprint area corresponding to the template set corresponding to the first finger is greater than the preset fingerprint area, and the number of fingerprint entry is greater than the preset number; the total fingerprint area represents the fingerprint area of ​​the first finger that has been entered.

[0017] If the preset stop entry condition is not met, it indicates that the user still needs to continue fingerprint entry, that is, it indicates that the electronic device needs to start a new fingerprint entry and return to the above step of starting to collect the fingerprint image corresponding to the first finger, or if the electronic device detects that the first finger touches the fingerprint collection area, it returns to the above step of starting to collect the fingerprint image corresponding to the first finger, that is, restarting to collect the fingerprint image corresponding to the new fingerprint entry. When x frames of fingerprint images are collected, it is determined whether the new fingerprint entry is a sliding entry.

[0018] When the electronic device meets the preset stop entry condition, it indicates that the fingerprint entry can be ended. The electronic device ends the entry of the fingerprint of the first finger, determines the fingerprint information of the first finger based on the template set corresponding to the first finger, and completes the entry of the fingerprint of the first finger.

[0019] In a possible design, after the fingerprint of the first finger is recorded, the electronic device receives the first operation input by the user again, indicating that the user needs to record a new fingerprint.

[0020] In response to the first operation, for each fingerprint already existing in the electronic device (that is, each recorded fingerprint), the electronic device obtains the number of various abnormal recording behaviors corresponding to the fingerprint, and the number of abnormal recording behaviors corresponding to the fingerprint indicates the number of times the abnormal recording behavior occurs during the fingerprint recording.

[0021] The abnormal input behavior includes at least one of pressing input, abnormal sliding speed, quick lifting and repeated input;

[0022] For each abnormal input behavior, the electronic device can calculate the sum of the number of such abnormal input behaviors corresponding to all existing fingerprints to obtain the total number of such abnormal input behaviors. The higher the total number of such abnormal input behaviors, the higher the probability of such abnormal input behaviors occurring during fingerprint input.

[0023] Afterwards, the electronic device may use the abnormal entry behavior with the highest total number of occurrences as the target abnormal entry behavior, or use the abnormal entry behavior with a total number of occurrences greater than a preset number of occurrences as the target abnormal entry behavior. Afterwards, the electronic device may display a second interface. The second interface is used to play the abnormal behavior guidance animation corresponding to the target abnormal entry behavior.

[0024] Wherein, each of the existing fingerprints includes the fingerprint of the first finger.

[0025] In this application, it is considered that in actual use, users generally record fingerprints of multiple fingers. After the first finger is recorded, the user continues to record the fingerprint of the second finger on the mobile phone. In order to improve the efficiency of fingerprint recording, the electronic device can play the corresponding abnormal behavior guidance animation for the abnormal recording behavior that occurs frequently during the user's historical fingerprint recording, realize the targeted playback of the guidance animation, reduce the probability of more problems that occurred during the historical fingerprint recording period appearing during the recording of new fingerprints, and improve the effectiveness of the guidance animation playback.

[0026] In a possible design, the sliding entry guide animation includes at least one of a sliding speed guide animation portion, a contact duration guide animation portion, and a sliding direction position guide animation portion.

[0027] The sliding speed guiding animation part guides the sliding speed of the user's finger to reduce the probability of the user's finger sliding too fast or too slow.

[0028] The contact time guiding animation part guides the time period for which the user's finger contacts the fingerprint collection area, so as to reduce the probability of lifting the finger too quickly.

[0029] The sliding direction and position guiding animation part guides the sliding direction and sliding position of the user's finger to reduce the probability of repeated entry.

[0030] Correspondingly, the abnormal behavior guidance animation may be part of the sliding entry guidance animation.

[0031] In the case where the target abnormal input behavior includes abnormal sliding speed, the second interface may play the sliding speed guide animation portion; the sliding speed guide animation portion here represents the abnormal behavior guide animation corresponding to the target abnormal input behavior.

[0032] In the case where the target abnormal input behavior includes quick lifting, the above-mentioned second interface can play the contact duration guidance animation part; here, the contact duration guidance animation part represents the abnormal behavior guidance animation corresponding to the target abnormal input behavior.

[0033] In the case where the target abnormal entry behavior includes repeated entry, the above-mentioned second interface can play the contact time guidance animation part; here, the sliding direction position guidance animation part represents the abnormal behavior guidance animation corresponding to the target abnormal entry behavior.

[0034] In the present application, when the electronic device needs to enter a new fingerprint and plays a sliding entry guidance animation, the electronic device plays part of the animation content in the sliding entry guidance animation for the user's abnormal entry behavior that occurred more frequently during the user's historical fingerprint entry, without having to play the animation content corresponding to the user's abnormal entry behavior that occurred less frequently or did not occur, thereby achieving targeted playback of the guidance animation, thereby achieving fast and effective playback of the guidance animation, shortening the playback time of the guidance animation, and ensuring the success of guiding the user to correctly slide and enter the fingerprint, thereby improving the user experience.

[0035] In one possible design, when the above-mentioned target abnormal input behavior includes press input, the above-mentioned second interface can play a sliding input guide animation, or at least one of a sliding speed guide animation part, a contact duration guide animation part, and a sliding direction position guide animation part.

[0036] In another possible design, the abnormal behavior guidance animation corresponding to the abnormal entry behavior may also be a separate abnormal behavior guidance animation, rather than a part of the sliding entry guidance animation, and the abnormal behavior guidance animation may be pre-stored in the electronic device.

[0037] In one possible design, when the electronic device satisfies the first preset condition, it indicates that the fingerprint entry can be completed, and the electronic device can vibrate to prompt the completion of the fingerprint entry. The user can lift his finger and perform the next fingerprint entry, thereby achieving timely feedback of the press entry, allowing the user to perform the next fingerprint entry in time, thereby improving the efficiency of fingerprint entry.

[0038] Correspondingly, when it is detected that the first finger leaves the fingerprint collection area and the fingerprint image collection stops, it indicates that the current fingerprint entry can be ended, and the electronic device can vibrate to prompt the end of the current fingerprint entry. The user can start the next fingerprint entry, realizing timely feedback of the sliding entry, so that the user can perform the next fingerprint entry in time, thereby improving the efficiency of fingerprint entry.

[0039] In a possible design, when the electronic device satisfies the first preset condition, it indicates that the current press recording can be ended, and the electronic device can splice the x frames of images collected during the current press recording. Afterwards, the electronic device can use the spliced ​​fingerprint image to determine the partial fingerprint information corresponding to the first finger, and the partial fingerprint information corresponding to the first finger represents the fingerprint part recorded in this press recording. Afterwards, the electronic device can display the filled image of the first fingerprint based on the partial fingerprint information corresponding to the first finger, so as to realize timely feedback of the press recording.

[0040] Correspondingly, after a sliding entry is completed, the electronic device can also splice the fingerprint images collected during this sliding entry (such as the fingerprint images collected from the time when the first finger is detected to touch the fingerprint collection area to the time when the first finger leaves the fingerprint collection area). Afterwards, the electronic device can use the spliced ​​fingerprint images to determine the partial fingerprint information corresponding to the first finger. Afterwards, the electronic device can display the filled image of the first fingerprint based on the partial fingerprint information corresponding to the first finger, so as to realize timely feedback of the sliding entry.

[0041] In a possible design, the process of determining the fingerprint entry result may include:

[0042] The electronic device can use the above-mentioned first motion data as the input parameter of the first preset model, and move the first preset model to obtain the fingerprint entry result. The fingerprint entry result indicates that the fingerprint entry method this time is sliding entry, that is, it indicates that the above-mentioned x frames of fingerprint images are entered by the first finger pressing the fingerprint collection area. Among them, the first preset model is obtained after training the network model based on the sample motion data corresponding to the sliding entry and / or the sample motion data corresponding to the pressing entry. The first preset model is used to identify the fingerprint entry method based on the motion data, that is, to identify the fingerprint entry method corresponding to the fingerprint image collected during the first motion data collection period, so as to realize the identification of the fingerprint entry method.

[0043] In a possible design, whether the similarity between the first fingerprint image frame and the xth fingerprint image frame is greater than or equal to a preset similarity can be determined by the following implementation.

[0044] In one implementation, when the area of ​​the overlapping region between the first frame fingerprint image and the x-th frame fingerprint image is greater than or equal to a preset area threshold, the electronic device can determine that the similarity between the first frame fingerprint image and the x-th frame fingerprint image is greater than or equal to a preset similarity. When the area of ​​the overlapping region between the first frame fingerprint image and the x-th frame fingerprint image is less than a preset area threshold, the electronic device can determine that the similarity between the first frame fingerprint image and the x-th frame fingerprint image is less than a preset similarity.

[0045] In another implementation, the electronic device may use the first frame of fingerprint image and the x-th frame of fingerprint image as input parameters of the second preset model, run the second preset model, and obtain the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image, so that the electronic device can determine whether the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image is greater than or equal to the preset similarity. Alternatively, the second preset model may directly output a similarity comparison result, which is used to indicate whether the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image is greater than or equal to the preset similarity.

[0046] In another implementation, when the number of key points matched between the first frame fingerprint image and the x-th frame fingerprint image is greater than or equal to a preset number, it indicates that the degree of matching between the two is high, and the electronic device can determine that the similarity between the first frame fingerprint image and the x-th frame fingerprint image is greater than or equal to the preset similarity. When the number of key points matched between the first frame fingerprint image and the x-th frame fingerprint image is less than a preset number, it indicates that the degree of matching between the two is low, and the electronic device can determine that the similarity between the first frame fingerprint image and the x-th frame fingerprint image is less than the preset similarity.

[0047] In one possible design, before the user triggers the electronic device to enter the fingerprint, the electronic device needs to start the fingerprint application first. Accordingly, the user can input a second operation (such as a click operation on the fingerprint control), and the electronic device receives the second operation, which is used to trigger the electronic device to start the fingerprint application.

[0048] The electronic device may, in response to the second operation, use the sensed data as an input parameter of a target recognition model, run the target recognition model, and obtain a user identity result input by the target recognition model, wherein the user identity result indicates whether the current user is the owner user, and the sensed data represents motion data generated by a motion sensor of the electronic device based on a touch operation within a target time before receiving the second operation, that is, motion data collected during the period of receiving the touch operation;

[0049] When the user identity result indicates that the current user is the owner of the machine, a third interface is displayed, and the third interface includes a new fingerprint control.

[0050] When the user identity result indicates that the current user is not the owner of the device, a password input interface is displayed for the user to enter the lock screen password. When the password is entered correctly, the electronic device can display the third interface.

[0051] Among them, the above-mentioned target recognition model can be obtained by training a preset category model using sample data of the owner user (such as motion data collected by a motion sensor during a touch operation performed by the owner user).

[0052] In the present application, when different users touch the display screen of the mobile phone, the motion data collected by the motion sensor is different, that is, the distribution characteristics of the perception data are different. Therefore, after the electronic device receives the second operation input by the user, the electronic device can use the perception data to determine whether the user currently using the electronic device is the owner of the device, thereby realizing seamless recognition of the user's identity.

[0053] In one possible design, in order to improve data security, after the fingerprint of the first finger is entered, the mobile phone can encrypt and save the fingerprint information of the first finger, or, after the fingerprint of the first finger is successfully entered, if the fingerprint area corresponding to the template set corresponding to the first finger is larger than the preset fingerprint area, the mobile phone will encrypt and save the fingerprint information of the first finger to improve the security of fingerprint information storage and prevent the fingerprint information from being tampered with or obtained.

[0054] In a second aspect, the present application provides an electronic device, comprising a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, the display screen comprises a folding screen, the memory is used to store computer program code, and the computer program code comprises computer instructions; when the processor executes the computer instructions, the electronic device executes a fingerprint entry method as described in any one of the above-mentioned first aspects.

[0055] In a third aspect, the present application provides a computer-readable storage medium, comprising computer instructions, which, when executed on an electronic device, enables the electronic device to execute the fingerprint entry method as described in any one of the above-mentioned first aspects.

[0056] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the fingerprint entry method as described in any one of the first aspects above.

[0057] It can be understood that the beneficial effects that can be achieved by the electronic device described in the second aspect, the computer-readable storage medium described in the third aspect, and the computer program product described in the fourth aspect provided above can be referred to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1A A schematic diagram of fingerprint entry provided in an embodiment of the present application;

[0059] Figure 1B A schematic diagram 1 of a sliding input direction provided in an embodiment of the present application;

[0060] Figure 1C A schematic diagram of a sliding input direction provided in an embodiment of the present application Figure 2 ;

[0061] Figure 2 A schematic diagram of a sliding input direction provided in an embodiment of the present application Figure 3 ;

[0062] Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0063] Figure 4 A schematic diagram of a fingerprint entry method provided in an embodiment of the present application;

[0064] Figure 5A A schematic diagram of a fingerprint input interface provided in an embodiment of the present application;

[0065] Figure 5B A fingerprint input interface provided in the embodiment of the present application Figure 2 ;

[0066] Figure 5C A fingerprint input interface provided in the embodiment of the present application Figure 3 ;

[0067] Figure 5D A fingerprint input interface provided in the embodiment of the present application Figure 4 ;

[0068] Figure 5E Schematic diagram 5 of a fingerprint input interface provided in an embodiment of the present application;

[0069] Fig. 5F Schematic diagram 6 of a fingerprint input interface provided in an embodiment of the present application;

[0070] Fig. 6A A schematic diagram 1 of a display of a pressing input prompt provided in an embodiment of the present application;

[0071] Figure 6B A schematic diagram of a press input prompt display provided in an embodiment of the present application Figure 2 ;

[0072] Fig. 7A A schematic diagram of a fingerprint filling interface provided in an embodiment of the present application;

[0073] Figure 7BA fingerprint filling interface provided in the embodiment of the present application Figure 2 ;

[0074] Figure 8 Schematic diagram 7 of a fingerprint input interface provided in an embodiment of the present application;

[0075] Fig. 9 A schematic diagram of an abnormal behavior guidance animation interface provided in an embodiment of the present application;

[0076] Fig.10 An interface diagram of an abnormal behavior guidance animation provided in an embodiment of the present application Figure 2 ;

[0077] Fig.11 An interface diagram of an abnormal behavior guidance animation provided in an embodiment of the present application Figure 3 ;

[0078] Fig.12 An interface diagram of an abnormal behavior guidance animation provided in an embodiment of the present application Figure 4 ;

[0079] Fig.13A A fingerprint input interface provided in the embodiment of the present application Figure 8 ;

[0080] Fig. 13B A fingerprint input interface provided in the embodiment of the present application Figure 9 . DETAILED DESCRIPTION

[0081] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0082] In some embodiments, most electronic devices (such as mobile phones) have fingerprint recognition functions. In order to realize the fingerprint recognition function, users need to enter their fingerprints in advance. Taking into account factors such as the spatial structure and cost of mobile phones, the fingerprint collection area of ​​mobile phones may become smaller and smaller. In order to improve the efficiency of fingerprint entry, the mobile phone can use a sliding entry method to enter fingerprints, that is, during fingerprint entry, the user's finger can slide on the fingerprint collection area of ​​the mobile phone, and the mobile phone will collect the corresponding fingerprint image for determining the fingerprint information of the finger using the collected fingerprint image. For example, the user's finger can be placed first like Figure 1AThen, the user's finger can slide horizontally, that is, left and right, or along the x direction on the fingerprint collection area of ​​the mobile phone (as shown in FIG. Figure 1B Alternatively, the user's finger can slide vertically, that is, up and down, or along the y direction on the fingerprint collection area of ​​the mobile phone (as shown in FIG. Figure 1C shown).

[0083] However, since most users are accustomed to using the press-to-enter method to enter fingerprints, that is, users press the fingerprint collection area of ​​the mobile phone (such as Figure 2 The user presses the finger on the fingerprint collection area shown in the figure, and then lifts the finger without sliding the finger, resulting in failure of sliding fingerprint registration. The mobile phone may need to repeatedly guide the user on how to slide to register before the user can successfully slide to register the fingerprint, resulting in a long time required for fingerprint registration, low fingerprint registration efficiency, and a poor user registration experience.

[0084] Therefore, in response to the above problems, the present application proposes a fingerprint entry method that combines press entry and slide entry. Considering that when entering a fingerprint, the user is generally required to perform multiple fingerprint entry. Therefore, during the fingerprint entry period, when the electronic device detects that the first finger touches the fingerprint collection area of ​​the electronic device, it indicates that a fingerprint entry has started, and the electronic device can start to collect the fingerprint image of the first finger. Afterwards, when x frames of fingerprint images are collected, the electronic device can determine whether the electronic device meets the first preset condition, and the first preset condition may include that the similarity between the xth frame fingerprint image corresponding to the first finger collected by the electronic device and the first frame fingerprint image corresponding to the first finger is greater than the preset similarity and / or the fingerprint entry result determined by the electronic device based on the collected first motion data indicates that the first finger is stationary. Among them, the first motion data represents the motion data collected by the motion sensor of the electronic device from the time when the electronic device collects the first frame fingerprint image to the time when the electronic device collects the xth frame fingerprint image. x represents a positive integer greater than 1.

[0085] When the electronic device meets the first preset condition, it indicates that the finger did not slide during the current fingerprint entry, that is, it indicates that the fingerprint entry method is press entry. The electronic device can end the current fingerprint entry, stop collecting fingerprint images, and add the first target fingerprint image collected by the fingerprint device to the template set corresponding to the first finger. The first target fingerprint image is determined based on the x frames of fingerprint images collected during the current fingerprint entry. The electronic device outputs the first prompt information, which is used to prompt the sliding entry of the fingerprint, realize the timely feedback of the press entry, and realize the timely reminder of the sliding entry, so that the user can adjust the fingerprint entry method in time and use the sliding entry method with higher fingerprint entry efficiency to enter, thereby improving the efficiency of fingerprint entry. And the electronic device adds the fingerprint image corresponding to the press entry to the template set corresponding to the first finger, improves the collection efficiency of the template set corresponding to the first finger, thereby improving the speed of fingerprint entry and improving the user entry experience.

[0086] When the electronic device does not meet the first preset condition, it indicates that the finger slides during the current fingerprint entry, which means that the fingerprint entry method is sliding entry. The electronic device can continue to collect fingerprint images until it detects that the first finger leaves the fingerprint collection area, or stops collecting fingerprint images when the duration of this sliding entry is greater than the preset duration threshold, and ends this fingerprint entry. Among them, the duration of this sliding entry represents the duration from the beginning of this fingerprint entry, that is, from the time when the first finger is detected to touch the fingerprint collection area to the current time. Afterwards, the electronic device can add the fingerprint image of the first finger collected during this fingerprint entry to the template set corresponding to the first finger, so as to quickly obtain the fingerprint image, avoid the user from performing fingerprint entry for a long time, ensure the effectiveness of fingerprint entry, and improve the efficiency of fingerprint entry.

[0087] The template set corresponding to the first finger is used to generate fingerprint information corresponding to the first fingerprint.

[0088] It should be understood that the above Figure 1A , Figure 1B , Figure 1C as well as Figure 2 The position of the fingerprint collection area shown is only an example, and the position of the fingerprint collection area can be set according to the needs, and this application does not limit it. Figure 1A , Figure 1B , Figure 1C as well as Figure 2 The shape of the mobile phone shown is only an example. The mobile phone can also be a folding screen mobile phone (such as an outward folding screen mobile phone, an inward folding screen mobile phone, a mobile phone that folds left and right, a mobile phone that folds up and down) or other types of mobile phones. This application does not limit the shape of the mobile phone.

[0089] Exemplarily, the electronic device in the embodiments of the present application may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR)\virtual reality (VR) device, and other electronic devices with a fingerprint collection area. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0090] For example, Figure 3 A schematic structural diagram of an electronic device 100 is shown.

[0091] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0092] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0093] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0094] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0095] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0096] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0097] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0098] The charging management module 140 is used to receive charging input from a charger. The charging management module 140 charges the battery 142 and can also power the electronic device through the power management module 141.

[0099] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0100] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0101] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0102] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0103] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0104] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0105] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0106] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0107] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0108] The ISP is used to process data fed back by the camera 193 .

[0109] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0110] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0111] Video codecs are used to compress or decompress digital videos. NPU is a neural network (NN) computing processor that quickly processes input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.

[0112] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .

[0113] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0114] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0115] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0116] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0117] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0118] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0119] The earphone jack 170D is used to connect a wired earphone.

[0120] The above-mentioned sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, a magnetometer, a linear acceleration sensor, a gravity acceleration sensor, a rotation vector sensor, etc.

[0121] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0122] The gyroscope sensor can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor. The gyroscope sensor can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor can also be used for navigation and somatosensory game scenes.

[0123] The acceleration sensor can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0124] The fingerprint sensor is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc. In some embodiments, the fingerprint sensor transmits the collected fingerprint image to the processor, and the processor performs fingerprint entry or fingerprint unlocking operations based on the fingerprint image. Optionally, the fingerprint sensor can be an optical fingerprint sensor, a capacitive fingerprint sensor, an ultrasonic fingerprint sensor, etc. In an embodiment of the present application, the fingerprint sensor can be set under the display screen of the electronic device or at a designated position on the body of the electronic device (such as the above Figure 1A The fingerprint sensor is located on the side of the body as shown in the figure, and the position of the fingerprint sensor corresponds to the fingerprint collection area.

[0125] The touch sensor is also called a "touch panel". The touch sensor can be arranged on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be arranged on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0126] Bone conduction sensors can pick up vibration signals.

[0127] The magnetometer can be used to test the strength and direction of the magnetic field and locate the orientation of electronic devices. The principle of the magnetometer 180D is similar to that of the compass, and it can measure the angle between the current electronic device and the four directions of east, south, west and north.

[0128] The linear acceleration sensor is the data obtained by the acceleration sensor minus the effect of gravity.

[0129] The gravity acceleration sensor can sense the change of acceleration force, which is the force acting on the electronic device when it is accelerating.

[0130] The rotation vector in the rotation vector sensor represents the direction of the electronic device and is a data obtained by mixing the coordinate axis and the angle.

[0131] In one embodiment, the motion sensor may include at least one of the above-mentioned acceleration sensor, linear acceleration sensor, gravity acceleration sensor, magnetometer, gyroscope sensor, and rotation vector sensor.

[0132] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0133] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, fingerprint collection, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0134] The indicator 192 may be an indicator light. The SIM card interface 195 is used to connect a SIM card. The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.

[0135] The present application provides a fingerprint entry method. During fingerprint entry of an electronic device, when the electronic device detects that the user's finger contacts the fingerprint collection area of ​​the mobile phone, it indicates that a fingerprint entry has started, and the mobile phone can start to collect fingerprint images. Afterwards, the mobile phone can use the collected fingerprint image to determine whether the user's finger slides, that is, to determine the user's fingerprint entry method, so that the mobile phone adds the fingerprint image to the template set corresponding to the finger according to the fingerprint entry method. The template set is used to determine the fingerprint information of the finger and realize the successful entry of the fingerprint. And during the fingerprint entry, the electronic device can enter the fingerprint based on the sliding entry method and the pressing entry method, realizing the fusion of sliding entry and pressing entry, and improving the efficiency of fingerprint entry.

[0136] In the following, the electronic device is a mobile phone, and the fingerprint collection area is located on the side of the electronic device (as shown in the above Figure 1A , Figure 1B or Figure 1C As an example, a fingerprint entry method provided by an embodiment of the present application is described in detail in combination with the accompanying drawings. Figure 4 As shown, the method may include steps S301-S316.

[0137] S301. The mobile phone receives a first operation, and the first operation is used to trigger the mobile phone to add a fingerprint.

[0138] S302. In response to the first operation, the mobile phone displays interface 1, which displays a sliding input guiding animation.

[0139] Exemplarily, the first operation may be a trigger operation (such as a click operation) of a user on a newly created fingerprint control. The above slide entry guide animation prompts how to perform slide entry.

[0140] For example, if a user clicks Figure 5A In response to the click operation of the icon 50 of the setting application, the mobile phone can display the following Figure 5B When the user wants to add a fingerprint, the user can click the biometric identification and password control 52 on the setting interface 51. In response to the click operation of the biometric identification and password control 52, the mobile phone can display the following Figure 5C The interface 53 shown in FIG. 5 includes a fingerprint control 54. Afterwards, the user can click the fingerprint control 54 on the interface 53. In response to the click operation of the fingerprint control 54, the mobile phone can display the following information: Figure 5DThe password input interface shown in the figure is for the user to enter the lock screen password. When the lock screen password entered by the user is correct, the mobile phone can display the following Figure 5E The interface 55 shown in FIG. 5 (or referred to as the third interface) includes a new fingerprint control 56, which is used to trigger the mobile phone to add a new fingerprint. Afterwards, when the user clicks the new fingerprint control 56, the mobile phone responds to the click operation of the new fingerprint control 56 and can display the following information: Fig. 5F The interface 1 (or first interface) shown in the figure displays the screen in the slide entry guide animation, that is, the mobile phone plays the slide entry guide animation on the interface 1. Here, the user's click operation on the new fingerprint control 56 can be the above-mentioned first operation.

[0141] It should be understood that the above Fig. 5F The slide entry animation shown is a multi-frame animation. FIG. 5A to FIG. 5F The process shown is only an example of adding fingerprints, which is not shown in this application. In addition, the above-mentioned click operation on the new fingerprint control is only an example of the first operation, and the first operation can also be other triggering operations. For example, the first operation can be the user inputting a first preset gesture in the relevant interface, such as in the above Figure 5C The interface shown in the figure inputs an S-shaped gesture, etc. The first preset gesture is used to trigger the mobile phone display interface 1. Among them, the first preset gesture can be pre-configured in the mobile phone. In addition, the mobile phone can prompt the user of the function triggered by the first preset gesture in the relevant interface, and the present application does not limit the specific operation type of the above-mentioned first operation.

[0142] S303: When it is detected that the first finger touches the fingerprint collection area of ​​the mobile phone, the mobile phone starts to collect the fingerprint image corresponding to the first finger.

[0143] In an embodiment of the present application, during the playback of the above-mentioned sliding entry guide animation, or after the playback of the above-mentioned sliding entry guide animation ends, if it is detected that one finger of the user (i.e., the first finger) touches the fingerprint collection area of ​​the mobile phone, indicating that a fingerprint entry has started, the mobile phone can start collecting fingerprint images to obtain the fingerprint image of the first finger.

[0144] S304: After collecting x frames of fingerprint images corresponding to the first finger, the mobile phone determines whether the similarity between the first frame of fingerprint image and the xth frame of fingerprint image in the x frames of fingerprint images is greater than or equal to a preset similarity.

[0145] Wherein, x is a positive integer greater than 1, such as x is 10.

[0146] In the embodiment of the present application, after x frames of fingerprint images have been continuously collected, the mobile phone can determine the similarity between the first frame of fingerprint images and the xth frame of fingerprint images in the x frames of fingerprint images to determine whether the user's finger slides, that is, to determine whether the fingerprint entry method for this time is sliding entry or pressing entry. In the case where the similarity between the above-mentioned first frame of fingerprint image and the xth frame of image is greater than or equal to the preset similarity, it indicates that the similarity between the first frame of fingerprint image and the xth frame of image is high, and the user's finger has not slid, that is, the probability of being in a static state is high, which also indicates that the probability of this fingerprint entry method being pressing entry is high. Therefore, the mobile phone can use the collected x frames of fingerprint images as the fingerprint images corresponding to one fingerprint entry, and the mobile phone can execute S305.

[0147] When the similarity between the first fingerprint image and the x-th fingerprint image in the above x-frame fingerprint images is less than the preset similarity, it indicates that the similarity between the first fingerprint image and the x-th fingerprint image is low, and the user's finger slides, that is, the probability of being in a sliding state is high, which also indicates that the probability of sliding entry is high. Therefore, the mobile phone can continue to collect fingerprint images until the user's finger is lifted, and then end the fingerprint entry. The mobile phone can execute S309.

[0148] In some embodiments, the mobile phone can use the area of ​​the overlapping region between the fingerprint images to determine the similarity between the fingerprint images. Exemplarily, the mobile phone can determine whether the area of ​​the overlapping region between the first frame of fingerprint image and the x-th frame of fingerprint image is greater than or equal to a preset area threshold. If the area of ​​the overlapping region is greater than or equal to the preset area threshold, the mobile phone can determine that the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image is greater than or equal to the preset similarity. If the area of ​​the overlapping region is less than the preset area threshold, the mobile phone can determine that the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image is less than the preset similarity.

[0149] Optionally, the area of ​​the overlapping region may be expressed by a ratio, and the corresponding preset area threshold may also be expressed by a ratio, for example, the preset area threshold is 90%.

[0150] In other embodiments, the mobile phone can use a model to determine the similarity between fingerprint images. Exemplarily, the mobile phone can input the above-mentioned first frame fingerprint image and the x-th frame fingerprint image into model 1 (or referred to as the second preset model), and model 1 can calculate the similarity between the first frame fingerprint image and the x-th frame fingerprint image, and output the similarity. After obtaining the similarity output by model 1, the mobile phone can compare the similarity with the preset similarity to determine whether the similarity is greater than the preset similarity. Alternatively, model 1 can directly output a similarity comparison result, which indicates whether the similarity between the first frame fingerprint image and the x-th frame fingerprint image is greater than or equal to the preset similarity.

[0151] The above-mentioned model 1 is a network model that has been trained by sample fingerprint images (such as fingerprint images with similarity greater than or equal to a preset similarity), which can be used to calculate the similarity between fingerprint images. Optionally, after obtaining the similarity between fingerprint images, the model 1 can also compare the similarity with the preset similarity to directly output the corresponding similarity comparison result.

[0152] In addition, the mobile phone can also determine the similarity between the first frame fingerprint image and the xth frame fingerprint image by other methods. For example, the mobile phone can determine the number of matching key points between the fingerprint images, and the number of matching key points represents the similarity between the fingerprint images. Afterwards, the mobile phone can determine whether the similarity between the fingerprint images is greater than or equal to the preset similarity by judging whether the number of matching key points is greater than or equal to the preset number. This application does not limit the method of determining the similarity between fingerprint images.

[0153] S305: The mobile phone stops collecting fingerprint images, and determines a first sub-template corresponding to the first finger based on the x frames of fingerprint images.

[0154] The first sub-template (or referred to as the first target fingerprint image) corresponding to the first finger is used to determine the partial fingerprint information corresponding to the first finger.

[0155] S306. The mobile phone adds the first sub-template corresponding to the first finger to the template set corresponding to the first finger.

[0156] In the embodiment of the present application, after the x-th frame of fingerprint image corresponding to the first finger is collected, if the similarity between the first frame of fingerprint image and the x-th frame of fingerprint image is greater than or equal to the preset similarity, it indicates that the user's finger is likely to be stationary on the fingerprint collection area of ​​the mobile phone, that is, it indicates that the user is currently pressing to enter the fingerprint, and the mobile phone can stop collecting fingerprint images and use the collected x-frame fingerprint images as the current fingerprint entry, that is, the fingerprint image corresponding to the current pressing and entering. Correspondingly, the x-frame fingerprint images can be used as the first sub-template corresponding to the first finger. Alternatively, since the similarity between the x-frame fingerprint images is high, the mobile phone can use any frame of the x-frame fingerprint images as the first sub-template corresponding to the first finger.

[0157] In some embodiments, a trusted application (TA) in a mobile phone, such as a fingerprint TA (or fingerprint application), can send a stop image acquisition instruction to the fingerprint device, and the stop image acquisition instruction is used to trigger the fingerprint device to stop acquiring fingerprint images. In addition, the fingerprint TA can report a first message, and the first message is used to indicate that the current press entry is completed, such as reporting to the processor.

[0158] S307: The mobile phone outputs a first prompt message, where the first prompt message is used to prompt the user to slide and enter the fingerprint.

[0159] Exemplarily, in order to improve the efficiency of fingerprint entry, when the mobile phone determines that the fingerprint entry method this time is press entry, the mobile phone can display a first prompt message, and / or voice output the first prompt message to prompt the user to use the sliding entry method to enter the fingerprint, thereby realizing timely reminder of sliding entry.

[0160] In some embodiments, the mobile phone may display the first prompt information through the interface, that is, the first prompt information is part of the content of the interface (such as Fig. 6A Alternatively, the mobile phone may display the first prompt information through a pop-up window (such as Figure 6B The first prompt information 61 shown).

[0161] S308. The mobile phone displays an interface 2 based on the first sub-template corresponding to the first finger, where the interface 2 displays a filled image of the first fingerprint.

[0162] In some embodiments, when there are multiple fingerprint images in the first sub-template corresponding to the first finger, the mobile phone can splice the first sub-template corresponding to the first finger. Afterwards, the mobile phone can use the spliced ​​fingerprint image to determine the partial fingerprint information corresponding to the first finger, and the partial fingerprint information corresponding to the first finger represents the fingerprint part recorded in this fingerprint recording. Then, the mobile phone can display interface 2, and interface 2 includes a fingerprint display area, and the fingerprint display area is used to display the fingerprint pattern recorded subsequently. Correspondingly, the mobile phone can display the fingerprint pattern recorded by this pressing in the fingerprint display area in a first display mode, and the fingerprint pattern indicates the partial fingerprint information corresponding to the first finger, so as to realize dynamic fingerprint filling, so that the user can know the fingerprint part that has been recorded.

[0163] Exemplarily, the fingerprint display area displays an initial fingerprint image (such as Fig. 7A After that, the mobile phone can change the color of some lines in the initial fingerprint image based on the partial fingerprint information corresponding to the first finger, that is, based on the fingerprint pattern recorded by the current pressing, and display the latest fingerprint image (such as Figure 7B It should be understood that the dotted line in the fingerprint image 71 represents the fingerprint portion that has been recorded, and the color of the dotted line portion in the fingerprint image 71 is different from the color of the solid line portion.

[0164] In other embodiments, since the similarity between the x frames of fingerprint images is high, the mobile phone does not need to splice the x frames of fingerprint images, but can directly select a fingerprint image from the x frames of fingerprint images. Afterwards, the mobile phone can use the selected fingerprint image to determine the partial fingerprint information corresponding to the first finger. For example, the mobile phone can select the first frame of fingerprint image, the xth frame of fingerprint image, or any other fingerprint image from the fingerprint image corresponding to the current press entry, so as to use the selected fingerprint image to determine the partial fingerprint information corresponding to the first finger, thereby realizing rapid determination of fingerprint information.

[0165] In some embodiments, when a fingerprint entry is completed, the mobile phone can call a motor to vibrate to prompt the user to lift his finger to proceed to the next fingerprint entry through motor vibration.

[0166] In some embodiments, when a fingerprint entry is completed, the mobile phone may not perform the filling animation, that is, the mobile phone may not execute the above S308.

[0167] The above describes the process of the mobile phone processing when the mobile phone determines that the fingerprint entry method is press entry based on the first frame fingerprint image and the xth frame fingerprint image. The following will continue to describe the process of the mobile phone processing when the fingerprint entry method is slide entry.

[0168] S309: The mobile phone continues to collect the fingerprint image of the first finger until the mobile phone stops collecting the fingerprint image when the second preset condition is met.

[0169] The second preset condition includes detecting that the first finger leaves the fingerprint collection area, or the sliding input time is greater than the preset time threshold. The sliding input time indicates the time from the detection of the first finger touching the fingerprint collection area to the current time, that is, the time from the start of the current fingerprint input to the current time. The longer the sliding input time, the longer the current fingerprint input time.

[0170] In the embodiment of the present application, after the x-th frame fingerprint image corresponding to the first finger is collected, if the similarity between the first frame image and the x-th frame fingerprint image is less than the preset similarity, it indicates that the possibility that the user's finger is in a stationary state on the fingerprint collection area of ​​the mobile phone is low, that is, the user's finger is sliding, that is, the user's fingerprint entry method this time is sliding entry, and the mobile phone does not need to end this fingerprint entry, and can continue to collect the fingerprint image corresponding to this fingerprint entry. When it is detected that the user's finger leaves the fingerprint collection area, the mobile phone stops collecting fingerprint images, that is, when the fingerprint image is stopped when the user's finger is lifted, it indicates that this sliding entry is over, and the mobile phone can stop collecting fingerprint images, or when the sliding entry time is too long, the mobile phone can automatically end this fingerprint entry and stop collecting fingerprint images, thereby avoiding the user from performing a fingerprint entry for a long time, ensuring the efficiency of fingerprint entry, and avoiding the first finger from pressing on the fingerprint collection area for a long time during the sliding process, causing the mobile phone to collect fingerprint images with higher similarity, ensuring the effectiveness of fingerprint image acquisition, thereby improving the efficiency of fingerprint entry.

[0171] S310: The mobile phone uses the fingerprint image collected from the time when the first finger touches the fingerprint collection area until the mobile phone meets the second preset condition as the second sub-template corresponding to the first finger.

[0172] S311. The mobile phone adds the second sub-template corresponding to the first finger to the template set corresponding to the first finger.

[0173] For example, the mobile phone can regard the time from the first finger touching the fingerprint collection area to the time when the first finger of the user leaves the fingerprint collection area as one sliding entry, or the time from the first finger touching the fingerprint collection area to the time when the sliding entry duration is greater than a preset duration threshold as one sliding entry. Accordingly, the fingerprint image collected during this sliding entry process can be used as the fingerprint image corresponding to this sliding entry, that is, the second sub-template (or called the second target fingerprint image). Afterwards, the mobile phone can add each fingerprint image in the above second sub-template to the template set corresponding to the first finger.

[0174] In some embodiments, when it is determined that the current fingerprint entry is a sliding entry, the mobile phone can continue to collect fingerprint images. During the collection process, the mobile phone can determine whether the sliding entry duration is greater than a preset duration threshold. If greater than, it indicates that the sliding entry duration is too long, and the mobile phone can end the sliding entry, that is, stop collecting fingerprint images. If less than or equal to, the mobile phone can continue to collect fingerprint images. When the user's first finger is lifted, although the sliding entry duration is less than or equal to the preset duration threshold, the mobile phone can also end the sliding entry.

[0175] In some embodiments, the mobile phone can determine whether there is abnormal behavior in this sliding entry based on the second sub-template corresponding to the first finger. In the case of abnormal sliding behavior, the mobile phone can output a second prompt information for the abnormal sliding behavior to prompt the user of the problem in this sliding entry, thereby guiding the user to correctly perform sliding fingerprint entry and improve the efficiency of fingerprint entry.

[0176] The abnormal sliding behavior may include at least one of sliding too slowly, sliding too fast, lifting too quickly, and repeated entry. Lifting too quickly means that the duration of this sliding entry is short, that is, the contact time between the user's finger and the fingerprint collection area is short. Repeated entry means that the fingerprint part of this sliding entry already exists.

[0177] Correspondingly, for a sliding speed that is too fast, the second prompt information is used to prompt to reduce the sliding speed. For example, the second prompt information for a sliding speed that is too fast may be "your finger is sliding too fast, please slow down the sliding speed to enter data."

[0178] If the sliding speed is too slow, the second prompt message is used to prompt to increase the sliding speed. For example, the second prompt message if the sliding speed is too slow may be "The finger slides too slowly, please increase the sliding speed slightly to enter the data."

[0179] For lifting the finger too quickly, the second prompt information is used to prompt to increase the contact time between the finger and the fingerprint collection area. For example, the second prompt information for lifting the finger too quickly can be "The finger was lifted too quickly, please increase the contact time between the finger and the fingerprint collection area."

[0180] For repeated entry, the second prompt information is used to prompt to enter the fingerprint from different angles and directions. For example, the second prompt information for repeated entry can be "enter the fingerprint from different angles and directions to ensure complete entry".

[0181] In some embodiments, the mobile phone can use the time of this sliding entry to determine whether there is any abnormal sliding behavior of lifting too quickly in this sliding entry. The mobile phone can obtain a first sliding duration, which represents the time from when the user's finger touches the fingerprint collection area of ​​the mobile phone to when the user's finger leaves the fingerprint collection area of ​​the mobile phone. When the first sliding duration is less than the preset sliding duration, the mobile phone can determine that there is an abnormal sliding behavior of lifting too quickly in this sliding entry. When the first sliding duration is greater than or equal to the preset sliding duration, the mobile phone can determine that there is no abnormal sliding behavior of lifting too quickly in this sliding entry.

[0182] Alternatively, the mobile phone can use the number of fingerprint images corresponding to a sliding entry to determine whether there is an abnormal sliding behavior of lifting too quickly in this sliding entry. The mobile phone can determine whether the number of fingerprint images in the second sub-template corresponding to the above-mentioned first finger is less than the preset number of images. If it is less than the preset number of images, it indicates that the number of fingerprint images collected during this sliding entry is small, and the mobile phone can determine that there is an abnormal sliding behavior of lifting too quickly in this sliding entry. If it is greater than or equal to the preset number of images, the mobile phone can determine that there is no abnormal sliding behavior of lifting too quickly in this sliding entry.

[0183] In addition, the mobile phone can also determine whether there is an abnormal behavior of lifting too quickly in this sliding entry by other means. For example, the mobile phone can splice the fingerprint image in the second sub-template corresponding to this sliding entry, so as to use the area and number of pixels of the fingerprint image on the spliced ​​image to determine whether there is an abnormal behavior of lifting too quickly.

[0184] In some embodiments, the mobile phone can use the overlapping area between adjacent fingerprint images in the second sub-template corresponding to a sliding entry to determine whether there is an abnormal behavior of sliding too fast or too slow in this sliding entry. When the number of adjacent fingerprint images whose overlapping area is greater than the first preset area threshold is too large (such as greater than the first number), the mobile phone can determine that there is an abnormal sliding behavior of sliding too slowly in this sliding entry.

[0185] When the number of adjacent fingerprint images whose overlapping area is smaller than the second preset area threshold is too large (e.g., greater than the second number), the mobile phone can determine that there is an abnormal sliding behavior of sliding too fast in this sliding entry. The first preset area threshold is greater than the second preset area threshold, and the first number and the second number can be the same or different.

[0186] In some embodiments, the mobile phone can splice the second sub-template corresponding to a sliding entry. Afterwards, the mobile phone can use the spliced ​​image to determine the partial fingerprint information corresponding to the first finger recorded in this sliding entry. If the mobile phone already has the partial fingerprint information corresponding to the first finger, indicating that the user has repeatedly entered the fingerprint, the mobile phone can determine that there is an abnormal sliding behavior of repeated entry in this sliding entry.

[0187] In some embodiments, when a sliding entry corresponding to the first finger has abnormal sliding behavior, in order to improve the entry efficiency, the mobile phone can add the second sub-template corresponding to this sliding entry to the template set corresponding to the first finger. Alternatively, in order to ensure the accuracy of fingerprint entry, the mobile phone may not add the second sub-template corresponding to this sliding entry to the template set of the first fingerprint, and may delete the second sub-template corresponding to this sliding entry.

[0188] S312. The mobile phone displays interface 3 based on the second sub-template corresponding to the first finger, where interface 3 displays a filled image of the first fingerprint.

[0189] The implementation process of S312 may refer to the implementation process of S308 described above, and will not be described in detail here.

[0190] In some embodiments, when a fingerprint entry is completed, the mobile phone may not perform the filling animation, that is, the mobile phone may not execute the above S312.

[0191] In some embodiments, when a sliding entry is completed, the mobile phone can call a motor to vibrate to prompt the completion of the fingerprint entry and proceed to the next fingerprint entry.

[0192] S313: The mobile phone determines whether the mobile phone meets the preset stop input condition.

[0193] In an embodiment of the present application, after a fingerprint entry is completed, such as after a press entry is completed, or after a slide entry is completed, the mobile phone can determine whether the mobile phone currently meets the preset stop entry conditions, that is, whether the fingerprint entry can be ended, that is, whether a new fingerprint entry needs to be started.

[0194] When the mobile phone does not meet the preset stop entry condition, it indicates that the user still needs to continue fingerprint entry, that is, the mobile phone needs to start a new fingerprint entry, and the mobile phone can execute S314.

[0195] When the mobile phone meets the preset stop entry condition, it indicates that the fingerprint entry can be ended without starting a new fingerprint entry, and the mobile phone can execute S315.

[0196] In some embodiments, the above-mentioned preset stop entry condition may include at least one of the following: the number of fingerprint images in the template set corresponding to the first finger is greater than a preset stop number threshold, the fingerprint area corresponding to the template set corresponding to the first finger is greater than a preset fingerprint area, and the number of fingerprint entry times is greater than a preset number.

[0197] The fingerprint area corresponding to the template set corresponding to the first finger indicates the area of ​​the fingerprint portion of the first finger that has been recorded. The process of determining the total fingerprint area corresponding to the template set corresponding to the first finger may include: the mobile phone may first splice all fingerprint images in the template set corresponding to the first finger. Afterwards, the mobile phone may extract fingerprint information using the spliced ​​images and determine the fingerprint area, that is, obtain the fingerprint area corresponding to the template set corresponding to the first finger.

[0198] The above-mentioned number of entry times represents the sum of the number of sliding entry times and the number of pressing entry times.

[0199] It should be noted that, when the mobile phone satisfies the condition that the total fingerprint area corresponding to the template set corresponding to the first finger is greater than the preset fingerprint area, it indicates that the fingerprint of the first finger has been successfully recorded. When the mobile phone satisfies the condition that the number of fingerprint images in the template set corresponding to the first finger is greater than the preset stop number threshold, or when the mobile phone satisfies the condition that the number of fingerprint recordings is greater than the preset number, it is still impossible to determine whether the fingerprint of the first finger has been successfully recorded. The mobile phone can continue to judge whether the first finger has been successfully recorded based on the fingerprint area corresponding to the template set corresponding to the first finger. For example, the mobile phone can determine whether the fingerprint area corresponding to the template set corresponding to the first finger is greater than the preset fingerprint area. If it is greater than the preset fingerprint area, it indicates that the fingerprint of the first finger has been successfully recorded. If it is less than or equal to the preset fingerprint area, it indicates that the fingerprint of the first finger has not been successfully recorded, and the mobile phone can prompt the user to re-enter the first finger.

[0200] S314: The mobile phone starts a new fingerprint entry, collects a new fingerprint image corresponding to the first finger, and returns to the above S304.

[0201] In the embodiment of the present application, when the mobile phone does not meet the preset stop input condition, the mobile phone can restart the input, that is, when the user's first finger is detected to touch the fingerprint collection area of ​​the electronic device, the fingerprint image of the first finger is restarted to obtain a new fingerprint image corresponding to the first finger. Then, when the number of new fingerprint images collected reaches x frames, the similarity between the first frame fingerprint image and the xth frame fingerprint image in the new x frames fingerprint image is used to determine whether the fingerprint input mode is sliding input or pressing input, so as to perform corresponding operations according to the fingerprint input mode.

[0202] In some embodiments, the above-mentioned method of determining the fingerprint entry method of the first finger by the similarity between the first frame fingerprint image and the xth frame fingerprint image is only an example, and the mobile phone can also determine the entry method this time by other methods. For example, the mobile phone can determine the fingerprint entry method this time by using the motion data collected by the motion sensor of the mobile phone. Generally speaking, the degree of influence of press entry and slide entry on the motion state of the mobile phone is different. Since the finger is stationary on the fingerprint collection area during the press entry process, and the finger is sliding on the fingerprint collection area during the slide entry process, compared with the press entry, the slide entry has a greater degree of influence on the motion state of the mobile phone, and the posture change degree of the mobile phone is greater, so that the motion data collected by the mobile phone during the press entry process is different from the motion data collected by the mobile phone during the slide entry process.

[0203] Therefore, during a fingerprint entry process, the mobile phone can use the motion data collected by the motion sensor of the mobile phone to distinguish whether the fingerprint entry is a sliding entry or a pressing entry. Exemplarily, the mobile phone can obtain the first motion data collected by the motion sensor when it detects that the user's first finger touches the fingerprint collection area, that is, after a fingerprint entry starts. The first motion data represents the motion data collected by the motion sensor of the mobile phone within a preset time after the mobile phone detects that the user's finger touches the fingerprint collection area, or the first motion data represents the motion data collected from the time the mobile phone detects that the user's finger touches the fingerprint collection area to the time the mobile phone collects the xth frame of fingerprint image.

[0204] Afterwards, the mobile phone can input the above-mentioned first motion data into model 2 (or referred to as the first preset model) to obtain the input method result output by model 2. The input method result indicates whether the fingerprint input method is sliding input or pressing input, thereby determining the fingerprint input method. Model 2 is obtained by training the network model based on relevant sample motion data (such as sample motion data corresponding to pressing input and / or sample motion data corresponding to sliding input).

[0205] The motion sensor may include at least one of a gyroscope sensor, an acceleration sensor, a magnetometer, a linear acceleration sensor, a gravity acceleration sensor and a rotation vector sensor.

[0206] The gyroscope sensor is used to collect the motion posture data of the mobile phone.

[0207] The acceleration sensor is used to detect the acceleration and gravity of the mobile phone during movement. Specifically, the acceleration and gravity can be detected through three axes (X axis, Y axis and Z axis). For example, the acceleration sensor can detect the tilt direction of the mobile phone.

[0208] The magnetometer is used to measure magnetic field strength data and direction data. For example, when the phone is placed horizontally, the magnetometer can detect the four directions of east, south, west and north to realize the function of a compass. For another example, when the phone is held vertically, the magnetometer can detect the three-dimensional direction of the phone.

[0209] The linear acceleration sensor is used to detect the magnitude and direction of the offset velocity to which the mobile phone is subjected when it is in a non-stationary state.

[0210] The gravity acceleration sensor is used to detect the posture and gravity changes of the mobile phone. For example, when the user's finger slides on the fingerprint collection area of ​​the mobile phone, the holding angle of the mobile phone and the gravity will change accordingly, and the gravity acceleration sensor in the mobile phone will collect the corresponding change data.

[0211] The rotation vector sensor is used to detect the angular data and three-axis data of the mobile phone. For example, the rotation vector sensor can detect angle changes, detect relative orientation changes, etc.

[0212] In some embodiments, after receiving a first operation input by a user, the mobile phone (such as the fingerprint TA on the finger) can trigger the motion sensor to collect motion data in response to the first operation, or trigger the motion sensor to collect motion data when the first fingerprint entry begins. Alternatively, the motion sensor can collect motion data in real time or periodically, and the mobile phone can cache the motion data for a period of time, such as by sliding window caching. When it is necessary to determine the fingerprint entry mode this time, the first motion data is read from the cache.

[0213] In an embodiment of the present application, the mobile phone can select a method for determining the fingerprint entry method according to demand. For example, in order to accurately determine the fingerprint entry method, the mobile phone can determine the fingerprint entry method through the first frame of fingerprint image and the xth frame of fingerprint image collected during the current fingerprint entry. In addition, the mobile phone can also use the motion data collected by the motion sensor to determine the fingerprint entry method while judging through the first frame of fingerprint image and the xth frame of fingerprint image collected during the current fingerprint entry. When the fingerprint entry methods determined by the two methods are consistent, the mobile phone can directly determine that the fingerprint entry method of this time is the fingerprint entry method determined by any method. When the fingerprint entry methods determined by the two methods are consistent, the mobile phone can use the default fingerprint entry method (such as sliding entry or pressing entry) as the fingerprint entry method.

[0214] S315. The mobile phone stops recording fingerprints.

[0215] S316. The mobile phone determines the fingerprint information of the first finger using the template set corresponding to the first finger.

[0216] In the embodiment of the present application, when the mobile phone meets the preset stop entry condition, it indicates that the fingerprint collection of the first finger is completed, and the mobile phone does not need to continue to collect fingerprint images. The mobile phone can exit the current new fingerprint interface and can display the above Fig. 5F The interface shown. And the mobile phone can splice all fingerprint images in the template set corresponding to the first finger, so as to determine the fingerprint information of the first finger using the spliced ​​images.

[0217] In some embodiments, in order to improve data security, after the fingerprint of the first finger is entered, the mobile phone can encrypt and save the fingerprint information of the first finger, or, after the fingerprint of the first finger is successfully entered, if the fingerprint area corresponding to the template set corresponding to the first finger is larger than the preset fingerprint area, the mobile phone will encrypt and save the fingerprint information of the first finger to improve the security of fingerprint information storage and prevent the fingerprint information from being tampered with or obtained.

[0218] In some embodiments, the sliding entry guiding animation played when entering the fingerprint of the first finger may include a sliding speed guiding animation portion, a contact duration guiding animation portion, and a sliding direction position guiding animation portion.

[0219] The sliding speed guiding animation part guides the sliding speed of the user's finger. For example, the sliding speed guiding animation part guides the sliding speed of the user's finger by showing the change of the position of the user's finger on the fingerprint sensing area (such as Fig. 9 The sliding entry guide animation shown in the figure can reduce the probability of the user's finger sliding too fast or too slow.

[0220] The contact duration guide animation part guides the user's finger to contact the fingerprint collection area for a certain period of time (such as Fig.10 Alternatively, the contact duration guiding animation part can be the same as the sliding speed guiding animation part, guiding the sliding speed of the user's finger by showing the change in the position of the user's finger on the fingerprint sensing area.

[0221] The sliding direction and position guidance animation part guides the sliding direction and sliding position of the user's finger (such as Fig.11 or Fig.12 The sliding direction position shown in the figure guides multiple frames of the animation part) to reduce the probability of repeated entry.

[0222] Generally speaking, in actual use, users will record fingerprints of multiple fingers. After the first finger is recorded, the user continues to record another finger (or called the second finger) on the mobile phone. In order to improve the efficiency of fingerprint entry, the mobile phone can play the corresponding sliding entry guide animation part for the abnormal entry behavior during the fingerprint entry of the first finger, so as to achieve targeted playback of the sliding entry guide animation and improve the effectiveness of the guide animation playback. Among them, the abnormal entry behavior may include at least one of pressing entry, abnormal sliding speed, lifting too fast (or described as fast lifting) and repeated entry. Among them, the abnormal sliding speed may include sliding speed too fast and / or sliding speed too slow.

[0223] For example, after the fingerprint of the first finger is recorded, the mobile phone receives the first operation again (such as the user clicks Figure 8 The new fingerprint control shown in the figure indicates that the mobile phone needs to enter a new fingerprint. In response to the first operation, for each finger that has already entered a fingerprint (or described as each fingerprint that already exists in the mobile phone), the mobile phone can count the number of various abnormal entry behaviors that occur during the fingerprint entry, and obtain the number of each abnormal entry behavior corresponding to the fingerprint. Afterwards, for each abnormal entry behavior, the mobile phone can calculate the sum of the number of such abnormal entry behaviors corresponding to all existing fingerprints, and obtain the total number of such abnormal entry behaviors. The higher the total number of a certain abnormal entry behavior, the higher the probability of such abnormal entry behavior occurring during the fingerprint entry period.

[0224] For example, the existing (i.e., recorded) fingerprints include the fingerprint of the first finger (e.g. Figure 8 Fingerprint 1 shown). Abnormal entry behavior includes press entry. The mobile phone can count the number of press entries that occur during the fingerprint entry of the first finger to obtain the total number of press entries. For another example, the entry behavior includes abnormal sliding speed, and the abnormal sliding speed includes sliding too fast and sliding too slow. The mobile phone can count the number of sliding too fast and the number of sliding too slow that occur during the fingerprint entry of the first finger, that is, the abnormal sliding behavior that occurs during the fingerprint entry is the number of sliding too fast and the number of sliding too slow. Afterwards, the mobile phone can calculate the sum of the number of sliding speeds that are too fast and the number of sliding speeds that are too slow to obtain the number of abnormal sliding speeds, that is, the total number of abnormal sliding speeds.

[0225] Afterwards, the mobile phone can display interface 3 (or called the second interface), and play the abnormal behavior guidance animation corresponding to the target abnormal entry behavior on this interface 3. The target abnormal entry behavior can be the abnormal entry behavior with the highest total number of times, or the abnormal entry behavior with a total number of occurrences greater than the preset number of occurrences, so as to achieve targeted playback of the guidance animation and reduce the probability of more problems that occurred during the historical fingerprint entry to occur during the fingerprint entry of a new finger, thereby improving the effectiveness of the guidance animation playback and thus improving the efficiency of fingerprint sliding entry.

[0226] In some embodiments, the above-mentioned sliding entry guidance animation includes at least one frame, and the above-mentioned abnormal behavior guidance animation includes at least one frame. The abnormal behavior guidance animation corresponding to the abnormal sliding speed may be the above-mentioned sliding speed guidance animation part, the abnormal behavior guidance animation corresponding to lifting too fast may be the above-mentioned contact duration guidance animation part, the abnormal behavior guidance animation corresponding to repeated entry may be the above-mentioned sliding direction position guidance animation part, and the abnormal behavior guidance animation corresponding to pressing entry may be the above-mentioned sliding entry guidance animation. For example, if the target entry behavior has the highest total number of abnormal entry behaviors, and the target entry behavior is abnormal sliding speed, then the mobile phone can play the abnormal behavior guidance animation corresponding to the abnormal fluctuation speed, that is, play the sliding speed guidance animation part, to guide the user to slide and enter at the correct sliding speed, without playing the animation part that is not related to the sliding speed guidance, so as to achieve fast and effective playback of the abnormal behavior guidance animation and shorten the playback time of the abnormal behavior guidance animation.

[0227] In addition, the abnormal behavior guidance animation corresponding to the abnormal entry behavior may also be a separate abnormal behavior guidance animation, rather than a part of the sliding entry guidance animation, and the abnormal behavior guidance animation may be pre-stored in the mobile phone.

[0228] In the embodiment of the present application, if the mobile phone supporting sliding input does not integrate the algorithm of pressing input, during the fingerprint input, the fingerprint device (such as fingerprint sensor) of the mobile phone will continuously collect fingerprint images after the user's finger is pressed, until the user's finger leaves the fingerprint collection area, that is, until the user lifts the finger, the mobile phone will vibrate once to prompt the user to complete a fingerprint input, and fill the fingerprint, and prompt the user of the abnormal behavior of this fingerprint input. Based on this, when the user's finger does not move for a long time on the fingerprint collection area, that is, when the user uses the pressing input method to input the fingerprint, the mobile phone needs to wait until the user's finger is lifted before it will vibrate and fill the fingerprint, resulting in the inability to perform feedback and dynamic filling of pressing input, reducing the user's fingerprint input experience. And it is necessary to wait until the user's finger is lifted before prompting the user that sliding input is required, and the prompt timeliness of sliding input is poor, which affects the efficiency of user fingerprint input. Therefore, it is necessary to integrate the algorithm of pressing input on the mobile phone supporting sliding input to achieve timely feedback of pressing input and timely prompt of sliding input, so as to improve the efficiency of user fingerprint input.

[0229] In some embodiments, the above x can be 10. The time for one sliding entry is about 1.5 seconds, the frame rate of the mobile phone is generally 40 frames / second, and the number of fingerprint images collected by one sliding entry is about 60 frames. After starting a fingerprint entry, after collecting 10 frames of fingerprint images, the mobile phone determines whether the fingerprint entry method is sliding entry, that is, determines whether to end the fingerprint entry. When it is determined that the fingerprint entry method is not sliding entry but pressing entry, the mobile phone can end the fingerprint entry and prompt the user to slide entry, without having to wait until the end of one sliding entry, that is, without having to collect 60 frames of fingerprint images, to determine whether the fingerprint entry method is sliding entry, so as to prompt the user to slide entry, thereby achieving timely feedback of fingerprint entry and improving the efficiency of fingerprint entry. In addition, the mobile phone can store any one of the 10 fingerprint images corresponding to this fingerprint entry (that is, the 10 fingerprint images collected during this fingerprint entry) into the template set corresponding to the finger, without discarding the fingerprint image collected during the pressing entry, thereby improving the collection efficiency of the template set corresponding to the finger, thereby improving the fingerprint collection efficiency of the finger and improving the efficiency of fingerprint entry.

[0230] In some embodiments, when different users perform touch operations on the display screen of the mobile phone, the motion data (herein referred to as perception data) collected by the motion sensor of the mobile phone are different. Specifically, when different users operate the mobile phone, the perception data received by the motion sensor based on the user's touch operation feedback will have different characteristics. Therefore, after the user inputs the second operation, the mobile phone receives the second operation. The second operation can be used to trigger the mobile phone to start the fingerprint application, such as the above Figure 5CThe click operation of the fingerprint control is shown. The second operation can be placed before the first operation.

[0231] In response to the second operation, the mobile phone may obtain the sensing data, which represents the motion data collected by the motion sensor during the user's touch operation within the target time before the second operation. For example, if the target time is 10 minutes, the sensing data represents the motion data collected by the mobile phone within 10 minutes before receiving the second operation.

[0232] The above-mentioned perception data may be obtained from a cache.

[0233] Afterwards, the mobile phone can input the perception data into the target recognition model so that the target recognition model can use the distribution characteristics of the perception data to identify the user identity. The user identity indicates whether the user currently using the mobile phone is the owner, that is, whether the current user is the owner user, thereby realizing the identification of the user identity.

[0234] When the user identity indicates that the current user is not the owner of the device, it indicates that the user may be a risky user. In order to ensure the security of fingerprint data, the mobile phone can display a password input interface (such as the above Figure 5D When the password is entered correctly, the mobile phone can display interface 4 (or the third interface), which (as shown above) Figure 5E The interface 55 shown, or as described above Figure 8 The interface shown) includes a new fingerprint control, so that the user can enter the fingerprint by triggering the new fingerprint control, thereby ensuring the security of fingerprint entry and thus ensuring the data security of the electronic device.

[0235] When the user identity indicates that the current user is the owner of the device, it indicates that the user is a trusted user. The mobile phone can display interface 4, which includes a new fingerprint control, so that the user can enter the fingerprint by triggering the new fingerprint control. On the basis of ensuring the security of fingerprint entry, the user identity can be recognized without feeling, reducing the user's operation and reducing the tediousness of fingerprint entry. For example, the user clicks on Fig.13A The mobile phone receives a click operation of the fingerprint control, and in response to the click operation, the mobile phone uses the sensing data to identify the user's identity. In the case where the user's identity indicates the owner of the phone, the mobile phone does not need the user to enter a password and can directly display the following information: Fig. 13B The interface shown.

[0236] The target recognition model can be obtained by training the preset category model using the sample data of the owner user. Specifically, the preset category model can be trained based on the initial perception data when the user turns on the phone for the first time. In other words, the preset category model is trained for the owner user, which is more targeted and can improve the accuracy of user identity determination. It can be understood that in this embodiment, it is assumed that the series of operations performed after the first power-on are performed by the owner user.

[0237] It should be noted that the target recognition model trained by the mobile phone based on the sample data of the owner user is suitable for the mobile phone to determine whether the user is the owner user. That is to say, if the user identities recognized by the mobile phone using the target recognition model include the owner user and the non-owner user, the mobile phone needs to collect sample data about the owner user for training and learning to obtain the target recognition model.

[0238] It is understood that after obtaining the target recognition model, the mobile phone can directly input the above-mentioned perception data group into the target recognition model to obtain the user identity result to output the user identity. In addition, the motion data collected by the mobile phone and the identification of the user identity are performed under the authorization of the user.

[0239] In some embodiments, after the fingerprint is successfully entered, the mobile phone can use the entered fingerprint to unlock, access applications, make payments, and other operations.

[0240] In some embodiments, the present application provides a computer-readable storage medium, including computer instructions, which, when executed on an electronic device, enable the electronic device to execute the fingerprint entry method as described above.

[0241] In some embodiments, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the fingerprint entry method as described above.

[0242] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0243] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0244] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0245] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0246] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0247] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A fingerprint entry method, characterized in that: Applied to an electronic device, the electronic device includes a fingerprint collection area, the fingerprint collection area is arranged on a display screen of the electronic device, a side frame of the electronic device, or a rear shell of the electronic device, the method includes: Receiving a first operation; the first operation is used to trigger the electronic device to enter a new fingerprint; In response to the first operation, displaying a first interface, wherein the first interface is used to play a sliding input guide animation; Detecting that a first finger touches the fingerprint collection area, and starting to collect a fingerprint image of the first finger; In the case where x frames of fingerprint images are collected, if the electronic device meets a first preset condition, the electronic device stops collecting fingerprint images and saves a first target fingerprint image in a template set corresponding to the first finger; wherein x is a positive integer greater than 1; the first preset condition includes that the similarity between the first frame of fingerprint images and the xth frame of fingerprint images in the x frames of fingerprint images is greater than or equal to a preset similarity, and / or that the first motion data when the electronic device collects the x frames of fingerprint images indicates that the x frames of fingerprint images are recorded by the first finger by pressing the fingerprint collection area; the first target fingerprint image is obtained based on the x frames of fingerprint images and is used for fingerprint recognition of the first finger; If the electronic device does not meet the first preset condition, the electronic device continues to collect fingerprint images until the electronic device meets the second preset condition and stops collecting fingerprint images; wherein the second preset condition includes detecting that the first finger leaves the fingerprint collection area, or the sliding entry time is greater than a preset time threshold; wherein the sliding entry time represents the time from detecting that the first finger touches the fingerprint collection area to the current time; A second target fingerprint image is saved in the template set corresponding to the first finger; wherein the second target fingerprint image is obtained based on the fingerprint image collected from the time when the first finger is detected to touch the fingerprint collection area to the time when the electronic device meets the second preset condition.

2. The method according to claim 1, characterized in that If the electronic device meets the first preset condition, the x frames of fingerprint images correspond to one fingerprint entry; the method further includes: The electronic device outputs first prompt information; the first prompt information is used to prompt sliding to enter the fingerprint; If the electronic device does not meet the preset stop input condition, returning to the step of starting to collect the fingerprint image of the first finger; When the electronic device meets the preset stop recording condition, stop recording the fingerprint of the first finger, and determine the fingerprint information of the first finger based on the template set corresponding to the first finger; Among them, the preset stop entry condition includes at least one of the following: the number of fingerprint images in the template set corresponding to the first finger is greater than a preset stop number threshold, the total fingerprint area corresponding to the template set corresponding to the first finger is greater than a preset fingerprint area, and the number of fingerprint entry times is greater than a preset number; the total fingerprint area represents the fingerprint area of ​​the first finger that has been entered.

3. The method according to claim 2, characterized in that After stopping recording the fingerprint of the first finger, the method further includes: receiving the first operation; In response to the first operation, for each fingerprint already present in the electronic device, the number of various abnormal input behaviors corresponding to the fingerprint is obtained; the number of abnormal input behaviors corresponding to the fingerprint indicates the number of times the abnormal input behaviors occur during the fingerprint input; the abnormal input behaviors include at least one of pressing input, abnormal sliding speed, quick lifting, and repeated input; For each abnormal input behavior, the sum of the number of abnormal input behaviors corresponding to each fingerprint is calculated to obtain the total number of abnormal input behaviors; Display the second interface; the second interface is used to play the abnormal behavior guidance animation corresponding to the target abnormal entry behavior, and the target abnormal entry behavior represents the abnormal entry behavior with the highest total number of times, or represents the abnormal entry behavior with a total number of times greater than the preset number of occurrences.

4. The method according to claim 3, characterized in that The sliding entry guiding animation includes the abnormal behavior guiding animation.

5. The method according to claim 3 or 4, characterized in that: The sliding entry guiding animation includes at least one of a sliding speed guiding animation part, a contact duration guiding animation part, and a sliding direction position guiding animation part; When the target abnormal input behavior includes abnormal sliding speed, the second interface plays the sliding speed guiding animation part; When the abnormal target input behavior includes quick lifting, the second interface plays the contact duration guiding animation part; In the case where the target abnormal input behavior includes repeated input, the second interface plays the sliding direction position guidance animation portion.

6. The method according to any one of claims 1 to 5, characterized in that If the electronic device meets the first preset condition, the method further includes: The electronic device vibrates to prompt the user to start the next fingerprint entry.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: The first motion data is used as an input parameter of a first preset model, and the first preset model is moved to obtain a fingerprint entry result; the fingerprint entry result indicates that the x-frame fingerprint image is entered by the first finger by pressing the fingerprint collection area; the first preset model is obtained by training a network model based on sample motion data corresponding to sliding entry and / or sample motion data corresponding to pressing entry; the first preset model is used to identify the fingerprint entry method corresponding to the fingerprint image based on the motion data.

8. The method according to any one of claims 1 to 7, characterized in that The first operation represents a click operation on a newly created fingerprint control; Before receiving the first operation, the method further includes: Receiving a second operation; the second operation is used to trigger the electronic device to start a fingerprint application; In response to the second operation, the target recognition model is run using the sensed data as an input parameter to obtain a user identity result, wherein the user identity result indicates whether the current user is an owner user, and the sensed data represents motion data generated by a motion sensor of the electronic device based on a touch operation within a target time before receiving the second operation; When the user identity result indicates that the current user is the owner of the machine, a third interface is displayed, and the third interface includes the new fingerprint control.

9. An electronic device, characterized in that: The electronic device includes a fingerprint device, a display screen, a memory and one or more processors; the fingerprint device, the display screen, the memory and the processor are coupled; the fingerprint device is used to collect fingerprint images, the display screen is used to display images generated by the processor, and the memory is used to store computer program codes, and the computer program codes include computer instructions; when the processor executes the computer instructions, the electronic device executes the method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 8.

Images