Biometric methods, biometric devices and storage media

Abstract

This disclosure relates to a biometric identification method, a biometric identification device, and a storage medium. The biometric identification method is applied to a terminal, which supports multiple biometric identification modes, including at least a first biometric identification mode and a second biometric identification mode. The method includes: performing biometric identification on a user's biometric features using the first biometric identification mode and obtaining the identification result of the first biometric identification mode; when the identification result is a failure, determining a first identification failure type; and based on the first identification failure type, determining and switching to a second biometric identification mode least affected by the first identification failure type to identify the user's biometric features. Through this disclosure, when one biometric identification mode fails, switching to another biometric identification mode least affected by the current identification failure type can improve biometric identification efficiency, enhance terminal biometric identification performance, and meet the user's biometric identification needs.

Description

Technical Field

[0001] This disclosure relates to the field of terminal technology, and in particular to biometric methods, biometric devices and storage media. Background Technology

[0002] With the development of terminal technology, terminals are playing an increasingly important role in people's lives, and it is becoming more and more convenient to use terminals for activities such as payment and office work.

[0003] While mobile devices bring convenience to people's lives, they also pose threats to information security and property security. This has led to the development of various biometric technologies applied to mobile devices to enhance data security.

[0004] For example, when a user makes a payment through a mobile device, biometric verification, such as fingerprint recognition, is required to verify the security of the payment. Only after successful verification can the user use their mobile phone to make the payment. This method reduces the risk to data security on the mobile phone to some extent.

[0005] However, when users make payments via fingerprint recognition, fingerprint recognition often fails due to dirt or other reasons on their hands. Users are forced to repeatedly attempt fingerprint recognition to complete the payment, resulting in a poor user experience.

[0006] Therefore, how to improve the efficiency of biometric identification is an urgent problem to be solved. Summary of the Invention

[0007] To overcome the problems existing in related technologies, this disclosure provides a biometric method, a biometric device, and a storage medium.

[0008] According to a first aspect of the present disclosure, a biometric identification method is provided. The biometric identification method is applied to a terminal, the terminal supporting multiple biometric identification modes, the multiple biometric identification modes including at least a first biometric identification mode and a second biometric identification mode. The biometric identification method includes: performing biometric identification on a user's biometric features to be identified using the first biometric identification mode and obtaining the identification result of the first biometric identification mode; when the identification result is an identification failure, determining a first identification failure type; and determining and switching to a second biometric identification mode that is least affected by the first identification failure type to identify the user's biometric features.

[0009] In one embodiment, determining the first identification failure type includes: based on the correspondence between biometric features and biometric templates, determining a first biometric template from among multiple biometric templates corresponding to the biometric feature that failed to be identified, wherein the first biometric template is the biometric template with the highest similarity to the biometric feature that failed to be identified; based on the correspondence between biometric templates and identification failure types, determining the identification failure type corresponding to the first biometric template, and using the identification failure type corresponding to the first biometric template as the first identification failure type.

[0010] In one embodiment, determining the first identification failure type includes: acquiring association factor information of the first biometric pattern, the association factor information including multiple association factors that cause the first biometric pattern to fail to identify; detecting a first association factor in the association factor information, the first association factor being any one or more of the multiple association factors; if the detection of the first association factor meets a preset condition, then determining the identification failure type corresponding to the first association factor based on the correspondence between association factors and identification failure types.

[0011] In one embodiment, determining the second biometric pattern least affected by the first identification failure type includes: obtaining association factor information of other biometric patterns; and determining the biometric pattern whose association factor information of other biometric patterns does not contain the first association factor as the second biometric pattern.

[0012] In one embodiment, determining the second biometric pattern least affected by the first identification failure type includes: determining a second identification failure type different from the first identification type; determining the biometric pattern corresponding to the second identification failure type based on the correspondence between biometric patterns and identification failure types; and determining the biometric pattern corresponding to the second identification failure type as the second biometric pattern least affected by the identification failure type.

[0013] In one embodiment, the biometric mode corresponding to the second identification failure type includes a contact biometric mode and / or a contactless biometric mode; determining the biometric mode corresponding to the second identification failure type as the second biometric mode least affected by the identification failure type includes: when the first biometric mode is a contact biometric mode, determining a second contact biometric mode different from the first contact biometric mode as the second biometric mode least affected by the identification failure type; or, when the first biometric mode is a contactless biometric mode, determining a second non-contact biometric mode different from the first non-contact biometric mode as the second biometric mode least affected by the identification failure type.

[0014] In one embodiment, the contact-based biometric mode includes at least one of capacitive fingerprint recognition, optical fingerprint recognition, and ultrasonic fingerprint recognition; the non-contact biometric mode includes at least one of face recognition, iris recognition, and voiceprint recognition.

[0015] According to a second aspect of the present disclosure, a biometric device is provided, applied to a terminal, the terminal supporting multiple biometric modes, the multiple biometric modes including at least a first biometric mode and a second biometric mode, the biometric device comprising: an acquisition unit configured to perform biometric identification on a user's biometric features to be identified using the first biometric mode, and acquire the identification result of the first biometric mode; a determination unit configured to, when the identification result is an identification failure, determine a first identification failure type, and, based on the first identification failure type, determine a second biometric mode least affected by the first identification failure type; and a processing unit configured to switch to the second biometric mode least affected by the first identification failure type, and identify the user's biometric features to be identified.

[0016] In one embodiment, the determining unit determines the first identification failure type in the following manner: based on the correspondence between biometric features and biometric templates, among multiple biometric templates corresponding to the biometric feature that failed to be identified, a first biometric template is determined, wherein the first biometric template is the biometric template with the highest similarity to the biometric feature that failed to be identified; based on the correspondence between biometric templates and identification failure types, the identification failure type corresponding to the first biometric template is determined, and the identification failure type corresponding to the first biometric template is taken as the first identification failure type.

[0017] In one embodiment, the determining unit determines the first recognition failure type in the following manner: acquiring the association factor information of the first biometric pattern, the association factor information including multiple association factors that cause the first biometric pattern to fail to recognize; detecting the first association factor in the association factor information, the first association factor being any one or more of the multiple association factors; if the detection of the first association factor meets a preset condition, then determining the recognition failure type corresponding to the first association factor based on the correspondence between association factors and recognition failure types.

[0018] In one embodiment, the determining unit determines the second biometric pattern least affected by the first identification failure type by: obtaining the association factor information of other biometric patterns; and determining the biometric pattern whose association factor information of other biometric patterns does not contain the first association factor as the second biometric pattern.

[0019] In one embodiment, the determining unit determines the second biometric pattern least affected by the first identification failure type in the following manner: determining a second identification failure type different from the first identification type; determining the biometric pattern corresponding to the second identification failure type based on the correspondence between biometric patterns and identification failure types; and determining the biometric pattern corresponding to the second identification failure type as the second biometric pattern least affected by the identification failure type.

[0020] In one embodiment, the biometric mode corresponding to the second identification failure type includes a contact biometric mode and / or a non-contact biometric mode; the determining unit determines the biometric mode corresponding to the second identification failure type as the second biometric mode least affected by the identification failure type in the following manner: when the first biometric mode is a contact biometric mode, a second contact biometric mode different from the first contact biometric mode is determined as the second biometric mode least affected by the identification failure type; or, when the first biometric mode is a non-contact biometric mode, a second non-contact biometric mode different from the first non-contact biometric mode is determined as the second biometric mode least affected by the identification failure type.

[0021] In one embodiment, the contact-based biometric mode includes at least one of capacitive fingerprint recognition, optical fingerprint recognition, and ultrasonic fingerprint recognition; the non-contact biometric mode includes at least one of face recognition, iris recognition, and voiceprint recognition.

[0022] According to a third aspect of this disclosure, a biometric device is provided, comprising: a memory configured to store instructions; and a processor configured to invoke the instructions to execute the biometric method of the first aspect or any example thereof.

[0023] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided, which stores computer-executable instructions that, when executed by a processor, perform the biometric method of the first aspect or any example of the first aspect.

[0024] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: the terminal supports multiple biometric identification modes. When performing biometric identification on the user's biometric features in one biometric identification mode, the identification result of the current biometric identification mode is obtained. When the identification result fails, the identification failure type is determined, and the second biometric identification mode with the least impact from the identification failure type is determined and switched to. This can accurately obtain the biometric identification mode suitable for the current identification scenario, make up for the defects of the current identification scenario of the current biometric identification mode, achieve high-efficiency biometric identification of users, improve the biometric identification success rate, improve the terminal biometric identification performance, and meet the user's biometric identification needs.

[0025] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0026] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0027] Figure 1 This is a flowchart illustrating a biometric method according to an exemplary embodiment.

[0028] Figure 2 This is a flowchart illustrating a biometric method according to an exemplary embodiment.

[0029] Figure 3 This is an example flowchart illustrating how, after a face recognition failure, the face recognition is switched to another biometric recognition mode for different types of failure, according to an exemplary embodiment.

[0030] Figure 4 This is a block diagram illustrating a biometric device according to an exemplary embodiment.

[0031] Figure 5 This is a block diagram illustrating a biometric device according to an exemplary embodiment. Detailed Implementation

[0032] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0033] The technical solutions of the exemplary embodiments disclosed herein can be applied to application scenarios that utilize biometric technology supported by a terminal for biometric identification. In the exemplary embodiments described below, the terminal is sometimes also referred to as a smart terminal device, which can be a mobile terminal, user equipment (UE), mobile station (MS), etc. A terminal is a device that provides voice and / or data connectivity to a user, or a chip located within the device, such as a handheld device or in-vehicle device with wireless connectivity. Examples of terminals may include: mobile phones, tablets, laptops, PDAs, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in autonomous driving, wireless terminals in remote surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, etc.

[0034] Biometric technology closely integrates computers with high-tech methods such as optics, acoustics, biosensors, and biostatistics to identify individuals using inherent physiological characteristics (such as fingerprints, faces, and irises) and behavioral features (such as handwriting, voice, and gait).

[0035] Currently, with the development of terminal technology, biometric technology has been widely applied to various terminals, such as smart wearable terminals and mobile phones, and these terminals can now support a variety of biometric functions.

[0036] When using the biometric recognition function of a terminal for biometric recognition, a biometric recognition mode is usually enabled based on user settings or the terminal's default mode. Based on the enabled biometric recognition mode, the user's biometric image is extracted and matched with pre-stored biometric images. Based on the matching result, it is determined whether the recognition is successful or unsuccessful.

[0037] Furthermore, if recognition fails, it will continue to attempt recognition based on the same biometric mode. If recognition still fails, it will continue until a preset threshold of recognition attempts is reached. If recognition still fails, to prevent the current biometric recognition of the terminal from being considered illegal, the biometric recognition method will be disabled and the terminal will be locked.

[0038] However, many recognition failures are due to scenario-specific limitations of each biometric method. For example, fingerprint recognition requires a clean, dry environment for the user's fingers. Iris recognition requires the user not wearing glasses. In practice, however, it often happens that the user's hands are dirty during fingerprint recognition, or the user is wearing glasses during iris recognition, leading to recognition failure. As a result, users are forced to repeatedly perform fingerprint or iris recognition, resulting in low efficiency and a poor user experience.

[0039] This disclosure provides a biometric identification method. In this method, the terminal supports multiple biometric identification modes. When performing biometric identification on a user's biometric features using one mode, the identification result of the current mode is obtained. If the identification fails, the failure type is determined. Based on the failure type, a suitable biometric identification mode for the current identification scenario can be accurately obtained, compensating for the limitations of the current mode in that scenario. Therefore, when one biometric identification mode fails, switching to another mode least affected by the first failure type can improve the biometric identification success rate, enhance the terminal's biometric identification performance, and meet the user's biometric identification needs.

[0040] Figure 1 This is a flowchart illustrating a biometric method according to an exemplary embodiment, such as... Figure 1 As shown, the terminal supports multiple biometric modes, and the biometric methods used in the terminal include the following steps.

[0041] In step S11, the user's biometric features to be identified are biometrically identified using the first biometric identification mode, and the identification result of the first biometric identification mode is obtained.

[0042] In this disclosure, the terminal can be a terminal that supports two or more biometric modes. When performing biometric identification on a user's biometric features using one biometric mode, the terminal obtains the identification result of the current biometric mode. If the identification result is a failure, the current biometric mode is switched to another biometric mode to continue biometric identification on the user.

[0043] For ease of description, this disclosure refers to the current biometric mode as the first biometric mode and the other biometric mode after switching as the second biometric mode.

[0044] In this disclosure, the biometric modes supported in the terminal include contact biometric modes and non-contact biometric modes.

[0045] Contact-based biometric identification modes include at least one of capacitive fingerprint recognition, optical fingerprint recognition, and ultrasonic fingerprint recognition. Non-contact biometric identification modes include at least one of facial recognition, iris recognition, and voiceprint recognition.

[0046] In step S12, when the identification result is identification failure, a first identification failure type is determined.

[0047] To avoid biometric recognition failures due to limitations in the recognition scenario, when a recognition failure occurs, the type of failure can be determined to accurately identify the current recognition scenario's flaws. Then, based on the failure type, the current biometric mode (the first biometric mode) is switched to another biometric mode on the terminal that is least affected by the cause of the failure (the second biometric mode).

[0048] Therefore, when the current biometric identification mode cannot accurately identify biometric features in the current identification scenario, switching the current biometric identification mode to another biometric identification technology in the terminal that is least affected by the reason for identification failure can make up for the defects of the current biometric identification mode in the current identification scenario, achieve efficient biometric identification of users, and improve the biometric identification success rate.

[0049] In one implementation method, determining the identification failure type can be achieved, for example, in the following way:

[0050] This disclosure allows for the pre-storage of multiple biometric templates corresponding to biometric features in the terminal. These biometric templates can include those corresponding to biometric features in cases of recognition failure. For example, for fingerprint features, multiple fingerprint recognition templates can be pre-stored, such as fingerprint templates showing water stains or fingerprint templates showing dust.

[0051] When the recognition result is a failure, the biometric feature at the time of the failure is obtained, and based on the preset correspondence between the biometric feature and the biometric template, the biometric template with the highest similarity to the failed biometric feature can be determined from among multiple biometric templates corresponding to the failed biometric feature. For ease of description, this disclosure refers to the biometric template with the highest similarity to the failed biometric feature as the first biometric template.

[0052] Based on the correspondence between biometric templates and recognition failure types, the recognition failure type corresponding to the biometric template with the highest similarity to the biometrics that failed to recognize the recognition (i.e., the first biometric template) can be determined, and the recognition failure type corresponding to the first biometric template can be used as the first recognition failure type.

[0053] For example, the first biometric mode is iris recognition. Preset iris recognition failure types include, for example, the user wearing glasses or the device shaking. When iris recognition fails, the iris features at the time of failure are acquired. These features might include, for example, an incomplete match between the identified iris biometric features and preset iris biometric features. Based on the correspondence between iris features and iris feature templates, the iris features at the time of failure are matched with multiple iris feature templates to determine the iris feature template with the highest similarity to the failed iris feature. Based on the preset correspondence between iris feature templates and failure types, the failure type corresponding to the iris feature template with the highest similarity to the failed iris feature is determined. For example, if the failure type corresponding to the iris feature template with the highest similarity to the failed iris feature is "the user is wearing glasses," then the iris recognition failure type can be determined to be "the user is wearing glasses."

[0054] Then, based on the type of recognition failure when the user is wearing glasses, the biometric model is switched to the biometric model that is not affected by the user wearing glasses or is least affected by the user wearing glasses.

[0055] For example, if the first biometric mode is the capacitive recognition mode, the capacitive recognition failure type includes fingerprints with water stains or dirt, or fingerprints with dust.

[0056] When fingerprint recognition fails, the fingerprint features at the time of failure are acquired. These features might include unclear or unrecognized areas of the fingerprint biometrics. Based on the correspondence between fingerprint features and fingerprint feature templates, the fingerprint features at the time of failure are matched with multiple fingerprint feature templates to determine the template with the highest similarity to the failed fingerprint. Then, based on a pre-defined correspondence between fingerprint feature templates and failure types, the failure type corresponding to the template with the highest similarity to the failed fingerprint is determined. For example, if the failure type corresponding to the template with the highest similarity to the failed fingerprint is "fingerprint with water stains or dirt," then the fingerprint recognition failure type is determined to be "fingerprint with water stains or dirt." Subsequently, based on the failure type of "fingerprint with water stains or dirt," the biometric model is switched to the biometric model least affected by or unaffected by "fingerprint with water stains or dirt."

[0057] In another implementation, determining the type of identification failure can be achieved, for example, in the following way:

[0058] In this disclosure, for each biometric pattern, associated factor information corresponding to the biometric pattern can be pre-constructed. This associated factor information may, for example, be multiple associated factors characterizing the environment or scenario in which the biometric pattern exists, and these multiple associated factor information may include multiple associated factors characterizing the factors that cause the biometric pattern to fail to recognize the biometric pattern.

[0059] For example, the biometric mode is the face recognition mode, and the associated factors information corresponding to the face recognition mode include low ambient light and the terminal being shaken.

[0060] For example, the biometric recognition mode is the iris recognition mode. The associated factors for the iris recognition mode include strong ambient light, the user wearing glasses, and the terminal being shaken.

[0061] For example, the biometric recognition mode is the fingerprint recognition mode, and the associated factors information corresponding to the fingerprint recognition mode include insufficient finger pressure and excessive finger pressure.

[0062] Furthermore, when a user's biometric features are identified using a first biometric mode and the identification fails, multiple related factor information corresponding to the first biometric mode is acquired. Then, one or more related factors from this information are detected to cause the first biometric mode to fail. If one or more related factors meet preset conditions that lead to the first biometric mode's failure, the identification failure type corresponding to the detected related factor meeting the preset conditions is determined as the identification failure type corresponding to the detected related factor meeting the preset conditions, based on the correspondence between related factors and identification failure types.

[0063] For example, if the first biometric recognition mode is iris recognition, and iris recognition is performed on the user's iris features, and the recognition result is a failure, then multiple related factor information corresponding to the iris biometric recognition mode is obtained. These related factor information includes strong ambient light, the user wearing glasses, and the terminal being shaken. For example, based on the obtained related factor information, a detection is performed to determine if strong ambient light might cause iris recognition mode failure. For instance, if the ambient light intensity is detected by an ambient light sensor and exceeds a preset light intensity threshold, then the related factor of strong light is determined to meet the preset condition for iris recognition mode failure. Based on the correspondence between related factors and recognition failure types, the recognition failure type corresponding to the detected strong ambient light is determined. For example, if the recognition failure type corresponding to the detected strong ambient light is "strong ambient light," then "strong ambient light" is determined as the recognition failure type corresponding to the detected related factor that meets the preset condition.

[0064] In step S13, based on the first identification failure type, the second biometric identification mode, which is least affected by the first identification failure reason, is determined and switched to identify the user's biometric characteristics.

[0065] In one implementation, after determining the type of identification failure, the system can identify which of the supported biometric modes are least affected by the current type of identification failure, based on the biometric modes supported by the terminal. Then, according to the identified biometric mode least affected by the current type of identification failure, i.e., the second biometric mode, the system switches to the second biometric mode to continue biometric identification of the user.

[0066] In one implementation, based on the biometric characteristics at the time of recognition failure, the biometric pattern least affected by the current recognition failure type is determined. This can be achieved, for example, in the following way:

[0067] The system acquires other biometric modes supported by the terminal besides the first biometric mode, and obtains possible recognition failure types for these other biometric modes. It then compares these possible recognition failure types with the first recognition failure type to determine a second recognition failure type that differs from the first. Based on the correspondence between biometric modes and recognition failure types, the biometric mode corresponding to the second recognition failure type is determined as the second biometric mode least affected by the recognition failure type.

[0068] In addition, to improve user experience and achieve seamless switching of biometric modes, when multiple biometric modes with the least impact from recognition failure types are determined, if the first biometric mode is a contact biometric mode, then the first contact biometric mode will be switched to the second contact biometric mode. Alternatively, if the first biometric mode is a non-contact biometric mode, then the first non-contact biometric mode will be switched to the second non-contact biometric mode.

[0069] For example, if the first biometric mode is iris recognition, and iris recognition fails, determining that the failure type is due to the user wearing glasses indicates that part of the iris is not being recognized. Based on the failure type, the biometric mode least affected by the failure is determined, resulting in face recognition and fingerprint recognition modes. To achieve seamless switching between biometric modes, the iris recognition mode can be switched to the user's face recognition mode.

[0070] For example, if the first biometric mode is capacitive fingerprint recognition, and the failure is identified as a water stain or dirt on the fingerprint, then the cause of the failure is determined to be water or dirt on the user's finger. Based on the failure type, the biometric mode least affected by the cause of failure is determined, resulting in face recognition, ultrasonic fingerprint recognition, and voiceprint recognition. To achieve seamless switching between biometric modes, the capacitive fingerprint mode can be switched to the ultrasonic fingerprint recognition mode, which is least affected by water or dirt.

[0071] In another implementation, based on the identification failure type determined by the association factor information corresponding to the biometric pattern, the biometric pattern least affected by the current identification failure type is determined. This can be achieved, for example, in the following way:

[0072] Obtain the association factor information of other biometric modes supported by the terminal, and determine the biometric mode that does not contain association factors that cause the iris recognition mode to fail as the second biometric mode.

[0073] For example, in cases where the recognition failure type is determined based on the associated factor information corresponding to the iris recognition mode, after determining that the recognition failure type of the iris recognition mode is due to strong ambient light, the associated factor information of other biometric modes supported by the terminal is obtained. The biometric mode whose associated factor information does not contain the associated factors that cause the iris recognition mode to fail is determined as the second biometric mode. For example, if the other biometric mode supported by the terminal is a face recognition mode, the associated factors for the face recognition mode include low ambient light and the terminal being shaken. Since the associated factor information for the face recognition mode does not include the associated factor of strong ambient light, the iris recognition mode can be switched to the face recognition mode to identify the user's biometric features.

[0074] In an exemplary embodiment of this disclosure, a first biometric mode is used to perform biometric identification on the user's biometric features. When identification fails, the identification failure type is determined, and a second biometric mode that is least affected by the identification failure type is determined and switched to. This can accurately obtain a biometric mode suitable for the current identification scenario, make up for the defects of the current identification scenario of the current biometric mode, achieve efficient biometric identification of the user, and improve the biometric identification success rate.

[0075] The present disclosure will now take face recognition as an example to illustrate the application of the biometric method of the present disclosure in detail.

[0076] Figure 2 This is a flowchart illustrating a biometric method according to an exemplary embodiment, such as... Figure 2As shown, the biometric method used in the terminal includes the following steps.

[0077] In step S21, the user's facial features are biometrically identified using a face recognition mode, and the recognition result of the face recognition mode is obtained.

[0078] In step S22, when the face recognition result is a recognition failure, the type of face recognition failure is determined.

[0079] The recognition failure type can characterize the reason why the facial recognition feature information does not match the preset facial feature information. The recognition failure type can be determined, for example, in the following way:

[0080] When face recognition fails, the system acquires the facial biometric features at the time of failure. These features are then compared with multiple pre-stored facial biometric templates for similarity matching. Based on the correspondence between facial biometric features and templates, the template with the highest similarity to the failed face is identified. Furthermore, based on the pre-defined correspondence between facial biometric templates and failure types, the failure type corresponding to the template with the highest similarity to the failed face is determined.

[0081] For example, the facial biometric features of a failed face recognition attempt are compared with multiple pre-stored facial biometric templates to obtain the template with the highest similarity to the failed face. Then, based on the pre-defined correspondence between the facial biometric templates and the type of recognition failure, the type of recognition failure is determined to be facial makeup.

[0082] For example, the facial biometrics of a failed face recognition attempt are matched with multiple pre-stored facial biometric templates to obtain the template with the highest similarity to the failed face. Then, based on the pre-defined correspondence between the facial biometric templates and the type of recognition failure, the type of recognition failure is determined to be a skin color mismatch.

[0083] For example, after a face recognition failure, multiple related factors corresponding to the face recognition mode are acquired. These related factors include insufficient ambient light and the terminal being shaken. For instance, for insufficient ambient light, detection is performed to prevent face recognition mode failure. For example, by using light intensity information collected by an ambient light sensor, if the ambient light intensity is detected to be lower than a preset light intensity threshold, it is determined that insufficient light is a related factor that meets the preset condition for face recognition mode failure. Based on the correspondence between related factors and recognition failure types, the recognition failure type corresponding to the detected insufficient ambient light is determined. For example, if the recognition failure type corresponding to insufficient ambient light is "dark ambient light," then "dark ambient light" is determined as the recognition failure type corresponding to the detected related factor that meets the preset condition.

[0084] In step S23, based on the type of face recognition failure, the system determines and switches to the second biometric mode, which is least affected by the type of face recognition failure, to identify the user's biometric features.

[0085] Figure 3 This is an example flowchart illustrating how, after a face recognition failure, the face recognition is switched to another biometric recognition mode for different types of failure, according to an exemplary embodiment.

[0086] exist Figure 3 In the process, after a face recognition failure, the failure type is determined as either low ambient light, makeup on the face, or mismatch between the face's skin tone.

[0087] For cases where facial recognition fails due to low ambient light, the system retrieves correlation information for other biometric modes supported by the terminal based on the failure type. Biometric modes whose correlation information does not include low ambient light are identified as the second biometric mode, thus obtaining the iris recognition and fingerprint recognition modes supported by the terminal. The current facial recognition mode is then switched to iris recognition mode for continued user identification. Alternatively, the current facial recognition mode can be switched to fingerprint recognition mode for continued user identification.

[0088] For cases where facial recognition failure is due to makeup, the possible failure types of other biometric modes supported by the terminal are determined based on the failure type, and other failure types different from facial makeup are identified. Based on the correspondence between biometric modes and failure types, the biometric mode least affected by facial makeup is determined, resulting in the supported voiceprint and fingerprint recognition modes. The current facial recognition mode is then switched to voiceprint recognition mode to continue user identification. Alternatively, the current facial recognition mode can be switched to fingerprint recognition mode to continue user identification.

[0089] For facial recognition failures due to skin color mismatch, the system identifies potential failure types for other biometric modes supported by the terminal, and identifies other failure types different from skin color mismatch. Based on the correspondence between biometric modes and failure types, the biometric mode least affected by the user's skin color is determined, resulting in the supported iris and fingerprint recognition modes. The current facial recognition mode is then switched to iris recognition mode for continued user identification. Alternatively, the current facial recognition mode can be switched to fingerprint recognition mode for continued user identification.

[0090] In an exemplary embodiment of this disclosure, a user's biometric features are biometrically identified using a first biometric mode. If identification fails, the identification failure type is determined, and a second biometric mode that is least affected by the identification failure type is determined and switched to. This can compensate for the current identification scenario defects of the current biometric mode, achieve efficient biometric identification of the user, and improve the biometric identification success rate.

[0091] Based on the same concept, embodiments of this disclosure also provide a biometric device.

[0092] It is understood that the biometric device provided in this disclosure includes hardware structures and / or software modules corresponding to each function in order to achieve the above-mentioned functions. In conjunction with the units and algorithm steps of the various examples disclosed in this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of this disclosure.

[0093] Figure 4This is a block diagram illustrating a biometric device according to an exemplary embodiment. (Refer to...) Figure 4 A biometric device 400 is applied to a terminal, the terminal supports multiple biometric modes, the multiple biometric modes include at least a first biometric mode and a second biometric mode, and the biometric device includes: an acquisition unit 401, a determination unit 402 and a processing unit 403.

[0094] The acquisition unit 401 is configured to perform biometric identification on the user's biometric features in a first biometric mode and acquire the identification result of the first biometric mode; the determination unit 402 is configured to determine a first identification failure type when the identification result is identification failure, and determine a second biometric mode that is least affected by the first identification failure type based on the first identification failure type; the processing unit 403 is configured to switch to the second biometric mode that is least affected by the first identification failure type and identify the user's biometric features.

[0095] In one embodiment, the determining unit 402 determines the first identification failure type in the following manner: based on the correspondence between biometric features and biometric templates, among multiple biometric templates corresponding to the biometric feature that failed to be identified, a first biometric template is determined, wherein the first biometric template is the biometric template with the highest similarity to the biometric feature that failed to be identified; based on the correspondence between biometric templates and identification failure types, the identification failure type corresponding to the first biometric template is determined, and the identification failure type corresponding to the first biometric template is taken as the first identification failure type.

[0096] In one embodiment, the determining unit 402 determines the first recognition failure type in the following manner: acquiring the association factor information of the first biometric pattern, the association factor information including multiple association factors that cause the first biometric pattern to fail to recognize; detecting the first association factor in the association factor information, the first association factor being any one or more of the multiple association factors; if the detection of the first association factor meets a preset condition, then determining the recognition failure type corresponding to the first association factor based on the correspondence between association factors and recognition failure types.

[0097] In one embodiment, the determining unit 402 determines the second biometric pattern least affected by the first identification failure type by: obtaining the association factor information of other biometric patterns; and determining the biometric pattern whose association factor information of other biometric patterns does not contain the first association factor as the second biometric pattern.

[0098] In one embodiment, the determining unit 402 determines the second biometric mode least affected by the first identification failure type in the following manner: determining a second identification failure type different from the first identification type; determining the biometric mode corresponding to the second identification failure type based on the correspondence between biometric modes and identification failure types; and determining the biometric mode corresponding to the second identification failure type as the second biometric mode least affected by the identification failure type.

[0099] In one embodiment, the biometric mode corresponding to the second identification failure type includes a contact biometric mode and / or a non-contact biometric mode; the determining unit 402 determines the biometric mode corresponding to the second identification failure type as the second biometric mode least affected by the identification failure type in the following manner: when the first biometric mode is a contact biometric mode, the second contact biometric mode, which is different from the first contact biometric mode, is determined as the second biometric mode least affected by the identification failure type; or, when the first biometric mode is a non-contact biometric mode, the second non-contact biometric mode, which is different from the first non-contact biometric mode, is determined as the second biometric mode least affected by the identification failure type.

[0100] In one embodiment, the contact-based biometric mode includes at least one of capacitive fingerprint recognition, optical fingerprint recognition, and ultrasonic fingerprint recognition; the non-contact biometric mode includes at least one of face recognition, iris recognition, and voiceprint recognition.

[0101] Figure 5 This is a block diagram illustrating a biometric device 500 according to an exemplary embodiment. For example, device 500 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0102] Reference Figure 5 The device 500 may include one or more of the following components: a processing component 502, a memory 504, a power component 506, a multimedia component 508, an audio component 510, an input / output (I / O) interface 512, a sensor component 514, and a communication component 516.

[0103] Processing component 502 typically controls the overall operation of device 500, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 502 may include one or more modules to facilitate interaction between processing component 502 and other components. For example, processing component 502 may include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502.

[0104] Memory 504 is configured to store various types of data to support the operation of device 500. Examples of such data include instructions for any application or method operating on device 500, contact data, phonebook data, messages, pictures, videos, etc. Memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0105] The power supply component 506 provides power to the various components of the device 500. The power supply component 506 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device 500.

[0106] Multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 508 includes a front-facing camera and / or a rear-facing camera. When the device 500 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0107] Audio component 510 is configured to output and / or input audio signals. For example, audio component 510 includes a microphone (MIC) configured to receive external audio signals when device 500 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 504 or transmitted via communication component 516. In some embodiments, audio component 510 also includes a speaker for outputting audio signals.

[0108] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0109] Sensor assembly 514 includes one or more sensors for providing status assessments of various aspects of device 500. For example, sensor assembly 514 may detect the on / off state of device 500, the relative positioning of components such as the display and keypad of device 500, changes in the position of device 500 or a component of device 500, the presence or absence of user contact with device 500, the orientation or acceleration / deceleration of device 500, and temperature changes of device 500. Sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 514 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0110] Communication component 516 is configured to facilitate wired or wireless communication between device 500 and other devices. Device 500 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 516 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 516 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0111] In an exemplary embodiment, the apparatus 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0112] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, which can be executed by a processor 520 of the device 500 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0113] It is understood that in this disclosure, "multiple" refers to two or more, and other quantifiers are similar. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. The singular forms "a," "the," and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0114] It is further understood that the terms "first," "second," etc., are used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.

[0115] It can be further understood that, unless otherwise specified, "connection" includes both direct connections where no other components exist between the two parties and indirect connections where other components exist between them.

[0116] It is further understood that although operations are described in a specific order in the accompanying drawings in the embodiments of this disclosure, this should not be construed as requiring these operations to be performed in the specific order or serial order shown, or requiring all of the shown operations to be performed to obtain the desired result. In certain environments, multitasking and parallel processing may be advantageous.

[0117] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0118] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A biometric identification method, characterized in that, Applied to a terminal, the terminal supports multiple biometric modes, the multiple biometric modes including at least a first biometric mode and a second biometric mode, the method includes: The user's biometric features are identified using a first biometric mode, and the identification result of the first biometric mode is obtained. When the identification result is identification failure, a first identification failure type is determined; Based on the first identification failure type, determine and switch to the second biometric identification mode that is least affected by the first identification failure type to identify the user's biometric features; The determination of the first identification failure type includes: Obtain the association factor information of the first biometric pattern, the association factor information including multiple association factors that cause the first biometric pattern to fail to recognize; The first related factor in the related factor information is detected, where the first related factor is any one or more of the plurality of related factors; If the first associated factor detection meets the preset conditions, then based on the correspondence between the associated factors and the identification failure type, the identification failure type corresponding to the first associated factor is determined; The associated factor information is used to characterize multiple associated factors of the environment or scene in which the biometric pattern is located, and the associated factor information includes multiple associated factors that cause the first biometric pattern to fail to recognize. The determination of the second biometric pattern least affected by the first identification failure type includes: Obtain information on factors related to other biometric patterns; Biometric patterns that do not contain the first associated factor in the associated factor information of other biometric patterns are identified as the second biometric pattern.

2. The biometric identification method according to claim 1, characterized in that, The determination of the first identification failure type includes: The biometric features that failed to be identified are obtained. Based on the correspondence between biometric features and biometric templates, a first biometric template is determined among multiple biometric templates that correspond to the biometric features that failed to be identified. The first biometric template is the biometric template with the highest similarity to the biometric features that failed to be identified. Based on the correspondence between biometric templates and recognition failure types, the recognition failure type corresponding to the first biometric template is determined, and the recognition failure type corresponding to the first biometric template is taken as the first recognition failure type.

3. The biometric identification method according to claim 1, characterized in that, The determination of the second biometric pattern least affected by the first identification failure type includes: Determine a second identification failure type that is different from the first identification failure type; Based on the correspondence between biometric patterns and recognition failure types, determine the biometric pattern corresponding to the second recognition failure type; The biometric pattern corresponding to the second identification failure type is determined as the second biometric pattern least affected by the identification failure type.

4. The biometric identification method according to claim 3, characterized in that, The biometric modes corresponding to the second type of identification failure include contact biometric modes and / or non-contact biometric modes; The step of determining the biometric pattern corresponding to the second identification failure type as the second biometric pattern least affected by the identification failure type includes: When the first biometric mode is a contact-based biometric mode, a second contact-based biometric mode, different from the first contact-based biometric mode, is determined as the second biometric mode least affected by the recognition failure type; or... When the first biometric mode is a non-contact biometric mode, the second non-contact biometric mode, which is different from the first non-contact biometric mode, is determined as the second biometric mode least affected by the recognition failure type.

5. The biometric identification method according to claim 4, characterized in that, The contact-based biometric identification mode includes at least one of the following: capacitive fingerprint identification mode, optical fingerprint identification mode, and ultrasonic fingerprint identification mode; The contactless biometric identification mode includes at least one of face recognition mode, iris recognition mode and voiceprint recognition mode.

6. A biometric identification device, characterized in that, Applied to a terminal, the terminal supports multiple biometric modes, the multiple biometric modes including at least a first biometric mode and a second biometric mode, the device comprising: The acquisition unit is configured to perform biometric identification on the user's biometric features in a first biometric mode and acquire the identification result of the first biometric mode. The determining unit is configured to, when the recognition result is recognition failure, determine a first recognition failure type, and, based on the first recognition failure type, determine a second biometric mode that is least affected by the first recognition failure type; The processing unit is configured to switch to a second biometric mode that is least affected by the first identification failure type to identify the user's biometric features; The determining unit determines the first recognition failure type in the following manner: acquiring the association factor information of the first biometric pattern, the association factor information including multiple association factors that cause the first biometric pattern to fail to recognize; detecting the first association factor in the association factor information, the first association factor being any one or more of the multiple association factors; if the detection of the first association factor meets a preset condition, then determining the recognition failure type corresponding to the first association factor based on the correspondence between association factors and recognition failure types; The associated factor information is used to characterize multiple associated factors of the environment or scene in which the biometric pattern is located, and the associated factor information includes multiple associated factors that cause the first biometric pattern to fail to recognize. The determining unit determines the second biometric pattern that is least affected by the first identification failure type using the following method: Obtain the association factor information of other biometric patterns; determine the biometric pattern that does not contain the first association factor in the association factor information of other biometric patterns as the second biometric pattern.

7. The biometric device according to claim 6, characterized in that, The determining unit determines the first identification failure type in the following manner: The biometric features that failed to be identified are obtained. Based on the correspondence between biometric features and biometric templates, a first biometric template is determined among multiple biometric templates that correspond to the biometric features that failed to be identified. The first biometric template is the biometric template with the highest similarity to the biometric features that failed to be identified. Based on the correspondence between biometric templates and recognition failure types, the recognition failure type corresponding to the first biometric template is determined, and the recognition failure type corresponding to the first biometric template is taken as the first recognition failure type.

8. The biometric device according to claim 6, characterized in that, The determining unit determines the second biometric pattern that is least affected by the first identification failure type using the following method: Determine a second identification failure type that is different from the first identification failure type; Based on the correspondence between biometric patterns and recognition failure types, determine the biometric pattern corresponding to the second recognition failure type; The biometric pattern corresponding to the second identification failure type is determined as the second biometric pattern least affected by the identification failure type.

9. The biometric device according to claim 8, characterized in that, The biometric modes corresponding to the second type of identification failure include contact biometric modes and / or non-contact biometric modes; The determining unit uses the following method to determine the biometric pattern corresponding to the second identification failure type as the second biometric pattern least affected by the identification failure type: When the first biometric mode is a contact-based biometric mode, a second contact-based biometric mode, different from the first contact-based biometric mode, is determined as the second biometric mode least affected by the recognition failure type; or... When the first biometric mode is a non-contact biometric mode, the second non-contact biometric mode, which is different from the first non-contact biometric mode, is determined as the second biometric mode least affected by the recognition failure type.

10. The biometric device according to claim 9, characterized in that, The contact-based biometric identification mode includes at least one of the following: capacitive fingerprint identification mode, optical fingerprint identification mode, and ultrasonic fingerprint identification mode; The contactless biometric identification mode includes at least one of face recognition mode, iris recognition mode and voiceprint recognition mode.

11. A biometric identification device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the biometric method according to any one of claims 1-5.

12. A non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to perform the biometric method according to any one of claims 1-5.

Images