Biometric Authentication Method, Device, Computer Equipment and Storage Medium
Through the real-time adjustment of the display status of the mapping pattern through the space acquisition technology, the problem of low hand position adjustment efficiency in existing biological authentication is solved, and an efficient and accurate biological authentication process is achieved, which improves user experience and convenience.
Patent Information
- Application Number
- CN202210890681.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-27
- Publication Date
- 2025-07-01
- Estimated Expiration
- 2042-07-27
AI Technical Summary
Among the existing biological authentication methods, especially the palm print recognition and acquisition method, users need to continuously adjust their hand positions, resulting in inefficient collection efficiency and relying on hardware infrastructure, limiting convenience and flexibility.
By using the space acquisition technology, by displaying the mapping pattern corresponding to the key areas of the target part, the display status of the mapping pattern is adjusted in real time according to the relative position changes of the target part relative to the image acquisition element, and intuitively guide the user to adjust the position to match the preset recognition pattern, thereby performing biological authentication.
It improves the collection efficiency and accuracy of biometric authentication, reduces dependence on hardware facilities, improves user experience and convenience, and adapts to efficient use scenarios for multiple people.
Smart Images

Figure CN117521044B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technologies, and in particular, to a biometric authentication method, apparatus, computer device, storage medium, and computer program product. Background Art
[0002] With the development of image recognition technologies, methods of using images for biometric authentication have been widely applied in various fields. Biometric authentication includes face recognition authentication, palmprint recognition authentication, iris recognition authentication, etc.
[0003] During the process of biometric authentication, the user needs to continuously adjust the position of the part to be collected so that the part to be collected is in a suitable position. Taking palmprint recognition as an example, the premise of palmprint recognition is to collect palmprints. Currently, the commonly used method for collecting palmprints is contact collection. In the method of contact collection of palmprints, the user needs to place the hand on the collection device and adjust the position of the hand so that the hand is within the collection area specified by the collection device for the collection device to capture an image of the palm.
[0004] However, the user needs to continuously move the palm to place it within the collection area specified by the collection device, and the user can only succeed in collection after multiple repeated placement attempts, resulting in low collection efficiency. Summary of the Invention
[0005] Based on this, in view of the above technical problems, it is necessary to provide a biometric authentication method, apparatus, computer device, computer-readable storage medium, and computer program product that can improve the efficiency of palmprint collection.
[0006] On the one hand, the present application provides a biometric authentication method. The method includes:
[0007] In response to an air collection operation triggered by a target part of a target object, displaying a mapping pattern corresponding to a key area of the target part, where the display state of the mapping pattern is related to the relative position of the target part with respect to an image acquisition element;
[0008] When the relative position of the target part with respect to the image acquisition element changes, the display state of the currently displayed mapping pattern changes following the change in the relative position, and the display state includes at least one of a display position or a display size;
[0009] When the currently displayed mapping pattern matches a preset recognition pattern, acquiring an image of the key area of the target part through the image acquisition element; the key area image is used for biometric authentication of the target object.
[0010] On the other hand, the present application also provides a biometric authentication apparatus. The apparatus includes:
[0011] A display module, configured to respond to an air acquisition operation triggered by a target part of a target object, and display a mapping pattern corresponding to a key area of the target part, wherein a display state of the mapping pattern is related to a relative position of the target part with respect to an image acquisition element;
[0012] The display module is further configured to, when the relative position of the target part with respect to the image acquisition element changes, change the display state of the currently displayed mapping pattern following the change of the relative position, and the display state includes at least one of a display position or a display size;
[0013] An acquisition module, configured to, when the currently displayed mapping pattern matches a preset recognition pattern, acquire an image of a key area of the target part through the image acquisition element; the key area image is used for biometric authentication of the target object.
[0014] In one embodiment, the display module is further configured to, when the spatial height of the target part with respect to the image acquisition element changes, reversely change the display size of the currently displayed mapping pattern following the change of the spatial height; the display position of the currently displayed mapping pattern changes in the same direction following the change of the planar position of the key area of the target part within the acquisition range of the image acquisition element.
[0015] In one embodiment, the display module is further configured to, when the spatial height of the target part with respect to the image acquisition element is getting farther and farther, decrease the display size of the currently displayed mapping pattern following the increase of the spatial height; when the spatial height of the target part with respect to the image acquisition element is getting closer and closer, increase the display size of the currently displayed mapping pattern following the decrease of the spatial height.
[0016] In one embodiment, the display module is further configured to determine the current spatial height of the target part of the target object with respect to the image acquisition element; based on a preset distance mapping relationship, map the spatial height to a current display size, wherein the greater the spatial height, the smaller the mapped current display size; and adjust the display size of the mapping pattern to the current display size for updated display.
[0017] In one embodiment, a plurality of distance sensors are deployed around the image acquisition element, and the display module is further configured to, when the target part is within the acquisition range of the image acquisition element, obtain a plurality of effective distances corresponding to the key area of the target part through the plurality of distance sensors; and determine the current spatial height of the target part relative to the image acquisition element based on the plurality of effective distances.
[0018] In one embodiment, the display module is further configured to obtain the planar position of the key area of the target part within the acquisition range of the image acquisition element; determine the offset information of the planar position relative to a preset position within the acquisition range; determine the current display position of the mapping pattern according to the offset information, and adjust the display position of the mapping pattern to the current display position for updated display.
[0019] In one embodiment, the display module is further configured to perform normalization processing on the offset information according to the acquisition range to obtain an offset ratio; and determine the current display position of the mapping pattern in the current display interface based on the sign information carried in the offset information and the offset ratio.
[0020] In one embodiment, at least three distance sensors are deployed around the image acquisition element, and the display module is further configured to, when the target part is within the acquisition range of the image acquisition element, obtain at least three effective distances corresponding to the key area of the target part through the distance sensors; construct a virtual plane of the key area based on the at least three effective distances; determine the relative pose of the key area based on the relative angle between the virtual plane and a standard plane; and adjust the display state of the mapping pattern based on the relative pose.
[0021] In one embodiment, the above device further includes a first detection module, configured to obtain the moving speed of a target part within the acquisition range of the image acquisition element; perform integrity detection on the target part within the acquisition range of the image acquisition element to obtain an integrity detection result; and execute the step of acquiring an image of the key area of the target part through the image acquisition element when it is determined, based on at least one of the moving speed or the integrity detection result, that the detected target part meets the acquisition conditions.
[0022] In one embodiment, the acquisition module is further configured to trigger and output a first prompt message when the currently displayed mapping pattern matches a preset recognition pattern, where the first prompt message is used to prompt the target object to keep the target part in the current state unchanged; and acquire an image of the key area of the target part through the image acquisition element when the target part keeps the current state unchanged.
[0023] In one embodiment, the above-mentioned device further includes a prompting module, configured to trigger and output a second prompting message when the currently displayed mapping pattern does not match the preset recognition pattern, where the second prompting message is used to prompt the target object to adjust the relative position of the target part with respect to the image acquisition element, so that the mapping pattern that changes with the change of the relative position matches the preset recognition pattern.
[0024] In one embodiment, when the display size of the currently displayed mapping pattern is larger than the display size of the preset recognition pattern, the second prompting message is used to prompt the target object to control the target part to move away from the image acquisition element.
[0025] In one embodiment, when the display size of the currently displayed mapping pattern is smaller than the display size of the preset recognition pattern, the second prompting message is used to prompt the target object to control the target part to move closer to the image acquisition element.
[0026] In one embodiment, the above-mentioned device further includes a second detection module, configured to perform target detection and live body detection on a target that appears within the acquisition range of the image acquisition element; when it is detected that the target is the target part of the target object and a live body is detected, it is determined that the target part of the target object has triggered an air acquisition operation.
[0027] In one embodiment, the above-mentioned device further includes a communication module, configured to send the acquired key area image to a server for the server to perform biometric authentication on the key area image, and perform resource transfer when the biometric authentication is passed; when the biometric authentication is passed, receive and display the resource transfer result feedback by the server.
[0028] On the other hand, the present application also provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, the steps of the above-mentioned biometric authentication method are implemented.
[0029] On the other hand, the present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned biometric authentication method are implemented.
[0030] On the other hand, the present application also provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned biometric authentication method are implemented.
[0031] The above-mentioned biometric authentication method, device, computer equipment, storage medium, and computer program product perform biometric authentication in a non-contact acquisition manner, breaking the rigid requirements for hardware infrastructure. By responding to a non-contact acquisition operation triggered by a target part of a target object and visually concretely displaying the key area of the target part as a mapping pattern, based on the change in the relative position of the target part relative to the image acquisition element, the display state of the displayed mapping pattern also changes accordingly. By feeding back the difference between the mapping pattern and a preset recognition pattern to the target object, the target object is intuitively and clearly prompted to make adaptive adjustments so that the mapping pattern matches the preset recognition pattern. Thereby, the acquisition efficiency is greatly improved, and the user experience is enhanced. When the currently displayed mapping pattern matches the preset recognition pattern, the key area image of the target part is collected by the image acquisition element to perform biometric authentication, which can ensure the accuracy of the collected image and further improve the accuracy of the biometric authentication result. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 FIG. 6 is a schematic diagram of a contact acquisition scenario in an embodiment;
[0033] Figure 2 FIG. 10 is an application environment diagram of a biometric authentication method in an embodiment;
[0034] Figure 3 FIG. 14 is a flowchart of a biometric authentication method in an embodiment;
[0035] Figure 4A FIG. 18 is a schematic diagram of a mapping pattern in an embodiment;
[0036] Figure 4B FIG. 22 is a schematic diagram of a mapping pattern in another embodiment;
[0037] Figure 5 FIG. 26 is a schematic diagram of the spatial height and planar position of a target part in an embodiment;
[0038] Figure 6A FIG. 30 is a schematic diagram of a mapping pattern and a preset recognition pattern in an embodiment;
[0039] Figure 6B FIG. 34 is a schematic diagram of a mapping pattern and a preset recognition pattern in another embodiment;
[0040] Figure 6C FIG. 38 is a schematic diagram of a mapping pattern and a preset recognition pattern in yet another embodiment;
[0041] Figure 7A FIG. 42 is a schematic diagram of the principle of distance detection in an embodiment;
[0042] Figure 7BSchematic diagram of the principle of distance detection in another embodiment;
[0043] Figure 8A Schematic diagram of a key area in one embodiment;
[0044] Figure 8B Schematic diagram of the offset of a key area in one embodiment;
[0045] Figure 9 Schematic diagram of the quality of a palmprint image in one embodiment;
[0046] Figure 10 Schematic diagram of the palm brushing collection and palm brushing payment scenarios in one embodiment;
[0047] Figure 11A Schematic diagram of the guidance of a display interface in one embodiment;
[0048] Figure 11B Schematic diagram of the guidance of a display interface in another embodiment;
[0049] Figure 11C Schematic diagram of the guidance of a display interface in yet another embodiment;
[0050] Figure 11D Schematic diagram of an animation demonstration in one embodiment;
[0051] Figure 12 Schematic diagram of a collection process in one embodiment;
[0052] Figure 13 Schematic diagram of a palmprint recognition scenario in one embodiment;
[0053] Figure 14 Structural block diagram of a biometric authentication device in one embodiment;
[0054] Figure 15 Internal structure diagram of a computer device in one embodiment. Detailed implementation manners
[0055] In order to make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0056] The current methods of palm brushing collection or palm brushing payment are as Figure 1 shown, which require users to continuously try and adjust the placement position of the hand, resulting in low collection efficiency. Moreover, the contact-based palm brushing collection method requires special collection equipment. For example, a palm vein sensor needs to be set in the collection equipment to sense the veins under the palm skin to achieve biometric authentication. This method has certain requirements for hardware performance.
[0057] In view of this, an embodiment of the present application provides a biometric authentication method, which abandons the contact-based palm brushing acquisition method and uses a non-contact palm brushing acquisition method to collect palm prints, breaking the rigid requirements for hardware infrastructure. In the non-contact palm brushing acquisition method, by collecting images of the palm prints of the hand and mapping the recognized palm part into a mapping pattern for display, as the relative position between the palm and the acquisition device changes, the displayed mapping pattern also gives corresponding feedback, thus greatly improving the acquisition and payment completion rate, enhancing user convenience, and facilitating users to quickly collect and pay. When multiple people queue up to use a single device, it is more convenient and efficient.
[0058] The biometric authentication method provided by the embodiment of the present application can be applied to an application environment such as Figure 2 shown. Among them, the acquisition device 202 communicates with the server 204 through a network. The data storage system can store the data that the server 204 needs to process. The data storage system can be integrated on the server 204, or placed in the cloud or on other servers.
[0059] In one embodiment, the target object triggers a non-contact acquisition operation by placing the target part within the visible range of the image acquisition element, so as to display a mapping pattern corresponding to the key area of the target part through the display element. When the target object changes the relative position of its target part with respect to the image acquisition element, based on the change in the relative position of the target part with respect to the image acquisition element, the display state of the mapping pattern displayed by the display element also changes accordingly. The target object can adjust the relative position of its target part with respect to the image acquisition element according to the display state of the displayed mapping pattern, so that the displayed mapping pattern matches the preset recognition pattern, and when the displayed mapping pattern matches the preset recognition pattern, the image acquisition element is used to collect an image of the key area of the target part, thereby being used for subsequent biometric authentication of the target object.
[0060] Among them, the acquisition device 202 is used to collect an image of the key area of the target part of the target object. The acquisition device 202 includes at least an image acquisition element, and the image acquisition element is used to capture an object within the visible range. Among them, the visible range of the image acquisition element is determined based on the field of view angle. In one embodiment, the image acquisition element is, for example, a camera, a video camera, a camera module integrated with an optical system or a CCD chip, or a camera module integrated with an optical system and a CMOS chip, etc. Among them, the image acquisition element can be integrated in the acquisition device 202, or can be set independently of the acquisition device 202. For example, the image acquisition element can be externally connected to the acquisition device 202 and communicate through a wired or wireless manner.
[0061] In one embodiment, the acquisition device 202 may further include a display element. The display element is used to provide an interface for the target object to view the mapping pattern. In one embodiment, the display element is, for example, a liquid crystal display screen, a projector, or the like. Among them, the display element may be integrated in the acquisition device 202 or may be provided independently of the acquisition device 202. For example, the display element may be externally connected to the acquisition device 202 and communicatively connected by wired or wireless means.
[0062] In a specific example, the acquisition device 202 may further be, but is not limited to, various desktop computers, laptop computers, smartphones, tablet computers, Internet of Things devices, or portable wearable devices. The Internet of Things devices may be smart speakers, smart TVs, smart air conditioners, or in-vehicle devices, etc. The portable wearable devices may be smart watches, smart bracelets, or head-mounted devices, etc. In one embodiment, the acquisition device 202 may further be an electronic device with a payment function.
[0063] Among them, the server 204 may be an independent physical server, may also be a server cluster or a distributed system composed of multiple physical servers, and may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), or big data and artificial intelligence platforms.
[0064] In some embodiments, the acquisition device 202 may be loaded with an APP (Application) application program or an application program with a mapping pattern display function, including traditional application programs that need to be installed separately and small program applications that can be used without downloading and installing. The application program may be one or more of the application programs with social functions, instant messaging functions, or payment functions, etc.
[0065] In one embodiment, as Figure 3 shown, a biometric authentication method is provided. This method can be executed independently by the acquisition device or can be executed in cooperation by the acquisition device and the server. The following takes the method applied to the Figure 2 acquisition device as an example for description, including the following steps:
[0066] Step S302, in response to an air acquisition operation triggered by a target part of the target object, display a mapping pattern corresponding to the key area of the target part, and the display state of the mapping pattern is related to the relative position of the target part relative to the image acquisition element.
[0067] Among them, the target object is, for example, a person, an animal, etc. The target part includes, but is not limited to, one or more of the face, palm, or finger, etc. Taking the palm as an example, the palmprint image at the center of the palm needs to be collected, and there is no need to collect the images of other positions of the palm. Therefore, the palm center area is the key area, and other areas are non-key areas. Similarly, for other target parts, the key area is concerned during collection, and the non-key area does not need to be collected. In order to avoid the interference of the non-key area on the collection process and improve the accuracy and efficiency of collecting the key area image, in the embodiments of the present application, the key area of the target part is visualized in the form of a mapping pattern, and the relative position of the target part relative to the image acquisition element is fed back in the display state of the mapping pattern. Thus, there is no need to pay attention to the state of the non-key area of the target part (such as position, posture, occlusion, etc.), and the interference of the non-key area of the target part on collecting the key area can be excluded, and the collection accuracy is higher.
[0068] Among them, the non-contact acquisition operation is an operation that the target object triggers through its target part to perform image acquisition on the target part of the target object in a non-contact acquisition manner. When the image acquisition element detects the target part within its visible range, that is, when the target part is within the visible range of the image acquisition element, the non-contact acquisition operation can be triggered. The key area image obtained by the image acquisition element for collecting the target part of the target object is used for subsequent biometric authentication of the target object. The specific content about biometric authentication will be described later.
[0069] For example, the image acquisition element can be in a working or sleeping state. After the image acquisition element is awakened to start collecting images, the image acquisition element can detect images of various objects; until the image acquisition element detects the target part of the target object, it is determined that the target part triggers the non-contact acquisition operation. In other words, although the image acquisition element detects images of other objects, the non-contact acquisition operation will not be triggered, thus ensuring that only the target object triggers through the target part and improving the security of the collection process.
[0070] In one embodiment, in order to avoid false triggering, after the image acquisition element detects the target part, when the duration that the target part stays within the visible range of the image acquisition element is not less than a preset duration, it is determined that the target part triggers the non-contact acquisition operation. That is, when the image acquisition element continuously detects the image of the target part within the preset duration, it is determined that the target part triggers the non-contact acquisition operation. Thus, the phenomenon of false triggering caused by the target part staying within the visible range briefly is avoided, and it is ensured that the target object has the intention of biometric authentication.
[0071] Among them, the mapping pattern is the figurative display of the key area of the target part in the interface displayed by the display element. The mapping pattern can be displayed as a two-dimensional planar pattern, a three-dimensional solid pattern, etc. The mapping pattern can be a complex pattern, or a simple geometric figure or a combination of geometric figures. The mapping pattern can be a closed figure, a semi-closed figure, or an unclosed figure, etc. Exemplarily, the mapping pattern can be a circle, an ellipse, or a polygon, etc., or a cross, or other irregular geometric figures, etc. The display state of the mapping pattern includes, but is not limited to, one or more of the display position presented by the mapping pattern in the interface, or the display size presented in the interface, etc.
[0072] Exemplarily, the key area of the target part can be mapped to a mapping pattern of a two-dimensional circle. For example Figure 4A As shown, in the display interface displayed by the display element 402, the solid-line filled two-dimensional circle M is the figurative display of the target part. The different display positions and display sizes of the two-dimensional circle M intuitively reflect the relative position of the target part relative to the image acquisition element 401.
[0073] Again, the key area of the target part can be mapped to a mapping pattern composed of geometric line segments. For example Figure 4B As shown. In the display interface displayed by the display element 402, the cross solid-line segment N is the figurative display of the target part. The different display positions and display sizes of the cross solid-line segment N intuitively reflect the relative position of the target part relative to the image acquisition element 401.
[0074] Among them, the relative position refers to the spatial position relationship of the target part relative to the image acquisition element, including but not limited to the spatial height of the target part relative to the image acquisition element, and the planar position of the target part on the plane parallel to the image acquisition element. As Figure 5 shown, the relative position of the target part relative to the image acquisition element includes the spatial height H of the target part relative to the image acquisition element, and the planar position (x, y) of the target part on the plane parallel to the image acquisition element.
[0075] Specifically, the target object triggers an air acquisition operation, and the acquisition device responds to the air acquisition operation and displays a mapping pattern corresponding to the key area of the target part through the display element.
[0076] Step S304, when the relative position of the target part relative to the image acquisition element changes, the display state of the currently displayed mapping pattern changes following the change of the relative position, and the display state includes at least one of the display position or the display size.
[0077] To provide an intuitive real-time feedback on the current state of the target part, the display state of the mapping pattern should change with the change of the state of the target part, so as to give the target object an intuitive and clear perception, that is, to have a clear understanding of the relative position of its own target part with respect to the image acquisition element. Thus, the target object can be quickly and directly guided to adjust the state of the target part, which facilitates the image acquisition element to collect a suitable key area image more quickly.
[0078] Specifically, when the target object controls the movement of the target part, the relative position of the target part with respect to the image acquisition element changes. Accordingly, the display position of the mapping pattern also changes accordingly, or the display size of the mapping pattern also changes accordingly, or both the display position and the display size of the mapping pattern change, etc.
[0079] In one embodiment, when the target part is getting farther and farther away from the image acquisition element, in order to reflect this state, as the distance increases, the display size of the displayed mapping pattern can become smaller and smaller. For another example, the degree of deviation of the mapping pattern from a preset position in the interface (such as the center position of the interface) becomes larger and larger, etc.
[0080] In one embodiment, the display state of the displayed mapping pattern further includes, but is not limited to, one or more of the blurring degree, color, or movement speed, etc.
[0081] For example, as the relative position of the target part with respect to the image acquisition element changes, the blurring degree (i.e., transparency) of the displayed mapping pattern also changes accordingly.
[0082] For another example, as the relative position of the target part with respect to the image acquisition element changes, the color of the displayed mapping pattern changes, or the shade of the color changes.
[0083] For yet another example, as the relative position of the target part with respect to the image acquisition element changes, the movement speed of the displayed mapping pattern also changes, which can be a process from slow to fast, from fast to slow, from stationary to moving, or from moving to stationary, etc.
[0084] In an actual application scenario, even if the target object controls the target part to maintain a posture, the target part is very likely to make slight movements, such as slight displacements in the height direction or the plane direction.
[0085] In order to avoid the problem of inconvenient operation caused by over-sensitivity, in one embodiment, there is a tolerance range for the change amount of the relative position of the target part with respect to the image acquisition element. When the change amount of the relative position is within this tolerance range, it can be regarded that the relative position of the target part with respect to the image acquisition element remains unchanged. Correspondingly, the display state of the mapped pattern displayed by the display element will not change either.
[0086] For another example, in another embodiment, when the change amount of the relative position is within this tolerance range, although the relative position of the target part with respect to the image acquisition element has changed, the display state of the mapped pattern displayed by the display element will not change.
[0087] Step S306, when the currently displayed mapped pattern matches the preset recognition pattern, collect the key area image of the target part through the image acquisition element; the key area image is used for biometric authentication of the target object.
[0088] In the scenario of non-contact acquisition operation, since the relative position of the target part with respect to the image acquisition element is uncontrollable and may change at any time, and the acquisition process requires the target part to be in the correct position or remain in the correct position for a certain period of time. For example, it is required that the spatial height of the target part from the image acquisition element is appropriate. Too high or too low will cause the collected key area image to be blurred, unclear or incomplete; for another example, it is required that the target part is within the acquisition range of the image acquisition element. Too far offset will cause the collected key area image to be incomplete or distorted, ultimately resulting in inaccurate biometric authentication results. Among them, the acquisition range is within the visible range of the image acquisition element.
[0089] Therefore, in order to guide the target object to adjust the relative position of its target part with respect to the image acquisition element so as to give the target object direct and clear feedback, in addition to displaying the mapped pattern, the display element also displays a preset recognition pattern. The preset recognition pattern is a pattern fixed in the interface and is used to represent the display state of the mapped pattern when the target part of the target object is in the correct spatial position. Thus, when the relative position of the target part with respect to the image acquisition element changes, the display state of the mapped pattern also changes accordingly. By feeding back the difference between the mapped pattern and the preset recognition pattern to the target object, the target object can make adaptive adjustments to make the mapped pattern match the preset recognition pattern.
[0090] Among them, the matching conditions include, but are not limited to, one or more of the size, position, or coincidence rate with a preset recognition pattern of the mapping pattern satisfying the conditions. For example, when the size of the mapping pattern is the same as or the difference from the size of the preset recognition pattern is less than a threshold, it is determined that the mapping pattern matches the preset recognition pattern. Another example is that when the position of the mapping pattern coincides with or the difference from the position of the preset recognition pattern is less than a threshold, it is determined that the mapping pattern matches the preset recognition pattern. Still another example is that when the mapping pattern coincides with the preset recognition pattern and the coincidence rate is greater than the threshold, it is determined that the mapping pattern matches the preset recognition pattern, and so on.
[0091] Exemplarily, assume that the mapping pattern m is a two-dimensional circle, as Figure 6A shown. The preset recognition pattern M can be a circle with a fixed size and a fixed position. When the spatial height of the target part relative to the image acquisition element is too high, it is shown that the mapping pattern m is smaller than the preset recognition pattern M, as Figure 6A shown in (a) and (b) of. Conversely, when the spatial height of the target part relative to the image acquisition element is too low, it is shown that the mapping pattern m is larger than the preset recognition pattern M, as Figure 6A shown in (c) of. At the same time, when the planar position of the target part relative to the image acquisition element changes, it is shown that the orientation of the mapping pattern m relative to the preset recognition pattern M also changes accordingly, as Figure 6A shown in (a), (b), and (c) of. When the mapping pattern m matches the preset recognition pattern M in terms of size and position, that is, in the display state shown in Figure 6A shown in (d) of, it can be determined that the mapping pattern matches the preset recognition pattern. In some embodiments, when the mapping pattern matches the preset recognition pattern, the display color of the mapping pattern can also change accordingly to give the target object a clearer and more obvious feedback.
[0092] Another example is that assume the mapping pattern n is a cross, as Figure 6B shown. The preset recognition pattern M can be a cross with a fixed size and a fixed position. When the spatial height of the target part relative to the image acquisition element changes, the display position and display size of the mapping pattern n also change accordingly, as Figure 6B shown in (a), (b), and (c) of. When the mapping pattern n matches the preset recognition pattern N in terms of size and position, that is, in the display state shown in Figure 6B shown in (d) of, it can be determined that the mapping pattern matches the preset recognition pattern.
[0093] Of course, the mapping pattern and the preset recognition pattern are not necessarily the same pattern, as Figure 6CAs shown, the display state of the mapping pattern n reflects the relative position of the target part with respect to the image acquisition element, so as to prompt the target object to adjust the spatial position of the target part, so that the mapping pattern n matches the preset recognition pattern M. For example, the preset recognition pattern M is exactly the circumcircle of the mapping pattern.
[0094] When the mapping pattern matches the preset recognition pattern, the acquisition device acquires an image of the key area of the target part through the image acquisition element. Thus, after acquiring the image of the key area of the target part, the target object can be biometrically authenticated. Biometric authentication refers to verifying the identity of the target object using the biometric information of the target object. In the embodiments of the present application, the biometric information refers to the information of the key area of the target part. Taking the target part as the palm as an example, the information of the key area includes, but is not limited to, one or more of palmprint, palm shape, or vein, etc.
[0095] In one embodiment, when the mapping pattern matches the preset recognition pattern, the acquisition device acquires multiple frames of images of the key area of the target part through the image acquisition element to improve the accuracy of authentication.
[0096] In one embodiment, the acquisition device sends one or more frames of images of the key area to the server for the server to perform biometric authentication based on the one or more frames of images of the key area. The server can use a palmprint recognition model, etc. to recognize the images of the key area, extract one or more biometric information such as palmprint, palm shape, or vein in the images, and perform recognition based on the one or more biometric information to determine whether the target object is a pre-registered object. When the target object is a pre-registered object, it is determined that the biometric authentication of the target object passes. Of course, when the hardware conditions of the acquisition device support it, the acquisition device itself can also process the images of the key area for biometric authentication.
[0097] In one embodiment, the acquisition device also receives the authentication result returned by the server and displays the authentication result on the display interface through the display element. For example, when the biometric authentication of the target object passes, the acquisition device receives the authentication result of "authentication passed" returned by the server and displays it on the display interface through the display element, such as prompts like "Congratulations on passing the authentication" or "Authentication successful" to feedback the authentication result to the target object.
[0098] In the above biological authentication method, biological authentication is performed in a non-contact acquisition manner, breaking the rigid requirement for hardware infrastructure. By responding to a non-contact acquisition operation triggered by a target part of a target object and visually concretizing the key area of the target part as a mapping pattern, based on the change in the relative position of the target part with respect to the image acquisition component, the display state of the displayed mapping pattern also changes accordingly. By feeding back the difference between the mapping pattern and a preset recognition pattern to the target object, the target object can be intuitively and clearly prompted to make adaptive adjustments so that the mapping pattern matches the preset recognition pattern. Thereby, the acquisition efficiency is greatly improved, and the user experience is enhanced. When the currently displayed mapping pattern matches the preset recognition pattern, the key area image of the target part is collected by the image acquisition component for biological authentication, which can ensure the accuracy of the collected image, thereby improving the accuracy of the biological authentication result and protecting the resource security of the target object at the same time.
[0099] In order to ensure the security of biological authentication and prevent forgery by using photos to achieve the purpose of biological authentication, in one embodiment, before responding to a non-contact acquisition operation triggered by a target part of a target object and displaying a mapping pattern corresponding to the key area of the target part, the above method further includes: performing target detection and liveness detection on a target that appears within the acquisition range of the image acquisition component; and determining that the target part of the target object has triggered a non-contact acquisition operation when it is detected that the target is the target part of the target object and liveness is detected.
[0100] Specifically, the acquisition device performs target detection on a target that appears within the acquisition range of the image acquisition component to ensure that the object triggering the non-contact acquisition operation is the target part of the target object, rather than other objects or other parts of the target object. At the same time, the acquisition device performs liveness detection on a target that appears within the acquisition range of the image acquisition component to determine that the currently detected target part has vital signs, rather than a photo, statue, etc.
[0101] Exemplarily, the acquisition device is also provided with an infrared sensor to detect a target that appears within the acquisition range of the image acquisition component and detect whether there are vein features. When vein features are detected, the acquisition device determines that the currently monitored target passes the liveness detection. On the contrary, when vein features are not detected, the acquisition device determines that the currently monitored target fails the liveness detection, so the non-contact acquisition operation can be refused to be executed.
[0102] In the above embodiment, by performing target detection and liveness detection before determining that the non-contact acquisition operation is triggered, the privacy security and resource security of the target object can be protected on the premise of secure biological authentication.
[0103] In one embodiment, the display state is reflected by the display position and the display size. Accordingly, when the relative position of the target part with respect to the image acquisition element changes, the display state of the currently displayed mapping pattern changes following the change in the relative position, including: when the spatial height of the target part with respect to the image acquisition element changes, the display size of the currently displayed mapping pattern changes in the opposite direction following the change in the spatial height; the display position of the currently displayed mapping pattern changes in the same direction following the change in the planar position of the key area of the target part within the acquisition range of the image acquisition element.
[0104] It should be noted that the planar position is the position of the target part in a plane parallel to the image acquisition element. When the target part is facing the image acquisition element directly, the planar position of the target part is the planar position in the plane where it is located and facing directly. When the target part has a certain inclination angle with respect to the image acquisition element, the planar position of the target part is the position of its projection in a plane parallel to the image acquisition element.
[0105] Among them, during the process of the target object performing the non-contact acquisition operation, the relative position of the target part with respect to the image acquisition element may change. For example, the spatial height of the target part from the image acquisition element changes, or the planar position of the target part with respect to the image acquisition element changes.
[0106] In order to visually feedback the current state of the target part, the display state of the mapping pattern should change following the change in the state of the target part. In other words, when the spatial height of the target part with respect to the image acquisition element changes, or when the planar position of the target part with respect to the image acquisition element changes, the display state of the mapping pattern should also change.
[0107] The display size of the mapping pattern can intuitively reflect the distance of the target part relative to the image acquisition element. In one embodiment, when the spatial height of the target part relative to the image acquisition element is getting farther and farther, the display size of the currently displayed mapping pattern decreases as the spatial height increases; when the spatial height of the target part relative to the image acquisition element is getting closer and closer, the display size of the currently displayed mapping pattern increases as the spatial height decreases. That is, when the target part is getting farther and farther relative to the image acquisition element, the mapping pattern is getting smaller and smaller; when the target part is getting closer and closer relative to the image acquisition element, the mapping pattern is getting larger and larger. In other words, the larger the spatial height, the smaller the displayed mapping pattern; conversely, the smaller the spatial height, the larger the displayed mapping pattern. That is, the display size of the mapping pattern changes in the opposite direction with the change of the spatial height. Thus, it conforms to the size transformation relationship of "near is large and far is small", can more intuitively and quickly reflect the spatial position of the target part, and is convenient for the target object to make quick adjustments.
[0108] The display position of the mapping pattern can intuitively reflect the position offset of the target part relative to the image acquisition element, that is, the azimuth of the target part in the image acquisition element. When the target part is on the left side of the image acquisition element, the mapping pattern is also displayed on the left; when the target part is on the right side of the image acquisition element, the mapping pattern is also displayed on the right; the same is true for the upper and lower azimuths. In other words, the display position of the mapping pattern changes in the same direction as the change of the plane position of the target part.
[0109] In the above embodiment, by feeding back the difference between the mapping pattern and the preset recognition pattern to the target object, the target object can be intuitively and clearly prompted to make adaptive adjustments so that the mapping pattern matches the preset recognition pattern. Thus, the acquisition efficiency is greatly improved, and the use experience is improved.
[0110] Generally, when converting the spatial height of the target part relative to the image acquisition element in the actual physical space into the display size of the mapping pattern in the display interface, numerical conversion is required to present a more beautiful interface. For this purpose, in one embodiment, when the spatial height of the target part relative to the image acquisition element changes, the display size of the currently displayed mapping pattern changes in the opposite direction with the change of the spatial height, including: determining the current spatial height of the target part of the target object relative to the image acquisition element; based on the pre-set distance mapping relationship, mapping the spatial height to the current display size, where the larger the spatial height, the smaller the mapped current display size; adjusting the display size of the mapping pattern to the current display size for updated display.
[0111] Specifically, the acquisition device obtains the current spatial height of the target part of the target object relative to the image acquisition element, and based on the pre-set distance mapping relationship, maps the spatial height to the current display size of the mapping pattern.
[0112] Exemplarily, the distance mapping relationship can be expressed by the following formula:
[0113]
[0114] Where P is the current spatial height of the target part relative to the image acquisition element, L is the preset standard height, and f is the size scaling ratio of the mapping pattern, that is, it is enlarged when the distance is too close and reduced when the distance is too far. To avoid the mapping pattern being too large or too small and affecting the experience, f is set to a fixed value when P < 0.2L or P > 1.8L, so as to ensure that the display size of the mapping pattern is within a suitable range.
[0115] Then, the acquisition device adjusts the display size of the mapping pattern to the current display size through the display element for updated display, so as to provide real-time feedback on the current spatial height of the target part relative to the image acquisition element.
[0116] Thus, by mapping the detected spatial height of the target part relative to the image acquisition element to the display size of the mapping pattern in a certain proportion, which conforms to the well-known relationship of "objects appear larger when closer and smaller when farther away", it is convenient for the target object to adjust the target part to a suitable distance, with higher efficiency.
[0117] In one embodiment, the acquisition device can obtain the spatial height of the target part relative to the image acquisition element through the acquired image. For example, based on the mapping relationship between the size of the key area in the acquired target part and the spatial height, the spatial height of the target part relative to the image acquisition element is calculated. In another embodiment, a plurality of distance sensors are deployed around the image acquisition element. When the target part is placed within the visible range of the image acquisition element, the acquisition device can detect the spatial height of the target part relative to the image acquisition element through the distance sensors.
[0118] Therefore, determining the current spatial height of the target part of the target object relative to the image acquisition element includes: when the target part is within the acquisition range of the image acquisition element, obtaining a plurality of effective distances corresponding to the key area of the target part through a plurality of distance sensors; based on the plurality of effective distances, determining the current spatial height of the target part relative to the image acquisition element.
[0119] Among them, the number of distance sensors can be set according to actual needs, and the distance sensors are symmetrically distributed. The distance sensor is, for example, a sensor using ToF (Time of Flight) technology, etc. When the distance sensor does not detect an object, or the distance between the object and it exceeds the detectable range, the distance sensor will output a specific value. When the distance sensor detects an object within its detectable range, the distance sensor outputs the distance value.
[0120] Generally, the target part will block at least one distance sensor, and the acquisition device calculates based on the distances detected and output by each of the at least one distance sensor to obtain the final distance, and this final distance is the current spatial height of the target part relative to the image acquisition element.
[0121] Specifically, when the target part is within the acquisition range of the image acquisition element, the target part is within the detectable range of one or more distance sensors, that is, the projection area of the key area of the target part onto the plane where the distance sensors are located covers one or more distance sensors. Then the acquisition device obtains a plurality of effective distances corresponding to the key area of the target part through the one or more distance sensors. And the remaining distance sensors that do not detect the target part will output invalid distance values. Thus, the acquisition device can determine the current spatial height of the target part relative to the image acquisition element according to the plurality of effective distances. Exemplarily, the acquisition device takes the average value of the plurality of effective distances as the current spatial height of the target part relative to the image acquisition element.
[0122] Exemplarily, as Figure 7A shown, around the camera of the image acquisition element, a plurality of distance sensors P are provided. The acquisition device determines the distance sensors set corresponding to this range according to the range covered by the key area R of the target part, that is, the distance sensors blocked by the target part, and obtains the current spatial height of the target part relative to the image acquisition element based on the distance values output by these distance sensors.
[0123] In an actual scenario, due to possible phenomena such as occlusion by an arm, etc., all the plurality of distance sensors may return a distance value, but only some of the distance values are the distance values corresponding to the target part, and the remaining distance values may be the distance values of the arm detected due to occlusion by the arm, etc., thus resulting in inaccurate distance detection results.
[0124] Thus, in one embodiment, the set distance sensors are divided into quadrants, and there are multiple distance sensors in each quadrant. Thereby, the acquisition device determines the center G of the key area according to the key area of the target part detected by the image acquisition element, and according to the quadrant where the center G of the key area is located, obtains the multiple distance values output by the multiple distance sensors in this quadrant, and determines the current spatial height of the target part relative to the image acquisition element based on the multiple distance values.
[0125] As Figure 7B shown, the acquisition device determines that the quadrant where the center G of the key area is located is the first quadrant based on the key area R of the target part detected by the image acquisition element, and thus determines the distance sensors in the first quadrant (shown as black circles in the figure for distinction from other sensors), and obtains the distance values output by these sensors.
[0126] Thereby, by setting multiple distance sensors around the camera for detection, the spatial height of the target part relative to the image acquisition element can be obtained more accurately, and further the size of the presented mapping pattern can be more accurate, enabling the target object to adjust the spatial height of the target part more quickly and accurately.
[0127] In addition to the display size of the mapping pattern, the mapping pattern can also reflect the orientation of the target part relative to the image acquisition element through its display position. In one embodiment, the display position of the currently displayed mapping pattern changes in the same direction as the change in the planar position of the key area of the target part within the acquisition range of the image acquisition element, including: obtaining the planar position of the key area of the target part within the acquisition range of the image acquisition element; determining the offset information of the planar position relative to the preset position within the acquisition range; determining the current display position of the mapping pattern according to the offset information, and adjusting the display position of the mapping pattern to the current display position for updated display.
[0128] Specifically, the acquisition device determines the key area of the target part based on the image of the target part detected by the image acquisition element through methods such as target detection algorithms. Exemplarily, the acquisition device uses the YOLO (You Only Look Once: Unified, Real-Time Object Detection) algorithm to extract features from the image of the target part, thereby determining the key area in the image of the target part.
[0129] For example, the acquisition device divides the image of the target part into S*S grids, and then predicts multiple bounding boxes for each grid. Each bounding box contains the center coordinates (x, y), width w, height h, and confidence level. Since the embodiments of the present application focus on the key area of the target part, the confidence level is used to output the probability that the detected object is the key area (such as the palm center) of the target part. Exemplarily, the bounding box with the highest confidence level can be used as the range of the key area. Thus, the key area of the target part can be determined. For example Figure 8A As shown, (x, y) is the pixel position of the upper left corner of the key area, w is the width of the key area, and h is the height of the key area. According to the coordinates of the upper left corner of the key area and the width and height of the key area, the position of the center of the key area can be determined. Among them, the width w and height h can be normalized, that is, divided by the width W and height H of the image respectively, so that the width w and height h of the bounding box are within the range of [0, 1].
[0130] After determining the key area of the target part, the acquisition device can determine the current planar position of the key area within the acquisition range based on the pixel position of the upper left corner of the key area. Then, the acquisition device can calculate the offset information of the planar position relative to a preset position within the acquisition range according to the planar position where the key area is located.
[0131] Exemplarily, the offset is determined according to the difference between the pixel position of the preset position (also represented in the form of coordinates) and the pixel position corresponding to the planar position (i.e., the pixel position of the upper left corner). The offset is a vector value, and the orientation of the target part relative to the image acquisition element can be determined according to the sign information of the offset.
[0132] Thus, based on the offset information, the acquisition device can determine the current display position of the mapping pattern and adjust the display position of the mapping pattern to the current display position for updated display, so as to real-time feedback the current orientation and position offset of the target part relative to the image acquisition element.
[0133] In the above embodiments, by mapping the change in the planar position of the key area of the target part within the acquisition range of the image acquisition element to the display position of the mapping pattern, when the target part drives the key area to shift in a certain direction, the mapping pattern also shifts in that direction accordingly, which can intuitively and clearly feedback the current state of the target part and real-time feedback to prompt the target object to make adjustments, with higher acquisition efficiency.
[0134] In one embodiment, determining the current display position of the mapping pattern according to the offset information includes: normalizing the offset information according to the acquisition range to obtain an offset ratio; and determining the current display position of the mapping pattern in the current display interface based on the sign information carried in the offset information and the offset ratio.
[0135] Specifically, the acquisition device determines a corresponding image range according to the acquisition range of the image acquisition element, that is, the width W and height H of the image. Based on the image range, the calculated offset information is normalized. The acquisition device may then obtain the offset ratio of the key area within the image range, and then, based on the sign information carried in the offset information, that is, the vector information of the offset amount, and in combination with the offset ratio, the current display position of the mapping pattern in the current display interface can be determined.
[0136] Exemplarily, as Figure 8B shown, the center of the acquisition range of the image acquisition element (represented by a solid black circle in the figure) is the preset position within the acquisition range, with coordinates (W / 2, H / 2). Taking this preset position as the center coordinates to establish a coordinate system, assuming that the positive direction of the X-axis is horizontally to the right and the positive direction of the Y-axis is vertically downward, the acquisition device can determine the coordinates of the center of the key area (represented by a dashed circle in the figure) as (x + w / 2, y + h / 2) according to the detected coordinates (x, y), width w, and height h of the upper left corner of the key area, and determine the offset information of the center of the key area relative to the preset position on the X-axis and Y-axis respectively as: dx = x + w / 2 - W / 2, dy = y + h / 2 - H / 2.
[0137] Considering that the hardware conditions of different devices are different and the image resolution may vary, therefore, in one embodiment, the offset information is normalized. For example, using dx` = dx / (W / 2) and dy` = dy / (H / 2), the offset ratio of the center of the key area relative to the preset position can be obtained. During the normalization process, the sign information of the offset amount is retained, where the sign information includes "+" and "-", representing the positive and negative directions of the coordinate axes respectively.
[0138] Thus, by using the offset ratio and sign information, the change in the planar position of the key area of the target part within the acquisition range of the image acquisition element can be correctly displayed, that is, the offset of the key area relative to the camera center in the plane. Thus, a more intuitive feedback can be given to the target object, facilitating the target object to quickly adjust the target position.
[0139] Considering that it is difficult for the target part to maintain a posture precisely, in one embodiment, at least three distance sensors are deployed around the image acquisition element. When the relative position of the target part with respect to the image acquisition element changes, the display state of the currently displayed mapping pattern changes following the change in the relative position, including: when the target part is within the acquisition range of the image acquisition element, at least three effective distances corresponding to the key area of the target part are obtained through the distance sensors; a virtual plane of the key area is constructed based on the at least three effective distances; the relative posture of the key area is determined based on the relative angle between the virtual plane and the standard plane; and the display state of the mapping pattern is adjusted based on the relative posture.
[0140] Specifically, when the target part is within the acquisition range of the image acquisition element, the target part is at least within the detectable ranges of three distance sensors, that is, the projection area of the key area of the target part onto the plane where the distance sensors are located covers at least three distance sensors. Thus, the acquisition device can obtain at least three effective distances output by the distance sensors. Based on the at least three effective distances, the acquisition device constructs a virtual plane corresponding to the posture of the current target part. Thus, based on the relative angle (such as the tangent angle) between the virtual plane and the standard plane, the acquisition device can determine the relative posture of the key area, that is, the tilt posture of the current target part. Thus, according to the tilt posture of the current target part, the acquisition device can adjust the display state of the mapping pattern through the display element according to this relative posture.
[0141] Exemplarily, according to the relative posture of the key area, the acquisition device calculates its components in the height direction and the plane direction, and maps them respectively as the change amounts of the mapping pattern in terms of the display position and the display size, thereby reflecting the current tilt posture of the target part.
[0142] Thus, when the posture of the target part changes and the posture of the target part is tilted to a certain extent, real-time feedback can also be performed through the display state of the mapping pattern, which can ensure that the acquired image is more accurate, thereby improving the accuracy of biometric authentication.
[0143] Such as Figure 9As shown, when the target part is tilted, moving too fast, too close or too far, or too dark or too bright due to other factors, the images of the key area collected will also have various situations, resulting in the image quality being difficult to meet the standards of biometric authentication, or resulting in biometric authentication failure or low accuracy. Therefore, in order to ensure that the quality of the collected images meets the standards for biometric authentication, in one embodiment, before collecting the images of the key area of the target part through the image acquisition element, the method further includes: obtaining the moving speed of the target part within the acquisition range of the image acquisition element. When the moving speed is too fast, the collected images may be blurred, affecting the accuracy of subsequent steps.
[0144] Specifically, the acquisition device determines the moving speed of the target part based on at least one of the change amount of the spatial height or the offset amount of the planar position of the key area corresponding to the consecutive multiple frames of images of the target part detected by the image acquisition element. Exemplarily, the acquisition device calculates the change amount of the spatial height between every two adjacent frames based on the consecutive N frames of images of the target part detected by the image acquisition element. When the change amount is less than the preset threshold, the acquisition device determines that the moving speed of the target part is appropriate and meets the acquisition conditions.
[0145] For another example, the acquisition device calculates the offset amount of the planar position between every two adjacent frames based on the consecutive N frames of images of the target part detected by the image acquisition element. When the offset amount is less than the preset threshold, the acquisition device determines that the moving speed of the target part is appropriate and meets the acquisition conditions.
[0146] For yet another example, only when both the change amount of the spatial height and the offset amount of the planar position between every two adjacent frames meet the corresponding threshold conditions, the acquisition device determines that the moving speed of the target part is appropriate and meets the acquisition conditions, etc.
[0147] Thus, when it is determined based on the moving speed that the detected target part meets the acquisition conditions, the acquisition device performs the step of collecting the images of the key area of the target part through the image acquisition element.
[0148] Considering that in the actual scenario, the key area may be blocked by other objects (such as the palm center being blocked by the sleeve, etc.), in order to ensure the accuracy of the acquisition, in another embodiment, before collecting the images of the key area of the target part through the image acquisition element, the method further includes: performing an integrity detection on the target part within the acquisition range of the image acquisition element to obtain an integrity detection result. Specifically, the acquisition device obtains the image of the target part through the image acquisition element and performs an integrity detection on the image of the target part, thereby obtaining an integrity detection result, which is used to indicate whether the key area of the target part is complete, in other words, whether there is a blocked situation in the key area. When there is no blockage of the target part, the acquisition device determines that the target part meets the acquisition conditions.
[0149] For example, the acquisition device can perform integrity detection on the image of the target part by judging the skin color. Exemplarily, the acquisition device extracts the pixel values in the key area of the target part and compares them with the pixel values in the non-key area. When the pixel value difference exceeds the threshold, it indicates that there is occlusion in the key area. For another example, the acquisition device can use a pre-trained classification model, input the image of the target part into the classification model, and the classification model outputs the integrity detection result of whether there is occlusion.
[0150] Thus, when it is determined based on the integrity detection result that the detected target part meets the acquisition condition, the acquisition device executes the step of acquiring the key area image of the target part through the image acquisition component.
[0151] In another embodiment, in order to further ensure the accuracy of acquisition and further guarantee the accuracy of biometric authentication, when both the moving speed and the integrity detection result meet the acquisition conditions, the step of acquiring the key area image of the target part through the image acquisition component is executed.
[0152] At the same time, in order to determine that the current operation is indeed carried out with the consent of the target object and to fully obtain the authorization of the target object, before acquiring the key area image of the target part through the image acquisition component, when the acquisition device determines that the duration of the image of the target part that meets the image quality condition detected by the image acquisition component is not less than the preset duration, an instruction is issued to make the image acquisition component perform the acquisition.
[0153] Specifically, the acquisition device can obtain the moving speed of the target part within the acquisition range of the image acquisition component. When the moving speed is within a small range, it can be determined that the authentication intention of the target object is met. Exemplarily, based on the continuous N frames of images of the target part detected by the image acquisition component, when at least one of the change amount of the spatial height or the offset amount of the planar position of the key area corresponding to the continuous N frames of images meets the threshold condition, it is determined that the authentication intention of the target object is met. The moving speed range restricted by this threshold condition should be more stringent than the threshold condition set to ensure image quality.
[0154] Thus, it can be ensured that the authorization of the target object can be fully obtained, and the target object can interrupt the authentication process at any time before finally acquiring the image.
[0155] Under the condition of meeting one or more of the above embodiments, the acquisition device acquires the key area image of the target part through the image acquisition component. Usually, in order to ensure the accuracy of the biometric authentication result, the image acquisition component acquires multiple key area images to obtain a more accurate biometric authentication result by recognizing the multiple key area images.
[0156] To this end, in one embodiment, when the currently displayed mapping pattern matches the preset recognition pattern, the key area image of the target part is collected by the image acquisition element, including: when the currently displayed mapping pattern matches the preset recognition pattern, triggering the output of a first prompt message, where the first prompt message is used to prompt the target object to keep the target part in the current state unchanged; when the target part remains in the current state unchanged, collecting the key area image of the target part by the image acquisition element.
[0157] Among them, the first prompt message is used to prompt the target object to keep the target part in the current state unchanged. In an actual scenario, when the target object remains in the current state within a certain range, it can be regarded as the target object keeping the target part in the current state unchanged.
[0158] Specifically, when the currently displayed mapping pattern matches the preset recognition pattern, the acquisition device is triggered to output the first prompt message. For example, the acquisition device can display the first prompt message in the display interface through a display element in the form of text, pattern, or animation. Another example is that the acquisition device can display the first prompt message in the form of voice or music through a sound playback element such as a speaker. Among them, the sound playback element can be integrated in the acquisition device or set independently of the acquisition device. For example, the sound playback element is connected to the acquisition device in an external connection manner.
[0159] Thus, the acquisition device can collect the key area image of the target part by the image acquisition element when the target part remains in the current state unchanged.
[0160] In the above embodiment, by outputting the first prompt message and combining the display interface where the mapping pattern matches the preset recognition pattern, it is possible to timely and clearly feedback to the target object that the state of the target part meets the acquisition conditions, avoiding the movement of the target part again, thereby improving the completion rate and the acquisition efficiency.
[0161] In the case where the mapping pattern does not match the preset recognition pattern, feedback can also be given to the target object to prompt it to make adjustments. In one embodiment, the above method further includes: when the currently displayed mapping pattern does not match the preset recognition pattern, triggering the output of a second prompt message, where the second prompt message is used to prompt the target object to adjust the relative position of the target part with respect to the image acquisition element so that the mapping pattern that changes following the change of the relative position matches the preset recognition pattern.
[0162] Among them, the second prompt message is used to prompt that the current state of the target object does not meet the acquisition condition, so as to guide the target object to adjust the relative position of the target part with respect to the image acquisition component, so that the relative position of the target part with respect to the image acquisition component is appropriate, so that the mapped pattern matches the preset recognition pattern.
[0163] Specifically, when the currently displayed mapped pattern does not match the preset recognition pattern, the acquisition device is triggered to output the second prompt message. For example, the acquisition device can display the second prompt message in the display interface through a display component in the form of text, pattern, or animation. Another example is that the acquisition device can display the second prompt message in the form of voice or music through a sound playback component such as a speaker.
[0164] In one embodiment, when the display size of the currently displayed mapped pattern is larger than the display size of the preset recognition pattern, the acquisition device outputs the second prompt message, which is used to prompt the target object to control the target part to move away from the image acquisition component. In one embodiment, when the display size of the currently displayed mapped pattern is smaller than the display size of the preset recognition pattern, the acquisition device outputs the second prompt message, and the second prompt message is used to prompt the target object to control the target part to approach the image acquisition component. Thus, the spatial height of the target part with respect to the image acquisition component can be clearly feedback, which is convenient for the target object to adjust the height.
[0165] In one embodiment, when the display position of the currently displayed mapped pattern has an offset with respect to the preset position of the preset recognition pattern, the acquisition device outputs the second prompt message, and the second prompt message is used to prompt the target object to adjust the planar position of the target part. For example, when the display position is offset to the left (or right) with respect to the preset position, the acquisition device outputs the second prompt message to prompt the target object to adjust the target part to the right (or left); or, when the display position is offset upward (or downward) with respect to the preset position, the acquisition device outputs the second prompt message to prompt the target object to adjust the target part downward (or upward). Thus, the offset of the target part with respect to the image acquisition component can be clearly feedback, which is convenient for the target object to adjust the orientation.
[0166] In the above embodiments, by outputting the second prompt message when the mapped pattern and the preset recognition pattern fail to match, and combining the display state of the mapped pattern to prompt the target object to adjust the state of the target part, it can help the target object more easily adjust the position of the target part, and can achieve more efficient acquisition and biometric authentication.
[0167] In one embodiment, the method further includes: sending the captured key area image to a server for the server to perform biometric authentication on the key area image and execute resource transfer in case of successful biometric authentication; and receiving and displaying the resource transfer result feedback by the server in case of successful biometric authentication.
[0168] Specifically, the acquisition device sends the captured key area image to the server. After receiving the key area image, the server performs biometric authentication on the key area image. In case of successful biometric authentication, the server can execute a resource transfer operation related to the target object. The resource transfer operation refers to that, in case of successful biometric authentication, the server transfers the preset resources in the account pre-bound to the target object stored in it to a preset account.
[0169] Taking a specific scenario as an example, in case of successful biometric authentication of the target object, the server withdraws a preset quantity of resources such as property and props in the target object's account and transfers them to another preset account. The preset account can be a merchant account, for example, paying a certain amount to the merchant account. The preset account can also be other non-merchant accounts, such as transferring money to the non-merchant account or transferring virtual props to the non-merchant account, etc.
[0170] In the above embodiment, through the non-contact biometric authentication method, the requirement for hardware devices is avoided, and the inconvenience caused by forgetting to carry a portable terminal in the case of current common mobile payment and code scanning payment is also avoided. At the same time, biometric authentication is performed by swiping the palm to perform resource transfer, which is more efficient and greatly improves the convenience.
[0171] The present application also provides an application scenario that applies the above biometric authentication method. Specifically, the application of the biometric authentication method in this application scenario is as follows: The user places the palm above the image acquisition element, and the acquisition device responds to the non-contact acquisition operation triggered by the user's palm and displays a mapping pattern corresponding to the palm's palm center area through the display element. In case of a change in the relative position of the palm's palm center area with respect to the image acquisition element, the display state of the displayed mapping pattern also changes accordingly, thus giving the user real-time and intuitive feedback to guide the user to adjust the height and position of the palm during payment. In case of a match between the currently displayed mapping pattern and a preset recognition pattern, the image acquisition element captures an image of the palm's palm center area to perform biometric authentication on the user. Of course, it is not limited to this. The biometric authentication method provided by the present application can also be applied in other application scenarios, such as swiping the palm to pass through a turnstile, ticket checking at an airport / railway station, etc.
[0172] Exemplarily, when a user passes through a turnstile, by placing the palm above the camera set on the turnstile and performing palm-sweeping authentication, during this process, a mapping pattern corresponding to the palm center area can be displayed through the turnstile or an external display connected to the turnstile for the user to adjust. When the mapping pattern matches the preset recognition pattern, an image of the palm center area of the palm is collected through the camera to perform biometric authentication on the user. After the biometric authentication is passed, the user can successfully pass through the turnstile.
[0173] The following takes a specific application scenario of palm-sweeping collection and palm-sweeping payment as an example for illustration. As Figure 10 shown, the user or the initiator of palm-sweeping collection / payment collects the palmprint through a palm-sweeping device. The collection device collects or reads the palmprint through an image collection component and prompts the user whether the collection is successful or not. Thus, when making a payment in different scenarios, the user can directly extend the palm for payment, which is more convenient and fast. At the same time, efficient interaction prompts can more effectively guide the user to perform palmprint collection and palmprint payment.
[0174] During the process of collecting the palmprint, the collection device displays a mapping pattern through a display component. When the user's palm approaches the collection device, the recognized palm center is mapped to a circular shape on the display interface. As the distance between the palm and the device changes, the interface also gives corresponding feedback, greatly improving the payment completion rate. Thus, the key part "palm center" recognized in palm-sweeping payment is mapped to a circular shape on the display interface, making it easier for the user to recognize the key part; at the same time, the relationship of near-big and far-small of the distance between the collection device and the palm is shown on the display interface, making it convenient for the user to adjust the appropriate distance; the overlap of the circular shape mapped by the palm center and the key recognition area helps the user to more easily adjust the position of the palm during payment.
[0175] To improve the user experience, as Figure 11A shown, before the user triggers the air collection operation, the collection device also displays a palm-sweeping guiding interface for the user through a display component, as Figure 11A shown in (a), or an interface for guiding the user to enter the palm center can also be displayed, as Figure 11A shown in (b).
[0176] During the process of collecting the palmprint, as the relative position of the palm changes, the display state of the mapped circular shape also changes accordingly. As Figure 11B shown in (a), the user's palm center is mapped into a circular shape. The orientation of this circular shape relative to the preset recognition pattern (the filled area composed of a circle and a cross) reflects the planar position of the palm relative to the collection device. At the same time, the size of this circular shape reflects the spatial height of the palm relative to the collection device. The collection device also outputs a second prompt message through the display component to prompt the user to adjust the position of the palm to move the circular shape into the preset recognition pattern displayed on the interface. As Figure 11BAs shown in (b), when the circle exactly fills the preset recognition pattern, that is, the mapped pattern matches the preset recognition pattern, the image acquisition element is triggered to collect the image of the palm area. During this process, the acquisition device also outputs a first prompt message through the display element to prompt the user to keep the state of the palm unchanged.
[0177] When the height of the palm relative to the image acquisition element (i.e., the scanning area in the figure) is too low, such as Figure 11C As shown in (a), when the circle is too large, it reflects that the spatial height of the palm relative to the image acquisition element is too low. Therefore, the acquisition device outputs a second prompt message through the display element to prompt the user to adjust the height of the palm to be farther away from the image acquisition element. Conversely, when the height of the palm relative to the image acquisition element is too high, such as Figure 11C As shown in (b), when the circle is too small, it reflects that the spatial height of the palm relative to the image acquisition element is too high. Therefore, the acquisition device outputs a second prompt message through the display element to prompt the user to adjust the height of the palm to be closer to the image acquisition element.
[0178] In one embodiment, the display element can also be demonstrated by means of animation to guide the user to make adjustments. As Figure 11D As shown in (a) and (b), prompt is made by means of animation. In the animation, the acquisition device remains stationary, demonstrating the upward displacement of the palm, thereby guiding the user to adjust the palm away from the image acquisition element; or, in the animation, the acquisition device remains stationary, demonstrating the downward displacement of the palm, thereby guiding the user to adjust the palm closer to the image acquisition element.
[0179] In one embodiment, prompt can also be made by different display colors. For example, when the palm is too close, red is used to prompt that the user needs to be farther away from the device; when the palm is too far, red is used to prompt that the user needs to be closer to the device; and when the palm is moved up or down to the appropriate height, white is used to prompt that the height is appropriate.
[0180] In a specific example, the above biometric authentication process can be as Figure 12 shown, including the following steps: The camera collects an image stream. When a palm is detected, the acquisition device processes the collected image data. First, through data format preprocessing, the image data is made to meet the subsequent data format requirements. Based on the detected image, the acquisition device respectively obtains the position and distance of the palm, and makes judgments on being too close, too far, and within the effective range. At the same time, the acquisition device makes a judgment on the palm ROI (Region of Interest) to ensure that the key area of the palm is within the acquisition range of the image acquisition device, avoiding distortion caused by the key area of the palm being at the edge of the visible range. At the same time, the acquisition device also makes judgments on the moving speed and occlusion to ensure that the quality of the collected image meets the standard. Among them, Figure 12Steps 4 to 10 are the process of image recognition. When the above conditions are all met, the acquisition device feeds back the recognition result through the display interface in the way of a mapping pattern, and feeds back the position and height of the palm through the mapping pattern, so as to give prompts and guidance to the user.
[0181] Through the biometric authentication method provided by the above one or more embodiments, such as Figure 13 As shown, the image of the key area of the hand is detected by the camera, the liveness detection is carried out by the infrared sensor, the palmprint is optimized through the palmprint quality judgment, and the image meeting the image quality conditions is collected for biometric authentication. By this means, the situation that it is difficult to distinguish identical twins in face recognition is avoided, and the accuracy of recognition can be effectively improved.
[0182] In a specific embodiment, when it is determined that the detected target part meets the acquisition conditions by satisfying at least one of the target detection and liveness detection, or the detection result based on the moving speed or integrity, the acquisition device responds to the air acquisition operation triggered by the target part of the target object and displays a mapping pattern corresponding to the key area of the target part.
[0183] On the one hand, when the spatial height of the target part changes relative to the image acquisition element, the display size of the currently displayed mapping pattern changes in the opposite direction with the change of the spatial height. That is, when the spatial height of the target part is getting farther and farther from the image acquisition element, the display size of the currently displayed mapping pattern decreases as the spatial height increases; when the spatial height of the target part is getting closer and closer to the image acquisition element, the display size of the currently displayed mapping pattern increases as the spatial height decreases.
[0184] In terms of technical implementation, a plurality of distance sensors are deployed around the image acquisition element. When the target part is within the acquisition range of the image acquisition element, the acquisition device obtains a plurality of effective distances corresponding to the key area of the target part through the plurality of distance sensors; based on the plurality of effective distances, the current spatial height of the target part relative to the image acquisition element is determined. Based on the pre-set distance mapping relationship, the spatial height is mapped to the current display size, where the larger the spatial height, the smaller the mapped current display size; the display size of the mapping pattern is adjusted to the current display size for updated display.
[0185] On the other hand, the display position of the currently displayed mapping pattern changes in the same direction as the change in the planar position of the key area of the target part within the acquisition range of the image acquisition element. In terms of technical implementation, the planar position of the key area of the target part within the acquisition range of the image acquisition element is obtained; the offset information of the planar position relative to the preset position within the acquisition range is determined; the offset information is normalized according to the acquisition range to obtain an offset ratio; based on the sign information carried in the offset information and the offset ratio, the current display position of the mapping pattern in the current display interface is determined, and the display position of the mapping pattern is adjusted to the current display position for updated display.
[0186] On the other hand, considering the angular change of the target part, at least three distance sensors are deployed around the image acquisition element. When the target part is within the acquisition range of the image acquisition element, at least three effective distances corresponding to the key area of the target part are obtained through the distance sensors; a virtual plane of the key area is constructed based on the at least three effective distances; the relative pose of the key area is determined based on the relative angle between the virtual plane and the standard plane; the display state of the mapping pattern is adjusted based on the relative pose.
[0187] In one case, when the currently displayed mapping pattern matches the preset recognition pattern, the acquisition device is triggered to output a first prompt message, and the first prompt message is used to prompt the target object to keep the target part in the current state unchanged; when the target part remains in the current state unchanged, the key area image of the target part is acquired through the image acquisition element. The key area image of the target part is acquired through the image acquisition element; the key area image is used for biometric authentication of the target object.
[0188] In another case, when the currently displayed mapping pattern does not match the preset recognition pattern, the acquisition device is triggered to output a second prompt message, and the second prompt message is used to prompt the target object to adjust the relative position of the target part with respect to the image acquisition element so that the mapping pattern that changes with the change of the relative position matches the preset recognition pattern.
[0189] It should be understood that although the steps in the flowcharts involved in the above embodiments are sequentially shown according to the indications of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.
[0190] Based on the same inventive concept, an embodiment of the present application also provides a biometric authentication device for implementing the biometric authentication method involved above. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the biometric authentication device provided below can refer to the limitations on the biometric authentication method in the above text, and will not be repeated here.
[0191] In one embodiment, as Figure 14 shown, a biometric authentication device is provided, including: a display module 1401 and a collection module 1402, where:
[0192] The display module 1401 is configured to display a mapping pattern corresponding to the key area of the target part in response to a non-contact collection operation triggered by the target part of the target object, and the display state of the mapping pattern is related to the relative position of the target part with respect to the image acquisition element.
[0193] The display module 1401 is further configured to, when the relative position of the target part with respect to the image acquisition element changes, the display state of the currently displayed mapping pattern changes following the change of the relative position, and the display state includes at least one of the display position or the display size.
[0194] The collection module 1402 is configured to, when the currently displayed mapping pattern matches a preset recognition pattern, collect an image of the key area of the target part through the image acquisition element; the key area image is used for biometric authentication of the target object.
[0195] In one embodiment, the display module is further configured to, when the spatial height of the target part with respect to the image acquisition element changes, the display size of the currently displayed mapping pattern changes in the opposite direction following the change of the spatial height; the display position of the currently displayed mapping pattern changes in the same direction following the change of the planar position of the key area of the target part within the acquisition range of the image acquisition element.
[0196] In one embodiment, the display module is further configured to, when the spatial height of the target part relative to the image acquisition element is getting farther and farther away, reduce the display size of the currently displayed mapping pattern as the spatial height increases; and when the spatial height of the target part relative to the image acquisition element is getting closer and closer, increase the display size of the currently displayed mapping pattern as the spatial height decreases.
[0197] In one embodiment, the display module is further configured to determine the current spatial height of the target part of the target object relative to the image acquisition element; based on a pre-set distance mapping relationship, map the spatial height to the current display size, where the greater the spatial height, the smaller the mapped current display size; and adjust the display size of the mapping pattern to the current display size for updated display.
[0198] In one embodiment, a plurality of distance sensors are deployed around the image acquisition element, and the display module is further configured to, when the target part is within the acquisition range of the image acquisition element, obtain a plurality of effective distances corresponding to the key area of the target part through the plurality of distance sensors; and determine the current spatial height of the target part relative to the image acquisition element based on the plurality of effective distances.
[0199] In one embodiment, the display module is further configured to obtain the planar position of the key area of the target part within the acquisition range of the image acquisition element; determine the offset information of the planar position relative to a preset position within the acquisition range; determine the current display position of the mapping pattern according to the offset information, and adjust the display position of the mapping pattern to the current display position for updated display.
[0200] In one embodiment, the display module is further configured to perform normalization processing on the offset information according to the acquisition range to obtain an offset ratio; and determine the current display position of the mapping pattern in the current display interface based on the sign information carried in the offset information and the offset ratio.
[0201] In one embodiment, at least three distance sensors are deployed around the image acquisition element, and the display module is further configured to, when the target part is within the acquisition range of the image acquisition element, obtain at least three effective distances corresponding to the key area of the target part through the distance sensors; construct a virtual plane of the key area based on the at least three effective distances; determine the relative pose of the key area based on the relative angle between the virtual plane and a standard plane; and adjust the display state of the mapping pattern based on the relative pose.
[0202] In one embodiment, the above-mentioned device further includes a first detection module, configured to obtain the moving speed of a target part within the acquisition range of the image acquisition element; perform integrity detection on the target part within the acquisition range of the image acquisition element to obtain an integrity detection result; and when it is determined that the detected target part meets the acquisition condition based on at least one of the moving speed or the integrity detection result, execute the step of acquiring an image of a key area of the target part through the image acquisition element.
[0203] In one embodiment, the acquisition module is further configured to trigger and output a first prompt message when the currently displayed mapping pattern matches a preset recognition pattern, where the first prompt message is used to prompt the target object to keep the target part in the current state unchanged; and when the target part remains in the current state unchanged, acquire an image of a key area of the target part through the image acquisition element.
[0204] In one embodiment, the above-mentioned device further includes a prompt module, configured to trigger and output a second prompt message when the currently displayed mapping pattern does not match the preset recognition pattern, where the second prompt message is used to prompt the target object to adjust the relative position of the target part with respect to the image acquisition element so that the mapping pattern that changes following the change of the relative position matches the preset recognition pattern.
[0205] In one embodiment, when the display size of the currently displayed mapping pattern is larger than the display size of the preset recognition pattern, the second prompt message is used to prompt the target object to control the target part to move away from the image acquisition element.
[0206] In one embodiment, when the display size of the currently displayed mapping pattern is smaller than the display size of the preset recognition pattern, the second prompt message is used to prompt the target object to control the target part to move closer to the image acquisition element.
[0207] In one embodiment, the above-mentioned device further includes a second detection module, configured to perform target detection and live body detection on a target that appears within the acquisition range of the image acquisition element; and when it is detected that the target is the target part of the target object and a live body is detected, determine that the target part of the target object has triggered an air acquisition operation.
[0208] In one embodiment, the above-mentioned device further includes a communication module, configured to send the acquired key area image to a server for the server to perform biometric authentication on the key area image, and perform resource transfer when the biometric authentication is passed; and when the biometric authentication is passed, receive and display the resource transfer result feedback by the server.
[0209] Each module in the above-mentioned biometric authentication device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.
[0210] In one embodiment, a computer device is provided. This computer device can be the acquisition device in the foregoing embodiment, and its internal structural diagram can be as Figure 15 shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display element, and an image acquisition element. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display element, and the image acquisition element are connected to the system bus through the input / output interface. Among them, the processor of this computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used for exchanging information between the processor and external devices. The communication interface of the computer device is used for communicating with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (Near Field Communication), or other technologies. The computer program, when executed by the processor, implements a biometric authentication method. The display element of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.
[0211] Those skilled in the art can understand that Figure 15 the structure shown in
[0212] is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.
[0213] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.
[0214] In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.
[0215] It should be noted that the user information (including but not limited to user palmprint information, user account information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions.
[0216] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processors, graphics processors, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.
[0217] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.
[0218] The above embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.
Claims
1. A biometric authentication method, characterized in that, The method includes: In response to an air acquisition operation triggered by a target part of a target object, displaying a mapping pattern corresponding to a key area of the target part, where the display state of the mapping pattern is related to the relative position of the target part with respect to an image acquisition element; a plurality of distance sensors are deployed in quadrants around the image acquisition element, and there are at least two distance sensors in each quadrant; When the target part is within the acquisition range of the image acquisition element, determining the center of the key area according to the key area of the target part detected by the image acquisition element; obtaining distance values respectively output by at least two distance sensors within the quadrant where the center of the key area is located, and determining the current spatial height of the target part with respect to the image acquisition element based on the at least two distance values. When the spatial height changes, the display size of the currently displayed mapping pattern changes in the opposite direction with the change of the spatial height; obtaining the planar position of the key area within the acquisition range of the image acquisition element, determining the offset information of the planar position with respect to a preset position within the acquisition range, performing normalization processing on the offset information according to the acquisition range to obtain an offset ratio, and determining the current display position of the mapping pattern based on the sign information carried in the offset information and the offset ratio, and adjusting the display position of the currently displayed mapping pattern to the current display position; Obtaining an image of the target part through the image acquisition element, performing integrity detection on the image, and determining the occlusion condition of the key area of the target part; wherein, determining the occlusion condition of the key area according to the pixel value difference between the key area and the non-key area of the target part, or analyzing the image through a pre-trained classification model to determine the occlusion condition of the key area; When the currently displayed mapping pattern matches a preset recognition pattern and it is determined that the detected target part meets the acquisition conditions based on the occlusion condition of the key area, acquiring an image of the key area of the target part through the image acquisition element; the key area image is used for biometric authentication of the target object.
2. The method according to claim 1, wherein The method further includes: The display position of the currently displayed mapping pattern changes in the same direction as the change of the planar position of the key area of the target part within the acquisition range of the image acquisition element.
3. The method according to claim 1, characterized in that, The situation that when the spatial height changes, the display size of the currently displayed mapping pattern changes in the opposite direction with the change of the spatial height includes: When the spatial height of the target part with respect to the image acquisition element increases, the display size of the currently displayed mapping pattern decreases with the increase of the spatial height; When the spatial height of the target part with respect to the image acquisition element decreases, the display size of the currently displayed mapping pattern increases with the decrease of the spatial height.
4. The method according to any one of claims 1 to 3, characterized in that When the spatial height changes, the display size of the currently displayed mapping pattern changes in the opposite direction as the spatial height changes, including: Based on a pre-set distance mapping relationship, mapping the spatial height to the currently displayed size, where the larger the spatial height, the smaller the currently displayed size obtained by mapping; Adjusting the display size of the currently displayed mapping pattern to the currently displayed size.
5. The method according to claim 4, characterized in that The distance mapping relationship can be expressed by the following formula: Where P is the current spatial height of the target part relative to the image acquisition element, L is a preset standard height, and f is the size scaling ratio of the mapping pattern.
6. The method according to any one of claims 1 to 3, characterized in that, The method further includes: When the change amount of the relative position is within the allowable range, the display state of the currently displayed mapping pattern does not change.
7. The method according to any one of claims 1 to 3, characterized in that At least three distance sensors are deployed around the image acquisition element, and the method further includes: When the target part is within the acquisition range of the image acquisition element, obtaining at least three effective distances corresponding to the key area of the target part through the at least three distance sensors; Based on the at least three effective distances, constructing a virtual plane of the key area; Based on the relative angle between the virtual plane and the standard plane, determining the relative pose of the key area; Adjusting the display state of the mapping pattern based on the relative pose, where the display state includes at least one of the display position and the display size.
8. The method according to any one of claims 1 to 3, characterized in that The method further includes: Obtaining the moving speed of a target part within the acquisition range of the image acquisition element; Determining that the detected target part meets the acquisition conditions based on the moving speed; or determining that the detected target part meets the acquisition conditions based on the moving speed and the occlusion condition of the key area.
9. The method according to any one of claims 1 to 3, characterized in that When the currently displayed mapping pattern matches a preset recognition pattern and it is determined that the detected target part meets the acquisition conditions based on the occlusion condition of the key area, acquiring an image of the key area of the target part through the image acquisition element, including: When the currently displayed mapping pattern matches the preset recognition pattern, triggering the output of a first prompt message for prompting the target object to keep the target part in the current state unchanged; When the target part remains in the current state unchanged and it is determined that the detected target part meets the acquisition conditions based on the occlusion condition of the key area, acquiring an image of the key area of the target part through the image acquisition element.
10. The method according to any one of claims 1 to 3, characterized in that The method further includes: When the currently displayed mapping pattern does not match the preset recognition pattern, triggering the output of a second prompt message for prompting the target object to adjust the relative position of the target part with respect to the image acquisition element so that the mapping pattern that changes with the change of the relative position matches the preset recognition pattern.
11. The method according to claim 10, wherein When the display size of the currently displayed mapping pattern is greater than the display size of the preset recognition pattern, the second prompt message is used to prompt the target object to control the target part away from the image acquisition element.
12. The method according to claim 10, wherein When the display size of the currently displayed mapping pattern is less than the display size of the preset recognition pattern, the second prompt message is used to prompt the target object to control the target part closer to the image acquisition element.
13. The method according to claim 10, wherein When the display position of the currently displayed mapping pattern is offset relative to the preset position of the preset recognition pattern, the second prompt message is used to prompt the target object to adjust the planar position of the target part.
14. The method according to any one of claims 1 to 3, characterized in that, Before displaying the mapping pattern corresponding to the key area of the target part in response to the air acquisition operation triggered by the target part of the target object, the method further includes: Performing target detection and live body detection on the target that appears within the acquisition range of the image acquisition element; When it is detected that the target is the target part of the target object and a live body is detected, it is determined that the target part of the target object triggers the air acquisition operation.
15. The method according to any one of claims 1 to 3, characterized in that The method further includes: Sending the key area image to the server for the server to perform biometric authentication on the key area image and execute resource transfer in the case of successful biometric authentication; In the case of successful biometric authentication, receiving and displaying the resource transfer result feedback by the server.
16. A biometric authentication device, characterized in that, The device includes: A display module, configured to display a mapping pattern corresponding to the key area of the target part in response to the air acquisition operation triggered by the target part of the target object, wherein the display state of the mapping pattern is related to the relative position of the target part relative to the image acquisition element; a plurality of distance sensors are deployed in quadrants around the image acquisition element, and there are at least two distance sensors in each quadrant; The display module is further configured to, when the target part is within the acquisition range of the image acquisition element, determine the key area center according to the key area of the target part detected by the image acquisition element; obtain the distance values respectively output by at least two distance sensors within the quadrant where the key area center is located, and determine the current spatial height of the target part relative to the image acquisition element based on the at least two distance values. When the spatial height changes, the display size of the currently displayed mapping pattern changes in the opposite direction with the change of the spatial height; obtain the planar position of the key area within the acquisition range of the image acquisition element, determine the offset information of the planar position relative to the preset position within the acquisition range, perform normalization processing on the offset information according to the acquisition range to obtain an offset ratio, and determine the current display position of the mapping pattern based on the sign information carried in the offset information and the offset ratio, and adjust the display position of the currently displayed mapping pattern to the current display position; Obtain an image of the target part through the image acquisition element, perform integrity detection on the image, and determine the occlusion condition of the key area of the target part; wherein, determine the occlusion condition of the key area according to the pixel value difference between the key area and the non-key area of the target part, or analyze the image through a pre-trained classification model to determine the occlusion condition of the key area; An acquisition module, configured to, when the currently displayed mapping pattern matches the preset recognition pattern and it is determined that the detected target part meets the acquisition condition based on the occlusion condition of the key area, acquire an image of the key area of the target part through the image acquisition element; the key area image is used for biometric authentication of the target object.
17. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 15.
18. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 15.
19. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 15.
Citation Information
Patent Citations
Palm feature identification method, palm feature identification device and storage medium
CN107341473A
Identity recognition method and palmprint key point detection model training method and device
CN112132099A
Gesture control method and device, electronic equipment and storage medium
CN112947755A
Data information acquisition method
CN114332964A