Service processing methods, apparatus, device, storage medium and program product
By acquiring biometric features and location information through biometric devices and combining them with identity information, candidate business information can be intelligently screened, solving the problem of fixed functions of biometric technology in specific scenarios and realizing efficient and flexible business processing and personalized services.
Patent Information
- Application Number
- PCT/CN2024/099505
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-21
- Filing Date
- 2024-06-17
- Publication Date
- 2025-02-27
AI Technical Summary
Existing biometric technologies can only perform fixed business functions in specific application scenarios, which leads to the need for frequent reconfiguration of business servers, reducing business processing efficiency and flexibility.
By acquiring the biometric characteristics and location information of the target object through biometric identification devices, and combining them with identity information, candidate business information is intelligently filtered. Through the interaction between the terminal device and the business server, the target object is allowed to choose business functions independently, reducing dependence on the business server.
It improves the efficiency and flexibility of biometric operations, enhances the user experience, enables personalized and diverse business functions, and reduces maintenance operations.
Smart Images

Figure CN2024099505_27022025_PF_FP_ABST
Abstract
Description
Business processing method, device, equipment, storage medium and program product
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 21, 2023, with application number 2023110559232 and application name “Business processing methods, devices, equipment and storage media based on biometric identification”. Technical Field
[0002] The present application relates to the field of computer and communication technology, and in particular to a business processing method, apparatus, device, storage medium, and program product.
[0003] Background of the Invention
[0004] Compared to traditional password recognition technology, biometrics technology analyzes and identifies physiological characteristics to identify individuals, providing more convenient, faster, secure, and reliable authentication results. As a result, it is gradually being used in a variety of application scenarios. For example, in access control scenarios, the target object uses biometrics to unlock the door. In another example, in payment scenarios, the target object uses biometrics to make payments.
[0005] However, in actual applications, if the target object expects to achieve specific business functions through biometric operations, it is necessary to refer to the specific application scenario and pre-configure the relevant functions of the business server so that the business server can return business information related to the application scenario after the target object passes the biometric recognition; this limits the application and promotion of biometric operations to a certain extent, that is, in an application scenario, the business server can usually only feedback a fixed business information, thereby realizing a pre-configured fixed business function.
[0006] For example, in an access control scenario, the biometric recognition device can only receive the door opening / closing command sent by the business server to realize the access control unlocking function.
[0007] For another example, in a payment scenario, the biometric recognition device can only receive payment information fed back by the business server to implement the payment function.
[0008] It can be seen that under the relevant technology, if the target object hopes to realize other business functions in a specific application scenario, it needs to reconfigure the business server, which makes the business operation and maintenance operations cumbersome and reduces the efficiency of business processing.
[0009] Summary of the Invention
[0010] The embodiments of the present application provide a business processing method, apparatus, device, and storage medium for improving the efficiency of business processing based on biometric operations.
[0011] In one aspect, an embodiment of the present application provides a service processing method, the method comprising:
[0012] receiving object description information sent by a biometric recognition device, wherein the object description information includes: biometric characteristics and location information of a target object;
[0013] Obtaining the identity information of the target object recorded in the biometric feature, and obtaining a set of business information associated with the identity information;
[0014] Filtering at least one candidate business information that matches the location information from the business information set;
[0015] sending the at least one candidate service information to a terminal device associated with the identity information, wherein the terminal device determines at least one target service information from the at least one candidate service information in response to a selection operation triggered by the target object; and
[0016] Receive the at least one target service information returned by the terminal device, and process the service corresponding to each target service information in the at least one target service information.
[0017] On the other hand, an embodiment of the present application provides a service processing method, the method comprising:
[0018] receiving at least one piece of candidate service information sent by a service server, where the at least one piece of candidate service information is determined by the service server based on biometrics and location information of a target object;
[0019] In response to a selection operation triggered by the target object, determining at least one target business information from the at least one candidate business information; and,
[0020] The at least one target service information is sent to the service server, so that the service server processes the service corresponding to each target service information in the at least one target service information.
[0021] On the other hand, an embodiment of the present application provides a service processing method, the method comprising:
[0022] Obtaining object description information of a target object, wherein the object description information includes: biometric characteristics and location information of the target object;
[0023] The object description information is sent to a business server so that the business server performs the following operations: based on the biometric feature and the location information, obtain at least one candidate business information, send the at least one candidate business information to a terminal device, and perform business processing based on at least one target business information returned by the terminal device; each target business information is determined in the at least one candidate business information by the terminal device in response to a selection operation triggered by the target object.
[0024] On the other hand, an embodiment of the present application provides a service processing device, including:
[0025] A receiving module, configured to receive object description information sent by a biometric recognition device, wherein the object description information includes: biometric characteristics and location information of a target object;
[0026] An acquisition module, configured to acquire the identity information of the target object recorded in the biometric feature, and acquire a set of business information associated with the identity information;
[0027] A matching module, configured to filter out at least one candidate business information that matches the location information from the business information set;
[0028] a sending module, configured to send the at least one candidate business information to a terminal device associated with the identity information, wherein the terminal device determines at least one target business information from the at least one candidate business information in response to a selection operation triggered by the target object; and
[0029] The receiving module is further configured to receive the at least one target service information returned by the terminal device, and process the service corresponding to each target service information in the at least one target service information.
[0030] On the other hand, an embodiment of the present application provides a service processing device, including:
[0031] a receiving module, configured to receive at least one candidate service information sent by a service server, wherein the at least one candidate service information is determined by the service server based on the biometric characteristics and location information of the target object;
[0032] a determination module, configured to determine at least one target business information from the at least one candidate business information in response to a selection operation triggered by the target object; and
[0033] The sending module is configured to send the at least one target service information to the service server, so that the service server processes the service corresponding to each target service information in the at least one target service information.
[0034] On the other hand, an embodiment of the present application provides a service processing device, including:
[0035] An acquisition module is used to acquire object description information of a target object, wherein the object description information includes: biometric features and location information of the target object;
[0036] A sending module is used to send the object description information to a business server so that the business server performs the following operations: based on the biometric characteristics and the location information, obtain at least one candidate business information, send the at least one candidate business information to a terminal device, and perform business processing based on at least one target business information returned by the terminal device; each target business information is determined by the terminal device in the at least one candidate business information in response to a selection operation triggered by the target object.
[0037] On the other hand, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned business processing method when executing the program.
[0038] On the other hand, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a computer device. When the program runs on the computer device, the computer device executes the steps of the above-mentioned business processing method.
[0039] On the other hand, an embodiment of the present application provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer device, the computer device executes the steps of the above-mentioned business processing method.
[0040] BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0042] FIG1 is a schematic diagram of an application scenario provided by an embodiment of the present application;
[0043] FIG2 is a system architecture diagram of a business processing system provided in an embodiment of the present application;
[0044] FIG3 is a schematic diagram of an application in a transportation scenario provided by an embodiment of the present application;
[0045] FIG4 is a schematic diagram of an application in a vehicle-mounted scenario provided by an embodiment of the present application;
[0046] FIG5 is a schematic diagram of an interactive process of a business processing method based on biometric identification provided in an embodiment of the present application;
[0047] FIG6 is a schematic diagram of obtaining object description information provided in an embodiment of the present application;
[0048] FIG7 is a schematic diagram of generating a biometric feature according to an embodiment of the present application;
[0049] FIG8 is a schematic diagram of a model training of an identity recognition model provided in an embodiment of the present application;
[0050] FIG9 is a schematic diagram of matching a biometric feature with a candidate feature according to an embodiment of the present application;
[0051] FIG10 is a schematic diagram of a business information set provided in an embodiment of the present application;
[0052] FIG11 is a schematic diagram of matching real-time location information and scene types provided in an embodiment of the present application;
[0053] FIG12 is a schematic diagram of third-party platforms associated with four application scenarios provided in an embodiment of the present application;
[0054] FIG13 is a schematic diagram of filtering reference service information provided in an embodiment of the present application;
[0055] FIG14 is a schematic diagram of an object selection operation provided in an embodiment of the present application;
[0056] FIG15 is a schematic diagram of the structure of a service processing device provided in an embodiment of the present application;
[0057] FIG16 is a schematic diagram of the structure of a service processing device provided in an embodiment of the present application;
[0058] FIG17 is a schematic diagram of the structure of a service processing device provided in an embodiment of the present application;
[0059] FIG18 is a schematic diagram of the structure of a computer device provided in an embodiment of the present application;
[0060] FIG19 is a schematic structural diagram of another computer device provided in an embodiment of the present application.
[0061] Implementation Method
[0062] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be combined with each other in any way. In addition, although a logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that here.
[0063] The terms "first" and "second" in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any of its variations are intended to cover non-exclusive protection. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in this application can mean at least two, for example, two, three or more, and the embodiments of this application are not limited thereto.
[0064] The term "and / or" in the embodiments of this application is simply a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this document generally indicates that the related objects are in an "or" relationship.
[0065] In the technical solutions of this application, the collection, dissemination, and use of data are in compliance with the requirements of relevant national laws and regulations. It is understood that in the following specific implementation methods of this application, when user-related data and the collection of related data are involved, when the various embodiments of this application are applied to specific products or technologies, relevant licenses or consents need to be obtained, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions.
[0066] To facilitate understanding of the technical solutions provided in the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:
[0067] Biometric technology: A technology that confirms or verifies the identity of a target object by analyzing and identifying an individual's biological characteristics. Common biometric characteristics include fingerprints, palms, irises, voices, faces, etc.
[0068] Face recognition: A biometric technology that performs identity verification and identification by analyzing and identifying facial features of the human body, such as facial contours, eyes, nose, mouth and other biometric features.
[0069] Palm swipe recognition: A biometric technology that performs identity verification and identification by analyzing and identifying biometric features such as palm prints and palm veins.
[0070] Palm veins: Unique features inside the palm that can be used for palm recognition, such as the density, shape, and size of the veins on the palm.
[0071] Palm prints: The surface of the palm has unique features that can be used as features for palm recognition, such as the main lines from the end of the fingers to the wrist, wrinkles, fine textures, ridge ends, bifurcation points and other texture patterns.
[0072] 3D camera: A camera that captures three-dimensional images, commonly used in biometric applications such as facial recognition and palm scanning. Compared to traditional cameras, 3D cameras incorporate relevant hardware and software for liveness detection, such as depth cameras and infrared cameras. A 3D camera captures images of an object from different angles and distances, then uses built-in sensors and algorithms to calculate the object's three-dimensional shape and position, resulting in a more realistic, three-dimensional image.
[0073] Liveness detection: A method used to determine the true physiological characteristics of a target object during identity verification operations. For example, in a palm swipe recognition operation, it is necessary to verify whether the palm in the captured palm image has biometric characteristics. For example, image analysis technology can be used to determine whether the palm has biometric characteristics such as hemoglobin.
[0074] Structured Query Language (SQL): An embedded relational database management system that is a lightweight, self-contained, zero-configuration database engine. SQL is designed as a library that can be statically or dynamically integrated into applications without the need for a separate database server, making it well-suited for the data storage needs of embedded systems, mobile applications, and small applications.
[0075] Point of Interest (POI): represents a point of interest or location of interest in a geographic information system. It is commonly used in positioning applications to identify specific geographic locations on a map, such as stores, airports, restaurants, parks, etc., thereby providing users with corresponding location-related information and services.
[0076] Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to achieve the best results.
[0077] Machine Learning (ML): studies how computers simulate or implement human learning behavior to acquire new knowledge or skills and reorganize existing knowledge structures to continuously improve their performance. Machine learning is the core of artificial intelligence, and usually includes artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and learning by teaching. In the embodiment of the present application, a deep learning method is used to train an identity recognition model, and then the identity recognition model is used to identify the identity of the corresponding target object based on the biometric features sent by the biometric recognition device, so as to obtain the identity information of the target object through the identity recognition.
[0078] Intelligent Traffic System (ITS), also known as Intelligent Transportation System (ITS), is an integrated application of information technology, computer technology, data communication technology, sensor technology, electronic control technology, automatic control theory, operations research, artificial intelligence, etc. to transportation, service control and vehicle manufacturing, strengthening the connection between vehicles, roads and users, thereby forming a comprehensive transportation system that ensures safety, improves efficiency, improves the environment and saves energy.
[0079] Intelligent Vehicle Infrastructure Cooperative Systems (IVICS), abbreviated as IVICS, adopts advanced wireless communication and next-generation Internet technologies to implement all-round dynamic real-time information interaction between vehicles and roads. It also conducts active vehicle safety control and road cooperative management based on the collection and integration of dynamic traffic information in all time and space, fully realizing the effective coordination between people, vehicles and roads, ensuring traffic safety, and improving traffic efficiency, thus forming a safe, efficient and environmentally friendly road traffic system.
[0080] The following is a brief introduction to the design concept of the embodiment of this application:
[0081] In practice, biometrics are increasingly being used for personal authentication, enabling the provision of corresponding business functions for authenticated users. Compared to traditional password recognition, biometrics, which analyze and identify physiological characteristics, can provide authentication results more conveniently, quickly, securely, and reliably. Consequently, they are increasingly being adopted in a wide range of scenarios. For example, in access control scenarios, biometrics can unlock access doors. Another example is payment methods, where biometrics can be used to facilitate payment.
[0082] However, in practice, if the target user wishes to use biometrics to achieve specific business functions, they must refer to the specific application scenario and pre-configure the relevant functions on the business server. This ensures that after the target user passes biometrics, the business server can return business information related to the application scenario. This approach limits the application and promotion of biometrics operations to a certain extent. In other words, in a specific application scenario, the business server can usually only return a fixed type of business information, thereby achieving a pre-configured fixed business function.
[0083] For example, in an access control scenario, when the target object completes biometric operations such as face recognition and / or palm recognition through a biometric device and successfully passes identity authentication, the biometric device will receive a door opening command issued by the business server and provide access control unlocking services for the target object.
[0084] For example, in a payment scenario, when the target object completes biometric operations such as face recognition and / or palm recognition through a biometric device and successfully passes identity authentication, the biometric device will receive payment information fed back by the business server and provide online payment services for the target object.
[0085] As can be seen from the above, in related technologies, if the target object hopes to implement other business functions in a specific application scenario, it needs to reconfigure the business server, which makes business operations and maintenance cumbersome and reduces business processing efficiency. Therefore, how to improve the efficiency of implementing business functions based on biometric operations is currently an urgent problem to be solved.
[0086] In view of the above problems, a business processing method based on biometrics is proposed in an embodiment of the present application. In this method, the business server intelligently filters out at least one matching candidate business information from the business information set based on the object description information sent by the biometric device, combined with the identity information of the target object recorded in the biometric feature, and the location information of the target object. This makes it possible for the realization of multiple business functions in specific application scenarios no longer rely on reconfiguration of the business server, solving the technical defect of the related technology of only sending a fixed type of business information in a specific scenario, reducing business operation and maintenance operations, and improving the efficiency of business processing.
[0087] On the other hand, the business server sends at least one candidate business information to the terminal device associated with the identity information, so that the target object can independently select the required target business information and perform corresponding business processing for it, thereby providing personalized multiple business services for different target objects, meeting the actual business needs of the target object to achieve multiple business functions through biometric operations, improving the flexibility and diversity of business processing, and improving the user experience while improving business processing efficiency.
[0088] To further improve business processing efficiency and user experience, embodiments of the present application can also dynamically screen candidate business information that meets preset matching criteria based on the scenario types corresponding to different location information, combined with the scenario matching degree between each original business information in the business information set and different scenario types. The business server intelligently screens candidate business information that meets the preset matching criteria, reducing the process of manual intervention, improving the efficiency and accuracy of business processing, and providing target objects with business functions that are more closely related to their scenarios, allowing them to enjoy more personalized business services that are closer to their actual needs, thereby improving the user experience.
[0089] In order to improve the efficiency of business processing and information security, the embodiments of the present application can also perform identity recognition processing or feature matching processing on the acquired biometric features, that is, further identity authentication and identification are performed after obtaining the biometric features of the target object, including but not limited to identity recognition of the biometric features to obtain an identity identifier, or matching the biometric features with candidate features, so as to more accurately and quickly obtain the identity information corresponding to the biometric features, prevent the occurrence of false identities or misidentifications, improve the reliability and accuracy of biometric recognition, and enhance the information security of business processing based on biometric recognition as much as possible.
[0090] To further improve the information security and efficiency of business processing, embodiments of the present application can perform identity recognition processing on biometrics using a trained identity recognition model. The identity recognition model learns the association between different biometrics and identity identifiers using a large amount of sample data, enabling it to more accurately map input biometrics to corresponding identity identifiers, thereby obtaining highly accurate identity recognition results and improving the information security of biometric-based business processing. Furthermore, through iterative training, the identity recognition model gradually optimizes its own parameter settings, enabling the identity recognition model to more accurately and quickly predict identity identifiers when performing identity recognition processing, improving the model's recognition efficiency and enabling rapid execution of identity recognition processing in scenarios with high real-time requirements, thereby further improving the efficiency of biometric-based business processing.
[0091] In order to further improve the information security of business processing, in the embodiment of the present application, the business server can perform compliance verification on the reference business information through a preset information filtering strategy before saving the reference business information to the business information collection, thereby ensuring the legality and reliability of the new business information saved, preventing non-compliant or false business information from being added to the business information collection, and ensuring the information security of the business information obtained by the target object, thereby improving the information security of business processing.
[0092] In order to further improve the user experience, the embodiment of the present application can obtain reference business information from various third-party platforms through the terminal device to update the business information set, so that the business information set covers a wider range of business fields and service content, and increases the diversity and richness of business information, thereby providing the target object with more business options that meet their personalized needs, improving the personalization of business functions and user experience. In addition, the terminal device can accurately obtain the scene type corresponding to the specific location of the target object by matching the real-time location information of the target object with the preset location information of the corresponding preset scene type, ensuring that the reference business information subsequently obtained is highly matched with the current scene of the target object, avoiding irrelevant or redundant business information from being added to the business information set, thereby providing the target object with business functions that are closely related to the scene in which it is located, and improving the user experience.
[0093] To further improve the information security of business processing, the embodiments of the present application can add liveness detection for the target object when obtaining the biometric image of the target object, ensuring that the biometric is that of the real target object and not a forgery, preventing the illegal use of false biometrics such as photos, and improving the accuracy and reliability of biometric identification. In addition, for palm swipe recognition operations, the embodiments of the present application can perform feature fusion processing on the extracted palm print features and palm vein features of the target object to obtain biometric features. Compared with single biometric recognition, multi-factor fusion recognition such as palm print and palm vein fusion recognition has higher recognition accuracy and robustness, further improving the accuracy and reliability of biometric recognition, reducing the false recognition rate, and thus improving the information security of business processing based on biometric recognition.
[0094] After introducing the design concepts of the embodiments of the present application, the following briefly introduces the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present application and are not limiting. In the specific implementation process, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.
[0095] The solutions provided by the embodiments of this application can be applied to any business processing scenario involving identity verification through biometric operations, including but not limited to cloud technology, artificial intelligence, smart transportation, assisted driving, etc. For example, biometric operations such as palm scanning, face scanning, and pupil verification can be used to implement online payment, information display, unlocking gates or access control, etc. As shown in Figure 1, an application scenario provided by the embodiments of this application can include a terminal device 101, a biometric identification device 102, and a business server 103.
[0096] The terminal device 101 refers to any device that is connected to the server and provides business services to the target object. For example, it can be a mobile phone, a tablet computer (PAD), a laptop computer, a desktop computer, a smart TV, an intelligent vehicle-mounted device, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, and an intelligent wearable device. The terminal device 101 can be installed with a business processing application corresponding to the business processing system. The business processing application has the function of configuring business information related to identity information for the target object, configuring preset location information and its corresponding preset scene type, and receiving and viewing the business processing results returned by the server. For example, it can be a proprietary application corresponding to the business processing system, or it can be an instant messaging application, a short video application, a news application, a shopping application, and other applications with equivalent functions of the business processing system. The embodiment of the present application does not limit this. The application involved in the embodiment of the present application can be a software client, or it can be a client such as a web page or a small program, and the specific type of the client is not limited.
[0097] The biometric recognition device 102 may be, but is not limited to, a handheld gate scanner, a cash register, a tablet computer, a smartphone, a laptop computer, a desktop computer, a smart home appliance, an intelligent voice interaction device, or an intelligent vehicle-mounted device. During actual business processing, the biometric recognition device is used to capture a biometric image of a target object, extract biometric features corresponding to the biometric image, and obtain the target object's location information, thereby obtaining object description information of the target object. The biometric recognition device 102 may include an image acquisition device for capturing biometric images of the target object, such as a palm image or facial image. The image acquisition device may be a 3D camera. It may also include a communication module that matches the communication module in the service server 103, thereby establishing a communication link with the service server 103 and transmitting object description information to the service server.
[0098] The business server 103 is the background processing server corresponding to the business processing system, which provides corresponding business functions for business processing applications. For example, in access control and online payment scenarios, it issues access control instructions and payment instructions, or returns corresponding business information to the terminal device.
[0099] For example, the server 103 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms, but is not limited to these. In addition, the business server 103 may include at least one processor 1031, a memory 1032, and an I / O interface 1033 (not shown) for interacting with a terminal.
[0100] In addition, the business server 103 can also be configured with a business database 1034 (not shown in the figure), which can be used to store the identity information of the target object, the business information set associated with the identity information of the target object, and the device identification, candidate features and associated identity information of the terminal device.
[0101] Among them, the memory 1032 of the server 103 can also store program instructions of the business processing method provided in the embodiment of the present application. When these program instructions are executed by the processor 1031, they can be used to implement the steps of the business processing method provided in the embodiment of the present application to perform corresponding business processing.
[0102] The terminal device 101, the biometric recognition device 102, and the service server 103 can be directly or indirectly connected to each other through one or more networks 104. The network 104 can be a wired network or a wireless network. For example, the wireless network can be a mobile cellular network or a Wireless Fidelity (WIFI) network. Of course, other possible networks are also possible, and the embodiments of the present invention are not limited thereto.
[0103] It should be noted that in the embodiment of the present application, the number of terminal devices 101, biometric recognition devices 102 and business servers 103 can be one or more, that is, there is no limit on the number of terminal devices 101, biometric recognition devices 102 or business servers 103.
[0104] FIG2 is an architecture diagram of a business processing system provided in an embodiment of the present application. The architecture may include the following parts:
[0105] (1) Terminal device 201:
[0106] This corresponds to terminal device 101 in Figure 1 , and is used to register the target's identity information, configure business information related to that identity information, configure a preset location and its corresponding preset scenario type, and receive business processing results returned by the server. Terminal device 201 runs a business processing app 2011. After a user logs into business processing app 2011, the app enters a user-related login state. Terminal device 201 also includes a communication module 2012 for communicating with business service end 203. Communication module 2012 may be, for example, a Bluetooth module or other possible communication modules.
[0107] The business processing app 2011 primarily hosts a business information customization module 2011-1, which primarily provides a business information binding function. Specifically, the target subject's identity information and associated business information set stored by the business server 203 can be manually configured through the business information customization module 2011-1. For example, the target subject can upload a photo album 2013 or a photo taken on-site, and use the information obtained by parsing the barcode (one-dimensional code) or two-dimensional code in the image as the required business information to be configured. This information is then sent to the business server 203, which, upon review and approval, associates the business information with the target subject's identity information.
[0108] (2) Biometric identification terminal 202:
[0109] That is, corresponding to the biometric recognition device 102 in Figure 1 above, the biometric recognition terminal 202 has a communication module 2022 that matches the business service terminal 203. The biometric recognition terminal 202 also has a biometric recognition app 2021 installed, which can call the communication module 2023 to establish a communication connection with the business service terminal 203, thereby sending object description information to the business service terminal 203 when the target object performs a biometric recognition operation. Among them, the biometric recognition app 2021 may include the following modules:
[0110] Biometrics module 2021-1 is used to call image acquisition module 2023 to collect biometric image data of the target subject when a biometrics operation is performed on the target subject. The module can also perform optimization and liveness detection on the collected biometric image data. For example, the module can comprehensively evaluate and select the optimal biometric image based on factors such as the size, angle, image contrast, brightness, and clarity of the biometric features in the biometric image.
[0111] The location acquisition module 2021 - 2 is used to obtain the current location information of the target object when the target object performs a biometric recognition operation, and send it to the business service end through the communication module 2022 .
[0112] (3) Business server 203:
[0113] That is, it corresponds to the business server 103 in FIG1 above, providing background services of the business processing system, including regular business services 2034, biometric services 2032 for biometric APPs, and business information review services 2033 for business processing APPs, wherein,
[0114] The biometric identification service 2032 is used to receive the biometric characteristics and location information of the target object sent by the biometric identification terminal 202, and perform identity recognition and verification on the target object.
[0115] The business information review service 2033 is used to receive the business information uploaded by the terminal device 201 and review the information according to the preset information filtering strategy. When it is determined that the business information has passed the review, the business information is associated with the identity information of the target object.
[0116] In addition, the business service end is also configured with a related database 2031 for storing information related to business processing, such as the identity information of the target object, the business information set associated with the identity information of the target object, the device identification of the terminal device associated with the identity information of different target objects, candidate features and associated identity information, etc. Among them, this information can be used, for example, in a lightweight database such as structured query SQL. SQL is a relational database management system that complies with ACID (i.e., the four basic elements for the correct execution of database transactions, namely atomicity (atomicity, or indivisibility), consistency (consistency), isolation (isolation, also known as independence), and durability). Therefore, other or other types of databases that can also achieve the corresponding database functions are applicable.
[0117] Of course, in addition to the above functions, other possible functions may also be included, and the embodiments of the present application do not limit this.
[0118] In practical applications, the biometric-based business processing method in the embodiment of the present application can be applied to transportation scenarios 1001, parking scenarios 1003, access control scenarios, check-in scenarios, shopping scenarios 1004, etc.
[0119] For example, referring to Figure 3, in the transportation scenario 1001, taking the face-scanning and hand-scanning gate machine 301 in the airport, high-speed rail station, and subway station as an example of a biometric identification device, the face-scanning and hand-scanning gate machine 301 includes a palm recognizer 3011, a face recognizer 3012, and a screen for displaying an application interface 3013 including biometric identification results.
[0120] When a passenger passes through the face-scanning and hand-held gate machine 301, the passenger can face the palm facing the palm recognizer 3011 or the face facing the face recognizer 3012. The face-scanning and hand-held gate machine 301 collects the passenger's palm image, face image and other biometric images, and extracts the passenger's biometric features and its own location information based on the biometric images, and sends them to the relevant business server 302.
[0121] The business server 302 uses the business processing method provided in the embodiment of the present application to obtain a business information set associated with the passenger's identity information from its business database based on the biometric characteristics of the passenger sent by the face-scanning and palm-swipe gate machine 301, and summarizes and filters out candidate business information that matches the passenger's location information such as the airport, high-speed rail station, and subway station from the business information set, and sends it to the passenger's corresponding terminal device 303, such as a smartphone.
[0122] For example, based on the passenger's current location information at a certain airport, multiple candidate business information such as the passenger's boarding pass at the airport, booked flights, hotels, car rentals, and other itinerary information, and baggage check-in information are filtered out; for another example, based on the passenger's location information at a certain subway station, multiple candidate business information such as entertainment recommendations such as shopping malls and tourist attractions near the station, the passenger's transportation card balance, and historical travel records are filtered out.
[0123] Passengers can use their terminal devices 303 to select the target business information they need from multiple candidate business information, so that the business server 302 performs corresponding business processing according to the target business information and provides the required business service functions for the passengers.
[0124] For another example, referring to Figure 4, in a vehicle-mounted scenario, the vehicle terminal 401 includes a vehicle-mounted camera 4011 and a screen for displaying an application interface 4012. The vehicle-mounted camera 4011 collects the driver's facial image, and extracts his facial biometric features based on the facial image, which are sent to the relevant business server 402 together with the vehicle's current location information.
[0125] Based on the service processing method provided in the embodiments of the present application, the service server 402 authenticates the driver based on the received facial biometric features. When the driver passes the authentication, the service server 402 retrieves the service information set associated with the driver's identity information from the service database, aggregates and filters the service information set to select candidate service information that matches the current location scenario, and sends it to the corresponding vehicle-mounted terminal 401, which then displays it directly to the driver through the application interface 4012 on the screen, or sends it to the driver's corresponding mobile phone or other terminal device (not shown in the figure).
[0126] For example, based on the vehicle's current location information, the service server 402 can retrieve information about the vehicle's current status, navigation route, real-time traffic conditions, and nearby gas stations and service areas. If the vehicle is currently near a parking lot, the service server can further filter out candidate service information, such as parking space availability, parking fee information, and parking route planning, for the driver to select. The driver can then select the target service information they require, and the service server 402 will execute the corresponding service processing to provide the driver with the required service functions. For example, if the driver selects parking route planning, the service server can list the number of available parking spaces, the distance to each space, and provide relevant parking recommendations based on the driver's parking preferences or service information such as the vehicle's fuel level.
[0127] For another example, in the conference check-in scene 1002, a biometric recognition device including a face and palm recognition module is provided. After arriving at the conference site, participants can check in for the conference by face or palm recognition. The biometric recognition device collects biometric images such as the participant's face image or palm image, extracts the corresponding biometric features and sends them together with the location information to the business server. The business server uses the business processing method provided in the embodiment of the present application, combined with the biometric features and location information, to authenticate and identify each participant, and determines that the participant is eligible to attend the conference and has arrived at the conference site. In addition, based on the participant's location information (i.e., conference venue) and identity information, candidate business information that the participant may be interested in is screened from the business database, such as meeting arrangements, participant account information, conference maps and navigation, communication forums, exhibitor information, conference material downloads, etc., and sent to the participant's terminal device, such as a smartphone. The participant uses the terminal device to view the received candidate business information and select the target business information according to their needs, such as selecting an account to log in to the meeting, viewing the meeting schedule, meeting theme and speakers, logging into the conference communication forum, etc. After the participant selects the target business information, the business server performs the corresponding business processing to provide the required business services to the participant. For example, it can add selected meeting agenda items to attendees' personal schedules, provide navigation to relevant meeting rooms, or provide channels for interacting with speakers.
[0128] In addition, it is understandable that in the specific implementation of this application, when data related to the biological images, biological characteristics, etc. of the target object are involved, when the embodiments involved in this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.
[0129] It should be noted that the method provided in the embodiments of the present application is not limited to the application scenario shown in Figure 4, but can also be used in other possible application scenarios, and the embodiments of the present application are not limiting. The components and structures shown in Figure 4 are merely exemplary and non-restrictive. In actual scenarios, other components and structures may be provided as needed. The functions that can be implemented by the device for the application scenario shown in Figure 4 will be described in the subsequent method embodiments, and will not be elaborated on here.
[0130] The following describes the business processing method provided by the exemplary embodiment of the present application in combination with the application scenarios and system architecture described above, with reference to the accompanying drawings. It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principles of the present application, and the implementation of the present application is not limited in this respect.
[0131] 5 , which is a flow diagram of the business processing method provided in an embodiment of the present application, the flow of the method is described as follows:
[0132] Step 501: The biometric recognition device obtains object description information of the target object.
[0133] Step 502: The biometric recognition device sends the object description information to the business server corresponding to the business processing system.
[0134] In this embodiment of the present application, the object description information of the target object includes the target object's biometric characteristics and location information. The biometric characteristics are used to uniquely identify and recognize the identity information of the target object, and the location information is used to indicate the target object's current geographical location or spatial environment. The biometric recognition device identifies and obtains the target object's biometric characteristics and location information, and sends them to the corresponding service server, thereby implementing subsequent service processing.
[0135] In one possible embodiment, the biometric recognition device may obtain a biometric image of the target object and extract biometric features contained in the biometric image in response to a biometric operation triggered by the target object, and obtain object description information of the target object based on the current location information and biometric features of the target object.
[0136] Specifically, biometric operations include but are not limited to face recognition operations, palm swipe recognition operations, pupil recognition operations, etc., and corresponding biometric devices may include but are not limited to facial recognition devices, palm print recognition devices, pupil recognition devices, etc.
[0137] As shown in Figure 6, when a target object 601 aligns its face, palm, or eyes with a biometric recognition device 602, the biometric recognition device 602 can use its own image acquisition device to obtain biometric images 603 of the target object, such as facial images, palm images, and eye images, and extract biometric features 6041 of the target object, such as facial features, palm prints, and pupils. Furthermore, the biometric recognition device is equipped with a positioning device such as a Global Positioning System (GPS), Wi-Fi positioning, or Bluetooth positioning to obtain the target object's coordinates, area identifier, or other location information 6042 with detailed location descriptions. This embodiment of the present application does not impose specific limitations on this. Biometric features 6041 and location information 6042 together constitute object description information 604.
[0138] In one possible embodiment, the biometric features of a biological image extracted by a biometric recognition device may refer to the biometric features obtained by extracting features from the biological image, which may be the biological image itself, for example, the numerical information of each color channel of a biological image such as a face, palm, or finger, or the grayscale, brightness, and other information of the biological image; or, it may be the features obtained by processing the biological image using an image processing method, for example, binarizing the image; or, it may be the image features obtained by extracting features from the biological image using an artificial neural network model learned using a deep learning method.
[0139] In one possible implementation, as shown in FIG7 , using a palm swipe recognition operation as an example of a biometric recognition operation triggered by a target object, the biometric recognition device may, in response to the palm swipe recognition operation triggered by the target object, collect a palm image set of the target object, including a palm print image 701 and a palm vein image 702, to extract biometric features therefrom. Furthermore, liveness detection 703 is performed on the target object using the palm vein image 702 in the palm image set, ensuring that the collected palm image set is of the authentic target object and not an illegal biometric recognition operation using false biometric features such as forged photos, thereby improving the accuracy and reliability of biometric recognition.
[0140] After the target object passes the liveness detection, the biometric recognition device can extract the palm print feature 704 of the palm print image and the palm vein feature 705 of the palm vein image in the palm image set, and merge the palm print feature 704 and the palm vein feature 705, that is, feature fusion processing, to obtain the biometric feature 706 of the target object.
[0141] Compared with single biometric recognition, palm print and palm vein multi-factor fusion recognition has higher recognition accuracy and robustness, further improving the accuracy and reliability of biometric recognition, reducing the false recognition rate, and thus improving the information security of biometric-based business processing.
[0142] Specifically, palm swipe refers to technology that uses multimedia information from your palm to exchange for identity information. When performing a service that requires identity verification, a palm swipe operation refers to the action performed by the target user to provide the required information for authentication.
[0143] Palm swipe recognition typically involves the subject placing their palm within the biometric image capture range of a biometric recognition device with palm swipe functionality, allowing the device to collect a palm image set for subsequent identification. This palm image set may include, but is not limited to, palm vein images, palm print images, and palm RGB images. A palm vein image may be a palm vein image or a dorsal vein image; a palm print image may be a palm print image or a dorsal print image; and a palm RGB image may be a palm RGB image or a dorsal RGB image.
[0144] In one possible implementation, the image acquisition device in the biometric recognition device may be configured with a 3D camera for capturing a 3D biometric image of the target object. The 3D camera primarily consists of a color sensor (i.e., an RGB sensor) and an infrared sensor (i.e., an IR sensor). The color sensor is used to capture color images, while the infrared sensor is used to capture infrared images and is used for liveness detection, i.e., determining whether the target object is alive.
[0145] Taking palm swiping recognition operation as an example, the biometric recognition device can use infrared sensors to collect infrared images of the target object's palm veins and perform liveness detection. By analyzing characteristics such as blood flow in the palm vein infrared image, it determines whether the target object is a real living person. If the target object passes the liveness detection, subsequent processing will continue; otherwise, the palm swiping recognition operation of the target object will be rejected.
[0146] After the target object passes the liveness detection, the biometric recognition device uses image processing algorithms to identify and extract palm print features in the palm print image, such as the palm print lines, bifurcation points, etc., and through infrared image processing and analysis of the characteristics of the palm vein image, such as the distribution and shape of the palm blood vessel network.
[0147] After acquiring the target subject's palm print and palm vein features, the biometric recognition device can fuse (or merge) these features. This fusion process can employ various algorithms, such as feature-level fusion and decision-level fusion, to combine the two biometric features to generate a fused biometric signature for subsequent identity verification and service processing, thereby achieving accurate biometric recognition and personalized services.
[0148] Step 503: The service server obtains the identity information of the target object recorded in the biometric feature.
[0149] In an embodiment of the present application, the business server obtains the identity information recorded in the biometric feature through the object description information sent by the biometric recognition device, and obtains a set of business information related to the identity information from a database or other resources.
[0150] In one possible implementation, in order to improve the efficiency and security of business processing, the embodiment of the present application may perform identity recognition processing on the biometric characteristics to obtain the identity identifier corresponding to the biometric characteristics, and then determine the identity information associated with the identity identifier.
[0151] In this way, the identity information of the corresponding identity identifier can be obtained quickly and accurately, preventing the occurrence of false identities or misidentifications, improving the reliability and accuracy of biometrics, and the information security of business processing based on biometrics.
[0152] Specifically, an identity identifier represents an identity of different target objects in the business processing system. For example, it can be indicated by a unique identifier such as an account ID or ID number. Identity recognition processing refers to the process of confirming an identity identifier that matches the target object's biometric characteristics by analyzing, verifying, and matching the target object's biometric characteristics. Through identity recognition processing, the business server can link abstract biometric characteristics with specific identity identifiers, thereby obtaining the corresponding identity information from its database or other resources based on the association between the identity identifier and the identity information. For example, the identity of the target object can be identified and verified by analyzing and matching key feature points such as the position of the eyes, nose, and mouth in a facial image, the lines, details, and feature points of a fingerprint, the uniqueness of the iris texture, the sound characteristics and spectrum of speech, the lines and feature points of the palm, and the vein images of the fingers, palms, and other parts.
[0153] In a possible implementation, in order to improve the efficiency of business processing, identity recognition processing may be performed using a trained identity recognition model.
[0154] In the embodiments of the present application, the identification model uses a deep learning method based on a multi-layered convolutional neural network (CNN) structure to learn and distinguish subtle feature differences between target objects in large amounts of data, thereby achieving higher accuracy identification. For example, the identification model is MobileNets, ResNet, DenseNet, etc.
[0155] The following describes the process of training the identity recognition model using sample data, which includes the following steps:
[0156] Obtain sample data, wherein the sample data includes: multiple sample identifications and sample biometric features corresponding to each of the multiple sample identifications. Based on the sample data, iteratively train the initial identity recognition model to be trained to obtain a trained identity recognition model, wherein each iterative training process includes the following operations:
[0157] The initial identity recognition model is used to predict the sample biometrics input in this iteration to obtain the predicted identity of the sample biometrics;
[0158] Determine the difference between the sample identity identifier corresponding to the sample biometric and the predicted identity identifier as a loss value;
[0159] Based on the loss value, the parameters of the initial identity recognition model are adjusted.
[0160] Specifically, taking the classification model as an example of the identity recognition model, as shown in Figure 8, the embodiment of the present application uses a large-scale biometric sample set 801 to train the initial identity recognition model 802, so that the initial identity recognition model 802 can learn richer and more generalized feature representations, and finally obtain the target identity recognition model 803.
[0161] By pre-labeling multiple sample biometrics in the biometric sample set 801 with labels of their corresponding sample identities, the initial identity recognition model 802 is then trained for binary classification using the labeled sample data.
[0162] During the training process, it is necessary to set some key parameters. The quality of these parameter settings directly affects the performance of the model. In the embodiment of the present application, a grid search method can be used to obtain the values of key parameters. During model training, regularization term coefficients are set to prevent overfitting, thereby improving the generalization ability of the model. For example, these parameters include the weights used in the convolutional layer, the fully connected layer, and the softmax layer.
[0163] During the training process, the loss value is used to characterize the difference between the sample identity identifier corresponding to the sample biometric and the predicted identity identifier. Model training is to minimize the difference between the sample identity identifier and the predicted identity identifier. Determine whether the identity recognition model has converged based on the loss value. When it is determined that the identity recognition model has not converged, the model parameters of the identity recognition model are adjusted based on the loss value, and the next round of training is carried out using the identity recognition model after parameter adjustment. When it is determined that the identity recognition model has converged, the training is terminated and the trained identity recognition model is output. Of course, in the embodiment of the present application, the training can also be terminated and the trained identity recognition model can be output when the number of iterative pre-training reaches a preset number. This application does not make specific limitations on this.
[0164] In one possible implementation, as shown in FIG9 , to improve the efficiency and security of business processing, this embodiment of the present application may further perform feature matching between at least one pre-stored candidate feature 901 and a target object's biometric feature 903. Identity information 902 associated with the candidate feature upon a successful match is used as the target object's identity information 904.
[0165] Specifically, upon receiving the biometric characteristics of a target subject from a biometric recognition device, the service server matches the biometric characteristics with pre-stored candidate characteristics, including but not limited to using various feature matching algorithms such as feature vector similarity calculation and pattern matching, to assess the similarity between the biometric characteristics and the candidate characteristics. If a match is successful, meaning the similarity between the biometric characteristics and a candidate characteristic exceeds a preset threshold, the service server uses the identity information of the candidate characteristic as the identity information of the target subject.
[0166] Specifically, the target subject can pre-register their biometrics to the service server. The service server then associates the biometrics uploaded by each target subject with their identity information and stores them in its database. For example, each candidate feature could be a palm feature containing palm print and palm vein information corresponding to each target subject, while the corresponding identity information could include the target subject's name, ID number, etc.
[0167] Step 504: The service server obtains a service information set associated with the identity information.
[0168] In an embodiment of the present application, when the business server obtains the identity information of the target object through biometrics, it can obtain the business information set associated with the identity information based on the mapping relationship between the identity information and the business information set.
[0169] In one possible implementation, the business information collection may include but is not limited to business information such as historical business records, business preference settings, function configurations or function options related to the target object in various business scenarios, and different business information can be used to provide the target object with different business functions in corresponding business scenarios.
[0170] Specifically, referring to Figure 10, taking the four business scenarios of transportation scenario 1001, conference check-in scenario 1002, parking scenario 1003 and shopping scenario 1004 as examples, the business information set associated with the identity information of the target object may include multiple business information corresponding to the above four business scenarios.
[0171] For example, the transportation scene 1001 may include itinerary information such as boarding passes, flight information, hotel reservation information, car reservation information, baggage check-in information, entertainment recommendation information such as shopping malls and tourist attractions, travel preference information such as commonly used transportation methods, transportation card balance information, historical travel records, weather forecasts, traffic conditions and other business information.
[0172] The conference check-in scene 1002 may include business information such as conference arrangements, conference topics and speaker information, participant account information, conference map and navigation, conference exchange forum, exhibitor information, and conference material downloads.
[0173] Parking scene 1003 may include parking space information, parking fees and payment methods, parking time reminders and timing, parking facility information (such as automatic car washers, charging piles, etc.), parking regulations and access instructions, parking lot contact information and customer service, driver's historical parking records, parking route planning and other business information.
[0174] In the shopping scenario 1004, business information such as consumer payment methods, historical shopping information and logistics status, product catalog and price information, shopping mall promotions and coupons, product reviews and user feedback may be included.
[0175] The business server can provide different business functions for the target object based on different business information. For example, it can automatically display boarding passes based on flight information, recommend nearby store information based on hotel reservation information, display transportation card balance, sign in for meetings for the target object, recommend parking routes for the target object, and other business functions.
[0176] In a possible implementation, in order to make the business information set cover more business fields and business functions, the diversity and richness of business information are increased, thereby providing target objects with business options that better meet their personalized needs and improving user experience.
[0177] In an embodiment of the present application, the terminal device can obtain the real-time location information of the target object in real time, and match the real-time location information with the preset location information of the corresponding preset scene type, so as to accurately obtain the scene type corresponding to the specific location of the target object. When the match is successful, based on the preset scene type corresponding to the preset location information, reference business information is obtained from a third-party platform associated with the corresponding preset scene type, and the reference business information is sent to the business server, so that the business server saves the reference business information as new original business information in the business information collection, ensuring that the obtained reference business information is highly matched with the current scene of the target object, avoiding irrelevant or redundant business information from being added to the business information collection, so that the business server provides the target object with business functions that are closely related to the scene where it is, thereby improving the user experience.
[0178] Specifically, as shown in Figure 11, the preset location information represents the geographic coordinates or area within which a specific scenario type occurs. This can be achieved by pre-setting a POI at a specific geographic location. A POI indicates that the location information is of particular interest or importance to the target subject, while a preset scenario type refers to a specific type of activity or situation that is predicted to occur at a specific geographic location, such as a POI.
[0179] For example, geographical locations such as shopping malls, shopping centers, commercial streets, restaurants, hotels, and scenic spots can be set as POIs corresponding to shopping scene type 1104, geographical locations such as underground parking lots, roadside parking spaces, and indoor parking lots can be set as POIs corresponding to parking scene type 1102, geographical locations such as exhibition halls, convention centers, and conference rooms can be set as POIs corresponding to conference scene type 1101, and geographical locations such as railway stations, high-speed rail stations, airports, bus stops, and subway stations can be set as POIs corresponding to transportation type 1103.
[0180] In actual application, the terminal device can obtain the location information of the target object (for example, longitude and latitude values, etc.) 1105 in real time to determine its geographical location, and match the real-time location information 1105 with the pre-set POI data 1106 to determine the target scene type 1107 of the target object, thereby knowing whether the target object is near or inside a specific POI.
[0181] Taking the preset shopping scene 1004 as an example, the shopping scene type 1104 can be pre-associated with the preset location coordinates corresponding to various POIs, such as shopping centers, commercial streets, and amusement parks. The terminal device carried by the target object obtains the target object's current location coordinates in real time and compares them with the location coordinates of the preset POIs. If the coordinate similarity between the two exceeds a preset threshold, it is determined that the target object is near or within the POI, and the shopping scene type 1104 corresponding to the POI is then used as the scene type of the target object.
[0182] In one possible implementation, when obtaining the preset scenario type corresponding to the preset location information, reference service information can be obtained from the third-party platform corresponding to the preset scenario type using pre-set mapping rules between each preset scenario type and its associated third-party platform. The mapping rules can be formulated based on the historical sources of historical service information corresponding to different scenario types and business requirements.
[0183] As shown in Figure 12, the transportation scene type 1201 can be associated with third-party platforms such as public transportation platforms, car rental platforms, and air ticket / train ticket / high-speed rail license plate reservations; the shopping scene type 1202 can be associated with third-party platforms such as e-commerce platforms, shopping mall applets, brand official websites, and coupons; the in-vehicle scene 1203 can be associated with third-party platforms such as in-vehicle navigation systems, gas station platforms, automobile manufacturer platforms, and parking lot applets; the meeting scene 1204 can be associated with third-party platforms such as meeting organization platforms and communication platforms with scan code check-in functions.
[0184] Specifically, the target object can pre-authorize the terminal device to allow the business processing app on the terminal device to access various third-party applications and obtain specific business information, thereby ensuring the legal use of business information and information security. At least one third-party platform corresponding to each scenario type can be recorded in the database.
[0185] When determining the preset scenario type that matches the target object's real-time location information, the business processing app on the terminal device can query a list of third-party platforms associated with the preset scenario type based on the records in the database, and obtain reference business information related to the preset scenario type from each third-party platform by calling the corresponding API. The method of calling the API can be based on the interface specifications of each third-party platform.
[0186] Finally, the reference business information obtained from various third-party platforms is integrated, filtered, sorted, and processed as needed, and the processed reference business information is sent to the business server.
[0187] In one possible implementation, when a terminal device obtains reference business information from a third-party platform, it can obtain reference business information related to a preset scenario type through various methods such as calling an API interface, keyword matching, and data filtering, thereby ensuring that the obtained reference business information is highly matched with the scenario where the target object is located, and avoiding irrelevant or redundant business information from being added to the business information collection.
[0188] Specifically, a specific API interface can be selected for calling to request adapted reference business information. The API interface provided by the third-party platform allows the terminal device to send a specific type of request to it to obtain business information in a specific scenario. For example, when the preset scene type is a dining scene type, the API of the food review platform can be called to request reference business information such as reviews, menus, and addresses of nearby restaurants. Alternatively, keywords related to the preset scene type can be searched in the massive data of the third-party platform, and adapted reference business information can be obtained through keyword matching. For example, when the preset scene type is a scenic spot scene type, the terminal device can search for information containing keywords such as "attractions" and "travel" to obtain business information related to the scenic spot. In addition, the terminal device can also filter out business information related to the preset scene type by setting specific filtering conditions. For example, when the preset scene type is a shopping scene 1004 type, reference business information such as nearby shopping malls, shopping discounts, and brand promotions can be filtered out.
[0189] In one possible implementation, as shown in FIG13 , to improve information security during business processing, a business server may, upon receiving reference business information 1301 sent by a terminal device, perform a compliance check 1303 on the reference business information using a preset information filtering policy 1302. If the reference business information passes the check, the reference business information is saved as new original business information in a business information collection 1304. This prevents non-compliant or false business information from being added to the business information collection, thereby ensuring the information security of the business information obtained by the target object.
[0190] Specifically, information filtering strategies can identify sensitive words, phrases, or patterns in reference business information to determine whether it contains non-compliant content and intercept illegal or non-compliant reference business information. Information filtering strategies include but are not limited to:
[0191] 1) Keyword-based filtering strategy: Pre-defined keywords are matched with the text information in the reference business information to identify whether the reference business information contains sensitive content.
[0192] 2) Part-of-speech tagging-based filtering strategy: By segmenting and tagging the text information in the reference business information, it is determined whether there is non-compliant content based on pre-defined rules. Compared with the keyword-based filtering strategy, this strategy is relatively complex, but it can more accurately identify illegal content.
[0193] 3) Machine learning-based filtering strategies: Machine learning algorithms are used to train models to identify non-compliant content within reference business information. This typically requires a large amount of training data and manual annotation to adapt to the ever-changing nature of non-compliant content.
[0194] 4) Hybrid filtering strategy: Combine multiple filtering strategies including but not limited to the above to improve the detection accuracy and adaptability of information filtering.
[0195] 5) Manual review strategy: To avoid missed detections and false positives, manual review and other measures can be combined with the above-mentioned filtering strategies to further ensure the compliance of reference business information.
[0196] Step 505: The service server selects at least one candidate service information that matches the location information from the service information set.
[0197] Step 506: The service server sends at least one candidate service information to the terminal device associated with the identity information.
[0198] In an embodiment of the present application, when the business server obtains a set of business information associated with identity information, it will filter out at least one candidate business information that matches the location information of the target object from a large amount of business information as the target business information, and then return the target business information to the terminal device associated with the identity information, so that the target object triggers the selection operation and executes the subsequent business processing flow.
[0199] It should be noted that in the embodiments of the present application, the terminal device and the biometric recognition device can be two independent devices as described above, each performing different functions, or they can be an integrated device that integrates the functions of the terminal device and the biometric recognition device and is used to implement all the functions involved in the terminal device and the biometric recognition device described above. Therefore, the service server can send candidate service information to the terminal device and can also return it to the integrated device that integrates the functions of the biometric recognition device and the terminal device, so that the target object can trigger the candidate selection operation through the integrated device.
[0200] For example, in an in-vehicle scenario, the in-vehicle terminal is an all-in-one device that integrates a terminal device and a biometric identification device, simultaneously carrying out all the functions of both the biometric identification device and the terminal device. Equipped with a camera, the in-vehicle terminal can perform facial recognition on a target subject, such as the driver, to obtain their biometric characteristics. It also uses the in-vehicle GPS to obtain their location information, thereby obtaining their object description. This information is then wirelessly transmitted to the corresponding service server in the service processing system. The service server then returns candidate service information, which is displayed on the in-vehicle display corresponding to the in-vehicle terminal, allowing the target subject to select the desired service information and implement subsequent service processing.
[0201] In a possible implementation, the target scene type corresponding to the location information can be obtained to calculate the scene matching degree between each original business information contained in the business information set and the target scene type, thereby judging whether the scene matching degree meets the preset matching conditions to filter out at least one qualified candidate business information from each original business information.
[0202] Specifically, the scenario matching degree between the original business information and the target scenario type can be calculated in the following ways:
[0203] 1) Text matching method: Analyze the text descriptions, keywords, or tags in the original business information and compare them with the semantics of the target scenario type to calculate the semantic match between the two.
[0204] Alternatively, natural language processing techniques can be used to calculate the degree of textual match between the original business information and the target scenario type. For example, word embedding models such as Word2Vec (Word Embedding Model) or Bidirectional Encoder Representations from Transformers (BERT) can be used to represent the text of the original business information and the target scenario type, and the cosine similarity or Euclidean distance between the texts can be calculated.
[0205] 2) Geographic matching method: Geographic Information System (GIS) data such as geographic coordinates, geographic boundaries, and geographic features are used to determine whether the target location and the location associated with each business information are within the same geographic area or geographic feature.
[0206] Alternatively, the distance or similarity between the target location of the target object and the location associated with each piece of business information is calculated to match the business information with the location information. For example, a metric such as Euclidean distance, Manhattan distance, or cosine similarity is used to calculate the distance between the location information and the location information associated with each piece of business information in the business information set. A smaller distance indicates a higher similarity, and thus a higher degree of match between the business information and the location information.
[0207] 3) Location classification method: pre-specify the corresponding preset scene type for each original business information in the business information set, which can be set by label or scene category, and calculate the matching degree of type similarity between the target scene type and the preset scene type corresponding to each original business information.
[0208] For example, the intersection between labels or Jaccard Similarity Coefficient (Jaccard) similarity is used to measure the degree of matching.
[0209] 4) Model matching method: Use machine learning algorithms such as classification models, regression models, or neural networks to train models based on historical matching data to predict the degree of match between the target scenario type and business information.
[0210] Specifically, when calculating the scene matching degree between each piece of original service information and the target scene type, the magnitude relationship between each scene matching degree and a preset matching degree threshold can be compared. If it is determined that the scene matching degree between a piece of original service information and the target scene type is not less than the preset matching degree threshold, the scene matching degree is determined to meet the preset matching condition, and the original service information is thus selected as candidate service information.
[0211] Step 507: The terminal device determines at least one target service information from at least one candidate service information in response to the selection operation triggered by the target object.
[0212] Step 508: The terminal device sends at least one target service information to the service server.
[0213] In an embodiment of the present application, as shown in FIG14 , after receiving at least one candidate service information from a service server, a terminal device may notify a target user and display the relevant candidate service information to the target user. The target user may browse the candidate service information on the terminal device and select at least one target service information of their choice, causing the terminal device to return the target service information selected by the target user to the service server.
[0214] Specifically, taking a shopping scene in a certain mall as an example, with a shopper as the target object, the business server 1401 will screen out candidate business information 1, 2, 3, ... n related to the shopping scene and send it to the terminal device 1402 such as a smartphone used by the shopper or the biometric device 1403 used by the shopper. The candidate business information 1, 2, 3, ... n includes but is not limited to information about different stores in the mall, mall event information, the location of mall toilets, and other candidate business information. The shopper's smartphone or other terminal device 1402 can display a list of candidate business information on its screen in the form of a pop-up window. The shopper can select the target business information of interest from the candidate business information list, so that the terminal device will return the target business information selected by the shopper to the business server. By allowing the target object to select the target business information of interest from a large number of candidate business information based on personal preferences and needs, the shopper's shopping experience and shopping convenience are improved.
[0215] Step 509: The service server receives at least one target service information returned by the terminal device, and processes the service corresponding to each target service information in the at least one target service information.
[0216] In an embodiment of the present application, the target business information selected by the target object is sent to the business server through the terminal device, so that the business server can learn the business needs of the target object and perform corresponding business processing according to the target business information, thereby providing personalized multiple business services for different target objects, meeting the actual business needs of the target object to realize multiple business functions through biometric operations, improving the flexibility and diversity of business processing, thereby improving business processing efficiency, and enhancing the experience of the target object.
[0217] Specifically, taking the transportation scenario as an example, passengers are the target objects. Passengers can select at least one target business information they need based on multiple candidate information displayed on the terminal device, such as boarding pass information, itinerary information, recommended shopping mall information, transportation card balance information, historical ride records, etc. The business server performs corresponding business operations based on the target business information selected by the passenger.
[0218] When a passenger selects the boarding pass information, the service server can generate an electronic boarding pass for the passenger, including flight information, seat number, boarding time and other information, and send it to the passenger's terminal device to improve the passenger's travel experience and travel convenience.
[0219] When a passenger selects the itinerary information, the service server will generate a detailed itinerary based on the passenger's travel arrangements and other information, including departure time, transportation method, destination and other information, and provide real-time traffic information to help passengers avoid congested roads and improve their travel experience.
[0220] When a passenger selects the recommended shopping mall information, nearby shopping malls or shopping centers will be recommended based on the passenger's current location and historical preferences, and a mall map and navigation will be provided to help passengers quickly find the store of interest, as well as push promotional activities and coupon information within the mall.
[0221] When a passenger selects the transportation card balance information, the business server can display the balance and usage record of the passenger's associated transportation card, remind the passenger to recharge in time based on the balance, and provide the location of nearby recharge points and ticket vending machines to ensure that the passenger can ride the bus normally and improve the passenger's travel experience.
[0222] When a passenger selects a historical ride record, the service server will collect the passenger's past ride records, including starting and ending stations, ride time, etc., and count and analyze the passenger's travel habits to plan better travel plans and routes for the passenger, thereby improving the passenger's travel experience.
[0223] Referring to FIG. 15 , based on the same inventive concept, an embodiment of the present application further provides a service processing device 150 applied to a service server in a service processing system, the device comprising:
[0224] The receiving module 1501 is configured to receive object description information sent by a biometric recognition device, where the object description information includes: biometric features and location information of a target object;
[0225] An acquisition module 1502 is configured to acquire the identity information of the target object recorded in the biometric feature, and acquire a set of business information associated with the identity information;
[0226] The matching module 1503 is configured to filter out at least one candidate service information that matches the location information from the service information set;
[0227] a sending module 1504, configured to send at least one candidate business information to a terminal device associated with the identity information, wherein the terminal device determines at least one target business information from the at least one candidate business information in response to a selection operation triggered by the target object; and
[0228] The receiving module 1501 is further configured to receive the at least one target service information returned by the terminal device, and process the service corresponding to each target service information in the at least one target service information.
[0229] Optionally, the business information set includes multiple original business information, and the matching module 1503 is specifically configured to:
[0230] Obtaining a target scene type corresponding to the location information;
[0231] respectively obtaining a scene matching degree between each piece of original business information in the plurality of original business information and the target scene type;
[0232] At least one original service information whose scene matching degree meets a preset matching condition is determined as the at least one candidate service information.
[0233] Optionally, the acquisition module 1502 is specifically configured to:
[0234] Performing identity recognition processing on the biometric feature to obtain an identity identifier corresponding to the biometric feature;
[0235] The identity information associated with the identity identifier is determined.
[0236] Optionally, the acquisition module 1502 is specifically configured to:
[0237] matching at least one pre-stored candidate feature with the biometric feature;
[0238] The identity information associated with the candidate feature when the match is successful is used as the identity information.
[0239] Optionally, the identity recognition process is performed by a trained identity recognition model, and the apparatus further includes a training module 1506 for:
[0240] Acquiring sample data, wherein the sample data includes: a plurality of sample identifications, and sample biometric features corresponding to each of the plurality of sample identifications;
[0241] Based on the sample data, the initial identity recognition model is iteratively trained to obtain the trained identity recognition model, wherein each iterative training process includes the following operations:
[0242] Using the initial identity recognition model, predict the sample biometrics input during this iteration to obtain a predicted identity identifier for the sample biometrics;
[0243] Determine the difference between the sample identity identifier corresponding to the sample biometric and the predicted identity identifier as a loss value;
[0244] Based on the loss value, the parameters of the initial identity recognition model are adjusted.
[0245] Optionally, the receiving module 1501 is further configured to:
[0246] receiving reference service information sent by the terminal device, where the reference service information is obtained by the terminal device from a third-party platform based on the real-time location information of the target object;
[0247] The apparatus 150 further comprises:
[0248] The storage module 1505 is configured to:
[0249] Based on the preset information filtering strategy, the reference business information is verified for compliance;
[0250] When the reference business information passes verification, the reference business information is saved as new original business information in the business information collection.
[0251] The device can be used to execute the method executed by the business server in each embodiment of the present application. Therefore, for the functions that can be implemented by each functional module of the device, please refer to the description of the aforementioned embodiments and will not be repeated here.
[0252] Referring to FIG. 16 , based on the same inventive concept, an embodiment of the present application further provides a service processing device 160 applied to a terminal device, the device including:
[0253] Receiving module 1601, configured to receive at least one candidate service information sent by a service server, where the at least one candidate service information is determined by the service server based on the biometrics and location information of a target object;
[0254] A determination module 1602 is configured to determine at least one target business information from the at least one candidate business information in response to a selection operation triggered by the target object; and
[0255] The sending module 1603 is configured to send the at least one target service information to the service server, so that the service server processes the service corresponding to each target service information in the at least one target service information.
[0256] The device can be used to execute the methods executed by the terminal equipment in each embodiment of the present application. Therefore, for the functions that can be implemented by each functional module of the device, please refer to the description of the aforementioned embodiments and no further details will be given.
[0257] Referring to FIG. 17 , based on the same inventive concept, an embodiment of the present application further provides a service processing device 170 applied to a biometric identification device, the device comprising:
[0258] An acquisition module 1701 is configured to acquire object description information of a target object, wherein the object description information includes: target object biometrics and location information of the target object;
[0259] The sending module 1702 is used to send the object description information to the business server so that the business server performs the following operations: based on the biometric characteristics and the location information, obtain at least one candidate business information, send the at least one candidate business information to the terminal device, and perform business processing based on at least one target business information returned by the terminal device; each target business information is determined by the terminal device in the at least one candidate business information in response to the selection operation triggered by the target object.
[0260] The device can be used to execute the methods executed by the biometric identification devices in the various embodiments of the present application. Therefore, for the functions that can be implemented by the various functional modules of the device, please refer to the description of the aforementioned embodiments and no further details will be given.
[0261] Referring to FIG18 , based on the same technical concept, an embodiment of the present application further provides a computer device. In one embodiment, the computer device may be the service server shown in FIG1 , and as shown in FIG18 , the computer device includes a memory 1801 , a communication module 1803 , and at least one processor 1802 .
[0262] Memory 1801 is used to store computer programs executed by processor 1802. Memory 1801 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and programs required for running instant messaging functions, while the data storage area may store various instant messaging messages and operating instruction sets.
[0263] Memory 1801 may be a volatile memory, such as random-access memory (RAM); a non-volatile memory, such as read-only memory, flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 1801 may be a combination of the aforementioned memories.
[0264] The processor 1802 may include at least one central processing unit (CPU) or a digital processing unit, etc. The processor 1802 is configured to implement the above-mentioned biometric-based service processing method when calling the computer program stored in the memory 1801 .
[0265] The communication module 1803 is used to communicate with terminal equipment, biometric identification devices or other servers.
[0266] The specific connection medium between the memory 1801, communication module 1803, and processor 1802 is not limited in the embodiments of the present application. In Figure 18, the embodiment of the present application shows that the memory 1801 and the processor 1802 are connected via a bus 1804. Bus 1804 is depicted as a bold line in Figure 18. The connection methods between other components are merely schematic and are not intended to be limiting. Bus 1804 can be divided into an address bus, a data bus, a control bus, etc. For ease of description, Figure 18 only uses a single bold line, but does not represent a single bus or a single type of bus.
[0267] The memory 1801 stores computer storage media, which stores computer executable instructions. The computer executable instructions are used to implement the biometric-based business processing method of the embodiment of the present application. The processor 1802 is used to execute the biometric-based business processing method of the above-mentioned embodiments.
[0268] In another embodiment, the computer device may also be a terminal device or a biometric recognition device as shown in FIG1 . In this embodiment, the structure of the computer device may be as shown in FIG19 , including: a communication component 1910 , a memory 1920 , a display unit 1930 , a camera 1940 , a sensor 1950 , an audio circuit 1960 , a Bluetooth module 1970 , a processor 1980 , and other components.
[0269] The communication component 1910 is used to communicate with the service server. In some embodiments, it may include a wireless fidelity (WiFi) module. The WiFi module is a short-range wireless transmission technology. The computer device can help users send and receive information through the WiFi module.
[0270] The memory 1920 can be used to store software programs and data. The processor 1980 executes various functions and data processing of the terminal device by running the software programs or data stored in the memory 1920. The memory 1920 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. The memory 1920 stores an operating system that enables the terminal device to run. In the present application, the memory 1920 can store the operating system and various application programs, and may also store code for executing the business processing method based on biometric identification in the embodiment of the present application.
[0271] The display unit 1930 can also be used to display information input by the user or provided to the user, as well as a graphical user interface (GUI) for displaying various menus of the terminal device. Specifically, the display unit 1930 may include a display screen 1932 disposed on the front of the terminal device or biometric recognition device. The display screen 1932 may be configured in the form of a liquid crystal display, a light-emitting diode, or the like. The display unit 1930 can be used to display at least one candidate service information in the embodiments of the present application, or to respond to a target object selection operation, etc.
[0272] The display unit 1930 can also be used to receive input digital or character information and generate signal input related to user settings and function control of the terminal device. Specifically, the display unit 1930 may include a touch screen 1931 set on the front of the terminal device, which can collect user touch operations on or near it, such as clicking a button, dragging a scroll box, etc.
[0273] The touch screen 1931 can be covered on the display screen 1932, or the touch screen 1931 and the display screen 1932 can be integrated to realize the input and output functions of the terminal device. The integrated display screen can be simply called a touch screen display. In this application, the display unit 1930 can display the application and the corresponding operation steps.
[0274] Camera 1940 can be used to capture still images, and users can post comments on images captured by camera 1940 through the application. Camera 1940 can be one or more. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to processor 1980 for conversion into a digital image signal.
[0275] The terminal device may further include at least one sensor 1950, such as an acceleration sensor 1951, a distance sensor 1952, a fingerprint sensor 1953, and a temperature sensor 1954. The terminal device may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, and a motion sensor.
[0276] The audio circuit 1960, speaker 1961, and microphone 1962 provide an audio interface between the user and the terminal device. The audio circuit 1960 converts received audio data into electrical signals and transmits them to the speaker 1961, which then converts them into sound signals for output. The terminal device may also be equipped with a volume button for adjusting the volume of the sound signal. Meanwhile, the microphone 1962 converts the collected sound signals into electrical signals, which are then received by the audio circuit 1960 and converted into audio data. The audio data is then output to the communication component 1910 for transmission to, for example, another terminal device, or to the memory 1920 for further processing.
[0277] The Bluetooth module 1970 is used to exchange information with other Bluetooth devices having a Bluetooth module through the Bluetooth protocol. For example, the terminal device can establish a Bluetooth connection with a wearable computer device (such as a smart watch) that also has a Bluetooth module through the Bluetooth module 1970 to exchange data.
[0278] Processor 1980 is the control center of the terminal device, connecting the various components of the entire terminal using various interfaces and lines. It executes various terminal functions and processes data by running or executing software programs stored in memory 1920 and accessing data stored in memory 1920. In some embodiments, processor 1980 may include at least one processing unit; processor 1980 may also integrate an application processor and a baseband processor, where the application processor primarily processes the operating system, user interface, and application programs, while the baseband processor primarily handles wireless communications. It is understood that the baseband processor may not be integrated into processor 1980. In this application, processor 1980 can run the operating system, application programs, user interface display and touch response, as well as the biometric-based service processing method of the embodiments of this application. In addition, processor 1980 is coupled to display unit 1930.
[0279] Based on the same inventive concept, an embodiment of the present application also provides a storage medium, which stores a computer program. When the computer program runs on a computer, it enables the computer to execute the steps of the biometric-based business processing method described above in this specification according to various exemplary embodiments of the present application.
[0280] In some possible implementations, various aspects of the business processing method provided in the present application can also be implemented in the form of a computer program product, which includes a computer program. When the program product is run on a computer device, the computer program is used to enable the computer device to execute the steps of the biometric-based business processing method according to various exemplary embodiments of the present application described above in this specification. For example, the computer device can execute the steps of each embodiment.
[0281] The program product may employ any combination of at least one readable medium. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having at least one wire, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
[0282] The program product of the embodiment of the present application may be a portable compact disc read-only memory (CD-ROM) and include a computer program, and can be run on a computer device. However, the program product of the present application is not limited thereto. In the present application, a readable storage medium may be any tangible medium containing or storing a program, and the computer program included therein may be used by or in conjunction with a command execution system, apparatus, or device.
[0283] A readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a readable computer program. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with a command execution system, apparatus, or device.
[0284] The computer program embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0285] Computer programs for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages.
[0286] It should be noted that although several units or subunits of the device are mentioned in the detailed description above, this division is merely exemplary and not mandatory. In fact, depending on the embodiment of the application, the features and functions of two or more units described above can be embodied in a single unit. Conversely, the features and functions of a single unit described above can be further divided and embodied by multiple units.
[0287] Furthermore, although the operations of the method of the present application are described in a particular order in the accompanying drawings, this does not require or imply that the operations must be performed in this particular order, or that all illustrated operations must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.
[0288] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on at least one computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contains computer-usable program code.
[0289] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.
[0290] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A business processing method, executed by a computer device, comprising: Receiving object description information sent by a biometric recognition device, the object description information including: biometric characteristics and location information of a target object; Acquire the identity information of the target object recorded in the biometric feature, and acquire a set of business information associated with the identity information; Filtering at least one candidate business information matching the location information from the business information set; sending the at least one candidate service information to a terminal device associated with the identity information, wherein the terminal device determines at least one target service information from the at least one candidate service information in response to a selection operation triggered by the target object; and, Receive the at least one target service information returned by the terminal device, and process the service corresponding to each target service information in the at least one target service information.
2. The method of claim 1, wherein: The business information set includes a plurality of original business information, and the step of screening out at least one candidate business information matching the location information from the business information set includes: Acquire a target scene type corresponding to the location information; Respectively obtaining a scene matching degree between each piece of original business information in the plurality of original business information and the target scene type; At least one original service information whose scene matching degree meets a preset matching condition is determined as the at least one candidate service information.
3. The method according to claim 1 or 2, wherein: The obtaining the identity information of the target object recorded in the biometric feature includes: Performing identity recognition processing on the biometric feature to obtain an identity identifier corresponding to the biometric feature; The identity information associated with the identity identifier is determined.
4. The method according to claim 1 or 2, wherein: The obtaining the identity information of the target object recorded in the biometric feature includes: Matching at least one pre-stored candidate feature with the biometric feature; The identity information associated with the candidate feature when the match is successful is used as the identity information.
5. The method of claim 3, wherein: The identity recognition process is performed by a trained identity recognition model, and the training process of the identity recognition model includes: Acquire sample data, wherein the sample data includes: a plurality of sample identifications, and sample biometric features corresponding to each of the plurality of sample identifications; Based on the sample data, the initial identity recognition model is iteratively trained to obtain the trained identity recognition model, wherein each iterative training process includes the following operations: The sample biometric feature input in this iteration is predicted by the initial identity recognition model to obtain a predicted identity identifier of the sample biometric feature; Determine the difference between the sample identity identifier corresponding to the sample biometric feature and the predicted identity identifier as a loss value; Based on the loss value, the parameters of the initial identity recognition model are adjusted.
6. The method according to any one of claims 1 to 5, further comprising: receiving reference service information sent by the terminal device, where the reference service information is obtained by the terminal device from a third-party platform based on the real-time location information of the target object; Based on a preset information filtering strategy, the reference business information is checked for compliance; When the reference business information passes the verification, the reference business information is taken as new original business information and saved in the business information set.
7. A business processing method, executed by a computer device, the method comprising: Receiving at least one candidate service information sent by a service server, where the at least one candidate service information is determined by the service server based on the biometrics and location information of the target object; In response to the selection operation triggered by the target object, at least one target business information is determined from the at least one candidate business information. interest; and, The at least one target service information is sent to the service server, so that the service server processes the service corresponding to each target service information in the at least one target service information.
8. The method of claim 7, further comprising: Acquire the real-time location information of the target object, and match the real-time location information with the preset location information; When the match is successful, based on the preset scene type corresponding to the preset location information, obtaining reference business information from a third-party platform associated with the preset scene type; The reference business information is sent to the business server, so that the business server takes the reference business information as new original business information and saves it into the business information set.
9. A business processing method, executed by a computer device, the method comprising: Acquire object description information of the target object, wherein the object description information includes: biological characteristics and location information of the target object; The object description information is sent to a business server so that the business server performs the following operations: based on the biometric feature and the location information, at least one candidate business information is obtained, the at least one candidate business information is sent to a terminal device, and based on at least one target business information returned by the terminal device, business processing is performed; each target business information is determined in the at least one candidate business information by the terminal device in response to a selection operation triggered by the target object.
10. The method of claim 9, wherein: The obtaining of the object description information of the target object includes: In response to a biometric recognition operation triggered by the target object, acquiring a biometric image of the target object; Extracting biological features contained in the biological image; The object description information is acquired based on the location information and the biometric feature of the target object.
11. The method of claim 10, wherein: The biometric identification operation includes a palm swiping identification operation; The step of acquiring a biological image of the target object in response to a biometric recognition operation triggered by the target object includes: In response to the palm recognition operation, collecting a palm image set of the target object, the palm image set including a palm print image and a palm vein image; The step of extracting the biological features contained in the biological image comprises: Based on the palm vein image, performing liveness detection on the target object; When the target object passes the liveness detection, extracting the palmprint features of the palmprint image and the palm vein features of the palm vein image; The palm print feature and the palm vein feature are combined to obtain the biological feature.
12. A service processing device, comprising: A receiving module, used to receive object description information sent by a biometric recognition device, wherein the object description information includes: biometric characteristics and location information of a target object; An acquisition module, used to acquire the identity information of the target object recorded in the biometric feature, and acquire a set of business information associated with the identity information; A matching module, configured to filter out at least one candidate service information matching the location information from the service information set; a sending module, configured to send the at least one candidate business information to a terminal device associated with the identity information, wherein the terminal device determines at least one target business information from the at least one candidate business information in response to a selection operation triggered by the target object; and The receiving module is further used to receive the at least one target service information returned by the terminal device, and process the service corresponding to each target service information in the at least one target service information.
13. The device of claim 12, wherein: The service information set includes a plurality of original service information, and the matching module is used to obtain a target scene type corresponding to the location information; and respectively obtain a scene matching degree between each of the plurality of original service information and the target scene type; At least one original service information whose scene matching degree meets a preset matching condition is determined as the at least one candidate service information.
14. The device according to claim 12 or 13, wherein: The receiving module is further used to receive reference business information sent by the terminal device, where the reference business information is obtained by the terminal device from a third-party platform based on the real-time location information of the target object; The device also includes: A storage module, used for performing compliance verification on the reference business information based on a preset information filtering strategy; In the reference industry When the service information passes the verification, the reference service information is used as new original service information and saved in the service information set.
15. A service processing device, comprising: A receiving module, configured to receive at least one candidate service information sent by a service server, wherein the at least one candidate service information is determined by the service server based on the biometrics and location information of the target object; A determination module, configured to determine at least one target business information from the at least one candidate business information in response to a selection operation triggered by the target object; and, The sending module is used to send the at least one target business information to the business server, so that the business server processes the business corresponding to each target business information in the at least one target business information.
16. A service processing device, comprising: An acquisition module, used to acquire object description information of a target object, wherein the object description information includes: biological characteristics and location information of the target object; A sending module, used for sending the object description information to a business server so that the business server performs the following operations: based on the biometric feature and the location information, obtain at least one candidate business information, send the at least one candidate business information to a terminal device, and perform business processing based on at least one target business information returned by the terminal device; each target business information is determined by the terminal device in the at least one candidate business information in response to a selection operation triggered by the target object.
17. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 11 are implemented.
18. A computer-readable storage medium storing a computer program executable by a computer device, wherein when the program is run on the computer device, the computer device executes the steps of any one of the methods of claims 1 to 11.
19. A computer program product, comprising a computer program stored on a computer-readable storage medium, wherein the computer program comprises program instructions, and when the program instructions are executed by a computer device, the computer device is caused to execute the steps of the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Data processing method and device, electronic equipment and storage medium
CN112883350A
Regional integrated smart park service platform
CN116596176A
System and method for secure touchless authentication of user paired device, behavior and identity
US11096059B1
Method for biometric recognition of a user amongst a plurality of registered users to a service, employing user localization information
US20160315936A1
Cited By
Server configuration matching method and device, equipment and storage medium
CN120561618A
Method and system for authenticating and securing vehicular services
US12509020B2
Method and system for authenticating and securing vehicular services
US20250115210A1