Resource transfer method and apparatus, computer device, and storage medium
By querying or distributing face verification data from the local face database of potential points of interest of the target object, the problem of time-consuming resource transfer for the first face scan of the user is solved, achieving efficient local recognition and verification and improving the user experience.
Patent Information
- Application Number
- CN202111327845.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-10
- Publication Date
- 2025-11-07
- Estimated Expiration
- 2041-11-10
AI Technical Summary
In existing resource transfer methods, the first time a user performs a resource transfer operation by scanning their face, it requires identification and verification in the cloud, which is easily affected by network conditions and can take a long time.
By receiving location information of target objects reported by social applications, the system can find target social objects with whom it has close social relationships, and query or send facial verification data in the local facial database of potential interest points of the target objects. The local facial database is then used for recognition and verification, reducing cloud interaction.
It effectively improves the efficiency of users transferring resources using facial recognition for the first time, reduces time consumption, and enhances the user experience.
Smart Images

Figure CN116108287B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of computers, in particular to a resource transfer method and device, computer equipment and a storage medium. BACKGROUND
[0002] With the development of computer technology and Internet technology, the application of face resource transfer services based on face recognition technology in different scenarios has landed, making various types of applications with face resource transfer functions widely popular among the public.
[0003] However, in the current resource transfer mode, when a user performs a resource transfer operation for the first time, identification verification needs to be performed in the cloud, which is easily affected by the network, resulting in a long time consumption for the user to perform a resource transfer by facial recognition. SUMMARY
[0004] Therefore, it is necessary to provide a resource transfer method, device, computer equipment and storage medium that can effectively reduce the time consumption of a user performing a resource transfer by facial recognition.
[0005] A resource transfer method, the method comprising: receiving location information of a target object reported through a social application; finding a target social object having an intimate social relationship with the target object; when it is determined that the target social object has a resource transfer record at a point of interest corresponding to the location information, querying a local face database of the point of interest for face verification data of the target object; and if the face verification data of the target object is not queried, downloading the face verification data of the target object to the local face database; wherein the downloaded face verification data is used to instruct a resource transfer device of the point of interest to perform resource transfer based on the face verification data and collected face data when the target object performs product interaction at the point of interest.
[0006] A resource transfer device, characterized in that the device comprises: a receiving module configured to receive location information of a target object reported through a social application; a finding module configured to find a target social object having an intimate social relationship with the target object; a querying module configured to query a local face database of a point of interest for face verification data of the target object when it is determined that the target social object has a resource transfer record at the point of interest corresponding to the location information; and a downloading module configured to download the face verification data of the target object to the local face database if the face verification data of the target object is not queried; wherein the downloaded face verification data is used to instruct a resource transfer device of the point of interest to perform resource transfer based on the face verification data and collected face data when the target object performs product interaction at the point of interest.
[0007] In one embodiment, the apparatus further comprises: an obtaining module, configured to obtain social objects having a friend relationship chain with the target object; and a determining module, configured to determine at least one of the social objects as a target social object having a close social relationship when the target object is in a same social group as at least one of the social objects having the friend relationship chain.
[0008] In one embodiment, the obtaining module is further configured to obtain group member objects in the close social group; and the determining module is further configured to determine a social frequency between the target object and at least one of the group member objects if the at least one of the group member objects belongs to the social objects having the friend relationship chain; and determine the at least one of the group member objects as the target social object having the close social relationship if the social frequency reaches a preset frequency threshold.
[0009] In one embodiment, the searching module is further configured to search for a candidate interest point having a resource transfer record of the target social object; the determining module is further configured to determine a distance between a location of the candidate interest point and the location information; and the searching module is further configured to determine the candidate interest point as an interest point corresponding to the location information and determine that the target social object has a resource transfer record at the interest point when the distance is less than or equal to a preset distance threshold; and the querying module is further configured to query face verification data of the target object in a local face database of the interest point.
[0010] In one embodiment, the obtaining module is further configured to obtain a resource transfer device list of the interest point; the resource transfer device list comprises device information of at least two of the resource transfer devices; and the delivering module is further configured to deliver the face verification data of the target object to a local face database of each of the resource transfer devices if the face verification data of the target object is not queried in at least one of the resource transfer devices of the resource transfer device list.
[0011] In one embodiment, the apparatus further comprises: an adjusting module, configured to adjust an effective period of the face verification data of the target object if the face verification data of the target object is queried but the face verification data of the target object is out of the effective period; or the delivering module is further configured to re-collect the face verification data of the target object and deliver the collected face verification data to the local face database.
[0012] In one embodiment, the apparatus further comprises: a matching module, configured to match the face data collected by the resource transfer device with the face verification data stored in the background to obtain a matching result when the face data collected by the resource transfer device is received; and the delivering module is further configured to deliver the face verification data and resource account information of the target object to the resource transfer device if the matching result indicates that the face data is consistent with the face verification data stored in the background.
[0013] A computer device includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to perform the following steps: receiving location information of a target object reported through a social application; locating a target social object with a close social relationship with the target object; when it is determined that the target social object has a resource transfer record at the point of interest corresponding to the location information, querying the target object's facial verification data in the local facial database at the point of interest; if the target object's facial verification data is not found, sending the target object's facial verification data to the local facial database; wherein the sent facial verification data is used to instruct the resource transfer device at the point of interest to perform resource transfer based on the facial verification data and collected facial data when the target object interacts with a product at the point of interest.
[0014] A computer-readable storage medium storing a computer program, which, when executed by a processor, performs the following steps: receiving location information of a target object reported through a social application; locating a target social object with a close social relationship with the target object; when it is determined that the target social object has a resource transfer record at the point of interest corresponding to the location information, querying the target object's facial verification data in the local facial database at the point of interest; if the target object's facial verification data is not found, sending the target object's facial verification data to the local facial database; wherein the sent facial verification data is used to instruct the resource transfer device at the point of interest to perform resource transfer based on the facial verification data and collected facial data when the target object interacts with a product at the point of interest.
[0015] The resource transfer method, device, computer device and storage medium described above receive position information of a target object reported through a social application; a target social object having an intimate social relationship with the target object is found; when it is determined that the target social object has a resource transfer record at a point of interest corresponding to the position information, human face verification data of the target object is queried from a local human face library of the point of interest; if the human face verification data of the target object is not queried, the human face verification data of the target object is issued to the local human face library; wherein the issued human face verification data is used to instruct a resource transfer device of the point of interest to perform resource transfer based on the human face verification data and collected human face data when the target object performs product interaction at the point of interest. Since the target social object having an intimate social relationship with the target object is found and it is determined that the target social object has a resource transfer record at a point of interest close to the position information of the target object, the potential point of interest that the target object may reach can be inferred, and the human face verification data of the target object is issued to the local human face library of the point of interest where the target object is likely to perform face brushing resource transfer in advance. When the target object performs product interaction at the point of interest, local recognition can be performed using the data in the local human face library, without the need for interaction with the cloud for recognition verification, thereby effectively improving the efficiency of the first use of face brushing for resource transfer operation by the user, effectively reducing the time consumption of face brushing for resource transfer by the user, and improving the user experience.
[0016] A resource transfer method, the method comprising: collecting human face data of a target object when the target object performs product interaction at a point of interest; comparing the human face data with human face verification data in a local human face library of the point of interest to obtain a comparison result; the human face verification data is issued by a server when it is determined that a target social object has a resource transfer record at the point of interest and the local human face library of the point of interest does not store human face verification data of the target object; the target social object is a social object having an intimate social relationship with the target object; and when the comparison result indicates that the human face data is consistent with the human face verification data, the resource of the target object is transferred.
[0017] A resource transfer device, the device comprising: a collection module configured to collect human face data of a target object when the target object performs product interaction at a point of interest; a comparison module configured to compare the human face data with human face verification data in a local human face library of the point of interest to obtain a comparison result; the human face verification data is issued by a server when it is determined that a target social object has a resource transfer record at the point of interest and the local human face library of the point of interest does not store human face verification data of the target object; the target social object is a social object having an intimate social relationship with the target object; and a transfer module configured to transfer the resource of the target object when the comparison result indicates that the human face data is consistent with the human face verification data.
[0018] In one embodiment, the apparatus further comprises: the collecting module is further configured to collect at least two video frame images of the target object; the determining module is configured to determine a definition of each of the video frame images and a face angle in each of the video frame images; determine a score of each of the video frame images based on the definition and the face angle; and the selecting module is configured to select a video frame image corresponding to a maximum score as the face data of the target object.
[0019] In one embodiment, the apparatus further comprises: an uploading module configured to upload the face data to the server when the comparison result indicates that the face data is inconsistent with the face verification data, so that the server matches the face data with the face verification data stored in the background.
[0020] A computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program: collecting face data of a target object when the target object interacts with a product at a point of interest; comparing the face data with face verification data in a local face library of the point of interest to obtain a comparison result; the face verification data is issued by a server when a target social object has a resource transfer record at the point of interest and the local face library of the point of interest does not store face verification data of the target object; the target social object is a social object having an intimate social relationship with the target object; and when the comparison result indicates that the face data is consistent with the face verification data, transferring resources of the target object.
[0021] A computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the following steps: collecting face data of a target object when the target object interacts with a product at a point of interest; comparing the face data with face verification data in a local face library of the point of interest to obtain a comparison result; the face verification data is issued by a server when a target social object has a resource transfer record at the point of interest and the local face library of the point of interest does not store face verification data of the target object; the target social object is a social object having an intimate social relationship with the target object; and when the comparison result indicates that the face data is consistent with the face verification data, transferring resources of the target object.
[0022] The resource transfer method, device, computer device and storage medium described above, when the target object interacts with a product at a point of interest, collects face data of the target object, and compares the face data with face verification data in a local face library of the point of interest to obtain a comparison result; wherein the face verification data is issued by the server when it is determined that the target social object exists at the point of interest and the local face library of the point of interest does not store the face verification data of the target object; the target social object is a social object that has an intimate social relationship with the target object; and when the comparison result indicates that the face data is consistent with the face verification data, the resource of the target object is transferred. Since the face verification data of the target object is issued in advance to the local face library of the point of interest, that is, the local face library already stores the face verification data of the target object, the data in the local face library can be directly used for local recognition, and there is no need to interact with the cloud for recognition verification, so that the efficiency of the first use of the user to perform the resource transfer operation by face recognition can be effectively improved, the time consumption of the user to perform the resource transfer by face recognition is effectively reduced, and the user experience is improved. BRIEF DESCRIPTION OF DRAWINGS
[0023] Figure 1 An application environment diagram of a resource transfer method in an embodiment;
[0024] Figure 2 A flowchart of a resource transfer method in an embodiment;
[0025] Figure 3 A flowchart of a step of finding a target social object having an intimate social relationship with a target object in an embodiment;
[0026] Figure 4 A flowchart of a step of determining at least one social object as a target social object having an intimate social relationship when the target object and the at least one social object having a friend relationship chain are in the same social group in an embodiment;
[0027] Figure 5 A flowchart of a resource transfer method in another embodiment;
[0028] Figure 6 A schematic diagram of a product side in an embodiment;
[0029] Figure 7 A schematic diagram of the overall architecture of a resource transfer system in an embodiment;
[0030] Figure 8 A structural block diagram of a resource transfer device in an embodiment;
[0031] Figure 9 A structural block diagram of a resource transfer device in another embodiment;
[0032] Figure 10 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0033] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0034] The resource transfer method provided in this application can be applied to, for example... Figure 1 The application environment shown. For example... Figure 1 As shown, the application environment includes a terminal 102, a server 104, and a resource transfer device 106. The application environment can be one where the terminal 102 interacts with the server 104, and the server 104 interacts with the resource transfer device 106. Specifically, the terminal 102 communicates with the server 104 via a network, and the server 104 communicates with the resource transfer device 106 via a network. A local database 108 is deployed in the resource transfer device 106. Server 104 can receive the location information of the target object reported by terminal 102 through a social application. Server 104 searches for target social objects with close social relationships with the target object. When server 104 determines that the target social object has a resource transfer record at the point of interest corresponding to the location information, server 104 queries the target object's face verification data in the local face database of the point of interest corresponding to the location information. If server 104 does not find the target object's face verification data, server 104 sends the target object's face verification data to the local face database. The sent face verification data is used to instruct the resource transfer device 106 of the point of interest to perform resource transfer based on the face verification data and the collected face data when the target object interacts with the product at the point of interest.
[0035] The terminal 102 and the resource transfer device 106 may be, but are not limited to, various personal computers, laptops, smartphones, tablets, portable wearable devices, smart voice interaction devices, smart home appliances, vehicle terminals, and other vehicle networking devices.
[0036] The local database 108 can be a database deployed independently or a database deployed in the resource transfer device 106. The server 104 can be implemented by an independent server or a server cluster composed of multiple servers. It can be understood that the server 104 provided in the embodiments of the present application can also be a service node in a blockchain system. The service nodes in the blockchain system form a peer-to-peer (P2P, Peer To Peer) network among each other. The P2P protocol is an application layer protocol running on the transmission control protocol (TCP, Transmission Control Protocol) protocol.
[0037] In one embodiment, as shown in Figure 2 , a resource transfer method is provided. The method is described by taking the server in Figure 1 as an example, and includes the following steps:
[0038] Step 202, receiving the location information of the target object reported through the social application.
[0039] The social application refers to a social software, that is, a software for realizing communication through a network is a social software. Broadly speaking, a communication device such as a mobile phone or a fixed phone also belongs to the category of a social software, that is, all software capable of communicating with people is called a social software. The social software in the embodiments of the present application can be a social application program (i.e., a social APP, Application), that is, various types of social application programs installed in a user terminal. For example, the social application can include various types of social applications such as Facebook, Messenger, and WeChat.
[0040] The target object refers to each user registered to use the social application. For example, the background server of a certain social application can obtain that 100 users have registered to use the social application, and the background server stores the social account information corresponding to each user. It should be noted that the social account information of the user, the location information of the user, the resource transfer record, and the face verification data involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use, and processing of the related data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions.
[0041] The location information refers to the geographic location information of the location of the target object. For example, the location geographic information of the current location of the social user A is No. 42, Bao'an Avenue, Bao'an District, Shenzhen City; or the location geographic information of the location of the target object is specific latitude and longitude coordinate information.
[0042] Specifically, the server can receive the location information of the target object reported by the user terminal through the social application. That is, the user can start a social application with a face resource transfer function in the terminal through a trigger operation. The social application program collects the location information of the user by calling the built-in sensor in the terminal, and reports the location information of the user to the server, so that the server can receive the location information of the target object reported by the user terminal through the social application.
[0043] For example, user A can start an application with a face resource transfer function in the terminal through a trigger operation. The application collects the current location information of user A by calling the built-in motion sensor in the terminal, and reports the current location information of user A to the server, so that the server can receive the location information of user A reported through the application in real time.
[0044] Step 204, find a target social object having an intimate social relationship with the target object.
[0045] The target social object refers to an object having an intimate social relationship with the target object. For example, user A and user B have an intimate social relationship, and user B can be a target social object.
[0046] The intimate social relationship refers to a relationship between users that meets the preset intimate social relationship condition, that is, an intimate social relationship. For example, the preset intimate social relationship condition is that the relationship between users is a friend relationship in the social application, and the social frequency between users reaches a preset frequency threshold. When the relationship between users meets the above-mentioned preset intimate social relationship condition, it can be determined that the relationship between users is an intimate social relationship.
[0047] Specifically, after the server receives the location information of the target object reported through the social application, the server can find a target social object having an intimate social relationship with the target object. Assuming that the target object is user A in the social application, and the preset intimate social relationship condition is that the relationship between users in the social application is a friend relationship, and the social frequency between users reaches a preset frequency threshold 80, after the server receives the location information of user A reported through the social application, the server can find a social object in the social application whose relationship with user A is a friend relationship and whose social frequency with user A reaches the preset frequency threshold 80. Assuming that the relationship between user A and user B, user C in the social application is a friend relationship, and the social frequency between user A and user B, user C is 120, 30 respectively, since 120 is greater than the preset frequency threshold 80, the server can find that the target social object having an intimate social relationship with user A is user B.
[0048] It can be understood that the preset close social relationship condition configured in the embodiments of the present application includes but is not limited to the above conditions, and can also include other types of conditions and search methods. Here, the way of searching for a target social object having a close social relationship with the target object is not specifically limited.
[0049] In step 206, when it is determined that the target social object has a resource transfer record at the interest point corresponding to the location information, the face verification data of the target object is queried in the local face database of the interest point.
[0050] The interest point (POI, Point of Interest) can be a location point of product interaction that a user (such as a target object and a social object) is interested in. For example, in a geographic information system, it can be a shop, a supermarket, an apartment, etc. The interest point in the embodiments of the present application can be understood as a specific geographic location point in a positioning system, having a certain range interval. For example, points in the interval of POI number 030-039 all belong to the range interval contained by the interest point POI3.
[0051] The resource transfer record refers to a record corresponding to a resource transfer operation of a user when conducting product transactions at an interest point. For example, when user A conducts product transactions at interest point A, the resource transfer device transfers resources in the account of user A to another account, and at the same time generates a resource transfer record corresponding to the resource transfer operation of user A when conducting product transactions at interest point A. The resource transfer record can include various types of information corresponding to the resource transfer operation, such as the resource transfer amount of the resource transfer operation, the transfer-out account information of the resource transfer operation, and the transfer-in account information of the resource transfer operation.
[0052] The local face database refers to a face database deployed in the database of the resource transfer device. The local face database is used to store face verification data of each user.
[0053] The face verification data refers to face data used to verify the unique identity information of a user. For example, the face verification data of user A can be pre-collected authentication face data of user A that meets the requirements of face verification data. For example, under the authorization permission of user A, the face verification data of user A is reported to the server through a terminal application program.
[0054] Specifically, after the server finds the target social object having the close social relationship with the target object, when the server determines that the target social object has the resource transfer record in the interest point corresponding to the location information of the target object, the server queries the face verification data of the target object in the local face database of the interest point corresponding to the location information. That is, after the server finds the target social object having the close social relationship with the target object, the server can find whether there is the resource transfer record corresponding to the user identifier of the target social object in the interest point corresponding to the location information of the target object according to the user identifier of the target social object, and if the server finds the resource transfer record corresponding to the user identifier of the target social object in the interest point corresponding to the location information, the server determines that the target social object has the resource transfer record in the interest point corresponding to the location information of the target object. In addition, when the server determines that a certain target social object does not have the resource transfer record in the interest point corresponding to the location information, the server continues to find whether there is the resource transfer record corresponding to the user identifier of the next target social object in the interest point corresponding to the location information according to the user identifier of the next target social object, and stops finding when all the target social objects are found whether there is the resource transfer record in the interest point corresponding to the location information.
[0055] Further, when the server determines that the target social object has the resource transfer record in the interest point corresponding to the location information of the target object, the server can query whether there is the face verification data of the target object in the local face database of the interest point corresponding to the location information of the target object. The interest point corresponding to the location information of the target object can include multiple interest points, for example, the location information of the target object is a building A, and the interest point corresponding to the location information of the target object can include the interest point A101, A102 corresponding to the first floor of the building A, the interest point A201, A202 corresponding to the second floor, and the interest point A302, A302 corresponding to the third floor, etc.
[0056] For example, assume that the server receives the location information of the target object, i.e., user A01, as POIA, the geographical location information corresponding to POIA is A Mansion in Nanshan District, Shenzhen City, Guangdong Province, the server finds that the target social object in close social relationship with user A is user B01, and then the server can search whether there is a resource transfer record corresponding to user identifier B01 in the interest point corresponding to the location information POIA of user A according to the user identifier B01 of user B01. Assume that user B01 generated a resource transfer record POIA101-B01 when interacting with a product at the interest point POIA101 corresponding to A Mansion in Nanshan District, Shenzhen City, Guangdong Province at 10:35 on October 29, 2021, and when the server finds that there is a resource transfer record POIA101-B01 corresponding to user B01 in the interest point corresponding to the location information POIA of user A, the server determines that there is a resource transfer record of user B01 in the interest point POIA101 corresponding to the location information POIA of user A. Further, when the server determines that there is a resource transfer record of user B01 in the interest point POIA101 corresponding to the location information POIA of user A, the server can query whether there is face verification data of user A in the local face database of the interest point POIA101 corresponding to the location information POIA of user A.
[0057] In step 208, if the face verification data of the target object is not queried, the face verification data of the target object is sent to the local face database; wherein the sent face verification data is used to instruct the resource transfer device of the interest point to perform resource transfer based on the face verification data and the collected face data when the target object interacts with a product at the interest point.
[0058] The product interaction refers to the product interaction operation between the user and the resource transfer device when the user performs product transaction. For example, when the user performs product transaction, the user can start the product interaction control in the resource transfer device by triggering operation, so that the product interaction control can perform corresponding interaction operation.
[0059] The resource transfer device refers to a device used for resource transfer operation when the user performs product transaction, for example, the resource transfer device can include face recognition terminal device, terminal device, multifunctional terminal device and other types of devices, and the multifunctional terminal device can include pos (Point of sales terminal) and other devices.
[0060] The face data refers to the face data collected by the camera, which can be face streaming data, such as face video streaming data collected by the camera; or face image directly collected by the camera.
[0061] Resource transfer refers to an operation of transferring resources from one account to another account. That is, the ownership of resources is changed from one party to another party, and from the perspective of technical implementation, it refers to transferring resources from one user account (a transfer-out account) to another user account (a transfer-in account). In the field of computer technology, resources generally refer to virtual resources corresponding to entity resources in the real world, such as storage space, computing power, currency property for network transactions, such as Renminbi, US dollars, and virtual currencies such as Q coins and game coupons purchased by users. The resources in the embodiments of the present application can be virtual resources, for example, the virtual resources include but are not limited to virtual currency resources and virtual gift resources. The receiver of the virtual gift resources is not limited to obtaining virtual currency resources equivalent to the virtual gift resources in the gift value by receiving the virtual gift resources.
[0062] Specifically, when the server determines that the target social object has a resource transfer record at the interest point corresponding to the location information, the server can query the face verification data of the target object in the local face library of the interest point. If the server does not query the face verification data of the target object, the server downloads the face verification data of the target object to the local face library; wherein the downloaded face verification data is used to instruct the resource transfer device of the interest point to perform resource transfer based on the face verification data and the collected face data when the target object interacts with the product at the interest point.
[0063] For example, when the server determines that user B01 has a resource transfer record at the interest point POIA101 corresponding to the location information POIA of user A, the server can query whether there is face verification data A of user A in the local face library of the interest point POIA101 corresponding to the location information POIA of user A. If the server does not query the face verification data A of user A, the server downloads the face verification data A of user A to the local face library of the interest point POIA101, so that when user A interacts with the product at the interest point POIA101, the resource transfer device pos101 of the interest point POIA101 performs resource transfer based on the face verification data A and the face data collected in real time by the resource transfer device pos101.
[0064] In addition, if the server queries the face verification data of the target object in the local face library of the interest point corresponding to the location information of the target object, the server can also perform the corresponding process according to the preset steps, for example, when the server queries the face verification data of the target object, but the face verification data of the target object exceeds the valid period, the server can adjust the valid period of the face verification data, so that the face verification data of the target object is within the valid period, and when the target object interacts with the product at the interest point, the resource transfer device of the interest point can identify and verify the resource transfer operation of the target object based on the face verification data.
[0065] In the resource transfer method, the position information of the target object reported through the social application is received, a target social object having an intimate social relationship with the target object is found, when it is determined that the target social object has a resource transfer record at the interest point corresponding to the position information, the face verification data of the target object is queried from the local face library at the interest point, and if the face verification data of the target object is not queried, the face verification data of the target object is issued to the local face library. The face verification data issued is used to instruct the resource transfer device at the interest point to perform resource transfer based on the face verification data and the collected face data when the target object performs product interaction at the interest point. Since the target social object having an intimate social relationship with the target object is found, and it is determined that the target social object has a resource transfer record at the interest point close to the position information of the target object, the potential interest point that the target object may reach can be inferred, and the face verification data of the target object is issued to the local face library at the interest point where the target object may potentially perform face brushing resource transfer. When the target object performs product interaction at the interest point, local recognition can be performed using the data in the local face library, and there is no need to interact with the cloud for recognition verification, so that the efficiency of the first use of face brushing for resource transfer operation of the user can be effectively improved, the time consumption of the user for face brushing for resource transfer is effectively reduced, and the user experience is improved.
[0066] In one embodiment, as shown in Figure 3 The step of finding the target social object having an intimate social relationship with the target object includes:
[0067] In step 302, the social objects having a friend relationship chain with the target object are acquired.
[0068] In step 304, when the target object and at least one social object having a friend relationship chain are in the same social group, the at least one social object is determined as the target social object having an intimate social relationship.
[0069] The friend relationship chain refers to a linked list established based on the friend relationship between social users. For example, user A adds user B as a friend, and the background server can add the user identifier of user B in the friend relationship chain table of user A, that is, user B is marked as a friend of user A.
[0070] Specifically, after the server receives the position information of the target object reported through the social application, the server can find the target social object having an intimate social relationship with the target object, that is, the server can acquire the social objects having a friend relationship chain with the target object. When the server determines that the target object and at least one social object having a friend relationship chain are in the same social group, the server can determine the at least one social object as the target social object having an intimate social relationship.
[0071] For example, assuming that the social objects in the friend chain of user A include user B and user C, after the server receives the location information of the target object, i.e., user A, reported through the social application, the server can find the target social object having an intimate social relationship with user A, i.e., the server can obtain the social objects having a friend relationship chain with user A as user B and user C. When the server determines that user A and the social object user B having a friend relationship chain are in the same social group C01, the server can determine user B as the target social object having an intimate social relationship. The above user C belongs to the social object having a friend relationship chain with user A, but user C is not in the same social group as user A, and thus user C is not the target social object having an intimate social relationship with user A. Therefore, based on the friend chain information of the target user and the social group relationship between the target user and other users, the target social group having an intimate social relationship with the target user can be accurately and quickly determined, so that the subsequent interest point that the target user is likely to reach can be inferred according to the resource transfer state of the target social group, and the face verification data of the target user can be issued in advance to the local database of the interest point where the potential face brushing resource transfer operation is likely to occur, so as to improve the user experience of the first use of the face brushing resource transfer operation by the user.
[0072] In one embodiment, as shown in FIG. 1, the social group includes an intimate social group, and when the target object and at least one social object having a friend relationship chain are in the same social group, the step of determining the at least one social object as the target social object having an intimate social relationship includes: Figure 4
[0073] Step 402: Obtain group member objects in the intimate social group.
[0074] Step 404: If at least one group member object belongs to a social object in the friend relationship chain, determine the social frequency between the target object and the at least one group member object.
[0075] Step 406: If the social frequency reaches a preset frequency threshold, determine the at least one group member object as the target social object having an intimate social relationship.
[0076] The intimate social group refers to a group having an intimate relationship with the target object, for example, user A establishes a social group named "loving family", and when the relationship between the social group and user A meets the social group having an intimate relationship, the social group named "loving family" is the intimate social group.
[0077] Specifically, the server can acquire group member objects in the intimate social group, and if the server determines that at least one group member object belongs to a social object in the friend relationship chain of the target object, the server finds the social frequency between the target object and the at least one group member object; if the server determines that the social frequency between the target object and the group member object reaches a preset frequency threshold, the server determines the at least one group member object as a target social object that has an intimate social relationship with the target object.
[0078] For example, assuming that all group member objects in an intimate social group named "loving family" are user A, user B, user C and user D, and the social objects in the friend relationship chain of user A include user B and user C, the server can acquire all group member objects in the intimate social group named "loving family", and if the server determines that user B and user C in the group member objects of the intimate social group named "loving family" belong to the social objects in the friend relationship chain of user A, the server can find the social frequency between user A and user B and user C, respectively.
[0079] Assuming that the preset frequency threshold is 80, and the server finds that the social frequency between user A and user B and user C is 120 and 30, respectively, the server can determine that the social frequency between user A and user B reaches the preset frequency threshold 80, and since 120 is greater than the preset frequency threshold 80, the server determines user B in the intimate social group named "loving family" as a target social object that has an intimate social relationship with user A. Thus, based on the friend chain information of the target user and the social group relationship between the target user and other users, the target social group that has an intimate social relationship with the target user can be accurately and quickly determined, so that the subsequent interest point that the target user may potentially reach can be inferred according to the resource transfer state of the target social group, and the face verification data of the target user can be issued in advance to the local database of the related interest point where the face resource transfer operation may potentially occur, so as to improve the user experience of the target user when using the face resource transfer operation for the first time.
[0080] In one embodiment, when it is determined that the target social object has a resource transfer record in the interest point corresponding to the location information, the step of querying the face verification data of the target object in the local face library of the interest point includes:
[0081] Finding a candidate interest point where the target social object has a resource transfer record;
[0082] Determining the distance between the location of the candidate interest point and the location information;
[0083] When the distance is less than or equal to the preset distance threshold, the candidate interest point is taken as the interest point corresponding to the location information, and it is determined that the target social object has a resource transfer record in the interest point;
[0084] The face verification data of the target object is queried in the local face library of the interest point.
[0085] Specifically, the server receives the location information of the target object reported through the social application, and finds the target social object having an intimate social relationship with the target object. When the server determines that the target social object has a resource transfer record in the interest point corresponding to the location information of the target object, the server can query whether there is face verification data of the target object in the local face library of the interest point corresponding to the location information of the target object. That is, the server can find the candidate interest point having the resource transfer record of the target social object, and determine the distance between the location of the candidate interest point and the location information of the target object. When the server detects that the distance between the location of the candidate interest point and the location information of the target object is less than or equal to the preset distance threshold, the server can take the candidate interest point as the interest point corresponding to the location information of the target object, and determine that the target social object has a resource transfer record in the interest point corresponding to the location information of the target object. Further, the server can query whether there is face verification data of the target object in the local face library of the interest point corresponding to the location information of the target object.
[0086] For example, assuming that the server receives the location information of the target object, i.e. user A, reported through the social application as POIA, and finds that the target social object having an intimate social relationship with user A is user B, the server can further find that the candidate interest points having the resource transfer record of user B are POIA101, POIB101 and POIF101, and the server can calculate the distance between each candidate interest point and the location information POIA of user A.
[0087] Assuming that the preset distance threshold is 100, the server calculates that the distance between the location of the candidate interest point POIA101 and the location information POIA of user A is 30; the distance between the location of the candidate interest point POIB101 and the location information POIA of user A is 890; and the distance between the location of the candidate interest point POIF101 and the location information POIA of user A is 960. Since 30 is less than 100, that is, the server detects that the distance between the location of the candidate interest point POIA101 and the location information POIA of user A is less than the preset distance threshold 100, the server can take the candidate interest point POIA101 as the interest point corresponding to the location information POIA of user A, and determine that user B exists in the resource transfer record of the interest point POIA101 corresponding to the location information POIA of user A. Further, the server can query whether the face verification data of user A exists in the local face database of the interest point POIA101. Thus, the target user's potential possible arrival interest point can be inferred according to the resource transfer record of the target social group, and it is queried whether the face verification data of the target user exists in the local face database of the target user's potential possible arrival interest point. If not, the face verification data of the target user can be issued in advance to the local database of the related potential possible interest point where the face verification data of the target user is transferred, so as to reduce the time consumption of the user's face verification resource transfer, and also improve the user experience of the user's first use of the face verification resource transfer operation.
[0088] In one embodiment, the local face database is a database deployed in the resource transfer device; and the method further comprises:
[0089] obtaining a resource transfer device list of the interest point, wherein the resource transfer device list comprises device information of at least two resource transfer devices;
[0090] if the face verification data of the target object is not queried, issuing the face verification data of the target object to the local face database, comprising:
[0091] if the face verification data of the target object is not queried in at least one resource transfer device of the resource transfer device list, issuing the face verification data of the target object to the local face database of each resource transfer device.
[0092] Specifically, after the server receives the location information of the target object reported through the social application and finds the target social object having an intimate social relationship with the target object, when the server determines that the target social object exists in the resource transfer record of the interest point corresponding to the location information of the target object, the server can further obtain the resource transfer device list of the interest point corresponding to the location information of the target object, wherein the resource transfer device list comprises device information of at least two resource transfer devices, and the local face database is deployed in the database of each resource transfer device.
[0093] Further, the server can query whether the face verification data of the target object exists in the local face library of the resource transfer device corresponding to the resource transfer device list of the interest point corresponding to the position information of the target object. If the server does not query the face verification data of the target object in at least one resource transfer device in the resource transfer device list, the server distributes the face verification data of the target object to the local face library of each resource transfer device.
[0094] For example, assuming that the server obtains the device information of the resource transfer device included in the resource transfer device list of the interest point POIA101 corresponding to the position information POIA of the target object, i.e., user A, as pos11, pos22 and pos33, the server can query whether the face verification data of the target object exists in the local face library of each resource transfer device in the resource transfer device list. If the server does not query the face verification data of the target object in the resource transfer devices pos11 and pos22 in the resource transfer device list, the server distributes the face verification data of the target object to the local face library of the resource transfer devices pos11 and pos22. If the server queries the face verification data of the target object in the resource transfer device pos33 in the resource transfer device list, the server can further query whether the face verification data of the target object exceeds the limited period, and perform the processing steps of the next process. Thus, according to the resource transfer record of the target social group, the interest point that the target user is likely to reach can be inferred, and whether the face verification data of the target user exists in the local face library of the resource transfer device of the interest point that the target user is likely to reach can be queried. If not, the face verification data of the target user can be distributed in advance to the local database of the resource transfer device where the face recognition resource transfer operation is likely to occur, so as to reduce the time consumption of the user face recognition resource transfer, and improve the user experience of the first use of the face recognition resource transfer operation.
[0095] In one embodiment, the method further comprises:
[0096] If the face verification data of the target object is queried, but the face verification data of the target object exceeds the valid period, the valid period of the face verification data is adjusted; or
[0097] The face verification data of the target object is re-collected, and the collected face verification data is distributed to the local face library.
[0098] Specifically, the server receives the location information of the target object reported through the social application, and finds the target social object having an intimate social relationship with the target object. When the server determines that the target social object has a resource transfer record at the interest point corresponding to the location information of the target object, the server can query whether there is face verification data of the target object in the local face library of the interest point corresponding to the location information of the target object. If the server queries the face verification data of the target object in the local face library of the interest point, but the face verification data of the target object is out of the valid period, the server can adjust the valid period of the face verification data. Or, the server can re-collect the face verification data of the target object, and distribute the re-collected face verification data to the local face library of the interest point corresponding to the location information of the target object.
[0099] For example, the server receives the location information of the target object, i.e. user A, reported through the social application as POIA, and finds the target social object having an intimate social relationship with user A as user B. When the server determines that user B has a resource transfer record at the interest point POIA101 corresponding to the location information POIA of user A, the server can query whether there is face verification data A of user A in the local face library of the interest point POIA101.
[0100] Suppose the valid period of the face verification data A of user A is from October 31, 2010 to October 31, 2021. If the server queries the face verification data A of user A in the local face library of the interest point POIA101, but the face verification data A of user A is out of the valid period, the server can adjust the valid period of the face verification data A, i.e. the server can adjust the valid period of the face verification data A of user A to October 31, 2021 to October 31, 2022, and update the valid period of the face verification data A of user A in the local face library of the interest point POIA101 at the same time.
[0101] Or, the server can re-collect the face verification data A of user A, and distribute the re-collected face verification data A to the local face library of the interest point POIA101. In this way, the potential interest point that the target user may reach can be inferred according to the resource transfer record of the target social group, and it can be queried whether there is face verification data of the target user in the local face library of the interest point that the target user may reach. If the face verification data of the target object is queried, but the face verification data of the target object is out of the valid period, the valid period of the face verification data can be adjusted in advance. Or, the face verification data of the target object is re-collected, and the collected face verification data is distributed to the local face library, so as to reduce the time consumption of the user to perform the face recognition resource transfer, and also improve the user experience of the user to use the face recognition resource transfer operation.
[0102] In one embodiment, the local face library is a database deployed on the resource transfer device; before receiving the location information of the target object reported through the social application, the method further comprises:
[0103] When the face data collected by the resource transfer device is received, the face data is matched with the face verification data stored in the background to obtain a matching result;
[0104] If the matching result indicates that the face data is consistent with the face verification data stored in the background, the face verification data and the resource account information of the target object are issued to the resource transfer device.
[0105] Specifically, before the server receives the location information of the target object reported through the social application, when the server receives the face data collected by the resource transfer device, the server can match the face data uploaded by the resource transfer device with the face verification data stored in the background to obtain a matching result; if the matching result indicates that the face data is consistent with the face verification data stored in the background, the server can issue the face verification data and the resource account information of the target object to the resource transfer device. Wherein, when the server matches the face data uploaded by the resource transfer device with the face verification data stored in the background, any face data matching method can be used, and here the way of matching the face data with the face verification data stored in the background is not limited. For example, a similarity matching method can be used, the server can perform similarity matching on the face data uploaded by the resource transfer device and the face verification data stored in the background, if the similarity between the face data uploaded by the resource transfer device and the face verification data stored in the background reaches a preset similarity threshold, it indicates that the matching is successful; if the similarity between the face data uploaded by the resource transfer device and the face verification data stored in the background does not reach the preset similarity threshold, it indicates that the matching fails, and the server can return a matching failure response message to the resource transfer device.
[0106] For example, before the server receives the location information of the target object reported through the social application, when the server receives the face data A of user A collected by the resource transfer device pos11 in real time, the server can match the face data A of user A uploaded by the resource transfer device pos11 with the face verification data A of user A stored in the background, to obtain a matching result. If the matching result indicates that the face data A is consistent with the face verification data A stored in the background, the server can download the face verification data A and the resource account information of user A to the resource transfer device pos11. Therefore, when the user interacts with the product at the interest point, the local face library is preferentially used for local recognition. Only when the local face library cannot be recognized, the collected face data is uploaded to the server for matching recognition, so that the corresponding processing flow can be effectively adopted for different business conditions under different scenarios, thereby effectively improving the user experience.
[0107] In one embodiment, as shown in Figure 5 , a resource transfer method is provided. Taking the resource transfer device in Figure 1 as an example, the method comprises the following steps:
[0108] Step 502, when the target object interacts with the product at the interest point, the face data of the target object is collected.
[0109] Step 504, compare the face data with the face verification data in the local face library of the interest point to obtain a comparison result; the face verification data is face verification data issued by the server when it is determined that the target social object has a resource transfer record at the interest point, and the local face library of the interest point does not store the face verification data of the target object; the target social object is a social object having an intimate social relationship with the target object.
[0110] Step 506, when the comparison result indicates that the face data is consistent with the face verification data, the resource of the target object is transferred.
[0111] The comparison result refers to the comparison result between the collected face data and the face verification data in the local face library of the interest point. The comparison result can include a comparison result indicating that the face data is consistent with the face verification data, or a comparison result indicating that the face data is inconsistent with the face verification data.
[0112] Specifically, when the target object interacts with the product at the interest point, the resource transfer device can call the built-in camera to collect the face data of the target object, and compare the collected face data with the face verification data in the local face library of the interest point to obtain a comparison result. The face verification data is issued by the server when it is determined that the target social object has a resource transfer record at the interest point, and the local face library of the interest point does not store the face verification data of the target object. The target social object is a social object that has an intimate social relationship with the target object. Further, when the comparison result indicates that the face data is consistent with the face verification data, the resource transfer device transfers the resource of the target object.
[0113] For example, when the target object, i.e., user A, interacts with the product at the interest point POI A101, the resource transfer device pos101 can call the built-in camera to collect the face data A of user A, and compare the collected face data A with the face verification data A in the local face library, to obtain a comparison result. The face verification data A is issued by the server when it is determined that the target social object, i.e., user B01, has a resource transfer record at the interest point POI A101, and the local face library of the interest point POI A101 does not store the face verification data A of user A. User B01 is a social object that has an intimate social relationship with user A. Further, when the comparison result indicates that the face data A is consistent with the face verification data A, the resource transfer device pos101 transfers the resource in the account of user A.
[0114] In the above resource transfer method, when the target object interacts with the product at the interest point, the face data of the target object is collected, and the face data is compared with the face verification data in the local face library of the interest point to obtain a comparison result. The face verification data is issued by the server when it is determined that the target social object has a resource transfer record at the interest point, and the local face library of the interest point does not store the face verification data of the target object. The target social object is a social object that has an intimate social relationship with the target object. When the comparison result indicates that the face data is consistent with the face verification data, the resource of the target object is transferred. Since the face verification data of the target object is issued in advance to the local face library of the interest point, i.e., the local face library already stores the face verification data of the target object, the data in the local face library can be directly used for local recognition, without the need for interaction with the cloud for recognition verification, thereby effectively improving the efficiency of the user's first use of face recognition for resource transfer operation, effectively reducing the time consumption of the user's face recognition for resource transfer, and improving the user experience.
[0115] In one embodiment, the step of collecting the face data of the target object includes:
[0116] Collecting at least two video frame images of the target object.
[0117] determining the sharpness of each video frame image and the face angle in each video frame image;
[0118] determining the score of each video frame image based on the sharpness and the face angle;
[0119] selecting the video frame image corresponding to the maximum score as the face data of the target object.
[0120] The video frame image refers to each frame image in the video stream data.
[0121] The sharpness refers to the clarity of each detail image and its boundary. The sharpness in the embodiments of the present application is used to measure the quality of the video frame image.
[0122] The face angle refers to the face posture information of the target object. The face posture information is used to reflect the angle information of the face orientation. The face posture information can include the pitch angle information, the yaw angle information and the roll angle information.
[0123] Specifically, the resource transfer device can call the built-in camera to collect at least two video frame images of the target object, and determine the sharpness of each video frame image and the face angle in each video frame image. Further, the resource transfer device can determine the score of each video frame image based on the sharpness and the face angle, and select the video frame image corresponding to the maximum score as the face data of the target object.
[0124] For example, the resource transfer device can call the built-in camera to collect the video stream data of the target object, and screen each frame image in the collected video stream data. Assuming that the video stream data collected by the resource transfer device contains five frame images, respectively Figure 1 、 Figure 2 、 Figure 3 、 Figure 4 and Figure 5 , the resource transfer device can determine the sharpness of each video frame image and the face angle in each video frame image. Further, the resource transfer device can determine the score of each video frame image based on the sharpness of each frame image and the face angle in each frame image. Assuming that the score of each video frame image determined by the resource transfer device based on the sharpness of each frame image and the face angle in each frame image is Figure 1 、 Figure 2 、 Figure 3 、 Figure 4 and Figure 5 respectively 80, 85, 86, 90 and 95, the resource transfer device can select the video frame image corresponding to the maximum score 95, that is Figure 5Face data of the target object. Thus, when the user interacts with the product at the point of interest, the resource transfer device of the point of interest can automatically call the built-in camera to collect the video stream data of the target object, and screen each frame of image in the collected video stream data, so as to quickly and accurately screen the optimal face data, and match and identify the face data with the face verification data in the local face library, thereby improving the efficiency of local identification of face data, effectively reducing the time consumption of the user in face recognition for resource transfer, and improving the user experience.
[0125] In one embodiment, the method further comprises:
[0126] When the comparison result indicates that the face data is inconsistent with the face verification data, uploading the face data to the server to enable the server to match the face data with the face verification data stored in the background.
[0127] Specifically, when the target object interacts with the product at the point of interest, the resource transfer device can call the built-in camera to collect the face data of the target object, and compare the collected face data with the face verification data in the local face library of the point of interest to obtain a comparison result. The face verification data is issued by the server when the target social object has a resource transfer record at the point of interest and the local face library of the point of interest does not store the face verification data of the target object. The target social object is a social object having an intimate social relationship with the target object. Further, when the comparison result indicates that the face data is inconsistent with the face verification data, the resource transfer device can upload the face data to the server to enable the server to match the face data with the face verification data stored in the background.
[0128] For example, when the target object, i.e., user A, interacts with a product at the point of interest POI A101, the resource transfer device pos101 can call the built-in camera to collect the face data A of user A, and compare the collected face data A with the face verification data A in the local face library, to obtain a comparison result. The face verification data A is issued by the server when the target social object, i.e., user B01, has a resource transfer record at the point of interest POI A101, and the local face library of the point of interest POI A101 does not store the face verification data A of user A. User B01 is a social object having an intimate social relationship with user A. Further, when the comparison result indicates that the face data A is inconsistent with the face verification data A, the resource transfer device pos101 can upload the face data A to the server, so that the server matches the face data A with the face verification data A stored in the background. If the matching is successful, the server returns the matching result to the resource transfer device pos101, so that the resource transfer device pos101 transfers the resource in the account of user A. Thus, when a user interacts with a product at a point of interest, the data in the local face library is preferentially used for local recognition. Only when the local face library cannot be recognized, the collected face data is uploaded to the server for matching recognition. Therefore, the corresponding processing flow can be effectively adopted for different business conditions under different scenarios, thereby effectively improving the user experience.
[0129] In one embodiment, a resource transfer system is provided, which includes:
[0130] A user device configured to report location information of a target object to a server through a social application;
[0131] A server configured to find a target social object having an intimate social relationship with the target object, and query face verification data of the target object from a local face library of a point of interest when it is determined that the target social object has a resource transfer record at the point of interest corresponding to the location information. If the face verification data of the target object is not queried, the face verification data of the target object is issued to the local face library.
[0132] A resource transfer device configured to perform resource transfer based on the face verification data and collected face data when the target object interacts with a product at the point of interest.
[0133] Specifically, in the resource transfer system, the user equipment can report the location information of the target object to the server through the social application, and after the user equipment reports the location information of the target object to the server through the social application, the user equipment can receive the authorization request sent by the server; the authorization request is generated by the server when it is determined that the target social object has a resource transfer record at the interest point of the location information, and the local face library of the interest point does not store the face verification data of the target object; the target social object is a social object that has an intimate social relationship with the target object.
[0134] Further, the user equipment sends authorization confirmation information to the server in response to the authorization request to authorize the server to issue the face verification data of the target object to the local face library of the interest point; wherein the issued face verification data is used to instruct the resource transfer equipment of the interest point to perform resource transfer based on the face verification data and the collected face data when the target object interacts with the product at the interest point. That is, when the target object interacts with the product at the interest point, the resource transfer equipment of the interest point can perform resource transfer based on the face verification data and the collected face data.
[0135] The server in the embodiment of the present application can find a target social object that has an intimate social relationship with the target object; when the server determines that the target social object has a resource transfer record at the interest point corresponding to the location information of the target object, it queries the local face library of the interest point corresponding to the location information of the target object to determine whether there is face verification data of the target object; if the server does not query the face verification data of the target object in the local face library, the server issues the face verification data of the target object to the local face library; if the server queries the face verification data of the target object in the local face library of the interest point corresponding to the location information of the target object, the server can also execute the corresponding process according to the preset steps, for example, when the server queries the face verification data of the target object, but the face verification data of the target object exceeds the valid period, the server can adjust the valid period of the face verification data, so that the face verification data of the target object is within the valid period, and when the target object interacts with the product at the interest point, the resource transfer equipment of the interest point can identify and verify the resource transfer operation of the target object based on the face verification data.
[0136] In this embodiment, by searching for a target social object having an intimate social relationship with the target object and determining that the target social object has a resource transfer record at a point of interest close to the location information of the target object, the potential possible arrival point of interest of the target object can be inferred, and the face verification data of the target object is pre-downloaded to the local face library of the point of interest where the target object is likely to occur face recognition resource transfer, so that local recognition can be performed using the data in the local face library when the target object interacts with the product at the point of interest, without the need for interaction with the cloud for identification verification, thereby effectively improving the efficiency of the user's first use of face recognition for resource transfer operation, effectively reducing the time consumption of the user's face recognition for resource transfer, and improving the user experience.
[0137] The application also provides an application scenario applying the above resource transfer method. Specifically, the resource transfer method is applied in the application scenario as follows.
[0138] When the user interacts with the product at a certain store offline, the above resource transfer method can be used, that is, the user terminal can report the location information of the target object to the server through the social application, and the server can search for a target social object having an intimate social relationship with the target object. When the server determines that the target social object has a resource transfer record at the store corresponding to the location information of the target object, the local face library of the store corresponding to the location information of the target object is queried to determine whether the face verification data of the target object exists. If the server does not query the face verification data of the target object in the local face library of the store, the server pre-downloads the face verification data of the target object to the local face library of the store, so that the resource transfer device of the store can perform resource transfer based on the face verification data in the local face library and the collected face data when the target object interacts with the product in the store. Since a target social object having an intimate social relationship with the target user is searched for, and it is determined that the target social object has a resource transfer record at a store close to the target user, the potential possible arrival point or store of the target user can be inferred, and the face verification data of the target user is pre-downloaded to the local face library of the store, so that local recognition can be performed using the data in the local face library when the target user interacts with the product at the point of interest or the store, without the need for interaction with the cloud for identification verification, thereby effectively improving the efficiency of the user's first use of face recognition for resource transfer operation, effectively reducing the time consumption of the user's face recognition for resource transfer, and improving the user experience.
[0139] The method provided by the application embodiment can be applied to the scene of the user's first face recognition for resource transfer. The resource transfer method provided by the application embodiment is described below with reference to the scene of the user interacting with the product at an offline store, including the following steps:
[0140] In the traditional resource transfer mode, the experience of the user's first face payment based on face payment business is crucial to the stickiness of whether the user continues to use the business product. Since the user needs to perform identification verification in the cloud when performing the payment operation for the first time, it is easy to be affected by the network, resulting in a long overall time consumption of the user's face payment experience, and also causing poor experience of the user's face payment.
[0141] Therefore, in order to solve the above problems, even in the case of the user's first face payment, the time consumption of the user's face payment can be effectively reduced, and the user experience can be effectively improved to ensure the service quality. In this embodiment, a method for inferring based on the payment activity state of the user's related close group is proposed, which specifically includes:
[0142] On the product side, for example, as shown in Figure 6 , it is a schematic diagram of the product side. Figure 6 The resource transfer device in may be a device with face payment function. It can be understood that the method provided by the embodiments of the present application can be applied to various software, mobile applications, terminal devices, etc. with face payment function.
[0143] On the technical side, as shown in Figure 7 , it is a schematic diagram of the overall architecture of the resource transfer system. Figure 7 The overall architecture in may include an IoT (Internet of Things, IoT) face terminal device, an IoT face backend related service, and a user device ABC, which can be a mobile phone or a vehicle networking device, etc.
[0144] I. User mobile phone end.
[0145] 1. The backend service, i.e. the server, can determine whether the relationship between user B and user C and user A belongs to a close relationship based on the following two conditions, i.e. the backend service infers the potential possible merchant or store of user A using face payment through the payment activity state of user B and user C.
[0146] Condition 1: User A is the target user who needs to issue face verification data to the local face terminal device in this case. In social applications, for example, in WeChat, user B and user C are friends of user A, and user B and user C exist in a certain WeChat group with user A.
[0147] Condition 2, user B and user C install WeChat APP on the mobile phone, and the user can obtain the login state information related to the user after logging in WeChat. When user B and user C use WeChat payment, the POI information of the payment place where user B and user C perform payment operation meets the preset distance threshold with the POI information of user A. For example, the POI information of the payment place of the code scanning payment or the payment code payment is close to the POI information of user A.
[0148] When the above conditions are met, the backend service can determine that user A, user B and user C are in an intimate relationship group. Assuming that the backend service queries the face verification data of user A and does not exist in the local face library of the face terminal device of the merchant or store where user B and user C have consumed, the backend service will push the face verification data of the user A to the local face library of the face terminal device of the merchant or store.
[0149] II. Face terminal device
[0150] The face terminal device core runs a face APP, and the core of the face APP includes a face recognition module, a library update module, etc. Face recognition refers to a technology of obtaining personal identity information through face multimedia information.
[0151] Specifically, when the face terminal device performs face collection and recognition, the face collection module in the face terminal device can collect the current face streaming media data of the user through the face APP calling the 3D camera. The 3D camera refers to the addition of living body related hardware and software, including depth camera and infrared camera, to ensure information security compared with traditional cameras.
[0152] After the face collection module obtains the face streaming media data, the face terminal device can optimize the images in the streaming media data. The preset conditions for optimization include: through the coefficients of face size, face angle, image contrast, image brightness and image clarity, the face terminal device performs comprehensive evaluation on each video frame image based on the above various coefficient indicators, and obtains the comprehensive score of each video frame image. The face terminal device selects the optimal face picture based on the comprehensive score of each video frame image, for example, the face terminal device can select the video frame image corresponding to the maximum comprehensive score as the optimal face picture.
[0153] Further, the face terminal device sends the selected optimal face data to the local face database for recognition, that is, calls the local recognition service to recognize the face data. If the local face database obtains a successful recognition result after recognition, the face terminal device can directly use the local recognition result to obtain the user identity information and then call the back-end WeChat payment service to directly perform the payment operation, that is, it is not necessary to upload the face picture of the user to the cloud for recognition verification, thereby greatly reducing the time consumption of the user for face payment operation and improving the user experience. If the local face database obtains a failed recognition result after recognition, the face terminal device needs to upload the currently collected face picture to the back-end service, call the back-end face recognition service to recognize and verify the face picture of the user, obtain the identity information of the user, and then perform the WeChat payment.
[0154] The library updating module in the face terminal device is configured to receive data pushed by the cloud, that is, the back-end service, to the local face database, or receive related operations such as addition, deletion, modification, and query of the cloud, that is, the back-end service, on the local database. For example, when the back-end service identifies that the face verification data of user A needs to be stored in the local face database of the face terminal device of the merchant or store consumed by users B and C, if the back-end service queries that the face verification data of user A does not exist in the local face database of the face terminal device of the merchant or store consumed by users B and C, the back-end service needs to push the face verification data of user A to the local face database and store the face verification data in the local face database. Subsequently, when user A performs face payment in the merchant or store consumed by users B and C, since the face data of user A has been stored in the local face database, the face terminal device can directly use the local data to perform face recognition to complete the face payment operation. The local database in the embodiment of the application can be a SQLite database, and SQLite is a lightweight database and a relational database management system complying with ACID.
[0155] III. Back-end service
[0156] 1. The core of the back-end service includes a cloud face payment service, a cloud face database updating service, and an intimate group library strategy reasoning service.
[0157] 2、Cloud face recognition service, for receiving face data uploaded from the terminal, extracting features from the face data uploaded by the terminal, obtaining corresponding feature data, comparing the feature data with the feature data in the back-end database, finding the highest score feature data, and matching the highest score feature data related to the face data with the face verification data in the back-end database to obtain a matching result. For example, in the WeChat system, if the matching is successful, the user's WeChat account or WeChat payment code related information is finally returned. After the cloud comparison result is displayed, the user's face feature data and the corresponding WeChat account information are sent to the corresponding face terminal device.
[0158] 3、Intimate group library strategy reasoning service, through which the user A and the user B and the user C and other related intimate groups are constantly found out, and according to the payment records of the user B and the user C, such as the merchant number or store information of the payment records, the face terminal device list of the merchant or store with payment records is further obtained, and the face library updating service is further called to send the face data to the local face library of each device in the face terminal device list.
[0159] 4、Cloud face library updating service, which will trigger the operation of updating the local face library of the face terminal device after receiving the related request from the intimate group library strategy reasoning service, for example, the face verification data of the current user is sent to the face terminal device available for the user to use, so that the face terminal device updates the data in the local face library.
[0160] In this embodiment, by combining the WeChat payment state of the intimate user in the same social group as the target user and with POI information close to the target user's POI information, the target user's face verification data is sent to the device end local face library in advance, so as to effectively improve the probability of the first use of face payment, that is, local recognition, and further improve the user experience.
[0161] It should be understood that, although Figures 1-7 The steps in the flowchart are displayed in sequence according to the direction of the arrow, but these steps are not necessarily executed in sequence according to the direction of the arrow. Unless otherwise specified in this article, the execution of these steps has no strict order limitation, and these steps can be executed in other order. Moreover, Figures 1-7 At least part of the steps in the flowchart can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with other steps or steps or stages in other steps.
[0162] In one embodiment, as shown in Figure 8 A resource transfer apparatus is provided, which can be a software module or a hardware module, or a combination of both as part of a computer device, and specifically includes a receiving module 802, a searching module 804, an inquiring module 806, and a delivering module 808, wherein:
[0163] The receiving module 802 is configured to receive location information of a target object reported through a social application.
[0164] The searching module 804 is configured to search for a target social object having an intimate social relationship with the target object.
[0165] The inquiring module 806 is configured to, when it is determined that the target social object has a resource transfer record at a point of interest corresponding to the location information, query a local face database of the point of interest for face verification data of the target object.
[0166] The delivering module 808 is configured to, if the face verification data of the target object is not queried, deliver the face verification data of the target object to the local face database; wherein the delivered face verification data is used to instruct a resource transfer device of the point of interest to perform resource transfer based on the face verification data and collected face data when the target object interacts with a product at the point of interest.
[0167] In one embodiment, the apparatus further includes an obtaining module configured to obtain social objects having a friend relationship chain with the target object; and a determining module configured to, when the target object and at least one social object having the friend relationship chain are in the same social group, determine the at least one social object as a target social object having an intimate social relationship.
[0168] In one embodiment, the obtaining module is further configured to obtain group member objects in the intimate social group; and the determining module is further configured to, if at least one of the group member objects belongs to the social object of the friend relationship chain, determine a social frequency between the target object and the at least one group member object; and if the social frequency reaches a preset frequency threshold, determine the at least one group member object as a target social object having an intimate social relationship.
[0169] In one embodiment, the searching module is further configured to search for a candidate point of interest where the target social object has a resource transfer record; the determining module is further configured to determine a distance between a location of the candidate point of interest and the location information; when the distance is less than or equal to a preset distance threshold, determine the candidate point of interest as the point of interest corresponding to the location information, and determine that the target social object has a resource transfer record at the point of interest; and the inquiring module is further configured to query the local face database of the point of interest for the face verification data of the target object.
[0170] In one embodiment, the acquisition module is further configured to acquire a resource transfer device list of the point of interest; the resource transfer device list includes device information of at least two resource transfer devices; and the delivery module is further configured to deliver the face verification data of the target object to a local face library of each resource transfer device if the face verification data of the target object is not queried from at least one resource transfer device in the resource transfer device list.
[0171] In one embodiment, the device further comprises an adjustment module configured to adjust an effective period of the face verification data of the target object if the face verification data of the target object is queried but the face verification data of the target object is out of the effective period; or the delivery module is further configured to re-collect the face verification data of the target object and deliver the collected face verification data to the local face library.
[0172] In one embodiment, the device further comprises a matching module configured to match the face data collected by the resource transfer device with the face verification data stored in the background to obtain a matching result when the face data collected by the resource transfer device is received; and the delivery module is further configured to deliver the face verification data and the resource account information of the target object to the resource transfer device if the matching result indicates that the face data is consistent with the face verification data stored in the background.
[0173] In one embodiment, as shown in Figure 9 A resource transfer device is provided, which can be a part of a computer device in the form of a software module or a hardware module, or a combination of both. The device specifically comprises an acquisition module 902, a comparison module 904 and a transfer module 906, wherein:
[0174] The acquisition module 902 is configured to collect face data of a target object when the target object interacts with a product at a point of interest.
[0175] The comparison module 904 is configured to compare the face data with face verification data in a local face library of the point of interest to obtain a comparison result; the face verification data is delivered by a server when a target social object is determined to have a resource transfer record at the point of interest and the local face library of the point of interest does not store the face verification data of the target object; and the target social object is a social object having an intimate social relationship with the target object.
[0176] The transfer module 906 is configured to transfer resources of the target object when the comparison result indicates that the face data is consistent with the face verification data.
[0177] In one embodiment, the apparatus further comprises: the collecting module is further configured to collect at least two video frame images of the target object; the determining module is configured to determine a sharpness of each of the video frame images and a face angle in each of the video frame images; determine a score of each of the video frame images based on the sharpness and the face angle; and the selecting module is configured to select a video frame image corresponding to a maximum score as the face data of the target object.
[0178] In one embodiment, the apparatus further comprises: an uploading module configured to upload the face data to the server when the comparison result indicates that the face data is inconsistent with the face verification data, so that the server matches the face data with the face verification data stored in the background.
[0179] The specific limitations of the resource transfer apparatus can refer to the limitations of the resource transfer method described above, which will not be repeated here. Each module in the above resource transfer apparatus can be realized by software, hardware and their combination in whole or in part. The above modules can be embedded in or independent of the processor in the computer device in hardware form, or can be stored in the memory in the computer device in the form of software, so that the processor calls and executes the operations corresponding to each module.
[0180] In one embodiment, a computer device is provided, which can be a server, and its internal structure diagram can be as shown in Figure 10 The computer device includes a processor, a memory and a network interface connected by a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store resource transfer data. The network interface of the computer device is used to communicate with external terminals through network connection. The computer program is executed by the processor to implement a resource transfer method.
[0181] Those skilled in the art can understand that Figure 10 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.
[0182] In one embodiment, a computer device is also provided, which includes a memory and a processor, the memory stores a computer program, and the processor executes the computer program to implement the steps in each of the above method embodiments.
[0183] In an embodiment, a computer readable storage medium storing a computer program is provided. The computer program, when executed by a processor, implements the steps of any of the above method embodiments.
[0184] In an embodiment, a computer program product or computer program including computer instructions stored in a computer readable storage medium is provided. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the steps of any of the above method embodiments.
[0185] A person of ordinary skill in the art can understand that all or part of the processes in the above method embodiments can be completed by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above method embodiments. Any reference to memory, storage, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0186] Any combination of the technical features of the above embodiments can be made. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist, it should be considered as the scope of the present application.
[0187] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of the patent of the present application should be subject to the appended claims.
Claims
1. A resource transfer method, characterized by, The method comprises: receiving position information of a target object reported through a social application; finding a target social object having an intimate social relationship with the target object; when it is determined that the target social object has a resource transfer record at a point of interest corresponding to the position information, querying a local face library at the point of interest for face verification data of the target object; if the face verification data of the target object is not queried, issuing the face verification data of the target object to the local face library; wherein the face verification data issued is used to instruct a resource transfer device at the point of interest to perform resource transfer based on the face verification data and collected face data when the target object interacts with a product at the point of interest.
2. The method of claim 1, wherein, The finding of the target social object having an intimate social relationship with the target object comprises: obtaining social objects having a friend relationship chain with the target object; when the target object and at least one social object having the friend relationship chain are in the same social group, determining the at least one social object as a target social object having an intimate social relationship.
3. The method of claim 2, wherein, The social group comprises an intimate social group; The determination of the at least one social object as a target social object having an intimate social relationship when the target object and at least one social object having the friend relationship chain are in the same social group comprises: obtaining group member objects in the intimate social group; if at least one of the group member objects belongs to a social object of the friend relationship chain, determining a social frequency between the target object and the at least one group member object; if the social frequency reaches a preset frequency threshold, determining the at least one group member object as a target social object having an intimate social relationship.
4. The method of claim 2, wherein, The querying of the face verification data of the target object from the local face library at the point of interest when it is determined that the target social object has a resource transfer record at the point of interest corresponding to the position information comprises: finding a candidate point of interest having a resource transfer record of the target social object; determining a distance between a location of the candidate point of interest and the position information; when the distance is less than or equal to a preset distance threshold, taking the candidate point of interest as the point of interest corresponding to the position information, and determining that the target social object has a resource transfer record at the point of interest; querying the face verification data of the target object from the local face library at the point of interest.
5. The method of claim 4, wherein, The local face library is a database deployed at the resource transfer device; the method further comprises: obtaining a resource transfer device list of the point of interest; the resource transfer device list comprises device information of at least two resource transfer devices; the issuing of the face verification data of the target object to the local face library if the face verification data of the target object is not queried comprises: if the face verification data of the target object is not queried from at least one of the resource transfer devices in the resource transfer device list, issuing the face verification data of the target object to a local face library of each resource transfer device.
6. The method of claim 1, wherein, The method further comprises: If the face verification data of the target object is found, but the face verification data of the target object is out of the valid period, the valid period of the face verification data is adjusted; or The face verification data of the target object is re-collected, and the collected face verification data is sent to the local face library.
7. The method of claim 1, wherein, The local face library is a database deployed in the resource transfer device; Before receiving the location information of the target object reported through the social application, the method further comprises: When the face data collected by the resource transfer device is received, the face data is matched with the face verification data stored in the background to obtain a matching result; If the matching result indicates that the face data is consistent with the face verification data stored in the background, the face verification data and the resource account information of the target object are sent to the resource transfer device.
8. A resource transfer method characterized by, The method comprises: When the target object interacts with a product at a point of interest, the face data of the target object is collected; The face data is compared with the face verification data in the local face library of the point of interest to obtain a comparison result; the face verification data is sent by the server when it is determined that a target social object has a resource transfer record at the point of interest, and the local face library of the point of interest does not store the face verification data of the target object; the target social object is a social object having an intimate social relationship with the target object; When the comparison result indicates that the face data is consistent with the face verification data, the resources of the target object are transferred.
9. The method of claim 8, wherein, The collection of the face data of the target object comprises: Collecting at least two video frame images of the target object; Determining the definition of each video frame image and the face angle in each video frame image; Based on the definition and the face angle, the score of each video frame image is determined; The video frame image corresponding to the maximum score is selected as the face data of the target object.
10. The method of claim 8, wherein, The method further comprises: When the comparison result indicates that the face data is inconsistent with the face verification data, the face data is uploaded to the server to enable the server to match the face data with the face verification data stored in the background.
11. A resource transfer apparatus, characterized by comprising: The device comprises: A receiving module for receiving location information of a target object reported through a social application; A finding module for finding a target social object having an intimate social relationship with the target object; A querying module for querying face verification data of the target object in a local face library of a point of interest when it is determined that the target social object has a resource transfer record at the point of interest corresponding to the location information; A sending module for sending the face verification data of the target object to the local face library if the face verification data of the target object is not found; wherein the sent face verification data is used to instruct a resource transfer device of the point of interest to perform resource transfer based on the face verification data and collected face data when the target object interacts with a product at the point of interest.
12. A resource transfer apparatus, characterized by comprising: The device comprises: The system comprises: The user equipment is used for reporting the position information of a target object to a server through a social application; The server is used for finding a target social object having an intimate social relationship with the target object; when it is determined that the target social object has a resource transfer record at a point of interest corresponding to the position information, the server queries the target object's face verification data in a local face library of the point of interest; if the target object's face verification data is not found, the server issues the target object's face verification data to the local face library; 13. A resource transfer system, characterized by The resource transfer device is used for transferring resources based on the face verification data and the collected face data when the target object interacts with a product at the point of interest. The processor executes the computer program to realize the steps of the method in any one of claims 1 to 10. The computer program is executed by the processor to realize the steps of the method in any one of claims 1 to 10. The computer program is executed by the processor to realize the steps of the method in any one of claims 1 to 10.
14. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that, 15. A computer readable storage medium storing a computer program, wherein the computer program comprises program instructions configured to cause a processor to perform the method according to any one of claims 1 to 14. 16. A computer program product comprising a computer program, characterized in that,
Citation Information
Patent Citations
A system and a method for authenticating a real friend relationship between online users
CN109558856A
Method and system for transmitting data to device over radio, and media
CN111225342A