Information processing method, device, storage medium and computer equipment

Abstract

The embodiments of the present application disclose an information processing method, device, storage medium and computer equipment. The embodiments of the present application display an information collection interface, which includes at least a preset action image; collects target action images corresponding to multiple users under the indication of the preset action image; sends the target action image to the server, so that the server returns the binding result of binding the second face information to the target sub-instant messaging account opened based on the target instant messaging account, and updates the target number of virtual resources determined by the first gesture information to the target instant messaging account; and displays the account binding result and the update result. In this way, the corresponding action demonstration can be performed through the indication of the preset action image displayed on the information collection interface, thereby realizing the opening of the target sub-instant messaging account of the second user and the update of virtual resources, thereby improving the diversity and efficiency of information processing.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an information processing method, apparatus, storage medium and computer equipment. Background Art

[0002] In order to improve payment convenience, face-scanning payment has been introduced in most consumer places such as supermarkets, hospitals, subways, shopping malls and restaurants. The face-scanning device can collect facial images, identify the payment account by facial image recognition, and then deduct money from the payment account to complete the payment. With this payment method, users do not need to provide bank cards or ID cards, nor do they need to enter passwords. They can complete the payment by standing in the payment area, which greatly improves the convenience of payment.

[0003] During the research and practice of the prior art, the inventor of the present application found that face-scanning payment in the prior art usually only supports face-scanning payment for a specific group of people. For underage users, payment needs to be made with the assistance of their parents. The process is simple and cumbersome, the user experience is poor, and the efficiency of information processing is low. Summary of the invention

[0004] The embodiments of the present application provide an information processing method, apparatus, storage medium, and computer equipment, which can enhance user experience and improve the diversity and efficiency of information processing.

[0005] To solve the above technical problems, the present application provides the following technical solutions:

[0006] An information processing method, comprising:

[0007] Displaying an information collection interface, wherein the information collection interface at least includes a preset action image;

[0008] Collecting target action images corresponding to multiple users under the instruction of the preset action image;

[0009] The target action image at least includes first facial information and first gesture information of a first user, and second facial information of a second user, the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account;

[0010] Sending the target action image to the server, so that the server returns a binding result of binding the second face information to the target sub-instant messaging account opened based on the target instant messaging account, and an update result of updating the target number of virtual resources determined by the first gesture information to the target sub-instant messaging account;

[0011] The account binding result and the update result are displayed.

[0012] An information processing method, comprising:

[0013] Receiving a target action image sent by a terminal device, wherein the target action image is an action image corresponding to an action image of a plurality of users collected by the terminal device under the indication of a preset action image on a displayed information collection interface;

[0014] Acquire first facial information and first gesture information corresponding to a first user in the target action image, and second facial information corresponding to a second user;

[0015] The first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account;

[0016] opening a target sub-instant messaging account based on the target instant messaging account, and binding the second facial information to the target sub-instant messaging account;

[0017] Determine a target amount of virtual resources according to the first gesture information, and update the target amount of virtual resources in the target sub-instant messaging account;

[0018] The account binding result and the update result are fed back to the terminal device.

[0019] An information processing device, comprising:

[0020] A first display unit, used to display an information collection interface, wherein the information collection interface at least includes a preset action image;

[0021] A collection unit, used for collecting target action images corresponding to multiple users under the instruction of the preset action image;

[0022] The target action image at least includes first facial information and first gesture information of a first user, and second facial information of a second user, the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account;

[0023] a sending unit, configured to send the target action image to a server, so that the server returns a binding result of binding the second face information to a target sub-instant messaging account opened based on the target instant messaging account, and an updating result of updating the target number of virtual resources determined by the first gesture information to the target sub-instant messaging account;

[0024] The second display unit is used to display the account binding result and the update result.

[0025] In some embodiments, the information processing device further includes:

[0026] A third display unit is used to display an information binding control, wherein the information binding control is triggered to display when it is detected that the number of current face information is multiple;

[0027] The first display unit is further configured to display an information collection interface in response to a triggering operation of the information binding control.

[0028] In some embodiments, the third display unit is used to:

[0029] Displaying a preset prompt interface, wherein the preset prompt interface is triggered to display when the number of current face information is detected to be multiple;

[0030] The information binding control and the preset protocol information are displayed on the preset prompt interface.

[0031] In some embodiments, the device further comprises:

[0032] When it is detected that the number of current face information is two, executing to collect target action images corresponding to multiple users under the instruction of preset action images;

[0033] When it is detected that the number of current face information is not two, a prompt message is generated.

[0034] In some embodiments, the acquisition unit includes:

[0035] A collection subunit, used for collecting multiple frames of action images corresponding to multiple users under the instructions of preset action images;

[0036] A first determination subunit is used to determine target face information and target gesture information of each user from the multiple frames of action images;

[0037] The second determining subunit is used to determine the target face information and the target gesture information as a target action image.

[0038] In some embodiments, the first determining subunit is used to:

[0039] Obtaining the face information and gesture information of each user in each frame of the action image, and obtaining the face information set and gesture information set corresponding to each user in the action images of different frames;

[0040] Based on a preset face screening rule, filter out target face information corresponding to each user from the face information set;

[0041] Based on preset gesture screening rules, target gesture information corresponding to each user is screened out from the gesture information set.

[0042] An information processing device, comprising:

[0043] A receiving unit, configured to receive a target action image sent by a terminal device, wherein the target action image is an action image corresponding to an action image of a plurality of users collected by the terminal device under the indication of a preset action image on a displayed information collection interface;

[0044] an acquisition unit, configured to acquire first face information and first gesture information corresponding to a first user, and second face information corresponding to a second user in the target action image;

[0045] The first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account;

[0046] a binding unit, configured to open a target sub-instant messaging account based on the target instant messaging account, and bind the second facial information to the target sub-instant messaging account;

[0047] an updating unit, configured to determine a target number of virtual resources according to the first gesture information, and update the target number of virtual resources in the target sub-instant messaging account;

[0048] The feedback unit is used to feed back the account binding result and the update result to the terminal device.

[0049] In some embodiments, the device further comprises:

[0050] An analyzing unit, configured to analyze the target action image to obtain target face information and target gesture information corresponding to each user in the target action image;

[0051] The acquisition unit is further configured to, when it is detected that the number of target face information is two, execute acquisition of first face information and first gesture information corresponding to the first user in the target action image, and second face information corresponding to the second user;

[0052] A prompt unit is used to generate prompt information and feed it back to the terminal device when it is detected that the number of target face information is not two.

[0053] In some embodiments, the device further comprises:

[0054] A first determining unit, configured to determine a user corresponding to target facial information associated with a target instant messaging account as a first user;

[0055] The second determining unit is used to determine the user corresponding to the target facial information that is not associated with the target instant messaging account as the second user.

[0056] In some embodiments, the device further comprises:

[0057] a gesture acquiring unit, configured to acquire second gesture information of the second user;

[0058] An associating unit is used to parse the palm vein information carried in the second gesture information and associate the palm vein information with the target sub-instant messaging account.

[0059] In some embodiments, the updating unit is used to:

[0060] Acquire the number of gestures indicated by the first gesture information;

[0061] A target number of virtual resources is matched based on the number of gestures, and the target number of virtual resources is updated in the target sub-instant messaging account.

[0062] In some embodiments, the device further comprises:

[0063] A query receiving unit, configured to receive a virtual resource transaction query instruction sent by a target instant messaging client corresponding to the target instant messaging account;

[0064] A query unit, configured to obtain the virtual resource transaction record of the target sub-instant messaging account based on the virtual resource transaction query instruction;

[0065] The record feedback unit is used to feed back the virtual resource transaction record to the target instant messaging client, so that the target instant messaging client displays the virtual resource transaction record.

[0066] A computer-readable storage medium stores a plurality of instructions, wherein the instructions are suitable for a processor to load to execute the steps in the above-mentioned information processing method.

[0067] A computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the information processing method provided above when executing the computer program.

[0068] A computer program product or a computer program, wherein the computer program product or the computer program comprises computer instructions, wherein the computer instructions are stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that the computer device executes the steps in the information processing method provided above.

[0069] The embodiment of the present application displays an information collection interface, which includes at least a preset action image; collects target action images corresponding to multiple users under the indication of the preset action image; sends the target action image to the server, so that the server returns the binding result of binding the second face information to the target sub-instant messaging account opened based on the target instant messaging account, and the update result of updating the target number of virtual resources determined by the first gesture information to the target instant messaging account; and displays the account binding result and the update result. In this way, the corresponding action demonstration can be performed through the indication of the preset action image displayed on the information collection interface, thereby realizing the opening of the target sub-instant messaging account of the second user and the update of virtual resources. Compared with the prior art, the payment behavior of underage users needs to be implemented with the assistance of their parents, which greatly improves the diversity and efficiency of information processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0071] Figure 1 It is a scenario diagram of the information processing system provided in an embodiment of the present application.

[0072] Figure 2 It is a flowchart of the information processing method provided in the embodiment of the present application.

[0073] Figure 3 It is another flowchart of the information processing method provided in an embodiment of the present application.

[0074] Figure 4 It is a scenario diagram of the information processing method provided in an embodiment of the present application.

[0075] Figure 5 It is a flowchart of the information processing method provided in the embodiment of the present application.

[0076] Figure 6 It is a schematic diagram of the architecture of the information processing system provided in an embodiment of the present application.

[0077] Figure 7 It is a schematic diagram of the structure of the information processing device provided in an embodiment of the present application.

[0078] Figure 8 It is a schematic diagram of the structure of the information processing device provided in an embodiment of the present application.

[0079] Fig. 9It is a schematic diagram of the structure of the terminal provided in the embodiment of the present application.

[0080] Fig.10 It is a schematic diagram of the structure of the server provided in the embodiment of the present application. DETAILED DESCRIPTION

[0081] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0082] Embodiments of the present application provide an information processing method, apparatus, storage medium, and computer equipment.

[0083] See also Figure 1 , Figure 1 The scenario diagram of the information processing system provided for the embodiment of the present application includes: a terminal device 11, a user terminal 12 and a server 20. The terminal device 11, the user terminal 12 and the server 20 can be connected through a communication network, and the communication network includes a wireless network and a wired network, wherein the wireless network includes a combination of one or more of a wireless wide area network, a wireless local area network, a wireless metropolitan area network, and a wireless personal network. The network includes network entities such as routers and gateways, which are not shown in the figure. The terminal device 11 can exchange information with the server 20 through the communication network. For example, the terminal device 11 synchronizes the collected target action image to the server 20. The user terminal 12 can also exchange information with the server 20 through the communication network. For example, the user terminal 12 can send a query instruction to the server 20 to query information.

[0084] The information processing system may include an information processing device, which may be specifically integrated in a terminal device 11. The terminal device 11 may be a personal computer (PC), a facial payment terminal, a facial payment device, or the like. The terminal device 11 is mainly used to display an information collection interface, which includes at least a preset action image; collect target action images corresponding to multiple users under the indication of the preset action image; wherein the target action image includes at least first facial information and first gesture information of a first user, and second facial information of a second user, the first facial information being associated with a target instant messaging account, and the second facial information being not associated with an instant messaging account; send the target action image to a server, so that the server returns a binding result of binding the second facial information to a target sub-instant messaging account opened based on the target instant messaging account, and an update result of updating the target number of virtual resources determined by the first gesture information to the target instant sub-message account; and display the account binding result and the update result.

[0085] The information processing system may include an information processing device, which may be integrated in a server. The server may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Figure 1 In the embodiment, the server is mainly used to receive a target action image sent by a terminal device 11, where the target action image is an action image corresponding to multiple users collected by the terminal device under the indication of a preset action image on the displayed information collection interface; obtain first facial information and first gesture information corresponding to a first user in the target action image, and second facial information corresponding to a second user; wherein the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; open a target sub-instant messaging account based on the target instant messaging account, and bind the second facial information to the target sub-instant messaging account; determine a target number of virtual resources based on the first gesture information, and update the target number of virtual resources in the target sub-instant messaging account; and feed back the account binding result and the update result to the terminal device.

[0086] The information processing system may include an information processing device, which may be integrated in a terminal having a storage unit and a microprocessor installed therein and having computing capabilities, such as a tablet computer, a mobile phone, a laptop computer, a desktop computer, etc. Figure 1 In the example, the terminal is Figure 1In the user terminal 12, the terminal 11 may be installed with various clients required by the user, such as an instant messaging client, etc. The terminal 11 may send a query command to the server to view information such as virtual resources of the instant client in real time.

[0087] It should be noted that Figure 1 The scenario diagram of the information processing system shown is merely an example. The information processing system and scenario described in the embodiments of the present application are intended to more clearly illustrate the technical solution of the embodiments of the present application, and do not constitute a limitation on the technical solution provided in the embodiments of the present application. A person of ordinary skill in the art will appreciate that with the evolution of information processing systems and the emergence of new business scenarios, the technical solution provided in the embodiments of the present application is equally applicable to similar technical problems.

[0088] The following are detailed descriptions of each.

[0089] An embodiment of the present application provides an information processing method, which can be executed by a terminal device or a server; the embodiment of the present application is described by taking the information processing method executed by a terminal device as an example.

[0090] See also Figure 2 , Figure 2 : is a flow chart of an information processing method provided in an embodiment of the present application. The information processing method includes:

[0091] In step 101, an information collection interface is displayed.

[0092] It should be noted that in the related technologies, with the development of the Internet, instant messaging has become an indispensable way of online communication in people's lives. Accordingly, in order to facilitate users' daily lives, instant messaging payment technology has emerged. Users can store virtual resources in the instant messaging client, and when payment is needed, they can make quick payments through the instant messaging client.

[0093] In recent years, with the popularization of face-scanning payment technology, instant messaging payment technology has also been upgraded accordingly. Users can pre-store the association between facial information and the corresponding instant messaging account in the background of the instant messaging client. In this way, when the user pays by face-scanning through a terminal device that can pay by face, the terminal device can automatically deduct fees from the corresponding bound instant messaging client account based on the facial information, which greatly facilitates the user's payment.

[0094] It can be seen that for some special groups, such as children and the elderly who do not know how to use instant messaging clients, they cannot use face recognition payment because they have not registered instant messaging clients. The above problem needs to be solved.

[0095] In order to solve the above-mentioned problem, an embodiment of the present application may display an information collection interface on a face-scanning payment terminal device. The information collection interface includes at least a preset action image, which is a DEMO (demonstration) image that instructs the user to perform a specified action. In one embodiment, the preset action image may be a photo of two users performing a specified action, for example, two users standing together and both of them making a specific gesture. The example given here is not intended as a specific limitation.

[0096] In some implementations, before displaying the information collection interface, the method further includes:

[0097] (1) Displaying an information binding control, where the information binding control is triggered to display when it is detected that the number of current face information is multiple;

[0098] (2) In response to the triggering operation of the information binding control, the information collection interface is displayed.

[0099] Among them, when the user makes an offline face-scanning payment, the face-scanning terminal device can detect the current number of facial information in real time. When it is detected that the current number of facial information is multiple, an information binding control is displayed. The information binding control can be displayed in the form of a floating window on the face-scanning payment interface to prompt the user whether to bind the consumption.

[0100] Furthermore, the user can trigger the information binding control by clicking on the information binding control or by making a sound "start binding consumption", and after the terminal device responds to the triggering operation of the information binding control, it can display the information collection interface, that is, display the preset action image to prompt the user to take corresponding actions according to the prompt to unlock the binding payment.

[0101] In one embodiment, while displaying the information binding control, preset protocol information can be displayed accordingly. The preset protocol information can be used to inform the user that face and other related privacy information will be collected next. The information binding control can only be triggered after the user agrees to the above preset protocol information.

[0102] In step 102, target action images corresponding to a plurality of users under the instruction of preset action images are collected.

[0103] Among them, the terminal device can collect in real time the target action images corresponding to the actions made by multiple users under the instructions of preset action images. In order to ensure the success of the subsequent instant messaging account binding, the target action image needs to include at least the first facial information and first gesture information of the first user, and the second facial information of the second user. The first facial information is associated with the target instant messaging account, and the second facial information is not associated with the instant messaging account. That is, the first user is a user who has registered an instant messaging account, and the second user is a user who has not registered an instant messaging account, such as an elderly person or a child. That is, the second user cannot use the face-swiping payment function.

[0104] It should be noted that the facial information is an informationized representation of a facial image, which can be used to represent the facial features of the facial image, and the gesture information is an informationized representation of the gesture made by the user's hand, which can be used to represent the gesture features of the gesture image.

[0105] In some implementations, before collecting target action images corresponding to multiple users under the instruction of the preset action image, the method further includes:

[0106] (1) when it is detected that the number of current face information is two, executing to collect target action images corresponding to multiple users under the instruction of preset action images;

[0107] (2) When it is detected that the number of current face information is not two, a prompt message is generated.

[0108] In order to ensure the smooth progress of binding, it is possible to pre-detect whether the current number of face information is two, because in the actual binding process, binding and subsequent update of virtual resources in the account can only be performed when there are only two users.

[0109] Based on this, when it is detected that the number of current face information is two, the target action images corresponding to multiple users under the instruction of the preset action images are collected.

[0110] In one embodiment, when it is detected that the number of current face information is two, liveness detection can be continued for the faces of the two face information to avoid information insecurity, and after the liveness detection is passed, binding information of whether the two face information is bound to the instant messaging account is obtained, and the binding information indicates whether the face information is bound to the instant messaging account, including two states of binding and unbinding. The binding state can be obtained by the terminal device sending the face information to the server background for real-time query. When one of the face information is bound to the target instant messaging account and the other face information is not bound to the instant messaging account, the operation of collecting the target action images corresponding to multiple users under the indication of the preset action image is performed. The collection method can be to open the camera to shoot multiple users for collection, and when the liveness detection fails or the binding state does not meet one bound and one unbound state, the camera is turned off to end the image collection.

[0111] When it is detected that the number of current face information is not two, a prompt message is generated to prompt the user that the current number of users does not meet the requirement. The prompt message may be "The number of faces currently photographed does not meet the condition, please retake the photo."

[0112] In some implementations, collecting target action images corresponding to multiple users under the instruction of the preset action image includes:

[0113] (1) collecting multiple frames of action images corresponding to multiple users under the instructions of preset action images;

[0114] (2) determining target face information and target gesture information of each user from the multiple frames of action images;

[0115] (3) The target face information and the target gesture information are determined as a target action image.

[0116] Among them, the corresponding video streams of multiple users under the instruction of preset action images (i.e., multiple frames of action images) can be collected. It should be noted that in each frame of action image, each user may have facial information and gesture information. In order to achieve better subsequent recognition effect, the target facial information and target gesture information with the highest clarity corresponding to each user can be selected from the multiple frames of action images, and the target facial information and target gesture information of each user can be determined as the target action image.

[0117] In some implementations, the step of determining target face information and target gesture information of each user from the multiple frames of action images may include:

[0118] (1.1) Obtaining facial information and gesture information of each user in each frame of the action image, and obtaining a set of facial information and a set of gesture information corresponding to each user in different frames of the action image;

[0119] (1.2) based on the preset face screening rules, screening out the target face information corresponding to each user from the face information set;

[0120] (1.3) Based on the preset gesture filtering rules, the target gesture information corresponding to each user is filtered out from the gesture information set.

[0121] Among them, the facial information and gesture information of each user in each frame of the action image can be obtained, and the facial information set and gesture information set corresponding to each user in the action images of different frames can be obtained. Taking two users as an example, the facial information set and gesture information set of the first user in each frame of the action image, as well as the facial information set and gesture information set of the second user in each frame of the action image can be obtained.

[0122] Furthermore, the preset face screening rules may include face size rules, face angle rules, image contrast rules, image brightness rules and / or clarity rules. Based on the preset face screening rules, the optimal target face information for each user can be screened out from the face information set.

[0123] The preset gesture screening rules may include palm size rules, palm angle rules, image contrast rules, image brightness rules and / or clarity rules. Based on the preset gesture screening rules, the optimal target gesture information for each user can be screened out from the gesture information set.

[0124] It should be noted that the face information and the gesture information are associated, and the association means that the face information and the gesture information are the face and gesture of the same user.

[0125] In step 103, the target action image is sent to the server.

[0126] Among them, the terminal device can send the target action image to the server, so that the server can quickly determine the first user, that is, the first facial information and first gesture information of the user who has registered the target instant messaging account, and the second user, that is, the second facial information of the user who has not registered the target instant messaging account from the target action image. It should be noted that the first facial information is associated with the target instant messaging account. Therefore, the first user corresponding to the first facial information can perform facial payment. The second facial information is not associated with the instant messaging account. Therefore, the second user corresponding to the second facial information cannot perform facial payment.

[0127] Furthermore, the server can open a corresponding target sub-instant messaging account based on the target instant messaging account of the first user, which can also be understood as opening a sub-account of the target instant messaging account. The target sub-instant messaging account is attached to the target instant messaging account and bound to the target instant messaging account. The second user does not need to perform tedious operations such as real-name authentication through the terminal to register specifically, which is convenient and fast, greatly improving the efficiency of information processing. In this way, the second face information can be stored in the server background, and the second face information can be quickly bound to the target sub-instant messaging account. The second face information can be used as verification information for face payment later, so that the second user who is not associated with the instant messaging account can quickly open the face payment function without tedious authentication.

[0128] Finally, the first gesture information of the first user who owns the target instant messaging account can be obtained, and the first gesture information can be analyzed to quickly determine the gesture made by the first user at that time, for example, the "yeah" gesture is a gesture of two fingers, and the target amount of virtual resources is determined according to the first gesture information. The virtual resources can be understood as transaction resources for face payment, or they can be virtual resources defined by any commercial company. For example, 20 virtual resources can be determined according to the first gesture information of the gesture of two fingers, and the target amount of virtual resources can be quickly recharged to the target sub-instant messaging account, so that the second user can use the target amount of virtual resources to realize face payment later. In this way, the first user does not need to perform specific operations such as transfer, and the target sub-instant messaging account is automatically opened and recharged, which greatly improves the efficiency of information processing. After the server implements the above operations, the account binding results and update results will be fed back to the terminal device.

[0129] In step 104, the account binding result and the update result are displayed.

[0130] Among them, after receiving the binding result and update result feedback from the terminal device, the terminal device will display them in a visual form on the current interface to prompt the first user and the second user to open the target sub-instant messaging account and recharge successfully. In this way, the second user can subsequently make facial payment through face on any terminal device, which greatly facilitates user use and improves user experience.

[0131] As can be seen from the above, the embodiment of the present application displays an information collection interface, which includes at least a preset action image; collects target action images corresponding to multiple users under the indication of the preset action image; sends the target action image to the server, so that the server returns the binding result of binding the second face information to the target sub-instant messaging account opened based on the target instant messaging account, and the update result of updating the target number of virtual resources determined by the first gesture information to the target instant messaging account; and displays the account binding result and the update result. In this way, the corresponding action demonstration can be performed through the indication of the preset action image displayed on the information collection interface, thereby realizing the opening of the target sub-instant messaging account of the second user and the update of virtual resources. Compared with the prior art, the payment behavior of underage users needs to be implemented with the assistance of their parents, which greatly improves the diversity and efficiency of information processing.

[0132] In combination with the method described in the above embodiment, the method will be further described in detail with examples below.

[0133] In this embodiment, the information processing device is specifically integrated into a server as an example for description, and specific reference is made to the following description.

[0134] See also Figure 3 and Figure 4 , Figure 3 Another flowchart of the information processing method provided in an embodiment of the present application. Figure 4 A schematic diagram of a scenario of an information processing method provided in an embodiment of the present application. The method flow may include:

[0135] In step 201, the terminal device displays a preset prompt interface, and displays information binding controls and preset protocol information on the preset prompt interface.

[0136] In order to better illustrate the embodiments of the present application, please refer to Figure 4 As shown, scene 20 includes a terminal device 21, a first user 22 and a second user 23. The terminal device 21 may be a palm face recognition device, that is, the terminal device 21 may not only recognize a face, but also recognize the user's palm information. The first user 22 may be an adult. The first user 22 opens a target instant messaging account, such as "XX's mother", and may quickly perform facial payment through facial information. The second user 23 may be a child. Since the second user 23 is a minor, he or she has not registered an instant messaging account and cannot use facial payment.

[0137] Based on the above application scenarios, when users consume offline, the terminal device will automatically detect whether the current number of facial information is multiple. When it is detected that the current number of facial information is two (that is, multiple), a preset prompt interface will be displayed on the terminal device, and the information binding control and preset protocol information will be displayed on the preset prompt interface. The information binding control can be a button, and the text "Quick Multi-Account Binding Recharge" can be displayed on the button. The preset protocol information can display the corresponding [Protocol Notice], which is used for the user in front of the display screen to collect facial-related information and collect children's facial information.

[0138] It can be understood that in the specific implementation of the present application, related data such as user facial information and gesture information are involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0139] Furthermore, only after the user agrees to the above-mentioned [Agreement Notice], can the triggering permission of the information binding control, such as click permission, be enabled.

[0140] In step 202, the terminal device displays an information collection interface in response to a triggering operation of the information binding control.

[0141] Among them, the first user 21 can click the information binding control with a finger to realize the trigger operation of the information binding control, so that the terminal device can respond to the trigger operation of the information binding control and display the information collection interface, and the information collection interface at least includes a preset action image, and the preset action image is a DEMO image that instructs the user to perform a specified action, such as a photo of two users standing together and both parties making a specific gesture of "yeah". The example here is not a specific limitation.

[0142] In step 203, the terminal device detects whether the current amount of facial information is two.

[0143] In order to ensure the smooth progress of binding, it is possible to pre-detect whether the current number of facial information is two, because in the actual binding process, binding and subsequent updates of virtual resources in the sub-account can only be performed when there are only two users.

[0144] Based on this, when it is detected that the current amount of face information is not two, step 204 is executed, and when it is detected that the current amount of face information is two, step 205 is executed.

[0145] In step 204, the terminal device generates prompt information.

[0146] Among them, when it is detected that the current number of facial information is not two, for example, when there is only one facial information, account binding and recharge cannot be achieved; or when there are more than two, it will also lead to the inability to determine the binding object and the recharge object. Therefore, the terminal device can generate a prompt message, such as the prompt message "The current number of people does not meet the requirements, please maintain two-person shooting."

[0147] In step 205, the terminal device collects multiple frames of action images corresponding to multiple users under the instruction of preset action images.

[0148] Among them, when it is detected that the current number of facial information is two, it means that the current number of people meets the conditions, and the corresponding video streams (ie, multiple frames of action images) of multiple users under the instructions of preset action images can be collected.

[0149] In step 206, the terminal device obtains the facial information and gesture information of each user in each frame of the action image, and obtains the facial information set and gesture information set corresponding to each user in the action images of different frames.

[0150] It should be noted that in each frame of action image, the first user 22 and the second user 23 have facial information and gesture information in each frame of action image, and a facial information set and a gesture information set of the first user 22, as well as a facial information set and a gesture information set of the second user 23 can be generated.

[0151] In step 207, the terminal device filters out the target face information corresponding to each user from the face information set based on the preset face filtering rules, and filters out the target gesture information corresponding to each user from the gesture information set based on the preset gesture filtering rules, and determines the target face information and target gesture information as the target action image.

[0152] The preset face screening rules may include face size rules, face angle rules, image contrast rules, image brightness rules and / or clarity rules, so that the optimal target face information of the first user 22 and the optimal target face information of the second user 23 can be screened out from the face information set based on the preset face screening rules.

[0153] The preset gesture filtering rules may include palm size rules, palm angle rules, image contrast rules, image brightness rules and / or clarity rules. Based on the preset gesture filtering rules, the optimal target gesture information of the first user 22 and the optimal target gesture information of the second user 23 can be filtered out from the gesture information set.

[0154] Further, the optimal target face information and target gesture information of the first user 22 and the optimal target face information and target gesture information of the second user 23 are determined as the target action image.

[0155] In step 208, the terminal device sends the target action image to the server, and displays the account binding result and the update result.

[0156] Among them, the terminal device 21 can send the target action image to the server, so that the server can quickly determine the first user 21, that is, the first facial information and first gesture information of the user who registered the target instant messaging account, and the second user 22, that is, the second facial information and second gesture information of the user who did not register the target instant messaging account from the target action image. It should be noted that the first facial information is associated with the target instant messaging account. Therefore, the first user 22 corresponding to the first facial information can perform facial payment. The second facial information is not associated with the instant messaging account. Therefore, the second user 23 corresponding to the second facial information cannot perform facial payment.

[0157] Furthermore, the server can open a corresponding target sub-instant messaging account based on the target instant messaging account of the first user 22, which can also be understood as opening a sub-account of the target instant messaging account. The target sub-instant messaging account is attached to the target instant messaging account and bound to the target instant messaging account. The second user 23 does not need to perform cumbersome operations such as real-name authentication through the terminal to register specifically, which is convenient and fast, greatly improving the efficiency of information processing. In this way, the second face information can be stored in the server background, and the second face information can be quickly bound to the target sub-instant messaging account. The second face information can be used as verification information for face payment later, so that the second user 23 who is not associated with the instant messaging account can quickly open the face payment function without cumbersome authentication.

[0158] Finally, the first gesture information of the first user 22 who owns the target instant messaging account can be obtained. The first gesture information can be analyzed to quickly determine the gesture made by the first user at that time, for example, the "yeah" gesture is a gesture of two fingers. According to the first gesture information, the target amount of virtual resources can be determined. The virtual resources can be understood as transaction resources for face payment, or they can be virtual resources defined by any commercial company. The association relationship between gestures and virtual resources can be set, for example, gesture 1 corresponds to a virtual resource of 10, gesture 2 corresponds to a virtual resource of 20, and so on. That is, the target amount of 20 virtual resources can be determined according to the first gesture information of the gesture of two fingers. Finally, the target amount of virtual resources can be quickly recharged to the target sub-instant messaging account, so that the second user 23 can use the target amount of 20 virtual resources to realize face payment later. In this way, the first user 22 does not need to perform specific operations such as transfer, and the target sub-instant messaging account is automatically opened and recharged, which greatly improves the efficiency of information processing. After the server implements the above operations, the account binding result and update result will be fed back to the terminal device 21.

[0159] After the terminal 21 receives the binding result and update result feedback from the terminal device, it will display them in a visual form on the current interface to prompt the first user 22 and the second user 23 to open the target sub-instant messaging account and recharge 20 virtual resources successfully. In this way, the second user 23 can subsequently make facial payment through face on any terminal device, which greatly facilitates user use and improves user experience.

[0160] As can be seen from the above, the embodiment of the present application displays an information collection interface, which includes at least a preset action image; collects target action images corresponding to multiple users under the indication of the preset action image; sends the target action image to the server, so that the server returns the binding result of binding the second face information to the target sub-instant messaging account opened based on the target instant messaging account, and the update result of updating the target number of virtual resources determined by the first gesture information to the target instant messaging account; and displays the account binding result and the update result. In this way, the corresponding action demonstration can be performed through the indication of the preset action image displayed on the information collection interface, thereby realizing the opening of the target sub-instant messaging account of the second user and the update of virtual resources. Compared with the prior art, the payment behavior of underage users needs to be implemented with the assistance of their parents, which greatly improves the diversity and efficiency of information processing.

[0161] An embodiment of the present application provides an information processing method, which can be executed by a terminal device or a server; the embodiment of the present application is described by taking the information processing method executed by a server as an example.

[0162] See also Figure 5 , Figure 5 : is a flow chart of an information processing method provided in an embodiment of the present application. The information processing method includes:

[0163] In step 301, a target action image sent by a terminal device is received.

[0164] In order to better illustrate the embodiments of the present application, please refer to Figure 6 As shown, Figure 6 It is a schematic diagram of the architecture of the information processing system provided in an embodiment of the present application.

[0165] The architecture 30 includes a server (backend service) 31, a terminal device (palm and face payment device) 32 and a user terminal (and a user's mobile phone). The terminal device 21 can install a palm and face payment application, turn on the 3D camera to quickly collect facial information and gesture information and send it to the server 31. The server can provide facial recognition services and palm vein recognition services, account services, and change services for sub-accounts, while the user terminal 32 can quickly recharge, close, and provide transaction query services for sub-accounts.

[0166] Based on the above architecture, the embodiment of the present application is described. The server can receive the target action image sent by the terminal device. The target action image can refer to the collection method of the embodiment of the information processing method of the above terminal device, which will not be repeated here.

[0167] In step 302, first facial information and first gesture information corresponding to a first user in a target action image, and second facial information corresponding to a second user are obtained.

[0168] In some implementations, before obtaining the first face information and the first gesture information corresponding to the first user in the target action image, and the second face information corresponding to the second user, the method may further include:

[0169] (1) analyzing the target action image to obtain target face information and target gesture information corresponding to each user in the target action image;

[0170] (2) when it is detected that the number of target face information is two, obtaining first face information and first gesture information corresponding to the first user in the target action image, and second face information corresponding to the second user;

[0171] (3) When it is detected that the number of target face information is not two, a prompt message is generated and fed back to the terminal device.

[0172] Among them, in order to ensure the smooth progress of subsequent binding, the target action image can be analyzed to obtain the target face information and target gesture information corresponding to each user in the target action image, and pre-detect whether the number of face information in the target action image transmitted by the terminal device is two. Because in the actual binding process, only when there are two users can the binding and subsequent virtual resource updates in the account be performed.

[0173] When the number of target facial information detected is two, the first facial information and first gesture information corresponding to the first user in the target action image, as well as the second facial information corresponding to the second user can be obtained. It should be noted that the first user is a user who has registered an instant messaging account, and the second user is a user who has not registered an instant messaging account.

[0174] In some embodiments, when it is detected that the number of target facial information is two, binding information of whether the two facial information are bound to the instant messaging account is also obtained, and the binding information indicates whether the facial information is bound to the instant messaging account, including two states of binding and unbinding. Only when one of the facial information is bound to the target instant messaging account and the other facial information is not bound to the instant messaging account, the first facial information and the first gesture information corresponding to the first user in the target action image, and the second facial information corresponding to the second user are obtained for subsequent binding.

[0175] When it is detected that the number of target facial information is not two or one of the facial information is not bound to the target instant messaging account, and the other facial information is not bound to the instant messaging account, a prompt message is generated and fed back to the terminal device, so that the terminal device turns off the camera and ends image acquisition.

[0176] In some implementations, before obtaining the first face information and the first gesture information corresponding to the first user in the target action image, and the second face information corresponding to the second user, the method further includes:

[0177] (1) determining a user corresponding to the target facial information associated with the target instant messaging account as a first user;

[0178] (2) A user corresponding to the target facial information that is not associated with the target instant messaging account is determined as the second user.

[0179] Among them, since the target action image contains target facial information of multiple users, for example, target facial information of two users, the users can be distinguished according to whether the target facial information is associated with an instant messaging account, and the user corresponding to the target facial information associated with the target instant messaging account is determined as the first user, and the first user can be an adult user, and the user corresponding to the target facial information not associated with the target instant messaging account is determined as the second user, and the second user can be a second-pass user.

[0180] Among them, the server can obtain the first facial information and first gesture information corresponding to the first user associated with the target instant messaging account in the target action image, and the second facial information corresponding to the second user not associated with the target instant messaging account based on whether the target instant messaging account is associated.

[0181] In step 303, a target sub-instant messaging account is opened based on the target instant messaging account, and the second facial information is bound to the target sub-instant messaging account.

[0182] It should be noted that the first facial information is associated with the target instant messaging account, so the first user corresponding to the first facial information can perform facial payment, and the second facial information is not associated with the instant messaging account, so the second user corresponding to the second facial information cannot perform facial payment.

[0183] Among them, the server can open the corresponding target sub-instant messaging account based on the target instant messaging account of the first user, which can also be understood as opening a sub-account of the target instant messaging account. The target sub-instant messaging account is attached to the target instant messaging account and bound to the target instant messaging account. There is no need for the second user to perform tedious operations such as real-name authentication through the terminal to register specifically, which is convenient and fast, greatly improving the efficiency of information processing. In this way, the second face information can be stored in the server background, and the second face information can be quickly bound to the target sub-instant messaging account. The second face information can be used as verification information for face payment later, so that the second user who is not associated with the instant messaging account can quickly open the face payment function without tedious authentication.

[0184] In some implementations, after opening a target sub-instant messaging account based on the target instant messaging account and binding the second face information to the target sub-instant messaging account, the method further includes:

[0185] (1) obtaining second gesture information of the second user;

[0186] (2) parsing the palm vein information carried in the second gesture information, and associating the palm vein information with the target sub-instant messaging account.

[0187] Among them, the second gesture information of the second user, that is, the user to be bound, can also be obtained, and the palm vein information carried in the second gesture information can be analyzed by computer vision technology. The palm vein information can also be understood as biological information. Palm vein, as the name implies, is the vein in the palm. The palm vein recognition system first obtains the individual palm vein distribution map through the vein recognition device, extracts the characteristic value from the palm vein distribution map according to the special comparison algorithm, obtains the image of the finger, palm, and back of the hand vein through the near-infrared CCD camera, stores the digital image of the vein in the computer system, and stores the characteristic value. When comparing veins, the vein map is taken in real time, the characteristic value is extracted, and the digital image is extracted by using advanced filtering, image binarization, and refinement methods. The features are compared with the vein characteristic values ​​stored in the host, and the vein features are matched by a complex matching algorithm, so as to identify the individual and confirm the identity.

[0188] Based on this, the server can associate the palm vein information of the second user with the target sub-instant messaging account, so that the palm vein information can be used as another verification information for payment later, greatly expanding the payment diversity of the second user.

[0189] In step 304, a target amount of virtual resources is determined according to the first gesture information, and the target amount of virtual resources is updated in the target sub-instant messaging account.

[0190] Among them, the first gesture information of the first user who owns the target instant messaging account can be obtained, and the first gesture information can be analyzed to quickly determine the gesture made by the first user at that time. For example, the "yeah" gesture is a gesture of two fingers. The target number of virtual resources is determined according to the first gesture information. The virtual resources can be understood as transaction resources for facial payment, or they can be virtual resources defined by any commercial company. For example, 20 virtual resources can be determined according to the first gesture information of the gesture of two fingers. Finally, the target number of virtual resources is quickly recharged into the target sub-instant messaging account, so that the second user can subsequently use the target number of virtual resources to realize facial payment.

[0191] In some implementations, determining a target amount of virtual resources according to the first gesture information, and updating the target amount of virtual resources in the target sub-instant messaging account includes:

[0192] (1) obtaining the number of gestures indicated by the first gesture information;

[0193] (2) Matching a target number of virtual resources based on the number of gestures, and updating the target number of virtual resources in the target sub-instant messaging account.

[0194] The number of gestures may be the number of fingers, and the first gesture image represented by the first gesture information may be analyzed based on computer vision technology to obtain the number of gestures, such as 1 finger, 2 fingers, etc.

[0195] Furthermore, the target number of virtual resources that the gesture matches may be determined according to a preset calculation rule, for example, 1 finger corresponds to a target number of 10 virtual resources, and 2 fingers correspond to a target number of 20 virtual resources.

[0196] Assuming that the current number of gestures is 2 fingers, 20 virtual resources can be matched, and the 20 virtual resources are added to the target sub-instant messaging account.

[0197] In some implementations, updating the target amount of virtual resources in the target sub-instant messaging account includes:

[0198] (1.1) deducting the target amount of virtual resources from the target instant messaging account;

[0199] (1.2) Add a target number of virtual resources to the target sub-instant messaging account.

[0200] The server may automatically deduct a target amount of 20 virtual resources from the main account, ie, the target instant messaging account, and simultaneously add a target amount of 20 virtual resources to the target sub-instant messaging account.

[0201] In this way, the first user does not need to perform specific operations such as transfer, and the target sub-instant messaging account can be automatically opened and recharged, which greatly improves the efficiency of information processing.

[0202] In step 305, the account binding result and the update result are fed back to the terminal device.

[0203] Among them, after the server implements the above operations, it will feedback the account binding results and update results to the terminal device, so that after the terminal device receives the binding results and update results fed back by the terminal device, it will display them in a visual form on the current interface to prompt the first user and the second user to open the target sub-instant messaging account and recharge successfully. In this way, the second user can subsequently make facial payment or palm vein payment on any terminal device, which greatly facilitates user use and improves user experience.

[0204] In some embodiments, it further comprises:

[0205] (1) receiving a virtual resource transaction query instruction sent by a target instant messaging client corresponding to the target instant messaging account;

[0206] (2) obtaining the virtual resource transaction record of the target sub-instant messaging account based on the virtual resource transaction query instruction;

[0207] (3) Feedback the virtual resource transaction record to the target instant messaging client, so that the target instant messaging client displays the virtual resource transaction record.

[0208] Among them, the target instant messaging account corresponds to the logged-in target instant messaging client as the management account of the target sub-instant messaging account. The user can quickly supervise the target sub-instant messaging account on the mobile phone, for example, he can view the number of virtual resources of the target sub-instant messaging account, close the target sub-instant messaging account and view the virtual resource transaction records of the target sub-instant messaging account.

[0209] Taking the viewing of virtual resource transaction records as an example here, the server can receive a virtual resource transaction query instruction sent by the target instant messaging client corresponding to the target instant messaging account. Based on the virtual resource transaction query instruction, the virtual resource transaction record of the target sub-instant messaging account in the recent time can be quickly retrieved. The virtual resource transaction record can be understood as a consumption record, and the virtual resource transaction record is fed back to the target instant messaging client, so that the target instant messaging client can quickly display the virtual resource transaction record, with good user experience and high information processing efficiency.

[0210] In order to better implement the information processing method provided in the embodiment of the present application, the embodiment of the present application also provides a device based on the above information processing method. The meanings of the terms are the same as those in the above information processing method, and the specific implementation details can refer to the description in the method embodiment.

[0211] See also Figure 7 , Figure 7 A schematic diagram of the structure of an information processing device provided in an embodiment of the present application, wherein the information processing device is applied to a terminal device and may include a first display unit 301, a collection unit 302, a sending unit 303, and a second display unit 304, etc.

[0212] The first display unit 301 is used to display an information collection interface, which at least includes a preset action image.

[0213] In some embodiments, the information processing device further includes:

[0214] A third display unit is used to display an information binding control, where the information binding control is triggered to display when it is detected that the number of current face information is multiple;

[0215] The first display unit is further used to display the information collection interface in response to a triggering operation of the information binding control.

[0216] In some embodiments, the third display unit is used to:

[0217] Display a preset prompt interface, which is triggered when the number of current face information is detected to be multiple;

[0218] The information binding control and the preset protocol information are displayed on the preset prompt interface.

[0219] The collecting unit 302 is used to collect target action images corresponding to multiple users under the instruction of the preset action image.

[0220] The target action image includes at least first facial information and first gesture information of the first user, and second facial information of the second user, the first facial information is associated with the target instant messaging account, and the second facial information is not associated with the instant messaging account.

[0221] In some embodiments, the apparatus further comprises:

[0222] When it is detected that the number of current face information is two, executing to collect target action images corresponding to multiple users under the instruction of preset action images;

[0223] When it is detected that the number of current face information is not two, a prompt message is generated.

[0224] In some embodiments, the acquisition unit 302 includes:

[0225] A collection subunit, used for collecting multiple frames of action images corresponding to multiple users under the instructions of preset action images;

[0226] A first determination subunit is used to determine target face information and target gesture information of each user from the multiple frames of action images;

[0227] The second determining subunit is used to determine the target face information and the target gesture information as a target action image.

[0228] In some embodiments, the first determining subunit is used to:

[0229] Obtaining the face information and gesture information of each user in each frame of the action image, and obtaining the face information set and gesture information set corresponding to each user in the action images of different frames;

[0230] Based on the preset face screening rules, the target face information corresponding to each user is screened out from the face information set;

[0231] Based on the preset gesture screening rule, the target gesture information corresponding to each user is screened out from the gesture information set.

[0232] The sending unit 303 is used to send the target action image to the server, so that the server returns a binding result of binding the second facial information to the target sub-instant messaging account opened based on the target instant messaging account, and an update result of updating the target number of virtual resources determined by the first gesture information to the target instant sub-message account.

[0233] The second display unit 304 is used to display the account binding result and the update result.

[0234] See also Figure 8 , Figure 8A structural diagram of an information processing device provided in an embodiment of the present application, wherein the information processing device is applied to a server and may include a receiving unit 301, an acquiring unit 302, a binding unit 303, an updating unit 304, and a feedback unit 304, etc.

[0235] The receiving unit 301 is used to receive the target action image sent by the terminal device, which is the action image corresponding to the preset action image of multiple users collected by the terminal device under the instruction of the preset action image on the displayed information collection interface.

[0236] The acquisition unit 302 is used to acquire first face information and first gesture information corresponding to the first user and second face information corresponding to the second user in the target action image.

[0237] Among them, the first facial information is associated with the target instant messaging account, and the second facial information is not associated with the instant messaging account.

[0238] In some embodiments, the apparatus further comprises:

[0239] An analysis unit, used to analyze the target action image to obtain target face information and target gesture information corresponding to each user in the target action image;

[0240] The acquisition unit is further configured to, when it is detected that the number of target face information is two, execute acquisition of first face information and first gesture information corresponding to the first user in the target action image, and second face information corresponding to the second user;

[0241] The prompt unit is used to generate prompt information and feed it back to the terminal device when it is detected that the number of target face information is not two.

[0242] In some embodiments, the apparatus further comprises:

[0243] A first determining unit, configured to determine a user corresponding to target facial information associated with a target instant messaging account as a first user;

[0244] The second determining unit is used to determine the user corresponding to the target facial information that is not associated with the target instant messaging account as the second user.

[0245] The binding unit 303 is used to open a target sub-instant messaging account based on the target instant messaging account, and bind the second facial information to the target sub-instant messaging account.

[0246] In some embodiments, the apparatus further comprises:

[0247] A gesture acquiring unit, configured to acquire second gesture information of the second user;

[0248] The associating unit is used to parse the palm vein information carried in the second gesture information and associate the palm vein information with the target sub-instant messaging account.

[0249] The updating unit 304 is configured to determine a target number of virtual resources according to the first gesture information, and update the target number of virtual resources in the target sub-instant messaging account.

[0250] In some embodiments, the updating unit 304 is configured to:

[0251] Acquire the number of gestures indicated by the first gesture information;

[0252] A target number of virtual resources is matched based on the number of gestures, and the target number of virtual resources is updated in the target sub-instant messaging account.

[0253] The feedback unit 305 is used to feed back the account binding result and the update result to the terminal device.

[0254] In some embodiments, the apparatus further comprises:

[0255] A query receiving unit, used to receive a virtual resource transaction query instruction sent by a target instant messaging client corresponding to the target instant messaging account;

[0256] A query unit, configured to obtain the virtual resource transaction record of the target sub-instant messaging account based on the virtual resource transaction query instruction;

[0257] The record feedback unit is used to feed back the virtual resource transaction record to the target instant messaging client, so that the target instant messaging client displays the virtual resource transaction record.

[0258] The specific implementation of each of the above units can be found in the previous embodiments, which will not be described in detail here.

[0259] The present application also provides a computer device, which may be a terminal device, such as Fig. 9 As shown, the terminal device may include a radio frequency (RF) circuit 601, a memory 602 including one or more computer-readable storage media, an input unit 603, a display unit 604, a sensor 605, an audio circuit 606, a wireless fidelity (WiFi) module 607, a processor 608 including one or more processing cores, and a power supply 609. Those skilled in the art will appreciate that Fig. 9 The terminal device structure shown in the figure does not constitute a limitation on the terminal device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. Among them:

[0260] The RF circuit 601 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is handed over to one or more processors 608 for processing; in addition, the data related to the uplink is sent to the base station. Generally, the RF circuit 601 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 601 can also communicate with the network and other devices through wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0261] The memory 602 can be used to store software programs and modules. The processor 608 executes various functional applications and information interactions by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the terminal device (such as audio data, a phone book, etc.), etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 608 and the input unit 603 with access to the memory 602.

[0262] The input unit 603 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, in a specific embodiment, the input unit 603 may include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display screen or a touch pad, can collect the user's touch operations on or near it (such as the user's operation on or near the touch-sensitive surface using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 608, and can receive and execute the command sent by the processor 608. In addition, the touch-sensitive surface can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch-sensitive surface, the input unit 603 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0263] The display unit 604 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal device, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 604 may include a display panel. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface may cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 608 to determine the type of touch event. The processor 608 then provides a corresponding visual output on the display panel according to the type of touch event. Although in Fig. 9 In the embodiment, the touch-sensitive surface and the display panel are used as two independent components to realize input and output functions, but in some embodiments, the touch-sensitive surface and the display panel can be integrated to realize input and output functions.

[0264] The terminal device may also include at least one sensor 605, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor may turn off the display panel and / or backlight when the terminal device is close to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the terminal device, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0265] The audio circuit 606, the speaker, and the microphone can provide an audio interface between the user and the terminal device. The audio circuit 606 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 606 and converted into audio data, and then the audio data is processed by the output processor 608 and sent to another terminal device through the RF circuit 601, or the audio data is output to the memory 602 for further processing. The audio circuit 606 may also include an earplug jack to provide communication between an external headset and the terminal device.

[0266] WiFi is a short-range wireless transmission technology. The terminal device can help users send and receive emails, browse web pages and access streaming media through the WiFi module 607. It provides users with wireless broadband Internet access. Fig. 9 A WiFi module 607 is shown, but it is understandable that it is not an essential component of the terminal device and can be omitted as needed without changing the essence of the invention.

[0267] The processor 608 is the control center of the terminal device. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it executes various functions of the terminal device and processes data, thereby monitoring the mobile phone as a whole. Optionally, the processor 608 may include one or more processing cores; preferably, the processor 608 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 608.

[0268] The terminal device also includes a power supply 609 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 608 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 609 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0269] Although not shown, the terminal device may also include a camera, a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the processor 608 in the terminal device will load the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 608 will run the applications stored in the memory 602 to implement various functions:

[0270] An information collection interface is displayed, which includes at least a preset action image; target action images corresponding to multiple users under the instruction of the preset action image are collected; wherein the target action image includes at least first facial information and first gesture information of a first user, and second facial information of a second user, the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; the target action image is sent to a server, so that the server returns a binding result of binding the second facial information to a target sub-instant messaging account opened based on the target instant messaging account, and an update result of updating a target number of virtual resources determined by the first gesture information to the target instant sub-message account; and the account binding result and the update result are displayed.

[0271] It should be noted that the computer device provided in the embodiment of the present application and the method in the above embodiment belong to the same concept, and the specific implementation of the above operations can be referred to the previous embodiment, which will not be repeated here.

[0272] The present application also provides a computer device, which may be a server. Fig.10 The figure is a schematic diagram of the structure of the computer device provided by this application. Specifically:

[0273] The computer device may include components such as a processing unit 701 of one or more processing cores, a storage unit 702 of one or more storage media, a power module 703, and an input module 704. Those skilled in the art will appreciate that Fig.10 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. Among them:

[0274] The processing unit 701 is the control center of the computer device. It uses various interfaces and lines to connect various parts of the entire computer device. By running or executing software programs and / or modules stored in the storage unit 702 and calling data stored in the storage unit 702, it executes various functions of the computer device and processes data, thereby monitoring the computer device as a whole. Optionally, the processing unit 701 may include one or more processing cores; preferably, the processing unit 701 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processing unit 701.

[0275] The storage unit 702 can be used to store software programs and modules. The processing unit 701 executes various functional applications and data processing by running the software programs and modules stored in the storage unit 702. The storage unit 702 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, and web page access, etc.); the data storage area may store data created according to the use of the computer device, etc. In addition, the storage unit 702 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the storage unit 702 may also include a memory controller to provide the processing unit 701 with access to the storage unit 702.

[0276] The computer device also includes a power module 703 for supplying power to various components. Preferably, the power module 703 can be logically connected to the processing unit 701 through a power management system, so as to achieve functions such as management of charging, discharging, and power consumption management through the power management system. The power module 703 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0277] The computer device may further include an input module 704, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0278] Although not shown, the computer device may also include a display unit, etc., which will not be described in detail here. Specifically in this embodiment, the processing unit 701 in the computer device will load the executable files corresponding to the processes of one or more application programs into the storage unit 702 according to the following instructions, and the processing unit 701 will run the application programs stored in the storage unit 702, thereby realizing various functions, as follows:

[0279] Receive a target action image sent by a terminal device, where the target action image is an action image corresponding to multiple users collected by the terminal device under the indication of a preset action image on an information collection interface displayed; obtain first facial information and first gesture information corresponding to a first user in the target action image, and second facial information corresponding to a second user; wherein the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; open a target sub-instant messaging account based on the target instant messaging account, and bind the second facial information to the target sub-instant messaging account; determine a target number of virtual resources based on the first gesture information, and update the target number of virtual resources in the target sub-instant messaging account; and feed back the account binding result and the update result to the terminal device.

[0280] It should be noted that the computer device provided in the embodiment of the present application and the method in the above embodiment belong to the same concept, and the specific implementation of the above operations can be referred to the previous embodiment, which will not be repeated here.

[0281] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0282] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the information processing methods provided in the embodiments of the present application. For example, the instructions can execute the following steps:

[0283] Display an information collection interface, which at least includes a preset action image; collect target action images corresponding to multiple users under the instruction of the preset action image; wherein the target action image at least includes the first facial information and first gesture information of the first user, and the second facial information of the second user, the first facial information is associated with the target instant messaging account, and the second facial information is not associated with the instant messaging account; send the target action image to the server, so that the server returns the binding result of binding the second facial information to the target sub-instant messaging account opened based on the target instant messaging account, and the update result of updating the target number of virtual resources determined by the first gesture information to the target instant sub-message account; display the account binding result and the update result. Or

[0284] Receive a target action image sent by a terminal device, where the target action image is an action image corresponding to multiple users collected by the terminal device under the indication of a preset action image on an information collection interface displayed; obtain first facial information and first gesture information corresponding to a first user in the target action image, and second facial information corresponding to a second user; wherein the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; open a target sub-instant messaging account based on the target instant messaging account, and bind the second facial information to the target sub-instant messaging account; determine a target number of virtual resources based on the first gesture information, and update the target number of virtual resources in the target sub-instant messaging account; and feed back the account binding result and the update result to the terminal device.

[0285] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various optional implementations provided in the above embodiments.

[0286] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0287] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0288] Since the instructions stored in the computer-readable storage medium can execute the steps in any information processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any information processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0289] The above is a detailed introduction to an information processing method, device, storage medium and computer equipment provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An information processing method, characterized in that: The method comprises: Displaying an information collection interface, wherein the information collection interface at least includes a preset action image; Collecting target action images corresponding to multiple users under the instruction of the preset action image; The target action image at least includes first facial information and first gesture information of a first user, and second facial information of a second user, the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; Sending the target action image to the server, so that the server returns a binding result of binding the second face information to the target sub-instant messaging account opened based on the target instant messaging account, and an update result of updating the target number of virtual resources determined by the first gesture information to the target sub-instant messaging account; Display the account binding result and the update result; Before collecting target action images corresponding to a plurality of users under the instruction of the preset action image, the method further includes: When it is detected that the number of current face information is two, the step of collecting target action images corresponding to multiple users under the instruction of the preset action image is executed; When it is detected that the number of current face information is not two, a prompt message is generated.

2. The information processing method according to claim 1, characterized in that: The method further comprises: Displaying an information binding control, wherein the information binding control is triggered to display when it is detected that the number of current face information is multiple; In response to the triggering operation of the information binding control, an information collection interface is displayed.

3. The information processing method according to claim 2, characterized in that: The display information binding control includes: Displaying a preset prompt interface, wherein the preset prompt interface is triggered to display when the number of current face information is detected to be multiple; The information binding control and the preset protocol information are displayed on the preset prompt interface.

4. The information processing method according to any one of claims 1 to 3, characterized in that: The collecting of target action images corresponding to a plurality of users under the instruction of the preset action image includes: Collecting multiple frames of action images corresponding to multiple users under the instructions of preset action images; Determining target face information and target gesture information of each user from the multiple frames of action images; The target face information and the target gesture information are determined as a target action image.

5. The information processing method according to claim 4, characterized in that: The step of determining target face information and target gesture information of each user from the multiple frames of action images includes: Obtaining the face information and gesture information of each user in each frame of the action image, and obtaining the face information set and gesture information set corresponding to each user in the action images of different frames; Based on a preset face screening rule, filter out target face information corresponding to each user from the face information set; Based on preset gesture screening rules, target gesture information corresponding to each user is screened out from the gesture information set.

6. An information processing method, characterized in that: The method comprises: Receiving a target action image sent by a terminal device, wherein the target action image is an action image corresponding to an action image of a plurality of users collected by the terminal device under the indication of a preset action image on a displayed information collection interface; Acquire first facial information and first gesture information corresponding to a first user in the target action image, and second facial information corresponding to a second user; The first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; opening a target sub-instant messaging account based on the target instant messaging account, and binding the second facial information to the target sub-instant messaging account; Determine a target amount of virtual resources according to the first gesture information, and update the target amount of virtual resources in the target sub-instant messaging account; Feedback the account binding result and the update result to the terminal device; wherein, before obtaining the first face information and the first gesture information corresponding to the first user in the target action image, and the second face information corresponding to the second user, the method further includes: Analyze the target action image to obtain target face information and target gesture information corresponding to each user in the target action image; When it is detected that the number of the target face information is two, acquiring first face information and first gesture information corresponding to the first user in the target action image, and second face information corresponding to the second user; When it is detected that the number of target face information is not two, a prompt message is generated and fed back to the terminal device.

7. The information processing method according to claim 6, characterized in that: Before obtaining the first face information and the first gesture information corresponding to the first user in the target action image, and the second face information corresponding to the second user, the method further includes: Determine the user corresponding to the target facial information associated with the target instant messaging account as the first user; The user corresponding to the target facial information that is not associated with the target instant messaging account is determined as the second user.

8. The information processing method according to claim 7, characterized in that: After the second facial information is bound to the target sub-instant messaging account, the method further includes: Acquire second gesture information of the second user; The palm vein information carried in the second gesture information is parsed, and the palm vein information is associated with the target sub-instant messaging account.

9. The information processing method according to claim 6, characterized in that: The step of determining a target number of virtual resources according to the first gesture information, and updating the target number of virtual resources in the target sub-instant messaging account includes: Acquire the number of gestures indicated by the first gesture information; A target number of virtual resources is matched based on the number of gestures, and the target number of virtual resources is updated in the target sub-instant messaging account.

10. The information processing method according to claim 6 or 9, characterized in that: The updating of the target number of virtual resources in the target sub-instant messaging account includes: Deducting a target amount of virtual resources from the target instant messaging account; A target amount of virtual resources is added to the target sub-instant messaging account.

11. The information processing method according to claim 6, characterized in that: The method further comprises: Receiving a virtual resource transaction query instruction sent by a target instant messaging client corresponding to the target instant messaging account; Acquiring the virtual resource transaction record of the target sub-instant messaging account based on the virtual resource transaction query instruction; The virtual resource transaction record is fed back to the target instant messaging client, so that the target instant messaging client displays the virtual resource transaction record.

12. An information processing device, characterized in that: include: A first display unit, used to display an information collection interface, wherein the information collection interface at least includes a preset action image; A collection unit, used for collecting target action images corresponding to multiple users under the instruction of the preset action image; The target action image at least includes first facial information and first gesture information of a first user, and second facial information of a second user, the first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; a sending unit, configured to send the target action image to a server, so that the server returns a binding result of binding the second face information to a target sub-instant messaging account opened based on the target instant messaging account, and an updating result of updating the target number of virtual resources determined by the first gesture information to the target sub-instant messaging account; A second display unit, used to display the account binding result and the update result; Wherein, the information processing device is also used for: when it is detected that the current number of facial information is two, executing the acquisition of target action images corresponding to multiple users under the instruction of preset action images; when it is detected that the current number of facial information is not two, generating prompt information.

13. The information processing device according to claim 12, characterized in that: The information processing device further includes: A third display unit is used to display an information binding control, wherein the information binding control is triggered to display when it is detected that the number of current face information is multiple; The first display unit is further configured to display an information collection interface in response to a triggering operation of the information binding control.

14. The information processing device according to claim 13, characterized in that: The third display unit is used for: Displaying a preset prompt interface, wherein the preset prompt interface is triggered to display when the number of current face information is detected to be multiple; The information binding control and the preset protocol information are displayed on the preset prompt interface.

15. The information processing device according to any one of claims 12 to 14, characterized in that: The acquisition unit comprises: A collection subunit, used for collecting multiple frames of action images corresponding to multiple users under the instructions of preset action images; A first determination subunit is used to determine target face information and target gesture information of each user from the multiple frames of action images; The second determining subunit is used to determine the target face information and the target gesture information as a target action image.

16. The information processing device according to claim 15, characterized in that: The first determining subunit is used to: Obtaining the face information and gesture information of each user in each frame of the action image, and obtaining the face information set and gesture information set corresponding to each user in the action images of different frames; Based on a preset face screening rule, filter out target face information corresponding to each user from the face information set; Based on preset gesture screening rules, target gesture information corresponding to each user is screened out from the gesture information set.

17. An information processing device, characterized in that: include: A receiving unit, configured to receive a target action image sent by a terminal device, wherein the target action image is an action image corresponding to an action image of a plurality of users collected by the terminal device under the indication of a preset action image on a displayed information collection interface; an acquisition unit, configured to acquire first face information and first gesture information corresponding to a first user, and second face information corresponding to a second user in the target action image; The first facial information is associated with a target instant messaging account, and the second facial information is not associated with an instant messaging account; a binding unit, configured to open a target sub-instant messaging account based on the target instant messaging account, and bind the second facial information to the target sub-instant messaging account; an updating unit, configured to determine a target number of virtual resources according to the first gesture information, and update the target number of virtual resources in the target sub-instant messaging account; A feedback unit, used to feed back the account binding result and the update result to the terminal device; The information processing device further includes: An analyzing unit, configured to analyze the target action image to obtain target face information and target gesture information corresponding to each user in the target action image; The acquisition unit is further configured to, when it is detected that the number of target face information is two, execute acquisition of first face information and first gesture information corresponding to the first user in the target action image, and second face information corresponding to the second user; A prompt unit is used to generate prompt information and feed it back to the terminal device when it is detected that the number of target face information is not two.

18. The information processing device according to claim 17, characterized in that: The information processing device further includes: A first determining unit, configured to determine a user corresponding to target facial information associated with a target instant messaging account as a first user; The second determining unit is used to determine the user corresponding to the target facial information that is not associated with the target instant messaging account as the second user.

19. The information processing device according to claim 18, characterized in that: The information processing device further includes: a gesture acquiring unit, configured to acquire second gesture information of the second user; An associating unit is used to parse the palm vein information carried in the second gesture information and associate the palm vein information with the target sub-instant messaging account.

20. The information processing device according to claim 17, characterized in that: The updating unit is used for: Acquire the number of gestures indicated by the first gesture information; A target number of virtual resources is matched based on the number of gestures, and the target number of virtual resources is updated in the target sub-instant messaging account.

21. The information processing device according to claim 17 or 20, characterized in that: The updating unit is used for: Deducting a target amount of virtual resources from the target instant messaging account; A target amount of virtual resources is added to the target sub-instant messaging account.

22. The information processing device according to claim 17, characterized in that: The information processing device further includes: A query receiving unit, configured to receive a virtual resource transaction query instruction sent by a target instant messaging client corresponding to the target instant messaging account; A query unit, configured to obtain the virtual resource transaction record of the target sub-instant messaging account based on the virtual resource transaction query instruction; The record feedback unit is used to feed back the virtual resource transaction record to the target instant messaging client, so that the target instant messaging client displays the virtual resource transaction record.

23. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the information processing method described in any one of claims 1 to 5 or any one of claims 6 to 11.

24. A computer device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the information processing method described in any one of claims 1 to 5 or any one of claims 6 to 11 when executing the computer program.

25. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the information processing method described in any one of claims 1 to 5 or any one of claims 6 to 11 are implemented.

Images