Resource transfer method based on interactive operation and related equipment
By collecting and authenticating user's palm print information on the video call page and detecting action conditions, transferring between virtual resource accounts is solved, and the problem of cumbersome transfer payment operations in video calls is improved, which improves convenience and user experience.
Patent Information
- Application Number
- CN202111503091.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-10
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2041-12-10
AI Technical Summary
During the video call, users cannot make transfer payments without logging out of the video session page, resulting in cumbersome operations and reducing user experience.
By collecting the user's palm print information on the video call page for identity authentication, and when the detection action meets the resource transfer conditions, the transfer between virtual resource accounts is triggered, and convenient virtual resource transfer during the video call is achieved.
It improves the convenience of users transferring virtual resources during video calls, realizes the combination of video calls and virtual resource transfer, and simplifies the transfer and payment process.
Smart Images

Figure CN116258497B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a resource transfer method based on interactive operation and related equipment. Background Art
[0002] With the development of communication technology, video calls using electronic devices have been widely used in social scenarios. In the process of using electronic devices to make video calls, the display screen of the electronic device can display the real-time video conversation image of the user who is making the video call. Through the video call, the user's environment can be shown to friends, so that the user can communicate face to face.
[0003] However, in the current related technologies, during a video call, if a user wants to initiate a transfer payment to the person on the video call, he needs to first exit the video conversation page with the person on the video call, and then transfer the payment to the person on the video call. The user's transfer payment needs cannot be met without exiting the video conversation page; this will result in more cumbersome operations and reduce user experience. Summary of the invention
[0004] The embodiments of the present application provide a resource transfer method based on interactive operations and related equipment. The related equipment may include a resource transfer device based on interactive operations, an electronic device, a computer-readable storage medium and a computer program product, which can realize the combination of video calls and virtual resource transfer, and improve the convenience of users transferring virtual resources during video calls.
[0005] The embodiment of the present application provides a resource transfer method based on interactive operation, including:
[0006] Displaying a video session page of a target session, the video session page including a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session;
[0007] Collecting palm print information of the first object from the first video frame;
[0008] Based on the palmprint information, performing identity authentication on the first object;
[0009] When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
[0010] Accordingly, an embodiment of the present application provides a resource transfer device based on interactive operation, including:
[0011] A display unit, configured to display a video session page of a target session, wherein the video session page includes a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session;
[0012] A collection unit, configured to collect palm print information of the first object from the first video frame;
[0013] an authentication unit, configured to perform identity authentication on the first object based on the palmprint information;
[0014] The transfer unit is used to trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition.
[0015] Optionally, in some embodiments of the present application, the transfer unit may include a first display subunit, a detection subunit and a first transfer subunit, as follows:
[0016] The first display subunit is configured to display transfer confirmation prompt information on the video session page based on the target resource transfer quantity input by the first object when the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition;
[0017] a detection subunit, configured to detect interactive operation information between the first object and the second object based on the confirmation transfer prompt information;
[0018] The first transfer subunit is used to trigger the transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when it is detected that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition.
[0019] Optionally, in some embodiments of the present application, the detection subunit can be specifically used to perform palm trajectory detection on the first video screen and the second video screen based on the confirmation transfer prompt information, to obtain palm motion data of the first object and the second object; based on the palm motion data of the first object and the second object, identify the interactive operation information between the first object and the second object.
[0020] Optionally, in some embodiments of the present application, the video conversation page includes a prompt area, and the prompt area prompts the first object and the second object to confirm the transfer operation with a preset effect.
[0021] Optionally, in some embodiments of the present application, the interactive operation information includes motion parameters of the interactive operation, and relative position information between the interactive operation and the prompt area;
[0022] The first transfer subunit can be specifically used to trigger the transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when the motion parameters of the interactive operation meet the preset motion conditions and the relative position information meets the preset position conditions.
[0023] Optionally, in some embodiments of the present application, the transfer unit may include a second display subunit, a first determination subunit, and a second transfer subunit, as follows:
[0024] The second display subunit is configured to display an augmented reality area on the video session page when the first object identity authentication succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, wherein the augmented reality area includes at least one virtual input control;
[0025] A first determining subunit, configured to determine a target resource transfer quantity input by the first object in response to a triggering operation of the first object on a target virtual input control in the augmented reality area;
[0026] The second transfer subunit is configured to transfer virtual resources from the virtual resource account of the first object to the virtual resource account of the second object based on the target resource transfer quantity.
[0027] Optionally, in some embodiments of the present application, the transfer unit may include an extraction subunit, a second determination subunit and a third transfer subunit, as follows:
[0028] The extraction subunit is configured to extract semantic feature information from input voice information in response to a voice input operation of the first object on the video conversation page when the first object identity authentication succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition;
[0029] A second determining subunit is used to determine the target resource transfer quantity according to the semantic feature information;
[0030] The third transfer subunit is configured to transfer virtual resources from the virtual resource account of the first object to the virtual resource account of the second object based on the target resource transfer quantity.
[0031] Optionally, in some embodiments of the present application, the transfer unit may include an identification subunit and a fourth transfer subunit, as follows:
[0032] The identification subunit is used to perform action recognition on the first object in the first video screen when the identity authentication of the first object and the second object is successful;
[0033] The fourth transfer subunit is configured to trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when it is identified that the action of the first object meets the resource transfer triggering condition.
[0034] Optionally, in some embodiments of the present application, the interactive operation-based resource transfer device may further include an identity authentication unit, which may be specifically used to collect palm print information of the second object from the second video screen; and perform identity authentication on the second object based on the palm print information of the second object.
[0035] An electronic device provided in an embodiment of the present application includes a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the steps in the resource transfer method based on interactive operation provided in an embodiment of the present application.
[0036] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the resource transfer method based on interactive operation provided in the embodiment of the present application are implemented.
[0037] In addition, an embodiment of the present application also provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements the steps in the resource transfer method based on interactive operations provided in an embodiment of the present application.
[0038] The embodiment of the present application provides a resource transfer method based on interactive operation and related equipment, which can display a video session page of a target session, wherein the video session page includes a first video screen corresponding to a first object in the target session and a second video screen corresponding to a second object; palm print information of the first object is collected from the first video screen; identity authentication is performed on the first object based on the palm print information; when the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered. The present application can transfer virtual resources based on the palm print information of the first object during a video call between the first object and the second object, so that the video call and the virtual resource transfer can be combined, which improves the convenience of users transferring virtual resources during the video call. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0040] Figure 1a is a schematic diagram of a scenario of a resource transfer method based on interactive operation provided in an embodiment of the present application;
[0041] Figure 1b is a flow chart of a resource transfer method based on interactive operation provided in an embodiment of the present application;
[0042] Figure 1c is another flow chart of the resource transfer method based on interactive operation provided in an embodiment of the present application;
[0043] Figure 1d is another flow chart of the resource transfer method based on interactive operation provided in an embodiment of the present application;
[0044] Figure 1e is another flow chart of the resource transfer method based on interactive operation provided in an embodiment of the present application;
[0045] Figure 2 is another flow chart of the resource transfer method based on interactive operation provided in an embodiment of the present application;
[0046] Figure 3 is a schematic diagram of the structure of a resource transfer device based on interactive operation provided in an embodiment of the present application;
[0047] Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0049] The embodiment of the present application provides a resource transfer method based on interactive operation and related equipment, and the related equipment may include a resource transfer device based on interactive operation, an electronic device, a computer-readable storage medium and a computer program product. The resource transfer device based on interactive operation can be integrated in an electronic device, and the electronic device can be a terminal or a server.
[0050] It is understandable that the resource transfer method based on interactive operation of this embodiment can be executed on the terminal, can be executed on the server, or can be executed by the terminal and the server together. The above examples should not be understood as limiting the present application.
[0051] like Figure 1a As shown, a resource transfer method based on interactive operation is performed by a terminal and a server together as an example. The resource transfer system based on interactive operation provided in the embodiment of the present application includes a terminal 10 and a server 11, etc. The terminal 10 and the server 11 are connected via a network, such as a wired or wireless network connection, etc., wherein the resource transfer device based on interactive operation can be integrated in the terminal.
[0052] Among them, the terminal 10 can be used to: display the video session page of the target session, the video session page includes the first video screen corresponding to the first object and the second video screen corresponding to the second object in the target session; collect the palm print information of the first object from the first video screen; authenticate the first object based on the palm print information; when the first object identity authentication is successful and the action of the first object in the first video screen meets the resource transfer triggering condition, trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object. Among them, the terminal 10 can include a mobile phone, a smart TV, a tablet computer, a laptop, or a personal computer (PC, Personal Computer), etc. A client can also be set on the terminal 10, and the client can be an application client or a browser client, etc.
[0053] The server 11 can be used to: receive the first video screen sent by the terminal 10, and collect the palm print information of the first object from the first video screen; authenticate the first object based on the palm print information; and then send the authentication result to the terminal 10. The server 11 can be a single server, or a server cluster or cloud server composed of multiple servers. The resource transfer method or device based on interactive operation disclosed in the present application, wherein multiple servers can be composed of a blockchain, and the server is a node on the blockchain.
[0054] The step of identity authentication performed by the server 11 may also be performed by the terminal 10 .
[0055] The resource transfer method based on interactive operation provided in the embodiment of the present application relates to computer vision technology in the field of artificial intelligence.
[0056] Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science. It attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making. Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level technology and software-level technology. Among them, artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, as well as machine learning / deep learning, autonomous driving, smart transportation and other major directions.
[0057] Among them, Computer Vision (CV) is a science that studies how to make machines "see". To put it more specifically, it refers to machine vision such as using cameras and computers to replace human eyes to identify and measure targets, and further perform graphic processing to make computer processing into images that are more suitable for human eye observation or transmission to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies, and attempts to establish an artificial intelligence system that can obtain information from images or multidimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous positioning and map construction, automatic driving, smart transportation and other technologies, as well as common biometric recognition technologies such as face recognition and fingerprint recognition.
[0058] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.
[0059] This embodiment will be described from the perspective of a resource transfer device based on interactive operations. The resource transfer device based on interactive operations may be integrated into an electronic device, which may be a server, a terminal or other device.
[0060] The resource transfer method based on interactive operation in the embodiment of the present application can be applied to various video conversation scenarios. This embodiment can be applied to various scenarios such as cloud technology, artificial intelligence, smart transportation, and assisted driving.
[0061] like Figure 1b As shown, the specific process of the resource transfer method based on interactive operation can be as follows:
[0062] 101. Display a video session page of a target session, where the video session page includes a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session.
[0063] The video session page of the target session is specifically a video session page of the target session in a client, and the client may be an application client or a browser client. In this embodiment, the client may be any type of client, such as an instant messaging client, a payment client, or a shopping client, etc., and this embodiment has no limitation on this.
[0064] Among them, the target session includes one or more session members, and the above-mentioned video session page can be used for at least two session members to conduct a video session. The video session page may include a video information display area for each session member who is conducting a video session in the target session, and the video screen corresponding to each session member can be displayed in its corresponding video information display area.
[0065] The video conversation page of this embodiment may include real-time video information of conversation members. The number of conversation members on the video conversation page is not limited and may be two, three, or the like.
[0066] The first object and the second object are session members of the target session. The first video screen corresponding to the first object includes a screen corresponding to the scene where the first object is located, and the first video screen corresponding to the first object can be acquired in real time by an image acquisition device of the terminal where the first object is located. The second video screen corresponding to the second object includes a screen corresponding to the scene where the second object is located, and the second video screen corresponding to the second object can be acquired in real time by an image acquisition device of the terminal where the second object is located. The image acquisition device can be a camera, etc.
[0067] 102. Collect palm print information of the first object from the first video frame.
[0068] In this embodiment, the step of “collecting the palm print information of the first object from the first video frame” may include:
[0069] Palmprint recognition is performed on the first video frame to obtain palmprint information of the first object.
[0070] Palmprint recognition is a biometric recognition technology. Palmprint information can specifically refer to the image information of the palm from the end of the finger to the wrist. The palmprint features of different objects are different, so identity authentication can be performed based on palmprint information.
[0071] Among them, biometric recognition technology is a technology that uses the inherent physiological characteristics of the human body (such as fingerprints, faces, irises, etc.) and behavioral characteristics (such as handwriting, voice, gait, etc.) to identify individuals through a close combination of computers with high-tech means such as optics, acoustics, biosensors and biostatistics principles.
[0072] Optionally, in this embodiment, the step of “performing palmprint recognition on the first video image to obtain palmprint information of the first object” may include:
[0073] Performing palmprint area recognition on the first video screen to obtain the palmprint area in the first video screen;
[0074] Feature extraction is performed on the palmprint area to obtain palmprint information of the first object.
[0075] Among them, the features of the palm print area can be extracted through a neural network model, and the neural network model can be a visual geometry group network (VGGNet, Visual Geometry Group Network), a residual network (ResNet, ResidualNetwork) and a densely connected convolutional network (DenseNet, Dense Convolutional Network), etc. However, it should be understood that the neural network model of this embodiment is not limited to the types listed above.
[0076] Among them, the neural network model can be obtained through deep learning, which is to implement artificial intelligence machine learning in a computing system by establishing a neural network with a hierarchical structure. Since the neural network with a hierarchical structure can extract and filter the input information layer by layer, deep learning has the ability to represent learning and can achieve end-to-end supervised learning and unsupervised learning.
[0077] Specifically, feature extraction of the palmprint region may be performed by convolution processing, pooling processing, or the like.
[0078] 103. Perform identity authentication on the first object based on the palm print information.
[0079] The palm print information may be the palm print information of the user's left palm or the palm print information of the user's right palm, which is not limited in this embodiment.
[0080] After the palm print information is obtained, it can be matched with the palm print feature information stored in the preset palm print information database to determine the user identity of the first object. The preset palm print information database can store a target mapping relationship set, which includes a mapping relationship between preset palm print feature information and preset user identities; for example, the target mapping relationship set can be a relationship table between preset palm print feature information and preset user identities.
[0081] Specifically, the preset palmprint information database can be SQLite, which is a lightweight database and a relational database management system that complies with ACID. ACID is the abbreviation of the four basic elements for the correct execution of database transactions, including: Atomicity, Consistency, Isolation, and Durability.
[0082] In some embodiments, the degree of match between the palm print information and each preset palm print feature information can be calculated, and based on the degree of match, the target palm print feature information can be determined from the preset palm print feature information. For example, the preset palm print feature information with the highest degree of match with the palm print information can be determined as the target palm print feature information; and then based on the target mapping relationship set, the user identity corresponding to the target palm print feature information is determined as the user identity of the first object.
[0083] Optionally, in this embodiment, before the step of “authenticating the first object based on the palmprint information”, the following steps may also be included:
[0084] Collecting palmprint feature information of the first subject;
[0085] Constructing a mapping relationship between the palmprint feature information and the user identity corresponding to the first object;
[0086] Based on the mapping relationship, the target mapping relationship set is updated.
[0087] The target mapping relationship set is updated, specifically, by adding the mapping relationship between the palmprint feature information and the user identity corresponding to the first object to the target mapping relationship set.
[0088] Specifically, through real-name authentication, palm print information can be associated with the user's identity, which can ensure the security of virtual resource transfer.
[0089] In a specific scenario, such as Figure 1c As shown in FIG. 1 , it is a flowchart of identity authentication through palmprint recognition technology, which is described in detail as follows:
[0090] A1. Collecting a palmprint image of the object to be authenticated. The palmprint image is specifically an image containing palmprint information, and specifically can be the first video screen corresponding to the first object in the above embodiment, or the second video screen corresponding to the second object;
[0091] A2, preprocessing the palmprint image to obtain a preprocessed palmprint area, wherein the preprocessing may include adjusting the size of the palmprint image, enhancing the image data, rotating the image, and identifying the palmprint area;
[0092] A3, extracting features from the palmprint area to obtain palmprint information of the object to be authenticated;
[0093] A4. Perform identity authentication on the subject to be authenticated based on the palmprint information.
[0094] 104. When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object.
[0095] The first object identity authentication success may specifically refer to identifying the user identity of the first object. Specifically, the first object is the payer, and the second object may be the payee. It is understandable that the first object may refer to one or more users, and the second object may also refer to one or more users.
[0096] The virtual resources in this embodiment are concepts that are opposite to real resources, and are mainly born with the birth of the Internet. Virtual resource transfer can be transferring virtual resources from one virtual resource account or a terminal application account to another virtual resource account or a terminal application account. For example, virtual resources can specifically be coupons, red envelopes, group purchase coupons, etc. Among them, the virtual resource account can specifically be a payment account.
[0097] Optionally, in this embodiment, the step of “when the identity authentication of the first object succeeds and the action of the first object in the first video screen is detected to meet the resource transfer trigger condition, triggering the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object” may include:
[0098] When the identities of the first object and the second object are successfully authenticated, performing action recognition on the first object in the first video screen;
[0099] When it is identified that the action of the first object meets the resource transfer triggering condition, the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
[0100] The resource transfer trigger condition can be set according to the actual situation, and this embodiment does not limit this. For example, the resource transfer trigger condition can be that the matching degree between the action of the first object and the preset resource transfer trigger action is higher than the preset value, and the preset value can be set according to the actual situation. The preset resource transfer trigger action can be set by the first object itself, or it can be set by the resource transfer system based on interactive operations, and this embodiment does not limit this. For example, the preset resource transfer trigger action can be a gesture of "ok", etc.
[0101] The calculation process of the matching degree between the action of the first object and the preset resource transfer triggering action may specifically be to calculate the vector distance between the feature vector corresponding to the identified action and the feature vector corresponding to the preset resource transfer triggering action; the smaller the vector distance, the higher the matching degree, and vice versa, the larger the vector distance, the lower the matching degree. When the vector distance is less than the preset threshold, it can be considered that the action of the first object meets the resource transfer triggering condition.
[0102] Optionally, in some embodiments, the action of the first object in the first video screen can be recognized by a neural network to determine whether the action of the first object meets the resource transfer triggering condition. The neural network can be a visual geometry group network (VGGNet, Visual Geometry Group Network), a residual network (ResNet, Residual Network) and a densely connected convolutional network (DenseNet, Dense Convolutional Network), etc., but it should be understood that the neural network of this embodiment is not limited to the types listed above.
[0103] Specifically, based on the video recognition interaction technology, the action of the first object in the first video screen can be recognized. The video recognition interaction technology mainly uses the behavior feature extraction in the biometric recognition technology to extract the user's behavior features through video recognition. Specifically, the video frame can be transmitted to the background for processing, analysis and understanding, and the action gestures of the person can be extracted.
[0104] There are many methods for authenticating the second object, which are not limited in this embodiment. For example, it can be the same authentication method as the first object, that is, an authentication method based on palm print information, or an authentication method based on face recognition.
[0105] Optionally, in this embodiment, the resource transfer method based on interactive operation may further include:
[0106] collecting palm print information of the second object from the second video screen;
[0107] Based on the palm print information of the second object, identity authentication is performed on the second object.
[0108] The process of performing identity authentication on the second object based on the palm print information of the second object may refer to the process of performing identity authentication on the first object in the above embodiment, which will not be described in detail here.
[0109] Optionally, in this embodiment, the step of “when the identity authentication of the first object succeeds and the action of the first object in the first video screen is detected to meet the resource transfer trigger condition, triggering the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object” may include:
[0110] When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, an augmented reality area is displayed on the video session page, where the augmented reality area includes at least one virtual input control;
[0111] In response to a triggering operation of the first object on a target virtual input control in the augmented reality area, determining a target resource transfer quantity input by the first object;
[0112] Based on the target resource transfer amount, virtual resources are transferred from the virtual resource account of the first object to the virtual resource account of the second object.
[0113] The triggering operation on the target virtual input control may be a click or slide operation on the target virtual input control, etc., which is not limited in this embodiment. The target resource transfer amount may be the amount of money to be paid.
[0114] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with real scenes. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to real scenes, thereby achieving "enhancement" of real scenes.
[0115] The augmented reality (AR) area may be an AR keyboard, and the virtual input control may be an AR virtual key. Specifically, different virtual input controls represent different information. For example, the augmented reality area may include virtual input controls corresponding to the numbers "0" to "9". The user may click on the virtual input control on the video session page to enter the transaction amount.
[0116] In a specific embodiment, during a video conversation between a first object and a second object, if the two need to transfer virtual resources, the first object and the second object can raise their palms to face the camera on the terminal. After the camera collects palm print information, the user identities of the first object and the second object can be identified based on the palm print information. When the identity identification and authentication of both parties are successful, the target conversation can enter the transaction mode; in the transaction mode, the transferor (specifically the first object) can use a gesture that meets the resource transfer trigger condition (such as an "ok" gesture) to initiate a transfer request to the second object. The resource transfer system based on interactive operations can guide the first object to input the transaction amount by voice, and then transfer the transaction amount from the first object's payment account to the second object's payment account. In this way, there is no need to interrupt the video conversation to conduct the transaction, which is more convenient.
[0117] Optionally, in this embodiment, the step of “when the identity authentication of the first object succeeds and the action of the first object in the first video screen is detected to meet the resource transfer trigger condition, triggering the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object” may include:
[0118] When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, in response to the voice input operation of the first object on the video session page, extracting semantic feature information from the input voice information;
[0119] Determining the target resource transfer quantity according to the semantic feature information;
[0120] Based on the target resource transfer amount, virtual resources are transferred from the virtual resource account of the first object to the virtual resource account of the second object.
[0121] Among them, semantic feature information can be extracted from speech information through a neural network, and the neural network can be a convolutional neural network, a residual network, a densely connected convolutional network, etc., but it should be understood that the neural network of this embodiment is not limited to the types listed above. In addition, other machine learning methods can also be used to extract semantic feature information, such as Mel spectrum, fundamental pitch and other acoustic features, and are not limited to the artificial neural network method.
[0122] Specifically, the speech-to-text (STT) technology can be used to convert the input voice information into text information, thereby determining the target resource transfer quantity. The speech-to-text technology can use traditional speech recognition (ASR) technology. The specific implementation process is as follows: Figure 1d The specific description is as follows:
[0123] a. Input voice signal (specifically, the voice information in the above embodiment);
[0124] b. Preprocessing the speech signal, which may include denoising, etc.;
[0125] c. Extracting semantic features from the preprocessed speech signal through the trained speech recognition model to obtain semantic feature information corresponding to the speech signal;
[0126] d. Based on the semantic feature information, obtain the speech recognition result.
[0127] Optionally, in this embodiment, the first object may also input the transaction amount in other ways, such as inputting the transaction amount through a keyboard, or inputting the transaction amount through gesture recognition, etc. Wherein, when inputting the transaction amount through gesture recognition, the matching degree of the recognized action of the first object and each preset gesture may be calculated, so that the preset gesture with the highest matching degree with the action of the first object is used as the target gesture, and the input transaction amount is determined according to the number corresponding to the target gesture. Wherein, the preset gesture may be set according to the actual situation, for example, the preset gesture may include gestures corresponding to "0" to "9".
[0128] Optionally, in this embodiment, the step of “when the identity authentication of the first object succeeds and the action of the first object in the first video screen is detected to meet the resource transfer trigger condition, triggering the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object” may include:
[0129] When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, based on the target resource transfer quantity input by the first object, a transfer confirmation prompt message is displayed on the video session page;
[0130] Based on the confirmation transfer prompt information, detecting interactive operation information between the first object and the second object;
[0131] When it is detected that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition, a transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
[0132] There are many presentation forms of the transfer confirmation prompt information, which are not limited in this embodiment. For example, the transfer confirmation prompt information can be presented in the form of text, audio, image, video, etc.
[0133] For example, the transfer confirmation prompt information may be a prompt for the first object and the second object to perform an interactive operation to confirm the transfer of the virtual resource of the transfer target resource quantity.
[0134] The preset transfer confirmation condition can be set according to actual conditions, and this embodiment does not limit this. For example, the preset transfer confirmation condition can be that the matching degree between the interactive operation information between the first object and the second object and the preset interactive operation information is higher than a preset value, and the preset value can be set according to actual conditions.
[0135] Optionally, in this embodiment, the step of “detecting interactive operation information between the first object and the second object based on the confirmation transfer prompt information” may include:
[0136] Based on the confirmation transfer prompt information, palm trajectory detection is performed on the first video screen and the second video screen to obtain palm motion data of the first object and the second object;
[0137] According to the palm motion data of the first object and the second object, interactive operation information between the first object and the second object is identified.
[0138] Specifically, the confirmation transfer prompt information can be a prompt for the first object and the second object to move their palms to the prompt area on the terminal display screen at a certain rate. The palms and the prompt area can be non-physical contact, and in a preset direction (such as a direction perpendicular to the display screen), the overlapping area of the palms and the prompt area reaches a preset percentage, which can trigger the confirmation of the virtual resource transfer. In this way, when the confirmation transfer prompt information is displayed on the video conversation page, the palms of both parties can be detected in real time, and combined with the guidance of the resource transfer system based on interactive operations, the palms can be moved at a suitable position at a speed exceeding a specific high-five rate until the overlapping area of the touch with the prompt area reaches a certain percentage to trigger the transaction.
[0139] Optionally, in this embodiment, the video conversation page includes a prompt area, and the prompt area prompts the first object and the second object to confirm the transfer operation with a preset effect.
[0140] Among them, the confirmation transfer prompt information can be presented in the form of a prompt area.
[0141] The preset effect may be set according to actual conditions. For example, the preset effect may be to highlight the prompt area.
[0142] Optionally, in this embodiment, the interactive operation information includes motion parameters of the interactive operation and relative position information between the interactive operation and the prompt area;
[0143] The step of “triggering the transfer of the target resource transfer amount of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when detecting that the interactive operation information between the first object and the second object meets the preset transfer confirmation condition” may include:
[0144] When the motion parameter of the interactive operation meets a preset motion condition and the relative position information meets a preset position condition, a transfer of the target resource transfer amount of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
[0145] The interactive operation can be set according to actual conditions, for example, the interactive operation can be a remote handshake, high five, hug, etc. between the first object and the second object. It is understandable that the operation types corresponding to the interactive operation of the first object and the second object can be the same or different; for example, the interactive operation of the first object can be a handshake action, and the interactive operation of the second object can be a hug action.
[0146] The motion parameters of the interactive operation may include motion parameters of the action corresponding to the first object and motion parameters of the action corresponding to the second object; specifically, the motion parameters may be palm movement speed, etc., which is not limited in this embodiment.
[0147] The preset motion condition and the preset position condition can be set according to actual conditions, and this embodiment does not limit this. For example, the preset motion condition can be that the palm movement speed of the first object and the second object exceeds the preset speed, and the preset position condition can be that the overlap area of the palms of both parties and the prompt area reaches a certain percentage.
[0148] Specifically, the relative position information between the interactive operation and the prompt area may include the relative position information between the palm area of the first object and the palm area of the second object and the prompt area at a certain moment, which can also be specifically understood as the overlap between the palm area and the prompt area.
[0149] The resource transfer method based on interactive operation provided by this application can be applied to virtual resource transfer in various video conversation scenarios. For example, it can be applied in multi-person video conversations to realize the function of multiple people grabbing red envelopes during the video conversation; it can also be applied in business negotiations, combining video ordering and contract signing and other operations, and completing offline contract signing and transfer operations online.
[0150] In a specific scenario, Figure 1e As shown, it is a flowchart corresponding to the resource transfer method based on interactive operation provided by this application, which is described as follows:
[0151] 1. The transferor (specifically the first party) and the recipient (specifically the second party) conduct a video conversation;
[0152] 2. Perform palm print recognition on the transferor and the recipient respectively to obtain the palm print information of both parties;
[0153] 3. Based on the palm print information, the transferor and the recipient are authenticated. When both parties are authenticated successfully, proceed to step 4;
[0154] 4. The transferor uses a specific gesture (such as the "OK" gesture) to initiate a transaction request
[0155] 5. After receiving the transaction request, the resource transfer system based on interactive operation prompts the transferor to enter the transaction amount by voice.
[0156] 6. Obtain the voice information input by the transferor on the video conversation page, send it to the resource transfer system based on interactive operations, perform voice recognition on the voice information, and obtain the transaction amount to be paid;
[0157] 7. Through the interactive resource transfer system, the transferor and the recipient are prompted to raise their hands for remote high-five payment
[0158] 8. The transferor and the recipient follow the guidance of the system and move their palms at a certain speed until the overlapping area of their palms reaches a certain percentage, that is, the palms are remotely touched in the same area (specifically, the prompt area) on the video conversation page, and the high-five is considered successful;
[0159] 9. When the system recognizes that the high-five is successful, it enters the transfer process and transfers the transaction amount to be paid from the transferor's payment account to the recipient's payment account. When the transfer is successful, the transfer mode is exited.
[0160] As can be seen from the above, this embodiment can display the video conversation page of the target conversation, and the video conversation page includes a first video screen corresponding to the first object in the target conversation and a second video screen corresponding to the second object; collect the palm print information of the first object from the first video screen; authenticate the first object based on the palm print information; when the first object identity authentication is successful, and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object. This application can transfer virtual resources based on the palm print information of the first object during the video call between the first object and the second object, so that the video call and the virtual resource transfer can be combined, which improves the convenience of users transferring virtual resources during the video call.
[0161] According to the method described in the above embodiment, the resource transfer device based on interactive operation is integrated into a terminal as an example for further detailed description.
[0162] The present application embodiment provides a resource transfer method based on interactive operation, such as Figure 2 As shown, the specific process of the resource transfer method based on interactive operation can be as follows:
[0163] 201. A terminal displays a video session page of a target session, where the video session page includes a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session.
[0164] Among them, the target session includes one or more session members, and the above-mentioned video session page can be used for at least two session members to conduct a video session. The video session page may include a video information display area for each session member who is conducting a video session in the target session, and the video screen corresponding to each session member can be displayed in its corresponding video information display area.
[0165] The video conversation page of this embodiment may include real-time video information of conversation members. The number of conversation members on the video conversation page is not limited and may be two, three, or the like.
[0166] 202. The terminal collects palm print information of the first object from the first video image.
[0167] In this embodiment, the step of “collecting the palm print information of the first object from the first video frame” may include:
[0168] Palmprint recognition is performed on the first video frame to obtain palmprint information of the first object.
[0169] Palmprint recognition is a biometric recognition technology. Palmprint information can specifically refer to the image information of the palm from the end of the finger to the wrist. The palmprint features of different objects are different, so identity authentication can be performed based on palmprint information.
[0170] 203. The terminal performs identity authentication on the first object based on the palm print information.
[0171] After the palm print information is obtained, it can be matched with the palm print feature information stored in the preset palm print information database to determine the user identity of the first object. The preset palm print information database can store a target mapping relationship set, which includes a mapping relationship between preset palm print feature information and preset user identities; for example, the target mapping relationship set can be a relationship table between preset palm print feature information and preset user identities.
[0172] 204. When the identity authentication of the first object and the second object is successful, the terminal performs action recognition on the first object in the first video screen.
[0173] The first object identity authentication success may specifically refer to identifying the user identity of the first object. Specifically, the first object is the payer, and the second object may be the payee. It is understandable that the first object may refer to one or more users, and the second object may also refer to one or more users.
[0174] There are many methods for authenticating the second object, which are not limited in this embodiment. For example, it can be the same authentication method as the first object, that is, an authentication method based on palm print information, or an authentication method based on face recognition.
[0175] Optionally, in this embodiment, the resource transfer method based on interactive operation may further include:
[0176] collecting palm print information of the second object from the second video screen;
[0177] Based on the palm print information of the second object, identity authentication is performed on the second object.
[0178] 205. When it is recognized that the action of the first object meets the resource transfer triggering condition, the terminal displays a transfer confirmation prompt message on the video session page based on the target resource transfer quantity input by the first object.
[0179] The resource transfer trigger condition can be set according to the actual situation, and this embodiment does not limit this. For example, the resource transfer trigger condition can be that the matching degree between the action of the first object and the preset resource transfer trigger action is higher than the preset value, and the preset value can be set according to the actual situation. The preset resource transfer trigger action can be set by the first object itself, or it can be set by the resource transfer system based on interactive operations, and this embodiment does not limit this. For example, the preset resource transfer trigger action can be a gesture of "ok", etc.
[0180] There are many presentation forms of the transfer confirmation prompt information, which are not limited in this embodiment. For example, the transfer confirmation prompt information can be presented in the form of text, audio, image, video, etc.
[0181] For example, the transfer confirmation prompt information may be a prompt for the first object and the second object to perform an interactive operation to confirm the transfer of the virtual resource of the transfer target resource quantity.
[0182] 206. The terminal detects interactive operation information between the first object and the second object based on the confirmation transfer prompt information.
[0183] Optionally, in this embodiment, the step of “detecting interactive operation information between the first object and the second object based on the confirmation transfer prompt information” may include:
[0184] Based on the confirmation transfer prompt information, palm trajectory detection is performed on the first video screen and the second video screen to obtain palm motion data of the first object and the second object;
[0185] According to the palm motion data of the first object and the second object, interactive operation information between the first object and the second object is identified.
[0186] Specifically, the confirmation transfer prompt information can be a prompt for the first object and the second object to move their palms to the prompt area on the terminal display screen at a certain rate. The palms and the prompt area can be non-physical contact, and in a preset direction (such as a direction perpendicular to the display screen), the overlapping area of the palms and the prompt area reaches a preset percentage, which can trigger the confirmation of the virtual resource transfer. In this way, when the confirmation transfer prompt information is displayed on the video conversation page, the palms of both parties can be detected in real time, and combined with the guidance of the resource transfer system based on interactive operations, the palms can be moved at a suitable position at a speed exceeding a specific high-five rate until the overlapping area of the touch with the prompt area reaches a certain percentage to trigger the transaction.
[0187] Optionally, in this embodiment, the video conversation page includes a prompt area, and the prompt area prompts the first object and the second object to confirm the transfer operation with a preset effect.
[0188] Among them, the confirmation transfer prompt information can be presented in the form of a prompt area.
[0189] The preset effect may be set according to actual conditions. For example, the preset effect may be to highlight the prompt area.
[0190] 207. When it is detected that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition, the terminal triggers the transfer of virtual resources of the target resource transfer quantity from the virtual resource account of the first object to the virtual resource account of the second object.
[0191] The preset transfer confirmation condition can be set according to actual conditions, and this embodiment does not limit this. For example, the preset transfer confirmation condition can be that the matching degree between the interactive operation information between the first object and the second object and the preset interactive operation information is higher than a preset value, and the preset value can be set according to actual conditions.
[0192] Optionally, in this embodiment, the interactive operation information includes motion parameters of the interactive operation and relative position information between the interactive operation and the prompt area;
[0193] The step of “triggering the transfer of the target resource transfer amount of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when detecting that the interactive operation information between the first object and the second object meets the preset transfer confirmation condition” may include:
[0194] When the motion parameter of the interactive operation meets a preset motion condition and the relative position information meets a preset position condition, a transfer of the target resource transfer amount of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
[0195] The interactive operation can be set according to actual conditions, for example, the interactive operation can be a remote handshake, high five, hug, etc. between the first object and the second object. It is understandable that the operation types corresponding to the interactive operation of the first object and the second object can be the same or different; for example, the interactive operation of the first object can be a handshake action, and the interactive operation of the second object can be a hug action.
[0196] The motion parameters of the interactive operation may include motion parameters of the action corresponding to the first object and motion parameters of the action corresponding to the second object; specifically, the motion parameters may be palm movement speed, etc., which is not limited in this embodiment.
[0197] The preset motion condition and the preset position condition can be set according to actual conditions, and this embodiment does not limit this. For example, the preset motion condition can be that the palm movement speed of the first object and the second object exceeds the preset speed, and the preset position condition can be that the overlap area of the palms of both parties and the prompt area reaches a certain percentage.
[0198] As can be seen from the above, in this embodiment, the terminal can display the video session page of the target session, and the video session page includes the first video screen corresponding to the first object in the target session and the second video screen corresponding to the second object; the palm print information of the first object is collected from the first video screen; based on the palm print information, the first object is authenticated; when the first object and the second object are successfully authenticated, the terminal recognizes the action of the first object in the first video screen; when it is recognized that the action of the first object meets the resource transfer triggering condition, the terminal displays the confirmation transfer prompt information on the video session page based on the target resource transfer quantity input by the first object; based on the confirmation transfer prompt information, the interactive operation information between the first object and the second object is detected; when it is detected that the interactive operation information between the first object and the second object meets the preset transfer confirmation condition, the terminal triggers the transfer of the target resource transfer quantity from the virtual resource account of the first object to the virtual resource account of the second object. In this application, during the process of the first object and the second object making a video call, the virtual resource is transferred based on the palm print information of the first object, so that the video call and the virtual resource transfer can be combined, which improves the convenience of users transferring virtual resources during the video call.
[0199] In order to better implement the above method, the embodiment of the present application also provides a resource transfer device based on interactive operation, such as Figure 3 As shown, the resource transfer device based on interactive operation may include a display unit 301, a collection unit 302, an authentication unit 303 and a transfer unit 304, as follows:
[0200] (1) Display unit 301;
[0201] The display unit 301 is used to display a video session page of a target session, wherein the video session page includes a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session.
[0202] (2) Collection unit 302;
[0203] The collecting unit 302 is used to collect the palm print information of the first object from the first video frame.
[0204] (3) authentication unit 303;
[0205] The authentication unit 303 is configured to perform identity authentication on the first object based on the palm print information.
[0206] (4) Transfer unit 304;
[0207] The transfer unit 304 is used to trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer trigger condition.
[0208] Optionally, in some embodiments of the present application, the transfer unit may include a first display subunit, a detection subunit and a first transfer subunit, as follows:
[0209] The first display subunit is configured to display transfer confirmation prompt information on the video session page based on the target resource transfer quantity input by the first object when the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition;
[0210] a detection subunit, configured to detect interactive operation information between the first object and the second object based on the confirmation transfer prompt information;
[0211] The first transfer subunit is used to trigger the transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when it is detected that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition.
[0212] Optionally, in some embodiments of the present application, the detection subunit can be specifically used to perform palm trajectory detection on the first video screen and the second video screen based on the confirmation transfer prompt information, to obtain palm motion data of the first object and the second object; based on the palm motion data of the first object and the second object, identify the interactive operation information between the first object and the second object.
[0213] Optionally, in some embodiments of the present application, the video conversation page includes a prompt area, and the prompt area prompts the first object and the second object to confirm the transfer operation with a preset effect.
[0214] Optionally, in some embodiments of the present application, the interactive operation information includes motion parameters of the interactive operation, and relative position information between the interactive operation and the prompt area;
[0215] The first transfer subunit can be specifically used to trigger the transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when the motion parameters of the interactive operation meet the preset motion conditions and the relative position information meets the preset position conditions.
[0216] Optionally, in some embodiments of the present application, the transfer unit may include a second display subunit, a first determination subunit, and a second transfer subunit, as follows:
[0217] The second display subunit is configured to display an augmented reality area on the video session page when the first object identity authentication succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, wherein the augmented reality area includes at least one virtual input control;
[0218] A first determining subunit, configured to determine a target resource transfer quantity input by the first object in response to a triggering operation of the first object on a target virtual input control in the augmented reality area;
[0219] The second transfer subunit is configured to transfer virtual resources from the virtual resource account of the first object to the virtual resource account of the second object based on the target resource transfer quantity.
[0220] Optionally, in some embodiments of the present application, the transfer unit may include an extraction subunit, a second determination subunit and a third transfer subunit, as follows:
[0221] The extraction subunit is configured to extract semantic feature information from input voice information in response to a voice input operation of the first object on the video conversation page when the first object identity authentication succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition;
[0222] A second determining subunit is used to determine the target resource transfer quantity according to the semantic feature information;
[0223] The third transfer subunit is configured to transfer virtual resources from the virtual resource account of the first object to the virtual resource account of the second object based on the target resource transfer quantity.
[0224] Optionally, in some embodiments of the present application, the transfer unit may include an identification subunit and a fourth transfer subunit, as follows:
[0225] The identification subunit is used to perform action recognition on the first object in the first video screen when the identity authentication of the first object and the second object is successful;
[0226] The fourth transfer subunit is configured to trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when it is identified that the action of the first object meets the resource transfer triggering condition.
[0227] Optionally, in some embodiments of the present application, the interactive operation-based resource transfer device may further include an identity authentication unit, which may be specifically used to collect palm print information of the second object from the second video screen; and perform identity authentication on the second object based on the palm print information of the second object.
[0228] As can be seen from the above, in this embodiment, the video session page of the target session can be displayed through the display unit 301, and the video session page includes the first video screen corresponding to the first object and the second video screen corresponding to the second object in the target session; the palm print information of the first object is collected from the first video screen by the collection unit 302; the identity of the first object is authenticated based on the palm print information by the authentication unit 303; when the identity authentication of the first object is successful, and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered by the transfer unit 304. In the process of the first object and the second object making a video call, the present application can transfer virtual resources based on the palm print information of the first object, so that the video call and the virtual resource transfer can be combined, which improves the convenience of users transferring virtual resources during the video call.
[0229] The present application also provides an electronic device, such as Figure 4 As shown, it shows a schematic diagram of the structure of an electronic device involved in an embodiment of the present application, and the electronic device may be a terminal or a server, etc. Specifically:
[0230] The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0231] The processor 401 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, the processor 401 performs various functions of the electronic device and processes data. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 401.
[0232] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
[0233] The electronic device also includes a power supply 403 for supplying power to each component. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, power consumption and other functions through the power management system. The power supply 403 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.
[0234] The electronic device may further include an input unit 404, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0235] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 401 in the electronic device will load the executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 will run the application programs stored in the memory 402, thereby realizing various functions, as follows:
[0236] A video session page of a target session is displayed, wherein the video session page includes a first video screen corresponding to a first object in the target session and a second video screen corresponding to a second object; palm print information of the first object is collected from the first video screen; identity authentication is performed on the first object based on the palm print information; when the identity authentication of the first object is successful and it is detected that an action of the first object in the first video screen meets a resource transfer trigger condition, triggering the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object.
[0237] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0238] As can be seen from the above, this embodiment can display the video conversation page of the target conversation, and the video conversation page includes a first video screen corresponding to the first object in the target conversation and a second video screen corresponding to the second object; collect the palm print information of the first object from the first video screen; authenticate the first object based on the palm print information; when the first object identity authentication is successful, and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, trigger the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object. This application can transfer virtual resources based on the palm print information of the first object during the video call between the first object and the second object, so that the video call and the virtual resource transfer can be combined, which improves the convenience of users transferring virtual resources during the video call.
[0239] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0240] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the interactive operation-based resource transfer methods provided in the embodiments of the present application. For example, the instructions can execute the following steps:
[0241] A video session page of a target session is displayed, wherein the video session page includes a first video screen corresponding to a first object in the target session and a second video screen corresponding to a second object; palm print information of the first object is collected from the first video screen; identity authentication is performed on the first object based on the palm print information; when the identity authentication of the first object is successful and it is detected that an action of the first object in the first video screen meets a resource transfer trigger condition, triggering the transfer of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object.
[0242] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0243] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0244] Since the instructions stored in the computer-readable storage medium can execute the steps in any one of the interactive operation-based resource transfer methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the interactive operation-based resource transfer methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0245] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various optional implementations of the resource transfer based on interactive operations.
[0246] The above is a detailed introduction to a resource transfer method based on interactive operations and related equipment provided in an embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A resource transfer method based on interactive operation, characterized in that: include: Displaying a video session page of a target session, the video session page including a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session, the first object and the second object being session members of the target session, the first video screen including a real-time screen corresponding to a scene where the first object is located, and the second video screen including a real-time screen corresponding to a scene where the second object is located; Collecting palm print information of the first object from the first video frame; Based on the palmprint information, performing identity authentication on the first object; When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, based on the target resource transfer amount input by the first object, a confirmation transfer prompt message is displayed on the video session page, where the target resource transfer amount is the amount that the first object needs to pay; Based on the confirmation transfer prompt information, detecting interactive operation information between the first object and the second object; When it is detected that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition, a transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
2. The method according to claim 1, characterized in that The detecting the interactive operation information between the first object and the second object based on the confirmation transfer prompt information includes: Based on the confirmation transfer prompt information, palm trajectory detection is performed on the first video screen and the second video screen to obtain palm motion data of the first object and the second object; According to the palm motion data of the first object and the second object, interactive operation information between the first object and the second object is identified.
3. The method according to claim 1, characterized in that The video conversation page includes a prompt area, and the prompt area prompts the first object and the second object to confirm the transfer operation with a preset effect.
4. The method according to claim 3, characterized in that The interactive operation information includes motion parameters of the interactive operation and relative position information between the interactive operation and the prompt area; The triggering of transferring the target resource transfer amount of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object when detecting that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition includes: When the motion parameter of the interactive operation meets a preset motion condition and the relative position information meets a preset position condition, a transfer of the target resource transfer amount of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
5. The method according to claim 1, characterized in that When the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, based on the target resource transfer quantity input by the first object, displaying a confirmation transfer prompt message on the video session page includes: When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, an augmented reality area is displayed on the video session page, where the augmented reality area includes at least one virtual input control; In response to a triggering operation of the first object on a target virtual input control in the augmented reality area, determining a target resource transfer quantity input by the first object; Based on the target resource transfer quantity input by the first object, a transfer confirmation prompt message is displayed on the video session page.
6. The method according to claim 1, characterized in that When the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, based on the target resource transfer quantity input by the first object, displaying a confirmation transfer prompt message on the video session page includes: When the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, in response to the voice input operation of the first object on the video session page, extracting semantic feature information from the input voice information; Determining the target resource transfer quantity according to the semantic feature information; Based on the target resource transfer quantity, a transfer confirmation prompt message is displayed on the video session page.
7. The method according to claim 1, characterized in that When the identity authentication of the first object is successful and it is detected that the action of the first object in the first video screen meets the resource transfer triggering condition, based on the target resource transfer quantity input by the first object, displaying a confirmation transfer prompt message on the video session page includes: When the identities of the first object and the second object are successfully authenticated, performing action recognition on the first object in the first video screen; When it is recognized that the action of the first object meets the resource transfer triggering condition, based on the target resource transfer quantity input by the first object, confirmation transfer prompt information is displayed on the video session page.
8. The method according to claim 7, characterized in that The method further comprises: collecting palm print information of the second object from the second video screen; Based on the palm print information of the second object, identity authentication is performed on the second object.
9. A resource transfer device based on interactive operation, characterized in that: include: a display unit, configured to display a video session page of a target session, the video session page comprising a first video screen corresponding to a first object and a second video screen corresponding to a second object in the target session, the first object and the second object being session members of the target session, the first video screen comprising a real-time screen corresponding to a scene where the first object is located, and the second video screen comprising a real-time screen corresponding to a scene where the second object is located; A collection unit, configured to collect palm print information of the first object from the first video frame; an authentication unit, configured to perform identity authentication on the first object based on the palmprint information; a transfer unit, configured to display a transfer confirmation prompt message on the video session page based on a target resource transfer amount input by the first object when the identity authentication of the first object succeeds and it is detected that the action of the first object in the first video screen meets a resource transfer trigger condition, wherein the target resource transfer amount is an amount that the first object needs to pay; Based on the confirmation transfer prompt information, detecting interactive operation information between the first object and the second object; When it is detected that the interactive operation information between the first object and the second object meets a preset transfer confirmation condition, a transfer of the target resource transfer quantity of virtual resources from the virtual resource account of the first object to the virtual resource account of the second object is triggered.
10. An electronic device, characterized in that: It comprises a memory and a processor; the memory stores an application program, and the processor is used to run the application program in the memory to execute the operations in the resource transfer method based on interactive operation as described in any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the interactive operation-based resource transfer method according to any one of claims 1 to 8.
12. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the resource transfer method based on interactive operation described in any one of claims 1 to 8 are implemented.
Citation Information
Patent Citations
Virtual object control method and device in live video and storage medium
CN110850983A
Method and system for associating biological characteristics with virtual resources and non-transitory storage medium
CN111355722A
User identity recognition method, device and equipment and medium thereof
CN111667275A
Virtual resource transfer method and device, storage medium and electronic equipment
CN111881276A
Virtual article interaction method
CN113542653A
