Fund processing method and device, electronic equipment and computer readable medium

By using transparent display screen and virtual keyboard in bank withdrawal system, the security risks of penetrating and leaking in bank card password input in the prior art are solved, achieving higher security and lower risk of password leakage.

CN119579161APending Publication Date: 2025-03-07CHINA CONSTRUCTION BANK +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411657232.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-19
Publication Date
2025-03-07

AI Technical Summary

Technical Problem

In the existing bank withdrawal methods, customers need to enter their bank card password on the physical keyboard, which poses a risk of being peeped at by others and leaked fingerprints, and poses a security risk.

Method used

By obtaining the amount of money processing in response to identity authentication, the amount processing amount is obtained, and the money processing system interface is displayed on the transparent display; it detects that the user's limbs interact with the money processing system interface on the transparent display, and determines the interactive location; displays the virtual keyboard at the interactive location, recognizes the user's operation on the virtual keyboard, determines the money processing password based on the operation and sends it to the money processing node.

Benefits of technology

It improves the security when processing money and reduces the risk of leaking payment passwords.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119579161A_ABST
    Figure CN119579161A_ABST
Patent Text Reader

Abstract

The invention discloses a fund processing method and device, electronic equipment and a computer readable medium, and relates to the technical field of big data processing, and the method comprises the steps: obtaining a fund processing amount in response to the passing of identity authentication, and displaying a fund processing system interface on a transparent display screen; in response to the detection that the limbs of the user interact with the fund processing system interface on the transparent display screen, determining an interaction position; displaying the virtual keyboard at the interaction position, and identifying the category of a first operation of the user on the virtual keyboard; executing a corresponding instruction based on the category, further identifying a second operation of the user on the virtual keyboard, determining a fund processing password according to the second operation, and sending the fund processing password to the fund processing node; and in response to the received password confirmation information sent by the fund processing node, executing user identity rechecking, and in response to the passing of the user identity rechecking, executing corresponding fund processing based on the fund processing amount. The security during fund processing is improved, and the password leakage risk is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of big data processing technology, and in particular to a payment processing method, device, electronic device and computer-readable medium. Background Art

[0002] At present, in online banking, customers can enjoy a variety of services, such as transfers, account inquiries, loan applications, and financial investment, but withdrawal services are not yet included. The existing bank withdrawal methods include customers withdrawing money through bank branches or ATMs. Customers need to bring their bank cards and ID cards to the counter or ATM and use their bank cards and ID cards to verify their identities. After the identity verification is passed, enter the withdrawal amount on the physical keyboard. After confirming the transaction, the bank system will deduct the corresponding amount from the customer's account and issue cash to the customer. Customers need to bring their ID cards and bank cards. Forgetting to bring both will result in the inability to withdraw money. If you go to the counter to withdraw money or ask common questions, you may have to spend a lot of time queuing. Entering the bank card password on the physical keyboard is at risk of being peeped by others and leaking fingerprints, which poses a security risk. Summary of the invention

[0003] In view of this, the embodiments of the present application provide a method, device, electronic device and computer-readable medium for processing funds, which can solve the problem that the bank card password is input on a physical keyboard when withdrawing money, which is at risk of being spied on and fingerprints leaked by others, and poses a security risk.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present application, a payment processing method is provided, comprising:

[0005] In response to the identity authentication being passed, the payment processing amount is obtained, and the payment processing system interface is displayed on the transparent display screen;

[0006] In response to detecting that a user's body interacts with the payment processing system interface on the transparent display screen, determining an interaction position;

[0007] Displaying a virtual keyboard at an interactive position, and identifying a category of a first operation performed by a user on the virtual keyboard;

[0008] Execute corresponding instructions based on the category, thereby identifying the second operation of the user on the virtual keyboard, determining the payment processing password according to the second operation and sending it to the payment processing node;

[0009] In response to receiving the password confirmation information sent by the payment processing node, a user identity review is performed, and in response to the user identity review being passed, corresponding payment processing is performed based on the payment processing amount.

[0010] Optionally, before obtaining the payment processing amount, the method further includes:

[0011] Start the camera to capture the user's iris information and start the microphone to capture the user's voiceprint information;

[0012] Extracting a first target feature of the iris information and extracting a second target feature of the voiceprint information;

[0013] The first target feature and the second target feature are sent to the payment processing node, and matching result data returned by the payment processing node is received. In response to the matching result data corresponding to a successful match, it is determined that the identity authentication is passed.

[0014] Optionally, determining an interaction location includes:

[0015] Measuring the horizontal distance of the limb interacting with the payment processing system interface on the transparent display screen and the vertical distance of the limb to the ground;

[0016] Determine the interaction position based on the horizontal distance and vertical distance.

[0017] Optionally, before displaying the virtual keyboard at the interaction position, the method further includes:

[0018] Generates a virtual keyboard with random order.

[0019] Optionally, identifying a category of a first operation performed by the user on the virtual keyboard includes:

[0020] Identifies the categories of gestures that the user makes on the virtual keyboard.

[0021] Optionally, determining the payment processing password according to the second operation includes:

[0022] The timestamp when the user's body clicks on the characters on the virtual keyboard is obtained, and the payment processing password is determined based on the clicked characters on the virtual keyboard and the corresponding timestamp.

[0023] In addition, the present application also provides a payment processing device, including:

[0024] A display unit is configured to obtain the payment processing amount in response to the identity authentication being passed, and display the payment processing system interface on the transparent display screen;

[0025] An interaction unit, configured to determine an interaction position in response to detecting that a user's body interacts with the payment processing system interface on the transparent display screen;

[0026] an identification unit, configured to display the virtual keyboard at the interaction position and identify a category of a first operation performed by the user on the virtual keyboard;

[0027] a sending unit configured to execute a corresponding instruction based on the category, thereby identifying a second operation of the user on the virtual keyboard, determining a payment processing password according to the second operation, and sending the password to the payment processing node;

[0028] The payment processing unit is configured to perform user identity review in response to receiving password confirmation information sent by the payment processing node, and in response to passing the user identity review, perform corresponding payment processing based on the payment processing amount.

[0029] Optionally, the device further includes an identity authentication unit configured to:

[0030] Start the camera to capture the user's iris information and start the microphone to capture the user's voiceprint information;

[0031] Extracting a first target feature of the iris information and extracting a second target feature of the voiceprint information;

[0032] The first target feature and the second target feature are sent to the payment processing node, and matching result data returned by the payment processing node is received. In response to the matching result data corresponding to a successful match, it is determined that the identity authentication is passed.

[0033] Optionally, the interaction unit is further configured to:

[0034] Measuring the horizontal distance of the limb interacting with the payment processing system interface on the transparent display screen and the vertical distance of the limb to the ground;

[0035] Determine the interaction position based on the horizontal distance and vertical distance.

[0036] Optionally, the device further includes a virtual keyboard generating unit configured to:

[0037] Generates a virtual keyboard with random order.

[0038] Optionally, the identification unit is further configured to:

[0039] Identifies the categories of gestures that the user makes on the virtual keyboard.

[0040] Optionally, the sending unit is further configured to:

[0041] The timestamp when the user's body clicks on the characters on the virtual keyboard is obtained, and the payment processing password is determined based on the clicked characters on the virtual keyboard and the corresponding timestamp.

[0042] In addition, the present application also provides a payment processing electronic device, including: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by one or more processors, the one or more processors implement the payment processing method as described above.

[0043] In addition, the present application also provides a computer-readable medium on which a computer program is stored, and when the program is executed by a processor, the payment processing method as described above is implemented.

[0044] To achieve the above objective, according to another aspect of the embodiments of the present application, a computer program product is provided.

[0045] A computer program product according to an embodiment of the present application includes a computer program, and when the program is executed by a processor, the payment processing method provided by the embodiment of the present application is implemented.

[0046] One embodiment of the above invention has the following advantages or beneficial effects: the present application obtains the payment processing amount in response to identity authentication passing, and displays the payment processing system interface on the transparent display screen; determines the interaction position in response to detecting that the user's body interacts with the payment processing system interface on the transparent display screen; displays the virtual keyboard at the interaction position, identifies the category of the user's first operation on the virtual keyboard; executes the corresponding instruction based on the category, and then identifies the user's second operation on the virtual keyboard, determines the payment processing password according to the second operation and sends it to the payment processing node; executes the user identity review in response to receiving the password confirmation information sent by the payment processing node, and executes the corresponding payment processing based on the payment processing amount in response to the user identity review passing. Thereby, the security when performing payment processing (such as withdrawal) is improved, and the risk of password leakage of payment processing (such as withdrawal) is reduced.

[0047] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The accompanying drawings are used to better understand the present application and do not constitute an improper limitation on the present application.

[0049] Figure 1 is a schematic diagram of the main process of a payment processing method according to an embodiment of the present application;

[0050] Figure 2 is a schematic diagram of the main process of a payment processing method according to an embodiment of the present application;

[0051] Figure 3 This is a schematic diagram of an application scenario of a payment processing method according to an embodiment of the present application;

[0052] Figure 4 This is a schematic diagram of the main process of identity authentication of a payment processing method according to an embodiment of the present application;

[0053] Figure 5It is a schematic diagram of the main process of identifying the position of a hand on a virtual keyboard according to a payment processing method of an embodiment of the present application;

[0054] Figure 6 It is a schematic diagram of the main flow of keyboard input recognition of a payment processing method according to an embodiment of the present application;

[0055] Figure 7 This is a schematic diagram of a process flow related to a server returning a withdrawal result in a payment processing method according to an embodiment of the present application;

[0056] Figure 8 is a schematic diagram of the main units of the payment processing device according to an embodiment of the present application;

[0057] Fig. 9 is an exemplary system architecture diagram to which the embodiments of the present application can be applied;

[0058] Fig.10 It is a structural diagram of a computer system of a terminal device or server suitable for implementing an embodiment of the present application. DETAILED DESCRIPTION

[0059] The following is a description of the exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, and they should be considered as merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of known functions and structures is omitted in the following description. It should be noted that the acquisition, transmission, storage, use, and processing of data in the technical solution of the present application are in compliance with the relevant provisions of national laws and regulations. It should be noted that in the embodiments of the present application, certain software, components, models, and other existing solutions in the industry may be mentioned, which should be considered as exemplary, and their purpose is only to illustrate the feasibility of the implementation of the technical solution of the present application, but it does not mean that the applicant has or must have used the solution. In the technical solution of the present application, the collection, analysis, use, transmission, storage, and other aspects of the user's personal information involved are in compliance with the provisions of relevant laws and regulations, and are used for legal and reasonable purposes, and are not shared, leaked, or sold outside of these legal uses, and are subject to supervision and management by regulatory authorities. Take necessary measures to prevent illegal access to such personal information, ensure that persons with access to personal information comply with relevant laws and regulations, and ensure the security of personal information. Once such personal information is no longer needed, risks should be minimized by limiting or even prohibiting data collection and / or deleting data.

[0060] When used, including in certain related applications, user privacy is protected by de-identifying data, such as by removing specific identifiers when used, controlling the amount or specificity of data stored, controlling how data is stored, and / or other methods of de-identification.

[0061] Figure 1 is a schematic diagram of the main process of the payment processing method according to an embodiment of the present application, such as Figure 1 As shown, the payment processing method mainly includes the following steps S101 to S105.

[0062] Step S101, in response to identity authentication being passed, obtaining the payment processing amount, and displaying the payment processing system interface on the transparent display screen.

[0063] In this embodiment, the execution subject of the payment processing method (for example, it can be a server of a mixed reality-based withdrawal system, and the mixed reality-based withdrawal system can control the operation of the mixed reality device and the bank system to interact with the user to realize payment processing) can receive the payment processing request through a wired connection or a wireless connection, and perform identity authentication based on the user information carried in the payment processing request. For example, the user information carried in the payment processing request may include the user's iris image, voiceprint feature information, etc. For example, when the user wears a mixed reality device, the execution subject can start the camera of the mixed reality device to capture the user's iris information and voiceprint information, extract the relevant iris features and voiceprint features, and send the extracted iris features and voiceprint features to the bank system for identity authentication. When the identity authentication is passed, the execution subject can obtain the payment processing amount carried in the payment processing request, and display the payment processing system interface (for example, the withdrawal system interface) returned by the bank system on the transparent display screen mapped by the mixed reality device.

[0064] The transparent display can only be seen by the user wearing the corresponding mixed reality device, which protects the user's privacy and improves the security of money processing. The mixed reality device corresponds to the transparent display one by one. For example, when a user wears mixed reality device A, he can see transparent display A, but cannot see transparent display B. Transparent display B can be seen by the user wearing mixed reality device B, thereby effectively protecting the user's privacy and improving the security of money processing.

[0065] Specifically, before obtaining the payment processing amount, the method also includes: starting the camera to capture the user's iris information and starting the microphone to capture the user's voiceprint information; extracting the first target feature of the iris information, and extracting the second target feature of the voiceprint information; sending the first target feature and the second target feature to the payment processing node, and receiving the matching result data returned by the payment processing node, and in response to the matching result data corresponding to a successful match, determining that the identity authentication is passed.

[0066] For example, the first target feature is the iris feature corresponding to the iris information, such as iris color feature, iris size feature, etc., and the second target feature is the voiceprint feature corresponding to the voiceprint information, such as timbre feature, sound intensity feature, sound length feature, pitch feature, etc. The iris feature and voiceprint feature are sent to the payment processing node (such as a bank system), and the payment processing node (such as a bank system) compares and matches the iris feature and voiceprint feature with the pre-stored feature template, and determines that the identity authentication is passed when the match is successful. This improves the security of payment processing.

[0067] Step S102, in response to detecting that the user's body interacts with the payment processing system interface on the transparent display screen, determining an interaction position.

[0068] The user's limbs, such as the user's hands, elbows, etc. When the user's limbs touch (i.e. interact with) the payment processing system interface on the transparent display screen that only the user can see, the execution subject can call the positioning program to determine the interactive position of the user's limbs relative to the transparent display screen, so as to generate a virtual keyboard in a suitable position to facilitate user operation.

[0069] Step S103: displaying a virtual keyboard at the interaction position, and identifying the category of the first operation of the user on the virtual keyboard.

[0070] Specifically, before displaying the virtual keyboard at the interaction position, the method further includes: generating a randomly arranged virtual keyboard.

[0071] After determining the interaction position, a randomly arranged virtual keyboard is generated, which can enhance the security of the user's password input and improve the security of payment processing.

[0072] Specifically, identifying the category of the first operation performed by the user on the virtual keyboard includes: identifying the category of a gesture performed by the user on the virtual keyboard.

[0073] The categories of the first operation of the user on the virtual keyboard may include a selection operation, a click operation, a drag operation, a zoom operation, and the like.

[0074] Step S104, executing corresponding instructions based on the category, and then identifying the second operation of the user on the virtual keyboard, determining the payment processing password according to the second operation and sending it to the payment processing node.

[0075] After determining the category of the user's first operation on the virtual keyboard, the implementation instructions of the operation corresponding to the determined category can be executed to quickly and accurately adjust the payment processing interface to the state required by the user, so as to promptly respond to the user's second operation on the virtual keyboard, such as a password input operation. According to the characters corresponding to the user's second operation on the virtual keyboard and the time of interaction with the characters, the payment processing password corresponding to this payment processing is determined and sent to the payment processing node in time for corresponding payment processing, thereby improving the security and efficiency of payment processing.

[0076] Specifically, determining the payment processing password according to the second operation includes: obtaining a timestamp when the user's body clicks on characters on the virtual keyboard, and determining the payment processing password based on the clicked characters on the virtual keyboard and the corresponding timestamp.

[0077] For example, characters include numbers and letters. Each timestamp contains a trusted time value. The execution subject can sort the trusted time values ​​contained in the timestamp according to the order of occurrence, and determine the payment processing password according to the characters corresponding to the sorted trusted time values, thereby improving the efficiency and accuracy of determining the payment processing password.

[0078] Step S105, in response to receiving the password confirmation information sent by the payment processing node, performing user identity review, and in response to passing the user identity review, performing corresponding payment processing based on the payment processing amount.

[0079] To perform user identity verification, the camera of the mixed reality device is activated again to capture the user's iris image, and the microphone of the mixed reality device is activated again to capture the user's voiceprint information. The user identity is verified based on the obtained iris image and voiceprint information of the user, and after the user identity verification is passed, the corresponding payment processing is performed based on the payment processing amount, for example, the ATM is notified to dispense cash.

[0080] In this embodiment, in response to identity authentication passing, the payment processing amount is obtained, and the payment processing system interface is displayed on the transparent display screen; in response to detecting that the user's body interacts with the payment processing system interface on the transparent display screen, the interaction position is determined; a virtual keyboard is displayed at the interaction position, and the category of the user's first operation on the virtual keyboard is identified; based on the category, the corresponding instruction is executed, and then the user's second operation on the virtual keyboard is identified, and the payment processing password is determined according to the second operation and sent to the payment processing node; in response to receiving the password confirmation information sent by the payment processing node, the user identity is reviewed, and in response to the user identity review passing, the corresponding payment processing is performed based on the payment processing amount. Thereby, the security of payment processing (such as withdrawal) is improved, and the risk of password leakage of payment processing (such as withdrawal) is reduced.

[0081] Figure 2 is a schematic diagram of the main flow of a payment processing method according to an embodiment of the present application, such as Figure 2 As shown, the payment processing method mainly includes the following steps S201 to S206.

[0082] Step S201, in response to identity authentication being passed, obtaining the payment processing amount, and displaying the payment processing system interface on the transparent display screen.

[0083] The payment processing amount can be the amount to be paid in the self-service shopping settlement scenario. When the execution entity determines that the identity authentication is passed and obtains the payment processing amount, the payment processing system interface (such as the self-service shopping payment interface) can be displayed on a transparent display screen that is only visible to the user who has passed the identity authentication, so as to facilitate the user to settle the payment.

[0084] Step S202, in response to detecting that the user's limb interacts with the payment processing system interface on the transparent display screen, measuring the horizontal distance of the limb interacting with the payment processing system interface on the transparent display screen and the vertical distance from the limb to the ground.

[0085] If it is detected that the user's limbs, such as hands or elbows, are in contact with the payment processing system interface on the transparent display screen, it is determined that the user has interacted with the payment processing system interface on the transparent display screen, and the measurement program is immediately started to measure the horizontal distance from the payment processing interface to the limb that interacted with the payment processing system interface on the transparent display screen and the vertical distance from the limb to the ground.

[0086] Step S203: determining the interaction position according to the horizontal distance and the vertical distance.

[0087] For example, when the horizontal distance between the user's limbs and the payment processing system interface on the transparent display screen is less than a preset distance threshold, the response of the payment processing system interface can be directly triggered. The horizontal distance measured in the embodiment of the present application is the distance that can trigger the response of the payment processing system interface, and the distance can be equal to the preset distance threshold. Specifically, the execution body can use the position of the user's standing feet as the coordinate origin, measure the horizontal distance from the coordinate origin to the payment processing interface, and then use the horizontal distance from the coordinate origin to the payment processing interface to subtract the horizontal distance from the payment processing interface to the limb that interacts with the payment processing system interface on the transparent display screen to determine the horizontal coordinate, and obtain the vertical coordinate based on the vertical distance from the limb to the ground. The interaction position can be accurately determined based on the horizontal coordinate and the vertical coordinate.

[0088] In some embodiments, the execution subject can directly use the position of the user's standing foot as the coordinate origin, measure the horizontal distance between the limb that interacts with the payment processing system interface on the transparent display screen and the coordinate origin to obtain the horizontal coordinate, and obtain the vertical coordinate based on the vertical distance from the limb to the ground, and accurately determine the interaction position based on the horizontal coordinate and the vertical coordinate. It is understandable that the embodiment of the present application does not specifically limit the coordinate origin, which can be the position of the user's standing foot, or any other reasonable position such as the shoulder position.

[0089] Step S204: display a virtual keyboard at the interaction position, and identify the category of the first operation of the user on the virtual keyboard.

[0090] By displaying the virtual keyboard at the determined interaction position, the user's first operation on the virtual keyboard can be facilitated, and the category of the user's first operation on the virtual keyboard can be identified through the user's operation trajectory, such as selection operation, click operation, drag operation and zoom operation.

[0091] Step S205, executing corresponding instructions based on the category, and then identifying the second operation of the user on the virtual keyboard, determining the payment processing password according to the second operation and sending it to the payment processing node.

[0092] When a user tapping operation on the virtual keyboard is detected, it is determined that the user has performed a second operation on the virtual keyboard, and the sorting function is turned on in time to obtain the characters and time corresponding to each tapping operation, and sort them based on time to determine the payment processing password and send it to the payment processing node.

[0093] Step S206, in response to receiving the password confirmation information sent by the payment processing node, performing user identity review, and in response to passing the user identity review, performing corresponding payment processing based on the payment processing amount.

[0094] In the self-service shopping settlement scenario, the execution entity can detect in real time or at preset intervals whether the payment processing node (such as the bank system) has sent the password confirmation information. If the password confirmation information sent by the payment processing node is detected, the payment control of the bank system can be called to execute the payment operation to ensure the security of the payment.

[0095] Figure 3 Schematic diagram of an application scenario of a payment processing method according to an embodiment of the present application. Figure 3As shown, taking withdrawal as an example, the withdrawal system based on mixed reality involves users, mixed reality devices and bank systems. Specifically, the withdrawal operation based on mixed reality integrates mixed reality, computer vision and sensing technology to provide users with a convenient and safe withdrawal experience. Users can perform withdrawal operations in the virtual interface by wearing mixed reality devices. The bank system implements identity authentication through voice and iris recognition; the server of the bank system transmits the withdrawal system interface to the mixed reality device, and the processor in the mixed reality device renders and projects the withdrawal system interface; the withdrawal system based on mixed reality tracks the user's hand position and distance through sensors, recognizes different gestures such as clicks and slides through computer vision algorithms, and recognizes key input by mapping the movement of fingers to the corresponding position of the virtual keyboard; data encryption transmission is used to ensure the security of the interaction between the virtual keyboard input and the server; through the intuitive mixed reality interface, users can more conveniently perform withdrawal operations without the need for traditional physical touch screens or keyboards, providing users with a safer, more convenient and flexible financial service experience.

[0096] Figure 4 1 is a schematic diagram of the main flow of identity authentication in a payment processing method according to an embodiment of the present application. Figure 4 As shown, taking the withdrawal of funds as an example, the identity authentication process: the user identity authentication process in the withdrawal method based on mixed reality technology is as follows: First, the camera is started through the mixed reality device to capture the user's iris image, and the microphone is started to remind the user to read a randomly generated phrase, capture the user's voiceprint information, and extract the relevant iris and voiceprint features. Then, the extracted iris and voiceprint feature information is sent to the bank system. When the bank system receives the iris and voiceprint features, it compares them with the pre-stored feature templates. If the comparison is successful, the bank system returns the withdrawal system page, which is rendered by the mixed reality device and superimposed on the transparent display.

[0097] Figure 5 FIG. 1 is a schematic diagram of the main flow of identifying the position of a hand on a virtual keyboard according to a payment processing method of an embodiment of the present application. Figure 5 As shown, when the user needs to enter the withdrawal password on the virtual keyboard, the system needs to identify which key the user presses, specifically, identify the position of the hand on the virtual keyboard. The identification process is as follows: Start the camera: The mixed reality device starts the camera and measures the distance from the mixed reality device to the user's hand. Generate and present a random virtual keyboard: The device generates a randomly arranged virtual keyboard and displays it on a horizontal plane at elbow height. Fingertip recognition: The device uses computer vision technology to identify the user's fingertip position. Key confirmation: Use computer vision technology to accurately identify the key where the user's fingertip rests. Output the mapping relationship between the fingertip and the keyboard.

[0098] Figure 6FIG. 1 is a schematic diagram of the main flow of keyboard input recognition of a payment processing method according to an embodiment of the present application. Figure 6 As shown, keyboard input recognition: The process of identifying user key input through a mixed reality device is as follows: First, the camera (i.e., camera) is started through the mixed reality device, and the mixed reality device tracks the movement trajectory of the user's fingertips on the virtual keyboard through the camera. Then, using the machine learning algorithm, the mixed reality device classifies the captured fingertip movements, and according to the recognized gestures, the device performs corresponding operations, such as selection, click, drag, zoom, etc. Finally, the user input is completed, and the recognition result is sent to the bank system server in encrypted form. For example, the device finally encrypts and transmits the recognized input (such as password, amount, etc.) and the timestamp and location obtained by the system to the bank system server.

[0099] Figure 7 FIG. 1 is a schematic diagram of a flow chart of a server returning a withdrawal result according to a payment processing method according to an embodiment of the present application. Figure 7 As shown, when the bank system receives the withdrawal password entered by the user, it sends confirmation information to the mixed reality device to confirm whether the transaction is confirmed. The mixed reality device presents the user with a confirmation information page that requires voice confirmation, prompting the user to make a voice confirmation. After receiving the user's confirmation voice, the mixed reality device scans and collects the user's iris information again, and sends the voice and iris features to the bank system. The bank system conducts a user identity review: the iris and voice are used to verify the identity information again. After the identity authentication is successful, the bank system notifies the ATM to issue the corresponding amount of cash. After the ATM issues cash, the transaction details, including time, place and amount, are returned to the bank system. The transaction notification is then forwarded to the mixed reality device through the bank system, and the transaction notification is then presented through the mixed reality device. ATM (Automated Teller Machine) is an electronic device used to perform financial transactions.

[0100] The embodiment of the present application utilizes mixed reality technology to develop a bank withdrawal system, and customers do not need to carry their ID cards and bank cards; customers can see the virtual interface by wearing mixed reality devices, other people cannot see the virtual interface, and password input operations are also safer.

[0101] Figure 8 Schematic diagram of the main units of the payment processing device according to the embodiment of the present application. Figure 8 As shown, the payment processing device 800 includes a display unit 801 , an interaction unit 802 , an identification unit 803 , a sending unit 804 and a payment processing unit 805 .

[0102] The display unit 801 is configured to obtain the payment processing amount in response to the identity authentication being passed, and display the payment processing system interface on the transparent display screen.

[0103] The interaction unit 802 is configured to determine an interaction position in response to detecting that a user's body interacts with the payment processing system interface on the transparent display screen.

[0104] The identification unit 803 is configured to display the virtual keyboard at the interaction position and identify the category of the first operation of the user on the virtual keyboard.

[0105] The sending unit 804 is configured to execute corresponding instructions based on the category, thereby identifying the second operation of the user on the virtual keyboard, determining the payment processing password according to the second operation, and sending it to the payment processing node.

[0106] The payment processing unit 805 is configured to perform user identity review in response to receiving the password confirmation information sent by the payment processing node, and in response to passing the user identity review, perform corresponding payment processing based on the payment processing amount.

[0107] In some embodiments, the payment processing device further includes Figure 8 The identity authentication unit not shown in the figure is configured to: start the camera to capture the user's iris information and start the microphone to capture the user's voiceprint information; extract the first target feature of the iris information and the second target feature of the voiceprint information; send the first target feature and the second target feature to the payment processing node, and receive the matching result data returned by the payment processing node, and determine that the identity authentication is passed in response to the matching result data corresponding to a successful match.

[0108] In some embodiments, the interaction unit 802 is further configured to: measure the horizontal distance of the limb interacting with the payment processing system interface on the transparent display screen and the vertical distance from the limb to the ground; and determine the interaction position based on the horizontal distance and the vertical distance.

[0109] In some embodiments, the payment processing device further includes Figure 8 The virtual keyboard generating unit not shown in the figure is configured to generate a randomly arranged virtual keyboard.

[0110] In some embodiments, the recognition unit 803 is further configured to: recognize the category of the gesture made by the user on the virtual keyboard.

[0111] In some embodiments, the sending unit 804 is further configured to: obtain a timestamp when the user's body clicks on a character on the virtual keyboard, and determine the payment processing password based on the clicked character on the virtual keyboard and the corresponding timestamp.

[0112] It should be noted that the payment processing method and payment processing device of the present application have a corresponding relationship in terms of specific implementation content, so the repeated content will not be explained again.

[0113] Fig. 9 An exemplary system architecture 900 is shown to which the payment processing method or payment processing device according to the embodiments of the present application can be applied.

[0114] like Fig. 9 As shown, system architecture 900 may include terminal devices 901, 902, 903, network 904 and server 905. Network 904 is used to provide a medium for communication links between terminal devices 901, 902, 903 and server 905. Network 904 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0115] Users can use terminal devices 901, 902, 903 to interact with server 905 through network 904 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 901, 902, 903, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

[0116] The terminal devices 901, 902, 903 may be various electronic devices having a payment processing screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0117] Server 905 may be a server that provides various services, such as a background management server that provides support for payment processing requests submitted by users using terminal devices 901, 902, and 903 (only as an example). In response to identity authentication passing, the background management server may obtain the payment processing amount and display the payment processing system interface on the transparent display screen; in response to detecting that the user's body interacts with the payment processing system interface on the transparent display screen, determine the interaction position; display the virtual keyboard at the interaction position, identify the category of the user's first operation on the virtual keyboard; execute the corresponding instruction based on the category, and then identify the user's second operation on the virtual keyboard, determine the payment processing password based on the second operation and send it to the payment processing node; in response to receiving the password confirmation information sent by the payment processing node, perform user identity review, and in response to the user identity review passing, perform corresponding payment processing based on the payment processing amount. Thereby improving the security when performing payment processing (such as withdrawal) and reducing the risk of password leakage of payment processing (such as withdrawal).

[0118] It should be noted that the payment processing method provided in the embodiment of the present application is generally executed by the server 905 , and accordingly, the payment processing device is generally set in the server 905 .

[0119] It should be understood that Fig. 9 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0120] Reference below Fig.10 , which shows a schematic diagram of the structure of a computer system 1000 of a terminal device suitable for implementing an embodiment of the present application. Fig.10 The terminal device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0121] like Fig.10 As shown, the computer system 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage part 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the computer system 1000 are also stored. The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0122] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0123] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1009, and / or installed from the removable medium 1011. When the computer program is executed by the central processing unit (CPU) 1001, the above-mentioned functions defined in the system of the present application are executed.

[0124] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. Computer-readable storage media may include, for example, but are not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0125] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0126] The units involved in the embodiments described in the present application may be implemented by software or hardware. The units described may also be set in a processor, for example, it may be described as: a processor includes a display unit, an interaction unit, an identification unit, a sending unit, and a payment processing unit. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0127] As another aspect, the present application also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently and not be assembled into the device. The above computer-readable medium carries one or more programs. When the above one or more programs are executed by a device, the device responds to identity authentication passing, obtains the payment processing amount, and displays the payment processing system interface on the transparent display screen; responds to detecting that the user's body interacts with the payment processing system interface on the transparent display screen, determines the interaction position; displays the virtual keyboard at the interaction position, identifies the category of the user's first operation on the virtual keyboard; executes corresponding instructions based on the category, and then identifies the user's second operation on the virtual keyboard, determines the payment processing password according to the second operation and sends it to the payment processing node; responds to receiving the password confirmation information sent by the payment processing node, performs user identity review, and responds to the user identity review passing, performs corresponding payment processing based on the payment processing amount.

[0128] The computer program product of the present application includes a computer program, and when the computer program is executed by a processor, the payment processing method in the embodiment of the present application is implemented.

[0129] According to the technical solution of the embodiment of the present application, the security of money processing (such as withdrawal) can be improved and the risk of password leakage during money processing (such as withdrawal) can be reduced.

[0130] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A payment processing method, characterized in that: include: In response to the identity authentication being passed, the payment processing amount is obtained, and the payment processing system interface is displayed on the transparent display screen; In response to detecting that a user's body interacts with the payment processing system interface on the transparent display screen, determining an interaction position; Displaying a virtual keyboard at the interaction position, and identifying a category of a first operation performed by a user on the virtual keyboard; executing corresponding instructions based on the categories, thereby identifying a second operation of the user on the virtual keyboard, determining a payment processing password according to the second operation and sending the password to the payment processing node; In response to receiving the password confirmation information sent by the payment processing node, a user identity review is performed, and in response to the user identity review being passed, corresponding payment processing is performed based on the payment processing amount.

2. The method according to claim 1, characterized in that: Before obtaining the payment processing amount, the method further includes: Start the camera to capture the user's iris information and start the microphone to capture the user's voiceprint information; Extracting a first target feature of the iris information, and extracting a second target feature of the voiceprint information; The first target feature and the second target feature are sent to a payment processing node, and matching result data returned by the payment processing node is received. In response to the matching result data corresponding to a successful match, it is determined that the identity authentication is passed.

3. The method according to claim 1, characterized in that The determining of the interaction position includes: Measuring the horizontal distance of the limb interacting with the payment processing system interface on the transparent display screen and the vertical distance of the limb to the ground; An interaction position is determined according to the horizontal distance and the vertical distance.

4. The method according to claim 1, characterized in that Before displaying the virtual keyboard at the interaction position, the method further includes: Generates a virtual keyboard with random order.

5. The method according to claim 1, characterized in that The identifying the category of the first operation of the user on the virtual keyboard includes: A category of a gesture performed by a user on the virtual keyboard is identified.

6. The method according to claim 1, characterized in that The determining the payment processing password according to the second operation includes: The timestamp when the user's body clicks on the characters on the virtual keyboard is obtained, and the payment processing password is determined based on the clicked characters on the virtual keyboard and the corresponding timestamp.

7. A payment processing device, characterized in that: include: A display unit is configured to obtain the payment processing amount in response to the identity authentication being passed, and display the payment processing system interface on the transparent display screen; an interaction unit, configured to determine an interaction position in response to detecting that a user's body interacts with the payment processing system interface on the transparent display screen; an identification unit, configured to display a virtual keyboard at the interaction position and identify a category of a first operation performed by a user on the virtual keyboard; a sending unit configured to execute a corresponding instruction based on the category, thereby identifying a second operation of the user on the virtual keyboard, determining a payment processing password according to the second operation, and sending the password to a payment processing node; The payment processing unit is configured to perform user identity review in response to receiving password confirmation information sent by the payment processing node, and in response to passing the user identity review, perform corresponding payment processing based on the payment processing amount.

8. The device according to claim 7, characterized in that The device also includes an identity authentication unit configured to: Start the camera to capture the user's iris information and start the microphone to capture the user's voiceprint information; Extracting a first target feature of the iris information, and extracting a second target feature of the voiceprint information; The first target feature and the second target feature are sent to a payment processing node, and matching result data returned by the payment processing node is received. In response to the matching result data corresponding to a successful match, it is determined that the identity authentication is passed.

9. The device according to claim 7, characterized in that The interaction unit is further configured to: Measuring the horizontal distance of the limb interacting with the payment processing system interface on the transparent display screen and the vertical distance of the limb to the ground; An interaction position is determined according to the horizontal distance and the vertical distance.

10. The device according to claim 7, characterized in that The device also includes a virtual keyboard generating unit, which is configured to: Generates a virtual keyboard with random order.

11. The device according to claim 7, characterized in that The identification unit is further configured to: A category of a gesture performed by a user on the virtual keyboard is identified.

12. The device according to claim 7, characterized in that The sending unit is further configured to: The timestamp when the user's body clicks on the characters on the virtual keyboard is obtained, and the payment processing password is determined based on the clicked characters on the virtual keyboard and the corresponding timestamp.

13. An electronic device for processing money, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.

14. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.